2024-05-08T04:09:59.829 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T04:09:59.829 DEBUG:teuthology.run:Teuthology command: teuthology --name neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi --verbose --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} --owner scheduled_neesingh@teuthology --archive /home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278 -- /home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278/orig.config.yaml 2024-05-08T04:09:59.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T04:09:59.958 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278 branch: wip-neesingh-testing1-20240507 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} email: neesingh@redhat.com first_in_suite: false job_id: '7697278' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-neesingh-testing1-20240507 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-neesingh-testing1-20240507 sha1: 4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20 owner: scheduled_neesingh@teuthology priority: 50 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4374 sha1: 4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20 sleep_before_teardown: 0 suite: fs:volumes suite_branch: wip-neesingh-testing1-20240507 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLkQZmD4UKgDLUlTN3eD7ez8gWVGDcIG7qap/3Ikrxc4kaLNkn8UTloZTVp6CTSriWeefdhK3HTtCBt4gUTGLKM= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPzmz//D1fxQ0e3NWkqEk9Qr95vHu4nCk7FJj6EKa6srYzFX6mzgDzxX+snfwqWhqGmmdtNtIGZm6ZJG7XVNH2M= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_04:04:15 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T04:09:59.958 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa; will attempt to use it 2024-05-08T04:09:59.959 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa/tasks 2024-05-08T04:09:59.959 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T04:09:59.960 INFO:teuthology.task.internal:Checking packages... 2024-05-08T04:09:59.984 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20' 2024-05-08T04:09:59.985 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T04:09:59.985 INFO:teuthology.packaging:ref: None 2024-05-08T04:09:59.985 INFO:teuthology.packaging:tag: None 2024-05-08T04:09:59.985 INFO:teuthology.packaging:branch: wip-neesingh-testing1-20240507 2024-05-08T04:09:59.985 INFO:teuthology.packaging:sha1: 4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20 2024-05-08T04:09:59.985 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-neesingh-testing1-20240507 2024-05-08T04:10:00.203 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1629.g4f7075d1 2024-05-08T04:10:00.205 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T04:10:00.212 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T04:10:00.212 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T04:10:00.251 INFO:teuthology.task.internal:Saving configuration 2024-05-08T04:10:00.267 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T04:10:00.273 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T04:10:00.297 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 04:05:17.840735', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLkQZmD4UKgDLUlTN3eD7ez8gWVGDcIG7qap/3Ikrxc4kaLNkn8UTloZTVp6CTSriWeefdhK3HTtCBt4gUTGLKM='} 2024-05-08T04:10:00.322 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 04:05:17.841886', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPzmz//D1fxQ0e3NWkqEk9Qr95vHu4nCk7FJj6EKa6srYzFX6mzgDzxX+snfwqWhqGmmdtNtIGZm6ZJG7XVNH2M='} 2024-05-08T04:10:00.322 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T04:10:00.329 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-08T04:10:00.329 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-08T04:10:00.329 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T04:10:00.393 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f172dd9f160>, signals=[15]) 2024-05-08T04:10:00.394 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T04:10:00.400 INFO:teuthology.task.internal:Opening connections... 2024-05-08T04:10:00.400 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:10:00.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T04:10:00.478 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:10:00.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T04:10:00.553 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T04:10:00.560 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-05-08T04:10:00.578 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-05-08T04:10:00.578 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-05-08T04:10:00.633 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-05-08T04:10:00.634 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2024-05-08T04:10:00.634 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-05-08T04:10:00.634 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-05-08T04:10:00.634 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2024-05-08T04:10:00.634 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2024-05-08T04:10:00.634 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T04:10:00.634 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-05-08T04:10:00.634 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2024-05-08T04:10:00.634 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T04:10:00.634 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-05-08T04:10:00.634 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T04:10:00.634 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T04:10:00.634 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T04:10:00.635 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-05-08T04:10:00.658 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2024-05-08T04:10:00.676 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2024-05-08T04:10:00.676 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-05-08T04:10:00.732 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2024-05-08T04:10:00.732 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2024-05-08T04:10:00.732 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2024-05-08T04:10:00.732 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2024-05-08T04:10:00.732 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2024-05-08T04:10:00.733 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2024-05-08T04:10:00.733 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T04:10:00.733 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-05-08T04:10:00.733 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2024-05-08T04:10:00.733 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T04:10:00.733 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2024-05-08T04:10:00.733 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T04:10:00.733 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T04:10:00.733 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T04:10:00.733 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-05-08T04:10:00.891 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T04:10:00.900 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T04:10:00.924 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T04:10:00.924 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2024-05-08T04:10:00.926 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2024-05-08T04:10:00.942 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T04:10:00.948 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T04:10:00.949 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2024-05-08T04:10:00.983 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2024-05-08T04:10:01.070 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T04:10:01.129 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T04:10:01.143 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-05-08T04:10:01.143 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-05-08T04:10:01.144 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T04:10:01.144 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T04:10:01.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:10:01.161 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-05-08T04:10:01.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:10:01.162 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2024-05-08T04:10:01.218 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-437.el9.x86_64 2024-05-08T04:10:01.218 INFO:teuthology.task.kernel:Running kernel on smithi104: 5.14.0-437.el9.x86_64 2024-05-08T04:10:01.218 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum install -y kernel 2024-05-08T04:10:01.220 INFO:teuthology.orchestra.run.smithi183.stdout:5.14.0-437.el9.x86_64 2024-05-08T04:10:01.220 INFO:teuthology.task.kernel:Running kernel on smithi183: 5.14.0-437.el9.x86_64 2024-05-08T04:10:01.220 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum install -y kernel 2024-05-08T04:10:04.500 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.1 MB 00:01 2024-05-08T04:10:06.191 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.1 MB 00:03 2024-05-08T04:10:10.241 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 19 MB 00:02 2024-05-08T04:10:16.000 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.2 MB 00:01 2024-05-08T04:10:17.775 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-05-08T04:10:19.140 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 19 MB 00:13 2024-05-08T04:10:19.204 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-05-08T04:10:23.299 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-08T04:10:24.393 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-05-08T04:10:24.983 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-05-08T04:10:26.340 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T04:10:26.341 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T04:10:26.433 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-05-08T04:10:26.445 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-05-08T04:10:26.445 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-05-08T04:10:26.445 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-05-08T04:10:26.445 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-05-08T04:10:26.445 INFO:teuthology.orchestra.run.smithi104.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T04:10:26.445 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-05-08T04:10:26.445 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T04:10:26.445 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T04:10:26.445 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T04:10:26.445 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:10:26.445 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-05-08T04:10:26.445 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-05-08T04:10:26.446 INFO:teuthology.orchestra.run.smithi104.stdout:Install 4 Packages 2024-05-08T04:10:26.446 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:10:26.446 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 78 M 2024-05-08T04:10:26.446 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 123 M 2024-05-08T04:10:26.446 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-05-08T04:10:27.101 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-08T04:10:27.402 INFO:teuthology.orchestra.run.smithi104.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 602 kB/s | 484 kB 00:00 2024-05-08T04:10:32.060 INFO:teuthology.orchestra.run.smithi104.stdout:(2/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 6.2 MB/s | 34 MB 00:05 2024-05-08T04:10:32.234 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-08T04:10:34.018 INFO:teuthology.orchestra.run.smithi104.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 4.2 MB/s | 28 MB 00:06 2024-05-08T04:10:34.282 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T04:10:34.282 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T04:10:34.372 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-05-08T04:10:34.387 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-05-08T04:10:34.387 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2024-05-08T04:10:34.387 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-05-08T04:10:34.387 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-05-08T04:10:34.387 INFO:teuthology.orchestra.run.smithi183.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T04:10:34.387 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-05-08T04:10:34.387 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T04:10:34.387 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T04:10:34.387 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T04:10:34.387 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:10:34.387 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-05-08T04:10:34.388 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-05-08T04:10:34.388 INFO:teuthology.orchestra.run.smithi183.stdout:Install 4 Packages 2024-05-08T04:10:34.388 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:10:34.388 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 78 M 2024-05-08T04:10:34.388 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 123 M 2024-05-08T04:10:34.388 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-05-08T04:10:35.077 INFO:teuthology.orchestra.run.smithi183.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 847 kB/s | 484 kB 00:00 2024-05-08T04:10:36.876 INFO:teuthology.orchestra.run.smithi104.stdout:(4/4): kernel-core-5.14.0-444.el9.x86_64.rpm 1.5 MB/s | 15 MB 00:10 2024-05-08T04:10:36.876 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-05-08T04:10:36.876 INFO:teuthology.orchestra.run.smithi104.stdout:Total 7.5 MB/s | 78 MB 00:10 2024-05-08T04:10:37.559 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-05-08T04:10:37.895 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-05-08T04:10:37.895 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-05-08T04:10:38.817 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-05-08T04:10:38.818 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-05-08T04:10:41.212 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-05-08T04:10:41.811 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T04:10:41.900 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T04:10:44.562 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T04:10:44.700 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T04:10:46.018 INFO:teuthology.orchestra.run.smithi183.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 1.3 MB/s | 15 MB 00:11 2024-05-08T04:10:49.371 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T04:10:49.418 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T04:10:54.131 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T04:11:14.530 INFO:teuthology.orchestra.run.smithi183.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 726 kB/s | 28 MB 00:39 2024-05-08T04:11:18.339 INFO:teuthology.orchestra.run.smithi183.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 793 kB/s | 34 MB 00:43 2024-05-08T04:11:18.339 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-05-08T04:11:18.339 INFO:teuthology.orchestra.run.smithi183.stdout:Total 1.8 MB/s | 78 MB 00:43 2024-05-08T04:11:19.018 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-05-08T04:11:19.369 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-05-08T04:11:19.369 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-05-08T04:11:20.280 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-05-08T04:11:20.281 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-05-08T04:11:22.676 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-05-08T04:11:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T04:11:23.363 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T04:11:23.363 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T04:11:23.402 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T04:11:23.682 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T04:11:23.682 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T04:11:23.682 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T04:11:23.683 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T04:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T04:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-05-08T04:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T04:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T04:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T04:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T04:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:11:24.507 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-05-08T04:11:24.832 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T04:11:24.947 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T04:11:24.947 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T04:11:24.948 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T04:11:24.948 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T04:11:24.948 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T04:11:24.948 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-08T04:11:24.948 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi104.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T04:11:24.948 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T04:11:24.998 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T04:11:24.999 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T04:11:24.999 DEBUG:teuthology.orchestra.run.smithi104:> sudo rpm -qi grub2-tools 2024-05-08T04:11:25.030 INFO:teuthology.orchestra.run.smithi104.stdout:Name : grub2-tools 2024-05-08T04:11:25.031 INFO:teuthology.orchestra.run.smithi104.stdout:Epoch : 1 2024-05-08T04:11:25.031 INFO:teuthology.orchestra.run.smithi104.stdout:Version : 2.06 2024-05-08T04:11:25.031 INFO:teuthology.orchestra.run.smithi104.stdout:Release : 68.el9 2024-05-08T04:11:25.031 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: x86_64 2024-05-08T04:11:25.031 INFO:teuthology.orchestra.run.smithi104.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T04:11:25.031 INFO:teuthology.orchestra.run.smithi104.stdout:Group : Unspecified 2024-05-08T04:11:25.031 INFO:teuthology.orchestra.run.smithi104.stdout:Size : 8264254 2024-05-08T04:11:25.032 INFO:teuthology.orchestra.run.smithi104.stdout:License : GPLv3+ 2024-05-08T04:11:25.032 INFO:teuthology.orchestra.run.smithi104.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T04:11:25.032 INFO:teuthology.orchestra.run.smithi104.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T04:11:25.032 INFO:teuthology.orchestra.run.smithi104.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T04:11:25.032 INFO:teuthology.orchestra.run.smithi104.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T04:11:25.032 INFO:teuthology.orchestra.run.smithi104.stdout:Packager : builder@centos.org 2024-05-08T04:11:25.032 INFO:teuthology.orchestra.run.smithi104.stdout:Vendor : CentOS 2024-05-08T04:11:25.033 INFO:teuthology.orchestra.run.smithi104.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T04:11:25.033 INFO:teuthology.orchestra.run.smithi104.stdout:Summary : Support tools for GRUB. 2024-05-08T04:11:25.033 INFO:teuthology.orchestra.run.smithi104.stdout:Description : 2024-05-08T04:11:25.033 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:11:25.033 INFO:teuthology.orchestra.run.smithi104.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T04:11:25.033 INFO:teuthology.orchestra.run.smithi104.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T04:11:25.033 INFO:teuthology.orchestra.run.smithi104.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T04:11:25.033 INFO:teuthology.orchestra.run.smithi104.stdout:hardware devices. 2024-05-08T04:11:25.033 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:11:25.033 INFO:teuthology.orchestra.run.smithi104.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T04:11:25.034 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T04:11:25.034 INFO:teuthology.task.kernel:Updating grub on smithi104 to boot 5.14.0-444.el9.x86_64 2024-05-08T04:11:25.034 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T04:11:25.656 INFO:teuthology.orchestra.run.smithi104.stderr:Generating grub configuration file ... 2024-05-08T04:11:26.017 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T04:11:26.147 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T04:11:27.078 INFO:teuthology.orchestra.run.smithi104.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T04:11:27.112 INFO:teuthology.orchestra.run.smithi104.stderr:done 2024-05-08T04:11:27.115 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-05-08T04:11:27.130 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.yWtjwcCCrJ 2024-05-08T04:11:27.131 DEBUG:teuthology.orchestra.run.smithi104:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yWtjwcCCrJ 2024-05-08T04:11:27.196 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.yWtjwcCCrJ 2024-05-08T04:11:27.337 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.yWtjwcCCrJ is 6KB 2024-05-08T04:11:27.384 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.yWtjwcCCrJ 2024-05-08T04:11:27.398 DEBUG:teuthology.orchestra.run.smithi104:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T04:11:27.459 INFO:teuthology.orchestra.run.smithi104.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T04:11:27.459 INFO:teuthology.orchestra.run.smithi104.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T04:11:27.460 INFO:teuthology.orchestra.run.smithi104.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T04:11:27.460 INFO:teuthology.orchestra.run.smithi104.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T04:11:27.461 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T04:11:27.610 DEBUG:teuthology.orchestra.run.smithi104:> sudo shutdown -r now 2024-05-08T04:11:30.835 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T04:11:30.966 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T04:11:35.686 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T04:11:57.613 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-08T04:11:57.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-05-08T04:11:57.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T04:12:05.077 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T04:12:05.113 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T04:12:05.403 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T04:12:05.403 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T04:12:05.404 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T04:12:05.404 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T04:12:06.269 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T04:12:06.269 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:12:06.270 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-05-08T04:12:06.270 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T04:12:06.270 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T04:12:06.270 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T04:12:06.270 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T04:12:06.270 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:12:06.270 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-05-08T04:12:06.656 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T04:12:06.731 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T04:12:06.731 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T04:12:06.732 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T04:12:06.732 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T04:12:06.732 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T04:12:06.732 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-08T04:12:06.732 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi183.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T04:12:06.732 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T04:12:06.783 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T04:12:06.783 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T04:12:06.783 DEBUG:teuthology.orchestra.run.smithi183:> sudo rpm -qi grub2-tools 2024-05-08T04:12:06.820 INFO:teuthology.orchestra.run.smithi183.stdout:Name : grub2-tools 2024-05-08T04:12:06.820 INFO:teuthology.orchestra.run.smithi183.stdout:Epoch : 1 2024-05-08T04:12:06.820 INFO:teuthology.orchestra.run.smithi183.stdout:Version : 2.06 2024-05-08T04:12:06.820 INFO:teuthology.orchestra.run.smithi183.stdout:Release : 68.el9 2024-05-08T04:12:06.820 INFO:teuthology.orchestra.run.smithi183.stdout:Architecture: x86_64 2024-05-08T04:12:06.821 INFO:teuthology.orchestra.run.smithi183.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T04:12:06.821 INFO:teuthology.orchestra.run.smithi183.stdout:Group : Unspecified 2024-05-08T04:12:06.821 INFO:teuthology.orchestra.run.smithi183.stdout:Size : 8264254 2024-05-08T04:12:06.821 INFO:teuthology.orchestra.run.smithi183.stdout:License : GPLv3+ 2024-05-08T04:12:06.821 INFO:teuthology.orchestra.run.smithi183.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T04:12:06.821 INFO:teuthology.orchestra.run.smithi183.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T04:12:06.822 INFO:teuthology.orchestra.run.smithi183.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T04:12:06.823 INFO:teuthology.orchestra.run.smithi183.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T04:12:06.823 INFO:teuthology.orchestra.run.smithi183.stdout:Packager : builder@centos.org 2024-05-08T04:12:06.823 INFO:teuthology.orchestra.run.smithi183.stdout:Vendor : CentOS 2024-05-08T04:12:06.823 INFO:teuthology.orchestra.run.smithi183.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T04:12:06.823 INFO:teuthology.orchestra.run.smithi183.stdout:Summary : Support tools for GRUB. 2024-05-08T04:12:06.823 INFO:teuthology.orchestra.run.smithi183.stdout:Description : 2024-05-08T04:12:06.824 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:12:06.824 INFO:teuthology.orchestra.run.smithi183.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T04:12:06.824 INFO:teuthology.orchestra.run.smithi183.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T04:12:06.824 INFO:teuthology.orchestra.run.smithi183.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T04:12:06.825 INFO:teuthology.orchestra.run.smithi183.stdout:hardware devices. 2024-05-08T04:12:06.825 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:12:06.825 INFO:teuthology.orchestra.run.smithi183.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T04:12:06.826 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T04:12:06.827 INFO:teuthology.task.kernel:Updating grub on smithi183 to boot 5.14.0-444.el9.x86_64 2024-05-08T04:12:06.827 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T04:12:07.446 INFO:teuthology.orchestra.run.smithi183.stderr:Generating grub configuration file ... 2024-05-08T04:12:08.869 INFO:teuthology.orchestra.run.smithi183.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T04:12:08.909 INFO:teuthology.orchestra.run.smithi183.stderr:done 2024-05-08T04:12:08.912 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2024-05-08T04:12:08.926 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.VZm295m5g2 2024-05-08T04:12:08.927 DEBUG:teuthology.orchestra.run.smithi183:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VZm295m5g2 2024-05-08T04:12:08.991 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.VZm295m5g2 2024-05-08T04:12:09.128 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.VZm295m5g2 is 6KB 2024-05-08T04:12:09.178 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.VZm295m5g2 2024-05-08T04:12:09.192 DEBUG:teuthology.orchestra.run.smithi183:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T04:12:09.254 INFO:teuthology.orchestra.run.smithi183.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T04:12:09.254 INFO:teuthology.orchestra.run.smithi183.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T04:12:09.254 INFO:teuthology.orchestra.run.smithi183.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T04:12:09.254 INFO:teuthology.orchestra.run.smithi183.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T04:12:09.255 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T04:12:09.401 DEBUG:teuthology.orchestra.run.smithi183:> sudo shutdown -r now 2024-05-08T04:12:16.034 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-05-08T04:12:25.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-05-08T04:12:25.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T04:12:28.094 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-05-08T04:12:39.414 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-08T04:12:39.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-05-08T04:12:39.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T04:12:40.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-05-08T04:12:40.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T04:12:57.763 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-05-08T04:13:06.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-05-08T04:13:06.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T04:13:11.924 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-05-08T04:13:12.235 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-05-08T04:13:12.235 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-444.el9.x86_64"... 2024-05-08T04:13:12.235 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-05-08T04:13:12.250 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-444.el9.x86_64 2024-05-08T04:13:12.251 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T04:13:12.251 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T04:13:12.251 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T04:13:13.251 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-08T04:13:13.252 DEBUG:teuthology.orchestra.run.smithi104:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T04:13:13.331 INFO:teuthology.orchestra.run.smithi104.stdout:ttyS1 2024-05-08T04:13:13.358 DEBUG:teuthology.parallel:result is None 2024-05-08T04:14:06.777 DEBUG:teuthology.orchestra.remote:timed out 2024-05-08T04:14:18.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-05-08T04:14:18.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T04:14:19.061 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-05-08T04:14:19.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-05-08T04:14:19.474 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-444.el9.x86_64"... 2024-05-08T04:14:19.474 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2024-05-08T04:14:19.491 INFO:teuthology.orchestra.run.smithi183.stdout:5.14.0-444.el9.x86_64 2024-05-08T04:14:19.491 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T04:14:19.491 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T04:14:19.491 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T04:14:20.493 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-08T04:14:20.494 DEBUG:teuthology.orchestra.run.smithi183:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T04:14:20.567 INFO:teuthology.orchestra.run.smithi183.stdout:ttyS1 2024-05-08T04:14:20.611 DEBUG:teuthology.parallel:result is None 2024-05-08T04:14:20.611 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T04:14:20.621 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T04:14:20.622 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T04:14:20.625 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T04:14:20.643 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T04:14:20.649 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T04:14:20.659 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T04:14:20.659 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T04:14:20.683 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T04:14:20.722 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T04:14:20.729 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T04:14:20.729 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T04:14:20.759 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T04:14:20.793 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T04:14:20.796 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T04:14:20.804 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T04:14:20.808 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T04:14:20.810 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T04:14:20.817 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T04:14:20.817 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T04:14:20.848 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T04:14:20.878 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T04:14:20.888 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T04:14:20.888 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T04:14:20.917 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T04:14:20.937 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T04:14:21.015 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T04:14:21.065 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T04:14:21.144 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T04:14:21.191 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:14:21.191 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T04:14:21.256 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T04:14:21.298 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T04:14:21.360 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T04:14:21.401 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T04:14:21.447 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:14:21.447 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T04:14:21.514 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2024-05-08T04:14:21.517 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2024-05-08T04:14:21.558 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T04:14:21.596 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T04:14:22.044 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T04:14:22.052 INFO:teuthology.task.internal:Starting timer... 2024-05-08T04:14:22.052 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T04:14:22.062 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T04:14:22.070 DEBUG:teuthology.orchestra.run.smithi104:> sudo service auditd rotate 2024-05-08T04:14:22.158 INFO:teuthology.orchestra.run.smithi104.stdout:Rotating logs: 2024-05-08T04:14:22.160 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2024-05-08T04:14:22.234 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: 2024-05-08T04:14:22.236 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T04:14:22.236 DEBUG:teuthology.orchestra.run.smithi104:> /usr/sbin/getenforce 2024-05-08T04:14:22.273 INFO:teuthology.orchestra.run.smithi104.stdout:Permissive 2024-05-08T04:14:22.274 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2024-05-08T04:14:22.307 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2024-05-08T04:14:22.307 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi104.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive'} 2024-05-08T04:14:22.308 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T04:14:22.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:14:22.339 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T04:14:22.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:14:22.375 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T04:14:22.375 DEBUG:teuthology.orchestra.run.smithi104:> sudo /usr/sbin/setenforce permissive 2024-05-08T04:14:22.406 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2024-05-08T04:14:22.439 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T04:14:22.449 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-08T04:14:22.454 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-08T04:14:22.576 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T04:14:22.593 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T04:14:22.594 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi104.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T04:18:19.897 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi104.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2024-05-08T04:18:19.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-05-08T04:18:19.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T04:18:19.977 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-05-08T04:18:20.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-05-08T04:18:20.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-05-08T04:18:20.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T04:18:20.135 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-05-08T04:18:20.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-05-08T04:18:20.215 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T04:18:20.225 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T04:18:20.226 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T04:18:20.226 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T04:18:20.229 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T04:18:20.229 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T04:18:20.256 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T04:18:20.270 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T04:18:20.284 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T04:18:20.294 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: ntpd: command not found 2024-05-08T04:18:20.299 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T04:18:20.305 INFO:teuthology.orchestra.run.smithi104.stdout:506 Cannot talk to daemon 2024-05-08T04:18:20.319 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T04:18:20.324 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2024-05-08T04:18:20.333 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T04:18:20.335 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2024-05-08T04:18:20.349 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T04:18:20.362 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T04:18:20.390 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-05-08T04:18:20.393 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T04:18:20.393 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-05-08T04:18:20.393 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T04:18:20.393 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T04:18:20.393 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T04:18:20.394 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T04:18:20.421 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2024-05-08T04:18:20.424 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T04:18:20.425 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-05-08T04:18:20.425 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T04:18:20.425 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T04:18:20.425 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T04:18:20.425 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T04:18:20.426 INFO:teuthology.run_tasks:Running task install... 2024-05-08T04:18:20.434 DEBUG:teuthology.task.install:project ceph 2024-05-08T04:18:20.434 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20'}} 2024-05-08T04:18:20.434 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20'} 2024-05-08T04:18:20.434 INFO:teuthology.task.install:Using flavor: default 2024-05-08T04:18:20.440 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T04:18:20.440 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T04:18:20.440 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20', 'tag': None, 'wait_for_package': False} 2024-05-08T04:18:20.441 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20 2024-05-08T04:18:20.443 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20', 'tag': None, 'wait_for_package': False} 2024-05-08T04:18:20.443 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20 2024-05-08T04:18:20.586 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-neesingh-testing1-20240507/4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/centos/9/flavors/default/ 2024-05-08T04:18:20.587 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1629.g4f7075d1 2024-05-08T04:18:20.592 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-neesingh-testing1-20240507/4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/centos/9/flavors/default/ 2024-05-08T04:18:20.592 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1629.g4f7075d1 2024-05-08T04:18:20.764 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-neesingh-testing1-20240507/4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-neesingh-testing1-20240507/4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-neesingh-testing1-20240507/4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T04:18:20.764 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:18:20.764 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T04:18:20.791 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T04:18:20.791 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T04:18:20.814 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-neesingh-testing1-20240507/4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-neesingh-testing1-20240507/4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-neesingh-testing1-20240507/4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T04:18:20.814 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:18:20.814 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T04:18:20.841 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T04:18:20.841 DEBUG:teuthology.orchestra.run.smithi104:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T04:18:20.855 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T04:18:20.907 DEBUG:teuthology.orchestra.run.smithi104:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T04:18:20.930 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T04:18:20.982 DEBUG:teuthology.orchestra.run.smithi104:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T04:18:20.994 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2024-05-08T04:18:20.996 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2024-05-08T04:18:21.046 INFO:teuthology.orchestra.run.smithi104.stdout:check_obsoletes = 1 2024-05-08T04:18:21.048 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum clean all 2024-05-08T04:18:21.226 INFO:teuthology.orchestra.run.smithi183.stdout:54 files removed 2024-05-08T04:18:21.254 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T04:18:21.284 INFO:teuthology.orchestra.run.smithi104.stdout:54 files removed 2024-05-08T04:18:21.311 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T04:18:21.921 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 208 kB/s | 82 kB 00:00 2024-05-08T04:18:21.997 INFO:teuthology.orchestra.run.smithi104.stdout:ceph packages for x86_64 198 kB/s | 82 kB 00:00 2024-05-08T04:18:22.338 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 28 kB/s | 10 kB 00:00 2024-05-08T04:18:22.406 INFO:teuthology.orchestra.run.smithi104.stdout:ceph noarch packages 28 kB/s | 10 kB 00:00 2024-05-08T04:18:22.722 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-05-08T04:18:22.873 INFO:teuthology.orchestra.run.smithi104.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-05-08T04:18:23.615 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-05-08T04:18:24.489 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.1 MB 00:01 2024-05-08T04:18:25.557 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-05-08T04:18:30.025 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 6.2 MB 00:00 2024-05-08T04:18:31.550 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 16 kB 00:00 2024-05-08T04:18:32.429 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 28 MB/s | 21 MB 00:00 2024-05-08T04:18:36.588 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 1.7 MB/s | 19 MB 00:11 2024-05-08T04:18:37.543 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-05-08T04:18:39.836 INFO:teuthology.orchestra.run.smithi104.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T04:18:39.836 INFO:teuthology.orchestra.run.smithi104.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T04:18:39.847 INFO:teuthology.orchestra.run.smithi104.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T04:18:39.848 INFO:teuthology.orchestra.run.smithi104.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T04:18:39.849 INFO:teuthology.orchestra.run.smithi104.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T04:18:39.849 INFO:teuthology.orchestra.run.smithi104.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T04:18:39.851 INFO:teuthology.orchestra.run.smithi104.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T04:18:39.853 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T04:18:39.854 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T04:18:39.915 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-05-08T04:18:39.932 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-05-08T04:18:39.932 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-05-08T04:18:39.932 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-05-08T04:18:39.932 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-05-08T04:18:39.932 INFO:teuthology.orchestra.run.smithi104.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T04:18:39.932 INFO:teuthology.orchestra.run.smithi104.stdout: ceph x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 6.6 k 2024-05-08T04:18:39.932 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 5.3 M 2024-05-08T04:18:39.932 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 887 k 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 145 k 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 1.5 M 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 138 k 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 1.8 M 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 7.4 M 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 49 k 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 9.8 M 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 47 M 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 264 k 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 748 k 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 220 k 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-shell x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 27 k 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 18 k 2024-05-08T04:18:39.933 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 31 k 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2 x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 744 k 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 127 k 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 162 k 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 321 k 2024-05-08T04:18:39.934 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 298 k 2024-05-08T04:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 99 k 2024-05-08T04:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 85 k 2024-05-08T04:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 3.1 M 2024-05-08T04:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 170 k 2024-05-08T04:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T04:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrading: 2024-05-08T04:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T04:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T04:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T04:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T04:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout: librados2 x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 3.4 M 2024-05-08T04:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1 x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 3.1 M 2024-05-08T04:18:39.935 INFO:teuthology.orchestra.run.smithi104.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 20 M 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 31 k 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 2.1 M 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 248 k 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 4.7 M 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 17 M 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 15 k 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 25 k 2024-05-08T04:18:39.936 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 163 k 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T04:18:39.937 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1 x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 501 k 2024-05-08T04:18:39.938 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T04:18:39.938 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2 x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 5.1 M 2024-05-08T04:18:39.938 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T04:18:39.938 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T04:18:39.938 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T04:18:39.938 INFO:teuthology.orchestra.run.smithi104.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T04:18:39.938 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T04:18:39.938 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T04:18:39.938 INFO:teuthology.orchestra.run.smithi104.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T04:18:39.938 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T04:18:39.938 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T04:18:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T04:18:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T04:18:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T04:18:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T04:18:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T04:18:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T04:18:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T04:18:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T04:18:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 45 k 2024-05-08T04:18:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 131 k 2024-05-08T04:18:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T04:18:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T04:18:39.939 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T04:18:39.940 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T04:18:39.941 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T04:18:39.941 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T04:18:39.941 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T04:18:39.941 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T04:18:39.941 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T04:18:39.941 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T04:18:39.941 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T04:18:39.941 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T04:18:39.941 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T04:18:39.941 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T04:18:39.941 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T04:18:39.941 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T04:18:39.941 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T04:18:39.942 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T04:18:39.942 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T04:18:39.942 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T04:18:39.942 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T04:18:39.942 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T04:18:39.942 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T04:18:39.942 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T04:18:39.942 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T04:18:39.942 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T04:18:39.942 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T04:18:39.942 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T04:18:39.943 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout:Installing weak dependencies: 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout:Install 148 Packages 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrade 8 Packages 2024-05-08T04:18:39.944 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:18:39.945 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 220 M 2024-05-08T04:18:39.945 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-05-08T04:18:40.853 INFO:teuthology.orchestra.run.smithi104.stdout:(1/156): ceph-19.0.0-1629.g4f7075d1.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-05-08T04:18:41.189 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.2 MB 00:01 2024-05-08T04:18:41.503 INFO:teuthology.orchestra.run.smithi104.stdout:(2/156): ceph-fuse-19.0.0-1629.g4f7075d1.el9.x8 1.3 MB/s | 887 kB 00:00 2024-05-08T04:18:41.611 INFO:teuthology.orchestra.run.smithi104.stdout:(3/156): ceph-immutable-object-cache-19.0.0-162 1.3 MB/s | 145 kB 00:00 2024-05-08T04:18:42.582 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 16 kB 00:00 2024-05-08T04:18:42.620 INFO:teuthology.orchestra.run.smithi104.stdout:(4/156): ceph-mds-19.0.0-1629.g4f7075d1.el9.x86 2.1 MB/s | 2.1 MB 00:01 2024-05-08T04:18:43.020 INFO:teuthology.orchestra.run.smithi104.stdout:(5/156): ceph-base-19.0.0-1629.g4f7075d1.el9.x8 2.1 MB/s | 5.3 MB 00:02 2024-05-08T04:18:43.337 INFO:teuthology.orchestra.run.smithi104.stdout:(6/156): ceph-mgr-19.0.0-1629.g4f7075d1.el9.x86 2.1 MB/s | 1.5 MB 00:00 2024-05-08T04:18:43.858 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-05-08T04:18:44.479 INFO:teuthology.orchestra.run.smithi104.stdout:(7/156): ceph-mon-19.0.0-1629.g4f7075d1.el9.x86 3.2 MB/s | 4.7 MB 00:01 2024-05-08T04:18:45.071 INFO:teuthology.orchestra.run.smithi104.stdout:(8/156): ceph-common-19.0.0-1629.g4f7075d1.el9. 4.4 MB/s | 20 MB 00:04 2024-05-08T04:18:45.137 INFO:teuthology.orchestra.run.smithi104.stdout:(9/156): ceph-selinux-19.0.0-1629.g4f7075d1.el9 379 kB/s | 25 kB 00:00 2024-05-08T04:18:46.887 INFO:teuthology.orchestra.run.smithi104.stdout:(10/156): ceph-radosgw-19.0.0-1629.g4f7075d1.el 4.1 MB/s | 9.8 MB 00:02 2024-05-08T04:18:47.638 INFO:teuthology.orchestra.run.smithi104.stdout:(11/156): cephfs-mirror-19.0.0-1629.g4f7075d1.e 293 kB/s | 220 kB 00:00 2024-05-08T04:18:47.729 INFO:teuthology.orchestra.run.smithi104.stdout:(12/156): cephfs-shell-19.0.0-1629.g4f7075d1.el 296 kB/s | 27 kB 00:00 2024-05-08T04:18:47.813 INFO:teuthology.orchestra.run.smithi104.stdout:(13/156): libcephfs-devel-19.0.0-1629.g4f7075d1 374 kB/s | 31 kB 00:00 2024-05-08T04:18:48.055 INFO:teuthology.orchestra.run.smithi104.stdout:(14/156): libcephfs2-19.0.0-1629.g4f7075d1.el9. 3.0 MB/s | 744 kB 00:00 2024-05-08T04:18:48.147 INFO:teuthology.orchestra.run.smithi104.stdout:(15/156): libcephsqlite-19.0.0-1629.g4f7075d1.e 1.7 MB/s | 163 kB 00:00 2024-05-08T04:18:48.239 INFO:teuthology.orchestra.run.smithi104.stdout:(16/156): librados-devel-19.0.0-1629.g4f7075d1. 1.3 MB/s | 127 kB 00:00 2024-05-08T04:18:48.464 INFO:teuthology.orchestra.run.smithi104.stdout:(17/156): ceph-osd-19.0.0-1629.g4f7075d1.el9.x8 3.3 MB/s | 17 MB 00:05 2024-05-08T04:18:48.489 INFO:teuthology.orchestra.run.smithi104.stdout:(18/156): libradosstriper1-19.0.0-1629.g4f7075d 2.0 MB/s | 501 kB 00:00 2024-05-08T04:18:48.557 INFO:teuthology.orchestra.run.smithi104.stdout:(19/156): python3-ceph-argparse-19.0.0-1629.g4f 676 kB/s | 45 kB 00:00 2024-05-08T04:18:48.640 INFO:teuthology.orchestra.run.smithi104.stdout:(20/156): python3-ceph-common-19.0.0-1629.g4f70 1.5 MB/s | 131 kB 00:00 2024-05-08T04:18:48.732 INFO:teuthology.orchestra.run.smithi104.stdout:(21/156): python3-cephfs-19.0.0-1629.g4f7075d1. 1.7 MB/s | 162 kB 00:00 2024-05-08T04:18:48.874 INFO:teuthology.orchestra.run.smithi104.stdout:(22/156): python3-rados-19.0.0-1629.g4f7075d1.e 2.2 MB/s | 321 kB 00:00 2024-05-08T04:18:49.041 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-05-08T04:18:49.316 INFO:teuthology.orchestra.run.smithi104.stdout:(23/156): ceph-test-19.0.0-1629.g4f7075d1.el9.x 11 MB/s | 47 MB 00:04 2024-05-08T04:18:49.341 INFO:teuthology.orchestra.run.smithi104.stdout:(24/156): python3-rbd-19.0.0-1629.g4f7075d1.el9 638 kB/s | 298 kB 00:00 2024-05-08T04:18:49.367 INFO:teuthology.orchestra.run.smithi104.stdout:(25/156): python3-rgw-19.0.0-1629.g4f7075d1.el9 1.9 MB/s | 99 kB 00:00 2024-05-08T04:18:49.408 INFO:teuthology.orchestra.run.smithi104.stdout:(26/156): rbd-fuse-19.0.0-1629.g4f7075d1.el9.x8 1.3 MB/s | 85 kB 00:00 2024-05-08T04:18:49.492 INFO:teuthology.orchestra.run.smithi104.stdout:(27/156): rbd-nbd-19.0.0-1629.g4f7075d1.el9.x86 2.0 MB/s | 170 kB 00:00 2024-05-08T04:18:49.559 INFO:teuthology.orchestra.run.smithi104.stdout:(28/156): ceph-grafana-dashboards-19.0.0-1629.g 472 kB/s | 31 kB 00:00 2024-05-08T04:18:49.634 INFO:teuthology.orchestra.run.smithi104.stdout:(29/156): rbd-mirror-19.0.0-1629.g4f7075d1.el9. 12 MB/s | 3.1 MB 00:00 2024-05-08T04:18:49.659 INFO:teuthology.orchestra.run.smithi104.stdout:(30/156): ceph-mgr-cephadm-19.0.0-1629.g4f7075d 1.3 MB/s | 138 kB 00:00 2024-05-08T04:18:49.735 INFO:teuthology.orchestra.run.smithi104.stdout:(31/156): librgw2-19.0.0-1629.g4f7075d1.el9.x86 4.0 MB/s | 5.1 MB 00:01 2024-05-08T04:18:49.802 INFO:teuthology.orchestra.run.smithi104.stdout:(32/156): ceph-mgr-dashboard-19.0.0-1629.g4f707 11 MB/s | 1.8 MB 00:00 2024-05-08T04:18:49.827 INFO:teuthology.orchestra.run.smithi104.stdout:(33/156): ceph-mgr-modules-core-19.0.0-1629.g4f 2.6 MB/s | 248 kB 00:00 2024-05-08T04:18:49.844 INFO:teuthology.orchestra.run.smithi104.stdout:(34/156): ceph-mgr-rook-19.0.0-1629.g4f7075d1.e 1.2 MB/s | 49 kB 00:00 2024-05-08T04:18:49.878 INFO:teuthology.orchestra.run.smithi104.stdout:(35/156): ceph-prometheus-alerts-19.0.0-1629.g4 306 kB/s | 15 kB 00:00 2024-05-08T04:18:49.903 INFO:teuthology.orchestra.run.smithi104.stdout:(36/156): ceph-volume-19.0.0-1629.g4f7075d1.el9 4.4 MB/s | 264 kB 00:00 2024-05-08T04:18:49.945 INFO:teuthology.orchestra.run.smithi104.stdout:(37/156): cephfs-top-19.0.0-1629.g4f7075d1.el9. 439 kB/s | 18 kB 00:00 2024-05-08T04:18:50.020 INFO:teuthology.orchestra.run.smithi104.stdout:(38/156): cephadm-19.0.0-1629.g4f7075d1.el9.noa 5.1 MB/s | 748 kB 00:00 2024-05-08T04:18:50.645 INFO:teuthology.orchestra.run.smithi104.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 115 kB/s | 80 kB 00:00 2024-05-08T04:18:50.854 INFO:teuthology.orchestra.run.smithi104.stdout:(40/156): ceph-mgr-diskprediction-local-19.0.0- 6.2 MB/s | 7.4 MB 00:01 2024-05-08T04:18:50.988 INFO:teuthology.orchestra.run.smithi104.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 830 kB/s | 803 kB 00:00 2024-05-08T04:18:51.376 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T04:18:51.376 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T04:18:51.387 INFO:teuthology.orchestra.run.smithi183.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T04:18:51.388 INFO:teuthology.orchestra.run.smithi183.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T04:18:51.389 INFO:teuthology.orchestra.run.smithi183.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T04:18:51.389 INFO:teuthology.orchestra.run.smithi183.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T04:18:51.391 INFO:teuthology.orchestra.run.smithi183.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T04:18:51.393 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T04:18:51.394 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T04:18:51.454 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-05-08T04:18:51.467 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-05-08T04:18:51.468 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-05-08T04:18:51.468 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-05-08T04:18:51.468 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-05-08T04:18:51.468 INFO:teuthology.orchestra.run.smithi183.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T04:18:51.468 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 6.6 k 2024-05-08T04:18:51.468 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 5.3 M 2024-05-08T04:18:51.468 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 887 k 2024-05-08T04:18:51.468 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 145 k 2024-05-08T04:18:51.468 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 1.5 M 2024-05-08T04:18:51.468 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 138 k 2024-05-08T04:18:51.468 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 1.8 M 2024-05-08T04:18:51.468 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 7.4 M 2024-05-08T04:18:51.468 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 49 k 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 9.8 M 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 47 M 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 264 k 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 748 k 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 220 k 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-shell x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 27 k 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 18 k 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 31 k 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 744 k 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 127 k 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T04:18:51.469 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 162 k 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 321 k 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 298 k 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 99 k 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 85 k 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 3.1 M 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 170 k 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2024-05-08T04:18:51.470 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T04:18:51.471 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T04:18:51.471 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T04:18:51.471 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T04:18:51.471 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 3.4 M 2024-05-08T04:18:51.471 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 3.1 M 2024-05-08T04:18:51.471 INFO:teuthology.orchestra.run.smithi183.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T04:18:51.471 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T04:18:51.471 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-05-08T04:18:51.471 INFO:teuthology.orchestra.run.smithi183.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T04:18:51.471 INFO:teuthology.orchestra.run.smithi183.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T04:18:51.471 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T04:18:51.471 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 20 M 2024-05-08T04:18:51.471 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 31 k 2024-05-08T04:18:51.472 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 2.1 M 2024-05-08T04:18:51.472 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 248 k 2024-05-08T04:18:51.472 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 4.7 M 2024-05-08T04:18:51.472 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 17 M 2024-05-08T04:18:51.472 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1629.g4f7075d1.el9 ceph-noarch 15 k 2024-05-08T04:18:51.472 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 25 k 2024-05-08T04:18:51.472 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T04:18:51.472 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T04:18:51.472 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T04:18:51.472 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T04:18:51.472 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T04:18:51.473 INFO:teuthology.orchestra.run.smithi183.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T04:18:51.473 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T04:18:51.473 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T04:18:51.473 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 163 k 2024-05-08T04:18:51.473 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T04:18:51.473 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T04:18:51.473 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T04:18:51.474 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T04:18:51.474 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T04:18:51.474 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 501 k 2024-05-08T04:18:51.474 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T04:18:51.474 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 5.1 M 2024-05-08T04:18:51.474 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T04:18:51.474 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T04:18:51.474 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T04:18:51.474 INFO:teuthology.orchestra.run.smithi183.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T04:18:51.474 INFO:teuthology.orchestra.run.smithi183.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T04:18:51.474 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T04:18:51.474 INFO:teuthology.orchestra.run.smithi183.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T04:18:51.474 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 45 k 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:19.0.0-1629.g4f7075d1.el9 ceph 131 k 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T04:18:51.475 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T04:18:51.476 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T04:18:51.476 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T04:18:51.476 INFO:teuthology.orchestra.run.smithi183.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T04:18:51.476 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T04:18:51.476 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T04:18:51.476 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T04:18:51.476 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T04:18:51.476 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T04:18:51.476 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T04:18:51.476 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T04:18:51.476 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T04:18:51.476 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T04:18:51.477 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T04:18:51.478 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T04:18:51.479 INFO:teuthology.orchestra.run.smithi183.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout:Installing weak dependencies: 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout:Install 148 Packages 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 8 Packages 2024-05-08T04:18:51.480 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:18:51.481 INFO:teuthology.orchestra.run.smithi104.stdout:(42/156): libquadmath-11.4.1-3.el9.x86_64.rpm 237 kB/s | 195 kB 00:00 2024-05-08T04:18:51.481 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 220 M 2024-05-08T04:18:51.481 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-05-08T04:18:51.688 INFO:teuthology.orchestra.run.smithi104.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 304 kB/s | 253 kB 00:00 2024-05-08T04:18:51.918 INFO:teuthology.orchestra.run.smithi183.stdout:(1/156): ceph-19.0.0-1629.g4f7075d1.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-05-08T04:18:51.980 INFO:teuthology.orchestra.run.smithi104.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:00 2024-05-08T04:18:52.205 INFO:teuthology.orchestra.run.smithi104.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 145 kB/s | 106 kB 00:00 2024-05-08T04:18:52.360 INFO:teuthology.orchestra.run.smithi183.stdout:(2/156): ceph-base-19.0.0-1629.g4f7075d1.el9.x8 7.9 MB/s | 5.3 MB 00:00 2024-05-08T04:18:52.427 INFO:teuthology.orchestra.run.smithi183.stdout:(3/156): ceph-immutable-object-cache-19.0.0-162 2.1 MB/s | 145 kB 00:00 2024-05-08T04:18:52.455 INFO:teuthology.orchestra.run.smithi104.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 176 kB/s | 135 kB 00:00 2024-05-08T04:18:52.643 INFO:teuthology.orchestra.run.smithi183.stdout:(4/156): ceph-mds-19.0.0-1629.g4f7075d1.el9.x86 9.8 MB/s | 2.1 MB 00:00 2024-05-08T04:18:52.664 INFO:teuthology.orchestra.run.smithi104.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-05-08T04:18:52.714 INFO:teuthology.orchestra.run.smithi104.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 943 kB 00:00 2024-05-08T04:18:52.739 INFO:teuthology.orchestra.run.smithi104.stdout:(49/156): python3-requests-2.25.1-8.el9.noarch. 164 kB/s | 125 kB 00:00 2024-05-08T04:18:52.765 INFO:teuthology.orchestra.run.smithi104.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-05-08T04:18:52.777 INFO:teuthology.orchestra.run.smithi183.stdout:(5/156): ceph-fuse-19.0.0-1629.g4f7075d1.el9.x8 1.0 MB/s | 887 kB 00:00 2024-05-08T04:18:52.782 INFO:teuthology.orchestra.run.smithi104.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 516 kB/s | 21 kB 00:00 2024-05-08T04:18:52.807 INFO:teuthology.orchestra.run.smithi104.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 313 kB 00:00 2024-05-08T04:18:52.810 INFO:teuthology.orchestra.run.smithi183.stdout:(6/156): ceph-mgr-19.0.0-1629.g4f7075d1.el9.x86 8.9 MB/s | 1.5 MB 00:00 2024-05-08T04:18:52.824 INFO:teuthology.orchestra.run.smithi104.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 796 kB/s | 33 kB 00:00 2024-05-08T04:18:52.849 INFO:teuthology.orchestra.run.smithi104.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 741 kB/s | 18 kB 00:00 2024-05-08T04:18:52.874 INFO:teuthology.orchestra.run.smithi104.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 479 kB/s | 11 kB 00:00 2024-05-08T04:18:52.925 INFO:teuthology.orchestra.run.smithi104.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-05-08T04:18:52.950 INFO:teuthology.orchestra.run.smithi104.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-05-08T04:18:52.967 INFO:teuthology.orchestra.run.smithi104.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-05-08T04:18:52.992 INFO:teuthology.orchestra.run.smithi104.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 662 kB 00:00 2024-05-08T04:18:53.017 INFO:teuthology.orchestra.run.smithi104.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 582 kB 00:00 2024-05-08T04:18:53.042 INFO:teuthology.orchestra.run.smithi104.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 518 kB/s | 25 kB 00:00 2024-05-08T04:18:53.059 INFO:teuthology.orchestra.run.smithi104.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-05-08T04:18:53.085 INFO:teuthology.orchestra.run.smithi104.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-05-08T04:18:53.110 INFO:teuthology.orchestra.run.smithi104.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-05-08T04:18:53.127 INFO:teuthology.orchestra.run.smithi104.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 848 kB/s | 35 kB 00:00 2024-05-08T04:18:53.152 INFO:teuthology.orchestra.run.smithi104.stdout:(66/156): python3-urllib3-1.26.5-5.el9.noarch.r 233 kB/s | 215 kB 00:00 2024-05-08T04:18:53.269 INFO:teuthology.orchestra.run.smithi104.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-05-08T04:18:53.286 INFO:teuthology.orchestra.run.smithi183.stdout:(7/156): ceph-common-19.0.0-1629.g4f7075d1.el9. 12 MB/s | 20 MB 00:01 2024-05-08T04:18:53.311 INFO:teuthology.orchestra.run.smithi104.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-05-08T04:18:53.370 INFO:teuthology.orchestra.run.smithi104.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-05-08T04:18:53.395 INFO:teuthology.orchestra.run.smithi104.stdout:(70/156): postgresql-contrib-13.14-1.el9.x86_64 7.2 MB/s | 911 kB 00:00 2024-05-08T04:18:53.420 INFO:teuthology.orchestra.run.smithi104.stdout:(71/156): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-05-08T04:18:53.462 INFO:teuthology.orchestra.run.smithi104.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-05-08T04:18:53.487 INFO:teuthology.orchestra.run.smithi104.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-08T04:18:53.563 INFO:teuthology.orchestra.run.smithi104.stdout:(74/156): postgresql-server-13.14-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-05-08T04:18:53.671 INFO:teuthology.orchestra.run.smithi104.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-05-08T04:18:53.696 INFO:teuthology.orchestra.run.smithi104.stdout:(76/156): python3-devel-3.9.18-3.el9.x86_64.rpm 1.2 MB/s | 244 kB 00:00 2024-05-08T04:18:53.721 INFO:teuthology.orchestra.run.smithi104.stdout:(77/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-05-08T04:18:53.747 INFO:teuthology.orchestra.run.smithi104.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 345 kB/s | 26 kB 00:00 2024-05-08T04:18:53.781 INFO:teuthology.orchestra.run.smithi104.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 326 kB/s | 19 kB 00:00 2024-05-08T04:18:53.806 INFO:teuthology.orchestra.run.smithi104.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-05-08T04:18:53.831 INFO:teuthology.orchestra.run.smithi104.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 416 kB/s | 35 kB 00:00 2024-05-08T04:18:53.856 INFO:teuthology.orchestra.run.smithi104.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-05-08T04:18:53.882 INFO:teuthology.orchestra.run.smithi104.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-05-08T04:18:53.907 INFO:teuthology.orchestra.run.smithi104.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 77 kB 00:00 2024-05-08T04:18:53.974 INFO:teuthology.orchestra.run.smithi104.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 5.1 MB 00:00 2024-05-08T04:18:53.990 INFO:teuthology.orchestra.run.smithi104.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 396 kB/s | 42 kB 00:00 2024-05-08T04:18:54.016 INFO:teuthology.orchestra.run.smithi104.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.5 MB/s | 269 kB 00:00 2024-05-08T04:18:54.041 INFO:teuthology.orchestra.run.smithi104.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-05-08T04:18:54.066 INFO:teuthology.orchestra.run.smithi104.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-05-08T04:18:54.083 INFO:teuthology.orchestra.run.smithi104.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 767 kB/s | 51 kB 00:00 2024-05-08T04:18:54.108 INFO:teuthology.orchestra.run.smithi104.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-05-08T04:18:54.134 INFO:teuthology.orchestra.run.smithi104.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 845 kB/s | 42 kB 00:00 2024-05-08T04:18:54.167 INFO:teuthology.orchestra.run.smithi104.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 777 kB/s | 44 kB 00:00 2024-05-08T04:18:54.178 INFO:teuthology.orchestra.run.smithi183.stdout:(8/156): ceph-radosgw-19.0.0-1629.g4f7075d1.el9 11 MB/s | 9.8 MB 00:00 2024-05-08T04:18:54.201 INFO:teuthology.orchestra.run.smithi104.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-05-08T04:18:54.243 INFO:teuthology.orchestra.run.smithi104.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 494 kB/s | 36 kB 00:00 2024-05-08T04:18:54.301 INFO:teuthology.orchestra.run.smithi104.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 485 kB/s | 47 kB 00:00 2024-05-08T04:18:54.353 INFO:teuthology.orchestra.run.smithi183.stdout:(9/156): ceph-osd-19.0.0-1629.g4f7075d1.el9.x86 11 MB/s | 17 MB 00:01 2024-05-08T04:18:54.360 INFO:teuthology.orchestra.run.smithi104.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 2.6 MB/s | 305 kB 00:00 2024-05-08T04:18:54.378 INFO:teuthology.orchestra.run.smithi183.stdout:(10/156): ceph-selinux-19.0.0-1629.g4f7075d1.el 126 kB/s | 25 kB 00:00 2024-05-08T04:18:54.470 INFO:teuthology.orchestra.run.smithi183.stdout:(11/156): cephfs-mirror-19.0.0-1629.g4f7075d1.e 2.3 MB/s | 220 kB 00:00 2024-05-08T04:18:54.511 INFO:teuthology.orchestra.run.smithi104.stdout:(98/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-05-08T04:18:54.535 INFO:teuthology.orchestra.run.smithi104.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 250 kB/s | 58 kB 00:00 2024-05-08T04:18:54.561 INFO:teuthology.orchestra.run.smithi104.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 472 kB/s | 94 kB 00:00 2024-05-08T04:18:54.562 INFO:teuthology.orchestra.run.smithi183.stdout:(12/156): cephfs-shell-19.0.0-1629.g4f7075d1.el 294 kB/s | 27 kB 00:00 2024-05-08T04:18:54.586 INFO:teuthology.orchestra.run.smithi104.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-05-08T04:18:54.611 INFO:teuthology.orchestra.run.smithi104.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 849 kB/s | 64 kB 00:00 2024-05-08T04:18:54.629 INFO:teuthology.orchestra.run.smithi183.stdout:(13/156): ceph-mon-19.0.0-1629.g4f7075d1.el9.x8 2.5 MB/s | 4.7 MB 00:01 2024-05-08T04:18:54.653 INFO:teuthology.orchestra.run.smithi104.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-05-08T04:18:54.654 INFO:teuthology.orchestra.run.smithi183.stdout:(14/156): libcephfs-devel-19.0.0-1629.g4f7075d1 339 kB/s | 31 kB 00:00 2024-05-08T04:18:54.722 INFO:teuthology.orchestra.run.smithi183.stdout:(15/156): libcephsqlite-19.0.0-1629.g4f7075d1.e 2.4 MB/s | 163 kB 00:00 2024-05-08T04:18:54.728 INFO:teuthology.orchestra.run.smithi104.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 5.9 MB/s | 863 kB 00:00 2024-05-08T04:18:54.780 INFO:teuthology.orchestra.run.smithi183.stdout:(16/156): librados-devel-19.0.0-1629.g4f7075d1. 2.1 MB/s | 127 kB 00:00 2024-05-08T04:18:54.805 INFO:teuthology.orchestra.run.smithi183.stdout:(17/156): libcephfs2-19.0.0-1629.g4f7075d1.el9. 4.1 MB/s | 744 kB 00:00 2024-05-08T04:18:54.856 INFO:teuthology.orchestra.run.smithi183.stdout:(18/156): libradosstriper1-19.0.0-1629.g4f7075d 6.5 MB/s | 501 kB 00:00 2024-05-08T04:18:54.914 INFO:teuthology.orchestra.run.smithi183.stdout:(19/156): python3-ceph-argparse-19.0.0-1629.g4f 773 kB/s | 45 kB 00:00 2024-05-08T04:18:54.970 INFO:teuthology.orchestra.run.smithi104.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 80 kB/s | 19 kB 00:00 2024-05-08T04:18:54.981 INFO:teuthology.orchestra.run.smithi183.stdout:(20/156): python3-ceph-common-19.0.0-1629.g4f70 1.9 MB/s | 131 kB 00:00 2024-05-08T04:18:55.057 INFO:teuthology.orchestra.run.smithi183.stdout:(21/156): python3-cephfs-19.0.0-1629.g4f7075d1. 2.1 MB/s | 162 kB 00:00 2024-05-08T04:18:55.115 INFO:teuthology.orchestra.run.smithi104.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 669 kB/s | 309 kB 00:00 2024-05-08T04:18:55.140 INFO:teuthology.orchestra.run.smithi183.stdout:(22/156): python3-rados-19.0.0-1629.g4f7075d1.e 3.8 MB/s | 321 kB 00:00 2024-05-08T04:18:55.146 INFO:teuthology.orchestra.run.smithi104.stdout:(107/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-05-08T04:18:55.205 INFO:teuthology.orchestra.run.smithi104.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 291 kB/s | 26 kB 00:00 2024-05-08T04:18:55.215 INFO:teuthology.orchestra.run.smithi183.stdout:(23/156): python3-rbd-19.0.0-1629.g4f7075d1.el9 3.9 MB/s | 298 kB 00:00 2024-05-08T04:18:55.238 INFO:teuthology.orchestra.run.smithi104.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 529 kB/s | 49 kB 00:00 2024-05-08T04:18:55.282 INFO:teuthology.orchestra.run.smithi183.stdout:(24/156): python3-rgw-19.0.0-1629.g4f7075d1.el9 1.5 MB/s | 99 kB 00:00 2024-05-08T04:18:55.297 INFO:teuthology.orchestra.run.smithi104.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 734 kB/s | 67 kB 00:00 2024-05-08T04:18:55.339 INFO:teuthology.orchestra.run.smithi104.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-05-08T04:18:55.350 INFO:teuthology.orchestra.run.smithi183.stdout:(25/156): rbd-fuse-19.0.0-1629.g4f7075d1.el9.x8 1.3 MB/s | 85 kB 00:00 2024-05-08T04:18:55.447 INFO:teuthology.orchestra.run.smithi104.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-05-08T04:18:55.481 INFO:teuthology.orchestra.run.smithi104.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 839 kB 00:00 2024-05-08T04:18:55.548 INFO:teuthology.orchestra.run.smithi104.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 433 kB/s | 43 kB 00:00 2024-05-08T04:18:55.573 INFO:teuthology.orchestra.run.smithi104.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 350 kB/s | 32 kB 00:00 2024-05-08T04:18:55.617 INFO:teuthology.orchestra.run.smithi183.stdout:(26/156): librgw2-19.0.0-1629.g4f7075d1.el9.x86 6.3 MB/s | 5.1 MB 00:00 2024-05-08T04:18:55.640 INFO:teuthology.orchestra.run.smithi104.stdout:(116/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2024-05-08T04:18:55.666 INFO:teuthology.orchestra.run.smithi104.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2024-05-08T04:18:55.675 INFO:teuthology.orchestra.run.smithi183.stdout:(27/156): rbd-mirror-19.0.0-1629.g4f7075d1.el9. 9.5 MB/s | 3.1 MB 00:00 2024-05-08T04:18:55.691 INFO:teuthology.orchestra.run.smithi104.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-05-08T04:18:55.700 INFO:teuthology.orchestra.run.smithi183.stdout:(28/156): rbd-nbd-19.0.0-1629.g4f7075d1.el9.x86 2.0 MB/s | 170 kB 00:00 2024-05-08T04:18:55.726 INFO:teuthology.orchestra.run.smithi183.stdout:(29/156): ceph-grafana-dashboards-19.0.0-1629.g 628 kB/s | 31 kB 00:00 2024-05-08T04:18:55.758 INFO:teuthology.orchestra.run.smithi104.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-05-08T04:18:55.776 INFO:teuthology.orchestra.run.smithi183.stdout:(30/156): ceph-mgr-cephadm-19.0.0-1629.g4f7075d 1.8 MB/s | 138 kB 00:00 2024-05-08T04:18:55.783 INFO:teuthology.orchestra.run.smithi104.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-05-08T04:18:55.800 INFO:teuthology.orchestra.run.smithi104.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 324 kB/s | 35 kB 00:00 2024-05-08T04:18:55.859 INFO:teuthology.orchestra.run.smithi104.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-05-08T04:18:55.917 INFO:teuthology.orchestra.run.smithi104.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-05-08T04:18:55.943 INFO:teuthology.orchestra.run.smithi183.stdout:(31/156): ceph-mgr-dashboard-19.0.0-1629.g4f707 8.2 MB/s | 1.8 MB 00:00 2024-05-08T04:18:55.951 INFO:teuthology.orchestra.run.smithi104.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-05-08T04:18:56.009 INFO:teuthology.orchestra.run.smithi104.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 193 kB/s | 18 kB 00:00 2024-05-08T04:18:56.018 INFO:teuthology.orchestra.run.smithi183.stdout:(32/156): ceph-mgr-modules-core-19.0.0-1629.g4f 3.2 MB/s | 248 kB 00:00 2024-05-08T04:18:56.043 INFO:teuthology.orchestra.run.smithi104.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2024-05-08T04:18:56.093 INFO:teuthology.orchestra.run.smithi183.stdout:(33/156): ceph-mgr-rook-19.0.0-1629.g4f7075d1.e 659 kB/s | 49 kB 00:00 2024-05-08T04:18:56.110 INFO:teuthology.orchestra.run.smithi104.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-05-08T04:18:56.135 INFO:teuthology.orchestra.run.smithi104.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-05-08T04:18:56.168 INFO:teuthology.orchestra.run.smithi183.stdout:(34/156): ceph-prometheus-alerts-19.0.0-1629.g4 205 kB/s | 15 kB 00:00 2024-05-08T04:18:56.227 INFO:teuthology.orchestra.run.smithi104.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-05-08T04:18:56.252 INFO:teuthology.orchestra.run.smithi104.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 396 kB/s | 46 kB 00:00 2024-05-08T04:18:56.261 INFO:teuthology.orchestra.run.smithi183.stdout:(35/156): ceph-volume-19.0.0-1629.g4f7075d1.el9 2.8 MB/s | 264 kB 00:00 2024-05-08T04:18:56.319 INFO:teuthology.orchestra.run.smithi104.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 858 kB/s | 79 kB 00:00 2024-05-08T04:18:56.344 INFO:teuthology.orchestra.run.smithi104.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 629 kB/s | 58 kB 00:00 2024-05-08T04:18:56.369 INFO:teuthology.orchestra.run.smithi183.stdout:(36/156): cephadm-19.0.0-1629.g4f7075d1.el9.noa 6.8 MB/s | 748 kB 00:00 2024-05-08T04:18:56.411 INFO:teuthology.orchestra.run.smithi104.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-05-08T04:18:56.437 INFO:teuthology.orchestra.run.smithi104.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-05-08T04:18:56.445 INFO:teuthology.orchestra.run.smithi183.stdout:(37/156): cephfs-top-19.0.0-1629.g4f7075d1.el9. 244 kB/s | 18 kB 00:00 2024-05-08T04:18:56.495 INFO:teuthology.orchestra.run.smithi104.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-05-08T04:18:56.529 INFO:teuthology.orchestra.run.smithi104.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 307 kB/s | 28 kB 00:00 2024-05-08T04:18:56.588 INFO:teuthology.orchestra.run.smithi104.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 335 kB/s | 31 kB 00:00 2024-05-08T04:18:56.629 INFO:teuthology.orchestra.run.smithi104.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-08T04:18:56.637 INFO:teuthology.orchestra.run.smithi183.stdout:(38/156): ceph-mgr-diskprediction-local-19.0.0- 8.6 MB/s | 7.4 MB 00:00 2024-05-08T04:18:56.662 INFO:teuthology.orchestra.run.smithi183.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 370 kB/s | 80 kB 00:00 2024-05-08T04:18:56.680 INFO:teuthology.orchestra.run.smithi104.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 643 kB/s | 59 kB 00:00 2024-05-08T04:18:56.721 INFO:teuthology.orchestra.run.smithi104.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 389 kB/s | 36 kB 00:00 2024-05-08T04:18:56.754 INFO:teuthology.orchestra.run.smithi183.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-05-08T04:18:56.763 INFO:teuthology.orchestra.run.smithi104.stdout:(141/156): python3-grpcio-1.46.7-10.el9.x86_64. 2.1 MB/s | 2.0 MB 00:00 2024-05-08T04:18:56.797 INFO:teuthology.orchestra.run.smithi104.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 434 kB/s | 51 kB 00:00 2024-05-08T04:18:56.823 INFO:teuthology.orchestra.run.smithi104.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-05-08T04:18:56.846 INFO:teuthology.orchestra.run.smithi183.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-05-08T04:18:56.856 INFO:teuthology.orchestra.run.smithi104.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 971 kB/s | 90 kB 00:00 2024-05-08T04:18:56.898 INFO:teuthology.orchestra.run.smithi104.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-05-08T04:18:56.923 INFO:teuthology.orchestra.run.smithi104.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-05-08T04:18:56.955 INFO:teuthology.orchestra.run.smithi183.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-05-08T04:18:56.988 INFO:teuthology.orchestra.run.smithi183.stdout:(43/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-05-08T04:18:57.032 INFO:teuthology.orchestra.run.smithi104.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-05-08T04:18:57.072 INFO:teuthology.orchestra.run.smithi183.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 910 kB/s | 106 kB 00:00 2024-05-08T04:18:57.097 INFO:teuthology.orchestra.run.smithi183.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-05-08T04:18:57.116 INFO:teuthology.orchestra.run.smithi104.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-05-08T04:18:57.506 INFO:teuthology.orchestra.run.smithi183.stdout:(46/156): ceph-test-19.0.0-1629.g4f7075d1.el9.x 15 MB/s | 47 MB 00:03 2024-05-08T04:18:57.531 INFO:teuthology.orchestra.run.smithi183.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 272 kB/s | 125 kB 00:00 2024-05-08T04:18:57.548 INFO:teuthology.orchestra.run.smithi183.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 476 kB/s | 215 kB 00:00 2024-05-08T04:18:57.649 INFO:teuthology.orchestra.run.smithi104.stdout:(149/156): librados2-19.0.0-1629.g4f7075d1.el9. 4.6 MB/s | 3.4 MB 00:00 2024-05-08T04:18:57.699 INFO:teuthology.orchestra.run.smithi104.stdout:(150/156): librbd1-19.0.0-1629.g4f7075d1.el9.x8 4.7 MB/s | 3.1 MB 00:00 2024-05-08T04:18:58.057 INFO:teuthology.orchestra.run.smithi183.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 210 kB/s | 107 kB 00:00 2024-05-08T04:18:58.165 INFO:teuthology.orchestra.run.smithi183.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 198 kB/s | 21 kB 00:00 2024-05-08T04:18:58.198 INFO:teuthology.orchestra.run.smithi183.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 995 kB/s | 689 kB 00:00 2024-05-08T04:18:58.250 INFO:teuthology.orchestra.run.smithi104.stdout:(151/156): NetworkManager-1.47.5-1.el9.x86_64.r 2.0 MB/s | 2.3 MB 00:01 2024-05-08T04:18:58.307 INFO:teuthology.orchestra.run.smithi183.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-05-08T04:18:58.333 INFO:teuthology.orchestra.run.smithi104.stdout:(152/156): NetworkManager-team-1.47.5-1.el9.x86 66 kB/s | 42 kB 00:00 2024-05-08T04:18:58.441 INFO:teuthology.orchestra.run.smithi183.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-05-08T04:18:58.508 INFO:teuthology.orchestra.run.smithi183.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 916 kB/s | 313 kB 00:00 2024-05-08T04:18:58.541 INFO:teuthology.orchestra.run.smithi183.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 181 kB/s | 18 kB 00:00 2024-05-08T04:18:58.608 INFO:teuthology.orchestra.run.smithi183.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-05-08T04:18:58.650 INFO:teuthology.orchestra.run.smithi183.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-08T04:18:58.717 INFO:teuthology.orchestra.run.smithi183.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-05-08T04:18:58.733 INFO:teuthology.orchestra.run.smithi104.stdout:(153/156): NetworkManager-libnm-1.47.5-1.el9.x8 1.7 MB/s | 1.8 MB 00:01 2024-05-08T04:18:58.818 INFO:teuthology.orchestra.run.smithi183.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.9 MB/s | 3.0 MB 00:00 2024-05-08T04:18:58.926 INFO:teuthology.orchestra.run.smithi183.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2024-05-08T04:18:58.951 INFO:teuthology.orchestra.run.smithi183.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 190 kB/s | 25 kB 00:00 2024-05-08T04:18:58.985 INFO:teuthology.orchestra.run.smithi183.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 2.1 MB/s | 582 kB 00:00 2024-05-08T04:18:59.027 INFO:teuthology.orchestra.run.smithi183.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 471 kB/s | 47 kB 00:00 2024-05-08T04:18:59.061 INFO:teuthology.orchestra.run.smithi183.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-05-08T04:18:59.092 INFO:teuthology.orchestra.run.smithi104.stdout:(154/156): NetworkManager-tui-1.47.5-1.el9.x86_ 295 kB/s | 248 kB 00:00 2024-05-08T04:18:59.094 INFO:teuthology.orchestra.run.smithi183.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-08T04:18:59.128 INFO:teuthology.orchestra.run.smithi183.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 350 kB/s | 35 kB 00:00 2024-05-08T04:18:59.359 INFO:teuthology.orchestra.run.smithi104.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 1.3 MB/s | 1.3 MB 00:01 2024-05-08T04:18:59.412 INFO:teuthology.orchestra.run.smithi183.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-05-08T04:18:59.537 INFO:teuthology.orchestra.run.smithi183.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 7.1 MB/s | 911 kB 00:00 2024-05-08T04:18:59.646 INFO:teuthology.orchestra.run.smithi183.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-05-08T04:18:59.817 INFO:teuthology.orchestra.run.smithi104.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.2 MB/s | 2.4 MB 00:01 2024-05-08T04:18:59.823 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-05-08T04:18:59.823 INFO:teuthology.orchestra.run.smithi104.stdout:Total 11 MB/s | 220 MB 00:19 2024-05-08T04:19:00.137 INFO:teuthology.orchestra.run.smithi183.stdout:(70/156): openblas-openmp-0.3.21-2.el9.x86_64.r 4.4 MB/s | 4.7 MB 00:01 2024-05-08T04:19:00.271 INFO:teuthology.orchestra.run.smithi183.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-05-08T04:19:00.455 INFO:teuthology.orchestra.run.smithi183.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 477 kB/s | 87 kB 00:00 2024-05-08T04:19:01.042 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-05-08T04:19:01.097 INFO:teuthology.orchestra.run.smithi183.stdout:(73/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.2 MB/s | 4.4 MB 00:02 2024-05-08T04:19:01.190 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-05-08T04:19:01.190 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-05-08T04:19:01.213 INFO:teuthology.orchestra.run.smithi183.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-05-08T04:19:01.330 INFO:teuthology.orchestra.run.smithi183.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-05-08T04:19:01.447 INFO:teuthology.orchestra.run.smithi183.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 220 kB/s | 26 kB 00:00 2024-05-08T04:19:01.556 INFO:teuthology.orchestra.run.smithi183.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-05-08T04:19:01.665 INFO:teuthology.orchestra.run.smithi183.stdout:(78/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-05-08T04:19:01.773 INFO:teuthology.orchestra.run.smithi183.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-05-08T04:19:03.281 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-05-08T04:19:03.281 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-05-08T04:19:03.698 INFO:teuthology.orchestra.run.smithi183.stdout:(80/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.6 MB/s | 5.1 MB 00:01 2024-05-08T04:19:03.806 INFO:teuthology.orchestra.run.smithi183.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-05-08T04:19:03.915 INFO:teuthology.orchestra.run.smithi183.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-05-08T04:19:04.024 INFO:teuthology.orchestra.run.smithi183.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 714 kB/s | 77 kB 00:00 2024-05-08T04:19:04.141 INFO:teuthology.orchestra.run.smithi183.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-05-08T04:19:04.266 INFO:teuthology.orchestra.run.smithi183.stdout:(85/156): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-05-08T04:19:04.375 INFO:teuthology.orchestra.run.smithi183.stdout:(86/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-05-08T04:19:04.484 INFO:teuthology.orchestra.run.smithi183.stdout:(87/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-05-08T04:19:04.592 INFO:teuthology.orchestra.run.smithi183.stdout:(88/156): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-05-08T04:19:04.717 INFO:teuthology.orchestra.run.smithi183.stdout:(89/156): python3-requests-oauthlib-1.3.0-12.el 429 kB/s | 54 kB 00:00 2024-05-08T04:19:05.451 INFO:teuthology.orchestra.run.smithi183.stdout:(90/156): postgresql-server-13.14-1.el9.x86_64. 1.0 MB/s | 5.8 MB 00:05 2024-05-08T04:19:05.559 INFO:teuthology.orchestra.run.smithi183.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-05-08T04:19:05.677 INFO:teuthology.orchestra.run.smithi183.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 378 kB/s | 44 kB 00:00 2024-05-08T04:19:06.019 INFO:teuthology.orchestra.run.smithi183.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 646 kB/s | 221 kB 00:00 2024-05-08T04:19:06.119 INFO:teuthology.orchestra.run.smithi183.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 359 kB/s | 36 kB 00:00 2024-05-08T04:19:06.235 INFO:teuthology.orchestra.run.smithi183.stdout:(95/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 410 kB/s | 47 kB 00:00 2024-05-08T04:19:06.661 INFO:teuthology.orchestra.run.smithi183.stdout:(96/156): socat-1.7.4.1-5.el9.x86_64.rpm 716 kB/s | 305 kB 00:00 2024-05-08T04:19:06.770 INFO:teuthology.orchestra.run.smithi183.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-05-08T04:19:06.953 INFO:teuthology.orchestra.run.smithi183.stdout:(98/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 511 kB/s | 94 kB 00:00 2024-05-08T04:19:07.137 INFO:teuthology.orchestra.run.smithi183.stdout:(99/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 347 kB/s | 64 kB 00:00 2024-05-08T04:19:07.237 INFO:teuthology.orchestra.run.smithi183.stdout:(100/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 449 kB/s | 45 kB 00:00 2024-05-08T04:19:07.321 INFO:teuthology.orchestra.run.smithi183.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 268 kB/s | 22 kB 00:00 2024-05-08T04:19:07.454 INFO:teuthology.orchestra.run.smithi183.stdout:(102/156): protobuf-compiler-3.14.0-13.el9.x86_ 6.3 MB/s | 863 kB 00:00 2024-05-08T04:19:08.080 INFO:teuthology.orchestra.run.smithi183.stdout:(103/156): abseil-cpp-20211102.0-3.el9.x86_64.r 877 kB/s | 548 kB 00:00 2024-05-08T04:19:08.197 INFO:teuthology.orchestra.run.smithi183.stdout:(104/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-05-08T04:19:08.264 INFO:teuthology.orchestra.run.smithi183.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-05-08T04:19:08.347 INFO:teuthology.orchestra.run.smithi183.stdout:(106/156): python3-babel-2.9.1-2.el9.noarch.rpm 774 kB/s | 6.0 MB 00:07 2024-05-08T04:19:08.664 INFO:teuthology.orchestra.run.smithi183.stdout:(107/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.1 MB/s | 16 MB 00:03 2024-05-08T04:19:08.689 INFO:teuthology.orchestra.run.smithi183.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 76 kB/s | 26 kB 00:00 2024-05-08T04:19:08.748 INFO:teuthology.orchestra.run.smithi183.stdout:(109/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-05-08T04:19:08.840 INFO:teuthology.orchestra.run.smithi183.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 447 kB/s | 67 kB 00:00 2024-05-08T04:19:08.873 INFO:teuthology.orchestra.run.smithi183.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-05-08T04:19:08.949 INFO:teuthology.orchestra.run.smithi183.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-05-08T04:19:08.974 INFO:teuthology.orchestra.run.smithi183.stdout:(113/156): liboath-2.6.7-2.el9.x86_64.rpm 157 kB/s | 49 kB 00:00 2024-05-08T04:19:09.032 INFO:teuthology.orchestra.run.smithi183.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 520 kB/s | 43 kB 00:00 2024-05-08T04:19:09.074 INFO:teuthology.orchestra.run.smithi183.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2024-05-08T04:19:09.100 INFO:teuthology.orchestra.run.smithi183.stdout:(116/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.2 MB/s | 839 kB 00:00 2024-05-08T04:19:09.125 INFO:teuthology.orchestra.run.smithi183.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 162 kB/s | 15 kB 00:00 2024-05-08T04:19:09.218 INFO:teuthology.orchestra.run.smithi183.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-05-08T04:19:09.242 INFO:teuthology.orchestra.run.smithi183.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-05-08T04:19:09.293 INFO:teuthology.orchestra.run.smithi183.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 468 kB/s | 35 kB 00:00 2024-05-08T04:19:09.318 INFO:teuthology.orchestra.run.smithi183.stdout:(121/156): python3-cheroot-8.6.0-4.el9.noarch.r 706 kB/s | 172 kB 00:00 2024-05-08T04:19:09.343 INFO:teuthology.orchestra.run.smithi183.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-05-08T04:19:09.402 INFO:teuthology.orchestra.run.smithi183.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2024-05-08T04:19:09.427 INFO:teuthology.orchestra.run.smithi183.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-05-08T04:19:09.453 INFO:teuthology.orchestra.run.smithi183.stdout:(125/156): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-05-08T04:19:09.478 INFO:teuthology.orchestra.run.smithi183.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-05-08T04:19:09.503 INFO:teuthology.orchestra.run.smithi183.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-05-08T04:19:09.528 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-05-08T04:19:09.528 INFO:teuthology.orchestra.run.smithi183.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-05-08T04:19:09.553 INFO:teuthology.orchestra.run.smithi183.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-05-08T04:19:09.613 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T04:19:09.620 INFO:teuthology.orchestra.run.smithi183.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-05-08T04:19:09.645 INFO:teuthology.orchestra.run.smithi183.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 395 kB/s | 46 kB 00:00 2024-05-08T04:19:09.650 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T04:19:09.662 INFO:teuthology.orchestra.run.smithi183.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 726 kB/s | 79 kB 00:00 2024-05-08T04:19:09.688 INFO:teuthology.orchestra.run.smithi183.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 861 kB/s | 58 kB 00:00 2024-05-08T04:19:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T04:19:09.738 INFO:teuthology.orchestra.run.smithi183.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-05-08T04:19:09.754 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T04:19:09.763 INFO:teuthology.orchestra.run.smithi183.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-05-08T04:19:09.780 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T04:19:09.788 INFO:teuthology.orchestra.run.smithi183.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-05-08T04:19:09.842 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T04:19:09.981 INFO:teuthology.orchestra.run.smithi183.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 116 kB/s | 28 kB 00:00 2024-05-08T04:19:10.006 INFO:teuthology.orchestra.run.smithi183.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 127 kB/s | 31 kB 00:00 2024-05-08T04:19:10.031 INFO:teuthology.orchestra.run.smithi183.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 778 kB/s | 188 kB 00:00 2024-05-08T04:19:10.057 INFO:teuthology.orchestra.run.smithi183.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-05-08T04:19:10.090 INFO:teuthology.orchestra.run.smithi183.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 427 kB/s | 36 kB 00:00 2024-05-08T04:19:10.115 INFO:teuthology.orchestra.run.smithi183.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 608 kB/s | 51 kB 00:00 2024-05-08T04:19:10.141 INFO:teuthology.orchestra.run.smithi183.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-08T04:19:10.166 INFO:teuthology.orchestra.run.smithi183.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-05-08T04:19:10.179 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T04:19:10.208 INFO:teuthology.orchestra.run.smithi183.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-05-08T04:19:10.233 INFO:teuthology.orchestra.run.smithi183.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-05-08T04:19:10.258 INFO:teuthology.orchestra.run.smithi183.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-05-08T04:19:10.290 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librados2-2:19.0.0-1629.g4f7075d1.el9.x86_64 8/164 2024-05-08T04:19:10.375 INFO:teuthology.orchestra.run.smithi183.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-05-08T04:19:10.415 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:19.0.0-1629.g4f7075d1.el9.x86_64 8/164 2024-05-08T04:19:10.441 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs2-2:19.0.0-1629.g4f7075d1.el9.x86_64 9/164 2024-05-08T04:19:10.531 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs2-2:19.0.0-1629.g4f7075d1.el9.x86_64 9/164 2024-05-08T04:19:10.562 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rados-2:19.0.0-1629.g4f7075d1.el9.x86_64 10/164 2024-05-08T04:19:10.617 INFO:teuthology.orchestra.run.smithi183.stdout:(149/156): librbd1-19.0.0-1629.g4f7075d1.el9.x8 8.7 MB/s | 3.1 MB 00:00 2024-05-08T04:19:10.693 INFO:teuthology.orchestra.run.smithi183.stdout:(150/156): NetworkManager-1.47.5-1.el9.x86_64.r 7.3 MB/s | 2.3 MB 00:00 2024-05-08T04:19:10.751 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T04:19:10.751 INFO:teuthology.orchestra.run.smithi183.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 720 kB/s | 42 kB 00:00 2024-05-08T04:19:10.810 INFO:teuthology.orchestra.run.smithi183.stdout:(152/156): librados2-19.0.0-1629.g4f7075d1.el9. 5.9 MB/s | 3.4 MB 00:00 2024-05-08T04:19:10.817 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T04:19:10.843 INFO:teuthology.orchestra.run.smithi183.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.6 MB/s | 248 kB 00:00 2024-05-08T04:19:10.845 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephsqlite-2:19.0.0-1629.g4f7075d1.el9.x86_64 13/164 2024-05-08T04:19:10.931 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1629.g4f7075d1.el9.x86_64 13/164 2024-05-08T04:19:10.954 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libradosstriper1-2:19.0.0-1629.g4f7075d1.el9.x86 14/164 2024-05-08T04:19:10.960 INFO:teuthology.orchestra.run.smithi183.stdout:(154/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-05-08T04:19:10.994 INFO:teuthology.orchestra.run.smithi183.stdout:(155/156): NetworkManager-libnm-1.47.5-1.el9.x8 4.9 MB/s | 1.8 MB 00:00 2024-05-08T04:19:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1629.g4f7075d1.el9.x86 14/164 2024-05-08T04:19:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T04:19:11.054 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T04:19:11.169 INFO:teuthology.orchestra.run.smithi183.stdout:(156/156): openssl-3.2.1-1.el9.x86_64.rpm 3.8 MB/s | 1.3 MB 00:00 2024-05-08T04:19:11.175 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-05-08T04:19:11.175 INFO:teuthology.orchestra.run.smithi183.stdout:Total 11 MB/s | 220 MB 00:19 2024-05-08T04:19:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T04:19:11.415 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T04:19:11.552 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T04:19:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T04:19:11.730 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T04:19:11.805 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T04:19:12.008 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T04:19:12.113 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T04:19:12.214 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T04:19:12.248 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-05-08T04:19:12.295 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-05-08T04:19:12.328 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-05-08T04:19:12.360 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-05-08T04:19:12.394 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-05-08T04:19:12.437 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-05-08T04:19:12.470 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-05-08T04:19:12.477 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-05-08T04:19:12.478 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-05-08T04:19:12.498 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-05-08T04:19:12.568 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-05-08T04:19:12.621 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/164 2024-05-08T04:19:12.651 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-05-08T04:19:12.695 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/164 2024-05-08T04:19:12.770 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/164 2024-05-08T04:19:12.805 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-common-2:19.0.0-1629.g4f7075d1.el9. 33/164 2024-05-08T04:19:12.849 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-argparse-2:19.0.0-1629.g4f7075d1.el 34/164 2024-05-08T04:19:12.877 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cephfs-2:19.0.0-1629.g4f7075d1.el9.x86_6 35/164 2024-05-08T04:19:12.947 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-05-08T04:19:13.000 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/164 2024-05-08T04:19:13.074 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-05-08T04:19:13.232 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-05-08T04:19:13.285 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-05-08T04:19:13.807 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-05-08T04:19:13.897 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-05-08T04:19:13.927 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/164 2024-05-08T04:19:13.969 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-05-08T04:19:14.008 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librados-devel-2:19.0.0-1629.g4f7075d1.el9.x86_6 45/164 2024-05-08T04:19:14.050 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-05-08T04:19:14.192 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/164 2024-05-08T04:19:14.235 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/164 2024-05-08T04:19:14.289 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-05-08T04:19:14.363 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T04:19:14.394 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T04:19:14.430 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T04:19:14.478 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T04:19:14.513 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T04:19:14.546 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-05-08T04:19:14.547 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-05-08T04:19:14.556 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T04:19:14.607 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T04:19:14.742 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T04:19:14.804 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T04:19:14.834 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T04:19:14.875 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T04:19:15.045 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T04:19:15.076 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T04:19:15.118 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T04:19:15.141 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T04:19:15.166 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T04:19:15.260 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T04:19:15.392 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T04:19:15.431 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T04:19:15.468 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T04:19:15.502 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T04:19:15.541 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T04:19:15.572 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T04:19:15.602 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T04:19:15.645 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T04:19:15.678 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T04:19:15.719 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T04:19:15.754 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T04:19:15.842 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T04:19:15.885 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T04:19:15.915 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T04:19:15.963 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T04:19:16.061 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T04:19:16.109 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T04:19:16.829 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T04:19:16.880 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T04:19:16.914 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T04:19:17.023 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T04:19:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T04:19:17.176 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T04:19:17.208 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T04:19:17.383 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T04:19:17.414 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T04:19:17.501 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T04:19:18.154 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T04:19:18.269 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T04:19:19.525 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T04:19:19.587 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T04:19:19.615 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T04:19:19.648 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T04:19:19.965 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T04:19:20.011 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librbd1-2:19.0.0-1629.g4f7075d1.el9.x86_64 101/164 2024-05-08T04:19:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:19.0.0-1629.g4f7075d1.el9.x86_64 101/164 2024-05-08T04:19:20.133 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rbd-2:19.0.0-1629.g4f7075d1.el9.x86_64 102/164 2024-05-08T04:19:20.169 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T04:19:20.621 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T04:19:20.656 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librgw2-2:19.0.0-1629.g4f7075d1.el9.x86_64 105/164 2024-05-08T04:19:20.681 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-05-08T04:19:20.727 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librgw2-2:19.0.0-1629.g4f7075d1.el9.x86_64 105/164 2024-05-08T04:19:20.757 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T04:19:20.757 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 106/164 2024-05-08T04:19:20.795 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T04:19:20.866 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T04:19:20.899 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T04:19:20.924 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T04:19:20.974 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T04:19:21.370 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T04:19:21.436 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:19.0.0-1629.g4f7075d1.el9.x86_64 8/164 2024-05-08T04:19:21.558 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:19.0.0-1629.g4f7075d1.el9.x86_64 8/164 2024-05-08T04:19:21.586 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:19.0.0-1629.g4f7075d1.el9.x86_64 9/164 2024-05-08T04:19:21.677 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:19.0.0-1629.g4f7075d1.el9.x86_64 9/164 2024-05-08T04:19:21.698 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:19.0.0-1629.g4f7075d1.el9.x86_64 10/164 2024-05-08T04:19:21.882 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T04:19:21.946 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T04:19:21.972 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephsqlite-2:19.0.0-1629.g4f7075d1.el9.x86_64 13/164 2024-05-08T04:19:22.077 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1629.g4f7075d1.el9.x86_64 13/164 2024-05-08T04:19:22.107 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:19.0.0-1629.g4f7075d1.el9.x86 14/164 2024-05-08T04:19:22.161 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1629.g4f7075d1.el9.x86 14/164 2024-05-08T04:19:22.183 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T04:19:22.205 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T04:19:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T04:19:22.564 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T04:19:22.732 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T04:19:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T04:19:22.919 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T04:19:22.961 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.0.0-1629.g4f7075d1.el9.x86_64 107/164 2024-05-08T04:19:22.975 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T04:19:22.995 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-common-2:19.0.0-1629.g4f7075d1.el9.x86_64 107/164 2024-05-08T04:19:23.168 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T04:19:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T04:19:23.365 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T04:19:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-05-08T04:19:23.439 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-05-08T04:19:23.503 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-05-08T04:19:23.547 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-05-08T04:19:23.557 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.0.0-1629.g4f7075d1.el9.x86_64 107/164 2024-05-08T04:19:23.590 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-05-08T04:19:23.598 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-base-2:19.0.0-1629.g4f7075d1.el9.x86_64 108/164 2024-05-08T04:19:23.623 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-05-08T04:19:23.651 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-05-08T04:19:23.688 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-base-2:19.0.0-1629.g4f7075d1.el9.x86_64 108/164 2024-05-08T04:19:23.688 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T04:19:23.688 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T04:19:23.689 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:19:23.717 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-05-08T04:19:23.724 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-selinux-2:19.0.0-1629.g4f7075d1.el9.x86_64 109/164 2024-05-08T04:19:23.772 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/164 2024-05-08T04:19:23.804 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-05-08T04:19:23.847 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/164 2024-05-08T04:19:23.922 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/164 2024-05-08T04:19:23.958 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:19.0.0-1629.g4f7075d1.el9. 33/164 2024-05-08T04:19:24.002 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:19.0.0-1629.g4f7075d1.el 34/164 2024-05-08T04:19:24.030 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:19.0.0-1629.g4f7075d1.el9.x86_6 35/164 2024-05-08T04:19:24.098 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-05-08T04:19:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/164 2024-05-08T04:19:24.218 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-05-08T04:19:24.349 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-05-08T04:19:24.405 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-05-08T04:19:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-05-08T04:19:25.008 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-05-08T04:19:25.047 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/164 2024-05-08T04:19:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-05-08T04:19:25.127 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:19.0.0-1629.g4f7075d1.el9.x86_6 45/164 2024-05-08T04:19:25.170 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-05-08T04:19:25.338 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/164 2024-05-08T04:19:25.397 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/164 2024-05-08T04:19:25.451 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-05-08T04:19:25.515 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T04:19:25.556 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T04:19:25.593 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T04:19:25.639 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T04:19:25.675 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T04:19:25.718 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T04:19:25.760 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T04:19:25.893 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T04:19:25.932 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T04:19:25.963 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T04:19:26.004 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T04:19:26.096 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T04:19:26.138 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T04:19:26.179 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T04:19:26.220 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T04:19:26.245 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T04:19:26.343 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T04:19:26.470 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T04:19:26.502 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T04:19:26.531 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T04:19:26.564 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T04:19:26.603 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T04:19:26.651 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T04:19:26.682 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T04:19:26.716 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T04:19:26.749 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T04:19:26.791 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T04:19:26.825 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T04:19:26.911 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T04:19:26.962 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T04:19:26.995 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T04:19:27.041 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T04:19:27.139 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T04:19:27.188 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T04:19:27.932 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T04:19:27.985 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T04:19:28.019 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T04:19:28.116 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T04:19:28.168 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T04:19:28.255 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T04:19:28.287 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T04:19:28.464 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T04:19:28.493 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T04:19:28.572 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T04:19:29.225 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T04:19:29.357 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T04:19:30.590 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T04:19:30.664 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T04:19:30.691 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T04:19:30.725 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T04:19:31.040 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T04:19:31.088 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:19.0.0-1629.g4f7075d1.el9.x86_64 101/164 2024-05-08T04:19:31.178 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:19.0.0-1629.g4f7075d1.el9.x86_64 101/164 2024-05-08T04:19:31.209 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:19.0.0-1629.g4f7075d1.el9.x86_64 102/164 2024-05-08T04:19:31.245 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T04:19:31.700 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T04:19:31.723 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:19.0.0-1629.g4f7075d1.el9.x86_64 105/164 2024-05-08T04:19:31.795 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:19.0.0-1629.g4f7075d1.el9.x86_64 105/164 2024-05-08T04:19:31.817 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 106/164 2024-05-08T04:19:33.972 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.0.0-1629.g4f7075d1.el9.x86_64 107/164 2024-05-08T04:19:34.013 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:19.0.0-1629.g4f7075d1.el9.x86_64 107/164 2024-05-08T04:19:34.570 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.0.0-1629.g4f7075d1.el9.x86_64 107/164 2024-05-08T04:19:34.608 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:19.0.0-1629.g4f7075d1.el9.x86_64 108/164 2024-05-08T04:19:34.698 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:19.0.0-1629.g4f7075d1.el9.x86_64 108/164 2024-05-08T04:19:34.698 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T04:19:34.698 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T04:19:34.698 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:19:34.743 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:19.0.0-1629.g4f7075d1.el9.x86_64 109/164 2024-05-08T04:19:35.599 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1629.g4f7075d1.el9.x86_64 109/164 2024-05-08T04:19:35.599 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /sys 2024-05-08T04:19:35.600 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /proc 2024-05-08T04:19:35.600 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /mnt 2024-05-08T04:19:35.600 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /var/tmp 2024-05-08T04:19:35.600 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /home 2024-05-08T04:19:35.600 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /root 2024-05-08T04:19:35.600 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /tmp 2024-05-08T04:19:35.600 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:19:35.763 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-volume-2:19.0.0-1629.g4f7075d1.el9.noarch 110/164 2024-05-08T04:19:35.782 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-volume-2:19.0.0-1629.g4f7075d1.el9.noarch 110/164 2024-05-08T04:19:35.782 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:35.782 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T04:19:35.782 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:19:37.282 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-osd-2:19.0.0-1629.g4f7075d1.el9.x86_64 111/164 2024-05-08T04:19:37.309 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-osd-2:19.0.0-1629.g4f7075d1.el9.x86_64 111/164 2024-05-08T04:19:37.309 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:37.309 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T04:19:37.309 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T04:19:37.310 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T04:19:37.310 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:19:37.516 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mds-2:19.0.0-1629.g4f7075d1.el9.x86_64 112/164 2024-05-08T04:19:37.540 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mds-2:19.0.0-1629.g4f7075d1.el9.x86_64 112/164 2024-05-08T04:19:37.540 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:37.540 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T04:19:37.540 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T04:19:37.540 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T04:19:37.540 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:19:37.983 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mon-2:19.0.0-1629.g4f7075d1.el9.x86_64 113/164 2024-05-08T04:19:38.007 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mon-2:19.0.0-1629.g4f7075d1.el9.x86_64 113/164 2024-05-08T04:19:38.007 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:38.007 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T04:19:38.007 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T04:19:38.007 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T04:19:38.007 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:19:38.121 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T04:19:38.170 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T04:19:38.225 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T04:19:38.412 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T04:19:38.484 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T04:19:38.561 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T04:19:38.650 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T04:19:38.788 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T04:19:38.834 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T04:19:38.866 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T04:19:38.893 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T04:19:39.381 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:19.0.0-1629.g4f7075d1.el9.noarch 125/164 2024-05-08T04:19:39.409 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephadm-2:19.0.0-1629.g4f7075d1.el9.noarch 125/164 2024-05-08T04:19:39.440 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1629.g4f7075d1.e 126/164 2024-05-08T04:19:39.501 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1629.g4f7075d1. 127/164 2024-05-08T04:19:39.532 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1629.g4f7075d1.el9.noa 128/164 2024-05-08T04:19:39.759 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1629.g4f7075d1.el9.noa 128/164 2024-05-08T04:19:39.799 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1629.g4f7075d1.el9.n 129/164 2024-05-08T04:19:40.758 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1629.g4f7075d1.el9.n 129/164 2024-05-08T04:19:40.791 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1629.g4f7 130/164 2024-05-08T04:19:40.893 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1629.g4f7 130/164 2024-05-08T04:19:41.053 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1629.g4f7075d1.el 131/164 2024-05-08T04:19:41.085 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-2:19.0.0-1629.g4f7075d1.el9.x86_64 132/164 2024-05-08T04:19:41.109 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1629.g4f7075d1.el9.x86_64 132/164 2024-05-08T04:19:41.109 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:41.109 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T04:19:41.109 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T04:19:41.109 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T04:19:41.109 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:19:41.160 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-rook-2:19.0.0-1629.g4f7075d1.el9.noarch 133/164 2024-05-08T04:19:41.172 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1629.g4f7075d1.el9.noarch 133/164 2024-05-08T04:19:41.269 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-2:19.0.0-1629.g4f7075d1.el9.x86_64 134/164 2024-05-08T04:19:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-fuse-2:19.0.0-1629.g4f7075d1.el9.x86_64 135/164 2024-05-08T04:19:42.183 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T04:19:42.213 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-radosgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 137/164 2024-05-08T04:19:42.237 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 137/164 2024-05-08T04:19:42.237 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:42.237 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T04:19:42.237 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T04:19:42.237 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T04:19:42.237 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:19:42.289 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1629.g4f707 138/164 2024-05-08T04:19:42.312 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1629.g4f707 138/164 2024-05-08T04:19:42.312 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:42.312 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T04:19:42.312 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:19:42.356 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 139/164 2024-05-08T04:19:42.379 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 139/164 2024-05-08T04:19:42.379 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:42.379 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T04:19:42.380 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T04:19:42.380 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T04:19:42.380 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:19:42.682 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 140/164 2024-05-08T04:19:42.705 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 140/164 2024-05-08T04:19:42.705 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:42.705 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T04:19:42.705 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T04:19:42.705 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T04:19:42.705 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:19:46.332 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1629.g4f7075d1.el9.x86_64 109/164 2024-05-08T04:19:46.333 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2024-05-08T04:19:46.333 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2024-05-08T04:19:46.333 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2024-05-08T04:19:46.333 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2024-05-08T04:19:46.333 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2024-05-08T04:19:46.333 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /root 2024-05-08T04:19:46.333 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2024-05-08T04:19:46.333 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:19:46.498 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-volume-2:19.0.0-1629.g4f7075d1.el9.noarch 110/164 2024-05-08T04:19:46.513 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-volume-2:19.0.0-1629.g4f7075d1.el9.noarch 110/164 2024-05-08T04:19:46.513 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:46.513 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T04:19:46.514 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:19:47.133 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-test-2:19.0.0-1629.g4f7075d1.el9.x86_64 141/164 2024-05-08T04:19:47.175 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-fuse-2:19.0.0-1629.g4f7075d1.el9.x86_64 142/164 2024-05-08T04:19:47.216 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-nbd-2:19.0.0-1629.g4f7075d1.el9.x86_64 143/164 2024-05-08T04:19:47.249 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T04:19:47.276 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T04:19:47.477 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-shell-2:19.0.0-1629.g4f7075d1.el9.x86_64 146/164 2024-05-08T04:19:47.522 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T04:19:47.552 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs-devel-2:19.0.0-1629.g4f7075d1.el9.x86_ 148/164 2024-05-08T04:19:47.581 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T04:19:47.628 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T04:19:47.984 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:19.0.0-1629.g4f7075d1.el9.x86_64 111/164 2024-05-08T04:19:48.011 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:19.0.0-1629.g4f7075d1.el9.x86_64 111/164 2024-05-08T04:19:48.011 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:48.011 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T04:19:48.011 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T04:19:48.011 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T04:19:48.011 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:19:48.218 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:19.0.0-1629.g4f7075d1.el9.x86_64 112/164 2024-05-08T04:19:48.229 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T04:19:48.241 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:19.0.0-1629.g4f7075d1.el9.x86_64 112/164 2024-05-08T04:19:48.241 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:48.241 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T04:19:48.242 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T04:19:48.242 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T04:19:48.242 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:19:48.267 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T04:19:48.288 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T04:19:48.685 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:19.0.0-1629.g4f7075d1.el9.x86_64 113/164 2024-05-08T04:19:48.754 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:19.0.0-1629.g4f7075d1.el9.x86_64 113/164 2024-05-08T04:19:48.754 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:48.754 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T04:19:48.754 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T04:19:48.754 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T04:19:48.754 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:19:48.815 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T04:19:48.863 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T04:19:48.920 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T04:19:49.103 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T04:19:49.122 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-top-2:19.0.0-1629.g4f7075d1.el9.noarch 152/164 2024-05-08T04:19:49.152 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T04:19:49.229 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T04:19:49.232 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T04:19:49.286 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T04:19:49.318 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T04:19:49.370 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T04:19:49.408 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T04:19:49.434 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T04:19:49.434 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T04:19:49.457 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T04:19:49.503 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T04:19:49.534 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T04:19:49.535 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T04:19:49.562 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T04:19:49.568 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T04:19:49.568 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T04:19:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T04:19:49.677 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T04:19:49.683 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T04:19:49.684 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T04:19:49.872 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T04:19:49.872 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T04:19:49.964 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T04:19:50.021 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:19.0.0-1629.g4f7075d1.el9.noarch 125/164 2024-05-08T04:19:50.029 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T04:19:50.051 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephadm-2:19.0.0-1629.g4f7075d1.el9.noarch 125/164 2024-05-08T04:19:50.083 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1629.g4f7075d1.e 126/164 2024-05-08T04:19:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1629.g4f7075d1. 127/164 2024-05-08T04:19:50.166 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1629.g4f7075d1.el9.noa 128/164 2024-05-08T04:19:50.392 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1629.g4f7075d1.el9.noa 128/164 2024-05-08T04:19:50.425 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1629.g4f7075d1.el9.n 129/164 2024-05-08T04:19:51.383 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1629.g4f7075d1.el9.n 129/164 2024-05-08T04:19:51.409 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1629.g4f7 130/164 2024-05-08T04:19:51.511 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1629.g4f7 130/164 2024-05-08T04:19:51.671 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1629.g4f7075d1.el 131/164 2024-05-08T04:19:51.711 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:19.0.0-1629.g4f7075d1.el9.x86_64 132/164 2024-05-08T04:19:51.734 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1629.g4f7075d1.el9.x86_64 132/164 2024-05-08T04:19:51.734 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:51.735 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T04:19:51.735 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T04:19:51.735 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T04:19:51.735 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:19:51.778 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-rook-2:19.0.0-1629.g4f7075d1.el9.noarch 133/164 2024-05-08T04:19:51.789 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1629.g4f7075d1.el9.noarch 133/164 2024-05-08T04:19:51.911 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:19.0.0-1629.g4f7075d1.el9.x86_64 134/164 2024-05-08T04:19:51.971 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:19.0.0-1629.g4f7075d1.el9.x86_64 135/164 2024-05-08T04:19:52.829 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T04:19:52.856 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 137/164 2024-05-08T04:19:52.879 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 137/164 2024-05-08T04:19:52.879 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:52.879 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T04:19:52.879 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T04:19:52.879 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T04:19:52.880 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:19:52.923 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1629.g4f707 138/164 2024-05-08T04:19:52.945 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1629.g4f707 138/164 2024-05-08T04:19:52.946 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:52.946 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T04:19:52.946 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:19:52.998 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 139/164 2024-05-08T04:19:53.022 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 139/164 2024-05-08T04:19:53.022 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:53.022 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T04:19:53.022 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T04:19:53.022 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T04:19:53.023 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:19:53.324 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 140/164 2024-05-08T04:19:53.347 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 140/164 2024-05-08T04:19:53.347 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T04:19:53.347 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T04:19:53.347 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T04:19:53.347 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T04:19:53.348 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:19:54.748 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-2:19.0.0-1629.g4f7075d1.el9.x86_64 1/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-base-2:19.0.0-1629.g4f7075d1.el9.x86_64 2/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-common-2:19.0.0-1629.g4f7075d1.el9.x86_64 3/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-fuse-2:19.0.0-1629.g4f7075d1.el9.x86_64 4/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1629.g4f707 5/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mds-2:19.0.0-1629.g4f7075d1.el9.x86_64 6/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-2:19.0.0-1629.g4f7075d1.el9.x86_64 7/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mon-2:19.0.0-1629.g4f7075d1.el9.x86_64 8/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-osd-2:19.0.0-1629.g4f7075d1.el9.x86_64 9/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-radosgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 10/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-selinux-2:19.0.0-1629.g4f7075d1.el9.x86_64 11/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-test-2:19.0.0-1629.g4f7075d1.el9.x86_64 12/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 13/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-shell-2:19.0.0-1629.g4f7075d1.el9.x86_64 14/164 2024-05-08T04:19:54.749 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs-devel-2:19.0.0-1629.g4f7075d1.el9.x86_ 15/164 2024-05-08T04:19:54.750 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs2-2:19.0.0-1629.g4f7075d1.el9.x86_64 16/164 2024-05-08T04:19:54.750 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephsqlite-2:19.0.0-1629.g4f7075d1.el9.x86_64 17/164 2024-05-08T04:19:54.750 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados-devel-2:19.0.0-1629.g4f7075d1.el9.x86_6 18/164 2024-05-08T04:19:54.750 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libradosstriper1-2:19.0.0-1629.g4f7075d1.el9.x86 19/164 2024-05-08T04:19:54.750 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librgw2-2:19.0.0-1629.g4f7075d1.el9.x86_64 20/164 2024-05-08T04:19:54.750 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1629.g4f7075d1.el 21/164 2024-05-08T04:19:54.750 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-common-2:19.0.0-1629.g4f7075d1.el9. 22/164 2024-05-08T04:19:54.750 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cephfs-2:19.0.0-1629.g4f7075d1.el9.x86_6 23/164 2024-05-08T04:19:54.750 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rados-2:19.0.0-1629.g4f7075d1.el9.x86_64 24/164 2024-05-08T04:19:54.750 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rbd-2:19.0.0-1629.g4f7075d1.el9.x86_64 25/164 2024-05-08T04:19:54.750 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 26/164 2024-05-08T04:19:54.750 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-fuse-2:19.0.0-1629.g4f7075d1.el9.x86_64 27/164 2024-05-08T04:19:54.750 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 28/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-nbd-2:19.0.0-1629.g4f7075d1.el9.x86_64 29/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1629.g4f7075d1. 30/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1629.g4f7075d1.el9.noa 31/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1629.g4f7075d1.el9.n 32/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1629.g4f7 33/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1629.g4f7075d1.el 34/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1629.g4f7075d1.el9.noarch 35/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1629.g4f7075d1.e 36/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-volume-2:19.0.0-1629.g4f7075d1.el9.noarch 37/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephadm-2:19.0.0-1629.g4f7075d1.el9.noarch 38/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-top-2:19.0.0-1629.g4f7075d1.el9.noarch 39/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T04:19:54.751 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T04:19:54.752 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T04:19:54.753 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T04:19:54.754 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T04:19:54.755 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T04:19:54.756 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T04:19:54.757 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T04:19:54.757 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T04:19:54.757 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T04:19:54.757 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T04:19:54.757 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T04:19:54.757 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T04:19:54.757 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T04:19:54.757 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T04:19:54.757 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T04:19:54.757 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T04:19:54.757 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T04:19:54.757 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T04:19:54.757 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T04:19:54.758 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:19.0.0-1629.g4f7075d1.el9.x86_64 149/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:19.0.0-1629.g4f7075d1.el9.x86_64 151/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T04:19:54.759 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T04:19:54.760 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T04:19:57.521 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T04:19:57.521 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:19:57.521 INFO:teuthology.orchestra.run.smithi104.stdout:Upgraded: 2024-05-08T04:19:57.521 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T04:19:57.521 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T04:19:57.521 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T04:19:57.522 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T04:19:57.522 INFO:teuthology.orchestra.run.smithi104.stdout: librados2-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.522 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.522 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T04:19:57.522 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T04:19:57.522 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-05-08T04:19:57.522 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T04:19:57.522 INFO:teuthology.orchestra.run.smithi104.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T04:19:57.522 INFO:teuthology.orchestra.run.smithi104.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T04:19:57.522 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T04:19:57.522 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.522 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.522 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.523 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-shell-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T04:19:57.524 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T04:19:57.525 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T04:19:57.525 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T04:19:57.525 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T04:19:57.525 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.525 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.525 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.525 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T04:19:57.525 INFO:teuthology.orchestra.run.smithi104.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T04:19:57.525 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T04:19:57.525 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T04:19:57.525 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T04:19:57.525 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.525 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T04:19:57.526 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T04:19:57.527 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T04:19:57.527 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T04:19:57.527 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T04:19:57.527 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T04:19:57.527 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T04:19:57.527 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T04:19:57.527 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T04:19:57.527 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T04:19:57.527 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T04:19:57.527 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T04:19:57.527 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T04:19:57.527 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.527 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T04:19:57.528 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T04:19:57.529 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T04:19:57.530 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T04:19:57.530 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T04:19:57.530 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T04:19:57.530 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T04:19:57.530 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T04:19:57.530 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T04:19:57.530 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T04:19:57.530 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T04:19:57.530 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T04:19:57.530 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T04:19:57.530 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T04:19:57.530 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T04:19:57.530 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T04:19:57.531 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T04:19:57.532 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T04:19:57.533 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T04:19:57.533 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:19:57.533 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-05-08T04:19:57.770 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:19.0.0-1629.g4f7075d1.el9.x86_64 141/164 2024-05-08T04:19:57.810 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:19.0.0-1629.g4f7075d1.el9.x86_64 142/164 2024-05-08T04:19:57.859 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:19.0.0-1629.g4f7075d1.el9.x86_64 143/164 2024-05-08T04:19:57.891 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T04:19:57.918 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T04:19:57.958 DEBUG:teuthology.parallel:result is None 2024-05-08T04:19:58.116 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-shell-2:19.0.0-1629.g4f7075d1.el9.x86_64 146/164 2024-05-08T04:19:58.164 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T04:19:58.194 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:19.0.0-1629.g4f7075d1.el9.x86_ 148/164 2024-05-08T04:19:58.224 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T04:19:58.262 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T04:19:58.885 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T04:19:58.926 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T04:19:58.946 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T04:19:59.768 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-top-2:19.0.0-1629.g4f7075d1.el9.noarch 152/164 2024-05-08T04:19:59.855 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T04:19:59.901 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T04:20:00.014 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T04:20:00.049 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T04:20:00.075 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T04:20:00.075 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T04:20:00.159 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T04:20:00.184 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T04:20:00.184 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T04:20:00.269 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T04:20:00.302 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T04:20:00.307 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T04:20:00.307 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T04:20:00.497 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T04:20:00.497 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T04:20:00.588 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T04:20:00.653 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T04:20:05.542 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T04:20:05.542 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:19.0.0-1629.g4f7075d1.el9.x86_64 1/164 2024-05-08T04:20:05.542 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:19.0.0-1629.g4f7075d1.el9.x86_64 2/164 2024-05-08T04:20:05.542 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:19.0.0-1629.g4f7075d1.el9.x86_64 3/164 2024-05-08T04:20:05.542 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:19.0.0-1629.g4f7075d1.el9.x86_64 4/164 2024-05-08T04:20:05.543 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1629.g4f707 5/164 2024-05-08T04:20:05.543 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:19.0.0-1629.g4f7075d1.el9.x86_64 6/164 2024-05-08T04:20:05.543 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:19.0.0-1629.g4f7075d1.el9.x86_64 7/164 2024-05-08T04:20:05.543 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:19.0.0-1629.g4f7075d1.el9.x86_64 8/164 2024-05-08T04:20:05.543 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:19.0.0-1629.g4f7075d1.el9.x86_64 9/164 2024-05-08T04:20:05.543 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 10/164 2024-05-08T04:20:05.543 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:19.0.0-1629.g4f7075d1.el9.x86_64 11/164 2024-05-08T04:20:05.543 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:19.0.0-1629.g4f7075d1.el9.x86_64 12/164 2024-05-08T04:20:05.543 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 13/164 2024-05-08T04:20:05.543 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-shell-2:19.0.0-1629.g4f7075d1.el9.x86_64 14/164 2024-05-08T04:20:05.543 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:19.0.0-1629.g4f7075d1.el9.x86_ 15/164 2024-05-08T04:20:05.543 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:19.0.0-1629.g4f7075d1.el9.x86_64 16/164 2024-05-08T04:20:05.543 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephsqlite-2:19.0.0-1629.g4f7075d1.el9.x86_64 17/164 2024-05-08T04:20:05.544 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:19.0.0-1629.g4f7075d1.el9.x86_6 18/164 2024-05-08T04:20:05.544 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:19.0.0-1629.g4f7075d1.el9.x86 19/164 2024-05-08T04:20:05.544 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:19.0.0-1629.g4f7075d1.el9.x86_64 20/164 2024-05-08T04:20:05.544 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1629.g4f7075d1.el 21/164 2024-05-08T04:20:05.544 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:19.0.0-1629.g4f7075d1.el9. 22/164 2024-05-08T04:20:05.544 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:19.0.0-1629.g4f7075d1.el9.x86_6 23/164 2024-05-08T04:20:05.544 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:19.0.0-1629.g4f7075d1.el9.x86_64 24/164 2024-05-08T04:20:05.544 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:19.0.0-1629.g4f7075d1.el9.x86_64 25/164 2024-05-08T04:20:05.544 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 26/164 2024-05-08T04:20:05.544 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:19.0.0-1629.g4f7075d1.el9.x86_64 27/164 2024-05-08T04:20:05.544 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 28/164 2024-05-08T04:20:05.557 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:19.0.0-1629.g4f7075d1.el9.x86_64 29/164 2024-05-08T04:20:05.557 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1629.g4f7075d1. 30/164 2024-05-08T04:20:05.557 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1629.g4f7075d1.el9.noa 31/164 2024-05-08T04:20:05.557 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1629.g4f7075d1.el9.n 32/164 2024-05-08T04:20:05.557 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1629.g4f7 33/164 2024-05-08T04:20:05.557 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1629.g4f7075d1.el 34/164 2024-05-08T04:20:05.557 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1629.g4f7075d1.el9.noarch 35/164 2024-05-08T04:20:05.557 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1629.g4f7075d1.e 36/164 2024-05-08T04:20:05.557 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-volume-2:19.0.0-1629.g4f7075d1.el9.noarch 37/164 2024-05-08T04:20:05.557 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephadm-2:19.0.0-1629.g4f7075d1.el9.noarch 38/164 2024-05-08T04:20:05.557 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-top-2:19.0.0-1629.g4f7075d1.el9.noarch 39/164 2024-05-08T04:20:05.557 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T04:20:05.558 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T04:20:05.558 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T04:20:05.558 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T04:20:05.558 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T04:20:05.558 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T04:20:05.558 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T04:20:05.558 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T04:20:05.558 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T04:20:05.558 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T04:20:05.558 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T04:20:05.559 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T04:20:05.560 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T04:20:05.560 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T04:20:05.560 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T04:20:05.560 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T04:20:05.560 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T04:20:05.560 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T04:20:05.560 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T04:20:05.560 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T04:20:05.560 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T04:20:05.560 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T04:20:05.560 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T04:20:05.560 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T04:20:05.560 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T04:20:05.561 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T04:20:05.562 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T04:20:05.563 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T04:20:05.563 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T04:20:05.563 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T04:20:05.563 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T04:20:05.563 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T04:20:05.563 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T04:20:05.563 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T04:20:05.563 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T04:20:05.563 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T04:20:05.563 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T04:20:05.563 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T04:20:05.563 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T04:20:05.564 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T04:20:05.565 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:19.0.0-1629.g4f7075d1.el9.x86_64 149/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:19.0.0-1629.g4f7075d1.el9.x86_64 151/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T04:20:05.566 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T04:20:05.567 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T04:20:05.567 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T04:20:05.567 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T04:20:08.132 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T04:20:08.132 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:08.132 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2024-05-08T04:20:08.132 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T04:20:08.132 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.133 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.134 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.134 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:20:08.134 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.134 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.134 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.134 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:20:08.134 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:20:08.134 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:20:08.134 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:20:08.134 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:20:08.134 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.134 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.134 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:20:08.135 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.135 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.135 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.135 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:20:08.135 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:20:08.135 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.135 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-shell-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.135 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top-2:19.0.0-1629.g4f7075d1.el9.noarch 2024-05-08T04:20:08.135 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T04:20:08.135 INFO:teuthology.orchestra.run.smithi183.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T04:20:08.135 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T04:20:08.135 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T04:20:08.135 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T04:20:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T04:20:08.139 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T04:20:08.140 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.141 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T04:20:08.142 INFO:teuthology.orchestra.run.smithi183.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T04:20:08.143 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.143 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.143 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:19.0.0-1629.g4f7075d1.el9.x86_64 2024-05-08T04:20:08.143 INFO:teuthology.orchestra.run.smithi183.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T04:20:08.143 INFO:teuthology.orchestra.run.smithi183.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T04:20:08.143 INFO:teuthology.orchestra.run.smithi183.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T04:20:08.143 INFO:teuthology.orchestra.run.smithi183.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T04:20:08.143 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T04:20:08.143 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T04:20:08.143 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T04:20:08.143 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:08.143 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-05-08T04:20:08.572 DEBUG:teuthology.parallel:result is None 2024-05-08T04:20:08.573 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20 2024-05-08T04:20:08.797 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T04:20:08.823 INFO:teuthology.orchestra.run.smithi104.stdout:19.0.0-1629.g4f7075d1.el9 2024-05-08T04:20:08.824 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1629.g4f7075d1.el9 2024-05-08T04:20:08.824 INFO:teuthology.task.install:The correct ceph version 19.0.0-1629.g4f7075d1 is installed. 2024-05-08T04:20:08.825 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20 2024-05-08T04:20:08.965 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T04:20:08.988 INFO:teuthology.orchestra.run.smithi183.stdout:19.0.0-1629.g4f7075d1.el9 2024-05-08T04:20:08.988 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1629.g4f7075d1.el9 2024-05-08T04:20:08.988 INFO:teuthology.task.install:The correct ceph version 19.0.0-1629.g4f7075d1 is installed. 2024-05-08T04:20:08.990 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T04:20:08.991 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:08.991 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T04:20:09.023 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:09.024 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T04:20:09.056 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T04:20:09.057 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:09.057 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T04:20:09.095 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T04:20:09.162 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:09.196 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T04:20:09.222 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T04:20:09.287 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T04:20:09.287 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:09.287 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T04:20:09.315 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T04:20:09.381 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:09.381 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T04:20:09.406 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T04:20:09.472 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T04:20:09.472 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:09.472 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T04:20:09.498 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T04:20:09.563 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:09.563 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T04:20:09.587 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T04:20:09.652 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T04:20:09.748 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T04:20:09.748 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /var/log/ceph 2024-05-08T04:20:09.751 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /var/log/ceph 2024-05-08T04:20:09.775 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T04:20:09.775 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T04:20:09.817 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T04:20:09.841 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T04:20:09.841 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T04:20:09.883 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T04:20:09.914 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-08T04:20:09.914 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-08T04:20:09.914 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-08T04:20:09.914 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:09.914 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T04:20:09.961 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T04:20:10.069 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T04:20:10.113 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:10.114 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T04:20:10.129 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T04:20:10.234 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T04:20:10.263 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T04:20:10.263 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T04:20:10.263 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278', 'branch': 'wip-neesingh-testing1-20240507', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7697278', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing1-20240507'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-neesingh-testing1-20240507', 'sha1': '4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 50, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4374, 'sha1': '4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'wip-neesingh-testing1-20240507', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi104.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLkQZmD4UKgDLUlTN3eD7ez8gWVGDcIG7qap/3Ikrxc4kaLNkn8UTloZTVp6CTSriWeefdhK3HTtCBt4gUTGLKM=', 'smithi183.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPzmz//D1fxQ0e3NWkqEk9Qr95vHu4nCk7FJj6EKa6srYzFX6mzgDzxX+snfwqWhqGmmdtNtIGZm6ZJG7XVNH2M='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_04:04:15', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T04:20:10.264 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T04:20:10.266 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T04:20:10.314 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T04:20:10.321 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T04:20:10.379 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:10.380 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T04:20:10.399 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T04:20:10.399 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2024-05-08T04:20:10.455 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T04:20:10.455 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T04:20:10.455 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-08T04:20:10.455 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T04:20:10.455 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T04:20:10.455 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-05-08 04:19:50.381252871 +0000 2024-05-08T04:20:10.455 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-05-08 04:18:00.503028015 +0000 2024-05-08T04:20:10.455 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-05-08 04:18:00.503028015 +0000 2024-05-08T04:20:10.455 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-05-08 04:18:00.503028015 +0000 2024-05-08T04:20:10.455 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T04:20:10.518 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-05-08T04:20:10.518 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-05-08T04:20:10.518 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000201012 s, 2.5 MB/s 2024-05-08T04:20:10.519 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T04:20:10.575 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2024-05-08T04:20:10.630 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T04:20:10.630 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T04:20:10.630 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-08T04:20:10.630 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T04:20:10.630 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T04:20:10.630 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-05-08 04:19:50.382252859 +0000 2024-05-08T04:20:10.630 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-05-08 04:18:00.860023919 +0000 2024-05-08T04:20:10.630 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-05-08 04:18:00.860023919 +0000 2024-05-08T04:20:10.631 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-05-08 04:18:00.860023919 +0000 2024-05-08T04:20:10.631 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T04:20:10.692 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-05-08T04:20:10.692 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-05-08T04:20:10.692 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000214849 s, 2.4 MB/s 2024-05-08T04:20:10.693 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T04:20:10.750 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2024-05-08T04:20:10.805 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T04:20:10.805 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T04:20:10.805 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-08T04:20:10.805 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T04:20:10.805 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T04:20:10.805 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-05-08 04:19:50.382252859 +0000 2024-05-08T04:20:10.805 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-05-08 04:18:01.185020190 +0000 2024-05-08T04:20:10.805 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-05-08 04:18:01.185020190 +0000 2024-05-08T04:20:10.805 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-05-08 04:18:01.185020190 +0000 2024-05-08T04:20:10.806 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T04:20:10.868 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-05-08T04:20:10.868 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-05-08T04:20:10.868 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000193728 s, 2.6 MB/s 2024-05-08T04:20:10.869 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T04:20:10.925 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2024-05-08T04:20:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T04:20:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T04:20:10.980 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-08T04:20:10.980 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T04:20:10.980 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T04:20:10.980 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-05-08 04:19:50.382252859 +0000 2024-05-08T04:20:10.980 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-05-08 04:18:01.513016427 +0000 2024-05-08T04:20:10.980 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-05-08 04:18:01.513016427 +0000 2024-05-08T04:20:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-05-08 04:18:01.513016427 +0000 2024-05-08T04:20:10.980 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T04:20:11.043 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-05-08T04:20:11.043 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-05-08T04:20:11.043 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000166786 s, 3.1 MB/s 2024-05-08T04:20:11.044 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T04:20:11.100 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T04:20:11.100 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:11.100 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T04:20:11.116 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T04:20:11.116 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2024-05-08T04:20:11.173 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T04:20:11.173 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T04:20:11.173 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-08T04:20:11.173 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T04:20:11.173 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T04:20:11.173 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-05-08 04:20:00.995069757 +0000 2024-05-08T04:20:11.174 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-05-08 04:18:01.441381348 +0000 2024-05-08T04:20:11.174 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-05-08 04:18:01.441381348 +0000 2024-05-08T04:20:11.174 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-05-08 04:18:01.441381348 +0000 2024-05-08T04:20:11.174 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T04:20:11.238 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-05-08T04:20:11.238 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-05-08T04:20:11.238 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000296528 s, 1.7 MB/s 2024-05-08T04:20:11.239 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T04:20:11.296 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2024-05-08T04:20:11.352 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T04:20:11.353 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T04:20:11.353 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-08T04:20:11.353 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T04:20:11.353 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T04:20:11.353 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-05-08 04:20:00.995069757 +0000 2024-05-08T04:20:11.353 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-05-08 04:18:01.780371984 +0000 2024-05-08T04:20:11.353 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-05-08 04:18:01.780371984 +0000 2024-05-08T04:20:11.353 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-05-08 04:18:01.780371984 +0000 2024-05-08T04:20:11.353 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T04:20:11.416 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-05-08T04:20:11.416 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-05-08T04:20:11.416 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000317641 s, 1.6 MB/s 2024-05-08T04:20:11.418 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T04:20:11.474 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2024-05-08T04:20:11.529 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T04:20:11.529 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T04:20:11.529 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-08T04:20:11.529 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T04:20:11.529 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T04:20:11.529 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-05-08 04:20:00.995069757 +0000 2024-05-08T04:20:11.529 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-05-08 04:18:02.123362510 +0000 2024-05-08T04:20:11.529 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-05-08 04:18:02.124362482 +0000 2024-05-08T04:20:11.529 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-05-08 04:18:02.123362510 +0000 2024-05-08T04:20:11.530 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T04:20:11.591 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-05-08T04:20:11.591 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-05-08T04:20:11.591 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000191179 s, 2.7 MB/s 2024-05-08T04:20:11.593 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T04:20:11.649 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2024-05-08T04:20:11.703 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T04:20:11.704 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T04:20:11.704 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-08T04:20:11.704 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T04:20:11.704 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T04:20:11.704 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-05-08 04:20:00.996069730 +0000 2024-05-08T04:20:11.704 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-05-08 04:18:02.458353257 +0000 2024-05-08T04:20:11.704 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-05-08 04:18:02.458353257 +0000 2024-05-08T04:20:11.704 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-05-08 04:18:02.458353257 +0000 2024-05-08T04:20:11.704 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T04:20:11.768 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-05-08T04:20:11.769 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-05-08T04:20:11.769 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000182188 s, 2.8 MB/s 2024-05-08T04:20:11.770 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T04:20:11.825 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T04:20:11.825 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T04:20:11.825 INFO:tasks.ceph:Generating config... 2024-05-08T04:20:11.827 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-08T04:20:11.827 INFO:tasks.ceph:[client] debug client = 20 2024-05-08T04:20:11.827 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T04:20:11.827 INFO:tasks.ceph:[client] pid file = 2024-05-08T04:20:11.827 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-08T04:20:11.827 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-08T04:20:11.827 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-08T04:20:11.827 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-08T04:20:11.827 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-08T04:20:11.827 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-08T04:20:11.827 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-08T04:20:11.828 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-08T04:20:11.828 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-08T04:20:11.828 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-08T04:20:11.828 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-08T04:20:11.828 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-08T04:20:11.828 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-08T04:20:11.828 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-05-08T04:20:11.828 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T04:20:11.828 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T04:20:11.828 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T04:20:11.828 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T04:20:11.828 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T04:20:11.828 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-08T04:20:11.828 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-08T04:20:11.828 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-08T04:20:11.829 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-08T04:20:11.829 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T04:20:11.829 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T04:20:11.829 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-08T04:20:11.829 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-08T04:20:11.829 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T04:20:11.829 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T04:20:11.829 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-08T04:20:11.829 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T04:20:11.830 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T04:20:11.830 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T04:20:11.830 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T04:20:11.830 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T04:20:11.830 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-08T04:20:11.830 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T04:20:11.830 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T04:20:11.882 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T04:20:11.885 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T04:20:11.928 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T04:20:11.992 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.104'), ('mon.b', '172.21.15.183'), ('mon.c', '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]')] 2024-05-08T04:20:11.993 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.104,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-08T04:20:11.993 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:11.993 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T04:20:12.048 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.104 --add b 172.21.15.183 --addv c '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:12.133 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:12.133 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: generated fsid c8b1f73b-90d2-40b8-ad3c-a036617abfed 2024-05-08T04:20:12.133 INFO:teuthology.orchestra.run.smithi104.stdout:setting min_mon_release = quincy 2024-05-08T04:20:12.133 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 0 2024-05-08T04:20:12.133 INFO:teuthology.orchestra.run.smithi104.stdout:fsid c8b1f73b-90d2-40b8-ad3c-a036617abfed 2024-05-08T04:20:12.134 INFO:teuthology.orchestra.run.smithi104.stdout:last_changed 2024-05-08T04:20:12.132926+0000 2024-05-08T04:20:12.134 INFO:teuthology.orchestra.run.smithi104.stdout:created 2024-05-08T04:20:12.132926+0000 2024-05-08T04:20:12.134 INFO:teuthology.orchestra.run.smithi104.stdout:min_mon_release 17 (quincy) 2024-05-08T04:20:12.134 INFO:teuthology.orchestra.run.smithi104.stdout:election_strategy: 1 2024-05-08T04:20:12.134 INFO:teuthology.orchestra.run.smithi104.stdout:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-05-08T04:20:12.134 INFO:teuthology.orchestra.run.smithi104.stdout:1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.b 2024-05-08T04:20:12.134 INFO:teuthology.orchestra.run.smithi104.stdout:2: [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] mon.c 2024-05-08T04:20:12.134 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-08T04:20:12.135 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T04:20:12.150 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c8b1f73b-90d2-40b8-ad3c-a036617abfed... 2024-05-08T04:20:12.151 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T04:20:12.192 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T04:20:12.232 INFO:teuthology.orchestra.run.smithi104.stdout:[global] 2024-05-08T04:20:12.232 INFO:teuthology.orchestra.run.smithi104.stdout: chdir = "" 2024-05-08T04:20:12.233 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T04:20:12.233 INFO:teuthology.orchestra.run.smithi104.stdout: auth supported = cephx 2024-05-08T04:20:12.233 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.233 INFO:teuthology.orchestra.run.smithi104.stdout: filestore xattr use omap = true 2024-05-08T04:20:12.233 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.233 INFO:teuthology.orchestra.run.smithi104.stdout: mon clock drift allowed = 1.000 2024-05-08T04:20:12.233 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.233 INFO:teuthology.orchestra.run.smithi104.stdout: osd crush chooseleaf type = 0 2024-05-08T04:20:12.233 INFO:teuthology.orchestra.run.smithi104.stdout: auth debug = true 2024-05-08T04:20:12.233 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.233 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on old message = true 2024-05-08T04:20:12.233 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on bug = true 2024-05-08T04:20:12.233 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn max object skew = 0 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default size = 2 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow primary affinity = true 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow pg remap = true 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on legacy crush tunables = false 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on crush straw calc version zero = false 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on no sortbitwise = false 2024-05-08T04:20:12.234 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on osd down out interval zero = false 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on too few osds = false 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: mon_allow_pool_size_one = true 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: osd default data pool replay window = 5 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: mon allow pool delete = true 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: mon cluster log file level = debug 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: debug asserts on shutdown = true 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: mon health detail to clog = false 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: mon host = "172.21.15.104,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2024-05-08T04:20:12.235 INFO:teuthology.orchestra.run.smithi104.stdout: fsid = c8b1f73b-90d2-40b8-ad3c-a036617abfed 2024-05-08T04:20:12.236 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.236 INFO:teuthology.orchestra.run.smithi104.stdout:[osd] 2024-05-08T04:20:12.236 INFO:teuthology.orchestra.run.smithi104.stdout: osd journal size = 100 2024-05-08T04:20:12.236 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.236 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub load threshold = 5.0 2024-05-08T04:20:12.236 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub max interval = 600 2024-05-08T04:20:12.236 INFO:teuthology.orchestra.run.smithi104.stdout: osd mclock profile = high_recovery_ops 2024-05-08T04:20:12.236 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.236 INFO:teuthology.orchestra.run.smithi104.stdout: osd recover clone overlap = true 2024-05-08T04:20:12.236 INFO:teuthology.orchestra.run.smithi104.stdout: osd recovery max chunk = 1048576 2024-05-08T04:20:12.236 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.236 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug shutdown = true 2024-05-08T04:20:12.236 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug op order = true 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug verify stray on activate = true 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug trim objects = true 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: osd open classes on start = true 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug pg log writeout = true 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: osd deep scrub update digest min age = 30 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: osd map max advance = 10 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: journal zero on create = true 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: filestore ondisk finisher threads = 3 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: filestore apply finisher threads = 3 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.237 INFO:teuthology.orchestra.run.smithi104.stdout: bdev debug aio = true 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug misdirected ops = true 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: bdev async discard = True 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: bdev enable discard = True 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore allocator = bitmap 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore block size = 96636764160 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore fsck on mount = True 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluefs = 1/20 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluestore = 1/20 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: debug osd = 20 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: debug rocksdb = 4/10 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.9 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.8 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: osd failsafe full ratio = 0.95 2024-05-08T04:20:12.238 INFO:teuthology.orchestra.run.smithi104.stdout: osd objectstore = bluestore 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: osd op complaint time = 180 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr] 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: debug mgr = 20 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: mgr/telemetry/nag = false 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: debug client = 20 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: debug finisher = 20 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout:[mon] 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-05-08T04:20:12.239 INFO:teuthology.orchestra.run.smithi104.stdout: debug paxos = 20 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: mon data avail warn = 5 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: mon mgr mkfs grace = 240 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd reporter subtree level = osd 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd prime pg temp = true 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T04:20:12.240 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: # 1m isn't quite enough 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: mon_down_mkfs_grace = 2m 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_filestore_osds = false 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: mon op complaint time = 120 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout:[client] 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: rgw cache enabled = true 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable ops log = true 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable usage log = true 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: client mount timeout = 600 2024-05-08T04:20:12.241 INFO:teuthology.orchestra.run.smithi104.stdout: debug client = 20 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = "" 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout: rados mon op timeout = 900 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout: rados osd op timeout = 900 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.a] 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.b] 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.c] 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.c] 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.d] 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout:[mds] 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout: debug mds = 20 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout: debug mds balancer = 20 2024-05-08T04:20:12.242 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-05-08T04:20:12.243 INFO:teuthology.orchestra.run.smithi104.stdout: mds debug frag = True 2024-05-08T04:20:12.243 INFO:teuthology.orchestra.run.smithi104.stdout: mds debug scatterstat = True 2024-05-08T04:20:12.243 INFO:teuthology.orchestra.run.smithi104.stdout: mds op complaint time = 180 2024-05-08T04:20:12.243 INFO:teuthology.orchestra.run.smithi104.stdout: mds verify scatter = True 2024-05-08T04:20:12.243 INFO:teuthology.orchestra.run.smithi104.stdout: osd op complaint time = 180 2024-05-08T04:20:12.243 INFO:teuthology.orchestra.run.smithi104.stdout: rados mon op timeout = 900 2024-05-08T04:20:12.243 INFO:teuthology.orchestra.run.smithi104.stdout: rados osd op timeout = 900 2024-05-08T04:20:12.243 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.244 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2024-05-08T04:20:12.245 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2024-05-08T04:20:12.246 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T04:20:12.246 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T04:20:12.246 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2024-05-08T04:20:12.246 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.246 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T04:20:12.246 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.246 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2024-05-08T04:20:12.246 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.246 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2024-05-08T04:20:12.246 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.246 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2024-05-08T04:20:12.246 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = "172.21.15.104,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = c8b1f73b-90d2-40b8-ad3c-a036617abfed 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock profile = high_recovery_ops 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.247 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug trim objects = true 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.248 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: bdev async discard = True 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: bdev enable discard = True 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore allocator = bitmap 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore block size = 96636764160 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore fsck on mount = True 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluefs = 1/20 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluestore = 1/20 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2024-05-08T04:20:12.249 INFO:teuthology.orchestra.run.smithi183.stdout: debug rocksdb = 4/10 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd full ratio = 0.9 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd nearfull ratio = 0.8 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout: osd failsafe full ratio = 0.95 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout: osd objectstore = bluestore 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2024-05-08T04:20:12.250 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: debug client = 20 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: debug finisher = 20 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2024-05-08T04:20:12.251 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: # 1m isn't quite enough 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: mon_down_mkfs_grace = 2m 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_filestore_osds = false 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: mon op complaint time = 120 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T04:20:12.252 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout: client mount timeout = 600 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout: debug client = 20 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = "" 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.b] 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.c] 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2024-05-08T04:20:12.253 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2024-05-08T04:20:12.254 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2024-05-08T04:20:12.254 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2024-05-08T04:20:12.254 INFO:teuthology.orchestra.run.smithi183.stdout:[mds] 2024-05-08T04:20:12.254 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds = 20 2024-05-08T04:20:12.254 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds balancer = 20 2024-05-08T04:20:12.254 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-05-08T04:20:12.254 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug frag = True 2024-05-08T04:20:12.254 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug scatterstat = True 2024-05-08T04:20:12.254 INFO:teuthology.orchestra.run.smithi183.stdout: mds op complaint time = 180 2024-05-08T04:20:12.254 INFO:teuthology.orchestra.run.smithi183.stdout: mds verify scatter = True 2024-05-08T04:20:12.254 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2024-05-08T04:20:12.254 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2024-05-08T04:20:12.254 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2024-05-08T04:20:12.255 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T04:20:12.256 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T04:20:12.348 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T04:20:12.348 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:12.349 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T04:20:12.364 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:12.364 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T04:20:12.419 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:20:12.419 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:12.419 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T04:20:12.419 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T04:20:12.495 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:12.495 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:12.550 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:20:12.550 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:12.550 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T04:20:12.551 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T04:20:12.585 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:12.585 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:12.642 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T04:20:12.642 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T04:20:12.642 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T04:20:12.693 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T04:20:12.695 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T04:20:12.775 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T04:20:12.778 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T04:20:12.778 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T04:20:12.829 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T04:20:12.832 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-08T04:20:12.856 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T04:20:12.946 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T04:20:12.949 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-08T04:20:12.973 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T04:20:13.024 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T04:20:13.027 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-08T04:20:13.051 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T04:20:13.142 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T04:20:13.144 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-08T04:20:13.169 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T04:20:13.169 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T04:20:13.210 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T04:20:13.223 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-08T04:20:13.303 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-08T04:20:13.316 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-08T04:20:13.357 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-08T04:20:13.369 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-08T04:20:13.450 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-08T04:20:13.463 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T04:20:13.463 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T04:20:13.463 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T04:20:13.488 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T04:20:13.488 INFO:tasks.ceph:role: osd.0 2024-05-08T04:20:13.488 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:20:13.488 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T04:20:13.559 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T04:20:13.559 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T04:20:13.560 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T04:20:13.560 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T04:20:13.560 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T04:20:13.560 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-05-08T04:20:13.560 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T04:20:13.560 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T04:20:13.560 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T04:20:13.560 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T04:20:14.078 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-05-08T04:20:14.081 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-05-08T04:20:14.081 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T04:20:14.210 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T04:20:14.246 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T04:20:14.314 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T04:20:14.314 INFO:tasks.ceph:role: osd.1 2024-05-08T04:20:14.314 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:20:14.314 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T04:20:14.389 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T04:20:14.389 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T04:20:14.389 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T04:20:14.389 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T04:20:14.389 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T04:20:14.389 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-05-08T04:20:14.389 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T04:20:14.389 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T04:20:14.389 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T04:20:14.389 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T04:20:14.835 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-05-08T04:20:14.837 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-05-08T04:20:14.838 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-08T04:20:14.929 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T04:20:14.960 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T04:20:15.026 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T04:20:15.026 INFO:tasks.ceph:role: osd.2 2024-05-08T04:20:15.026 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:20:15.026 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T04:20:15.098 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T04:20:15.099 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T04:20:15.099 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T04:20:15.099 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T04:20:15.099 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T04:20:15.099 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-05-08T04:20:15.099 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T04:20:15.099 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T04:20:15.099 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T04:20:15.100 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T04:20:15.605 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-05-08T04:20:15.607 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-05-08T04:20:15.607 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-08T04:20:15.745 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T04:20:15.779 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T04:20:15.847 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T04:20:15.847 INFO:tasks.ceph:role: osd.3 2024-05-08T04:20:15.847 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:20:15.847 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T04:20:15.921 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T04:20:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T04:20:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T04:20:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T04:20:15.921 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T04:20:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-05-08T04:20:15.921 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T04:20:15.921 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T04:20:15.921 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T04:20:15.922 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T04:20:16.446 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-05-08T04:20:16.448 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-05-08T04:20:16.448 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-08T04:20:16.602 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T04:20:16.635 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:16.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:16.734+0000 7f6add20e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T04:20:16.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:16.734+0000 7f6add20e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T04:20:16.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:16.734+0000 7f6add20e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T04:20:16.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:16.734+0000 7f6add20e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T04:20:16.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:16.734+0000 7f6add20e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T04:20:16.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:16.735+0000 7f6add20e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T04:20:19.591 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T04:20:19.622 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:19.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:19.710+0000 7fd47ef50640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T04:20:19.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:19.710+0000 7fd47ef50640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T04:20:19.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:19.710+0000 7fd47ef50640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T04:20:19.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:19.710+0000 7fd47ef50640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T04:20:19.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:19.710+0000 7fd47ef50640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T04:20:19.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:19.711+0000 7fd47ef50640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T04:20:22.570 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T04:20:22.596 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:22.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:22.680+0000 7fcf58820640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T04:20:22.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:22.680+0000 7fcf58820640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T04:20:22.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:22.680+0000 7fcf58820640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T04:20:22.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:22.680+0000 7fcf58820640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T04:20:22.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:22.680+0000 7fcf58820640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T04:20:22.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:22.681+0000 7fcf58820640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T04:20:25.538 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T04:20:25.568 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:25.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:25.655+0000 7f7362633640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T04:20:25.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:25.655+0000 7f7362633640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T04:20:25.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:25.655+0000 7f7362633640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T04:20:25.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:25.655+0000 7f7362633640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T04:20:25.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:25.655+0000 7f7362633640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T04:20:25.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:25.656+0000 7f7362633640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T04:20:28.506 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T04:20:28.533 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-08T04:20:28.563 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T04:20:28.563 INFO:tasks.ceph:role: osd.4 2024-05-08T04:20:28.564 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:20:28.564 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T04:20:28.639 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T04:20:28.639 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T04:20:28.640 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T04:20:28.640 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T04:20:28.640 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T04:20:28.640 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2024-05-08T04:20:28.640 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T04:20:28.640 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T04:20:28.640 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T04:20:28.640 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T04:20:29.147 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2024-05-08T04:20:29.150 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2024-05-08T04:20:29.150 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-08T04:20:29.276 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-08T04:20:29.306 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-08T04:20:29.372 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T04:20:29.372 INFO:tasks.ceph:role: osd.5 2024-05-08T04:20:29.372 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:20:29.372 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T04:20:29.445 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T04:20:29.445 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T04:20:29.445 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T04:20:29.445 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T04:20:29.446 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T04:20:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2024-05-08T04:20:29.446 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T04:20:29.446 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T04:20:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T04:20:29.446 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T04:20:29.905 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2024-05-08T04:20:29.907 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2024-05-08T04:20:29.907 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-08T04:20:29.994 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-08T04:20:30.023 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-08T04:20:30.087 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T04:20:30.087 INFO:tasks.ceph:role: osd.6 2024-05-08T04:20:30.087 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:20:30.087 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T04:20:30.160 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T04:20:30.160 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T04:20:30.160 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T04:20:30.160 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T04:20:30.160 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T04:20:30.160 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2024-05-08T04:20:30.160 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T04:20:30.160 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T04:20:30.160 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T04:20:30.160 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T04:20:30.640 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2024-05-08T04:20:30.642 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2024-05-08T04:20:30.643 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-08T04:20:30.763 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-08T04:20:30.794 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-08T04:20:30.859 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T04:20:30.859 INFO:tasks.ceph:role: osd.7 2024-05-08T04:20:30.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:20:30.859 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T04:20:30.932 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T04:20:30.932 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T04:20:30.932 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T04:20:30.932 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T04:20:30.932 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T04:20:30.932 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2024-05-08T04:20:30.932 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T04:20:30.932 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T04:20:30.932 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T04:20:30.932 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T04:20:31.452 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2024-05-08T04:20:31.454 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2024-05-08T04:20:31.454 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-08T04:20:31.589 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-08T04:20:31.619 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:31.720 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:31.719+0000 7f5afdcb5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-08T04:20:31.720 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:31.719+0000 7f5afdcb5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-08T04:20:31.720 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:31.719+0000 7f5afdcb5640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T04:20:31.721 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:31.719+0000 7f5afdcb5640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T04:20:31.721 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:31.719+0000 7f5afdcb5640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T04:20:31.721 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:31.720+0000 7f5afdcb5640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-08T04:20:34.579 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-08T04:20:34.610 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:34.700 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:34.699+0000 7f4623222640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-08T04:20:34.700 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:34.699+0000 7f4623222640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-08T04:20:34.700 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:34.699+0000 7f4623222640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T04:20:34.701 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:34.699+0000 7f4623222640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T04:20:34.701 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:34.699+0000 7f4623222640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T04:20:34.701 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:34.700+0000 7f4623222640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-08T04:20:37.553 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-08T04:20:37.583 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:37.673 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:37.672+0000 7f747880d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-08T04:20:37.674 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:37.672+0000 7f747880d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-08T04:20:37.674 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:37.672+0000 7f747880d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T04:20:37.674 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:37.672+0000 7f747880d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T04:20:37.674 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:37.672+0000 7f747880d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T04:20:37.674 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:37.673+0000 7f747880d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-08T04:20:40.265 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:20:40.268 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:20:40.540 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-08T04:20:40.567 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:40.655 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:40.653+0000 7f363501f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-08T04:20:40.655 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:40.653+0000 7f363501f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-08T04:20:40.655 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:40.653+0000 7f363501f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T04:20:40.655 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:40.653+0000 7f363501f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T04:20:40.655 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:40.653+0000 7f363501f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T04:20:40.656 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:40.654+0000 7f363501f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-08T04:20:43.509 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-08T04:20:43.539 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T04:20:43.539 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:43.539 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-08T04:20:43.569 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:43.569 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-08T04:20:43.637 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:43.637 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-08T04:20:43.703 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:43.703 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T04:20:43.770 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:43.770 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T04:20:43.836 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:43.836 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T04:20:43.901 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:43.901 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T04:20:43.966 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:43.966 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T04:20:43.995 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:43.995 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-08T04:20:44.065 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:44.065 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-08T04:20:44.134 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:44.134 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-08T04:20:44.203 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:44.203 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-08T04:20:44.270 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:44.270 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-08T04:20:44.336 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:44.336 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-08T04:20:44.402 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:44.402 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T04:20:44.419 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:44.419 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-08T04:20:44.475 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:44.475 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-08T04:20:44.491 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:44.491 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-08T04:20:44.547 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T04:20:44.547 DEBUG:teuthology.orchestra.run.smithi104:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T04:20:44.549 DEBUG:teuthology.orchestra.run.smithi183:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T04:20:44.590 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.y] 2024-05-08T04:20:44.590 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQB8/TpmC2JMKRAAuayaBslUW+T2xxUcFYJ2iQ== 2024-05-08T04:20:44.590 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2024-05-08T04:20:44.590 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQB8/TpmxdFrMRAAmzLHedytHXAGNpNucGZaCQ== 2024-05-08T04:20:44.590 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.c] 2024-05-08T04:20:44.590 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQB8/TpmFB1nOBAAtAvmTbNBjWFX/1fOOdjN5g== 2024-05-08T04:20:44.590 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.0] 2024-05-08T04:20:44.590 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCA/TpmI1TdKxAAmwA8+WnZMSYoYAZ9Jbq3PQ== 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.1] 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCD/TpmnHVwKhAA8eYNmL/xrJeFs5ZMoZEl7w== 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.2] 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCG/Tpmx++nKBAAn79a9YBVJXBBwVb3odRT+Q== 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.3] 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCJ/Tpm2c4qJxAAAvpc8VwahQ3eipDq4B0sLw== 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.x] 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQB8/TpmpYwyLhAAaPUMPrzgHp1zZyeBWtqiNA== 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQB9/TpmeApvARAAKgHwMIgcOw0WeJMA6B6Alw== 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.d] 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQB9/TpmvNx2CBAAiekQnEgL4wKKJK0cycdqmA== 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.4] 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCP/TpmTSzlKhAALgVYlmQcoxc95iy2wGzNTw== 2024-05-08T04:20:44.591 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.5] 2024-05-08T04:20:44.592 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCS/TpmT8O4KRAAtJalEzRoN4egUhKDGgWG2Q== 2024-05-08T04:20:44.592 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.6] 2024-05-08T04:20:44.592 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCV/Tpmr9wbKBAAjTGgFWKdCTJQeKFh+Qy8rQ== 2024-05-08T04:20:44.592 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.7] 2024-05-08T04:20:44.592 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCY/Tpmj8sIJxAAURnOCmVXzgueWr9WWIi5sg== 2024-05-08T04:20:44.592 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-05-08T04:20:44.592 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQB9/TpmmVCJDBAA7kFxGuTTRTJge+xrcPo3lw== 2024-05-08T04:20:44.592 INFO:teuthology.orchestra.run.smithi104.stdout:[client.2] 2024-05-08T04:20:44.592 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQB9/Tpm8YYTEhAAv2yuipPFRLKgsYmLKsVvUw== 2024-05-08T04:20:44.592 INFO:teuthology.orchestra.run.smithi104.stdout:[client.1] 2024-05-08T04:20:44.592 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQB9/TpmnZVEFRAAxxoeoXxT01K0NTE9OIDjEA== 2024-05-08T04:20:44.592 INFO:teuthology.orchestra.run.smithi104.stdout:[client.3] 2024-05-08T04:20:44.592 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQB9/TpmqiHcGhAAG6+jVhyfQkGUITvUBe7GxQ== 2024-05-08T04:20:44.610 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.y] 2024-05-08T04:20:44.610 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB8/TpmC2JMKRAAuayaBslUW+T2xxUcFYJ2iQ== 2024-05-08T04:20:44.610 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2024-05-08T04:20:44.610 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB8/TpmxdFrMRAAmzLHedytHXAGNpNucGZaCQ== 2024-05-08T04:20:44.610 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2024-05-08T04:20:44.610 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB8/TpmFB1nOBAAtAvmTbNBjWFX/1fOOdjN5g== 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.0] 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCA/TpmI1TdKxAAmwA8+WnZMSYoYAZ9Jbq3PQ== 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.1] 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCD/TpmnHVwKhAA8eYNmL/xrJeFs5ZMoZEl7w== 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.2] 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCG/Tpmx++nKBAAn79a9YBVJXBBwVb3odRT+Q== 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.3] 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCJ/Tpm2c4qJxAAAvpc8VwahQ3eipDq4B0sLw== 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.x] 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB8/TpmpYwyLhAAaPUMPrzgHp1zZyeBWtqiNA== 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB9/TpmeApvARAAKgHwMIgcOw0WeJMA6B6Alw== 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB9/TpmvNx2CBAAiekQnEgL4wKKJK0cycdqmA== 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.4] 2024-05-08T04:20:44.611 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCP/TpmTSzlKhAALgVYlmQcoxc95iy2wGzNTw== 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.5] 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCS/TpmT8O4KRAAtJalEzRoN4egUhKDGgWG2Q== 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.6] 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCV/Tpmr9wbKBAAjTGgFWKdCTJQeKFh+Qy8rQ== 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.7] 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCY/Tpmj8sIJxAAURnOCmVXzgueWr9WWIi5sg== 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout:[client.0] 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB9/TpmmVCJDBAA7kFxGuTTRTJge+xrcPo3lw== 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout:[client.2] 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB9/Tpm8YYTEhAAv2yuipPFRLKgsYmLKsVvUw== 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout:[client.1] 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB9/TpmnZVEFRAAxxoeoXxT01K0NTE9OIDjEA== 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout:[client.3] 2024-05-08T04:20:44.612 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB9/TpmqiHcGhAAG6+jVhyfQkGUITvUBe7GxQ== 2024-05-08T04:20:44.613 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T04:20:44.636 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T04:20:44.704 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T04:20:44.707 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T04:20:44.760 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T04:20:44.762 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T04:20:44.816 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:44.818 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:44.868 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:44.871 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:44.920 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:44.923 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:44.972 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:44.975 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:45.025 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T04:20:45.027 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T04:20:45.077 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T04:20:45.079 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T04:20:45.133 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T04:20:45.136 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T04:20:45.188 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:45.190 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:45.241 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:45.243 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:45.292 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:45.295 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:45.345 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:45.347 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T04:20:45.397 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T04:20:45.400 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T04:20:45.453 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T04:20:45.455 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T04:20:45.508 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T04:20:45.511 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T04:20:45.563 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T04:20:45.565 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T04:20:45.619 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T04:20:45.619 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T04:20:45.644 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T04:20:45.738 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T04:20:45.762 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-08T04:20:45.787 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T04:20:45.881 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-08T04:20:45.905 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-08T04:20:45.970 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T04:20:46.065 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-08T04:20:46.089 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:46.092 DEBUG:teuthology.orchestra.run.smithi183:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T04:20:46.144 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T04:20:46.144 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T04:20:46.145 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T04:20:46.147 INFO:tasks.ceph.mon.a:Started 2024-05-08T04:20:46.147 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T04:20:46.147 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T04:20:46.187 INFO:tasks.ceph.mon.b:Started 2024-05-08T04:20:46.187 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T04:20:46.187 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T04:20:46.189 INFO:tasks.ceph.mon.c:Started 2024-05-08T04:20:46.189 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T04:20:46.189 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-08T04:20:46.189 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-08T04:20:46.191 INFO:tasks.ceph.mgr.y:Started 2024-05-08T04:20:46.191 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T04:20:46.192 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T04:20:46.194 INFO:tasks.ceph.mgr.x:Started 2024-05-08T04:20:46.194 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T04:20:46.194 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T04:20:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.292+0000 7f9ef88e1640 1 Processor -- start 2024-05-08T04:20:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.292+0000 7f9ef88e1640 1 -- start start 2024-05-08T04:20:46.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef88e1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ef40cd9e0 0x7f9ef40ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:46.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef88e1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9ef415e330 0x7f9ef415e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:46.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef88e1640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef40caab0 con 0x7f9ef406ff50 2024-05-08T04:20:46.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef88e1640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef40ae540 con 0x7f9ef415e330 2024-05-08T04:20:46.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef88e1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40cad90 con 0x7f9ef40cd9e0 2024-05-08T04:20:46.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef259c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9ef406ff50 0x7f9ef406bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44066/0 (socket says 172.21.15.104:44066) 2024-05-08T04:20:46.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef259c640 1 -- 172.21.15.104:0/946016859 learned_addr learned my addr 172.21.15.104:0/946016859 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:20:46.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef1d9b640 1 --2- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ef40cd9e0 0x7f9ef40ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:46.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef2d9d640 1 --2- 172.21.15.104:0/946016859 >> v2:172.21.15.183:3300/0 conn(0x7f9ef415e330 0x7f9ef415e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:46.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef1d9b640 1 -- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ef40cd9e0 msgr2=0x7f9ef40ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T04:20:46.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef1d9b640 1 -- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ef40cd9e0 msgr2=0x7f9ef40ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T04:20:46.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef1d9b640 1 --2- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ef40cd9e0 0x7f9ef40ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T04:20:46.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef1d9b640 1 --2- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ef40cd9e0 0x7f9ef40ca460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T04:20:46.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef2d9d640 1 -- 172.21.15.104:0/946016859 >> v2:172.21.15.183:3300/0 conn(0x7f9ef415e330 msgr2=0x7f9ef415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-08T04:20:46.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef2d9d640 1 -- 172.21.15.104:0/946016859 >> v2:172.21.15.183:3300/0 conn(0x7f9ef415e330 msgr2=0x7f9ef415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T04:20:46.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef2d9d640 1 --2- 172.21.15.104:0/946016859 >> v2:172.21.15.183:3300/0 conn(0x7f9ef415e330 0x7f9ef415e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T04:20:46.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.293+0000 7f9ef2d9d640 1 --2- 172.21.15.104:0/946016859 >> v2:172.21.15.183:3300/0 conn(0x7f9ef415e330 0x7f9ef415e7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T04:20:46.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235602739 0 0) 0x7f9ef40caab0 con 0x7f9ef406ff50 2024-05-08T04:20:46.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9edc005730 con 0x7f9ef406ff50 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640902215 0 0) 0x7f9edc005730 con 0x7f9ef406ff50 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ef40cd9e0 msgr2=0x7f9ef40ca460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 --2- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ef40cd9e0 0x7f9ef40ca460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 >> v2:172.21.15.183:3300/0 conn(0x7f9ef415e330 msgr2=0x7f9ef415e7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 --2- 172.21.15.104:0/946016859 >> v2:172.21.15.183:3300/0 conn(0x7f9ef415e330 0x7f9ef415e7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef40cb070 con 0x7f9ef406ff50 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f9ee40019f0 con 0x7f9ef406ff50 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 >> v1:172.21.15.104:6789/0 conn(0x7f9ef406ff50 legacy=0x7f9ef406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 --2- 172.21.15.104:0/946016859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9edc005bc0 0x7f9edc005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 --2- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ef40cd9e0 0x7f9edc006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 --2- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9edc006f50 0x7f9edc0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40ae540 con 0x7f9edc005bc0 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40cad90 con 0x7f9edc006f50 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc00dd00 con 0x7f9ef40cd9e0 2024-05-08T04:20:46.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef259c640 1 --2- 172.21.15.104:0/946016859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9edc005bc0 0x7f9edc005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:46.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef259c640 1 -- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ef40cd9e0 msgr2=0x7f9edc006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:20:46.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef259c640 1 --2- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ef40cd9e0 0x7f9edc006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:46.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef259c640 1 -- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9edc006f50 msgr2=0x7f9edc0073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:20:46.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef2d9d640 1 --2- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9edc006f50 0x7f9edc0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:46.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef259c640 1 --2- 172.21.15.104:0/946016859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9edc006f50 0x7f9edc0073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:46.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.461+0000 7f9ef259c640 1 -- 172.21.15.104:0/946016859 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc005730 con 0x7f9edc005bc0 2024-05-08T04:20:46.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.462+0000 7f9ef259c640 1 --2- 172.21.15.104:0/946016859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9edc005bc0 0x7f9edc005fe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40013d0 tx=0x7f9edc007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e9454987e6b5e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:46.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.462+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee400a410 con 0x7f9edc005bc0 2024-05-08T04:20:46.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.462+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee402f070 con 0x7f9edc005bc0 2024-05-08T04:20:46.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.462+0000 7f9ef159a640 1 -- 172.21.15.104:0/946016859 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee402bc00 con 0x7f9edc005bc0 2024-05-08T04:20:46.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.463+0000 7f9ef88e1640 1 -- 172.21.15.104:0/946016859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9edc005bc0 msgr2=0x7f9edc005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:46.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.463+0000 7f9ef88e1640 1 --2- 172.21.15.104:0/946016859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9edc005bc0 0x7f9edc005fe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40013d0 tx=0x7f9edc007a40 comp rx=0 tx=0).stop 2024-05-08T04:20:46.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.463+0000 7f9ef2d9d640 1 -- 172.21.15.104:0/946016859 reap_dead start 2024-05-08T04:20:46.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.463+0000 7f9ef88e1640 1 -- 172.21.15.104:0/946016859 shutdown_connections 2024-05-08T04:20:46.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.463+0000 7f9ef88e1640 1 -- 172.21.15.104:0/946016859 >> 172.21.15.104:0/946016859 conn(0x7f9ef40cc890 msgr2=0x7f9ef40ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:46.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.463+0000 7f9ef88e1640 1 -- 172.21.15.104:0/946016859 shutdown_connections 2024-05-08T04:20:46.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.463+0000 7f9ef88e1640 1 -- 172.21.15.104:0/946016859 wait complete. 2024-05-08T04:20:46.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.465+0000 7f9ef88e1640 1 Processor -- start 2024-05-08T04:20:46.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.465+0000 7f9ef88e1640 1 -- start start 2024-05-08T04:20:46.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef88e1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9edc005bc0 0x7f9ef41401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:46.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef88e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ef41f3a60 0x7f9ef40b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:46.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef88e1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ef41f2e50 0x7f9ef41f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:46.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef88e1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40ca460 con 0x7f9ef41f3a60 2024-05-08T04:20:46.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef88e1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef4070330 con 0x7f9ef41f2e50 2024-05-08T04:20:46.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef88e1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40ca5e0 con 0x7f9edc005bc0 2024-05-08T04:20:46.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ef41f3a60 0x7f9ef40b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:46.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ef41f3a60 0x7f9ef40b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47246/0 (socket says 172.21.15.104:47246) 2024-05-08T04:20:46.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef1d9b640 1 -- 172.21.15.104:0/504593762 learned_addr learned my addr 172.21.15.104:0/504593762 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:20:46.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef259c640 1 --2- 172.21.15.104:0/504593762 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9edc005bc0 0x7f9ef41401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:46.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef2d9d640 1 --2- 172.21.15.104:0/504593762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ef41f2e50 0x7f9ef41f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:46.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef1d9b640 1 -- 172.21.15.104:0/504593762 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9edc005bc0 msgr2=0x7f9ef41401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:46.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef1d9b640 1 --2- 172.21.15.104:0/504593762 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9edc005bc0 0x7f9ef41401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:46.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef1d9b640 1 -- 172.21.15.104:0/504593762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ef41f2e50 msgr2=0x7f9ef41f32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:46.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef1d9b640 1 --2- 172.21.15.104:0/504593762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ef41f2e50 0x7f9ef41f32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:46.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.466+0000 7f9ef1d9b640 1 -- 172.21.15.104:0/504593762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef40b52e0 con 0x7f9ef41f3a60 2024-05-08T04:20:46.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.467+0000 7f9ef1d9b640 1 --2- 172.21.15.104:0/504593762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ef41f3a60 0x7f9ef40b4990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009b20 tx=0x7f9ee8011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:46.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.467+0000 7f9ee2ffd640 1 -- 172.21.15.104:0/504593762 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8011460 con 0x7f9ef41f3a60 2024-05-08T04:20:46.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.467+0000 7f9ee2ffd640 1 -- 172.21.15.104:0/504593762 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee800b7b0 con 0x7f9ef41f3a60 2024-05-08T04:20:46.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.467+0000 7f9ee2ffd640 1 -- 172.21.15.104:0/504593762 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee800bb80 con 0x7f9ef41f3a60 2024-05-08T04:20:46.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.467+0000 7f9ef88e1640 1 -- 172.21.15.104:0/504593762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef40b55c0 con 0x7f9ef41f3a60 2024-05-08T04:20:46.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.467+0000 7f9ef88e1640 1 -- 172.21.15.104:0/504593762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef40b5b80 con 0x7f9ef41f3a60 2024-05-08T04:20:46.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.467+0000 7f9ee2ffd640 1 -- 172.21.15.104:0/504593762 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9ee80108f0 con 0x7f9ef41f3a60 2024-05-08T04:20:46.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.467+0000 7f9ee2ffd640 1 -- 172.21.15.104:0/504593762 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9ee8024e00 con 0x7f9ef41f3a60 2024-05-08T04:20:46.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.468+0000 7f9ef88e1640 1 -- 172.21.15.104:0/504593762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef4075010 con 0x7f9ef41f3a60 2024-05-08T04:20:46.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.470+0000 7f9ee2ffd640 1 -- 172.21.15.104:0/504593762 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9ee8016070 con 0x7f9ef41f3a60 2024-05-08T04:20:46.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.536+0000 7f9ef88e1640 1 -- 172.21.15.104:0/504593762 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9ef40c9f90 con 0x7f9ef41f3a60 2024-05-08T04:20:46.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.537+0000 7f9ee2ffd640 1 -- 172.21.15.104:0/504593762 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9ee800bd20 con 0x7f9ef41f3a60 2024-05-08T04:20:46.538 INFO:teuthology.orchestra.run.smithi104.stderr:adjusted tunables profile to default 2024-05-08T04:20:46.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.538+0000 7f9ef88e1640 1 -- 172.21.15.104:0/504593762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ef41f3a60 msgr2=0x7f9ef40b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:46.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.538+0000 7f9ef88e1640 1 --2- 172.21.15.104:0/504593762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ef41f3a60 0x7f9ef40b4990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009b20 tx=0x7f9ee8011f60 comp rx=0 tx=0).stop 2024-05-08T04:20:46.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.538+0000 7f9ef88e1640 1 -- 172.21.15.104:0/504593762 shutdown_connections 2024-05-08T04:20:46.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.538+0000 7f9ef88e1640 1 --2- 172.21.15.104:0/504593762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ef41f2e50 0x7f9ef41f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:46.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.538+0000 7f9ef88e1640 1 --2- 172.21.15.104:0/504593762 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ef41f3a60 0x7f9ef40b4990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:46.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.538+0000 7f9ef88e1640 1 --2- 172.21.15.104:0/504593762 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9edc005bc0 0x7f9ef41401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:46.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.538+0000 7f9ef88e1640 1 -- 172.21.15.104:0/504593762 >> 172.21.15.104:0/504593762 conn(0x7f9ef40cc890 msgr2=0x7f9ef40cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:46.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.538+0000 7f9ef88e1640 1 -- 172.21.15.104:0/504593762 shutdown_connections 2024-05-08T04:20:46.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:46.538+0000 7f9ef88e1640 1 -- 172.21.15.104:0/504593762 wait complete. 2024-05-08T04:20:46.550 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T04:20:46.550 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T04:20:46.550 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:46.550 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T04:20:46.573 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:46.572+0000 7f2874a0d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T04:20:46.575 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:46.575 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T04:20:46.580 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:46.578+0000 7f76de91e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T04:20:46.641 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:46.641 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T04:20:46.705 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:20:46.705 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T04:20:46.734 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:46.732+0000 7f76de91e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T04:20:46.770 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:46.770 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-08T04:20:46.784 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:46.783+0000 7f2874a0d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T04:20:46.787 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:46.785+0000 7f76de91e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T04:20:46.795 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:46.795 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-08T04:20:46.838 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:46.837+0000 7f2874a0d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T04:20:46.860 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:46.860 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-08T04:20:46.925 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:20:46.925 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-08T04:20:46.990 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new b46048bf-ae50-47a6-bc07-2e61e9ba7693 0 2024-05-08T04:20:47.047 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:47.046+0000 7f76de91e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T04:20:47.082 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:47.082+0000 7f2874a0d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T04:20:47.096 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:47.094+0000 7f76de91e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T04:20:47.127 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:47.126+0000 7f2874a0d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T04:20:47.131 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.129+0000 7fa02c39e640 1 Processor -- start 2024-05-08T04:20:47.131 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.129+0000 7fa02c39e640 1 -- start start 2024-05-08T04:20:47.132 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.130+0000 7fa02c39e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa024099cb0 0x7fa02406be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.132 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.130+0000 7fa02c39e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02406cb40 con 0x7fa02406c3c0 2024-05-08T04:20:47.132 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.130+0000 7fa02c39e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02406ce20 con 0x7fa02409a090 2024-05-08T04:20:47.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.130+0000 7fa02c39e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02406fdc0 con 0x7fa024099cb0 2024-05-08T04:20:47.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.130+0000 7fa02a13a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa024099cb0 0x7fa02406be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.130+0000 7fa029939640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fa02409a090 0x7fa0240705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:40960/0 (socket says 172.21.15.183:40960) 2024-05-08T04:20:47.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.130+0000 7fa029939640 1 -- 172.21.15.183:0/1717718316 learned_addr learned my addr 172.21.15.183:0/1717718316 (peer_addr_for_me v1:172.21.15.183:0/0) 2024-05-08T04:20:47.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.131+0000 7fa02a13a640 1 -- 172.21.15.183:0/1717718316 >> v1:172.21.15.183:6789/0 conn(0x7fa02409a090 legacy=0x7fa0240705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.131+0000 7fa029138640 1 -- 172.21.15.183:0/1717718316 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573744697 0 0) 0x7fa02406ce20 con 0x7fa02409a090 2024-05-08T04:20:47.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.131+0000 7fa02a13a640 1 -- 172.21.15.183:0/1717718316 >> v1:172.21.15.104:6789/0 conn(0x7fa02406c3c0 legacy=0x7fa02415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.133 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.131+0000 7fa02a13a640 1 -- 172.21.15.183:0/1717718316 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0240700a0 con 0x7fa024099cb0 2024-05-08T04:20:47.134 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.131+0000 7fa02a13a640 1 --2- 172.21.15.183:0/1717718316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa024099cb0 0x7fa02406be80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa0140097d0 tx=0x7fa01402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d7620f417041b0e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:47.134 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.131+0000 7fa029138640 1 -- 172.21.15.183:0/1717718316 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014037070 con 0x7fa024099cb0 2024-05-08T04:20:47.134 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.131+0000 7fa029138640 1 -- 172.21.15.183:0/1717718316 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa014032440 con 0x7fa024099cb0 2024-05-08T04:20:47.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.131+0000 7fa029138640 1 -- 172.21.15.183:0/1717718316 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014032810 con 0x7fa024099cb0 2024-05-08T04:20:47.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.132+0000 7fa02c39e640 1 -- 172.21.15.183:0/1717718316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa024099cb0 msgr2=0x7fa02406be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.132+0000 7fa02c39e640 1 --2- 172.21.15.183:0/1717718316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa024099cb0 0x7fa02406be80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa0140097d0 tx=0x7fa01402a210 comp rx=0 tx=0).stop 2024-05-08T04:20:47.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.132+0000 7fa02c39e640 1 -- 172.21.15.183:0/1717718316 shutdown_connections 2024-05-08T04:20:47.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.132+0000 7fa02c39e640 1 --2- 172.21.15.183:0/1717718316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa024099cb0 0x7fa02406be80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.132+0000 7fa02c39e640 1 -- 172.21.15.183:0/1717718316 >> 172.21.15.183:0/1717718316 conn(0x7fa0240b32f0 msgr2=0x7fa0240b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:47.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.132+0000 7fa02c39e640 1 -- 172.21.15.183:0/1717718316 shutdown_connections 2024-05-08T04:20:47.135 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.132+0000 7fa02c39e640 1 -- 172.21.15.183:0/1717718316 wait complete. 2024-05-08T04:20:47.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.133+0000 7fa02c39e640 1 Processor -- start 2024-05-08T04:20:47.137 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.133+0000 7fa02c39e640 1 -- start start 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02c39e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa02406c3c0 0x7fa02415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02c39e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa024099cb0 0x7fa0240cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02c39e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa02409a090 0x7fa0240cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02c39e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0240cbe50 con 0x7fa024099cb0 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02c39e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02406fa70 con 0x7fa02409a090 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02c39e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0240cbfd0 con 0x7fa02406c3c0 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02a13a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa02406c3c0 0x7fa02415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02a13a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa02406c3c0 0x7fa02415aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:56708/0 (socket says 172.21.15.183:56708) 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02a13a640 1 -- 172.21.15.183:0/2341356872 learned_addr learned my addr 172.21.15.183:0/2341356872 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02a93b640 1 --2- 172.21.15.183:0/2341356872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa02409a090 0x7fa0240cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa029939640 1 --2- 172.21.15.183:0/2341356872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa024099cb0 0x7fa0240cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02a13a640 1 -- 172.21.15.183:0/2341356872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa02409a090 msgr2=0x7fa0240cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02a13a640 1 --2- 172.21.15.183:0/2341356872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa02409a090 0x7fa0240cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.138 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02a13a640 1 -- 172.21.15.183:0/2341356872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa024099cb0 msgr2=0x7fa0240cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.139 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.134+0000 7fa02a13a640 1 --2- 172.21.15.183:0/2341356872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa024099cb0 0x7fa0240cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.139 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.135+0000 7fa02a13a640 1 -- 172.21.15.183:0/2341356872 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa024144840 con 0x7fa02406c3c0 2024-05-08T04:20:47.139 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.135+0000 7fa02a13a640 1 --2- 172.21.15.183:0/2341356872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa02406c3c0 0x7fa02415aab0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa0140097d0 tx=0x7fa0140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:47.139 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.135+0000 7fa01affd640 1 -- 172.21.15.183:0/2341356872 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014037040 con 0x7fa02406c3c0 2024-05-08T04:20:47.139 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.135+0000 7fa01affd640 1 -- 172.21.15.183:0/2341356872 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa014030770 con 0x7fa02406c3c0 2024-05-08T04:20:47.139 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.135+0000 7fa02c39e640 1 -- 172.21.15.183:0/2341356872 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa024144b20 con 0x7fa02406c3c0 2024-05-08T04:20:47.139 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.135+0000 7fa01affd640 1 -- 172.21.15.183:0/2341356872 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014030b40 con 0x7fa02406c3c0 2024-05-08T04:20:47.139 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.135+0000 7fa02c39e640 1 -- 172.21.15.183:0/2341356872 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0241450e0 con 0x7fa02406c3c0 2024-05-08T04:20:47.139 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.135+0000 7fa01affd640 1 -- 172.21.15.183:0/2341356872 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa014044020 con 0x7fa02406c3c0 2024-05-08T04:20:47.139 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.135+0000 7fa01affd640 1 -- 172.21.15.183:0/2341356872 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa014046410 con 0x7fa02406c3c0 2024-05-08T04:20:47.139 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.136+0000 7fa02c39e640 1 -- 172.21.15.183:0/2341356872 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa024075010 con 0x7fa02406c3c0 2024-05-08T04:20:47.140 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.138+0000 7fa01affd640 1 -- 172.21.15.183:0/2341356872 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa01404b020 con 0x7fa02406c3c0 2024-05-08T04:20:47.210 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.208+0000 7fa02c39e640 1 -- 172.21.15.183:0/2341356872 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b46048bf-ae50-47a6-bc07-2e61e9ba7693", "id": 0} v 0) v1 -- 0x7fa02415dd10 con 0x7fa02406c3c0 2024-05-08T04:20:47.216 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.214+0000 7fa01affd640 1 -- 172.21.15.183:0/2341356872 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b46048bf-ae50-47a6-bc07-2e61e9ba7693", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa014032e20 con 0x7fa02406c3c0 2024-05-08T04:20:47.216 INFO:teuthology.orchestra.run.smithi183.stdout:0 2024-05-08T04:20:47.217 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.215+0000 7fa02c39e640 1 -- 172.21.15.183:0/2341356872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa02406c3c0 msgr2=0x7fa02415aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.217 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.215+0000 7fa02c39e640 1 --2- 172.21.15.183:0/2341356872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa02406c3c0 0x7fa02415aab0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa0140097d0 tx=0x7fa0140046c0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.217 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.215+0000 7fa02c39e640 1 -- 172.21.15.183:0/2341356872 shutdown_connections 2024-05-08T04:20:47.217 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.215+0000 7fa02c39e640 1 --2- 172.21.15.183:0/2341356872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa02409a090 0x7fa0240cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.217 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.215+0000 7fa02c39e640 1 --2- 172.21.15.183:0/2341356872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa024099cb0 0x7fa0240cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.217 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.215+0000 7fa02c39e640 1 --2- 172.21.15.183:0/2341356872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa02406c3c0 0x7fa02415aab0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.217 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.215+0000 7fa02c39e640 1 -- 172.21.15.183:0/2341356872 >> 172.21.15.183:0/2341356872 conn(0x7fa0240b32f0 msgr2=0x7fa0240cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:47.218 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.215+0000 7fa02c39e640 1 -- 172.21.15.183:0/2341356872 shutdown_connections 2024-05-08T04:20:47.218 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.215+0000 7fa02c39e640 1 -- 172.21.15.183:0/2341356872 wait complete. 2024-05-08T04:20:47.227 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 34c6e8e7-370e-4174-a877-d78be6a72479 1 2024-05-08T04:20:47.367 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.366+0000 7f0c18e74640 1 Processor -- start 2024-05-08T04:20:47.368 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.366+0000 7f0c18e74640 1 -- start start 2024-05-08T04:20:47.371 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c18e74640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0c14072490 0x7f0c1415e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.371 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c18e74640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1415ba80 con 0x7f0c1415edf0 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c18e74640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c14161ee0 con 0x7f0c1415b6a0 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c18e74640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c141621c0 con 0x7f0c14072490 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c1259c640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f0c1415b6a0 0x7f0c14161690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:40974/0 (socket says 172.21.15.183:40974) 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c1259c640 1 -- 172.21.15.183:0/1588125616 learned_addr learned my addr 172.21.15.183:0/1588125616 (peer_addr_for_me v1:172.21.15.183:0/0) 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c09d9b640 1 --2- 172.21.15.183:0/1588125616 >> v2:172.21.15.104:3300/0 conn(0x7f0c14072490 0x7f0c1415e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407687002 0 0) 0x7f0c14161ee0 con 0x7f0c1415b6a0 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c00003520 con 0x7f0c1415b6a0 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242257766 0 0) 0x7f0c1415ba80 con 0x7f0c1415edf0 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c14161ee0 con 0x7f0c1415edf0 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3879157840 0 0) 0x7f0c00003520 con 0x7f0c1415b6a0 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 >> v2:172.21.15.104:3300/0 conn(0x7f0c14072490 msgr2=0x7f0c1415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 --2- 172.21.15.183:0/1588125616 >> v2:172.21.15.104:3300/0 conn(0x7f0c14072490 0x7f0c1415e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 >> v1:172.21.15.104:6789/0 conn(0x7f0c1415edf0 legacy=0x7f0c1406bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c141624a0 con 0x7f0c1415b6a0 2024-05-08T04:20:47.372 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f0c04001670 con 0x7f0c1415b6a0 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 >> v1:172.21.15.183:6789/0 conn(0x7f0c1415b6a0 legacy=0x7f0c14161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 --2- 172.21.15.183:0/1588125616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c00003b40 0x7f0c00003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 --2- 172.21.15.183:0/1588125616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c00004800 0x7f0c00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 --2- 172.21.15.183:0/1588125616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c000051c0 0x7f0c0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c141621c0 con 0x7f0c00003b40 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0000c040 con 0x7f0c000051c0 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0000c240 con 0x7f0c00004800 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c12d9d640 1 --2- 172.21.15.183:0/1588125616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c000051c0 0x7f0c0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c09d9b640 1 --2- 172.21.15.183:0/1588125616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c00004800 0x7f0c00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.367+0000 7f0c1259c640 1 --2- 172.21.15.183:0/1588125616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c00003b40 0x7f0c00003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.368+0000 7f0c09d9b640 1 -- 172.21.15.183:0/1588125616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c000051c0 msgr2=0x7f0c0000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.368+0000 7f0c09d9b640 1 --2- 172.21.15.183:0/1588125616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c000051c0 0x7f0c0000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.368+0000 7f0c09d9b640 1 -- 172.21.15.183:0/1588125616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c00003b40 msgr2=0x7f0c00003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.368+0000 7f0c09d9b640 1 --2- 172.21.15.183:0/1588125616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c00003b40 0x7f0c00003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.373 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.368+0000 7f0c09d9b640 1 -- 172.21.15.183:0/1588125616 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c00003520 con 0x7f0c00004800 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.368+0000 7f0c12d9d640 1 --2- 172.21.15.183:0/1588125616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c000051c0 0x7f0c0000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.368+0000 7f0c1259c640 1 --2- 172.21.15.183:0/1588125616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c00003b40 0x7f0c00003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.368+0000 7f0c12d9d640 1 -- 172.21.15.183:0/1588125616 reap_dead start 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.368+0000 7f0c09d9b640 1 --2- 172.21.15.183:0/1588125616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c00004800 0x7f0c00004c80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009ac0 tx=0x7f0c00005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=151dc63a570b93b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.369+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc036070 con 0x7f0c00004800 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.369+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc031400 con 0x7f0c00004800 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.369+0000 7f0c11d9b640 1 -- 172.21.15.183:0/1588125616 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc009690 con 0x7f0c00004800 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.369+0000 7f0c18e74640 1 -- 172.21.15.183:0/1588125616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c00004800 msgr2=0x7f0c00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.369+0000 7f0c18e74640 1 --2- 172.21.15.183:0/1588125616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c00004800 0x7f0c00004c80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009ac0 tx=0x7f0c00005830 comp rx=0 tx=0).stop 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.369+0000 7f0c18e74640 1 -- 172.21.15.183:0/1588125616 shutdown_connections 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.369+0000 7f0c18e74640 1 --2- 172.21.15.183:0/1588125616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c00004800 0x7f0c00004c80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.369+0000 7f0c18e74640 1 -- 172.21.15.183:0/1588125616 >> 172.21.15.183:0/1588125616 conn(0x7f0c14071970 msgr2=0x7f0c14071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.369+0000 7f0c18e74640 1 -- 172.21.15.183:0/1588125616 shutdown_connections 2024-05-08T04:20:47.374 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.369+0000 7f0c18e74640 1 -- 172.21.15.183:0/1588125616 wait complete. 2024-05-08T04:20:47.377 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.371+0000 7f0c18e74640 1 Processor -- start 2024-05-08T04:20:47.377 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.371+0000 7f0c18e74640 1 -- start start 2024-05-08T04:20:47.377 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.371+0000 7f0c18e74640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c00004800 0x7f0c140ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.377 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.371+0000 7f0c18e74640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c14145890 0x7f0c140cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.377 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.371+0000 7f0c18e74640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c141595b0 0x7f0c14159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.377 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.371+0000 7f0c18e74640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1415e8b0 con 0x7f0c14145890 2024-05-08T04:20:47.377 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.371+0000 7f0c18e74640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1415e050 con 0x7f0c141595b0 2024-05-08T04:20:47.377 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.371+0000 7f0c18e74640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1415ea30 con 0x7f0c00004800 2024-05-08T04:20:47.377 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c1259c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c00004800 0x7f0c140ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.377 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c1259c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c00004800 0x7f0c140ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:56726/0 (socket says 172.21.15.183:56726) 2024-05-08T04:20:47.377 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c1259c640 1 -- 172.21.15.183:0/4216407441 learned_addr learned my addr 172.21.15.183:0/4216407441 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T04:20:47.378 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c12d9d640 1 --2- 172.21.15.183:0/4216407441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c141595b0 0x7f0c14159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.378 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c09d9b640 1 --2- 172.21.15.183:0/4216407441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c14145890 0x7f0c140cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.378 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c12d9d640 1 -- 172.21.15.183:0/4216407441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c00004800 msgr2=0x7f0c140ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.378 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c12d9d640 1 --2- 172.21.15.183:0/4216407441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c00004800 0x7f0c140ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.378 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c12d9d640 1 -- 172.21.15.183:0/4216407441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c14145890 msgr2=0x7f0c140cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.378 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c12d9d640 1 --2- 172.21.15.183:0/4216407441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c14145890 0x7f0c140cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.378 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c12d9d640 1 -- 172.21.15.183:0/4216407441 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c140ce820 con 0x7f0c141595b0 2024-05-08T04:20:47.378 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c1259c640 1 --2- 172.21.15.183:0/4216407441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c00004800 0x7f0c140ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:20:47.378 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c09d9b640 1 --2- 172.21.15.183:0/4216407441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c14145890 0x7f0c140cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:20:47.378 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c12d9d640 1 --2- 172.21.15.183:0/4216407441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c141595b0 0x7f0c14159a30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0c140cc3f0 tx=0x7f0c0c00d520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:47.378 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c0b7fe640 1 -- 172.21.15.183:0/4216407441 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04007ca0 con 0x7f0c141595b0 2024-05-08T04:20:47.378 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c0b7fe640 1 -- 172.21.15.183:0/4216407441 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c018070 con 0x7f0c141595b0 2024-05-08T04:20:47.378 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c18e74640 1 -- 172.21.15.183:0/4216407441 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c140ceb00 con 0x7f0c141595b0 2024-05-08T04:20:47.379 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c0b7fe640 1 -- 172.21.15.183:0/4216407441 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c001bf0 con 0x7f0c141595b0 2024-05-08T04:20:47.379 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c18e74640 1 -- 172.21.15.183:0/4216407441 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c140cf0c0 con 0x7f0c141595b0 2024-05-08T04:20:47.379 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.372+0000 7f0c0b7fe640 1 -- 172.21.15.183:0/4216407441 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0c0c003970 con 0x7f0c141595b0 2024-05-08T04:20:47.379 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.373+0000 7f0c0b7fe640 1 -- 172.21.15.183:0/4216407441 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f0c0c01d810 con 0x7f0c141595b0 2024-05-08T04:20:47.379 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.373+0000 7f0c18e74640 1 -- 172.21.15.183:0/4216407441 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c14075010 con 0x7f0c141595b0 2024-05-08T04:20:47.379 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.375+0000 7f0c0b7fe640 1 -- 172.21.15.183:0/4216407441 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0c0c003da0 con 0x7f0c141595b0 2024-05-08T04:20:47.449 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.447+0000 7f0c18e74640 1 -- 172.21.15.183:0/4216407441 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "34c6e8e7-370e-4174-a877-d78be6a72479", "id": 1} v 0) v1 -- 0x7f0c140aedf0 con 0x7f0c141595b0 2024-05-08T04:20:47.457 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.455+0000 7f0c0b7fe640 1 -- 172.21.15.183:0/4216407441 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34c6e8e7-370e-4174-a877-d78be6a72479", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c0c00ddc0 con 0x7f0c141595b0 2024-05-08T04:20:47.457 INFO:teuthology.orchestra.run.smithi183.stdout:1 2024-05-08T04:20:47.458 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.456+0000 7f0c18e74640 1 -- 172.21.15.183:0/4216407441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c141595b0 msgr2=0x7f0c14159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.458 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.456+0000 7f0c18e74640 1 --2- 172.21.15.183:0/4216407441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c141595b0 0x7f0c14159a30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0c140cc3f0 tx=0x7f0c0c00d520 comp rx=0 tx=0).stop 2024-05-08T04:20:47.458 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.456+0000 7f0c18e74640 1 -- 172.21.15.183:0/4216407441 shutdown_connections 2024-05-08T04:20:47.458 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.456+0000 7f0c18e74640 1 --2- 172.21.15.183:0/4216407441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c141595b0 0x7f0c14159a30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.458 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.456+0000 7f0c18e74640 1 --2- 172.21.15.183:0/4216407441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c14145890 0x7f0c140cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.458 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.456+0000 7f0c18e74640 1 --2- 172.21.15.183:0/4216407441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c00004800 0x7f0c140ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.458 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.456+0000 7f0c18e74640 1 -- 172.21.15.183:0/4216407441 >> 172.21.15.183:0/4216407441 conn(0x7f0c14071970 msgr2=0x7f0c141616e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:47.458 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.456+0000 7f0c18e74640 1 -- 172.21.15.183:0/4216407441 shutdown_connections 2024-05-08T04:20:47.459 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.456+0000 7f0c18e74640 1 -- 172.21.15.183:0/4216407441 wait complete. 2024-05-08T04:20:47.470 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new c3981d86-c512-4836-ab38-4bef72d3ce0a 2 2024-05-08T04:20:47.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.569+0000 7f842173b640 1 Processor -- start 2024-05-08T04:20:47.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.569+0000 7f842173b640 1 -- start start 2024-05-08T04:20:47.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.570+0000 7f842173b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f841c15de10 0x7f841c161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.570+0000 7f842173b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f841c0d07c0 0x7f841c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.570+0000 7f842173b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841c15e1f0 con 0x7f841c0ce5a0 2024-05-08T04:20:47.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.570+0000 7f842173b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841c0d0f50 con 0x7f841c0d07c0 2024-05-08T04:20:47.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.570+0000 7f842173b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c161e60 con 0x7f841c15de10 2024-05-08T04:20:47.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.570+0000 7f841affd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f841c15de10 0x7f841c161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.572 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.570+0000 7f8413fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f841c0ce5a0 0x7f841c0d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:40986/0 (socket says 172.21.15.183:40986) 2024-05-08T04:20:47.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.570+0000 7f8413fff640 1 -- 172.21.15.183:0/985807206 learned_addr learned my addr 172.21.15.183:0/985807206 (peer_addr_for_me v1:172.21.15.183:0/0) 2024-05-08T04:20:47.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.570+0000 7f841affd640 1 -- 172.21.15.183:0/985807206 >> v2:172.21.15.104:3300/0 conn(0x7f841c0d07c0 msgr2=0x7f841c0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:20:47.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.570+0000 7f841affd640 1 --2- 172.21.15.183:0/985807206 >> v2:172.21.15.104:3300/0 conn(0x7f841c0d07c0 0x7f841c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.570+0000 7f841affd640 1 -- 172.21.15.183:0/985807206 >> v1:172.21.15.183:6789/0 conn(0x7f841c0ce5a0 legacy=0x7f841c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.570+0000 7f841affd640 1 -- 172.21.15.183:0/985807206 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c162090 con 0x7f841c15de10 2024-05-08T04:20:47.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.570+0000 7f841a7fc640 1 -- 172.21.15.183:0/985807206 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368217834 0 0) 0x7f841c15e1f0 con 0x7f841c0ce5a0 2024-05-08T04:20:47.574 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.571+0000 7f841affd640 1 --2- 172.21.15.183:0/985807206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f841c15de10 0x7f841c161920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f840c0097a0 tx=0x7f840c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d6d3c978796c2c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:47.574 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.571+0000 7f841a7fc640 1 -- 172.21.15.183:0/985807206 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c037070 con 0x7f841c15de10 2024-05-08T04:20:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.571+0000 7f841a7fc640 1 -- 172.21.15.183:0/985807206 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c02ae50 con 0x7f841c15de10 2024-05-08T04:20:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.571+0000 7f841a7fc640 1 -- 172.21.15.183:0/985807206 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c032660 con 0x7f841c15de10 2024-05-08T04:20:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.571+0000 7f842173b640 1 -- 172.21.15.183:0/985807206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f841c15de10 msgr2=0x7f841c161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.571+0000 7f842173b640 1 --2- 172.21.15.183:0/985807206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f841c15de10 0x7f841c161920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f840c0097a0 tx=0x7f840c02a100 comp rx=0 tx=0).stop 2024-05-08T04:20:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.572+0000 7f842173b640 1 -- 172.21.15.183:0/985807206 shutdown_connections 2024-05-08T04:20:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.572+0000 7f842173b640 1 --2- 172.21.15.183:0/985807206 >> v2:172.21.15.104:3300/0 conn(0x7f841c0d07c0 0x7f841c0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.572+0000 7f842173b640 1 --2- 172.21.15.183:0/985807206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f841c15de10 0x7f841c161920 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.572+0000 7f842173b640 1 -- 172.21.15.183:0/985807206 >> 172.21.15.183:0/985807206 conn(0x7f841c072290 msgr2=0x7f841c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.572+0000 7f842173b640 1 -- 172.21.15.183:0/985807206 shutdown_connections 2024-05-08T04:20:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.572+0000 7f842173b640 1 -- 172.21.15.183:0/985807206 wait complete. 2024-05-08T04:20:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.573+0000 7f842173b640 1 Processor -- start 2024-05-08T04:20:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.573+0000 7f842173b640 1 -- start start 2024-05-08T04:20:47.578 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.573+0000 7f842173b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f841c0ce5a0 0x7f841c0c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.578 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.573+0000 7f842173b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f841c0d07c0 0x7f841c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.578 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.573+0000 7f842173b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f841c15de10 0x7f841c15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.578 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.573+0000 7f842173b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c162650 con 0x7f841c15de10 2024-05-08T04:20:47.578 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.573+0000 7f842173b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c0d1a90 con 0x7f841c0ce5a0 2024-05-08T04:20:47.578 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.573+0000 7f842173b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c0d1ce0 con 0x7f841c0d07c0 2024-05-08T04:20:47.578 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.573+0000 7f8413fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f841c0d07c0 0x7f841c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.578 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.573+0000 7f841affd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f841c0ce5a0 0x7f841c0c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.578 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f8413fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f841c0d07c0 0x7f841c15c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:56746/0 (socket says 172.21.15.183:56746) 2024-05-08T04:20:47.578 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f841affd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f841c0ce5a0 0x7f841c0c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44086/0 (socket says 172.21.15.183:44086) 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f8413fff640 1 -- 172.21.15.183:0/2004334499 learned_addr learned my addr 172.21.15.183:0/2004334499 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f841b7fe640 1 --2- 172.21.15.183:0/2004334499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f841c15de10 0x7f841c15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f8413fff640 1 -- 172.21.15.183:0/2004334499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f841c0ce5a0 msgr2=0x7f841c0c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f8413fff640 1 --2- 172.21.15.183:0/2004334499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f841c0ce5a0 0x7f841c0c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f8413fff640 1 -- 172.21.15.183:0/2004334499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f841c15de10 msgr2=0x7f841c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f8413fff640 1 --2- 172.21.15.183:0/2004334499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f841c15de10 0x7f841c15ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f8413fff640 1 -- 172.21.15.183:0/2004334499 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c0b5140 con 0x7f841c0d07c0 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f841affd640 1 --2- 172.21.15.183:0/2004334499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f841c0ce5a0 0x7f841c0c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f8413fff640 1 --2- 172.21.15.183:0/2004334499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f841c0d07c0 0x7f841c15c8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f840400c4d0 tx=0x7f840400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f84137fe640 1 -- 172.21.15.183:0/2004334499 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404018070 con 0x7f841c0d07c0 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f84137fe640 1 -- 172.21.15.183:0/2004334499 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8404007500 con 0x7f841c0d07c0 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f842173b640 1 -- 172.21.15.183:0/2004334499 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841c143a40 con 0x7f841c0d07c0 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f84137fe640 1 -- 172.21.15.183:0/2004334499 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404004a20 con 0x7f841c0d07c0 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f842173b640 1 -- 172.21.15.183:0/2004334499 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841c144000 con 0x7f841c0d07c0 2024-05-08T04:20:47.579 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f84137fe640 1 -- 172.21.15.183:0/2004334499 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f840401b070 con 0x7f841c0d07c0 2024-05-08T04:20:47.580 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.574+0000 7f84137fe640 1 -- 172.21.15.183:0/2004334499 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f8404012820 con 0x7f841c0d07c0 2024-05-08T04:20:47.580 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.575+0000 7f842173b640 1 -- 172.21.15.183:0/2004334499 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841c0d1870 con 0x7f841c0d07c0 2024-05-08T04:20:47.580 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.577+0000 7f84137fe640 1 -- 172.21.15.183:0/2004334499 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f8404012460 con 0x7f841c0d07c0 2024-05-08T04:20:47.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.649+0000 7f842173b640 1 -- 172.21.15.183:0/2004334499 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c3981d86-c512-4836-ab38-4bef72d3ce0a", "id": 2} v 0) v1 -- 0x7f841c0cf0e0 con 0x7f841c0d07c0 2024-05-08T04:20:47.656 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.654+0000 7f84137fe640 1 -- 172.21.15.183:0/2004334499 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c3981d86-c512-4836-ab38-4bef72d3ce0a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8404004bc0 con 0x7f841c0d07c0 2024-05-08T04:20:47.656 INFO:teuthology.orchestra.run.smithi183.stdout:2 2024-05-08T04:20:47.657 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.655+0000 7f842173b640 1 -- 172.21.15.183:0/2004334499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f841c0d07c0 msgr2=0x7f841c15c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.657 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.655+0000 7f842173b640 1 --2- 172.21.15.183:0/2004334499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f841c0d07c0 0x7f841c15c8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f840400c4d0 tx=0x7f840400c990 comp rx=0 tx=0).stop 2024-05-08T04:20:47.657 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.655+0000 7f842173b640 1 -- 172.21.15.183:0/2004334499 shutdown_connections 2024-05-08T04:20:47.657 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.655+0000 7f842173b640 1 --2- 172.21.15.183:0/2004334499 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f841c15de10 0x7f841c15ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.658 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.655+0000 7f842173b640 1 --2- 172.21.15.183:0/2004334499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f841c0d07c0 0x7f841c15c8c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.658 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.655+0000 7f842173b640 1 --2- 172.21.15.183:0/2004334499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f841c0ce5a0 0x7f841c0c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.658 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.655+0000 7f842173b640 1 -- 172.21.15.183:0/2004334499 >> 172.21.15.183:0/2004334499 conn(0x7f841c072290 msgr2=0x7f841c0d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:47.658 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.655+0000 7f842173b640 1 -- 172.21.15.183:0/2004334499 shutdown_connections 2024-05-08T04:20:47.658 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.655+0000 7f842173b640 1 -- 172.21.15.183:0/2004334499 wait complete. 2024-05-08T04:20:47.668 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 1bf57c2e-6076-43ac-a956-f3b61891430e 3 2024-05-08T04:20:47.767 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.765+0000 7fa1edd70640 1 Processor -- start 2024-05-08T04:20:47.767 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.765+0000 7fa1edd70640 1 -- start start 2024-05-08T04:20:47.768 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.766+0000 7fa1edd70640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa1e806ab60 0x7fa1e815caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.769 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.766+0000 7fa1edd70640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa1e80cad60 0x7fa1e80cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.769 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.766+0000 7fa1edd70640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e80cb6b0 con 0x7fa1e8072f90 2024-05-08T04:20:47.769 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.766+0000 7fa1edd70640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e815c010 con 0x7fa1e80cad60 2024-05-08T04:20:47.769 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.766+0000 7fa1edd70640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e815c2f0 con 0x7fa1e806ab60 2024-05-08T04:20:47.769 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.766+0000 7fa1e77fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa1e806ab60 0x7fa1e815caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.769 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.766+0000 7fa1e77fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa1e806ab60 0x7fa1e815caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44090/0 (socket says 172.21.15.183:44090) 2024-05-08T04:20:47.769 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.766+0000 7fa1e77fe640 1 -- 172.21.15.183:0/923993153 learned_addr learned my addr 172.21.15.183:0/923993153 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T04:20:47.769 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.766+0000 7fa1e7fff640 1 --2- 172.21.15.183:0/923993153 >> v2:172.21.15.104:3300/0 conn(0x7fa1e80cad60 0x7fa1e80cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.769 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.767+0000 7fa1e77fe640 1 -- 172.21.15.183:0/923993153 >> v2:172.21.15.104:3300/0 conn(0x7fa1e80cad60 msgr2=0x7fa1e80cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:20:47.769 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.767+0000 7fa1e77fe640 1 --2- 172.21.15.183:0/923993153 >> v2:172.21.15.104:3300/0 conn(0x7fa1e80cad60 0x7fa1e80cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.769 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.767+0000 7fa1e77fe640 1 -- 172.21.15.183:0/923993153 >> v1:172.21.15.104:6789/0 conn(0x7fa1e8072f90 legacy=0x7fa1e806af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.769 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.767+0000 7fa1e77fe640 1 -- 172.21.15.183:0/923993153 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e80cb990 con 0x7fa1e806ab60 2024-05-08T04:20:47.771 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.767+0000 7fa1e77fe640 1 --2- 172.21.15.183:0/923993153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1e806ab60 0x7fa1e815caf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1e806dc30 tx=0x7fa1d802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=275223aa65ff3a6b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:47.771 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.767+0000 7fa1e6ffd640 1 -- 172.21.15.183:0/923993153 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8037070 con 0x7fa1e806ab60 2024-05-08T04:20:47.771 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.767+0000 7fa1e6ffd640 1 -- 172.21.15.183:0/923993153 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d8032440 con 0x7fa1e806ab60 2024-05-08T04:20:47.771 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.767+0000 7fa1e6ffd640 1 -- 172.21.15.183:0/923993153 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8032810 con 0x7fa1e806ab60 2024-05-08T04:20:47.771 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.768+0000 7fa1edd70640 1 -- 172.21.15.183:0/923993153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1e806ab60 msgr2=0x7fa1e815caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.771 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.768+0000 7fa1edd70640 1 --2- 172.21.15.183:0/923993153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1e806ab60 0x7fa1e815caf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1e806dc30 tx=0x7fa1d802a270 comp rx=0 tx=0).stop 2024-05-08T04:20:47.771 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.768+0000 7fa1edd70640 1 -- 172.21.15.183:0/923993153 shutdown_connections 2024-05-08T04:20:47.771 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.768+0000 7fa1edd70640 1 --2- 172.21.15.183:0/923993153 >> v2:172.21.15.104:3300/0 conn(0x7fa1e80cad60 0x7fa1e80cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.771 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.768+0000 7fa1edd70640 1 --2- 172.21.15.183:0/923993153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1e806ab60 0x7fa1e815caf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.771 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.768+0000 7fa1edd70640 1 -- 172.21.15.183:0/923993153 >> 172.21.15.183:0/923993153 conn(0x7fa1e80b23e0 msgr2=0x7fa1e80b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:47.771 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.768+0000 7fa1edd70640 1 -- 172.21.15.183:0/923993153 shutdown_connections 2024-05-08T04:20:47.771 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.768+0000 7fa1edd70640 1 -- 172.21.15.183:0/923993153 wait complete. 2024-05-08T04:20:47.773 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.769+0000 7fa1edd70640 1 Processor -- start 2024-05-08T04:20:47.773 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.769+0000 7fa1edd70640 1 -- start start 2024-05-08T04:20:47.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.770+0000 7fa1edd70640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1e806ab60 0x7fa1e8159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.770+0000 7fa1edd70640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1e8072f90 0x7fa1e813dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.770+0000 7fa1edd70640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1e80cad60 0x7fa1e80b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.770+0000 7fa1edd70640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e80cb330 con 0x7fa1e8072f90 2024-05-08T04:20:47.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.770+0000 7fa1edd70640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e80cb1b0 con 0x7fa1e80cad60 2024-05-08T04:20:47.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.770+0000 7fa1edd70640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e80cd410 con 0x7fa1e806ab60 2024-05-08T04:20:47.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.770+0000 7fa1e77fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1e806ab60 0x7fa1e8159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.770+0000 7fa1e77fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1e806ab60 0x7fa1e8159490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:56762/0 (socket says 172.21.15.183:56762) 2024-05-08T04:20:47.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.770+0000 7fa1e77fe640 1 -- 172.21.15.183:0/645411225 learned_addr learned my addr 172.21.15.183:0/645411225 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T04:20:47.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.770+0000 7fa1e7fff640 1 --2- 172.21.15.183:0/645411225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1e80cad60 0x7fa1e80b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.770+0000 7fa1deffd640 1 --2- 172.21.15.183:0/645411225 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1e8072f90 0x7fa1e813dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.771+0000 7fa1e77fe640 1 -- 172.21.15.183:0/645411225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1e80cad60 msgr2=0x7fa1e80b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.774 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.771+0000 7fa1e77fe640 1 --2- 172.21.15.183:0/645411225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1e80cad60 0x7fa1e80b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.771+0000 7fa1e77fe640 1 -- 172.21.15.183:0/645411225 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1e8072f90 msgr2=0x7fa1e813dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.771+0000 7fa1e77fe640 1 --2- 172.21.15.183:0/645411225 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1e8072f90 0x7fa1e813dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.771+0000 7fa1e77fe640 1 -- 172.21.15.183:0/645411225 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8159b90 con 0x7fa1e806ab60 2024-05-08T04:20:47.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.771+0000 7fa1e77fe640 1 --2- 172.21.15.183:0/645411225 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1e806ab60 0x7fa1e8159490 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa1d802a2b0 tx=0x7fa1d80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:47.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.771+0000 7fa1e4ff9640 1 -- 172.21.15.183:0/645411225 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8037040 con 0x7fa1e806ab60 2024-05-08T04:20:47.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.771+0000 7fa1e4ff9640 1 -- 172.21.15.183:0/645411225 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d8042070 con 0x7fa1e806ab60 2024-05-08T04:20:47.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.771+0000 7fa1e4ff9640 1 -- 172.21.15.183:0/645411225 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8030880 con 0x7fa1e806ab60 2024-05-08T04:20:47.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.771+0000 7fa1edd70640 1 -- 172.21.15.183:0/645411225 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e80b39f0 con 0x7fa1e806ab60 2024-05-08T04:20:47.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.771+0000 7fa1edd70640 1 -- 172.21.15.183:0/645411225 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e813e200 con 0x7fa1e806ab60 2024-05-08T04:20:47.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.771+0000 7fa1e4ff9640 1 -- 172.21.15.183:0/645411225 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa1d8030a20 con 0x7fa1e806ab60 2024-05-08T04:20:47.775 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.771+0000 7fa1e4ff9640 1 -- 172.21.15.183:0/645411225 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fa1d803b430 con 0x7fa1e806ab60 2024-05-08T04:20:47.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.772+0000 7fa1edd70640 1 -- 172.21.15.183:0/645411225 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e80b0090 con 0x7fa1e806ab60 2024-05-08T04:20:47.776 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.774+0000 7fa1e4ff9640 1 -- 172.21.15.183:0/645411225 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa1e80b0090 con 0x7fa1e806ab60 2024-05-08T04:20:47.855 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:47.854+0000 7f2874a0d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T04:20:47.870 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.869+0000 7fa1edd70640 1 -- 172.21.15.183:0/645411225 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1bf57c2e-6076-43ac-a956-f3b61891430e", "id": 3} v 0) v1 -- 0x7fa1e8075010 con 0x7fa1e806ab60 2024-05-08T04:20:47.876 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.874+0000 7fa1e4ff9640 1 -- 172.21.15.183:0/645411225 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1bf57c2e-6076-43ac-a956-f3b61891430e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa1d8047460 con 0x7fa1e806ab60 2024-05-08T04:20:47.876 INFO:teuthology.orchestra.run.smithi183.stdout:3 2024-05-08T04:20:47.877 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.875+0000 7fa1edd70640 1 -- 172.21.15.183:0/645411225 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1e806ab60 msgr2=0x7fa1e8159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.877 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.875+0000 7fa1edd70640 1 --2- 172.21.15.183:0/645411225 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1e806ab60 0x7fa1e8159490 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa1d802a2b0 tx=0x7fa1d80046c0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.877 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.875+0000 7fa1edd70640 1 -- 172.21.15.183:0/645411225 shutdown_connections 2024-05-08T04:20:47.877 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.875+0000 7fa1edd70640 1 --2- 172.21.15.183:0/645411225 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1e80cad60 0x7fa1e80b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.877 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.875+0000 7fa1edd70640 1 --2- 172.21.15.183:0/645411225 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1e8072f90 0x7fa1e813dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.877 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.875+0000 7fa1edd70640 1 --2- 172.21.15.183:0/645411225 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1e806ab60 0x7fa1e8159490 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.877 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.875+0000 7fa1edd70640 1 -- 172.21.15.183:0/645411225 >> 172.21.15.183:0/645411225 conn(0x7fa1e80b23e0 msgr2=0x7fa1e80721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:47.878 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.875+0000 7fa1edd70640 1 -- 172.21.15.183:0/645411225 shutdown_connections 2024-05-08T04:20:47.878 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.875+0000 7fa1edd70640 1 -- 172.21.15.183:0/645411225 wait complete. 2024-05-08T04:20:47.887 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 337042e4-bd32-40e9-b393-503c01b4a0b4 4 2024-05-08T04:20:47.894 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:47.893+0000 7f76de91e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T04:20:47.943 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:47.942+0000 7f2874a0d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T04:20:47.985 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:47.984+0000 7f2874a0d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T04:20:47.986 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:47.985+0000 7f76de91e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T04:20:47.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.985+0000 7feff5bc1640 1 Processor -- start 2024-05-08T04:20:47.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.985+0000 7feff5bc1640 1 -- start start 2024-05-08T04:20:47.989 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7feff5bc1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7feff009ad20 0x7feff00cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7feff5bc1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff0099a40 0x7feff0099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7feff5bc1640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff009a390 con 0x7feff015bbc0 2024-05-08T04:20:47.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7feff5bc1640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff015bfa0 con 0x7feff009ad20 2024-05-08T04:20:47.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7feff5bc1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff00cd770 con 0x7feff0099a40 2024-05-08T04:20:47.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7fefeffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff0099a40 0x7feff0099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7fefeffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff0099a40 0x7feff0099e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:56772/0 (socket says 172.21.15.183:56772) 2024-05-08T04:20:47.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7fefeeffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7feff009ad20 0x7feff00cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7fefeffff640 1 -- 172.21.15.183:0/1163249138 learned_addr learned my addr 172.21.15.183:0/1163249138 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T04:20:47.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7fefef7fe640 1 --1- 172.21.15.183:0/1163249138 >> v1:172.21.15.104:6789/0 conn(0x7feff015bbc0 0x7feff00d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.183:39776/0 (socket says 172.21.15.183:39776) 2024-05-08T04:20:47.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7fefeffff640 1 -- 172.21.15.183:0/1163249138 >> v2:172.21.15.104:3300/0 conn(0x7feff009ad20 msgr2=0x7feff00cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:20:47.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7fefeffff640 1 --2- 172.21.15.183:0/1163249138 >> v2:172.21.15.104:3300/0 conn(0x7feff009ad20 0x7feff00cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.990 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7fefeffff640 1 -- 172.21.15.183:0/1163249138 >> v1:172.21.15.104:6789/0 conn(0x7feff015bbc0 legacy=0x7feff00d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.991 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.987+0000 7fefeffff640 1 -- 172.21.15.183:0/1163249138 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff00cf420 con 0x7feff0099a40 2024-05-08T04:20:47.991 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.988+0000 7fefeffff640 1 --2- 172.21.15.183:0/1163249138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff0099a40 0x7feff0099e50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009e50 tx=0x7fefe802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9640eaaca6dc8107 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:47.991 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.988+0000 7fefee7fc640 1 -- 172.21.15.183:0/1163249138 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe8036070 con 0x7feff0099a40 2024-05-08T04:20:47.991 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.988+0000 7fefee7fc640 1 -- 172.21.15.183:0/1163249138 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe8031600 con 0x7feff0099a40 2024-05-08T04:20:47.991 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.988+0000 7fefee7fc640 1 -- 172.21.15.183:0/1163249138 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80319d0 con 0x7feff0099a40 2024-05-08T04:20:47.992 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.989+0000 7feff5bc1640 1 -- 172.21.15.183:0/1163249138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff0099a40 msgr2=0x7feff0099e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.992 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.989+0000 7feff5bc1640 1 --2- 172.21.15.183:0/1163249138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff0099a40 0x7feff0099e50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009e50 tx=0x7fefe802a710 comp rx=0 tx=0).stop 2024-05-08T04:20:47.992 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.989+0000 7feff5bc1640 1 -- 172.21.15.183:0/1163249138 shutdown_connections 2024-05-08T04:20:47.992 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.989+0000 7feff5bc1640 1 --2- 172.21.15.183:0/1163249138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff0099a40 0x7feff0099e50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.992 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.989+0000 7feff5bc1640 1 --2- 172.21.15.183:0/1163249138 >> v2:172.21.15.104:3300/0 conn(0x7feff009ad20 0x7feff00cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.992 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.989+0000 7feff5bc1640 1 -- 172.21.15.183:0/1163249138 >> 172.21.15.183:0/1163249138 conn(0x7feff00b32a0 msgr2=0x7feff00b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:47.992 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.989+0000 7feff5bc1640 1 -- 172.21.15.183:0/1163249138 shutdown_connections 2024-05-08T04:20:47.992 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.989+0000 7feff5bc1640 1 -- 172.21.15.183:0/1163249138 wait complete. 2024-05-08T04:20:47.992 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.990+0000 7feff5bc1640 1 Processor -- start 2024-05-08T04:20:47.993 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.990+0000 7feff5bc1640 1 -- start start 2024-05-08T04:20:47.995 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7feff5bc1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff0099a40 0x7feff0157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.995 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7feff5bc1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff009ad20 0x7feff01f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.995 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7feff5bc1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff015bbc0 0x7feff00af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:47.995 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7feff5bc1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff00cfcc0 con 0x7feff015bbc0 2024-05-08T04:20:47.995 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7feff5bc1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff00cf9e0 con 0x7feff0099a40 2024-05-08T04:20:47.995 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7feff5bc1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff00cd3a0 con 0x7feff009ad20 2024-05-08T04:20:47.995 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefeeffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff009ad20 0x7feff01f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.995 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefef7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff0099a40 0x7feff0157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.995 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefef7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff0099a40 0x7feff0157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44122/0 (socket says 172.21.15.183:44122) 2024-05-08T04:20:47.995 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefef7fe640 1 -- 172.21.15.183:0/4104134964 learned_addr learned my addr 172.21.15.183:0/4104134964 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T04:20:47.995 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefeffff640 1 --2- 172.21.15.183:0/4104134964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff015bbc0 0x7feff00af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:47.995 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefef7fe640 1 -- 172.21.15.183:0/4104134964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff009ad20 msgr2=0x7feff01f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.995 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefef7fe640 1 --2- 172.21.15.183:0/4104134964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff009ad20 0x7feff01f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.996 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefef7fe640 1 -- 172.21.15.183:0/4104134964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff015bbc0 msgr2=0x7feff00af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:47.996 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefef7fe640 1 --2- 172.21.15.183:0/4104134964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff015bbc0 0x7feff00af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:47.996 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefef7fe640 1 -- 172.21.15.183:0/4104134964 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff015d6c0 con 0x7feff0099a40 2024-05-08T04:20:47.996 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefef7fe640 1 --2- 172.21.15.183:0/4104134964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff0099a40 0x7feff0157030 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fefe000c3e0 tx=0x7fefe000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:47.996 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefe7fff640 1 -- 172.21.15.183:0/4104134964 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe00074e0 con 0x7feff0099a40 2024-05-08T04:20:47.996 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefe7fff640 1 -- 172.21.15.183:0/4104134964 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe0007680 con 0x7feff0099a40 2024-05-08T04:20:47.996 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.991+0000 7fefe7fff640 1 -- 172.21.15.183:0/4104134964 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe00049e0 con 0x7feff0099a40 2024-05-08T04:20:47.996 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.992+0000 7feff5bc1640 1 -- 172.21.15.183:0/4104134964 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff015d9a0 con 0x7feff0099a40 2024-05-08T04:20:47.996 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.992+0000 7feff5bc1640 1 -- 172.21.15.183:0/4104134964 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff015df60 con 0x7feff0099a40 2024-05-08T04:20:47.996 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.992+0000 7fefe7fff640 1 -- 172.21.15.183:0/4104134964 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fefe001a020 con 0x7feff0099a40 2024-05-08T04:20:47.996 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.992+0000 7fefe7fff640 1 -- 172.21.15.183:0/4104134964 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fefe0013910 con 0x7feff0099a40 2024-05-08T04:20:47.996 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.992+0000 7feff5bc1640 1 -- 172.21.15.183:0/4104134964 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff015e160 con 0x7feff0099a40 2024-05-08T04:20:47.997 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:47.995+0000 7fefe7fff640 1 -- 172.21.15.183:0/4104134964 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7feff015e160 con 0x7feff0099a40 2024-05-08T04:20:48.032 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:48.030+0000 7f76de91e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T04:20:48.069 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.067+0000 7feff5bc1640 1 -- 172.21.15.183:0/4104134964 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "337042e4-bd32-40e9-b393-503c01b4a0b4", "id": 4} v 0) v1 -- 0x7feff0075010 con 0x7feff0099a40 2024-05-08T04:20:48.072 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.070+0000 7fefe7fff640 1 -- 172.21.15.183:0/4104134964 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "337042e4-bd32-40e9-b393-503c01b4a0b4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fefe0021070 con 0x7feff0099a40 2024-05-08T04:20:48.072 INFO:teuthology.orchestra.run.smithi183.stdout:4 2024-05-08T04:20:48.073 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.071+0000 7feff5bc1640 1 -- 172.21.15.183:0/4104134964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff0099a40 msgr2=0x7feff0157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.074 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.071+0000 7feff5bc1640 1 --2- 172.21.15.183:0/4104134964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff0099a40 0x7feff0157030 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fefe000c3e0 tx=0x7fefe000c8a0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.074 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.071+0000 7feff5bc1640 1 -- 172.21.15.183:0/4104134964 shutdown_connections 2024-05-08T04:20:48.074 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.071+0000 7feff5bc1640 1 --2- 172.21.15.183:0/4104134964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff015bbc0 0x7feff00af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.074 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.071+0000 7feff5bc1640 1 --2- 172.21.15.183:0/4104134964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff009ad20 0x7feff01f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.074 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.071+0000 7feff5bc1640 1 --2- 172.21.15.183:0/4104134964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff0099a40 0x7feff0157030 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.074 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.071+0000 7feff5bc1640 1 -- 172.21.15.183:0/4104134964 >> 172.21.15.183:0/4104134964 conn(0x7feff00b32a0 msgr2=0x7feff006f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:48.074 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.072+0000 7feff5bc1640 1 -- 172.21.15.183:0/4104134964 shutdown_connections 2024-05-08T04:20:48.074 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.072+0000 7feff5bc1640 1 -- 172.21.15.183:0/4104134964 wait complete. 2024-05-08T04:20:48.084 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 87223252-b257-4ec9-b05d-82dd21528ec7 5 2024-05-08T04:20:48.150 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:48.149+0000 7f2874a0d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T04:20:48.206 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:48.204+0000 7f76de91e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T04:20:48.206 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:48.205+0000 7f2874a0d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T04:20:48.224 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.222+0000 7fc8af59e640 1 Processor -- start 2024-05-08T04:20:48.224 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.222+0000 7fc8af59e640 1 -- start start 2024-05-08T04:20:48.225 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.223+0000 7fc8af59e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc8b00cbe40 0x7fc8b00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.223+0000 7fc8af59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc8b006ab60 0x7fc8b006af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.223+0000 7fc8af59e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b006b4b0 con 0x7fc8b0161100 2024-05-08T04:20:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.223+0000 7fc8af59e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b00cfde0 con 0x7fc8b00cbe40 2024-05-08T04:20:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.223+0000 7fc8af59e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b00cce90 con 0x7fc8b006ab60 2024-05-08T04:20:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.223+0000 7fc8aed9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc8b006ab60 0x7fc8b006af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.223+0000 7fc8aed9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc8b006ab60 0x7fc8b006af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44136/0 (socket says 172.21.15.183:44136) 2024-05-08T04:20:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.223+0000 7fc8aed9d640 1 -- 172.21.15.183:0/827583362 learned_addr learned my addr 172.21.15.183:0/827583362 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T04:20:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.224+0000 7fc8add9b640 1 --2- 172.21.15.183:0/827583362 >> v2:172.21.15.104:3300/0 conn(0x7fc8b00cbe40 0x7fc8b00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.224+0000 7fc8aed9d640 1 -- 172.21.15.183:0/827583362 >> v2:172.21.15.104:3300/0 conn(0x7fc8b00cbe40 msgr2=0x7fc8b00cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:20:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.224+0000 7fc8aed9d640 1 --2- 172.21.15.183:0/827583362 >> v2:172.21.15.104:3300/0 conn(0x7fc8b00cbe40 0x7fc8b00cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.224+0000 7fc8aed9d640 1 -- 172.21.15.183:0/827583362 >> v1:172.21.15.104:6789/0 conn(0x7fc8b0161100 legacy=0x7fc8b00b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.224+0000 7fc8aed9d640 1 -- 172.21.15.183:0/827583362 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b00cc2d0 con 0x7fc8b006ab60 2024-05-08T04:20:48.227 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.224+0000 7fc8aed9d640 1 --2- 172.21.15.183:0/827583362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b006ab60 0x7fc8b006af70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0070a90 tx=0x7fc8a802a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aeec10475c97614 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:48.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.224+0000 7fc8ad59a640 1 -- 172.21.15.183:0/827583362 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8036070 con 0x7fc8b006ab60 2024-05-08T04:20:48.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.225+0000 7fc8ad59a640 1 -- 172.21.15.183:0/827583362 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a8031600 con 0x7fc8b006ab60 2024-05-08T04:20:48.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.225+0000 7fc8ad59a640 1 -- 172.21.15.183:0/827583362 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80319d0 con 0x7fc8b006ab60 2024-05-08T04:20:48.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.225+0000 7fc8af59e640 1 -- 172.21.15.183:0/827583362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b006ab60 msgr2=0x7fc8b006af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.225+0000 7fc8af59e640 1 --2- 172.21.15.183:0/827583362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b006ab60 0x7fc8b006af70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0070a90 tx=0x7fc8a802a6a0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.225+0000 7fc8af59e640 1 -- 172.21.15.183:0/827583362 shutdown_connections 2024-05-08T04:20:48.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.225+0000 7fc8af59e640 1 --2- 172.21.15.183:0/827583362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b006ab60 0x7fc8b006af70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.225+0000 7fc8af59e640 1 --2- 172.21.15.183:0/827583362 >> v2:172.21.15.104:3300/0 conn(0x7fc8b00cbe40 0x7fc8b00cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.225+0000 7fc8af59e640 1 -- 172.21.15.183:0/827583362 >> 172.21.15.183:0/827583362 conn(0x7fc8b0099a40 msgr2=0x7fc8b00b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:48.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.225+0000 7fc8af59e640 1 -- 172.21.15.183:0/827583362 shutdown_connections 2024-05-08T04:20:48.228 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.225+0000 7fc8af59e640 1 -- 172.21.15.183:0/827583362 wait complete. 2024-05-08T04:20:48.231 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.227+0000 7fc8af59e640 1 Processor -- start 2024-05-08T04:20:48.231 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.227+0000 7fc8af59e640 1 -- start start 2024-05-08T04:20:48.231 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.227+0000 7fc8af59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8b006ab60 0x7fc8b01f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.231 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.227+0000 7fc8af59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8b00cbe40 0x7fc8b00c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.231 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.227+0000 7fc8af59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0161100 0x7fc8b00b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.231 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.227+0000 7fc8af59e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00ccb20 con 0x7fc8b00cbe40 2024-05-08T04:20:48.231 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.227+0000 7fc8af59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00cc840 con 0x7fc8b0161100 2024-05-08T04:20:48.231 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.227+0000 7fc8af59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00d02f0 con 0x7fc8b006ab60 2024-05-08T04:20:48.232 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8aed9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0161100 0x7fc8b00b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.232 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8ae59c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8b006ab60 0x7fc8b01f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.232 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8aed9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0161100 0x7fc8b00b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44142/0 (socket says 172.21.15.183:44142) 2024-05-08T04:20:48.232 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8aed9d640 1 -- 172.21.15.183:0/3383575833 learned_addr learned my addr 172.21.15.183:0/3383575833 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T04:20:48.232 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8ae59c640 1 --2- 172.21.15.183:0/3383575833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8b006ab60 0x7fc8b01f37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:56798/0 (socket says 172.21.15.183:56798) 2024-05-08T04:20:48.232 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8add9b640 1 --2- 172.21.15.183:0/3383575833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8b00cbe40 0x7fc8b00c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.232 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8aed9d640 1 -- 172.21.15.183:0/3383575833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8b006ab60 msgr2=0x7fc8b01f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.232 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8aed9d640 1 --2- 172.21.15.183:0/3383575833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8b006ab60 0x7fc8b01f37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.232 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8aed9d640 1 -- 172.21.15.183:0/3383575833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8b00cbe40 msgr2=0x7fc8b00c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.232 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8aed9d640 1 --2- 172.21.15.183:0/3383575833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8b00cbe40 0x7fc8b00c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.232 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8aed9d640 1 -- 172.21.15.183:0/3383575833 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b014a040 con 0x7fc8b0161100 2024-05-08T04:20:48.233 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8add9b640 1 --2- 172.21.15.183:0/3383575833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8b00cbe40 0x7fc8b00c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:20:48.233 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8aed9d640 1 --2- 172.21.15.183:0/3383575833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0161100 0x7fc8b00b31e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009f40 tx=0x7fc8a8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:48.233 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc89effd640 1 -- 172.21.15.183:0/3383575833 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a803f020 con 0x7fc8b0161100 2024-05-08T04:20:48.233 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc89effd640 1 -- 172.21.15.183:0/3383575833 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a8037040 con 0x7fc8b0161100 2024-05-08T04:20:48.233 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8af59e640 1 -- 172.21.15.183:0/3383575833 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b00c5a60 con 0x7fc8b0161100 2024-05-08T04:20:48.233 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc89effd640 1 -- 172.21.15.183:0/3383575833 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8036070 con 0x7fc8b0161100 2024-05-08T04:20:48.233 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc8af59e640 1 -- 172.21.15.183:0/3383575833 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b00b6060 con 0x7fc8b0161100 2024-05-08T04:20:48.233 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc89effd640 1 -- 172.21.15.183:0/3383575833 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc8a8042020 con 0x7fc8b0161100 2024-05-08T04:20:48.233 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.228+0000 7fc89effd640 1 -- 172.21.15.183:0/3383575833 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fc8a8044c00 con 0x7fc8b0161100 2024-05-08T04:20:48.234 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.229+0000 7fc8af59e640 1 -- 172.21.15.183:0/3383575833 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b0074fa0 con 0x7fc8b0161100 2024-05-08T04:20:48.234 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.231+0000 7fc89effd640 1 -- 172.21.15.183:0/3383575833 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc8a8049030 con 0x7fc8b0161100 2024-05-08T04:20:48.259 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:48.258+0000 7f2874a0d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T04:20:48.272 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:48.270+0000 7f76de91e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T04:20:48.328 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:48.326+0000 7f76de91e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T04:20:48.329 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.327+0000 7fc8af59e640 1 -- 172.21.15.183:0/3383575833 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "87223252-b257-4ec9-b05d-82dd21528ec7", "id": 5} v 0) v1 -- 0x7fc8b006e6e0 con 0x7fc8b0161100 2024-05-08T04:20:48.332 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.330+0000 7fc89effd640 1 -- 172.21.15.183:0/3383575833 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "87223252-b257-4ec9-b05d-82dd21528ec7", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc8a8007bf0 con 0x7fc8b0161100 2024-05-08T04:20:48.332 INFO:teuthology.orchestra.run.smithi183.stdout:5 2024-05-08T04:20:48.333 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.331+0000 7fc8af59e640 1 -- 172.21.15.183:0/3383575833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0161100 msgr2=0x7fc8b00b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.333 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.331+0000 7fc8af59e640 1 --2- 172.21.15.183:0/3383575833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0161100 0x7fc8b00b31e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009f40 tx=0x7fc8a8004a40 comp rx=0 tx=0).stop 2024-05-08T04:20:48.333 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.331+0000 7fc8af59e640 1 -- 172.21.15.183:0/3383575833 shutdown_connections 2024-05-08T04:20:48.334 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.331+0000 7fc8af59e640 1 --2- 172.21.15.183:0/3383575833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0161100 0x7fc8b00b31e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.334 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.331+0000 7fc8af59e640 1 --2- 172.21.15.183:0/3383575833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8b00cbe40 0x7fc8b00c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.334 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.331+0000 7fc8af59e640 1 --2- 172.21.15.183:0/3383575833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8b006ab60 0x7fc8b01f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.334 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.331+0000 7fc8af59e640 1 -- 172.21.15.183:0/3383575833 >> 172.21.15.183:0/3383575833 conn(0x7fc8b0099a40 msgr2=0x7fc8b00cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:48.334 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.331+0000 7fc8af59e640 1 -- 172.21.15.183:0/3383575833 shutdown_connections 2024-05-08T04:20:48.334 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.331+0000 7fc8af59e640 1 -- 172.21.15.183:0/3383575833 wait complete. 2024-05-08T04:20:48.344 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb 6 2024-05-08T04:20:48.371 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:48.370+0000 7f2874a0d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T04:20:48.442 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.440+0000 7f4d1d6bd640 1 Processor -- start 2024-05-08T04:20:48.442 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.440+0000 7f4d1d6bd640 1 -- start start 2024-05-08T04:20:48.444 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.441+0000 7f4d1d6bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4d180ce5a0 0x7f4d18161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.444 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.441+0000 7f4d1d6bd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1815e1f0 con 0x7f4d180d07c0 2024-05-08T04:20:48.444 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.441+0000 7f4d1d6bd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d18162090 con 0x7f4d1815de10 2024-05-08T04:20:48.444 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.441+0000 7f4d1d6bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d180d0f50 con 0x7f4d180ce5a0 2024-05-08T04:20:48.444 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.441+0000 7f4d167fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4d180ce5a0 0x7f4d18161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.444 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.441+0000 7f4d167fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4d180ce5a0 0x7f4d18161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44154/0 (socket says 172.21.15.183:44154) 2024-05-08T04:20:48.444 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.441+0000 7f4d167fc640 1 -- 172.21.15.183:0/1836917563 learned_addr learned my addr 172.21.15.183:0/1836917563 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T04:20:48.444 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.441+0000 7f4d167fc640 1 -- 172.21.15.183:0/1836917563 >> v1:172.21.15.183:6789/0 conn(0x7f4d1815de10 legacy=0x7f4d180d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.445 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.441+0000 7f4d167fc640 1 -- 172.21.15.183:0/1836917563 >> v1:172.21.15.104:6789/0 conn(0x7f4d180d07c0 legacy=0x7f4d180d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.445 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.441+0000 7f4d167fc640 1 -- 172.21.15.183:0/1836917563 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18162370 con 0x7f4d180ce5a0 2024-05-08T04:20:48.445 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.442+0000 7f4d167fc640 1 --2- 172.21.15.183:0/1836917563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d180ce5a0 0x7f4d18161920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009870 tx=0x7f4d0002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbe7ad2ade98e3f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:48.445 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.442+0000 7f4d15ffb640 1 -- 172.21.15.183:0/1836917563 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00037070 con 0x7f4d180ce5a0 2024-05-08T04:20:48.445 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.442+0000 7f4d15ffb640 1 -- 172.21.15.183:0/1836917563 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d00032440 con 0x7f4d180ce5a0 2024-05-08T04:20:48.445 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.442+0000 7f4d15ffb640 1 -- 172.21.15.183:0/1836917563 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00032810 con 0x7f4d180ce5a0 2024-05-08T04:20:48.446 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.443+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/1836917563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d180ce5a0 msgr2=0x7f4d18161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.446 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.443+0000 7f4d1d6bd640 1 --2- 172.21.15.183:0/1836917563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d180ce5a0 0x7f4d18161920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009870 tx=0x7f4d0002a270 comp rx=0 tx=0).stop 2024-05-08T04:20:48.446 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.443+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/1836917563 shutdown_connections 2024-05-08T04:20:48.446 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.443+0000 7f4d1d6bd640 1 --2- 172.21.15.183:0/1836917563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d180ce5a0 0x7f4d18161920 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.446 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.443+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/1836917563 >> 172.21.15.183:0/1836917563 conn(0x7f4d18072290 msgr2=0x7f4d18072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:48.446 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.443+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/1836917563 shutdown_connections 2024-05-08T04:20:48.447 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.443+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/1836917563 wait complete. 2024-05-08T04:20:48.447 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.444+0000 7f4d1d6bd640 1 Processor -- start 2024-05-08T04:20:48.447 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.444+0000 7f4d1d6bd640 1 -- start start 2024-05-08T04:20:48.447 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:48.444+0000 7f76de91e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T04:20:48.449 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d1d6bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d180ce5a0 0x7f4d180b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.449 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d1d6bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d180d07c0 0x7f4d180b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.449 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d1d6bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d1815de10 0x7f4d18145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.449 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d1d6bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d180d1a90 con 0x7f4d1815de10 2024-05-08T04:20:48.449 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d1d6bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d180d1ce0 con 0x7f4d180d07c0 2024-05-08T04:20:48.449 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d1d6bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d180b6dc0 con 0x7f4d180ce5a0 2024-05-08T04:20:48.450 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d167fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d180d07c0 0x7f4d180b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.450 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d16ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d180ce5a0 0x7f4d180b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.450 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d167fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d180d07c0 0x7f4d180b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44160/0 (socket says 172.21.15.183:44160) 2024-05-08T04:20:48.450 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d167fc640 1 -- 172.21.15.183:0/3275169407 learned_addr learned my addr 172.21.15.183:0/3275169407 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T04:20:48.450 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d177fe640 1 --2- 172.21.15.183:0/3275169407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d1815de10 0x7f4d18145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.450 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d167fc640 1 -- 172.21.15.183:0/3275169407 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d180ce5a0 msgr2=0x7f4d180b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.450 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d167fc640 1 --2- 172.21.15.183:0/3275169407 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d180ce5a0 0x7f4d180b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.450 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d167fc640 1 -- 172.21.15.183:0/3275169407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d1815de10 msgr2=0x7f4d18145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.450 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d167fc640 1 --2- 172.21.15.183:0/3275169407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d1815de10 0x7f4d18145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.450 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d167fc640 1 -- 172.21.15.183:0/3275169407 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18146340 con 0x7f4d180d07c0 2024-05-08T04:20:48.450 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d167fc640 1 --2- 172.21.15.183:0/3275169407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d180d07c0 0x7f4d180b3990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4d00000c00 tx=0x7f4d000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:48.450 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.445+0000 7f4d0f7fe640 1 -- 172.21.15.183:0/3275169407 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00037040 con 0x7f4d180d07c0 2024-05-08T04:20:48.450 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.446+0000 7f4d0f7fe640 1 -- 172.21.15.183:0/3275169407 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d00042070 con 0x7f4d180d07c0 2024-05-08T04:20:48.451 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.446+0000 7f4d0f7fe640 1 -- 172.21.15.183:0/3275169407 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00030bd0 con 0x7f4d180d07c0 2024-05-08T04:20:48.451 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.446+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/3275169407 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d18146620 con 0x7f4d180d07c0 2024-05-08T04:20:48.451 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.446+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/3275169407 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d180cbbe0 con 0x7f4d180d07c0 2024-05-08T04:20:48.451 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.446+0000 7f4d0f7fe640 1 -- 172.21.15.183:0/3275169407 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f4d00047460 con 0x7f4d180d07c0 2024-05-08T04:20:48.451 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.446+0000 7f4d0f7fe640 1 -- 172.21.15.183:0/3275169407 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4d0003da30 con 0x7f4d180d07c0 2024-05-08T04:20:48.451 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.447+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/3275169407 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d18067420 con 0x7f4d180d07c0 2024-05-08T04:20:48.452 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.450+0000 7f4d0f7fe640 1 -- 172.21.15.183:0/3275169407 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f4d18067420 con 0x7f4d180d07c0 2024-05-08T04:20:48.526 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.524+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/3275169407 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb", "id": 6} v 0) v1 -- 0x7f4d18075010 con 0x7f4d180d07c0 2024-05-08T04:20:48.530 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.528+0000 7f4d0f7fe640 1 -- 172.21.15.183:0/3275169407 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4d0003d440 con 0x7f4d180d07c0 2024-05-08T04:20:48.530 INFO:teuthology.orchestra.run.smithi183.stdout:6 2024-05-08T04:20:48.531 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.529+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/3275169407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d180d07c0 msgr2=0x7f4d180b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.531 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.529+0000 7f4d1d6bd640 1 --2- 172.21.15.183:0/3275169407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d180d07c0 0x7f4d180b3990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4d00000c00 tx=0x7f4d000046c0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.531 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.529+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/3275169407 shutdown_connections 2024-05-08T04:20:48.532 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.529+0000 7f4d1d6bd640 1 --2- 172.21.15.183:0/3275169407 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d180d07c0 0x7f4d180b3990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.532 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.529+0000 7f4d1d6bd640 1 --2- 172.21.15.183:0/3275169407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d1815de10 0x7f4d18145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.532 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.529+0000 7f4d1d6bd640 1 --2- 172.21.15.183:0/3275169407 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d180ce5a0 0x7f4d180b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.532 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.529+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/3275169407 >> 172.21.15.183:0/3275169407 conn(0x7f4d18072290 msgr2=0x7f4d1815a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:48.532 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.529+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/3275169407 shutdown_connections 2024-05-08T04:20:48.532 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.529+0000 7f4d1d6bd640 1 -- 172.21.15.183:0/3275169407 wait complete. 2024-05-08T04:20:48.542 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 352a8ab2-3103-4355-ae61-4f958e8b1259 7 2024-05-08T04:20:48.643 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.641+0000 7f4eda7a5640 1 Processor -- start 2024-05-08T04:20:48.643 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.641+0000 7f4eda7a5640 1 -- start start 2024-05-08T04:20:48.645 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.641+0000 7f4eda7a5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4ed406ab60 0x7f4ed4070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.645 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.641+0000 7f4eda7a5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed40d0450 con 0x7f4ed415de30 2024-05-08T04:20:48.645 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.641+0000 7f4eda7a5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed4072ab0 con 0x7f4ed40cff50 2024-05-08T04:20:48.645 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.641+0000 7f4eda7a5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed4161630 con 0x7f4ed406ab60 2024-05-08T04:20:48.645 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.642+0000 7f4ed37fe640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f4ed40cff50 0x7f4ed406af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:57316/0 (socket says 172.21.15.183:57316) 2024-05-08T04:20:48.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.642+0000 7f4ed37fe640 1 -- 172.21.15.183:0/3621846656 learned_addr learned my addr 172.21.15.183:0/3621846656 (peer_addr_for_me v1:172.21.15.183:0/0) 2024-05-08T04:20:48.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.642+0000 7f4ed3fff640 1 --2- 172.21.15.183:0/3621846656 >> v2:172.21.15.104:3300/0 conn(0x7f4ed406ab60 0x7f4ed4070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.642+0000 7f4ed2ffd640 1 -- 172.21.15.183:0/3621846656 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515809883 0 0) 0x7f4ed4072ab0 con 0x7f4ed40cff50 2024-05-08T04:20:48.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.642+0000 7f4ed2ffd640 1 -- 172.21.15.183:0/3621846656 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ec0003520 con 0x7f4ed40cff50 2024-05-08T04:20:48.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.642+0000 7f4ed2ffd640 1 -- 172.21.15.183:0/3621846656 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216833302 0 0) 0x7f4ed40d0450 con 0x7f4ed415de30 2024-05-08T04:20:48.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.642+0000 7f4ed2ffd640 1 -- 172.21.15.183:0/3621846656 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed4072ab0 con 0x7f4ed415de30 2024-05-08T04:20:48.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.642+0000 7f4ed2ffd640 1 -- 172.21.15.183:0/3621846656 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1262894480 0 0) 0x7f4ec0003520 con 0x7f4ed40cff50 2024-05-08T04:20:48.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.642+0000 7f4ed3fff640 1 -- 172.21.15.183:0/3621846656 >> v1:172.21.15.183:6789/0 conn(0x7f4ed40cff50 legacy=0x7f4ed406af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.642+0000 7f4ed3fff640 1 -- 172.21.15.183:0/3621846656 >> v1:172.21.15.104:6789/0 conn(0x7f4ed415de30 legacy=0x7f4ed4161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.642+0000 7f4ed3fff640 1 -- 172.21.15.183:0/3621846656 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4072d90 con 0x7f4ed406ab60 2024-05-08T04:20:48.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.643+0000 7f4ed3fff640 1 --2- 172.21.15.183:0/3621846656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ed406ab60 0x7f4ed4070820 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009720 tx=0x7f4ec402a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a4b832a1e0631b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:48.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.643+0000 7f4ed2ffd640 1 -- 172.21.15.183:0/3621846656 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4037070 con 0x7f4ed406ab60 2024-05-08T04:20:48.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.643+0000 7f4ed2ffd640 1 -- 172.21.15.183:0/3621846656 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec402abe0 con 0x7f4ed406ab60 2024-05-08T04:20:48.647 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.643+0000 7f4ed2ffd640 1 -- 172.21.15.183:0/3621846656 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc001670 con 0x7f4ed406ab60 2024-05-08T04:20:48.649 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.644+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3621846656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ed406ab60 msgr2=0x7f4ed4070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.650 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.644+0000 7f4eda7a5640 1 --2- 172.21.15.183:0/3621846656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ed406ab60 0x7f4ed4070820 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009720 tx=0x7f4ec402a0d0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.650 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.644+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3621846656 shutdown_connections 2024-05-08T04:20:48.650 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.644+0000 7f4eda7a5640 1 --2- 172.21.15.183:0/3621846656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ed406ab60 0x7f4ed4070820 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.650 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.644+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3621846656 >> 172.21.15.183:0/3621846656 conn(0x7f4ed40b23e0 msgr2=0x7f4ed40b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:48.650 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.644+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3621846656 shutdown_connections 2024-05-08T04:20:48.650 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.644+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3621846656 wait complete. 2024-05-08T04:20:48.650 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.645+0000 7f4eda7a5640 1 Processor -- start 2024-05-08T04:20:48.650 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.645+0000 7f4eda7a5640 1 -- start start 2024-05-08T04:20:48.650 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.646+0000 7f4eda7a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ed406ab60 0x7f4ed4154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.650 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.646+0000 7f4eda7a5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed40cff50 0x7f4ed4154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.650 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.646+0000 7f4eda7a5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ed415de30 0x7f4ed415c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.650 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.646+0000 7f4eda7a5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed41621d0 con 0x7f4ed406ab60 2024-05-08T04:20:48.650 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.646+0000 7f4eda7a5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed4070370 con 0x7f4ed415de30 2024-05-08T04:20:48.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.646+0000 7f4eda7a5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed4162350 con 0x7f4ed40cff50 2024-05-08T04:20:48.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.646+0000 7f4ed37fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed40cff50 0x7f4ed4154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.646+0000 7f4ed8d42640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ed415de30 0x7f4ed415c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.646+0000 7f4ed8d42640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ed415de30 0x7f4ed415c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:52146/0 (socket says 172.21.15.183:52146) 2024-05-08T04:20:48.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.646+0000 7f4ed8d42640 1 -- 172.21.15.183:0/3061157167 learned_addr learned my addr 172.21.15.183:0/3061157167 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T04:20:48.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.646+0000 7f4ed3fff640 1 --2- 172.21.15.183:0/3061157167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ed406ab60 0x7f4ed4154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4ed37fe640 1 -- 172.21.15.183:0/3061157167 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ed415de30 msgr2=0x7f4ed415c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4ed37fe640 1 --2- 172.21.15.183:0/3061157167 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ed415de30 0x7f4ed415c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4ed37fe640 1 -- 172.21.15.183:0/3061157167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ed406ab60 msgr2=0x7f4ed4154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4ed37fe640 1 --2- 172.21.15.183:0/3061157167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ed406ab60 0x7f4ed4154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4ed37fe640 1 -- 172.21.15.183:0/3061157167 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4155600 con 0x7f4ed40cff50 2024-05-08T04:20:48.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4ed8d42640 1 --2- 172.21.15.183:0/3061157167 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ed415de30 0x7f4ed415c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:20:48.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4ed3fff640 1 --2- 172.21.15.183:0/3061157167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ed406ab60 0x7f4ed4154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:20:48.652 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4ed37fe640 1 --2- 172.21.15.183:0/3061157167 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed40cff50 0x7f4ed4154b40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00c430 tx=0x7f4ebc00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:48.652 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4ed0ff9640 1 -- 172.21.15.183:0/3061157167 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc0074e0 con 0x7f4ed40cff50 2024-05-08T04:20:48.652 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4ed0ff9640 1 -- 172.21.15.183:0/3061157167 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc0047e0 con 0x7f4ed40cff50 2024-05-08T04:20:48.652 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3061157167 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed41558e0 con 0x7f4ed40cff50 2024-05-08T04:20:48.652 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4ed0ff9640 1 -- 172.21.15.183:0/3061157167 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc004c10 con 0x7f4ed40cff50 2024-05-08T04:20:48.652 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3061157167 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed4155ea0 con 0x7f4ed40cff50 2024-05-08T04:20:48.652 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4ed0ff9640 1 -- 172.21.15.183:0/3061157167 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f4ebc011070 con 0x7f4ed40cff50 2024-05-08T04:20:48.652 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.647+0000 7f4ed0ff9640 1 -- 172.21.15.183:0/3061157167 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f4ebc013a20 con 0x7f4ed40cff50 2024-05-08T04:20:48.652 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.648+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3061157167 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed40b3450 con 0x7f4ed40cff50 2024-05-08T04:20:48.652 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.650+0000 7f4ed0ff9640 1 -- 172.21.15.183:0/3061157167 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f4ebc004db0 con 0x7f4ed40cff50 2024-05-08T04:20:48.724 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.722+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3061157167 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "352a8ab2-3103-4355-ae61-4f958e8b1259", "id": 7} v 0) v1 -- 0x7f4ed4075010 con 0x7f4ed40cff50 2024-05-08T04:20:48.727 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.725+0000 7f4ed0ff9640 1 -- 172.21.15.183:0/3061157167 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "352a8ab2-3103-4355-ae61-4f958e8b1259", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4ebc013cf0 con 0x7f4ed40cff50 2024-05-08T04:20:48.727 INFO:teuthology.orchestra.run.smithi183.stdout:7 2024-05-08T04:20:48.729 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.726+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3061157167 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed40cff50 msgr2=0x7f4ed4154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.729 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.726+0000 7f4eda7a5640 1 --2- 172.21.15.183:0/3061157167 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed40cff50 0x7f4ed4154b40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc00c430 tx=0x7f4ebc00c8f0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.729 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.726+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3061157167 shutdown_connections 2024-05-08T04:20:48.729 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.726+0000 7f4eda7a5640 1 --2- 172.21.15.183:0/3061157167 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ed415de30 0x7f4ed415c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.729 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.726+0000 7f4eda7a5640 1 --2- 172.21.15.183:0/3061157167 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ed40cff50 0x7f4ed4154b40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.729 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.726+0000 7f4eda7a5640 1 --2- 172.21.15.183:0/3061157167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ed406ab60 0x7f4ed4154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.729 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.726+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3061157167 >> 172.21.15.183:0/3061157167 conn(0x7f4ed40b23e0 msgr2=0x7f4ed4158610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:48.729 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.727+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3061157167 shutdown_connections 2024-05-08T04:20:48.729 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:20:48.727+0000 7f4eda7a5640 1 -- 172.21.15.183:0/3061157167 wait complete. 2024-05-08T04:20:48.739 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T04:20:48.739 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T04:20:48.741 INFO:tasks.ceph.osd.0:Started 2024-05-08T04:20:48.741 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T04:20:48.742 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T04:20:48.744 INFO:tasks.ceph.osd.1:Started 2024-05-08T04:20:48.744 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T04:20:48.744 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T04:20:48.746 INFO:tasks.ceph.osd.2:Started 2024-05-08T04:20:48.746 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T04:20:48.746 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T04:20:48.748 INFO:tasks.ceph.osd.3:Started 2024-05-08T04:20:48.749 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-08T04:20:48.749 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-08T04:20:48.751 INFO:tasks.ceph.osd.4:Started 2024-05-08T04:20:48.751 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-08T04:20:48.751 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-08T04:20:48.753 INFO:tasks.ceph.osd.5:Started 2024-05-08T04:20:48.753 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-08T04:20:48.753 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-08T04:20:48.755 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:48.754+0000 7f2874a0d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T04:20:48.755 INFO:tasks.ceph.osd.6:Started 2024-05-08T04:20:48.756 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-08T04:20:48.756 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-08T04:20:48.758 INFO:tasks.ceph.osd.7:Started 2024-05-08T04:20:48.759 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:20:48.878 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:48.877+0000 7f76de91e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T04:20:48.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.883+0000 7fd6eaed1640 1 Processor -- start 2024-05-08T04:20:48.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.884+0000 7fd6eaed1640 1 -- start start 2024-05-08T04:20:48.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.884+0000 7fd6eaed1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6e40cdbf0 0x7fd6e41668d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.884+0000 7fd6eaed1640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e40cc700 con 0x7fd6e40cf360 2024-05-08T04:20:48.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.884+0000 7fd6eaed1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e40d0020 con 0x7fd6e4099a40 2024-05-08T04:20:48.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.884+0000 7fd6eaed1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e415ced0 con 0x7fd6e40cdbf0 2024-05-08T04:20:48.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.884+0000 7fd6e3fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd6e40cf360 0x7fd6e40cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:50198/0 (socket says 172.21.15.104:50198) 2024-05-08T04:20:48.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.884+0000 7fd6e3fff640 1 -- 172.21.15.104:0/1090555834 learned_addr learned my addr 172.21.15.104:0/1090555834 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:20:48.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.885+0000 7fd6e946e640 1 --2- 172.21.15.104:0/1090555834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6e40cdbf0 0x7fd6e41668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.885+0000 7fd6e37fe640 1 -- 172.21.15.104:0/1090555834 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529566742 0 0) 0x7fd6e40cc700 con 0x7fd6e40cf360 2024-05-08T04:20:48.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.885+0000 7fd6e37fe640 1 -- 172.21.15.104:0/1090555834 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d4003520 con 0x7fd6e40cf360 2024-05-08T04:20:48.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.885+0000 7fd6e946e640 1 -- 172.21.15.104:0/1090555834 >> v1:172.21.15.183:6789/0 conn(0x7fd6e4099a40 legacy=0x7fd6e4099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.885+0000 7fd6e37fe640 1 -- 172.21.15.104:0/1090555834 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682176022 0 0) 0x7fd6e40d0020 con 0x7fd6e4099a40 2024-05-08T04:20:48.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.885+0000 7fd6e946e640 1 -- 172.21.15.104:0/1090555834 >> v1:172.21.15.104:6789/0 conn(0x7fd6e40cf360 legacy=0x7fd6e40cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.885+0000 7fd6e946e640 1 -- 172.21.15.104:0/1090555834 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e40d0300 con 0x7fd6e40cdbf0 2024-05-08T04:20:48.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.886+0000 7fd6e946e640 1 --2- 172.21.15.104:0/1090555834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6e40cdbf0 0x7fd6e41668d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009dc0 tx=0x7fd6dc02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99c49e430fd471a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:48.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.886+0000 7fd6e37fe640 1 -- 172.21.15.104:0/1090555834 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc007740 con 0x7fd6e40cdbf0 2024-05-08T04:20:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.886+0000 7fd6e37fe640 1 -- 172.21.15.104:0/1090555834 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc0078e0 con 0x7fd6e40cdbf0 2024-05-08T04:20:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.886+0000 7fd6e37fe640 1 -- 172.21.15.104:0/1090555834 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc007c90 con 0x7fd6e40cdbf0 2024-05-08T04:20:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.886+0000 7fd6eaed1640 1 -- 172.21.15.104:0/1090555834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6e40cdbf0 msgr2=0x7fd6e41668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.886+0000 7fd6eaed1640 1 --2- 172.21.15.104:0/1090555834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6e40cdbf0 0x7fd6e41668d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009dc0 tx=0x7fd6dc02a6d0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.886+0000 7fd6eaed1640 1 -- 172.21.15.104:0/1090555834 shutdown_connections 2024-05-08T04:20:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.886+0000 7fd6eaed1640 1 --2- 172.21.15.104:0/1090555834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6e40cdbf0 0x7fd6e41668d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.886+0000 7fd6eaed1640 1 -- 172.21.15.104:0/1090555834 >> 172.21.15.104:0/1090555834 conn(0x7fd6e40b3280 msgr2=0x7fd6e40b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.886+0000 7fd6eaed1640 1 -- 172.21.15.104:0/1090555834 shutdown_connections 2024-05-08T04:20:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.886+0000 7fd6eaed1640 1 -- 172.21.15.104:0/1090555834 wait complete. 2024-05-08T04:20:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.888+0000 7fd6eaed1640 1 Processor -- start 2024-05-08T04:20:48.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.888+0000 7fd6eaed1640 1 -- start start 2024-05-08T04:20:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.888+0000 7fd6eaed1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6e4099a40 0x7fd6e40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.888+0000 7fd6eaed1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6e40cdbf0 0x7fd6e415b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.888+0000 7fd6eaed1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6e40cf360 0x7fd6e40c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.888+0000 7fd6eaed1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e40d08c0 con 0x7fd6e40cf360 2024-05-08T04:20:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.888+0000 7fd6eaed1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e4159860 con 0x7fd6e4099a40 2024-05-08T04:20:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.888+0000 7fd6eaed1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e40d0a40 con 0x7fd6e40cdbf0 2024-05-08T04:20:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e946e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6e40cf360 0x7fd6e40c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e3fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6e40cdbf0 0x7fd6e415b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e946e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6e40cf360 0x7fd6e40c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51982/0 (socket says 172.21.15.104:51982) 2024-05-08T04:20:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e3fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6e40cdbf0 0x7fd6e415b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:35696/0 (socket says 172.21.15.104:35696) 2024-05-08T04:20:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e946e640 1 -- 172.21.15.104:0/3990818616 learned_addr learned my addr 172.21.15.104:0/3990818616 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:20:48.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e8c6d640 1 --2- 172.21.15.104:0/3990818616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6e4099a40 0x7fd6e40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e946e640 1 -- 172.21.15.104:0/3990818616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6e40cdbf0 msgr2=0x7fd6e415b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e946e640 1 --2- 172.21.15.104:0/3990818616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6e40cdbf0 0x7fd6e415b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e946e640 1 -- 172.21.15.104:0/3990818616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6e4099a40 msgr2=0x7fd6e40b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e946e640 1 --2- 172.21.15.104:0/3990818616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6e4099a40 0x7fd6e40b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e946e640 1 -- 172.21.15.104:0/3990818616 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e40b56c0 con 0x7fd6e40cf360 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e3fff640 1 --2- 172.21.15.104:0/3990818616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6e40cdbf0 0x7fd6e415b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e946e640 1 --2- 172.21.15.104:0/3990818616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6e40cf360 0x7fd6e40c8860 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc02acc0 tx=0x7fd6dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e17fa640 1 -- 172.21.15.104:0/3990818616 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc040070 con 0x7fd6e40cf360 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e17fa640 1 -- 172.21.15.104:0/3990818616 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc031c40 con 0x7fd6e40cf360 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e17fa640 1 -- 172.21.15.104:0/3990818616 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc009450 con 0x7fd6e40cf360 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6eaed1640 1 -- 172.21.15.104:0/3990818616 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e40b59a0 con 0x7fd6e40cf360 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6eaed1640 1 -- 172.21.15.104:0/3990818616 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e40b5f60 con 0x7fd6e40cf360 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e17fa640 1 -- 172.21.15.104:0/3990818616 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd6dc039040 con 0x7fd6e40cf360 2024-05-08T04:20:48.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.889+0000 7fd6e17fa640 1 -- 172.21.15.104:0/3990818616 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd6dc045cd0 con 0x7fd6e40cf360 2024-05-08T04:20:48.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.890+0000 7fd6eaed1640 1 -- 172.21.15.104:0/3990818616 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e4075010 con 0x7fd6e40cf360 2024-05-08T04:20:48.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.892+0000 7fd6e17fa640 1 -- 172.21.15.104:0/3990818616 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd6dc054080 con 0x7fd6e40cf360 2024-05-08T04:20:48.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.953+0000 7fd6eaed1640 1 -- 172.21.15.104:0/3990818616 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6e4071b90 con 0x7fd6e40cf360 2024-05-08T04:20:48.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.954+0000 7fd6e17fa640 1 -- 172.21.15.104:0/3990818616 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fd6dc007840 con 0x7fd6e40cf360 2024-05-08T04:20:48.955 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:20:48.955 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":10,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:20:48.724780+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:20:48.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.955+0000 7fd6eaed1640 1 -- 172.21.15.104:0/3990818616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6e40cf360 msgr2=0x7fd6e40c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:48.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.955+0000 7fd6eaed1640 1 --2- 172.21.15.104:0/3990818616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6e40cf360 0x7fd6e40c8860 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc02acc0 tx=0x7fd6dc004a40 comp rx=0 tx=0).stop 2024-05-08T04:20:48.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.955+0000 7fd6eaed1640 1 -- 172.21.15.104:0/3990818616 shutdown_connections 2024-05-08T04:20:48.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.955+0000 7fd6eaed1640 1 --2- 172.21.15.104:0/3990818616 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6e40cf360 0x7fd6e40c8860 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.955+0000 7fd6eaed1640 1 --2- 172.21.15.104:0/3990818616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6e40cdbf0 0x7fd6e415b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.955+0000 7fd6eaed1640 1 --2- 172.21.15.104:0/3990818616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6e4099a40 0x7fd6e40b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:48.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.955+0000 7fd6eaed1640 1 -- 172.21.15.104:0/3990818616 >> 172.21.15.104:0/3990818616 conn(0x7fd6e40b3280 msgr2=0x7fd6e40b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:48.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.955+0000 7fd6eaed1640 1 -- 172.21.15.104:0/3990818616 shutdown_connections 2024-05-08T04:20:48.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:20:48.955+0000 7fd6eaed1640 1 -- 172.21.15.104:0/3990818616 wait complete. 2024-05-08T04:20:48.967 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T04:20:48.967 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T04:20:49.059 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:49.058+0000 7f2874a0d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T04:20:49.113 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:49.112+0000 7f2874a0d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T04:20:49.135 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:49.134+0000 7f76de91e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T04:20:49.187 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:49.185+0000 7f76de91e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T04:20:49.228 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:49.227+0000 7f2874a0d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T04:20:49.301 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:49.299+0000 7f76de91e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T04:20:49.343 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-05-08T04:20:49.342+0000 7f0b8522d640 -1 Falling back to public interface 2024-05-08T04:20:49.353 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-05-08T04:20:49.352+0000 7f456c744640 -1 Falling back to public interface 2024-05-08T04:20:49.361 INFO:tasks.ceph.osd.4.smithi183.stderr:2024-05-08T04:20:49.359+0000 7f5674340640 -1 Falling back to public interface 2024-05-08T04:20:49.362 INFO:tasks.ceph.osd.5.smithi183.stderr:2024-05-08T04:20:49.360+0000 7f46ac01c640 -1 Falling back to public interface 2024-05-08T04:20:49.376 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-05-08T04:20:49.374+0000 7f28ef216640 -1 Falling back to public interface 2024-05-08T04:20:49.378 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-05-08T04:20:49.377+0000 7f646d00c640 -1 Falling back to public interface 2024-05-08T04:20:49.382 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-05-08T04:20:49.381+0000 7f2ed1020640 -1 Falling back to public interface 2024-05-08T04:20:49.386 INFO:tasks.ceph.osd.6.smithi183.stderr:2024-05-08T04:20:49.384+0000 7f977420c640 -1 Falling back to public interface 2024-05-08T04:20:49.516 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:49.515+0000 7f2874a0d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T04:20:49.563 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:49.562+0000 7f2874a0d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T04:20:49.592 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:49.590+0000 7f76de91e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T04:20:49.640 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:49.638+0000 7f76de91e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T04:20:49.721 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:49.720+0000 7f2874a0d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T04:20:49.773 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T04:20:49.797 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:49.795+0000 7f76de91e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T04:20:49.862 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:49.861+0000 7f2874a0d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T04:20:49.866 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.865+0000 7f550e0bd640 1 Processor -- start 2024-05-08T04:20:49.866 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.865+0000 7f550e0bd640 1 -- start start 2024-05-08T04:20:49.868 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.866+0000 7f550e0bd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f550806ab40 0x7f55080acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:49.868 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.866+0000 7f550e0bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55080b3d00 0x7f550806ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:49.869 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.866+0000 7f550e0bd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550806ddc0 con 0x7f55080b3890 2024-05-08T04:20:49.869 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.866+0000 7f550e0bd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550806e0a0 con 0x7f550806ab40 2024-05-08T04:20:49.869 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.866+0000 7f550e0bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550806e380 con 0x7f55080b3d00 2024-05-08T04:20:49.869 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.866+0000 7f55077fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f550806ab40 0x7f55080acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:49.869 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.866+0000 7f54feffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f55080b3890 0x7f550806af20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:50208/0 (socket says 172.21.15.104:50208) 2024-05-08T04:20:49.869 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.866+0000 7f54feffd640 1 -- 172.21.15.104:0/2150291000 learned_addr learned my addr 172.21.15.104:0/2150291000 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:20:49.869 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.867+0000 7f5507fff640 1 --2- 172.21.15.104:0/2150291000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55080b3d00 0x7f550806ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:49.869 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.867+0000 7f55077fe640 1 -- 172.21.15.104:0/2150291000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55080b3d00 msgr2=0x7f550806ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:20:49.869 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.867+0000 7f55077fe640 1 --2- 172.21.15.104:0/2150291000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55080b3d00 0x7f550806ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:49.869 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.867+0000 7f55077fe640 1 -- 172.21.15.104:0/2150291000 >> v1:172.21.15.104:6789/0 conn(0x7f55080b3890 legacy=0x7f550806af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:49.869 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.867+0000 7f5506ffd640 1 -- 172.21.15.104:0/2150291000 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857881597 0 0) 0x7f550806ddc0 con 0x7f55080b3890 2024-05-08T04:20:49.869 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.867+0000 7f55077fe640 1 -- 172.21.15.104:0/2150291000 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550806e660 con 0x7f550806ab40 2024-05-08T04:20:49.870 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.867+0000 7f5507fff640 1 --2- 172.21.15.104:0/2150291000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55080b3d00 0x7f550806ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:20:49.870 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.867+0000 7f55077fe640 1 --2- 172.21.15.104:0/2150291000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f550806ab40 0x7f55080acea0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f54f80097d0 tx=0x7f54f802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6771ea033562ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:49.870 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.867+0000 7f5506ffd640 1 -- 172.21.15.104:0/2150291000 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8037070 con 0x7f550806ab40 2024-05-08T04:20:49.870 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.867+0000 7f5506ffd640 1 -- 172.21.15.104:0/2150291000 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f8032440 con 0x7f550806ab40 2024-05-08T04:20:49.870 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.867+0000 7f5506ffd640 1 -- 172.21.15.104:0/2150291000 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8032810 con 0x7f550806ab40 2024-05-08T04:20:49.873 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.868+0000 7f550e0bd640 1 -- 172.21.15.104:0/2150291000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f550806ab40 msgr2=0x7f55080acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:49.873 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.868+0000 7f550e0bd640 1 --2- 172.21.15.104:0/2150291000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f550806ab40 0x7f55080acea0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f54f80097d0 tx=0x7f54f802a1c0 comp rx=0 tx=0).stop 2024-05-08T04:20:49.873 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.868+0000 7f550e0bd640 1 -- 172.21.15.104:0/2150291000 shutdown_connections 2024-05-08T04:20:49.873 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.868+0000 7f550e0bd640 1 --2- 172.21.15.104:0/2150291000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55080b3d00 0x7f550806ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:49.873 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.868+0000 7f550e0bd640 1 --2- 172.21.15.104:0/2150291000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f550806ab40 0x7f55080acea0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:49.873 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.868+0000 7f550e0bd640 1 -- 172.21.15.104:0/2150291000 >> 172.21.15.104:0/2150291000 conn(0x7f55080cfe20 msgr2=0x7f55080d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:49.873 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.868+0000 7f550e0bd640 1 -- 172.21.15.104:0/2150291000 shutdown_connections 2024-05-08T04:20:49.873 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.868+0000 7f550e0bd640 1 -- 172.21.15.104:0/2150291000 wait complete. 2024-05-08T04:20:49.873 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.869+0000 7f550e0bd640 1 Processor -- start 2024-05-08T04:20:49.873 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.869+0000 7f550e0bd640 1 -- start start 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.870+0000 7f550e0bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f550806ab40 0x7f5508147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.870+0000 7f550e0bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55080b3890 0x7f55081518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.870+0000 7f550e0bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55080b3d00 0x7f550815ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.870+0000 7f550e0bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55080ad560 con 0x7f55080b3890 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.870+0000 7f550e0bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55080ad3e0 con 0x7f550806ab40 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.870+0000 7f550e0bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55080b32f0 con 0x7f55080b3d00 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.870+0000 7f54feffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55080b3890 0x7f55081518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.870+0000 7f54feffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55080b3890 0x7f55081518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52002/0 (socket says 172.21.15.104:52002) 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.870+0000 7f54feffd640 1 -- 172.21.15.104:0/621923476 learned_addr learned my addr 172.21.15.104:0/621923476 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.870+0000 7f5507fff640 1 --2- 172.21.15.104:0/621923476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55080b3d00 0x7f550815ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.870+0000 7f55077fe640 1 --2- 172.21.15.104:0/621923476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f550806ab40 0x7f5508147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.871+0000 7f54feffd640 1 -- 172.21.15.104:0/621923476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55080b3d00 msgr2=0x7f550815ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.871+0000 7f54feffd640 1 --2- 172.21.15.104:0/621923476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55080b3d00 0x7f550815ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:49.874 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.871+0000 7f54feffd640 1 -- 172.21.15.104:0/621923476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f550806ab40 msgr2=0x7f5508147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:49.875 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.871+0000 7f54feffd640 1 --2- 172.21.15.104:0/621923476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f550806ab40 0x7f5508147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:49.875 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.871+0000 7f54feffd640 1 -- 172.21.15.104:0/621923476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55081521c0 con 0x7f55080b3890 2024-05-08T04:20:49.875 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.871+0000 7f54feffd640 1 --2- 172.21.15.104:0/621923476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55080b3890 0x7f55081518c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c4d0 tx=0x7f54f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:49.875 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.871+0000 7f5504ff9640 1 -- 172.21.15.104:0/621923476 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0018070 con 0x7f55080b3890 2024-05-08T04:20:49.875 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.871+0000 7f5504ff9640 1 -- 172.21.15.104:0/621923476 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f0007500 con 0x7f55080b3890 2024-05-08T04:20:49.875 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.871+0000 7f550e0bd640 1 -- 172.21.15.104:0/621923476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55081524a0 con 0x7f55080b3890 2024-05-08T04:20:49.875 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.871+0000 7f5504ff9640 1 -- 172.21.15.104:0/621923476 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0004a20 con 0x7f55080b3890 2024-05-08T04:20:49.875 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.871+0000 7f550e0bd640 1 -- 172.21.15.104:0/621923476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5508152f20 con 0x7f55080b3890 2024-05-08T04:20:49.875 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.871+0000 7f5504ff9640 1 -- 172.21.15.104:0/621923476 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f54f001b070 con 0x7f55080b3890 2024-05-08T04:20:49.875 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.871+0000 7f5504ff9640 1 -- 172.21.15.104:0/621923476 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f54f0012ad0 con 0x7f55080b3890 2024-05-08T04:20:49.875 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.872+0000 7f550e0bd640 1 -- 172.21.15.104:0/621923476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5508068540 con 0x7f55080b3890 2024-05-08T04:20:49.876 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.874+0000 7f5504ff9640 1 -- 172.21.15.104:0/621923476 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f54f001d440 con 0x7f55080b3890 2024-05-08T04:20:49.915 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:49.914+0000 7f2874a0d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T04:20:49.933 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:49.932+0000 7f76de91e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T04:20:49.937 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.936+0000 7f550e0bd640 1 -- 172.21.15.104:0/621923476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f550806bef0 con 0x7f55080b3890 2024-05-08T04:20:49.938 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.937+0000 7f5504ff9640 1 -- 172.21.15.104:0/621923476 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f54f001d6e0 con 0x7f55080b3890 2024-05-08T04:20:49.938 INFO:teuthology.misc.health.smithi104.stdout: 2024-05-08T04:20:49.938 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":10,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:20:48.724780+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:20:49.939 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.938+0000 7f550e0bd640 1 -- 172.21.15.104:0/621923476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55080b3890 msgr2=0x7f55081518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:49.939 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.938+0000 7f550e0bd640 1 --2- 172.21.15.104:0/621923476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55080b3890 0x7f55081518c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c4d0 tx=0x7f54f000c990 comp rx=0 tx=0).stop 2024-05-08T04:20:49.939 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.938+0000 7f550e0bd640 1 -- 172.21.15.104:0/621923476 shutdown_connections 2024-05-08T04:20:49.940 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.938+0000 7f550e0bd640 1 --2- 172.21.15.104:0/621923476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55080b3d00 0x7f550815ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:49.940 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.938+0000 7f550e0bd640 1 --2- 172.21.15.104:0/621923476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55080b3890 0x7f55081518c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:49.940 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.938+0000 7f550e0bd640 1 --2- 172.21.15.104:0/621923476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f550806ab40 0x7f5508147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:49.940 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.938+0000 7f550e0bd640 1 -- 172.21.15.104:0/621923476 >> 172.21.15.104:0/621923476 conn(0x7f55080cfe20 msgr2=0x7f550806af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:49.940 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.938+0000 7f550e0bd640 1 -- 172.21.15.104:0/621923476 shutdown_connections 2024-05-08T04:20:49.940 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:49.938+0000 7f550e0bd640 1 -- 172.21.15.104:0/621923476 wait complete. 2024-05-08T04:20:49.948 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T04:20:49.984 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:49.982+0000 7f76de91e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T04:20:49.988 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:49.987+0000 7f2874a0d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T04:20:50.034 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:50.033+0000 7f2874a0d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T04:20:50.052 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:50.051+0000 7f76de91e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T04:20:50.097 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:50.095+0000 7f76de91e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T04:20:50.514 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:50.513+0000 7f2874a0d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T04:20:50.571 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:50.569+0000 7f76de91e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T04:20:50.628 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:50.627+0000 7f2874a0d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T04:20:50.689 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T04:20:50.687+0000 7f76de91e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T04:20:51.641 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:51.640+0000 7f28152d6640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-08T04:20:51.641 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:20:51.640+0000 7f28152d6640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-08T04:20:52.806 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-05-08T04:20:52.805+0000 7f456c744640 -1 osd.0 0 log_to_monitors true 2024-05-08T04:20:52.821 INFO:tasks.ceph.osd.4.smithi183.stderr:2024-05-08T04:20:52.820+0000 7f5674340640 -1 osd.4 0 log_to_monitors true 2024-05-08T04:20:52.858 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-05-08T04:20:52.857+0000 7f0b8522d640 -1 osd.1 0 log_to_monitors true 2024-05-08T04:20:52.878 INFO:tasks.ceph.osd.5.smithi183.stderr:2024-05-08T04:20:52.876+0000 7f46ac01c640 -1 osd.5 0 log_to_monitors true 2024-05-08T04:20:52.886 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-05-08T04:20:52.885+0000 7f2ed1020640 -1 osd.2 0 log_to_monitors true 2024-05-08T04:20:52.892 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-05-08T04:20:52.891+0000 7f646d00c640 -1 osd.3 0 log_to_monitors true 2024-05-08T04:20:52.906 INFO:tasks.ceph.osd.6.smithi183.stderr:2024-05-08T04:20:52.904+0000 7f977420c640 -1 osd.6 0 log_to_monitors true 2024-05-08T04:20:52.913 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-05-08T04:20:52.912+0000 7f28ef216640 -1 osd.7 0 log_to_monitors true 2024-05-08T04:20:56.612 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-05-08T04:20:56.611+0000 7f0b7ff55640 -1 osd.1 0 waiting for initial osdmap 2024-05-08T04:20:56.627 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-05-08T04:20:56.626+0000 7f0b78587640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T04:20:56.648 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-05-08T04:20:56.646+0000 7f28ebbfc640 -1 osd.7 0 waiting for initial osdmap 2024-05-08T04:20:56.657 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-05-08T04:20:56.655+0000 7f28e29f6640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T04:20:56.672 INFO:tasks.ceph.osd.6.smithi183.stderr:2024-05-08T04:20:56.670+0000 7f976f3bc640 -1 osd.6 0 waiting for initial osdmap 2024-05-08T04:20:56.680 INFO:tasks.ceph.osd.4.smithi183.stderr:2024-05-08T04:20:56.679+0000 7f56712eb640 -1 osd.4 0 waiting for initial osdmap 2024-05-08T04:20:56.686 INFO:tasks.ceph.osd.6.smithi183.stderr:2024-05-08T04:20:56.685+0000 7f97679ee640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T04:20:56.700 INFO:tasks.ceph.osd.4.smithi183.stderr:2024-05-08T04:20:56.698+0000 7f56680e5640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T04:20:56.705 INFO:tasks.ceph.osd.5.smithi183.stderr:2024-05-08T04:20:56.704+0000 7f46a7236640 -1 osd.5 0 waiting for initial osdmap 2024-05-08T04:20:56.714 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-05-08T04:20:56.713+0000 7f64699f4640 -1 osd.3 0 waiting for initial osdmap 2024-05-08T04:20:56.716 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-05-08T04:20:56.715+0000 7f2ecc0f4640 -1 osd.2 0 waiting for initial osdmap 2024-05-08T04:20:56.721 INFO:tasks.ceph.osd.5.smithi183.stderr:2024-05-08T04:20:56.720+0000 7f469f868640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T04:20:56.728 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-05-08T04:20:56.727+0000 7f2ec4726640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T04:20:56.728 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-05-08T04:20:56.727+0000 7f64607ee640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T04:20:56.745 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-05-08T04:20:56.744+0000 7f4567eb7640 -1 osd.0 0 waiting for initial osdmap 2024-05-08T04:20:56.755 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T04:20:56.761 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-05-08T04:20:56.760+0000 7f45604e9640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T04:20:56.846 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.845+0000 7ffaf8e46640 1 Processor -- start 2024-05-08T04:20:56.846 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.845+0000 7ffaf8e46640 1 -- start start 2024-05-08T04:20:56.848 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.846+0000 7ffaf8e46640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffaf41610c0 0x7ffaf406c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.846+0000 7ffaf8e46640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffaf406d510 0x7ffaf4071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.846+0000 7ffaf8e46640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf41614a0 con 0x7ffaf4071a70 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.846+0000 7ffaf8e46640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf40710a0 con 0x7ffaf406d510 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.846+0000 7ffaf8e46640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf406ca00 con 0x7ffaf41610c0 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.846+0000 7ffae9d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffaf406d510 0x7ffaf4071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.846+0000 7ffae9d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffaf406d510 0x7ffaf4071530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52092/0 (socket says 172.21.15.104:52092) 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.846+0000 7ffae9d9b640 1 -- 172.21.15.104:0/3204648935 learned_addr learned my addr 172.21.15.104:0/3204648935 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.846+0000 7ffaf259c640 1 --2- 172.21.15.104:0/3204648935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffaf41610c0 0x7ffaf406c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.846+0000 7ffae9d9b640 1 -- 172.21.15.104:0/3204648935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffaf41610c0 msgr2=0x7ffaf406c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.846+0000 7ffae9d9b640 1 --2- 172.21.15.104:0/3204648935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffaf41610c0 0x7ffaf406c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.846+0000 7ffae9d9b640 1 -- 172.21.15.104:0/3204648935 >> v1:172.21.15.183:6789/0 conn(0x7ffaf4071a70 legacy=0x7ffaf40ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.846+0000 7ffae9d9b640 1 -- 172.21.15.104:0/3204648935 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf406cce0 con 0x7ffaf406d510 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.847+0000 7ffae9d9b640 1 --2- 172.21.15.104:0/3204648935 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffaf406d510 0x7ffaf4071530 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009870 tx=0x7ffadc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e94a4bc474b0f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:56.849 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.847+0000 7ffaf1d9b640 1 -- 172.21.15.104:0/3204648935 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc037070 con 0x7ffaf406d510 2024-05-08T04:20:56.850 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.847+0000 7ffaf1d9b640 1 -- 172.21.15.104:0/3204648935 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc032440 con 0x7ffaf406d510 2024-05-08T04:20:56.850 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.847+0000 7ffaf1d9b640 1 -- 172.21.15.104:0/3204648935 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc032810 con 0x7ffaf406d510 2024-05-08T04:20:56.850 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.847+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3204648935 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffaf406d510 msgr2=0x7ffaf4071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:56.850 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.847+0000 7ffaf8e46640 1 --2- 172.21.15.104:0/3204648935 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffaf406d510 0x7ffaf4071530 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009870 tx=0x7ffadc02a270 comp rx=0 tx=0).stop 2024-05-08T04:20:56.850 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.847+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3204648935 shutdown_connections 2024-05-08T04:20:56.850 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.847+0000 7ffaf8e46640 1 --2- 172.21.15.104:0/3204648935 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffaf406d510 0x7ffaf4071530 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:56.850 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.847+0000 7ffaf8e46640 1 --2- 172.21.15.104:0/3204648935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffaf41610c0 0x7ffaf406c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:56.850 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.847+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3204648935 >> 172.21.15.104:0/3204648935 conn(0x7ffaf406f4a0 msgr2=0x7ffaf406f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:56.850 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.847+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3204648935 shutdown_connections 2024-05-08T04:20:56.850 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.847+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3204648935 wait complete. 2024-05-08T04:20:56.852 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.849+0000 7ffaf8e46640 1 Processor -- start 2024-05-08T04:20:56.853 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.849+0000 7ffaf8e46640 1 -- start start 2024-05-08T04:20:56.853 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf8e46640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffaf406d510 0x7ffaf415cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:56.853 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf8e46640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffaf4071a70 0x7ffaf40ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:56.853 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf8e46640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffaf41610c0 0x7ffaf40cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:56.853 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf8e46640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf406c660 con 0x7ffaf41610c0 2024-05-08T04:20:56.853 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf8e46640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf4070d30 con 0x7ffaf4071a70 2024-05-08T04:20:56.853 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf8e46640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf406c7e0 con 0x7ffaf406d510 2024-05-08T04:20:56.853 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffaf41610c0 0x7ffaf40cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:56.853 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffaf41610c0 0x7ffaf40cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52100/0 (socket says 172.21.15.104:52100) 2024-05-08T04:20:56.853 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf2d9d640 1 -- 172.21.15.104:0/3835038858 learned_addr learned my addr 172.21.15.104:0/3835038858 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:20:56.853 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffae9d9b640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffaf4071a70 0x7ffaf40ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:56.853 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf2d9d640 1 -- 172.21.15.104:0/3835038858 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffaf406d510 msgr2=0x7ffaf415cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:56.853 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf259c640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffaf406d510 0x7ffaf415cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:56.854 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf2d9d640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffaf406d510 0x7ffaf415cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:56.854 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf2d9d640 1 -- 172.21.15.104:0/3835038858 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffaf4071a70 msgr2=0x7ffaf40ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:56.854 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf2d9d640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffaf4071a70 0x7ffaf40ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:56.854 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf2d9d640 1 -- 172.21.15.104:0/3835038858 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf415e400 con 0x7ffaf41610c0 2024-05-08T04:20:56.854 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf2d9d640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffaf41610c0 0x7ffaf40cadf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffaec00c730 tx=0x7ffaec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:56.854 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaeb7fe640 1 -- 172.21.15.104:0/3835038858 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec003b70 con 0x7ffaf41610c0 2024-05-08T04:20:56.854 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaeb7fe640 1 -- 172.21.15.104:0/3835038858 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec003d10 con 0x7ffaf41610c0 2024-05-08T04:20:56.854 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3835038858 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf415e6e0 con 0x7ffaf41610c0 2024-05-08T04:20:56.854 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaeb7fe640 1 -- 172.21.15.104:0/3835038858 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec00aa90 con 0x7ffaf41610c0 2024-05-08T04:20:56.854 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.850+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3835038858 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf415eca0 con 0x7ffaf41610c0 2024-05-08T04:20:56.854 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.851+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3835038858 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf4068540 con 0x7ffaf41610c0 2024-05-08T04:20:56.855 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.852+0000 7ffaeb7fe640 1 -- 172.21.15.104:0/3835038858 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7ffaec00ac30 con 0x7ffaf41610c0 2024-05-08T04:20:56.855 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.852+0000 7ffaeb7fe640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffad406b440 0x7ffad406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:20:56.855 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.852+0000 7ffaeb7fe640 1 -- 172.21.15.104:0/3835038858 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7ffaec0891c0 con 0x7ffaf41610c0 2024-05-08T04:20:56.855 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.852+0000 7ffaf259c640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffad406b440 0x7ffad406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:20:56.855 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.853+0000 7ffaf259c640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffad406b440 0x7ffad406d900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffae4006fd0 tx=0x7ffae4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:20:56.858 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:56.857+0000 7ffaeb7fe640 1 -- 172.21.15.104:0/3835038858 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffaec058f40 con 0x7ffaf41610c0 2024-05-08T04:20:57.030 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.029+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3835038858 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaf40cf000 con 0x7ffaf41610c0 2024-05-08T04:20:57.030 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.029+0000 7ffaeb7fe640 1 -- 172.21.15.104:0/3835038858 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7ffaec058840 con 0x7ffaf41610c0 2024-05-08T04:20:57.031 INFO:teuthology.misc.health.smithi104.stdout: 2024-05-08T04:20:57.031 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":12,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:20:54.646098+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:20:57.033 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.031+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3835038858 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffad406b440 msgr2=0x7ffad406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:57.033 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.031+0000 7ffaf8e46640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffad406b440 0x7ffad406d900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffae4006fd0 tx=0x7ffae4008040 comp rx=0 tx=0).stop 2024-05-08T04:20:57.033 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.031+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3835038858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffaf41610c0 msgr2=0x7ffaf40cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:20:57.033 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.031+0000 7ffaf8e46640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffaf41610c0 0x7ffaf40cadf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffaec00c730 tx=0x7ffaec00cbf0 comp rx=0 tx=0).stop 2024-05-08T04:20:57.033 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.031+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3835038858 shutdown_connections 2024-05-08T04:20:57.033 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.031+0000 7ffaf8e46640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffad406b440 0x7ffad406d900 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:57.033 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.031+0000 7ffaf8e46640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffaf4071a70 0x7ffaf40ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:57.033 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.031+0000 7ffaf8e46640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffaf41610c0 0x7ffaf40cadf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:57.033 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.031+0000 7ffaf8e46640 1 --2- 172.21.15.104:0/3835038858 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffaf406d510 0x7ffaf415cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:20:57.033 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.031+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3835038858 >> 172.21.15.104:0/3835038858 conn(0x7ffaf406f4a0 msgr2=0x7ffaf40cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:20:57.033 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.031+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3835038858 shutdown_connections 2024-05-08T04:20:57.033 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:20:57.031+0000 7ffaf8e46640 1 -- 172.21.15.104:0/3835038858 wait complete. 2024-05-08T04:20:57.043 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T04:21:03.850 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:03.952 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.951+0000 7f51fd928640 1 Processor -- start 2024-05-08T04:21:03.953 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.951+0000 7f51fd928640 1 -- start start 2024-05-08T04:21:03.955 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51fd928640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f51f80d1070 0x7f51f80d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:03.955 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51fd928640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51f80b9320 0x7f51f80b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:03.956 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51fd928640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f80d2460 con 0x7f51f815dba0 2024-05-08T04:21:03.956 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51fd928640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f80ce170 con 0x7f51f80d1070 2024-05-08T04:21:03.956 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51fd928640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80d2740 con 0x7f51f80b9320 2024-05-08T04:21:03.956 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51f67fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f51f80d1070 0x7f51f80d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:03.956 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51f67fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f51f80d1070 0x7f51f80d1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43734/0 (socket says 172.21.15.104:43734) 2024-05-08T04:21:03.956 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51f67fc640 1 -- 172.21.15.104:0/744263028 learned_addr learned my addr 172.21.15.104:0/744263028 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:03.956 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51f67fc640 1 -- 172.21.15.104:0/744263028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51f80b9320 msgr2=0x7f51f80b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:03.956 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51f77fe640 1 --2- 172.21.15.104:0/744263028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51f80b9320 0x7f51f80b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:03.956 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51f67fc640 1 --2- 172.21.15.104:0/744263028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51f80b9320 0x7f51f80b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:03.956 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51f67fc640 1 -- 172.21.15.104:0/744263028 >> v1:172.21.15.183:6789/0 conn(0x7f51f815dba0 legacy=0x7f51f80d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:03.956 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51f67fc640 1 -- 172.21.15.104:0/744263028 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f80d2a20 con 0x7f51f80d1070 2024-05-08T04:21:03.956 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.952+0000 7f51f77fe640 1 --2- 172.21.15.104:0/744263028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51f80b9320 0x7f51f80b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:03.956 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.953+0000 7f51f67fc640 1 --2- 172.21.15.104:0/744263028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51f80d1070 0x7f51f80d1d60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009870 tx=0x7f51ec02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68049ab9ec839ab5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:03.957 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.953+0000 7f51f5ffb640 1 -- 172.21.15.104:0/744263028 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec037070 con 0x7f51f80d1070 2024-05-08T04:21:03.957 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.953+0000 7f51f5ffb640 1 -- 172.21.15.104:0/744263028 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec032440 con 0x7f51f80d1070 2024-05-08T04:21:03.957 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.953+0000 7f51f5ffb640 1 -- 172.21.15.104:0/744263028 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec032810 con 0x7f51f80d1070 2024-05-08T04:21:03.957 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.954+0000 7f51fd928640 1 -- 172.21.15.104:0/744263028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51f80d1070 msgr2=0x7f51f80d1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:03.957 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.954+0000 7f51fd928640 1 --2- 172.21.15.104:0/744263028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51f80d1070 0x7f51f80d1d60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009870 tx=0x7f51ec02a1c0 comp rx=0 tx=0).stop 2024-05-08T04:21:03.957 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.954+0000 7f51fd928640 1 -- 172.21.15.104:0/744263028 shutdown_connections 2024-05-08T04:21:03.957 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.954+0000 7f51fd928640 1 --2- 172.21.15.104:0/744263028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51f80b9320 0x7f51f80b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:03.957 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.954+0000 7f51fd928640 1 --2- 172.21.15.104:0/744263028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51f80d1070 0x7f51f80d1d60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:03.957 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.954+0000 7f51fd928640 1 -- 172.21.15.104:0/744263028 >> 172.21.15.104:0/744263028 conn(0x7f51f8072690 msgr2=0x7f51f8072aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:03.957 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.954+0000 7f51fd928640 1 -- 172.21.15.104:0/744263028 shutdown_connections 2024-05-08T04:21:03.957 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.954+0000 7f51fd928640 1 -- 172.21.15.104:0/744263028 wait complete. 2024-05-08T04:21:03.960 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.955+0000 7f51fd928640 1 Processor -- start 2024-05-08T04:21:03.960 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.955+0000 7f51fd928640 1 -- start start 2024-05-08T04:21:03.960 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51fd928640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51f80b9320 0x7f51f8153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:03.960 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51fd928640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51f80d1070 0x7f51f8160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:03.960 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51fd928640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51f815dba0 0x7f51f81608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:03.960 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51fd928640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f80d3500 con 0x7f51f80b9320 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51fd928640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f815df80 con 0x7f51f815dba0 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51fd928640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f815d190 con 0x7f51f80d1070 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51f6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51f80b9320 0x7f51f8153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51f6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51f80b9320 0x7f51f8153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43740/0 (socket says 172.21.15.104:43740) 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51f6ffd640 1 -- 172.21.15.104:0/1055094215 learned_addr learned my addr 172.21.15.104:0/1055094215 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51f67fc640 1 --2- 172.21.15.104:0/1055094215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51f80d1070 0x7f51f8160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51f6ffd640 1 -- 172.21.15.104:0/1055094215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51f80d1070 msgr2=0x7f51f8160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51f6ffd640 1 --2- 172.21.15.104:0/1055094215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51f80d1070 0x7f51f8160360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51f6ffd640 1 -- 172.21.15.104:0/1055094215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51f815dba0 msgr2=0x7f51f81608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51f6ffd640 1 --2- 172.21.15.104:0/1055094215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51f815dba0 0x7f51f81608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.956+0000 7f51f6ffd640 1 -- 172.21.15.104:0/1055094215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f81f4760 con 0x7f51f80b9320 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.957+0000 7f51f6ffd640 1 --2- 172.21.15.104:0/1055094215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51f80b9320 0x7f51f8153ea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f51e800c3c0 tx=0x7f51e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.957+0000 7f51dffff640 1 -- 172.21.15.104:0/1055094215 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e80052d0 con 0x7f51f80b9320 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.957+0000 7f51dffff640 1 -- 172.21.15.104:0/1055094215 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8005490 con 0x7f51f80b9320 2024-05-08T04:21:03.961 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.957+0000 7f51fd928640 1 -- 172.21.15.104:0/1055094215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f81f4d70 con 0x7f51f80b9320 2024-05-08T04:21:03.962 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.957+0000 7f51dffff640 1 -- 172.21.15.104:0/1055094215 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8007260 con 0x7f51f80b9320 2024-05-08T04:21:03.962 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.957+0000 7f51fd928640 1 -- 172.21.15.104:0/1055094215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f81f5330 con 0x7f51f80b9320 2024-05-08T04:21:03.962 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.958+0000 7f51fd928640 1 -- 172.21.15.104:0/1055094215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f8068540 con 0x7f51f80b9320 2024-05-08T04:21:03.962 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.958+0000 7f51dffff640 1 -- 172.21.15.104:0/1055094215 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f51e8007400 con 0x7f51f80b9320 2024-05-08T04:21:03.962 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.959+0000 7f51dffff640 1 --2- 172.21.15.104:0/1055094215 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f51e406b4d0 0x7f51e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:03.962 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.959+0000 7f51f67fc640 1 --2- 172.21.15.104:0/1055094215 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f51e406b4d0 0x7f51e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:03.962 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.959+0000 7f51dffff640 1 -- 172.21.15.104:0/1055094215 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f51e8089390 con 0x7f51f80b9320 2024-05-08T04:21:03.962 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.959+0000 7f51f67fc640 1 --2- 172.21.15.104:0/1055094215 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f51e406b4d0 0x7f51e406d990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f51ec034000 tx=0x7f51ec02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:03.964 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:03.963+0000 7f51dffff640 1 -- 172.21.15.104:0/1055094215 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f51e8058560 con 0x7f51f80b9320 2024-05-08T04:21:04.135 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.134+0000 7f51fd928640 1 -- 172.21.15.104:0/1055094215 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51f80b8930 con 0x7f51f80b9320 2024-05-08T04:21:04.135 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.134+0000 7f51dffff640 1 -- 172.21.15.104:0/1055094215 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12944 (secure 0 0 0) 0x7f51e8057e60 con 0x7f51f80b9320 2024-05-08T04:21:04.136 INFO:teuthology.misc.health.smithi104.stdout: 2024-05-08T04:21:04.136 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":16,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:00.677071+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:04.138 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.136+0000 7f51fd928640 1 -- 172.21.15.104:0/1055094215 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f51e406b4d0 msgr2=0x7f51e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.138 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.136+0000 7f51fd928640 1 --2- 172.21.15.104:0/1055094215 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f51e406b4d0 0x7f51e406d990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f51ec034000 tx=0x7f51ec02e000 comp rx=0 tx=0).stop 2024-05-08T04:21:04.138 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.136+0000 7f51fd928640 1 -- 172.21.15.104:0/1055094215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51f80b9320 msgr2=0x7f51f8153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.138 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.136+0000 7f51fd928640 1 --2- 172.21.15.104:0/1055094215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51f80b9320 0x7f51f8153ea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f51e800c3c0 tx=0x7f51e800c880 comp rx=0 tx=0).stop 2024-05-08T04:21:04.138 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.136+0000 7f51fd928640 1 -- 172.21.15.104:0/1055094215 shutdown_connections 2024-05-08T04:21:04.138 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.136+0000 7f51fd928640 1 --2- 172.21.15.104:0/1055094215 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f51e406b4d0 0x7f51e406d990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.138 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.136+0000 7f51fd928640 1 --2- 172.21.15.104:0/1055094215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51f815dba0 0x7f51f81608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.138 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.136+0000 7f51fd928640 1 --2- 172.21.15.104:0/1055094215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51f80d1070 0x7f51f8160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.139 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.136+0000 7f51fd928640 1 --2- 172.21.15.104:0/1055094215 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51f80b9320 0x7f51f8153ea0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.139 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.136+0000 7f51fd928640 1 -- 172.21.15.104:0/1055094215 >> 172.21.15.104:0/1055094215 conn(0x7f51f8072690 msgr2=0x7f51f80c94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:04.139 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.137+0000 7f51fd928640 1 -- 172.21.15.104:0/1055094215 shutdown_connections 2024-05-08T04:21:04.139 INFO:teuthology.misc.health.smithi104.stderr:2024-05-08T04:21:04.137+0000 7f51fd928640 1 -- 172.21.15.104:0/1055094215 wait complete. 2024-05-08T04:21:04.147 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-08T04:21:04.148 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T04:21:04.148 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T04:21:04.148 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T04:21:04.150 INFO:tasks.ceph.mds.a:Started 2024-05-08T04:21:04.151 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T04:21:04.151 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T04:21:04.152 INFO:tasks.ceph.mds.c:Started 2024-05-08T04:21:04.153 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T04:21:04.153 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T04:21:04.155 INFO:tasks.ceph.mds.b:Started 2024-05-08T04:21:04.155 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T04:21:04.156 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T04:21:04.158 INFO:tasks.ceph.mds.d:Started 2024-05-08T04:21:04.158 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-08T04:21:04.161 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:04.225 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-05-08T04:21:04.226 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-05-08T04:21:04.241 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2024-05-08T04:21:04.242 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2024-05-08T04:21:04.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.264+0000 7f2d0de5d640 1 Processor -- start 2024-05-08T04:21:04.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.264+0000 7f2d0de5d640 1 -- start start 2024-05-08T04:21:04.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.265+0000 7f2d0de5d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2d0815de10 0x7f2d08161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.265+0000 7f2d0de5d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0815e1f0 con 0x7f2d080ce5a0 2024-05-08T04:21:04.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.265+0000 7f2d0de5d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d08162090 con 0x7f2d080d07c0 2024-05-08T04:21:04.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.265+0000 7f2d077fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2d0815de10 0x7f2d08161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.265+0000 7f2d06ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f2d080ce5a0 0x7f2d080d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:51908/0 (socket says 172.21.15.104:51908) 2024-05-08T04:21:04.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.265+0000 7f2d06ffd640 1 -- 172.21.15.104:0/2966243090 learned_addr learned my addr 172.21.15.104:0/2966243090 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:04.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.265+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2966243090 --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d080d0f50 con 0x7f2d0815de10 2024-05-08T04:21:04.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.266+0000 7f2d067fc640 1 -- 172.21.15.104:0/2966243090 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010219928 0 0) 0x7f2d0815e1f0 con 0x7f2d080ce5a0 2024-05-08T04:21:04.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.266+0000 7f2d067fc640 1 -- 172.21.15.104:0/2966243090 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf4003520 con 0x7f2d080ce5a0 2024-05-08T04:21:04.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.266+0000 7f2d077fe640 1 -- 172.21.15.104:0/2966243090 >> v1:172.21.15.183:6789/0 conn(0x7f2d080d07c0 legacy=0x7f2d080d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.266+0000 7f2d077fe640 1 -- 172.21.15.104:0/2966243090 >> v1:172.21.15.104:6789/0 conn(0x7f2d080ce5a0 legacy=0x7f2d080d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.266+0000 7f2d077fe640 1 -- 172.21.15.104:0/2966243090 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d08162370 con 0x7f2d0815de10 2024-05-08T04:21:04.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.266+0000 7f2d077fe640 1 --2- 172.21.15.104:0/2966243090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d0815de10 0x7f2d08161920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80097a0 tx=0x7f2cf802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa25129bc74107d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:04.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.267+0000 7f2d067fc640 1 -- 172.21.15.104:0/2966243090 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8037070 con 0x7f2d0815de10 2024-05-08T04:21:04.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.267+0000 7f2d067fc640 1 -- 172.21.15.104:0/2966243090 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf8032440 con 0x7f2d0815de10 2024-05-08T04:21:04.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.267+0000 7f2d067fc640 1 -- 172.21.15.104:0/2966243090 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8032810 con 0x7f2d0815de10 2024-05-08T04:21:04.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.267+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2966243090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d0815de10 msgr2=0x7f2d08161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.267+0000 7f2d0de5d640 1 --2- 172.21.15.104:0/2966243090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d0815de10 0x7f2d08161920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80097a0 tx=0x7f2cf802a1a0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.267+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2966243090 shutdown_connections 2024-05-08T04:21:04.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.267+0000 7f2d0de5d640 1 --2- 172.21.15.104:0/2966243090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d0815de10 0x7f2d08161920 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.267+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2966243090 >> 172.21.15.104:0/2966243090 conn(0x7f2d08072290 msgr2=0x7f2d08072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:04.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.267+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2966243090 shutdown_connections 2024-05-08T04:21:04.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.267+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2966243090 wait complete. 2024-05-08T04:21:04.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.268+0000 7f2d0de5d640 1 Processor -- start 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.269+0000 7f2d0de5d640 1 -- start start 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.269+0000 7f2d0de5d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d080ce5a0 0x7f2d081480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.269+0000 7f2d0de5d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d080d07c0 0x7f2d081605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.269+0000 7f2d0de5d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d0815de10 0x7f2d08160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.269+0000 7f2d0de5d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080d1a90 con 0x7f2d080d07c0 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.269+0000 7f2d0de5d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080d1ce0 con 0x7f2d0815de10 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.269+0000 7f2d0de5d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080b6dc0 con 0x7f2d080ce5a0 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.269+0000 7f2d06ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d080d07c0 0x7f2d081605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.269+0000 7f2d06ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d080d07c0 0x7f2d081605f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43794/0 (socket says 172.21.15.104:43794) 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.269+0000 7f2d06ffd640 1 -- 172.21.15.104:0/2613552667 learned_addr learned my addr 172.21.15.104:0/2613552667 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.269+0000 7f2d077fe640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d080ce5a0 0x7f2d081480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.269+0000 7f2d07fff640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d0815de10 0x7f2d08160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.270+0000 7f2d06ffd640 1 -- 172.21.15.104:0/2613552667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d080ce5a0 msgr2=0x7f2d081480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.270+0000 7f2d06ffd640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d080ce5a0 0x7f2d081480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.270+0000 7f2d06ffd640 1 -- 172.21.15.104:0/2613552667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d0815de10 msgr2=0x7f2d08160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.270+0000 7f2d06ffd640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d0815de10 0x7f2d08160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.270+0000 7f2d06ffd640 1 -- 172.21.15.104:0/2613552667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d080c7880 con 0x7f2d080d07c0 2024-05-08T04:21:04.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.270+0000 7f2d06ffd640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d080d07c0 0x7f2d081605f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000c500 tx=0x7f2cf000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:04.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.270+0000 7f2cfffff640 1 -- 172.21.15.104:0/2613552667 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0017070 con 0x7f2d080d07c0 2024-05-08T04:21:04.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.270+0000 7f2cfffff640 1 -- 172.21.15.104:0/2613552667 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf0005ce0 con 0x7f2d080d07c0 2024-05-08T04:21:04.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.270+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2613552667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d080c7b60 con 0x7f2d080d07c0 2024-05-08T04:21:04.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.270+0000 7f2cfffff640 1 -- 172.21.15.104:0/2613552667 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0007330 con 0x7f2d080d07c0 2024-05-08T04:21:04.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.270+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2613552667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d080c8120 con 0x7f2d080d07c0 2024-05-08T04:21:04.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.271+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2613552667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d08075010 con 0x7f2d080d07c0 2024-05-08T04:21:04.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.272+0000 7f2cfffff640 1 -- 172.21.15.104:0/2613552667 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2cf001a070 con 0x7f2d080d07c0 2024-05-08T04:21:04.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.272+0000 7f2cfffff640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2ce806b4d0 0x7f2ce806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.272+0000 7f2cfffff640 1 -- 172.21.15.104:0/2613552667 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2cf0089290 con 0x7f2d080d07c0 2024-05-08T04:21:04.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.272+0000 7f2d077fe640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2ce806b4d0 0x7f2ce806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.273+0000 7f2d077fe640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2ce806b4d0 0x7f2ce806d990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8034000 tx=0x7f2cf802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:04.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.276+0000 7f2cfffff640 1 -- 172.21.15.104:0/2613552667 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2cf0057ed0 con 0x7f2d080d07c0 2024-05-08T04:21:04.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.450+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2613552667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d080744b0 con 0x7f2d080d07c0 2024-05-08T04:21:04.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.450+0000 7f2cfffff640 1 -- 172.21.15.104:0/2613552667 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12944 (secure 0 0 0) 0x7f2cf005bf70 con 0x7f2d080d07c0 2024-05-08T04:21:04.452 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:04.452 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":16,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:00.677071+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:04.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.452+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2613552667 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2ce806b4d0 msgr2=0x7f2ce806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.452+0000 7f2d0de5d640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2ce806b4d0 0x7f2ce806d990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8034000 tx=0x7f2cf802e000 comp rx=0 tx=0).stop 2024-05-08T04:21:04.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.452+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2613552667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d080d07c0 msgr2=0x7f2d081605f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.452+0000 7f2d0de5d640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d080d07c0 0x7f2d081605f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000c500 tx=0x7f2cf000c9c0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.452+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2613552667 shutdown_connections 2024-05-08T04:21:04.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.452+0000 7f2d0de5d640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2ce806b4d0 0x7f2ce806d990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.452+0000 7f2d0de5d640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d0815de10 0x7f2d08160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.452+0000 7f2d0de5d640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d080d07c0 0x7f2d081605f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.452+0000 7f2d0de5d640 1 --2- 172.21.15.104:0/2613552667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d080ce5a0 0x7f2d081480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.452+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2613552667 >> 172.21.15.104:0/2613552667 conn(0x7f2d08072290 msgr2=0x7f2d080b8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:04.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.452+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2613552667 shutdown_connections 2024-05-08T04:21:04.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.453+0000 7f2d0de5d640 1 -- 172.21.15.104:0/2613552667 wait complete. 2024-05-08T04:21:04.464 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:04.465 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:04.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.565+0000 7f38815f4640 1 Processor -- start 2024-05-08T04:21:04.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.565+0000 7f38815f4640 1 -- start start 2024-05-08T04:21:04.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.566+0000 7f38815f4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cd9e0 0x7f387c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.566+0000 7f38815f4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f387c15e330 0x7f387c15e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.566+0000 7f38815f4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387c0caab0 con 0x7f387c06ff50 2024-05-08T04:21:04.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.566+0000 7f38815f4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c0ae540 con 0x7f387c15e330 2024-05-08T04:21:04.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.566+0000 7f38815f4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0cad90 con 0x7f387c0cd9e0 2024-05-08T04:21:04.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.567+0000 7f38727fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cd9e0 0x7f387c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.567+0000 7f387b7fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f387c15e330 0x7f387c15e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.567+0000 7f38727fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cd9e0 0x7f387c0ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:57840/0 (socket says 172.21.15.104:57840) 2024-05-08T04:21:04.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.567+0000 7f38727fc640 1 -- 172.21.15.104:0/656775681 learned_addr learned my addr 172.21.15.104:0/656775681 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:04.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.567+0000 7f387affd640 1 --1- 172.21.15.104:0/656775681 >> v1:172.21.15.183:6789/0 conn(0x7f387c06ff50 0x7f387c06bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:32866/0 (socket says 172.21.15.104:32866) 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.567+0000 7f38727fc640 1 -- 172.21.15.104:0/656775681 >> v2:172.21.15.183:3300/0 conn(0x7f387c15e330 msgr2=0x7f387c15e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.567+0000 7f38727fc640 1 --2- 172.21.15.104:0/656775681 >> v2:172.21.15.183:3300/0 conn(0x7f387c15e330 0x7f387c15e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.567+0000 7f38727fc640 1 -- 172.21.15.104:0/656775681 >> v1:172.21.15.183:6789/0 conn(0x7f387c06ff50 legacy=0x7f387c06bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.567+0000 7f38727fc640 1 -- 172.21.15.104:0/656775681 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c0cb070 con 0x7f387c0cd9e0 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.568+0000 7f38727fc640 1 --2- 172.21.15.104:0/656775681 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cd9e0 0x7f387c0ca460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3864009870 tx=0x7f386402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77fb5fd950b7c4b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.568+0000 7f387a7fc640 1 -- 172.21.15.104:0/656775681 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864037070 con 0x7f387c0cd9e0 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.568+0000 7f387a7fc640 1 -- 172.21.15.104:0/656775681 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3864032440 con 0x7f387c0cd9e0 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.568+0000 7f387a7fc640 1 -- 172.21.15.104:0/656775681 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3864032810 con 0x7f387c0cd9e0 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.568+0000 7f38815f4640 1 -- 172.21.15.104:0/656775681 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cd9e0 msgr2=0x7f387c0ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.568+0000 7f38815f4640 1 --2- 172.21.15.104:0/656775681 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cd9e0 0x7f387c0ca460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3864009870 tx=0x7f386402a270 comp rx=0 tx=0).stop 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.568+0000 7f38815f4640 1 -- 172.21.15.104:0/656775681 shutdown_connections 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.568+0000 7f38815f4640 1 --2- 172.21.15.104:0/656775681 >> v2:172.21.15.183:3300/0 conn(0x7f387c15e330 0x7f387c15e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.568+0000 7f38815f4640 1 --2- 172.21.15.104:0/656775681 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cd9e0 0x7f387c0ca460 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.568+0000 7f38815f4640 1 -- 172.21.15.104:0/656775681 >> 172.21.15.104:0/656775681 conn(0x7f387c0cc890 msgr2=0x7f387c0ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:04.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.568+0000 7f38815f4640 1 -- 172.21.15.104:0/656775681 shutdown_connections 2024-05-08T04:21:04.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.568+0000 7f38815f4640 1 -- 172.21.15.104:0/656775681 wait complete. 2024-05-08T04:21:04.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.569+0000 7f38815f4640 1 Processor -- start 2024-05-08T04:21:04.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.570+0000 7f38815f4640 1 -- start start 2024-05-08T04:21:04.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.570+0000 7f38815f4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f387c06ff50 0x7f387c0b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.570+0000 7f38815f4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cd9e0 0x7f387c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.570+0000 7f38815f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f387c15e330 0x7f387c1e48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.570+0000 7f38815f4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c151050 con 0x7f387c15e330 2024-05-08T04:21:04.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.570+0000 7f38815f4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c070330 con 0x7f387c06ff50 2024-05-08T04:21:04.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.570+0000 7f38815f4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c1511d0 con 0x7f387c0cd9e0 2024-05-08T04:21:04.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.570+0000 7f387b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f387c15e330 0x7f387c1e48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.570+0000 7f387b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f387c15e330 0x7f387c1e48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43810/0 (socket says 172.21.15.104:43810) 2024-05-08T04:21:04.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.570+0000 7f387b7fe640 1 -- 172.21.15.104:0/3688920640 learned_addr learned my addr 172.21.15.104:0/3688920640 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:04.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.571+0000 7f387affd640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f387c06ff50 0x7f387c0b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.571+0000 7f38727fc640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cd9e0 0x7f387c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.571+0000 7f387b7fe640 1 -- 172.21.15.104:0/3688920640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cd9e0 msgr2=0x7f387c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.571+0000 7f387b7fe640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cd9e0 0x7f387c099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.571+0000 7f387b7fe640 1 -- 172.21.15.104:0/3688920640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f387c06ff50 msgr2=0x7f387c0b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.571+0000 7f387b7fe640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f387c06ff50 0x7f387c0b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.571+0000 7f387b7fe640 1 -- 172.21.15.104:0/3688920640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c0b3790 con 0x7f387c15e330 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.571+0000 7f387b7fe640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f387c15e330 0x7f387c1e48b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3874009d30 tx=0x7f387400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.571+0000 7f3873fff640 1 -- 172.21.15.104:0/3688920640 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874018020 con 0x7f387c15e330 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.571+0000 7f3873fff640 1 -- 172.21.15.104:0/3688920640 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3874014480 con 0x7f387c15e330 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.571+0000 7f3873fff640 1 -- 172.21.15.104:0/3688920640 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874014870 con 0x7f387c15e330 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.571+0000 7f38815f4640 1 -- 172.21.15.104:0/3688920640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c0b3a70 con 0x7f387c15e330 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.571+0000 7f38815f4640 1 -- 172.21.15.104:0/3688920640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c0b4030 con 0x7f387c15e330 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.572+0000 7f38815f4640 1 -- 172.21.15.104:0/3688920640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387c0b4230 con 0x7f387c15e330 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.573+0000 7f3873fff640 1 -- 172.21.15.104:0/3688920640 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3874005d10 con 0x7f387c15e330 2024-05-08T04:21:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.573+0000 7f3873fff640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f385c06b4d0 0x7f385c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.573+0000 7f3873fff640 1 -- 172.21.15.104:0/3688920640 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f387408a7a0 con 0x7f387c15e330 2024-05-08T04:21:04.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.573+0000 7f387affd640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f385c06b4d0 0x7f385c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.573+0000 7f387affd640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f385c06b4d0 0x7f385c06d990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f386c007fd0 tx=0x7f386c007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:04.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.577+0000 7f3873fff640 1 -- 172.21.15.104:0/3688920640 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f387c0b4230 con 0x7f387c15e330 2024-05-08T04:21:04.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.748+0000 7f38815f4640 1 -- 172.21.15.104:0/3688920640 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f387c075010 con 0x7f387c15e330 2024-05-08T04:21:04.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.748+0000 7f3873fff640 1 -- 172.21.15.104:0/3688920640 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3874022070 con 0x7f387c15e330 2024-05-08T04:21:04.751 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:04.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.750+0000 7f38815f4640 1 -- 172.21.15.104:0/3688920640 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f385c06b4d0 msgr2=0x7f385c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.750+0000 7f38815f4640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f385c06b4d0 0x7f385c06d990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f386c007fd0 tx=0x7f386c007e80 comp rx=0 tx=0).stop 2024-05-08T04:21:04.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.750+0000 7f38815f4640 1 -- 172.21.15.104:0/3688920640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f387c15e330 msgr2=0x7f387c1e48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.750+0000 7f38815f4640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f387c15e330 0x7f387c1e48b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3874009d30 tx=0x7f387400c490 comp rx=0 tx=0).stop 2024-05-08T04:21:04.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.750+0000 7f38815f4640 1 -- 172.21.15.104:0/3688920640 shutdown_connections 2024-05-08T04:21:04.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.750+0000 7f38815f4640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f385c06b4d0 0x7f385c06d990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.750+0000 7f38815f4640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f387c15e330 0x7f387c1e48b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.750+0000 7f38815f4640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cd9e0 0x7f387c099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.750+0000 7f38815f4640 1 --2- 172.21.15.104:0/3688920640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f387c06ff50 0x7f387c0b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.750+0000 7f38815f4640 1 -- 172.21.15.104:0/3688920640 >> 172.21.15.104:0/3688920640 conn(0x7f387c0cc890 msgr2=0x7f387c0ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:04.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.751+0000 7f38815f4640 1 -- 172.21.15.104:0/3688920640 shutdown_connections 2024-05-08T04:21:04.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.751+0000 7f38815f4640 1 -- 172.21.15.104:0/3688920640 wait complete. 2024-05-08T04:21:04.762 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:21:04.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.861+0000 7f02c32fc640 1 Processor -- start 2024-05-08T04:21:04.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.861+0000 7f02c32fc640 1 -- start start 2024-05-08T04:21:04.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02c32fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc15dad0 0x7f02bc0d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02c32fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f02bc0b5b90 0x7f02bc0b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02c32fc640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc0b9920 con 0x7f02bc0d35c0 2024-05-08T04:21:04.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02c32fc640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02bc0d2520 con 0x7f02bc0b5b90 2024-05-08T04:21:04.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02c32fc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0d2800 con 0x7f02bc15dad0 2024-05-08T04:21:04.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02c0897640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f02bc0d35c0 0x7f02bc0b5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:51924/0 (socket says 172.21.15.104:51924) 2024-05-08T04:21:04.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02c0897640 1 -- 172.21.15.104:0/1506682021 learned_addr learned my addr 172.21.15.104:0/1506682021 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:04.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02c1098640 1 --2- 172.21.15.104:0/1506682021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc15dad0 0x7f02bc0d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02c1899640 1 --2- 172.21.15.104:0/1506682021 >> v2:172.21.15.183:3300/0 conn(0x7f02bc0b5b90 0x7f02bc0b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071160646 0 0) 0x7f02bc0b9920 con 0x7f02bc0d35c0 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a8003520 con 0x7f02bc0d35c0 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3206836605 0 0) 0x7f02a8003520 con 0x7f02bc0d35c0 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc15dad0 msgr2=0x7f02bc0d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02b3fff640 1 --2- 172.21.15.104:0/1506682021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc15dad0 0x7f02bc0d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 >> v2:172.21.15.183:3300/0 conn(0x7f02bc0b5b90 msgr2=0x7f02bc0b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02b3fff640 1 --2- 172.21.15.104:0/1506682021 >> v2:172.21.15.183:3300/0 conn(0x7f02bc0b5b90 0x7f02bc0b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc0d2ae0 con 0x7f02bc0d35c0 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f02ac001690 con 0x7f02bc0d35c0 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 >> v1:172.21.15.104:6789/0 conn(0x7f02bc0d35c0 legacy=0x7f02bc0b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.862+0000 7f02b3fff640 1 --2- 172.21.15.104:0/1506682021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a80039b0 0x7f02a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02b3fff640 1 --2- 172.21.15.104:0/1506682021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02a8004800 0x7f02a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02b3fff640 1 --2- 172.21.15.104:0/1506682021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc15dad0 0x7f02a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0d2520 con 0x7f02a8004800 2024-05-08T04:21:04.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0d2800 con 0x7f02a80039b0 2024-05-08T04:21:04.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a800b9c0 con 0x7f02bc15dad0 2024-05-08T04:21:04.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02c0897640 1 --2- 172.21.15.104:0/1506682021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02a8004800 0x7f02a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02c1098640 1 --2- 172.21.15.104:0/1506682021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a80039b0 0x7f02a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02c1899640 1 --2- 172.21.15.104:0/1506682021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc15dad0 0x7f02a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02c0897640 1 -- 172.21.15.104:0/1506682021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc15dad0 msgr2=0x7f02a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:04.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02c0897640 1 --2- 172.21.15.104:0/1506682021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc15dad0 0x7f02a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02c0897640 1 -- 172.21.15.104:0/1506682021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a80039b0 msgr2=0x7f02a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:04.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02c0897640 1 --2- 172.21.15.104:0/1506682021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a80039b0 0x7f02a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02c0897640 1 -- 172.21.15.104:0/1506682021 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a8003520 con 0x7f02a8004800 2024-05-08T04:21:04.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.863+0000 7f02c1899640 1 --2- 172.21.15.104:0/1506682021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc15dad0 0x7f02a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:04.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.864+0000 7f02c0897640 1 --2- 172.21.15.104:0/1506682021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02a8004800 0x7f02a8004c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00c240 tx=0x7f02a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c0f573db63129d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:04.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.864+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac007d70 con 0x7f02a8004800 2024-05-08T04:21:04.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.864+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac005ad0 con 0x7f02a8004800 2024-05-08T04:21:04.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.864+0000 7f02b3fff640 1 -- 172.21.15.104:0/1506682021 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac007070 con 0x7f02a8004800 2024-05-08T04:21:04.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.864+0000 7f02c32fc640 1 -- 172.21.15.104:0/1506682021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02a8004800 msgr2=0x7f02a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.864+0000 7f02c32fc640 1 --2- 172.21.15.104:0/1506682021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02a8004800 0x7f02a8004c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00c240 tx=0x7f02a8005830 comp rx=0 tx=0).stop 2024-05-08T04:21:04.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.864+0000 7f02c1899640 1 -- 172.21.15.104:0/1506682021 reap_dead start 2024-05-08T04:21:04.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.864+0000 7f02c32fc640 1 -- 172.21.15.104:0/1506682021 shutdown_connections 2024-05-08T04:21:04.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.864+0000 7f02c32fc640 1 -- 172.21.15.104:0/1506682021 >> 172.21.15.104:0/1506682021 conn(0x7f02bc06c650 msgr2=0x7f02bc0d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:04.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.864+0000 7f02c32fc640 1 -- 172.21.15.104:0/1506682021 shutdown_connections 2024-05-08T04:21:04.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.864+0000 7f02c32fc640 1 -- 172.21.15.104:0/1506682021 wait complete. 2024-05-08T04:21:04.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.865+0000 7f02c32fc640 1 Processor -- start 2024-05-08T04:21:04.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.866+0000 7f02c32fc640 1 -- start start 2024-05-08T04:21:04.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.866+0000 7f02c32fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a8004800 0x7f02bc149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.866+0000 7f02c32fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc1f3510 0x7f02bc156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.866+0000 7f02c32fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02bc1f3990 0x7f02bc156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.866+0000 7f02c32fc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc15deb0 con 0x7f02bc1f3990 2024-05-08T04:21:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.866+0000 7f02c32fc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0d30a0 con 0x7f02a8004800 2024-05-08T04:21:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.866+0000 7f02c32fc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc15e030 con 0x7f02bc1f3510 2024-05-08T04:21:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.866+0000 7f02c1899640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02bc1f3990 0x7f02bc156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.866+0000 7f02c1899640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02bc1f3990 0x7f02bc156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43834/0 (socket says 172.21.15.104:43834) 2024-05-08T04:21:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.866+0000 7f02c1899640 1 -- 172.21.15.104:0/1409507023 learned_addr learned my addr 172.21.15.104:0/1409507023 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.866+0000 7f02c0897640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc1f3510 0x7f02bc156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.866+0000 7f02c1098640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a8004800 0x7f02bc149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.867+0000 7f02c1899640 1 -- 172.21.15.104:0/1409507023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc1f3510 msgr2=0x7f02bc156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.867+0000 7f02c1899640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc1f3510 0x7f02bc156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.867+0000 7f02c1899640 1 -- 172.21.15.104:0/1409507023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a8004800 msgr2=0x7f02bc149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.867+0000 7f02c1899640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a8004800 0x7f02bc149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.867+0000 7f02c1899640 1 -- 172.21.15.104:0/1409507023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc0cab70 con 0x7f02bc1f3990 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.867+0000 7f02c1899640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02bc1f3990 0x7f02bc156d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0cf890 tx=0x7f02b4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.867+0000 7f02b1ffb640 1 -- 172.21.15.104:0/1409507023 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b401a030 con 0x7f02bc1f3990 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.867+0000 7f02b1ffb640 1 -- 172.21.15.104:0/1409507023 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b4010e80 con 0x7f02bc1f3990 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.867+0000 7f02c32fc640 1 -- 172.21.15.104:0/1409507023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc0cade0 con 0x7f02bc1f3990 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.867+0000 7f02b1ffb640 1 -- 172.21.15.104:0/1409507023 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4003bd0 con 0x7f02bc1f3990 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.867+0000 7f02c32fc640 1 -- 172.21.15.104:0/1409507023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc0cb3a0 con 0x7f02bc1f3990 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.868+0000 7f02c32fc640 1 -- 172.21.15.104:0/1409507023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc075010 con 0x7f02bc1f3990 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.868+0000 7f02b1ffb640 1 -- 172.21.15.104:0/1409507023 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f02b4005d10 con 0x7f02bc1f3990 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.869+0000 7f02b1ffb640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f02a006b4d0 0x7f02a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.869+0000 7f02b1ffb640 1 -- 172.21.15.104:0/1409507023 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f02b408a630 con 0x7f02bc1f3990 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.869+0000 7f02c1098640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f02a006b4d0 0x7f02a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:04.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.869+0000 7f02c1098640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f02a006b4d0 0x7f02a006d990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02b80099c0 tx=0x7f02b8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:04.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:04.873+0000 7f02b1ffb640 1 -- 172.21.15.104:0/1409507023 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f02b4025020 con 0x7f02bc1f3990 2024-05-08T04:21:05.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.082+0000 7f02c32fc640 1 -- 172.21.15.104:0/1409507023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02bc0d2090 con 0x7f02bc1f3990 2024-05-08T04:21:05.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.083+0000 7f02b1ffb640 1 -- 172.21.15.104:0/1409507023 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f02b4059890 con 0x7f02bc1f3990 2024-05-08T04:21:05.084 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:05.084 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/1820805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1820805788},{"type":"v1","addr":"172.21.15.104:6836","nonce":1820805788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-05-08T04:21:05.084 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 2 2024-05-08T04:21:05.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.085+0000 7f02c32fc640 1 -- 172.21.15.104:0/1409507023 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f02a006b4d0 msgr2=0x7f02a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:05.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.085+0000 7f02c32fc640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f02a006b4d0 0x7f02a006d990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f02b80099c0 tx=0x7f02b8008040 comp rx=0 tx=0).stop 2024-05-08T04:21:05.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.085+0000 7f02c32fc640 1 -- 172.21.15.104:0/1409507023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02bc1f3990 msgr2=0x7f02bc156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:05.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.085+0000 7f02c32fc640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02bc1f3990 0x7f02bc156d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0cf890 tx=0x7f02b4009f90 comp rx=0 tx=0).stop 2024-05-08T04:21:05.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.085+0000 7f02c32fc640 1 -- 172.21.15.104:0/1409507023 shutdown_connections 2024-05-08T04:21:05.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.085+0000 7f02c32fc640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f02a006b4d0 0x7f02a006d990 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:05.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.085+0000 7f02c32fc640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02bc1f3990 0x7f02bc156d40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:05.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.085+0000 7f02c32fc640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02bc1f3510 0x7f02bc156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:05.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.085+0000 7f02c32fc640 1 --2- 172.21.15.104:0/1409507023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02a8004800 0x7f02bc149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:05.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.085+0000 7f02c32fc640 1 -- 172.21.15.104:0/1409507023 >> 172.21.15.104:0/1409507023 conn(0x7f02bc06c650 msgr2=0x7f02bc15b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:05.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.085+0000 7f02c32fc640 1 -- 172.21.15.104:0/1409507023 shutdown_connections 2024-05-08T04:21:05.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:05.085+0000 7f02c32fc640 1 -- 172.21.15.104:0/1409507023 wait complete. 2024-05-08T04:21:07.097 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:21:07.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.208+0000 7f907d9e0640 1 Processor -- start 2024-05-08T04:21:07.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.208+0000 7f907d9e0640 1 -- start start 2024-05-08T04:21:07.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.209+0000 7f907d9e0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f90780b6c90 0x7f90780cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.209+0000 7f907d9e0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90780ce920 0x7f907815e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.209+0000 7f907d9e0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90780d1610 con 0x7f90780d0d20 2024-05-08T04:21:07.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.209+0000 7f907d9e0640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90780cfee0 con 0x7f90780b6c90 2024-05-08T04:21:07.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.209+0000 7f907d9e0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90780d01c0 con 0x7f90780ce920 2024-05-08T04:21:07.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.209+0000 7f9076ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f90780b6c90 0x7f90780cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.209+0000 7f9076ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f90780b6c90 0x7f90780cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43838/0 (socket says 172.21.15.104:43838) 2024-05-08T04:21:07.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.209+0000 7f9076ffd640 1 -- 172.21.15.104:0/3764081874 learned_addr learned my addr 172.21.15.104:0/3764081874 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:07.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.209+0000 7f9076ffd640 1 -- 172.21.15.104:0/3764081874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90780ce920 msgr2=0x7f907815e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:07.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.209+0000 7f9076ffd640 1 --2- 172.21.15.104:0/3764081874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90780ce920 0x7f907815e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.209+0000 7f9076ffd640 1 -- 172.21.15.104:0/3764081874 >> v1:172.21.15.183:6789/0 conn(0x7f90780d0d20 legacy=0x7f90780ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:07.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.209+0000 7f9076ffd640 1 -- 172.21.15.104:0/3764081874 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90780d04a0 con 0x7f90780b6c90 2024-05-08T04:21:07.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.210+0000 7f9076ffd640 1 --2- 172.21.15.104:0/3764081874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90780b6c90 0x7f90780cf900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f90780b4430 tx=0x7f906802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4ce2dc7a51c027 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:07.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.210+0000 7f90767fc640 1 -- 172.21.15.104:0/3764081874 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068037070 con 0x7f90780b6c90 2024-05-08T04:21:07.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.210+0000 7f90767fc640 1 -- 172.21.15.104:0/3764081874 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068032440 con 0x7f90780b6c90 2024-05-08T04:21:07.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.210+0000 7f90767fc640 1 -- 172.21.15.104:0/3764081874 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068032810 con 0x7f90780b6c90 2024-05-08T04:21:07.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.210+0000 7f907d9e0640 1 -- 172.21.15.104:0/3764081874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90780b6c90 msgr2=0x7f90780cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.210+0000 7f907d9e0640 1 --2- 172.21.15.104:0/3764081874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90780b6c90 0x7f90780cf900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f90780b4430 tx=0x7f906802a290 comp rx=0 tx=0).stop 2024-05-08T04:21:07.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.211+0000 7f907d9e0640 1 -- 172.21.15.104:0/3764081874 shutdown_connections 2024-05-08T04:21:07.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.211+0000 7f907d9e0640 1 --2- 172.21.15.104:0/3764081874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90780ce920 0x7f907815e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.211+0000 7f907d9e0640 1 --2- 172.21.15.104:0/3764081874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90780b6c90 0x7f90780cf900 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.211+0000 7f907d9e0640 1 -- 172.21.15.104:0/3764081874 >> 172.21.15.104:0/3764081874 conn(0x7f907806f480 msgr2=0x7f907806f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:07.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.211+0000 7f907d9e0640 1 -- 172.21.15.104:0/3764081874 shutdown_connections 2024-05-08T04:21:07.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.211+0000 7f907d9e0640 1 -- 172.21.15.104:0/3764081874 wait complete. 2024-05-08T04:21:07.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.212+0000 7f907d9e0640 1 Processor -- start 2024-05-08T04:21:07.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.212+0000 7f907d9e0640 1 -- start start 2024-05-08T04:21:07.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f907d9e0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90780b6c90 0x7f90780c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f907d9e0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90780ce920 0x7f90780aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f907d9e0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90780d0d20 0x7f9078152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f907d9e0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907815eaf0 con 0x7f90780d0d20 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f907d9e0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90780b4880 con 0x7f90780ce920 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f907d9e0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907815ec70 con 0x7f90780b6c90 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f90777fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90780d0d20 0x7f9078152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f90777fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90780d0d20 0x7f9078152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43844/0 (socket says 172.21.15.104:43844) 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f90777fe640 1 -- 172.21.15.104:0/1799966322 learned_addr learned my addr 172.21.15.104:0/1799966322 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f9076ffd640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90780b6c90 0x7f90780c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f906e7fc640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90780ce920 0x7f90780aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f90777fe640 1 -- 172.21.15.104:0/1799966322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90780b6c90 msgr2=0x7f90780c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f90777fe640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90780b6c90 0x7f90780c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f90777fe640 1 -- 172.21.15.104:0/1799966322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90780ce920 msgr2=0x7f90780aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f90777fe640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90780ce920 0x7f90780aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f90777fe640 1 -- 172.21.15.104:0/1799966322 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90780a8870 con 0x7f90780d0d20 2024-05-08T04:21:07.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f90777fe640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90780d0d20 0x7f9078152c40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f907000b9a0 tx=0x7f907000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:07.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f9074ff9640 1 -- 172.21.15.104:0/1799966322 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070019070 con 0x7f90780d0d20 2024-05-08T04:21:07.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.213+0000 7f9074ff9640 1 -- 172.21.15.104:0/1799966322 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907000cbc0 con 0x7f90780d0d20 2024-05-08T04:21:07.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.214+0000 7f907d9e0640 1 -- 172.21.15.104:0/1799966322 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90780a8b50 con 0x7f90780d0d20 2024-05-08T04:21:07.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.214+0000 7f9074ff9640 1 -- 172.21.15.104:0/1799966322 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070014440 con 0x7f90780d0d20 2024-05-08T04:21:07.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.214+0000 7f907d9e0640 1 -- 172.21.15.104:0/1799966322 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90780a9110 con 0x7f90780d0d20 2024-05-08T04:21:07.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.215+0000 7f907d9e0640 1 -- 172.21.15.104:0/1799966322 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9078075010 con 0x7f90780d0d20 2024-05-08T04:21:07.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.215+0000 7f9074ff9640 1 -- 172.21.15.104:0/1799966322 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f907001c070 con 0x7f90780d0d20 2024-05-08T04:21:07.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.215+0000 7f9074ff9640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f905806b4d0 0x7f905806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.215+0000 7f9074ff9640 1 -- 172.21.15.104:0/1799966322 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9070089b80 con 0x7f90780d0d20 2024-05-08T04:21:07.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.215+0000 7f9076ffd640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f905806b4d0 0x7f905806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.216+0000 7f9076ffd640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f905806b4d0 0x7f905806d990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9068034000 tx=0x7f906802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:07.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.220+0000 7f9074ff9640 1 -- 172.21.15.104:0/1799966322 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9070058700 con 0x7f90780d0d20 2024-05-08T04:21:07.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.428+0000 7f907d9e0640 1 -- 172.21.15.104:0/1799966322 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9078068090 con 0x7f90780d0d20 2024-05-08T04:21:07.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.429+0000 7f9074ff9640 1 -- 172.21.15.104:0/1799966322 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7f907005c7a0 con 0x7f90780d0d20 2024-05-08T04:21:07.430 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:07.430 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/446112297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":446112297},{"type":"v1","addr":"172.21.15.183:6834","nonce":446112297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/702726775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":702726775},{"type":"v1","addr":"172.21.15.183:6835","nonce":702726775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/1820805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1820805788},{"type":"v1","addr":"172.21.15.104:6836","nonce":1820805788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/610189872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":610189872},{"type":"v1","addr":"172.21.15.104:6837","nonce":610189872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-05-08T04:21:07.431 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 3 2024-05-08T04:21:07.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.431+0000 7f907d9e0640 1 -- 172.21.15.104:0/1799966322 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f905806b4d0 msgr2=0x7f905806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.431+0000 7f907d9e0640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f905806b4d0 0x7f905806d990 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9068034000 tx=0x7f906802e000 comp rx=0 tx=0).stop 2024-05-08T04:21:07.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.431+0000 7f907d9e0640 1 -- 172.21.15.104:0/1799966322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90780d0d20 msgr2=0x7f9078152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.431+0000 7f907d9e0640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90780d0d20 0x7f9078152c40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f907000b9a0 tx=0x7f907000be60 comp rx=0 tx=0).stop 2024-05-08T04:21:07.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.431+0000 7f907d9e0640 1 -- 172.21.15.104:0/1799966322 shutdown_connections 2024-05-08T04:21:07.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.431+0000 7f907d9e0640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f905806b4d0 0x7f905806d990 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.431+0000 7f907d9e0640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90780ce920 0x7f90780aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.431+0000 7f907d9e0640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90780d0d20 0x7f9078152c40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.431+0000 7f907d9e0640 1 --2- 172.21.15.104:0/1799966322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90780b6c90 0x7f90780c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.431+0000 7f907d9e0640 1 -- 172.21.15.104:0/1799966322 >> 172.21.15.104:0/1799966322 conn(0x7f907806f480 msgr2=0x7f90780c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:07.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.431+0000 7f907d9e0640 1 -- 172.21.15.104:0/1799966322 shutdown_connections 2024-05-08T04:21:07.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.431+0000 7f907d9e0640 1 -- 172.21.15.104:0/1799966322 wait complete. 2024-05-08T04:21:07.443 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:07.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.542+0000 7f50467ee640 1 Processor -- start 2024-05-08T04:21:07.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.542+0000 7f50467ee640 1 -- start start 2024-05-08T04:21:07.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.542+0000 7f50467ee640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f504015bcd0 0x7f50400cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.542+0000 7f50467ee640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f50401601a0 0x7f50400cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.542+0000 7f50467ee640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50401606d0 con 0x7f50400cd940 2024-05-08T04:21:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.542+0000 7f50467ee640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50400cc410 con 0x7f504015bcd0 2024-05-08T04:21:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.542+0000 7f50467ee640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5040070450 con 0x7f50401601a0 2024-05-08T04:21:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.543+0000 7f503ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f504015bcd0 0x7f50400cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.543+0000 7f5044d8b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f50400cd940 0x7f5040099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:40360/0 (socket says 172.21.15.104:40360) 2024-05-08T04:21:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.543+0000 7f5044d8b640 1 -- 172.21.15.104:0/3241173885 learned_addr learned my addr 172.21.15.104:0/3241173885 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.543+0000 7f5037fff640 1 --2- 172.21.15.104:0/3241173885 >> v2:172.21.15.183:3300/0 conn(0x7f50401601a0 0x7f50400cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.543+0000 7f503ffff640 1 -- 172.21.15.104:0/3241173885 >> v2:172.21.15.183:3300/0 conn(0x7f50401601a0 msgr2=0x7f50400cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.543+0000 7f503ffff640 1 --2- 172.21.15.104:0/3241173885 >> v2:172.21.15.183:3300/0 conn(0x7f50401601a0 0x7f50400cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.543+0000 7f503ffff640 1 -- 172.21.15.104:0/3241173885 >> v1:172.21.15.104:6789/0 conn(0x7f50400cd940 legacy=0x7f5040099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.543+0000 7f503ffff640 1 -- 172.21.15.104:0/3241173885 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504015c0b0 con 0x7f504015bcd0 2024-05-08T04:21:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.543+0000 7f503ffff640 1 --2- 172.21.15.104:0/3241173885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f504015bcd0 0x7f50400cf700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5040072a00 tx=0x7f503002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9fc8c367ee824a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:07.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.544+0000 7f503f7fe640 1 -- 172.21.15.104:0/3241173885 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030037070 con 0x7f504015bcd0 2024-05-08T04:21:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.544+0000 7f503f7fe640 1 -- 172.21.15.104:0/3241173885 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5030032440 con 0x7f504015bcd0 2024-05-08T04:21:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.544+0000 7f503f7fe640 1 -- 172.21.15.104:0/3241173885 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030032810 con 0x7f504015bcd0 2024-05-08T04:21:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.544+0000 7f50467ee640 1 -- 172.21.15.104:0/3241173885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f504015bcd0 msgr2=0x7f50400cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.544+0000 7f50467ee640 1 --2- 172.21.15.104:0/3241173885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f504015bcd0 0x7f50400cf700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5040072a00 tx=0x7f503002a1a0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.544+0000 7f50467ee640 1 -- 172.21.15.104:0/3241173885 shutdown_connections 2024-05-08T04:21:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.544+0000 7f50467ee640 1 --2- 172.21.15.104:0/3241173885 >> v2:172.21.15.183:3300/0 conn(0x7f50401601a0 0x7f50400cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.544+0000 7f50467ee640 1 --2- 172.21.15.104:0/3241173885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f504015bcd0 0x7f50400cf700 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.544+0000 7f50467ee640 1 -- 172.21.15.104:0/3241173885 >> 172.21.15.104:0/3241173885 conn(0x7f50400b32f0 msgr2=0x7f50400b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.544+0000 7f50467ee640 1 -- 172.21.15.104:0/3241173885 shutdown_connections 2024-05-08T04:21:07.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.544+0000 7f50467ee640 1 -- 172.21.15.104:0/3241173885 wait complete. 2024-05-08T04:21:07.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.545+0000 7f50467ee640 1 Processor -- start 2024-05-08T04:21:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.545+0000 7f50467ee640 1 -- start start 2024-05-08T04:21:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f50467ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50400cd940 0x7f504006c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f50467ee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f504015bcd0 0x7f5040151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f50467ee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50401601a0 0x7f5040159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f50467ee640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50400ccc00 con 0x7f50400cd940 2024-05-08T04:21:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f50467ee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50400cc920 con 0x7f504015bcd0 2024-05-08T04:21:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f50467ee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50400ccee0 con 0x7f50401601a0 2024-05-08T04:21:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f503ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50400cd940 0x7f504006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f503ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50400cd940 0x7f504006c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52958/0 (socket says 172.21.15.104:52958) 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f503ffff640 1 -- 172.21.15.104:0/283297429 learned_addr learned my addr 172.21.15.104:0/283297429 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f503ffff640 1 -- 172.21.15.104:0/283297429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50401601a0 msgr2=0x7f5040159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f503ffff640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50401601a0 0x7f5040159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f503ffff640 1 -- 172.21.15.104:0/283297429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f504015bcd0 msgr2=0x7f5040151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f5037fff640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f504015bcd0 0x7f5040151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f503ffff640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f504015bcd0 0x7f5040151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f503ffff640 1 -- 172.21.15.104:0/283297429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50401567d0 con 0x7f50400cd940 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.546+0000 7f5037fff640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f504015bcd0 0x7f5040151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.547+0000 7f503ffff640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50400cd940 0x7f504006c610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5030000c00 tx=0x7f50300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.547+0000 7f503d7fa640 1 -- 172.21.15.104:0/283297429 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030037040 con 0x7f50400cd940 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.547+0000 7f503d7fa640 1 -- 172.21.15.104:0/283297429 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5030042070 con 0x7f50400cd940 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.547+0000 7f503d7fa640 1 -- 172.21.15.104:0/283297429 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030030bd0 con 0x7f50400cd940 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.547+0000 7f50467ee640 1 -- 172.21.15.104:0/283297429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5040155f30 con 0x7f50400cd940 2024-05-08T04:21:07.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.547+0000 7f50467ee640 1 -- 172.21.15.104:0/283297429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50401564f0 con 0x7f50400cd940 2024-05-08T04:21:07.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.548+0000 7f50467ee640 1 -- 172.21.15.104:0/283297429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5040075010 con 0x7f50400cd940 2024-05-08T04:21:07.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.548+0000 7f503d7fa640 1 -- 172.21.15.104:0/283297429 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5030047460 con 0x7f50400cd940 2024-05-08T04:21:07.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.549+0000 7f503d7fa640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f502006b500 0x7f502006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.549+0000 7f5037fff640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f502006b500 0x7f502006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.549+0000 7f503d7fa640 1 -- 172.21.15.104:0/283297429 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f50300aaa90 con 0x7f50400cd940 2024-05-08T04:21:07.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.549+0000 7f5037fff640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f502006b500 0x7f502006d9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5028006fd0 tx=0x7f5028008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:07.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.553+0000 7f503d7fa640 1 -- 172.21.15.104:0/283297429 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5030032e20 con 0x7f50400cd940 2024-05-08T04:21:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.725+0000 7f50467ee640 1 -- 172.21.15.104:0/283297429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50400b4120 con 0x7f50400cd940 2024-05-08T04:21:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.725+0000 7f503d7fa640 1 -- 172.21.15.104:0/283297429 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12944 (secure 0 0 0) 0x7f5030079c60 con 0x7f50400cd940 2024-05-08T04:21:07.727 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:07.727 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":16,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:00.677071+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:07.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.727+0000 7f50467ee640 1 -- 172.21.15.104:0/283297429 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f502006b500 msgr2=0x7f502006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.727+0000 7f50467ee640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f502006b500 0x7f502006d9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5028006fd0 tx=0x7f5028008040 comp rx=0 tx=0).stop 2024-05-08T04:21:07.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.727+0000 7f50467ee640 1 -- 172.21.15.104:0/283297429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50400cd940 msgr2=0x7f504006c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.727+0000 7f50467ee640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50400cd940 0x7f504006c610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5030000c00 tx=0x7f50300046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.727+0000 7f50467ee640 1 -- 172.21.15.104:0/283297429 shutdown_connections 2024-05-08T04:21:07.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.727+0000 7f50467ee640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f502006b500 0x7f502006d9c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.727+0000 7f50467ee640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f504015bcd0 0x7f5040151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.727+0000 7f50467ee640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50401601a0 0x7f5040159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.727+0000 7f50467ee640 1 --2- 172.21.15.104:0/283297429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50400cd940 0x7f504006c610 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.727+0000 7f50467ee640 1 -- 172.21.15.104:0/283297429 >> 172.21.15.104:0/283297429 conn(0x7f50400b32f0 msgr2=0x7f50400cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:07.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.728+0000 7f50467ee640 1 -- 172.21.15.104:0/283297429 shutdown_connections 2024-05-08T04:21:07.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.728+0000 7f50467ee640 1 -- 172.21.15.104:0/283297429 wait complete. 2024-05-08T04:21:07.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:07.740 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:07.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.840+0000 7f804599b640 1 Processor -- start 2024-05-08T04:21:07.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.840+0000 7f804599b640 1 -- start start 2024-05-08T04:21:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f804599b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8040162150 0x7f80400d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f804599b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8040161780 0x7f80400ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f804599b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80400b5540 con 0x7f80400d4010 2024-05-08T04:21:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f804599b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80400b57e0 con 0x7f8040161780 2024-05-08T04:21:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f804599b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80400b5ac0 con 0x7f8040162150 2024-05-08T04:21:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803f7fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f80400d4010 0x7f80400b8db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:40370/0 (socket says 172.21.15.104:40370) 2024-05-08T04:21:07.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803f7fe640 1 -- 172.21.15.104:0/225142184 learned_addr learned my addr 172.21.15.104:0/225142184 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803effd640 1 --2- 172.21.15.104:0/225142184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8040162150 0x7f80400d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f80367fc640 1 --2- 172.21.15.104:0/225142184 >> v2:172.21.15.183:3300/0 conn(0x7f8040161780 0x7f80400ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075361269 0 0) 0x7f80400b5540 con 0x7f80400d4010 2024-05-08T04:21:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f802c003520 con 0x7f80400d4010 2024-05-08T04:21:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4195374991 0 0) 0x7f802c003520 con 0x7f80400d4010 2024-05-08T04:21:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8040162150 msgr2=0x7f80400d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 --2- 172.21.15.104:0/225142184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8040162150 0x7f80400d2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 >> v2:172.21.15.183:3300/0 conn(0x7f8040161780 msgr2=0x7f80400ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 --2- 172.21.15.104:0/225142184 >> v2:172.21.15.183:3300/0 conn(0x7f8040161780 0x7f80400ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80400b5da0 con 0x7f80400d4010 2024-05-08T04:21:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f80367fc640 1 --2- 172.21.15.104:0/225142184 >> v2:172.21.15.183:3300/0 conn(0x7f8040161780 0x7f80400ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f8038001a10 con 0x7f80400d4010 2024-05-08T04:21:07.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 >> v1:172.21.15.104:6789/0 conn(0x7f80400d4010 legacy=0x7f80400b8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 --2- 172.21.15.104:0/225142184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f802c0039b0 0x7f802c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 --2- 172.21.15.104:0/225142184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8040162150 0x7f802c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 --2- 172.21.15.104:0/225142184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f802c004d40 0x7f802c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.841+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80400b57e0 con 0x7f802c0039b0 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.842+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80400b5ac0 con 0x7f802c004d40 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.842+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c00b9c0 con 0x7f8040162150 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.842+0000 7f803effd640 1 --2- 172.21.15.104:0/225142184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f802c0039b0 0x7f802c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.842+0000 7f80367fc640 1 --2- 172.21.15.104:0/225142184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8040162150 0x7f802c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.842+0000 7f803f7fe640 1 --2- 172.21.15.104:0/225142184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f802c004d40 0x7f802c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.842+0000 7f803effd640 1 -- 172.21.15.104:0/225142184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8040162150 msgr2=0x7f802c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.842+0000 7f803effd640 1 --2- 172.21.15.104:0/225142184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8040162150 0x7f802c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.842+0000 7f803effd640 1 -- 172.21.15.104:0/225142184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f802c004d40 msgr2=0x7f802c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.842+0000 7f803effd640 1 --2- 172.21.15.104:0/225142184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f802c004d40 0x7f802c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.842+0000 7f803effd640 1 -- 172.21.15.104:0/225142184 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c003520 con 0x7f802c0039b0 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.842+0000 7f803f7fe640 1 --2- 172.21.15.104:0/225142184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f802c004d40 0x7f802c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.842+0000 7f803effd640 1 --2- 172.21.15.104:0/225142184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f802c0039b0 0x7f802c003dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8030009ac0 tx=0x7f802c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9bc476608f8a131 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.843+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030036070 con 0x7f802c0039b0 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.843+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8030031400 con 0x7f802c0039b0 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.843+0000 7f803e7fc640 1 -- 172.21.15.104:0/225142184 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030009690 con 0x7f802c0039b0 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.843+0000 7f804599b640 1 -- 172.21.15.104:0/225142184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f802c0039b0 msgr2=0x7f802c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.843+0000 7f804599b640 1 --2- 172.21.15.104:0/225142184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f802c0039b0 0x7f802c003dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8030009ac0 tx=0x7f802c005830 comp rx=0 tx=0).stop 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.843+0000 7f803f7fe640 1 -- 172.21.15.104:0/225142184 reap_dead start 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.843+0000 7f804599b640 1 -- 172.21.15.104:0/225142184 shutdown_connections 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.843+0000 7f804599b640 1 -- 172.21.15.104:0/225142184 >> 172.21.15.104:0/225142184 conn(0x7f804006c330 msgr2=0x7f804006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.843+0000 7f804599b640 1 -- 172.21.15.104:0/225142184 shutdown_connections 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.843+0000 7f804599b640 1 -- 172.21.15.104:0/225142184 wait complete. 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.844+0000 7f804599b640 1 Processor -- start 2024-05-08T04:21:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.844+0000 7f804599b640 1 -- start start 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.845+0000 7f804599b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f802c0039b0 0x7f80400c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.845+0000 7f804599b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8040160f50 0x7f804015f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.845+0000 7f804599b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f804015f770 0x7f8040150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.845+0000 7f804599b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80400cee00 con 0x7f802c0039b0 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.845+0000 7f804599b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80400cec80 con 0x7f8040160f50 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.845+0000 7f804599b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80400cef80 con 0x7f804015f770 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.845+0000 7f803effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f802c0039b0 0x7f80400c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.845+0000 7f803effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f802c0039b0 0x7f80400c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52972/0 (socket says 172.21.15.104:52972) 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.845+0000 7f803effd640 1 -- 172.21.15.104:0/1557802108 learned_addr learned my addr 172.21.15.104:0/1557802108 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.845+0000 7f803f7fe640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f804015f770 0x7f8040150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.845+0000 7f80367fc640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8040160f50 0x7f804015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.846+0000 7f803effd640 1 -- 172.21.15.104:0/1557802108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f804015f770 msgr2=0x7f8040150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.846+0000 7f803effd640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f804015f770 0x7f8040150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.846+0000 7f803effd640 1 -- 172.21.15.104:0/1557802108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8040160f50 msgr2=0x7f804015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.846+0000 7f803effd640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8040160f50 0x7f804015f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.846+0000 7f803effd640 1 -- 172.21.15.104:0/1557802108 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804015fc00 con 0x7f802c0039b0 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.846+0000 7f80367fc640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8040160f50 0x7f804015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.846+0000 7f803effd640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f802c0039b0 0x7f80400c9990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8030009ac0 tx=0x7f8030004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.846+0000 7f803cff9640 1 -- 172.21.15.104:0/1557802108 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030040020 con 0x7f802c0039b0 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.846+0000 7f803cff9640 1 -- 172.21.15.104:0/1557802108 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8030003bc0 con 0x7f802c0039b0 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.846+0000 7f804599b640 1 -- 172.21.15.104:0/1557802108 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804015feb0 con 0x7f802c0039b0 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.846+0000 7f803cff9640 1 -- 172.21.15.104:0/1557802108 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030036040 con 0x7f802c0039b0 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.846+0000 7f804599b640 1 -- 172.21.15.104:0/1557802108 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8040160470 con 0x7f802c0039b0 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.847+0000 7f804599b640 1 -- 172.21.15.104:0/1557802108 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8040160b80 con 0x7f802c0039b0 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.847+0000 7f803cff9640 1 -- 172.21.15.104:0/1557802108 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8030043020 con 0x7f802c0039b0 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.848+0000 7f803cff9640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f802006b4d0 0x7f802006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.848+0000 7f80367fc640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f802006b4d0 0x7f802006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:07.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.848+0000 7f803cff9640 1 -- 172.21.15.104:0/1557802108 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f80300a9f80 con 0x7f802c0039b0 2024-05-08T04:21:07.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.848+0000 7f80367fc640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f802006b4d0 0x7f802006d990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80400d2400 tx=0x7f8028008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:07.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:07.852+0000 7f803cff9640 1 -- 172.21.15.104:0/1557802108 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f803004a070 con 0x7f802c0039b0 2024-05-08T04:21:08.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.019+0000 7f804599b640 1 -- 172.21.15.104:0/1557802108 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8040075010 con 0x7f802c0039b0 2024-05-08T04:21:08.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.020+0000 7f803cff9640 1 -- 172.21.15.104:0/1557802108 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80300044e0 con 0x7f802c0039b0 2024-05-08T04:21:08.021 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:08.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.022+0000 7f804599b640 1 -- 172.21.15.104:0/1557802108 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f802006b4d0 msgr2=0x7f802006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.022+0000 7f804599b640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f802006b4d0 0x7f802006d990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80400d2400 tx=0x7f8028008040 comp rx=0 tx=0).stop 2024-05-08T04:21:08.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.022+0000 7f804599b640 1 -- 172.21.15.104:0/1557802108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f802c0039b0 msgr2=0x7f80400c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.022+0000 7f804599b640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f802c0039b0 0x7f80400c9990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8030009ac0 tx=0x7f8030004730 comp rx=0 tx=0).stop 2024-05-08T04:21:08.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.022+0000 7f804599b640 1 -- 172.21.15.104:0/1557802108 shutdown_connections 2024-05-08T04:21:08.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.022+0000 7f804599b640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f802006b4d0 0x7f802006d990 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.022+0000 7f804599b640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8040160f50 0x7f804015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.022+0000 7f804599b640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f804015f770 0x7f8040150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.022+0000 7f804599b640 1 --2- 172.21.15.104:0/1557802108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f802c0039b0 0x7f80400c9990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.022+0000 7f804599b640 1 -- 172.21.15.104:0/1557802108 >> 172.21.15.104:0/1557802108 conn(0x7f804006c330 msgr2=0x7f80400b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:08.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.022+0000 7f804599b640 1 -- 172.21.15.104:0/1557802108 shutdown_connections 2024-05-08T04:21:08.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.022+0000 7f804599b640 1 -- 172.21.15.104:0/1557802108 wait complete. 2024-05-08T04:21:08.034 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T04:21:08.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.132+0000 7fc3afba9640 1 Processor -- start 2024-05-08T04:21:08.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.132+0000 7fc3afba9640 1 -- start start 2024-05-08T04:21:08.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.133+0000 7fc3afba9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc3a806ea40 0x7fc3a80b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.133+0000 7fc3afba9640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a815e780 con 0x7fc3a80ceee0 2024-05-08T04:21:08.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.133+0000 7fc3afba9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a815ea60 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.133+0000 7fc3afba9640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a815f390 con 0x7fc3a806ea40 2024-05-08T04:21:08.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.133+0000 7fc3ad945640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc3a80ceee0 0x7fc3a806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:40378/0 (socket says 172.21.15.104:40378) 2024-05-08T04:21:08.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.133+0000 7fc3ad945640 1 -- 172.21.15.104:0/3429815638 learned_addr learned my addr 172.21.15.104:0/3429815638 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:08.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.133+0000 7fc3ad144640 1 --2- 172.21.15.104:0/3429815638 >> v2:172.21.15.104:3300/0 conn(0x7fc3a806ea40 0x7fc3a80b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.133+0000 7fc3ac943640 1 -- 172.21.15.104:0/3429815638 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812185642 0 0) 0x7fc3a815e780 con 0x7fc3a80ceee0 2024-05-08T04:21:08.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.133+0000 7fc3ac943640 1 -- 172.21.15.104:0/3429815638 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc390003520 con 0x7fc3a80ceee0 2024-05-08T04:21:08.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.134+0000 7fc3ad144640 1 -- 172.21.15.104:0/3429815638 >> v1:172.21.15.183:6789/0 conn(0x7fc3a80b3ff0 legacy=0x7fc3a80b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.134+0000 7fc3ad144640 1 -- 172.21.15.104:0/3429815638 >> v1:172.21.15.104:6789/0 conn(0x7fc3a80ceee0 legacy=0x7fc3a806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.134+0000 7fc3ad144640 1 -- 172.21.15.104:0/3429815638 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a815ed40 con 0x7fc3a806ea40 2024-05-08T04:21:08.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.134+0000 7fc3ad144640 1 --2- 172.21.15.104:0/3429815638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3a806ea40 0x7fc3a80b26f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3a815f510 tx=0x7fc39c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7b7613551c78f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:08.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.134+0000 7fc3ac943640 1 -- 172.21.15.104:0/3429815638 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c037070 con 0x7fc3a806ea40 2024-05-08T04:21:08.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.134+0000 7fc3ac943640 1 -- 172.21.15.104:0/3429815638 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c032440 con 0x7fc3a806ea40 2024-05-08T04:21:08.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.134+0000 7fc3ac943640 1 -- 172.21.15.104:0/3429815638 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c032810 con 0x7fc3a806ea40 2024-05-08T04:21:08.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.135+0000 7fc3afba9640 1 -- 172.21.15.104:0/3429815638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3a806ea40 msgr2=0x7fc3a80b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.135+0000 7fc3afba9640 1 --2- 172.21.15.104:0/3429815638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3a806ea40 0x7fc3a80b26f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3a815f510 tx=0x7fc39c02a210 comp rx=0 tx=0).stop 2024-05-08T04:21:08.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.135+0000 7fc3afba9640 1 -- 172.21.15.104:0/3429815638 shutdown_connections 2024-05-08T04:21:08.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.135+0000 7fc3afba9640 1 --2- 172.21.15.104:0/3429815638 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3a806ea40 0x7fc3a80b26f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.135+0000 7fc3afba9640 1 -- 172.21.15.104:0/3429815638 >> 172.21.15.104:0/3429815638 conn(0x7fc3a80b13f0 msgr2=0x7fc3a80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:08.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.135+0000 7fc3afba9640 1 -- 172.21.15.104:0/3429815638 shutdown_connections 2024-05-08T04:21:08.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.135+0000 7fc3afba9640 1 -- 172.21.15.104:0/3429815638 wait complete. 2024-05-08T04:21:08.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.136+0000 7fc3afba9640 1 Processor -- start 2024-05-08T04:21:08.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.136+0000 7fc3afba9640 1 -- start start 2024-05-08T04:21:08.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3afba9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a806ea40 0x7fc3a8148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3afba9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3a80b3ff0 0x7fc3a806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3afba9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a80ceee0 0x7fc3a806d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3afba9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80cf440 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3afba9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80cf2c0 con 0x7fc3a806ea40 2024-05-08T04:21:08.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3afba9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a815b210 con 0x7fc3a80ceee0 2024-05-08T04:21:08.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3ad144640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3a80b3ff0 0x7fc3a806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3ad144640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3a80b3ff0 0x7fc3a806d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52988/0 (socket says 172.21.15.104:52988) 2024-05-08T04:21:08.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3ad144640 1 -- 172.21.15.104:0/3622636383 learned_addr learned my addr 172.21.15.104:0/3622636383 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:08.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3ad945640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a806ea40 0x7fc3a8148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3ad144640 1 -- 172.21.15.104:0/3622636383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a80ceee0 msgr2=0x7fc3a806d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3ae146640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a80ceee0 0x7fc3a806d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3ad144640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a80ceee0 0x7fc3a806d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3ad144640 1 -- 172.21.15.104:0/3622636383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a806ea40 msgr2=0x7fc3a8148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3ad144640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a806ea40 0x7fc3a8148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3ad144640 1 -- 172.21.15.104:0/3622636383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a81491f0 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3ad945640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a806ea40 0x7fc3a8148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.137+0000 7fc3ad144640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3a80b3ff0 0x7fc3a806d220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009890 tx=0x7fc39c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.138+0000 7fc3a67fc640 1 -- 172.21.15.104:0/3622636383 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c037040 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.138+0000 7fc3a67fc640 1 -- 172.21.15.104:0/3622636383 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c042070 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.138+0000 7fc3a67fc640 1 -- 172.21.15.104:0/3622636383 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c030960 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.138+0000 7fc3afba9640 1 -- 172.21.15.104:0/3622636383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a814a0e0 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.138+0000 7fc3afba9640 1 -- 172.21.15.104:0/3622636383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a814a6a0 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.139+0000 7fc3afba9640 1 -- 172.21.15.104:0/3622636383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a8075010 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.139+0000 7fc3a67fc640 1 -- 172.21.15.104:0/3622636383 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc39c030b00 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.140+0000 7fc3a67fc640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc39406b4d0 0x7fc39406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.140+0000 7fc3a67fc640 1 -- 172.21.15.104:0/3622636383 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc39c0aa7c0 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.140+0000 7fc3ad945640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc39406b4d0 0x7fc39406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.140+0000 7fc3ad945640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc39406b4d0 0x7fc39406d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc398001560 tx=0x7fc398009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:08.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.144+0000 7fc3a67fc640 1 -- 172.21.15.104:0/3622636383 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc3a81491f0 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.315+0000 7fc3afba9640 1 -- 172.21.15.104:0/3622636383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc3a80b0300 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.316+0000 7fc3a67fc640 1 -- 172.21.15.104:0/3622636383 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc39c079990 con 0x7fc3a80b3ff0 2024-05-08T04:21:08.317 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:08.317 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-05-08T04:21:08.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:21:08.317 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-05-08T04:21:08.318 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-05-08T04:21:08.318 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:21:08.318 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-05-08T04:21:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.318+0000 7fc3afba9640 1 -- 172.21.15.104:0/3622636383 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc39406b4d0 msgr2=0x7fc39406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.318+0000 7fc3afba9640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc39406b4d0 0x7fc39406d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc398001560 tx=0x7fc398009040 comp rx=0 tx=0).stop 2024-05-08T04:21:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.318+0000 7fc3afba9640 1 -- 172.21.15.104:0/3622636383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3a80b3ff0 msgr2=0x7fc3a806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.318+0000 7fc3afba9640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3a80b3ff0 0x7fc3a806d220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009890 tx=0x7fc39c0046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.318+0000 7fc3afba9640 1 -- 172.21.15.104:0/3622636383 shutdown_connections 2024-05-08T04:21:08.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.318+0000 7fc3afba9640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc39406b4d0 0x7fc39406d990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.318+0000 7fc3afba9640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a80ceee0 0x7fc3a806d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.318+0000 7fc3afba9640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3a80b3ff0 0x7fc3a806d220 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.318+0000 7fc3afba9640 1 --2- 172.21.15.104:0/3622636383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a806ea40 0x7fc3a8148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.318+0000 7fc3afba9640 1 -- 172.21.15.104:0/3622636383 >> 172.21.15.104:0/3622636383 conn(0x7fc3a80b13f0 msgr2=0x7fc3a806e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:08.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.318+0000 7fc3afba9640 1 -- 172.21.15.104:0/3622636383 shutdown_connections 2024-05-08T04:21:08.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.318+0000 7fc3afba9640 1 -- 172.21.15.104:0/3622636383 wait complete. 2024-05-08T04:21:08.329 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T04:21:08.330 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T04:21:08.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.432+0000 7f52f22c4640 1 Processor -- start 2024-05-08T04:21:08.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.432+0000 7f52f22c4640 1 -- start start 2024-05-08T04:21:08.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.432+0000 7f52f22c4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f52ec15b6a0 0x7f52ec0c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.432+0000 7f52f22c4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f52ec0aefb0 0x7f52ec0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.432+0000 7f52f22c4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52ec0af420 0x7f52ec0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.432+0000 7f52f22c4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ec15ba80 con 0x7f52ec15b6a0 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.432+0000 7f52f22c4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ec15efc0 con 0x7f52ec0aefb0 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.432+0000 7f52f22c4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0c5570 con 0x7f52ec0af420 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.433+0000 7f52ebfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f52ec15b6a0 0x7f52ec0c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.433+0000 7f52ebfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f52ec15b6a0 0x7f52ec0c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52992/0 (socket says 172.21.15.104:52992) 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.433+0000 7f52ebfff640 1 -- 172.21.15.104:0/3760040016 learned_addr learned my addr 172.21.15.104:0/3760040016 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.433+0000 7f52f0861640 1 --2- 172.21.15.104:0/3760040016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52ec0af420 0x7f52ec0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.433+0000 7f52e3fff640 1 --2- 172.21.15.104:0/3760040016 >> v2:172.21.15.183:3300/0 conn(0x7f52ec0aefb0 0x7f52ec0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.433+0000 7f52ebfff640 1 -- 172.21.15.104:0/3760040016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52ec0af420 msgr2=0x7f52ec0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.433+0000 7f52ebfff640 1 --2- 172.21.15.104:0/3760040016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52ec0af420 0x7f52ec0ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.433+0000 7f52ebfff640 1 -- 172.21.15.104:0/3760040016 >> v2:172.21.15.183:3300/0 conn(0x7f52ec0aefb0 msgr2=0x7f52ec0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.433+0000 7f52ebfff640 1 --2- 172.21.15.104:0/3760040016 >> v2:172.21.15.183:3300/0 conn(0x7f52ec0aefb0 0x7f52ec0ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.433+0000 7f52ebfff640 1 -- 172.21.15.104:0/3760040016 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec0c5850 con 0x7f52ec15b6a0 2024-05-08T04:21:08.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.434+0000 7f52ebfff640 1 --2- 172.21.15.104:0/3760040016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52ec15b6a0 0x7f52ec0c6610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f52ec066bb0 tx=0x7f52dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db35fe6dfee547c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:08.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.434+0000 7f52eb7fe640 1 -- 172.21.15.104:0/3760040016 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc037070 con 0x7f52ec15b6a0 2024-05-08T04:21:08.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.434+0000 7f52eb7fe640 1 -- 172.21.15.104:0/3760040016 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc032440 con 0x7f52ec15b6a0 2024-05-08T04:21:08.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.434+0000 7f52eb7fe640 1 -- 172.21.15.104:0/3760040016 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc032810 con 0x7f52ec15b6a0 2024-05-08T04:21:08.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.434+0000 7f52f22c4640 1 -- 172.21.15.104:0/3760040016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52ec15b6a0 msgr2=0x7f52ec0c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.434+0000 7f52f22c4640 1 --2- 172.21.15.104:0/3760040016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52ec15b6a0 0x7f52ec0c6610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f52ec066bb0 tx=0x7f52dc02a1e0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.434+0000 7f52f22c4640 1 -- 172.21.15.104:0/3760040016 shutdown_connections 2024-05-08T04:21:08.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.434+0000 7f52f22c4640 1 --2- 172.21.15.104:0/3760040016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52ec0af420 0x7f52ec0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.434+0000 7f52f22c4640 1 --2- 172.21.15.104:0/3760040016 >> v2:172.21.15.183:3300/0 conn(0x7f52ec0aefb0 0x7f52ec0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.434+0000 7f52f22c4640 1 --2- 172.21.15.104:0/3760040016 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52ec15b6a0 0x7f52ec0c6610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.434+0000 7f52f22c4640 1 -- 172.21.15.104:0/3760040016 >> 172.21.15.104:0/3760040016 conn(0x7f52ec0cc880 msgr2=0x7f52ec0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:08.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.434+0000 7f52f22c4640 1 -- 172.21.15.104:0/3760040016 shutdown_connections 2024-05-08T04:21:08.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.434+0000 7f52f22c4640 1 -- 172.21.15.104:0/3760040016 wait complete. 2024-05-08T04:21:08.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.435+0000 7f52f22c4640 1 Processor -- start 2024-05-08T04:21:08.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.436+0000 7f52f22c4640 1 -- start start 2024-05-08T04:21:08.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.436+0000 7f52f22c4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52ec0aefb0 0x7f52ec14f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.436+0000 7f52f22c4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52ec0af420 0x7f52ec06edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.436+0000 7f52f22c4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52ec15b6a0 0x7f52ec0c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.436+0000 7f52f22c4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0c60f0 con 0x7f52ec15b6a0 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.436+0000 7f52f22c4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0c5e10 con 0x7f52ec0af420 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.436+0000 7f52f22c4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0c6b50 con 0x7f52ec0aefb0 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.436+0000 7f52f0861640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52ec15b6a0 0x7f52ec0c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.436+0000 7f52f0861640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52ec15b6a0 0x7f52ec0c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52996/0 (socket says 172.21.15.104:52996) 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.436+0000 7f52f0861640 1 -- 172.21.15.104:0/3722612663 learned_addr learned my addr 172.21.15.104:0/3722612663 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.436+0000 7f52e3fff640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52ec0af420 0x7f52ec06edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.436+0000 7f52ebfff640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52ec0aefb0 0x7f52ec14f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.437+0000 7f52f0861640 1 -- 172.21.15.104:0/3722612663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52ec0aefb0 msgr2=0x7f52ec14f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.437+0000 7f52f0861640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52ec0aefb0 0x7f52ec14f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.437+0000 7f52f0861640 1 -- 172.21.15.104:0/3722612663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52ec0af420 msgr2=0x7f52ec06edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.437+0000 7f52f0861640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52ec0af420 0x7f52ec06edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.437+0000 7f52f0861640 1 -- 172.21.15.104:0/3722612663 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec14fb40 con 0x7f52ec15b6a0 2024-05-08T04:21:08.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.437+0000 7f52e3fff640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52ec0af420 0x7f52ec06edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:08.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.437+0000 7f52ebfff640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52ec0aefb0 0x7f52ec14f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:08.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.437+0000 7f52f0861640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52ec15b6a0 0x7f52ec0c8e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52e400efc0 tx=0x7f52e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:08.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.437+0000 7f52e97fa640 1 -- 172.21.15.104:0/3722612663 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4018020 con 0x7f52ec15b6a0 2024-05-08T04:21:08.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.437+0000 7f52e97fa640 1 -- 172.21.15.104:0/3722612663 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e4014480 con 0x7f52ec15b6a0 2024-05-08T04:21:08.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.437+0000 7f52f22c4640 1 -- 172.21.15.104:0/3722612663 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec06e590 con 0x7f52ec15b6a0 2024-05-08T04:21:08.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.437+0000 7f52e97fa640 1 -- 172.21.15.104:0/3722612663 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4014870 con 0x7f52ec15b6a0 2024-05-08T04:21:08.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.437+0000 7f52f22c4640 1 -- 172.21.15.104:0/3722612663 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec0c8640 con 0x7f52ec15b6a0 2024-05-08T04:21:08.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.438+0000 7f52f22c4640 1 -- 172.21.15.104:0/3722612663 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ec075010 con 0x7f52ec15b6a0 2024-05-08T04:21:08.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.439+0000 7f52e97fa640 1 -- 172.21.15.104:0/3722612663 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f52e4005d10 con 0x7f52ec15b6a0 2024-05-08T04:21:08.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.439+0000 7f52e97fa640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f52cc06b500 0x7f52cc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.439+0000 7f52e97fa640 1 -- 172.21.15.104:0/3722612663 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f52e408abb0 con 0x7f52ec15b6a0 2024-05-08T04:21:08.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.439+0000 7f52ebfff640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f52cc06b500 0x7f52cc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.439+0000 7f52ebfff640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f52cc06b500 0x7f52cc06d9c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f52dc034000 tx=0x7f52dc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:08.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.443+0000 7f52e97fa640 1 -- 172.21.15.104:0/3722612663 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52e4022030 con 0x7f52ec15b6a0 2024-05-08T04:21:08.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.615+0000 7f52f22c4640 1 -- 172.21.15.104:0/3722612663 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f52ec1604e0 con 0x7f52ec15b6a0 2024-05-08T04:21:08.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.777+0000 7f52e97fa640 1 -- 172.21.15.104:0/3722612663 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f52e4010040 con 0x7f52ec15b6a0 2024-05-08T04:21:08.778 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-05-08T04:21:08.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.779+0000 7f52f22c4640 1 -- 172.21.15.104:0/3722612663 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f52cc06b500 msgr2=0x7f52cc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.779+0000 7f52f22c4640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f52cc06b500 0x7f52cc06d9c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f52dc034000 tx=0x7f52dc02e000 comp rx=0 tx=0).stop 2024-05-08T04:21:08.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.779+0000 7f52f22c4640 1 -- 172.21.15.104:0/3722612663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52ec15b6a0 msgr2=0x7f52ec0c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.779+0000 7f52f22c4640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52ec15b6a0 0x7f52ec0c8e40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f52e400efc0 tx=0x7f52e400c490 comp rx=0 tx=0).stop 2024-05-08T04:21:08.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.779+0000 7f52f22c4640 1 -- 172.21.15.104:0/3722612663 shutdown_connections 2024-05-08T04:21:08.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.779+0000 7f52f22c4640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f52cc06b500 0x7f52cc06d9c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.779+0000 7f52f22c4640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52ec0af420 0x7f52ec06edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.779+0000 7f52f22c4640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52ec15b6a0 0x7f52ec0c8e40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.779+0000 7f52f22c4640 1 --2- 172.21.15.104:0/3722612663 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52ec0aefb0 0x7f52ec14f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.779+0000 7f52f22c4640 1 -- 172.21.15.104:0/3722612663 >> 172.21.15.104:0/3722612663 conn(0x7f52ec0cc880 msgr2=0x7f52ec0cde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:08.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.779+0000 7f52f22c4640 1 -- 172.21.15.104:0/3722612663 shutdown_connections 2024-05-08T04:21:08.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.779+0000 7f52f22c4640 1 -- 172.21.15.104:0/3722612663 wait complete. 2024-05-08T04:21:08.795 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T04:21:08.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.899+0000 7fd193329640 1 Processor -- start 2024-05-08T04:21:08.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.900+0000 7fd193329640 1 -- start start 2024-05-08T04:21:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.900+0000 7fd193329640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd18c0b5b60 0x7fd18c1617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.900+0000 7fd193329640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd18c161cf0 0x7fd18c0d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.900+0000 7fd193329640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18c162180 con 0x7fd18c15db50 2024-05-08T04:21:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.900+0000 7fd193329640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18c1626e0 con 0x7fd18c161cf0 2024-05-08T04:21:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.900+0000 7fd193329640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c162400 con 0x7fd18c0b5b60 2024-05-08T04:21:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.901+0000 7fd1910c5640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd18c15db50 0x7fd18c0b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:40382/0 (socket says 172.21.15.104:40382) 2024-05-08T04:21:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.901+0000 7fd1910c5640 1 -- 172.21.15.104:0/2119359496 learned_addr learned my addr 172.21.15.104:0/2119359496 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:08.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.901+0000 7fd1918c6640 1 --2- 172.21.15.104:0/2119359496 >> v2:172.21.15.104:3300/0 conn(0x7fd18c161cf0 0x7fd18c0d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.901+0000 7fd1908c4640 1 --2- 172.21.15.104:0/2119359496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd18c0b5b60 0x7fd18c1617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.901+0000 7fd1918c6640 1 -- 172.21.15.104:0/2119359496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd18c0b5b60 msgr2=0x7fd18c1617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:08.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.901+0000 7fd1918c6640 1 --2- 172.21.15.104:0/2119359496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd18c0b5b60 0x7fd18c1617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.901+0000 7fd1918c6640 1 -- 172.21.15.104:0/2119359496 >> v1:172.21.15.104:6789/0 conn(0x7fd18c15db50 legacy=0x7fd18c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.901+0000 7fd1918c6640 1 -- 172.21.15.104:0/2119359496 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0d1b80 con 0x7fd18c161cf0 2024-05-08T04:21:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.902+0000 7fd1918c6640 1 --2- 172.21.15.104:0/2119359496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c161cf0 0x7fd18c0d2660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd184009d90 tx=0x7fd18402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45438dbd170ffd47 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.902+0000 7fd183fff640 1 -- 172.21.15.104:0/2119359496 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184031600 con 0x7fd18c161cf0 2024-05-08T04:21:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.902+0000 7fd183fff640 1 -- 172.21.15.104:0/2119359496 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1840317a0 con 0x7fd18c161cf0 2024-05-08T04:21:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.902+0000 7fd183fff640 1 -- 172.21.15.104:0/2119359496 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184031b70 con 0x7fd18c161cf0 2024-05-08T04:21:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.902+0000 7fd193329640 1 -- 172.21.15.104:0/2119359496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c161cf0 msgr2=0x7fd18c0d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.902+0000 7fd193329640 1 --2- 172.21.15.104:0/2119359496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c161cf0 0x7fd18c0d2660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd184009d90 tx=0x7fd18402a5d0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.902+0000 7fd193329640 1 -- 172.21.15.104:0/2119359496 shutdown_connections 2024-05-08T04:21:08.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.902+0000 7fd193329640 1 --2- 172.21.15.104:0/2119359496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c161cf0 0x7fd18c0d2660 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.902+0000 7fd193329640 1 --2- 172.21.15.104:0/2119359496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd18c0b5b60 0x7fd18c1617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.902+0000 7fd193329640 1 -- 172.21.15.104:0/2119359496 >> 172.21.15.104:0/2119359496 conn(0x7fd18c0d0450 msgr2=0x7fd18c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:08.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.902+0000 7fd193329640 1 -- 172.21.15.104:0/2119359496 shutdown_connections 2024-05-08T04:21:08.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.902+0000 7fd193329640 1 -- 172.21.15.104:0/2119359496 wait complete. 2024-05-08T04:21:08.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.904+0000 7fd193329640 1 Processor -- start 2024-05-08T04:21:08.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.904+0000 7fd193329640 1 -- start start 2024-05-08T04:21:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.904+0000 7fd193329640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c0b5b60 0x7fd18c14ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.904+0000 7fd193329640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd18c15db50 0x7fd18c157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.904+0000 7fd193329640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd18c161cf0 0x7fd18c0b8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.904+0000 7fd193329640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0b6b00 con 0x7fd18c0b5b60 2024-05-08T04:21:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.904+0000 7fd193329640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0d2140 con 0x7fd18c161cf0 2024-05-08T04:21:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.904+0000 7fd193329640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0b6c80 con 0x7fd18c15db50 2024-05-08T04:21:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.904+0000 7fd1910c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c0b5b60 0x7fd18c14ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.904+0000 7fd1910c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c0b5b60 0x7fd18c14ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53012/0 (socket says 172.21.15.104:53012) 2024-05-08T04:21:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.904+0000 7fd1910c5640 1 -- 172.21.15.104:0/1096343429 learned_addr learned my addr 172.21.15.104:0/1096343429 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd1908c4640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd18c15db50 0x7fd18c157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd1918c6640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd18c161cf0 0x7fd18c0b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd1910c5640 1 -- 172.21.15.104:0/1096343429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd18c15db50 msgr2=0x7fd18c157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd1910c5640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd18c15db50 0x7fd18c157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd1910c5640 1 -- 172.21.15.104:0/1096343429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd18c161cf0 msgr2=0x7fd18c0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:08.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd1910c5640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd18c161cf0 0x7fd18c0b8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:08.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd1910c5640 1 -- 172.21.15.104:0/1096343429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c157fc0 con 0x7fd18c0b5b60 2024-05-08T04:21:08.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd1918c6640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd18c161cf0 0x7fd18c0b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:08.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd1910c5640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c0b5b60 0x7fd18c14ae50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd18800c400 tx=0x7fd18800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:08.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd181ffb640 1 -- 172.21.15.104:0/1096343429 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188017070 con 0x7fd18c0b5b60 2024-05-08T04:21:08.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd181ffb640 1 -- 172.21.15.104:0/1096343429 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd188005ce0 con 0x7fd18c0b5b60 2024-05-08T04:21:08.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd193329640 1 -- 172.21.15.104:0/1096343429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18c15e180 con 0x7fd18c0b5b60 2024-05-08T04:21:08.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd181ffb640 1 -- 172.21.15.104:0/1096343429 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1880072f0 con 0x7fd18c0b5b60 2024-05-08T04:21:08.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.905+0000 7fd193329640 1 -- 172.21.15.104:0/1096343429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18c154d40 con 0x7fd18c0b5b60 2024-05-08T04:21:08.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.906+0000 7fd193329640 1 -- 172.21.15.104:0/1096343429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18c074830 con 0x7fd18c0b5b60 2024-05-08T04:21:08.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.907+0000 7fd181ffb640 1 -- 172.21.15.104:0/1096343429 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd18801a070 con 0x7fd18c0b5b60 2024-05-08T04:21:08.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.907+0000 7fd181ffb640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd17006b4d0 0x7fd17006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:08.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.908+0000 7fd1908c4640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd17006b4d0 0x7fd17006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:08.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.908+0000 7fd181ffb640 1 -- 172.21.15.104:0/1096343429 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd1880892f0 con 0x7fd18c0b5b60 2024-05-08T04:21:08.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.908+0000 7fd1908c4640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd17006b4d0 0x7fd17006d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd18c157590 tx=0x7fd17c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:08.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:08.912+0000 7fd181ffb640 1 -- 172.21.15.104:0/1096343429 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd18c162180 con 0x7fd18c0b5b60 2024-05-08T04:21:09.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.082+0000 7fd193329640 1 -- 172.21.15.104:0/1096343429 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd18c0d1600 con 0x7fd18c0b5b60 2024-05-08T04:21:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.783+0000 7fd181ffb640 1 -- 172.21.15.104:0/1096343429 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd188087e20 con 0x7fd18c0b5b60 2024-05-08T04:21:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-05-08T04:21:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.785+0000 7fd193329640 1 -- 172.21.15.104:0/1096343429 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd17006b4d0 msgr2=0x7fd17006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.785+0000 7fd193329640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd17006b4d0 0x7fd17006d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd18c157590 tx=0x7fd17c008040 comp rx=0 tx=0).stop 2024-05-08T04:21:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.785+0000 7fd193329640 1 -- 172.21.15.104:0/1096343429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c0b5b60 msgr2=0x7fd18c14ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.785+0000 7fd193329640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c0b5b60 0x7fd18c14ae50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd18800c400 tx=0x7fd18800c8c0 comp rx=0 tx=0).stop 2024-05-08T04:21:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.785+0000 7fd193329640 1 -- 172.21.15.104:0/1096343429 shutdown_connections 2024-05-08T04:21:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.785+0000 7fd193329640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd17006b4d0 0x7fd17006d990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.785+0000 7fd193329640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd18c161cf0 0x7fd18c0b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.785+0000 7fd193329640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd18c15db50 0x7fd18c157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.785+0000 7fd193329640 1 --2- 172.21.15.104:0/1096343429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18c0b5b60 0x7fd18c14ae50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.785+0000 7fd193329640 1 -- 172.21.15.104:0/1096343429 >> 172.21.15.104:0/1096343429 conn(0x7fd18c0d0450 msgr2=0x7fd18c0b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:09.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.786+0000 7fd193329640 1 -- 172.21.15.104:0/1096343429 shutdown_connections 2024-05-08T04:21:09.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.786+0000 7fd193329640 1 -- 172.21.15.104:0/1096343429 wait complete. 2024-05-08T04:21:09.809 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T04:21:09.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.913+0000 7faf2641f640 1 Processor -- start 2024-05-08T04:21:09.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.913+0000 7faf2641f640 1 -- start start 2024-05-08T04:21:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf2641f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf200d35c0 0x7faf200b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf2641f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7faf200b59c0 0x7faf200b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf2641f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf200b9920 con 0x7faf2015dad0 2024-05-08T04:21:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf2641f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf200b5e10 con 0x7faf200b59c0 2024-05-08T04:21:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf2641f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf200d2520 con 0x7faf200d35c0 2024-05-08T04:21:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf249bc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7faf200b59c0 0x7faf200b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf249bc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7faf200b59c0 0x7faf200b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53022/0 (socket says 172.21.15.104:53022) 2024-05-08T04:21:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf249bc640 1 -- 172.21.15.104:0/1506745908 learned_addr learned my addr 172.21.15.104:0/1506745908 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf1f7fe640 1 --2- 172.21.15.104:0/1506745908 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf200d35c0 0x7faf200b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf249bc640 1 -- 172.21.15.104:0/1506745908 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf200d35c0 msgr2=0x7faf200b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf249bc640 1 --2- 172.21.15.104:0/1506745908 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf200d35c0 0x7faf200b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf249bc640 1 -- 172.21.15.104:0/1506745908 >> v1:172.21.15.183:6789/0 conn(0x7faf2015dad0 legacy=0x7faf200d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf249bc640 1 -- 172.21.15.104:0/1506745908 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf200d2800 con 0x7faf200b59c0 2024-05-08T04:21:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.914+0000 7faf1f7fe640 1 --2- 172.21.15.104:0/1506745908 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf200d35c0 0x7faf200b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.915+0000 7faf249bc640 1 --2- 172.21.15.104:0/1506745908 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf200b59c0 0x7faf200b6b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faf18009e50 tx=0x7faf1802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc3cad1ab65389c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.915+0000 7faf1effd640 1 -- 172.21.15.104:0/1506745908 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18036070 con 0x7faf200b59c0 2024-05-08T04:21:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.915+0000 7faf1effd640 1 -- 172.21.15.104:0/1506745908 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18031600 con 0x7faf200b59c0 2024-05-08T04:21:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.915+0000 7faf1effd640 1 -- 172.21.15.104:0/1506745908 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf180319d0 con 0x7faf200b59c0 2024-05-08T04:21:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.915+0000 7faf2641f640 1 -- 172.21.15.104:0/1506745908 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf200b59c0 msgr2=0x7faf200b6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.915+0000 7faf2641f640 1 --2- 172.21.15.104:0/1506745908 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf200b59c0 0x7faf200b6b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faf18009e50 tx=0x7faf1802a630 comp rx=0 tx=0).stop 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.915+0000 7faf2641f640 1 -- 172.21.15.104:0/1506745908 shutdown_connections 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.915+0000 7faf2641f640 1 --2- 172.21.15.104:0/1506745908 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf200b59c0 0x7faf200b6b30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.915+0000 7faf2641f640 1 --2- 172.21.15.104:0/1506745908 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf200d35c0 0x7faf200b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.915+0000 7faf2641f640 1 -- 172.21.15.104:0/1506745908 >> 172.21.15.104:0/1506745908 conn(0x7faf2006c650 msgr2=0x7faf200d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.915+0000 7faf2641f640 1 -- 172.21.15.104:0/1506745908 shutdown_connections 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.915+0000 7faf2641f640 1 -- 172.21.15.104:0/1506745908 wait complete. 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.917+0000 7faf2641f640 1 Processor -- start 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.917+0000 7faf2641f640 1 -- start start 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.917+0000 7faf2641f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf200b59c0 0x7faf201e2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.917+0000 7faf2641f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf200d35c0 0x7faf20143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.917+0000 7faf2641f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf2015dad0 0x7faf20154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.917+0000 7faf2641f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf200d30a0 con 0x7faf2015dad0 2024-05-08T04:21:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.917+0000 7faf2641f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf200d2dc0 con 0x7faf200d35c0 2024-05-08T04:21:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.917+0000 7faf2641f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf200d2170 con 0x7faf200b59c0 2024-05-08T04:21:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf249bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf2015dad0 0x7faf20154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf249bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf2015dad0 0x7faf20154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53028/0 (socket says 172.21.15.104:53028) 2024-05-08T04:21:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf249bc640 1 -- 172.21.15.104:0/1603646219 learned_addr learned my addr 172.21.15.104:0/1603646219 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf1f7fe640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf200d35c0 0x7faf20143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf1ffff640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf200b59c0 0x7faf201e2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf249bc640 1 -- 172.21.15.104:0/1603646219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf200b59c0 msgr2=0x7faf201e2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf249bc640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf200b59c0 0x7faf201e2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf249bc640 1 -- 172.21.15.104:0/1603646219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf200d35c0 msgr2=0x7faf20143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf249bc640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf200d35c0 0x7faf20143490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf249bc640 1 -- 172.21.15.104:0/1603646219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf201423f0 con 0x7faf2015dad0 2024-05-08T04:21:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf249bc640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf2015dad0 0x7faf20154a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faf18009e50 tx=0x7faf18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf1cff9640 1 -- 172.21.15.104:0/1603646219 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18036050 con 0x7faf2015dad0 2024-05-08T04:21:09.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf1cff9640 1 -- 172.21.15.104:0/1603646219 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18042070 con 0x7faf2015dad0 2024-05-08T04:21:09.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf2641f640 1 -- 172.21.15.104:0/1603646219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf201426d0 con 0x7faf2015dad0 2024-05-08T04:21:09.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf1cff9640 1 -- 172.21.15.104:0/1603646219 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18009510 con 0x7faf2015dad0 2024-05-08T04:21:09.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.918+0000 7faf2641f640 1 -- 172.21.15.104:0/1603646219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf20142c90 con 0x7faf2015dad0 2024-05-08T04:21:09.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.919+0000 7faf2641f640 1 -- 172.21.15.104:0/1603646219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf20075010 con 0x7faf2015dad0 2024-05-08T04:21:09.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.920+0000 7faf1cff9640 1 -- 172.21.15.104:0/1603646219 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7faf18007bd0 con 0x7faf2015dad0 2024-05-08T04:21:09.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.920+0000 7faf1cff9640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7faf0c06b4d0 0x7faf0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:09.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.920+0000 7faf1cff9640 1 -- 172.21.15.104:0/1603646219 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7faf180ab9e0 con 0x7faf2015dad0 2024-05-08T04:21:09.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.920+0000 7faf1ffff640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7faf0c06b4d0 0x7faf0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:09.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.921+0000 7faf1ffff640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7faf0c06b4d0 0x7faf0c06d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf10006fd0 tx=0x7faf10009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:09.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:09.924+0000 7faf1cff9640 1 -- 172.21.15.104:0/1603646219 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faf1807a3e0 con 0x7faf2015dad0 2024-05-08T04:21:10.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.132+0000 7faf2641f640 1 -- 172.21.15.104:0/1603646219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7faf200d3e00 con 0x7faf2015dad0 2024-05-08T04:21:10.351 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:21:10.354 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:21:10.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.793+0000 7faf1cff9640 1 -- 172.21.15.104:0/1603646219 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7faf1807e480 con 0x7faf2015dad0 2024-05-08T04:21:10.802 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T04:21:10.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.805+0000 7faf2641f640 1 -- 172.21.15.104:0/1603646219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7faf0c06b4d0 msgr2=0x7faf0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:10.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.805+0000 7faf2641f640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7faf0c06b4d0 0x7faf0c06d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf10006fd0 tx=0x7faf10009060 comp rx=0 tx=0).stop 2024-05-08T04:21:10.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.805+0000 7faf2641f640 1 -- 172.21.15.104:0/1603646219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf2015dad0 msgr2=0x7faf20154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:10.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.805+0000 7faf2641f640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf2015dad0 0x7faf20154a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faf18009e50 tx=0x7faf18004a40 comp rx=0 tx=0).stop 2024-05-08T04:21:10.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.806+0000 7faf2641f640 1 -- 172.21.15.104:0/1603646219 shutdown_connections 2024-05-08T04:21:10.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.806+0000 7faf2641f640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7faf0c06b4d0 0x7faf0c06d990 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf10006fd0 tx=0x7faf10009060 comp rx=0 tx=0).stop 2024-05-08T04:21:10.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.806+0000 7faf2641f640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf200d35c0 0x7faf20143490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:10.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.806+0000 7faf2641f640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf2015dad0 0x7faf20154a70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:10.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.806+0000 7faf2641f640 1 --2- 172.21.15.104:0/1603646219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf200b59c0 0x7faf201e2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:10.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.806+0000 7faf2641f640 1 -- 172.21.15.104:0/1603646219 >> 172.21.15.104:0/1603646219 conn(0x7faf2006c650 msgr2=0x7faf200b6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:10.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.809+0000 7faf2641f640 1 -- 172.21.15.104:0/1603646219 shutdown_connections 2024-05-08T04:21:10.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.809+0000 7faf2641f640 1 -- 172.21.15.104:0/1603646219 wait complete. 2024-05-08T04:21:10.828 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:10.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.926+0000 7f48d2ba5640 1 Processor -- start 2024-05-08T04:21:10.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.926+0000 7f48d2ba5640 1 -- start start 2024-05-08T04:21:10.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.927+0000 7f48d2ba5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48cc0ce5a0 0x7f48cc161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:10.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.927+0000 7f48d2ba5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc15e1f0 con 0x7f48cc15de10 2024-05-08T04:21:10.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.927+0000 7f48d2ba5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc162090 con 0x7f48cc0d07c0 2024-05-08T04:21:10.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.927+0000 7f48d2ba5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0d0f50 con 0x7f48cc0ce5a0 2024-05-08T04:21:10.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.927+0000 7f48d0941640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f48cc15de10 0x7f48cc0d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:40390/0 (socket says 172.21.15.104:40390) 2024-05-08T04:21:10.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.927+0000 7f48d0941640 1 -- 172.21.15.104:0/195603281 learned_addr learned my addr 172.21.15.104:0/195603281 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:10.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cbfff640 1 --2- 172.21.15.104:0/195603281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48cc0ce5a0 0x7f48cc161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:10.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819694007 0 0) 0x7f48cc15e1f0 con 0x7f48cc15de10 2024-05-08T04:21:10.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48bc003520 con 0x7f48cc15de10 2024-05-08T04:21:10.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761981127 0 0) 0x7f48cc162090 con 0x7f48cc0d07c0 2024-05-08T04:21:10.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48cc15e1f0 con 0x7f48cc0d07c0 2024-05-08T04:21:10.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4045160746 0 0) 0x7f48bc003520 con 0x7f48cc15de10 2024-05-08T04:21:10.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48cc0ce5a0 msgr2=0x7f48cc161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:10.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 --2- 172.21.15.104:0/195603281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48cc0ce5a0 0x7f48cc161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:10.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 >> v1:172.21.15.183:6789/0 conn(0x7f48cc0d07c0 legacy=0x7f48cc0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:10.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc162370 con 0x7f48cc15de10 2024-05-08T04:21:10.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f48c0001670 con 0x7f48cc15de10 2024-05-08T04:21:10.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 >> v1:172.21.15.104:6789/0 conn(0x7f48cc15de10 legacy=0x7f48cc0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:10.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 --2- 172.21.15.104:0/195603281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48cc0ce5a0 0x7f48bc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:10.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 --2- 172.21.15.104:0/195603281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48bc0040d0 0x7f48bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:10.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 --2- 172.21.15.104:0/195603281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48bc004d40 0x7f48bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:10.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0d0f50 con 0x7f48bc0040d0 2024-05-08T04:21:10.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc00bb50 con 0x7f48bc004d40 2024-05-08T04:21:10.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc00bd20 con 0x7f48cc0ce5a0 2024-05-08T04:21:10.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cbfff640 1 --2- 172.21.15.104:0/195603281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48bc0040d0 0x7f48bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:10.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48d0941640 1 --2- 172.21.15.104:0/195603281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48cc0ce5a0 0x7f48bc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:10.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48d1142640 1 --2- 172.21.15.104:0/195603281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48bc004d40 0x7f48bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:10.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cbfff640 1 -- 172.21.15.104:0/195603281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48cc0ce5a0 msgr2=0x7f48bc003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:10.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cbfff640 1 --2- 172.21.15.104:0/195603281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48cc0ce5a0 0x7f48bc003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:10.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cbfff640 1 -- 172.21.15.104:0/195603281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48bc004d40 msgr2=0x7f48bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:10.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cbfff640 1 --2- 172.21.15.104:0/195603281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48bc004d40 0x7f48bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:10.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48cbfff640 1 -- 172.21.15.104:0/195603281 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc003520 con 0x7f48bc0040d0 2024-05-08T04:21:10.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.928+0000 7f48d1142640 1 --2- 172.21.15.104:0/195603281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48bc004d40 0x7f48bc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:10.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.929+0000 7f48cbfff640 1 --2- 172.21.15.104:0/195603281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48bc0040d0 0x7f48bc004800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009ac0 tx=0x7f48bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255dc7574a1dcdc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:10.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.929+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b8036070 con 0x7f48bc0040d0 2024-05-08T04:21:10.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.929+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b8031400 con 0x7f48bc0040d0 2024-05-08T04:21:10.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.929+0000 7f48cb7fe640 1 -- 172.21.15.104:0/195603281 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b8009690 con 0x7f48bc0040d0 2024-05-08T04:21:10.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.930+0000 7f48d2ba5640 1 -- 172.21.15.104:0/195603281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48bc0040d0 msgr2=0x7f48bc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:10.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.930+0000 7f48d2ba5640 1 --2- 172.21.15.104:0/195603281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48bc0040d0 0x7f48bc004800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009ac0 tx=0x7f48bc005830 comp rx=0 tx=0).stop 2024-05-08T04:21:10.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.930+0000 7f48d1142640 1 -- 172.21.15.104:0/195603281 reap_dead start 2024-05-08T04:21:10.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.930+0000 7f48d2ba5640 1 -- 172.21.15.104:0/195603281 shutdown_connections 2024-05-08T04:21:10.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.930+0000 7f48d2ba5640 1 -- 172.21.15.104:0/195603281 >> 172.21.15.104:0/195603281 conn(0x7f48cc072290 msgr2=0x7f48cc072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:10.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.930+0000 7f48d2ba5640 1 -- 172.21.15.104:0/195603281 shutdown_connections 2024-05-08T04:21:10.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.930+0000 7f48d2ba5640 1 -- 172.21.15.104:0/195603281 wait complete. 2024-05-08T04:21:10.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.931+0000 7f48d2ba5640 1 Processor -- start 2024-05-08T04:21:10.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.931+0000 7f48d2ba5640 1 -- start start 2024-05-08T04:21:10.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48d2ba5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48bc0040d0 0x7f48cc14f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:10.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48d2ba5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48cc160b90 0x7f48cc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:10.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48d2ba5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48cc149ed0 0x7f48cc0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:10.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48d2ba5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0d1ce0 con 0x7f48cc160b90 2024-05-08T04:21:10.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48d2ba5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0d1a90 con 0x7f48bc0040d0 2024-05-08T04:21:10.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48d2ba5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0b6dc0 con 0x7f48cc149ed0 2024-05-08T04:21:10.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48cc160b90 0x7f48cc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:10.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48cc160b90 0x7f48cc0cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53034/0 (socket says 172.21.15.104:53034) 2024-05-08T04:21:10.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48cbfff640 1 -- 172.21.15.104:0/729159688 learned_addr learned my addr 172.21.15.104:0/729159688 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:10.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48d0941640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48bc0040d0 0x7f48cc14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:10.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48d1142640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48cc149ed0 0x7f48cc0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:10.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48cbfff640 1 -- 172.21.15.104:0/729159688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48cc149ed0 msgr2=0x7f48cc0ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:10.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48cbfff640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48cc149ed0 0x7f48cc0ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:10.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48cbfff640 1 -- 172.21.15.104:0/729159688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48bc0040d0 msgr2=0x7f48cc14f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:10.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48cbfff640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48bc0040d0 0x7f48cc14f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:10.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48cbfff640 1 -- 172.21.15.104:0/729159688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc160110 con 0x7f48cc160b90 2024-05-08T04:21:10.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48d0941640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48bc0040d0 0x7f48cc14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:10.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48cbfff640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48cc160b90 0x7f48cc0cc600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009be0 tx=0x7f48b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:10.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48c97fa640 1 -- 172.21.15.104:0/729159688 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b8040020 con 0x7f48cc160b90 2024-05-08T04:21:10.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48c97fa640 1 -- 172.21.15.104:0/729159688 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b8003c60 con 0x7f48cc160b90 2024-05-08T04:21:10.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.932+0000 7f48d2ba5640 1 -- 172.21.15.104:0/729159688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc14fb60 con 0x7f48cc160b90 2024-05-08T04:21:10.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.933+0000 7f48c97fa640 1 -- 172.21.15.104:0/729159688 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b8036040 con 0x7f48cc160b90 2024-05-08T04:21:10.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.933+0000 7f48d2ba5640 1 -- 172.21.15.104:0/729159688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc160390 con 0x7f48cc160b90 2024-05-08T04:21:10.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.934+0000 7f48d2ba5640 1 -- 172.21.15.104:0/729159688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc159df0 con 0x7f48cc160b90 2024-05-08T04:21:10.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.934+0000 7f48c97fa640 1 -- 172.21.15.104:0/729159688 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f48b8043020 con 0x7f48cc160b90 2024-05-08T04:21:10.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.934+0000 7f48c97fa640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f48b006b4d0 0x7f48b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:10.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.935+0000 7f48c97fa640 1 -- 172.21.15.104:0/729159688 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48b80aa2a0 con 0x7f48cc160b90 2024-05-08T04:21:10.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.935+0000 7f48d0941640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f48b006b4d0 0x7f48b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:10.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.935+0000 7f48d0941640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f48b006b4d0 0x7f48b006d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f48c0007c40 tx=0x7f48c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:10.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:10.939+0000 7f48c97fa640 1 -- 172.21.15.104:0/729159688 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f48cc159df0 con 0x7f48cc160b90 2024-05-08T04:21:11.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.111+0000 7f48d2ba5640 1 -- 172.21.15.104:0/729159688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48cc075010 con 0x7f48cc160b90 2024-05-08T04:21:11.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.112+0000 7f48c97fa640 1 -- 172.21.15.104:0/729159688 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16682 (secure 0 0 0) 0x7f48b804a070 con 0x7f48cc160b90 2024-05-08T04:21:11.113 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:11.113 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":19,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:10.132999+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:11.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.114+0000 7f48d2ba5640 1 -- 172.21.15.104:0/729159688 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f48b006b4d0 msgr2=0x7f48b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:11.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.114+0000 7f48d2ba5640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f48b006b4d0 0x7f48b006d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f48c0007c40 tx=0x7f48c0009040 comp rx=0 tx=0).stop 2024-05-08T04:21:11.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.114+0000 7f48d2ba5640 1 -- 172.21.15.104:0/729159688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48cc160b90 msgr2=0x7f48cc0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:11.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.114+0000 7f48d2ba5640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48cc160b90 0x7f48cc0cc600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009be0 tx=0x7f48b8004730 comp rx=0 tx=0).stop 2024-05-08T04:21:11.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.114+0000 7f48d2ba5640 1 -- 172.21.15.104:0/729159688 shutdown_connections 2024-05-08T04:21:11.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.114+0000 7f48d2ba5640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f48b006b4d0 0x7f48b006d990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.114+0000 7f48d2ba5640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48cc149ed0 0x7f48cc0ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.114+0000 7f48d2ba5640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48cc160b90 0x7f48cc0cc600 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.114+0000 7f48d2ba5640 1 --2- 172.21.15.104:0/729159688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48bc0040d0 0x7f48cc14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.114+0000 7f48d2ba5640 1 -- 172.21.15.104:0/729159688 >> 172.21.15.104:0/729159688 conn(0x7f48cc072290 msgr2=0x7f48cc0d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:11.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.114+0000 7f48d2ba5640 1 -- 172.21.15.104:0/729159688 shutdown_connections 2024-05-08T04:21:11.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.114+0000 7f48d2ba5640 1 -- 172.21.15.104:0/729159688 wait complete. 2024-05-08T04:21:11.126 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:11.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.224+0000 7efd6c215640 1 Processor -- start 2024-05-08T04:21:11.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.224+0000 7efd6c215640 1 -- start start 2024-05-08T04:21:11.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd6c215640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd64070c70 0x7efd64071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:11.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd6c215640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efd64157ac0 0x7efd64157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd6c215640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd64071590 con 0x7efd6415edf0 2024-05-08T04:21:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd6c215640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6406bc70 con 0x7efd64157ac0 2024-05-08T04:21:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd6c215640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd640d15c0 con 0x7efd64070c70 2024-05-08T04:21:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd697b0640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7efd6415edf0 0x7efd640b52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:40396/0 (socket says 172.21.15.104:40396) 2024-05-08T04:21:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd697b0640 1 -- 172.21.15.104:0/2666570897 learned_addr learned my addr 172.21.15.104:0/2666570897 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd6a7b2640 1 --2- 172.21.15.104:0/2666570897 >> v2:172.21.15.183:3300/0 conn(0x7efd64157ac0 0x7efd64157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd69fb1640 1 --2- 172.21.15.104:0/2666570897 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd64070c70 0x7efd64071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd68faf640 1 -- 172.21.15.104:0/2666570897 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816299453 0 0) 0x7efd64071590 con 0x7efd6415edf0 2024-05-08T04:21:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd68faf640 1 -- 172.21.15.104:0/2666570897 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd50003520 con 0x7efd6415edf0 2024-05-08T04:21:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd69fb1640 1 -- 172.21.15.104:0/2666570897 >> v2:172.21.15.183:3300/0 conn(0x7efd64157ac0 msgr2=0x7efd64157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd69fb1640 1 --2- 172.21.15.104:0/2666570897 >> v2:172.21.15.183:3300/0 conn(0x7efd64157ac0 0x7efd64157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd69fb1640 1 -- 172.21.15.104:0/2666570897 >> v1:172.21.15.104:6789/0 conn(0x7efd6415edf0 legacy=0x7efd640b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:11.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.225+0000 7efd69fb1640 1 -- 172.21.15.104:0/2666570897 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6415f550 con 0x7efd64070c70 2024-05-08T04:21:11.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.226+0000 7efd69fb1640 1 --2- 172.21.15.104:0/2666570897 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd64070c70 0x7efd64071050 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd600097a0 tx=0x7efd6002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c04c2fb692863c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:11.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.226+0000 7efd68faf640 1 -- 172.21.15.104:0/2666570897 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60037070 con 0x7efd64070c70 2024-05-08T04:21:11.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.226+0000 7efd68faf640 1 -- 172.21.15.104:0/2666570897 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd60032440 con 0x7efd64070c70 2024-05-08T04:21:11.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.226+0000 7efd68faf640 1 -- 172.21.15.104:0/2666570897 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600327f0 con 0x7efd64070c70 2024-05-08T04:21:11.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.227+0000 7efd6c215640 1 -- 172.21.15.104:0/2666570897 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd64070c70 msgr2=0x7efd64071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:11.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.227+0000 7efd6c215640 1 --2- 172.21.15.104:0/2666570897 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd64070c70 0x7efd64071050 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd600097a0 tx=0x7efd6002a180 comp rx=0 tx=0).stop 2024-05-08T04:21:11.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.227+0000 7efd6c215640 1 -- 172.21.15.104:0/2666570897 shutdown_connections 2024-05-08T04:21:11.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.227+0000 7efd6c215640 1 --2- 172.21.15.104:0/2666570897 >> v2:172.21.15.183:3300/0 conn(0x7efd64157ac0 0x7efd64157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.227+0000 7efd6c215640 1 --2- 172.21.15.104:0/2666570897 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd64070c70 0x7efd64071050 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.227+0000 7efd6c215640 1 -- 172.21.15.104:0/2666570897 >> 172.21.15.104:0/2666570897 conn(0x7efd640b3450 msgr2=0x7efd640b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:11.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.227+0000 7efd6c215640 1 -- 172.21.15.104:0/2666570897 shutdown_connections 2024-05-08T04:21:11.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.227+0000 7efd6c215640 1 -- 172.21.15.104:0/2666570897 wait complete. 2024-05-08T04:21:11.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.228+0000 7efd6c215640 1 Processor -- start 2024-05-08T04:21:11.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.228+0000 7efd6c215640 1 -- start start 2024-05-08T04:21:11.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd6c215640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd64070c70 0x7efd6413fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:11.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd6c215640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd64157ac0 0x7efd641f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:11.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd6c215640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd6415edf0 0x7efd640b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:11.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd6c215640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd640b5b80 con 0x7efd64070c70 2024-05-08T04:21:11.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd6c215640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6415fb10 con 0x7efd64157ac0 2024-05-08T04:21:11.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd6c215640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd64158490 con 0x7efd6415edf0 2024-05-08T04:21:11.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd69fb1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd64070c70 0x7efd6413fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:11.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd69fb1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd64070c70 0x7efd6413fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53044/0 (socket says 172.21.15.104:53044) 2024-05-08T04:21:11.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd69fb1640 1 -- 172.21.15.104:0/1109750396 learned_addr learned my addr 172.21.15.104:0/1109750396 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:11.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd6a7b2640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd6415edf0 0x7efd640b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:11.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd697b0640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd64157ac0 0x7efd641f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:11.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd69fb1640 1 -- 172.21.15.104:0/1109750396 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd6415edf0 msgr2=0x7efd640b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:11.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd69fb1640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd6415edf0 0x7efd640b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd69fb1640 1 -- 172.21.15.104:0/1109750396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd64157ac0 msgr2=0x7efd641f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:11.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd69fb1640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd64157ac0 0x7efd641f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd69fb1640 1 -- 172.21.15.104:0/1109750396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd641f4400 con 0x7efd64070c70 2024-05-08T04:21:11.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd697b0640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd64157ac0 0x7efd641f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:11.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.229+0000 7efd69fb1640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd64070c70 0x7efd6413fc70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efd60035040 tx=0x7efd600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:11.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.230+0000 7efd5a7fc640 1 -- 172.21.15.104:0/1109750396 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60037050 con 0x7efd64070c70 2024-05-08T04:21:11.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.230+0000 7efd5a7fc640 1 -- 172.21.15.104:0/1109750396 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd60043070 con 0x7efd64070c70 2024-05-08T04:21:11.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.230+0000 7efd6c215640 1 -- 172.21.15.104:0/1109750396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd641f46e0 con 0x7efd64070c70 2024-05-08T04:21:11.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.230+0000 7efd5a7fc640 1 -- 172.21.15.104:0/1109750396 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60006e10 con 0x7efd64070c70 2024-05-08T04:21:11.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.230+0000 7efd6c215640 1 -- 172.21.15.104:0/1109750396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd641f4ca0 con 0x7efd64070c70 2024-05-08T04:21:11.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.231+0000 7efd6c215640 1 -- 172.21.15.104:0/1109750396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd641f5080 con 0x7efd64070c70 2024-05-08T04:21:11.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.233+0000 7efd5a7fc640 1 -- 172.21.15.104:0/1109750396 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efd60032a30 con 0x7efd64070c70 2024-05-08T04:21:11.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.233+0000 7efd5a7fc640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efd4806b4d0 0x7efd4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:11.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.233+0000 7efd5a7fc640 1 -- 172.21.15.104:0/1109750396 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd600ab8c0 con 0x7efd64070c70 2024-05-08T04:21:11.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.233+0000 7efd697b0640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efd4806b4d0 0x7efd4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:11.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.234+0000 7efd697b0640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efd4806b4d0 0x7efd4806d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd640b32d0 tx=0x7efd54009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:11.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.237+0000 7efd5a7fc640 1 -- 172.21.15.104:0/1109750396 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efd641f5080 con 0x7efd64070c70 2024-05-08T04:21:11.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.407+0000 7efd6c215640 1 -- 172.21.15.104:0/1109750396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd64075010 con 0x7efd64070c70 2024-05-08T04:21:11.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.408+0000 7efd5a7fc640 1 -- 172.21.15.104:0/1109750396 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16682 (secure 0 0 0) 0x7efd6007a820 con 0x7efd64070c70 2024-05-08T04:21:11.409 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:11.410 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":19,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:10.132999+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:11.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.410+0000 7efd6c215640 1 -- 172.21.15.104:0/1109750396 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efd4806b4d0 msgr2=0x7efd4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:11.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.410+0000 7efd6c215640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efd4806b4d0 0x7efd4806d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd640b32d0 tx=0x7efd54009040 comp rx=0 tx=0).stop 2024-05-08T04:21:11.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.410+0000 7efd6c215640 1 -- 172.21.15.104:0/1109750396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd64070c70 msgr2=0x7efd6413fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:11.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.410+0000 7efd6c215640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd64070c70 0x7efd6413fc70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efd60035040 tx=0x7efd600046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.410+0000 7efd6c215640 1 -- 172.21.15.104:0/1109750396 shutdown_connections 2024-05-08T04:21:11.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.410+0000 7efd6c215640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efd4806b4d0 0x7efd4806d990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.410+0000 7efd6c215640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd64157ac0 0x7efd641f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.410+0000 7efd6c215640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd6415edf0 0x7efd640b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.410+0000 7efd6c215640 1 --2- 172.21.15.104:0/1109750396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd64070c70 0x7efd6413fc70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.410+0000 7efd6c215640 1 -- 172.21.15.104:0/1109750396 >> 172.21.15.104:0/1109750396 conn(0x7efd640b3450 msgr2=0x7efd64156640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:11.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.410+0000 7efd6c215640 1 -- 172.21.15.104:0/1109750396 shutdown_connections 2024-05-08T04:21:11.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.410+0000 7efd6c215640 1 -- 172.21.15.104:0/1109750396 wait complete. 2024-05-08T04:21:11.422 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T04:21:11.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.523+0000 7fb63b46a640 1 Processor -- start 2024-05-08T04:21:11.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.523+0000 7fb63b46a640 1 -- start start 2024-05-08T04:21:11.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb63b46a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb63415db30 0x7fb63406bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:11.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb63b46a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6340b93b0 0x7fb6340b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:11.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb63b46a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb6340b5970 0x7fb634161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:11.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb63b46a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6340b6b50 con 0x7fb63415db30 2024-05-08T04:21:11.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb63b46a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63406c800 con 0x7fb6340b5970 2024-05-08T04:21:11.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb63b46a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63406cae0 con 0x7fb6340b93b0 2024-05-08T04:21:11.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb639206640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb63415db30 0x7fb63406bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:11.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb639206640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb63415db30 0x7fb63406bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53058/0 (socket says 172.21.15.104:53058) 2024-05-08T04:21:11.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb639206640 1 -- 172.21.15.104:0/180796968 learned_addr learned my addr 172.21.15.104:0/180796968 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:11.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb639a07640 1 --2- 172.21.15.104:0/180796968 >> v2:172.21.15.183:3300/0 conn(0x7fb6340b5970 0x7fb634161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:11.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb638a05640 1 --2- 172.21.15.104:0/180796968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6340b93b0 0x7fb6340b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:11.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb639206640 1 -- 172.21.15.104:0/180796968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6340b93b0 msgr2=0x7fb6340b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:11.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb639206640 1 --2- 172.21.15.104:0/180796968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6340b93b0 0x7fb6340b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb639206640 1 -- 172.21.15.104:0/180796968 >> v2:172.21.15.183:3300/0 conn(0x7fb6340b5970 msgr2=0x7fb634161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:11.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb639206640 1 --2- 172.21.15.104:0/180796968 >> v2:172.21.15.183:3300/0 conn(0x7fb6340b5970 0x7fb634161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb639206640 1 -- 172.21.15.104:0/180796968 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63406cdc0 con 0x7fb63415db30 2024-05-08T04:21:11.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.524+0000 7fb639a07640 1 --2- 172.21.15.104:0/180796968 >> v2:172.21.15.183:3300/0 conn(0x7fb6340b5970 0x7fb634161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:11.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.525+0000 7fb639206640 1 --2- 172.21.15.104:0/180796968 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb63415db30 0x7fb63406bfb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb6340b6550 tx=0x7fb63002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26d23b9ccd6f3eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:11.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.525+0000 7fb62bfff640 1 -- 172.21.15.104:0/180796968 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630036070 con 0x7fb63415db30 2024-05-08T04:21:11.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.525+0000 7fb62bfff640 1 -- 172.21.15.104:0/180796968 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb630031600 con 0x7fb63415db30 2024-05-08T04:21:11.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.525+0000 7fb62bfff640 1 -- 172.21.15.104:0/180796968 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300319d0 con 0x7fb63415db30 2024-05-08T04:21:11.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.526+0000 7fb63b46a640 1 -- 172.21.15.104:0/180796968 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb63415db30 msgr2=0x7fb63406bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:11.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.526+0000 7fb63b46a640 1 --2- 172.21.15.104:0/180796968 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb63415db30 0x7fb63406bfb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb6340b6550 tx=0x7fb63002a6a0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.526+0000 7fb63b46a640 1 -- 172.21.15.104:0/180796968 shutdown_connections 2024-05-08T04:21:11.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.526+0000 7fb63b46a640 1 --2- 172.21.15.104:0/180796968 >> v2:172.21.15.183:3300/0 conn(0x7fb6340b5970 0x7fb634161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.526+0000 7fb63b46a640 1 --2- 172.21.15.104:0/180796968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6340b93b0 0x7fb6340b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.526+0000 7fb63b46a640 1 --2- 172.21.15.104:0/180796968 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb63415db30 0x7fb63406bfb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.526+0000 7fb63b46a640 1 -- 172.21.15.104:0/180796968 >> 172.21.15.104:0/180796968 conn(0x7fb6340d0430 msgr2=0x7fb6340d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:11.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.526+0000 7fb63b46a640 1 -- 172.21.15.104:0/180796968 shutdown_connections 2024-05-08T04:21:11.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.526+0000 7fb63b46a640 1 -- 172.21.15.104:0/180796968 wait complete. 2024-05-08T04:21:11.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.527+0000 7fb63b46a640 1 Processor -- start 2024-05-08T04:21:11.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.527+0000 7fb63b46a640 1 -- start start 2024-05-08T04:21:11.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.527+0000 7fb63b46a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6340b5970 0x7fb6341f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:11.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb63b46a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6340b93b0 0x7fb63415be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:11.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb63b46a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb63415db30 0x7fb63415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:11.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb63b46a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63415df10 con 0x7fb6340b93b0 2024-05-08T04:21:11.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb63b46a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63406c4f0 con 0x7fb6340b5970 2024-05-08T04:21:11.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb63b46a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6341f79b0 con 0x7fb63415db30 2024-05-08T04:21:11.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb638a05640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6340b93b0 0x7fb63415be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:11.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb638a05640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6340b93b0 0x7fb63415be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53062/0 (socket says 172.21.15.104:53062) 2024-05-08T04:21:11.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb638a05640 1 -- 172.21.15.104:0/1506399419 learned_addr learned my addr 172.21.15.104:0/1506399419 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:11.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb639206640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6340b5970 0x7fb6341f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:11.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb639a07640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb63415db30 0x7fb63415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:11.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb638a05640 1 -- 172.21.15.104:0/1506399419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb63415db30 msgr2=0x7fb63415c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:11.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb638a05640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb63415db30 0x7fb63415c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb638a05640 1 -- 172.21.15.104:0/1506399419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6340b5970 msgr2=0x7fb6341f7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:11.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb638a05640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6340b5970 0x7fb6341f7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:11.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb638a05640 1 -- 172.21.15.104:0/1506399419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6341f3780 con 0x7fb6340b93b0 2024-05-08T04:21:11.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb639a07640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb63415db30 0x7fb63415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:11.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb638a05640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6340b93b0 0x7fb63415be10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb62400d800 tx=0x7fb62400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:11.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb629ffb640 1 -- 172.21.15.104:0/1506399419 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62400b6c0 con 0x7fb6340b93b0 2024-05-08T04:21:11.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb629ffb640 1 -- 172.21.15.104:0/1506399419 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb624019070 con 0x7fb6340b93b0 2024-05-08T04:21:11.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb629ffb640 1 -- 172.21.15.104:0/1506399419 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62400ba80 con 0x7fb6340b93b0 2024-05-08T04:21:11.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb63b46a640 1 -- 172.21.15.104:0/1506399419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6341f3d40 con 0x7fb6340b93b0 2024-05-08T04:21:11.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.528+0000 7fb63b46a640 1 -- 172.21.15.104:0/1506399419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6341f4300 con 0x7fb6340b93b0 2024-05-08T04:21:11.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.529+0000 7fb63b46a640 1 -- 172.21.15.104:0/1506399419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb634155a60 con 0x7fb6340b93b0 2024-05-08T04:21:11.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.530+0000 7fb629ffb640 1 -- 172.21.15.104:0/1506399419 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb62400bc20 con 0x7fb6340b93b0 2024-05-08T04:21:11.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.530+0000 7fb629ffb640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb61806b4d0 0x7fb61806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:11.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.530+0000 7fb629ffb640 1 -- 172.21.15.104:0/1506399419 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb62408a580 con 0x7fb6340b93b0 2024-05-08T04:21:11.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.530+0000 7fb639206640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb61806b4d0 0x7fb61806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:11.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.531+0000 7fb639206640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb61806b4d0 0x7fb61806d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb630033000 tx=0x7fb630009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:11.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.534+0000 7fb629ffb640 1 -- 172.21.15.104:0/1506399419 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb624059490 con 0x7fb6340b93b0 2024-05-08T04:21:11.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:11.742+0000 7fb63b46a640 1 -- 172.21.15.104:0/1506399419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb634075010 con 0x7fb6340b93b0 2024-05-08T04:21:12.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.232+0000 7fb629ffb640 1 -- 172.21.15.104:0/1506399419 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb624058d90 con 0x7fb6340b93b0 2024-05-08T04:21:12.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.235+0000 7fb63b46a640 1 -- 172.21.15.104:0/1506399419 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb61806b4d0 msgr2=0x7fb61806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:12.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.235+0000 7fb63b46a640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb61806b4d0 0x7fb61806d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb630033000 tx=0x7fb630009000 comp rx=0 tx=0).stop 2024-05-08T04:21:12.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.235+0000 7fb63b46a640 1 -- 172.21.15.104:0/1506399419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6340b93b0 msgr2=0x7fb63415be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:12.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.235+0000 7fb63b46a640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6340b93b0 0x7fb63415be10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb62400d800 tx=0x7fb62400dcc0 comp rx=0 tx=0).stop 2024-05-08T04:21:12.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.235+0000 7fb63b46a640 1 -- 172.21.15.104:0/1506399419 shutdown_connections 2024-05-08T04:21:12.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.235+0000 7fb63b46a640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb61806b4d0 0x7fb61806d990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:12.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.235+0000 7fb63b46a640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb63415db30 0x7fb63415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:12.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.235+0000 7fb63b46a640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6340b93b0 0x7fb63415be10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:12.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.235+0000 7fb63b46a640 1 --2- 172.21.15.104:0/1506399419 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6340b5970 0x7fb6341f7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:12.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.235+0000 7fb63b46a640 1 -- 172.21.15.104:0/1506399419 >> 172.21.15.104:0/1506399419 conn(0x7fb6340d0430 msgr2=0x7fb6340b70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:12.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.235+0000 7fb63b46a640 1 -- 172.21.15.104:0/1506399419 shutdown_connections 2024-05-08T04:21:12.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.235+0000 7fb63b46a640 1 -- 172.21.15.104:0/1506399419 wait complete. 2024-05-08T04:21:12.249 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-08T04:21:12.249 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-08T04:21:12.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.356+0000 7fefc41b0640 1 Processor -- start 2024-05-08T04:21:12.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.356+0000 7fefc41b0640 1 -- start start 2024-05-08T04:21:12.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.357+0000 7fefc41b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc0d35c0 0x7fefbc0b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:12.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.357+0000 7fefc41b0640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefbc0b9920 con 0x7fefbc15dad0 2024-05-08T04:21:12.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.357+0000 7fefc41b0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefbc0d2520 con 0x7fefbc0b59c0 2024-05-08T04:21:12.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.357+0000 7fefc41b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0b5e10 con 0x7fefbc0d35c0 2024-05-08T04:21:12.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.357+0000 7fefc1f4c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fefbc15dad0 0x7fefbc0d1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:40408/0 (socket says 172.21.15.104:40408) 2024-05-08T04:21:12.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.357+0000 7fefc1f4c640 1 -- 172.21.15.104:0/3259416582 learned_addr learned my addr 172.21.15.104:0/3259416582 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:12.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935223953 0 0) 0x7fefbc0b9920 con 0x7fefbc15dad0 2024-05-08T04:21:12.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefa8003520 con 0x7fefbc15dad0 2024-05-08T04:21:12.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc174b640 1 --2- 172.21.15.104:0/3259416582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc0d35c0 0x7fefbc0b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:12.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 691424553 0 0) 0x7fefa8003520 con 0x7fefbc15dad0 2024-05-08T04:21:12.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc0d35c0 msgr2=0x7fefbc0b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:12.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 --2- 172.21.15.104:0/3259416582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc0d35c0 0x7fefbc0b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:12.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 >> v1:172.21.15.183:6789/0 conn(0x7fefbc0b59c0 legacy=0x7fefbc0b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:12.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc0d2800 con 0x7fefbc15dad0 2024-05-08T04:21:12.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fefb8001670 con 0x7fefbc15dad0 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 >> v1:172.21.15.104:6789/0 conn(0x7fefbc15dad0 legacy=0x7fefbc0d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 --2- 172.21.15.104:0/3259416582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefa80039e0 0x7fefa8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 --2- 172.21.15.104:0/3259416582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc0d35c0 0x7fefa8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 --2- 172.21.15.104:0/3259416582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefa8004d40 0x7fefa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0b5e10 con 0x7fefa80039e0 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa800baa0 con 0x7fefa8004d40 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa800bca0 con 0x7fefbc0d35c0 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc1f4c640 1 --2- 172.21.15.104:0/3259416582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefa80039e0 0x7fefa8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc174b640 1 --2- 172.21.15.104:0/3259416582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc0d35c0 0x7fefa8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc274d640 1 --2- 172.21.15.104:0/3259416582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefa8004d40 0x7fefa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc1f4c640 1 -- 172.21.15.104:0/3259416582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc0d35c0 msgr2=0x7fefa8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc1f4c640 1 --2- 172.21.15.104:0/3259416582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc0d35c0 0x7fefa8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc1f4c640 1 -- 172.21.15.104:0/3259416582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefa8004d40 msgr2=0x7fefa80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:12.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc1f4c640 1 --2- 172.21.15.104:0/3259416582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefa8004d40 0x7fefa80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:12.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc1f4c640 1 -- 172.21.15.104:0/3259416582 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa8003520 con 0x7fefa80039e0 2024-05-08T04:21:12.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.358+0000 7fefc174b640 1 --2- 172.21.15.104:0/3259416582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc0d35c0 0x7fefa8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:12.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.359+0000 7fefc1f4c640 1 --2- 172.21.15.104:0/3259416582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefa80039e0 0x7fefa8003dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fefb800c240 tx=0x7fefa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565f3cda33acc5db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:12.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.359+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb8007d10 con 0x7fefa80039e0 2024-05-08T04:21:12.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.359+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb8005ad0 con 0x7fefa80039e0 2024-05-08T04:21:12.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.359+0000 7fefc0f4a640 1 -- 172.21.15.104:0/3259416582 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb8007070 con 0x7fefa80039e0 2024-05-08T04:21:12.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.360+0000 7fefc41b0640 1 -- 172.21.15.104:0/3259416582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefa80039e0 msgr2=0x7fefa8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:12.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.360+0000 7fefc41b0640 1 --2- 172.21.15.104:0/3259416582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefa80039e0 0x7fefa8003dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fefb800c240 tx=0x7fefa8005830 comp rx=0 tx=0).stop 2024-05-08T04:21:12.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.360+0000 7fefc274d640 1 -- 172.21.15.104:0/3259416582 reap_dead start 2024-05-08T04:21:12.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.360+0000 7fefc41b0640 1 -- 172.21.15.104:0/3259416582 shutdown_connections 2024-05-08T04:21:12.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.360+0000 7fefc41b0640 1 -- 172.21.15.104:0/3259416582 >> 172.21.15.104:0/3259416582 conn(0x7fefbc06c650 msgr2=0x7fefbc0d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:12.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.360+0000 7fefc41b0640 1 -- 172.21.15.104:0/3259416582 shutdown_connections 2024-05-08T04:21:12.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.360+0000 7fefc41b0640 1 -- 172.21.15.104:0/3259416582 wait complete. 2024-05-08T04:21:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.361+0000 7fefc41b0640 1 Processor -- start 2024-05-08T04:21:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.361+0000 7fefc41b0640 1 -- start start 2024-05-08T04:21:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc41b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefa80039e0 0x7fefbc0aac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc41b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc1f7990 0x7fefbc14ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc41b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefbc0cbb20 0x7fefbc0cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc41b0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0d30a0 con 0x7fefa80039e0 2024-05-08T04:21:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc41b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0d2dc0 con 0x7fefbc0cbb20 2024-05-08T04:21:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc41b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefbc0d2170 con 0x7fefbc1f7990 2024-05-08T04:21:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc1f4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefa80039e0 0x7fefbc0aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc1f4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefa80039e0 0x7fefbc0aac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53088/0 (socket says 172.21.15.104:53088) 2024-05-08T04:21:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc1f4c640 1 -- 172.21.15.104:0/688712364 learned_addr learned my addr 172.21.15.104:0/688712364 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc174b640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc1f7990 0x7fefbc14ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc274d640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefbc0cbb20 0x7fefbc0cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc1f4c640 1 -- 172.21.15.104:0/688712364 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc1f7990 msgr2=0x7fefbc14ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc1f4c640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc1f7990 0x7fefbc14ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc1f4c640 1 -- 172.21.15.104:0/688712364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefbc0cbb20 msgr2=0x7fefbc0cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc1f4c640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefbc0cbb20 0x7fefbc0cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc1f4c640 1 -- 172.21.15.104:0/688712364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc1f7e10 con 0x7fefa80039e0 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc174b640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc1f7990 0x7fefbc14ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc274d640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefbc0cbb20 0x7fefbc0cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc1f4c640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefa80039e0 0x7fefbc0aac50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fefb8034040 tx=0x7fefbc0d26f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefb27fc640 1 -- 172.21.15.104:0/688712364 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb8042070 con 0x7fefa80039e0 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefb27fc640 1 -- 172.21.15.104:0/688712364 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb8007270 con 0x7fefa80039e0 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefb27fc640 1 -- 172.21.15.104:0/688712364 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb8007620 con 0x7fefa80039e0 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc41b0640 1 -- 172.21.15.104:0/688712364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefbc15f1f0 con 0x7fefa80039e0 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.362+0000 7fefc41b0640 1 -- 172.21.15.104:0/688712364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefbc15f7b0 con 0x7fefa80039e0 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.363+0000 7fefc41b0640 1 -- 172.21.15.104:0/688712364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefbc075010 con 0x7fefa80039e0 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.364+0000 7fefb27fc640 1 -- 172.21.15.104:0/688712364 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fefb8045070 con 0x7fefa80039e0 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.364+0000 7fefb27fc640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fefa006b4d0 0x7fefa006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.364+0000 7fefb27fc640 1 -- 172.21.15.104:0/688712364 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefb80aacc0 con 0x7fefa80039e0 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.364+0000 7fefc174b640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fefa006b4d0 0x7fefa006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.365+0000 7fefc174b640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fefa006b4d0 0x7fefa006d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fefbc156fb0 tx=0x7fefac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:12.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.368+0000 7fefb27fc640 1 -- 172.21.15.104:0/688712364 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fefb80b1080 con 0x7fefa80039e0 2024-05-08T04:21:12.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:12.574+0000 7fefc41b0640 1 -- 172.21.15.104:0/688712364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fefbc15d0f0 con 0x7fefa80039e0 2024-05-08T04:21:13.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.236+0000 7fefb27fc640 1 -- 172.21.15.104:0/688712364 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fefb804c030 con 0x7fefa80039e0 2024-05-08T04:21:13.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.238+0000 7fefc41b0640 1 -- 172.21.15.104:0/688712364 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fefa006b4d0 msgr2=0x7fefa006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.238+0000 7fefc41b0640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fefa006b4d0 0x7fefa006d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fefbc156fb0 tx=0x7fefac008040 comp rx=0 tx=0).stop 2024-05-08T04:21:13.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.238+0000 7fefc41b0640 1 -- 172.21.15.104:0/688712364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefa80039e0 msgr2=0x7fefbc0aac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.238+0000 7fefc41b0640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefa80039e0 0x7fefbc0aac50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fefb8034040 tx=0x7fefbc0d26f0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.238+0000 7fefc41b0640 1 -- 172.21.15.104:0/688712364 shutdown_connections 2024-05-08T04:21:13.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.238+0000 7fefc41b0640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fefa006b4d0 0x7fefa006d990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.238+0000 7fefc41b0640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefbc0cbb20 0x7fefbc0cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.238+0000 7fefc41b0640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefbc1f7990 0x7fefbc14ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.238+0000 7fefc41b0640 1 --2- 172.21.15.104:0/688712364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefa80039e0 0x7fefbc0aac50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.238+0000 7fefc41b0640 1 -- 172.21.15.104:0/688712364 >> 172.21.15.104:0/688712364 conn(0x7fefbc06c650 msgr2=0x7fefbc0b8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:13.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.238+0000 7fefc41b0640 1 -- 172.21.15.104:0/688712364 shutdown_connections 2024-05-08T04:21:13.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.238+0000 7fefc41b0640 1 -- 172.21.15.104:0/688712364 wait complete. 2024-05-08T04:21:13.251 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-08T04:21:13.251 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:21:13.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.351+0000 7f170ffb7640 1 Processor -- start 2024-05-08T04:21:13.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.351+0000 7f170ffb7640 1 -- start start 2024-05-08T04:21:13.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.352+0000 7f170ffb7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f17080b9620 0x7f17080ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.352+0000 7f170ffb7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17080cecc0 0x7f17080b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.352+0000 7f170ffb7640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17080d25a0 con 0x7f1708161090 2024-05-08T04:21:13.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.352+0000 7f170ffb7640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17080cf120 con 0x7f17080b9620 2024-05-08T04:21:13.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.352+0000 7f170ffb7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17080d2880 con 0x7f17080cecc0 2024-05-08T04:21:13.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.352+0000 7f170d552640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f17080b9620 0x7f17080ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.352+0000 7f170dd53640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f1708161090 0x7f17080d1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:40420/0 (socket says 172.21.15.104:40420) 2024-05-08T04:21:13.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.352+0000 7f170dd53640 1 -- 172.21.15.104:0/762811045 learned_addr learned my addr 172.21.15.104:0/762811045 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:13.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.353+0000 7f170e554640 1 --2- 172.21.15.104:0/762811045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17080cecc0 0x7f17080b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.353+0000 7f170d552640 1 -- 172.21.15.104:0/762811045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17080cecc0 msgr2=0x7f17080b6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:13.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.353+0000 7f170d552640 1 --2- 172.21.15.104:0/762811045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17080cecc0 0x7f17080b6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.353+0000 7f170d552640 1 -- 172.21.15.104:0/762811045 >> v1:172.21.15.104:6789/0 conn(0x7f1708161090 legacy=0x7f17080d1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.353+0000 7f170d552640 1 -- 172.21.15.104:0/762811045 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17080d2b60 con 0x7f17080b9620 2024-05-08T04:21:13.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.353+0000 7f170cd51640 1 -- 172.21.15.104:0/762811045 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213343665 0 0) 0x7f17080d25a0 con 0x7f1708161090 2024-05-08T04:21:13.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.353+0000 7f170d552640 1 --2- 172.21.15.104:0/762811045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17080b9620 0x7f17080ce780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f16f80097a0 tx=0x7f16f802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e963c7d78689fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:13.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.353+0000 7f170cd51640 1 -- 172.21.15.104:0/762811045 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8037070 con 0x7f17080b9620 2024-05-08T04:21:13.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.353+0000 7f170cd51640 1 -- 172.21.15.104:0/762811045 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f802ae50 con 0x7f17080b9620 2024-05-08T04:21:13.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.353+0000 7f170cd51640 1 -- 172.21.15.104:0/762811045 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8032660 con 0x7f17080b9620 2024-05-08T04:21:13.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.354+0000 7f170ffb7640 1 -- 172.21.15.104:0/762811045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17080b9620 msgr2=0x7f17080ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.354+0000 7f170ffb7640 1 --2- 172.21.15.104:0/762811045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17080b9620 0x7f17080ce780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f16f80097a0 tx=0x7f16f802a100 comp rx=0 tx=0).stop 2024-05-08T04:21:13.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.354+0000 7f170ffb7640 1 -- 172.21.15.104:0/762811045 shutdown_connections 2024-05-08T04:21:13.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.354+0000 7f170ffb7640 1 --2- 172.21.15.104:0/762811045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17080cecc0 0x7f17080b6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.354+0000 7f170ffb7640 1 --2- 172.21.15.104:0/762811045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17080b9620 0x7f17080ce780 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.354+0000 7f170ffb7640 1 -- 172.21.15.104:0/762811045 >> 172.21.15.104:0/762811045 conn(0x7f170806c400 msgr2=0x7f170806c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:13.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.354+0000 7f170ffb7640 1 -- 172.21.15.104:0/762811045 shutdown_connections 2024-05-08T04:21:13.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.354+0000 7f170ffb7640 1 -- 172.21.15.104:0/762811045 wait complete. 2024-05-08T04:21:13.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.355+0000 7f170ffb7640 1 Processor -- start 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.355+0000 7f170ffb7640 1 -- start start 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170ffb7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17080b9620 0x7f17081466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170ffb7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17080cecc0 0x7f170815de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170ffb7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1708161090 0x7f17080cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170ffb7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1708161470 con 0x7f1708161090 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170ffb7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17080d3640 con 0x7f17080b9620 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170ffb7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17080b7090 con 0x7f17080cecc0 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170e554640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1708161090 0x7f17080cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170e554640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1708161090 0x7f17080cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53102/0 (socket says 172.21.15.104:53102) 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170e554640 1 -- 172.21.15.104:0/828391706 learned_addr learned my addr 172.21.15.104:0/828391706 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170d552640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17080cecc0 0x7f170815de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170dd53640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17080b9620 0x7f17081466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170e554640 1 -- 172.21.15.104:0/828391706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17080cecc0 msgr2=0x7f170815de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170e554640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17080cecc0 0x7f170815de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170e554640 1 -- 172.21.15.104:0/828391706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17080b9620 msgr2=0x7f17081466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170e554640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17080b9620 0x7f17081466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.356+0000 7f170e554640 1 -- 172.21.15.104:0/828391706 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1708143b70 con 0x7f1708161090 2024-05-08T04:21:13.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.357+0000 7f170e554640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1708161090 0x7f17080cc340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f170000d800 tx=0x7f170000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:13.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.357+0000 7f16fe7fc640 1 -- 172.21.15.104:0/828391706 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170000b6c0 con 0x7f1708161090 2024-05-08T04:21:13.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.357+0000 7f16fe7fc640 1 -- 172.21.15.104:0/828391706 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1700019070 con 0x7f1708161090 2024-05-08T04:21:13.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.357+0000 7f16fe7fc640 1 -- 172.21.15.104:0/828391706 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170000bac0 con 0x7f1708161090 2024-05-08T04:21:13.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.357+0000 7f170ffb7640 1 -- 172.21.15.104:0/828391706 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170815e720 con 0x7f1708161090 2024-05-08T04:21:13.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.357+0000 7f170ffb7640 1 -- 172.21.15.104:0/828391706 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170815ece0 con 0x7f1708161090 2024-05-08T04:21:13.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.358+0000 7f170ffb7640 1 -- 172.21.15.104:0/828391706 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1708143d40 con 0x7f1708161090 2024-05-08T04:21:13.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.358+0000 7f16fe7fc640 1 -- 172.21.15.104:0/828391706 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f170000bc60 con 0x7f1708161090 2024-05-08T04:21:13.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.358+0000 7f16fe7fc640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f16ec06b500 0x7f16ec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.359+0000 7f16fe7fc640 1 -- 172.21.15.104:0/828391706 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f170008a4d0 con 0x7f1708161090 2024-05-08T04:21:13.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.359+0000 7f170dd53640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f16ec06b500 0x7f16ec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.359+0000 7f170dd53640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f16ec06b500 0x7f16ec06d9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17040012e0 tx=0x7f1704001630 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:13.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.363+0000 7f16fe7fc640 1 -- 172.21.15.104:0/828391706 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1700058d00 con 0x7f1708161090 2024-05-08T04:21:13.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.571+0000 7f170ffb7640 1 -- 172.21.15.104:0/828391706 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17080ce780 con 0x7f1708161090 2024-05-08T04:21:13.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.572+0000 7f16fe7fc640 1 -- 172.21.15.104:0/828391706 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f17080ce780 con 0x7f1708161090 2024-05-08T04:21:13.573 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:13.573 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/446112297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":446112297},{"type":"v1","addr":"172.21.15.183:6834","nonce":446112297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/702726775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":702726775},{"type":"v1","addr":"172.21.15.183:6835","nonce":702726775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/1820805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1820805788},{"type":"v1","addr":"172.21.15.104:6836","nonce":1820805788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:21:10.133307+0000","modified":"2024-05-08T04:21:12.575912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/610189872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":610189872},{"type":"v1","addr":"172.21.15.104:6837","nonce":610189872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T04:21:13.573 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-05-08T04:21:13.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.574+0000 7f170ffb7640 1 -- 172.21.15.104:0/828391706 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f16ec06b500 msgr2=0x7f16ec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.574+0000 7f170ffb7640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f16ec06b500 0x7f16ec06d9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17040012e0 tx=0x7f1704001630 comp rx=0 tx=0).stop 2024-05-08T04:21:13.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.574+0000 7f170ffb7640 1 -- 172.21.15.104:0/828391706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1708161090 msgr2=0x7f17080cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.574+0000 7f170ffb7640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1708161090 0x7f17080cc340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f170000d800 tx=0x7f170000dcc0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.574+0000 7f170ffb7640 1 -- 172.21.15.104:0/828391706 shutdown_connections 2024-05-08T04:21:13.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.574+0000 7f170ffb7640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f16ec06b500 0x7f16ec06d9c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.574+0000 7f170ffb7640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1708161090 0x7f17080cc340 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.574+0000 7f170ffb7640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17080cecc0 0x7f170815de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.574+0000 7f170ffb7640 1 --2- 172.21.15.104:0/828391706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17080b9620 0x7f17081466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.574+0000 7f170ffb7640 1 -- 172.21.15.104:0/828391706 >> 172.21.15.104:0/828391706 conn(0x7f170806c400 msgr2=0x7f17080b7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:13.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.574+0000 7f170ffb7640 1 -- 172.21.15.104:0/828391706 shutdown_connections 2024-05-08T04:21:13.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.574+0000 7f170ffb7640 1 -- 172.21.15.104:0/828391706 wait complete. 2024-05-08T04:21:13.586 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:13.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.683+0000 7ff42c693640 1 Processor -- start 2024-05-08T04:21:13.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.684+0000 7ff42c693640 1 -- start start 2024-05-08T04:21:13.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42c693640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff42406e9a0 0x7ff42416cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42c693640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff424162f30 con 0x7ff4240b29f0 2024-05-08T04:21:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42c693640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff424163210 con 0x7ff4240711c0 2024-05-08T04:21:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42c693640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4240af1c0 con 0x7ff42406e9a0 2024-05-08T04:21:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff429c2e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff4240b29f0 0x7ff4241625d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:40426/0 (socket says 172.21.15.104:40426) 2024-05-08T04:21:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff429c2e640 1 -- 172.21.15.104:0/175958190 learned_addr learned my addr 172.21.15.104:0/175958190 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42ac30640 1 --2- 172.21.15.104:0/175958190 >> v2:172.21.15.183:3300/0 conn(0x7ff42406e9a0 0x7ff42416cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650884912 0 0) 0x7ff424162f30 con 0x7ff4240b29f0 2024-05-08T04:21:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff410003520 con 0x7ff4240b29f0 2024-05-08T04:21:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 852810849 0 0) 0x7ff410003520 con 0x7ff4240b29f0 2024-05-08T04:21:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 >> v2:172.21.15.183:3300/0 conn(0x7ff42406e9a0 msgr2=0x7ff42416cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 --2- 172.21.15.104:0/175958190 >> v2:172.21.15.183:3300/0 conn(0x7ff42406e9a0 0x7ff42416cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 >> v1:172.21.15.183:6789/0 conn(0x7ff4240711c0 legacy=0x7ff4240715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4241634f0 con 0x7ff4240b29f0 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7ff414001670 con 0x7ff4240b29f0 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 >> v1:172.21.15.104:6789/0 conn(0x7ff4240b29f0 legacy=0x7ff4241625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 --2- 172.21.15.104:0/175958190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4100039b0 0x7ff410003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 --2- 172.21.15.104:0/175958190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4100043b0 0x7ff410004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 --2- 172.21.15.104:0/175958190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff410005080 0x7ff41000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240af1c0 con 0x7ff410005080 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41000bfe0 con 0x7ff4100043b0 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41000c1e0 con 0x7ff4100039b0 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42ac30640 1 --2- 172.21.15.104:0/175958190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff410005080 0x7ff41000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff42a42f640 1 --2- 172.21.15.104:0/175958190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4100039b0 0x7ff410003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.685+0000 7ff429c2e640 1 --2- 172.21.15.104:0/175958190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4100043b0 0x7ff410004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.686+0000 7ff42ac30640 1 -- 172.21.15.104:0/175958190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4100039b0 msgr2=0x7ff410003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.686+0000 7ff42ac30640 1 --2- 172.21.15.104:0/175958190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4100039b0 0x7ff410003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.686+0000 7ff42ac30640 1 -- 172.21.15.104:0/175958190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4100043b0 msgr2=0x7ff410004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:13.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.686+0000 7ff42ac30640 1 --2- 172.21.15.104:0/175958190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4100043b0 0x7ff410004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.686+0000 7ff42ac30640 1 -- 172.21.15.104:0/175958190 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff410003520 con 0x7ff410005080 2024-05-08T04:21:13.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.686+0000 7ff42ac30640 1 -- 172.21.15.104:0/175958190 reap_dead start 2024-05-08T04:21:13.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.686+0000 7ff42ac30640 1 --2- 172.21.15.104:0/175958190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff410005080 0x7ff41000b9c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff41c009f90 tx=0x7ff410005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4b313dbbef56a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:13.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.686+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c009c10 con 0x7ff410005080 2024-05-08T04:21:13.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.686+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c031440 con 0x7ff410005080 2024-05-08T04:21:13.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.686+0000 7ff42942d640 1 -- 172.21.15.104:0/175958190 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c031810 con 0x7ff410005080 2024-05-08T04:21:13.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.687+0000 7ff42c693640 1 -- 172.21.15.104:0/175958190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff410005080 msgr2=0x7ff41000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.687+0000 7ff42c693640 1 --2- 172.21.15.104:0/175958190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff410005080 0x7ff41000b9c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff41c009f90 tx=0x7ff410005830 comp rx=0 tx=0).stop 2024-05-08T04:21:13.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.687+0000 7ff42c693640 1 -- 172.21.15.104:0/175958190 shutdown_connections 2024-05-08T04:21:13.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.687+0000 7ff42c693640 1 --2- 172.21.15.104:0/175958190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff410005080 0x7ff41000b9c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.687+0000 7ff42c693640 1 -- 172.21.15.104:0/175958190 >> 172.21.15.104:0/175958190 conn(0x7ff4240b13f0 msgr2=0x7ff4240b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:13.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.687+0000 7ff42c693640 1 -- 172.21.15.104:0/175958190 shutdown_connections 2024-05-08T04:21:13.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.687+0000 7ff42c693640 1 -- 172.21.15.104:0/175958190 wait complete. 2024-05-08T04:21:13.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.688+0000 7ff42c693640 1 Processor -- start 2024-05-08T04:21:13.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.688+0000 7ff42c693640 1 -- start start 2024-05-08T04:21:13.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff42c693640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff410005080 0x7ff424160670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff42c693640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff42414f3c0 0x7ff42414f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff42c693640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4241fb590 0x7ff4241fba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff42c693640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240715a0 con 0x7ff42414f3c0 2024-05-08T04:21:13.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff42c693640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42406d220 con 0x7ff410005080 2024-05-08T04:21:13.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff42c693640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff424071720 con 0x7ff4241fb590 2024-05-08T04:21:13.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff429c2e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff42414f3c0 0x7ff42414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff429c2e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff42414f3c0 0x7ff42414f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53130/0 (socket says 172.21.15.104:53130) 2024-05-08T04:21:13.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff429c2e640 1 -- 172.21.15.104:0/149847692 learned_addr learned my addr 172.21.15.104:0/149847692 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:13.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff429c2e640 1 -- 172.21.15.104:0/149847692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4241fb590 msgr2=0x7ff4241fba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff429c2e640 1 --2- 172.21.15.104:0/149847692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4241fb590 0x7ff4241fba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff429c2e640 1 -- 172.21.15.104:0/149847692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff410005080 msgr2=0x7ff424160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff429c2e640 1 --2- 172.21.15.104:0/149847692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff410005080 0x7ff424160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff429c2e640 1 -- 172.21.15.104:0/149847692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff424160d70 con 0x7ff42414f3c0 2024-05-08T04:21:13.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff429c2e640 1 --2- 172.21.15.104:0/149847692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff42414f3c0 0x7ff42414f840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff414007310 tx=0x7ff4140077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:13.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.689+0000 7ff41affd640 1 -- 172.21.15.104:0/149847692 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41400f940 con 0x7ff42414f3c0 2024-05-08T04:21:13.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.690+0000 7ff41affd640 1 -- 172.21.15.104:0/149847692 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff414018070 con 0x7ff42414f3c0 2024-05-08T04:21:13.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.690+0000 7ff42c693640 1 -- 172.21.15.104:0/149847692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4240a8540 con 0x7ff42414f3c0 2024-05-08T04:21:13.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.690+0000 7ff41affd640 1 -- 172.21.15.104:0/149847692 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41400fd40 con 0x7ff42414f3c0 2024-05-08T04:21:13.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.690+0000 7ff42c693640 1 -- 172.21.15.104:0/149847692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4240a8b00 con 0x7ff42414f3c0 2024-05-08T04:21:13.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.691+0000 7ff42c693640 1 -- 172.21.15.104:0/149847692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff424075010 con 0x7ff42414f3c0 2024-05-08T04:21:13.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.691+0000 7ff41affd640 1 -- 172.21.15.104:0/149847692 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff41401d460 con 0x7ff42414f3c0 2024-05-08T04:21:13.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.692+0000 7ff41affd640 1 --2- 172.21.15.104:0/149847692 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff40806b4d0 0x7ff40806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.692+0000 7ff42a42f640 1 --2- 172.21.15.104:0/149847692 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff40806b4d0 0x7ff40806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.692+0000 7ff41affd640 1 -- 172.21.15.104:0/149847692 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff41408a290 con 0x7ff42414f3c0 2024-05-08T04:21:13.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.692+0000 7ff42a42f640 1 --2- 172.21.15.104:0/149847692 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff40806b4d0 0x7ff40806d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff420001880 tx=0x7ff420009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:13.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.696+0000 7ff41affd640 1 -- 172.21.15.104:0/149847692 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff414059110 con 0x7ff42414f3c0 2024-05-08T04:21:13.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.867+0000 7ff42c693640 1 -- 172.21.15.104:0/149847692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4240b2010 con 0x7ff42414f3c0 2024-05-08T04:21:13.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.868+0000 7ff41affd640 1 -- 172.21.15.104:0/149847692 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7ff414058a10 con 0x7ff42414f3c0 2024-05-08T04:21:13.869 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:13.870 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:13.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.870+0000 7ff42c693640 1 -- 172.21.15.104:0/149847692 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff40806b4d0 msgr2=0x7ff40806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.870+0000 7ff42c693640 1 --2- 172.21.15.104:0/149847692 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff40806b4d0 0x7ff40806d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff420001880 tx=0x7ff420009040 comp rx=0 tx=0).stop 2024-05-08T04:21:13.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.870+0000 7ff42c693640 1 -- 172.21.15.104:0/149847692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff42414f3c0 msgr2=0x7ff42414f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.870+0000 7ff42c693640 1 --2- 172.21.15.104:0/149847692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff42414f3c0 0x7ff42414f840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff414007310 tx=0x7ff4140077d0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.870+0000 7ff42c693640 1 -- 172.21.15.104:0/149847692 shutdown_connections 2024-05-08T04:21:13.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.870+0000 7ff42c693640 1 --2- 172.21.15.104:0/149847692 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff40806b4d0 0x7ff40806d990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.870+0000 7ff42c693640 1 --2- 172.21.15.104:0/149847692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4241fb590 0x7ff4241fba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.870+0000 7ff42c693640 1 --2- 172.21.15.104:0/149847692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff42414f3c0 0x7ff42414f840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.870+0000 7ff42c693640 1 --2- 172.21.15.104:0/149847692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff410005080 0x7ff424160670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.870+0000 7ff42c693640 1 -- 172.21.15.104:0/149847692 >> 172.21.15.104:0/149847692 conn(0x7ff4240b13f0 msgr2=0x7ff4240cc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:13.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.870+0000 7ff42c693640 1 -- 172.21.15.104:0/149847692 shutdown_connections 2024-05-08T04:21:13.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.870+0000 7ff42c693640 1 -- 172.21.15.104:0/149847692 wait complete. 2024-05-08T04:21:13.882 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-08T04:21:13.882 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:21:13.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.980+0000 7fd437e4d640 1 Processor -- start 2024-05-08T04:21:13.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.981+0000 7fd437e4d640 1 -- start start 2024-05-08T04:21:13.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.981+0000 7fd437e4d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd43015ba10 0x7fd430099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.981+0000 7fd437e4d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd43015ee90 0x7fd4300cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.981+0000 7fd437e4d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4300cc5d0 con 0x7fd4300d0320 2024-05-08T04:21:13.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.981+0000 7fd437e4d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4300d0770 con 0x7fd43015ee90 2024-05-08T04:21:13.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.981+0000 7fd437e4d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43009a340 con 0x7fd43015ba10 2024-05-08T04:21:13.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.982+0000 7fd4353e8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd43015ee90 0x7fd4300cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.982+0000 7fd4353e8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd43015ee90 0x7fd4300cfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53146/0 (socket says 172.21.15.104:53146) 2024-05-08T04:21:13.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.982+0000 7fd4353e8640 1 -- 172.21.15.104:0/2932393650 learned_addr learned my addr 172.21.15.104:0/2932393650 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:13.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.982+0000 7fd4353e8640 1 -- 172.21.15.104:0/2932393650 >> v2:172.21.15.183:3300/0 conn(0x7fd43015ba10 msgr2=0x7fd430099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:13.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.982+0000 7fd4353e8640 1 --2- 172.21.15.104:0/2932393650 >> v2:172.21.15.183:3300/0 conn(0x7fd43015ba10 0x7fd430099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.982+0000 7fd4353e8640 1 -- 172.21.15.104:0/2932393650 >> v1:172.21.15.183:6789/0 conn(0x7fd4300d0320 legacy=0x7fd4300b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:13.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.982+0000 7fd4353e8640 1 -- 172.21.15.104:0/2932393650 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43009a620 con 0x7fd43015ee90 2024-05-08T04:21:13.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.982+0000 7fd4353e8640 1 --2- 172.21.15.104:0/2932393650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd43015ee90 0x7fd4300cfde0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd4300b3fa0 tx=0x7fd42402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ec03a6e4183193 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:13.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.983+0000 7fd434be7640 1 -- 172.21.15.104:0/2932393650 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424037070 con 0x7fd43015ee90 2024-05-08T04:21:13.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.983+0000 7fd434be7640 1 -- 172.21.15.104:0/2932393650 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd424032440 con 0x7fd43015ee90 2024-05-08T04:21:13.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.983+0000 7fd434be7640 1 -- 172.21.15.104:0/2932393650 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424032810 con 0x7fd43015ee90 2024-05-08T04:21:13.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.983+0000 7fd437e4d640 1 -- 172.21.15.104:0/2932393650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd43015ee90 msgr2=0x7fd4300cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.983+0000 7fd437e4d640 1 --2- 172.21.15.104:0/2932393650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd43015ee90 0x7fd4300cfde0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd4300b3fa0 tx=0x7fd42402a230 comp rx=0 tx=0).stop 2024-05-08T04:21:13.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.983+0000 7fd437e4d640 1 -- 172.21.15.104:0/2932393650 shutdown_connections 2024-05-08T04:21:13.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.983+0000 7fd437e4d640 1 --2- 172.21.15.104:0/2932393650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd43015ee90 0x7fd4300cfde0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.983+0000 7fd437e4d640 1 --2- 172.21.15.104:0/2932393650 >> v2:172.21.15.183:3300/0 conn(0x7fd43015ba10 0x7fd430099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.983+0000 7fd437e4d640 1 -- 172.21.15.104:0/2932393650 >> 172.21.15.104:0/2932393650 conn(0x7fd4300b3280 msgr2=0x7fd4300b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:13.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.983+0000 7fd437e4d640 1 -- 172.21.15.104:0/2932393650 shutdown_connections 2024-05-08T04:21:13.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.983+0000 7fd437e4d640 1 -- 172.21.15.104:0/2932393650 wait complete. 2024-05-08T04:21:13.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.984+0000 7fd437e4d640 1 Processor -- start 2024-05-08T04:21:13.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.984+0000 7fd437e4d640 1 -- start start 2024-05-08T04:21:13.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.985+0000 7fd437e4d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4300d0320 0x7fd4300b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.985+0000 7fd437e4d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd43015ba10 0x7fd4300ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.985+0000 7fd437e4d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43015ee90 0x7fd43006bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.985+0000 7fd437e4d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd430099f80 con 0x7fd4300d0320 2024-05-08T04:21:13.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.985+0000 7fd437e4d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4300cc870 con 0x7fd43015ba10 2024-05-08T04:21:13.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.985+0000 7fd437e4d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43009a100 con 0x7fd43015ee90 2024-05-08T04:21:13.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.985+0000 7fd435be9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4300d0320 0x7fd4300b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.985+0000 7fd435be9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4300d0320 0x7fd4300b6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53148/0 (socket says 172.21.15.104:53148) 2024-05-08T04:21:13.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.985+0000 7fd435be9640 1 -- 172.21.15.104:0/2956740666 learned_addr learned my addr 172.21.15.104:0/2956740666 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.985+0000 7fd4363ea640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43015ee90 0x7fd43006bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.985+0000 7fd4353e8640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd43015ba10 0x7fd4300ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.986+0000 7fd435be9640 1 -- 172.21.15.104:0/2956740666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43015ee90 msgr2=0x7fd43006bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.986+0000 7fd435be9640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43015ee90 0x7fd43006bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.986+0000 7fd435be9640 1 -- 172.21.15.104:0/2956740666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd43015ba10 msgr2=0x7fd4300ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.986+0000 7fd435be9640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd43015ba10 0x7fd4300ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.986+0000 7fd435be9640 1 -- 172.21.15.104:0/2956740666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4300caaf0 con 0x7fd4300d0320 2024-05-08T04:21:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.986+0000 7fd435be9640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4300d0320 0x7fd4300b6580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd42000ba50 tx=0x7fd42000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.986+0000 7fd42e7fc640 1 -- 172.21.15.104:0/2956740666 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420019070 con 0x7fd4300d0320 2024-05-08T04:21:13.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.986+0000 7fd42e7fc640 1 -- 172.21.15.104:0/2956740666 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42000cc00 con 0x7fd4300d0320 2024-05-08T04:21:13.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.986+0000 7fd437e4d640 1 -- 172.21.15.104:0/2956740666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4300cadd0 con 0x7fd4300d0320 2024-05-08T04:21:13.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.986+0000 7fd42e7fc640 1 -- 172.21.15.104:0/2956740666 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420014440 con 0x7fd4300d0320 2024-05-08T04:21:13.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.986+0000 7fd437e4d640 1 -- 172.21.15.104:0/2956740666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4300cb390 con 0x7fd4300d0320 2024-05-08T04:21:13.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.987+0000 7fd437e4d640 1 -- 172.21.15.104:0/2956740666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd430075010 con 0x7fd4300d0320 2024-05-08T04:21:13.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.987+0000 7fd42e7fc640 1 -- 172.21.15.104:0/2956740666 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd42001c070 con 0x7fd4300d0320 2024-05-08T04:21:13.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.988+0000 7fd42e7fc640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd41c06b4d0 0x7fd41c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:13.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.988+0000 7fd42e7fc640 1 -- 172.21.15.104:0/2956740666 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd420089f50 con 0x7fd4300d0320 2024-05-08T04:21:13.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.988+0000 7fd4353e8640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd41c06b4d0 0x7fd41c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:13.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.988+0000 7fd4353e8640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd41c06b4d0 0x7fd41c06d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd424034000 tx=0x7fd42402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:13.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:13.992+0000 7fd42e7fc640 1 -- 172.21.15.104:0/2956740666 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd420058e60 con 0x7fd4300d0320 2024-05-08T04:21:14.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.162+0000 7fd437e4d640 1 -- 172.21.15.104:0/2956740666 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4300cfbc0 con 0x7fd41c06b4d0 2024-05-08T04:21:14.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.167+0000 7fd42e7fc640 1 -- 172.21.15.104:0/2956740666 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237079 (secure 0 0 0) 0x7fd4300cfbc0 con 0x7fd41c06b4d0 2024-05-08T04:21:14.171 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:14.172 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:21:14.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.170+0000 7fd437e4d640 1 -- 172.21.15.104:0/2956740666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd41c06b4d0 msgr2=0x7fd41c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.170+0000 7fd437e4d640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd41c06b4d0 0x7fd41c06d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd424034000 tx=0x7fd42402e000 comp rx=0 tx=0).stop 2024-05-08T04:21:14.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.170+0000 7fd437e4d640 1 -- 172.21.15.104:0/2956740666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4300d0320 msgr2=0x7fd4300b6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.170+0000 7fd437e4d640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4300d0320 0x7fd4300b6580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd42000ba50 tx=0x7fd42000bf10 comp rx=0 tx=0).stop 2024-05-08T04:21:14.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.170+0000 7fd437e4d640 1 -- 172.21.15.104:0/2956740666 shutdown_connections 2024-05-08T04:21:14.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.170+0000 7fd437e4d640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd41c06b4d0 0x7fd41c06d990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.170+0000 7fd437e4d640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd43015ba10 0x7fd4300ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.170+0000 7fd437e4d640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd43015ee90 0x7fd43006bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.170+0000 7fd437e4d640 1 --2- 172.21.15.104:0/2956740666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4300d0320 0x7fd4300b6580 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.170+0000 7fd437e4d640 1 -- 172.21.15.104:0/2956740666 >> 172.21.15.104:0/2956740666 conn(0x7fd4300b3280 msgr2=0x7fd4300cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:14.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.170+0000 7fd437e4d640 1 -- 172.21.15.104:0/2956740666 shutdown_connections 2024-05-08T04:21:14.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.170+0000 7fd437e4d640 1 -- 172.21.15.104:0/2956740666 wait complete. 2024-05-08T04:21:14.182 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-08T04:21:12.637999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219692,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755028,"statfs":{"total":773094113280,"available":772869148672,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000826"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-08T04:21:00.772916+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:21:00.772916+0000","last_peered":"2024-05-08T04:21:00.772916+0000","last_clean":"2024-05-08T04:21:00.772916+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:21:00.772916+0000","last_undegraded":"2024-05-08T04:21:00.772916+0000","last_fullsized":"2024-05-08T04:21:00.772916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:21:14.186 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:21:14.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.320+0000 7f2a0a1b7640 1 Processor -- start 2024-05-08T04:21:14.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.320+0000 7f2a0a1b7640 1 -- start start 2024-05-08T04:21:14.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.321+0000 7f2a0a1b7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2a0415edf0 0x7f2a040b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.321+0000 7f2a0a1b7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2a04157ac0 0x7f2a04157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.321+0000 7f2a0a1b7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a040d15c0 con 0x7f2a04070c70 2024-05-08T04:21:14.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.321+0000 7f2a0a1b7640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0406bc70 con 0x7f2a04157ac0 2024-05-08T04:21:14.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.321+0000 7f2a0a1b7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0415f550 con 0x7f2a0415edf0 2024-05-08T04:21:14.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.321+0000 7f2a03fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2a04157ac0 0x7f2a04157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.321+0000 7f2a03fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2a04157ac0 0x7f2a04157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53164/0 (socket says 172.21.15.104:53164) 2024-05-08T04:21:14.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.321+0000 7f2a03fff640 1 -- 172.21.15.104:0/2248464024 learned_addr learned my addr 172.21.15.104:0/2248464024 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:14.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.321+0000 7f2a02ffd640 1 --2- 172.21.15.104:0/2248464024 >> v2:172.21.15.183:3300/0 conn(0x7f2a0415edf0 0x7f2a040b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.321+0000 7f2a03fff640 1 -- 172.21.15.104:0/2248464024 >> v2:172.21.15.183:3300/0 conn(0x7f2a0415edf0 msgr2=0x7f2a040b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:14.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.321+0000 7f2a03fff640 1 --2- 172.21.15.104:0/2248464024 >> v2:172.21.15.183:3300/0 conn(0x7f2a0415edf0 0x7f2a040b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.321+0000 7f2a03fff640 1 -- 172.21.15.104:0/2248464024 >> v1:172.21.15.183:6789/0 conn(0x7f2a04070c70 legacy=0x7f2a04071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.321+0000 7f2a03fff640 1 -- 172.21.15.104:0/2248464024 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0415f830 con 0x7f2a04157ac0 2024-05-08T04:21:14.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.322+0000 7f2a03fff640 1 --2- 172.21.15.104:0/2248464024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a04157ac0 0x7f2a04157f30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2a040b4150 tx=0x7f29fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c78d391ef561a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:14.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.322+0000 7f2a027fc640 1 -- 172.21.15.104:0/2248464024 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc037070 con 0x7f2a04157ac0 2024-05-08T04:21:14.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.322+0000 7f2a027fc640 1 -- 172.21.15.104:0/2248464024 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc032440 con 0x7f2a04157ac0 2024-05-08T04:21:14.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.322+0000 7f2a027fc640 1 -- 172.21.15.104:0/2248464024 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc032810 con 0x7f2a04157ac0 2024-05-08T04:21:14.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.323+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/2248464024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a04157ac0 msgr2=0x7f2a04157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.323+0000 7f2a0a1b7640 1 --2- 172.21.15.104:0/2248464024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a04157ac0 0x7f2a04157f30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2a040b4150 tx=0x7f29fc02a270 comp rx=0 tx=0).stop 2024-05-08T04:21:14.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.323+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/2248464024 shutdown_connections 2024-05-08T04:21:14.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.323+0000 7f2a0a1b7640 1 --2- 172.21.15.104:0/2248464024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a04157ac0 0x7f2a04157f30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.323+0000 7f2a0a1b7640 1 --2- 172.21.15.104:0/2248464024 >> v2:172.21.15.183:3300/0 conn(0x7f2a0415edf0 0x7f2a040b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.323+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/2248464024 >> 172.21.15.104:0/2248464024 conn(0x7f2a040b3450 msgr2=0x7f2a040b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:14.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.323+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/2248464024 shutdown_connections 2024-05-08T04:21:14.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.323+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/2248464024 wait complete. 2024-05-08T04:21:14.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.324+0000 7f2a0a1b7640 1 Processor -- start 2024-05-08T04:21:14.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.324+0000 7f2a0a1b7640 1 -- start start 2024-05-08T04:21:14.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a0a1b7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a04070c70 0x7f2a04149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a0a1b7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a04157ac0 0x7f2a0415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a0a1b7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a0415edf0 0x7f2a0406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a0a1b7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040b57e0 con 0x7f2a0415edf0 2024-05-08T04:21:14.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a0a1b7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040b5b80 con 0x7f2a04157ac0 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a0a1b7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a040b5960 con 0x7f2a04070c70 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a03fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a0415edf0 0x7f2a0406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a03fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a0415edf0 0x7f2a0406d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53168/0 (socket says 172.21.15.104:53168) 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a03fff640 1 -- 172.21.15.104:0/1594308404 learned_addr learned my addr 172.21.15.104:0/1594308404 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a037fe640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a04070c70 0x7f2a04149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a02ffd640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a04157ac0 0x7f2a0415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a03fff640 1 -- 172.21.15.104:0/1594308404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a04070c70 msgr2=0x7f2a04149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a03fff640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a04070c70 0x7f2a04149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a03fff640 1 -- 172.21.15.104:0/1594308404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a04157ac0 msgr2=0x7f2a0415a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a03fff640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a04157ac0 0x7f2a0415a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a03fff640 1 -- 172.21.15.104:0/1594308404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040cb2e0 con 0x7f2a0415edf0 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f2a03fff640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a0415edf0 0x7f2a0406d1c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0090b0 tx=0x7f29fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.325+0000 7f29ebfff640 1 -- 172.21.15.104:0/1594308404 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc037040 con 0x7f2a0415edf0 2024-05-08T04:21:14.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.326+0000 7f29ebfff640 1 -- 172.21.15.104:0/1594308404 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc042070 con 0x7f2a0415edf0 2024-05-08T04:21:14.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.326+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/1594308404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a040cb5c0 con 0x7f2a0415edf0 2024-05-08T04:21:14.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.326+0000 7f29ebfff640 1 -- 172.21.15.104:0/1594308404 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc030920 con 0x7f2a0415edf0 2024-05-08T04:21:14.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.326+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/1594308404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a040cbb80 con 0x7f2a0415edf0 2024-05-08T04:21:14.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.326+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/1594308404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a04075010 con 0x7f2a0415edf0 2024-05-08T04:21:14.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.327+0000 7f29ebfff640 1 -- 172.21.15.104:0/1594308404 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f29fc030ac0 con 0x7f2a0415edf0 2024-05-08T04:21:14.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.327+0000 7f29ebfff640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29f006b4d0 0x7f29f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.328+0000 7f29ebfff640 1 -- 172.21.15.104:0/1594308404 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29fc0aa950 con 0x7f2a0415edf0 2024-05-08T04:21:14.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.328+0000 7f2a037fe640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29f006b4d0 0x7f29f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.328+0000 7f2a037fe640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29f006b4d0 0x7f29f006d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29f4001f10 tx=0x7f29f4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:14.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.332+0000 7f29ebfff640 1 -- 172.21.15.104:0/1594308404 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f29fc079210 con 0x7f2a0415edf0 2024-05-08T04:21:14.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.499+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/1594308404 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a0415b5b0 con 0x7f29f006b4d0 2024-05-08T04:21:14.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.504+0000 7f29ebfff640 1 -- 172.21.15.104:0/1594308404 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237079 (secure 0 0 0) 0x7f2a0415b5b0 con 0x7f29f006b4d0 2024-05-08T04:21:14.508 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:14.509 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:21:14.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.507+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/1594308404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29f006b4d0 msgr2=0x7f29f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.507+0000 7f2a0a1b7640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29f006b4d0 0x7f29f006d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29f4001f10 tx=0x7f29f4009040 comp rx=0 tx=0).stop 2024-05-08T04:21:14.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.507+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/1594308404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a0415edf0 msgr2=0x7f2a0406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.507+0000 7f2a0a1b7640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a0415edf0 0x7f2a0406d1c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0090b0 tx=0x7f29fc0046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.507+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/1594308404 shutdown_connections 2024-05-08T04:21:14.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.507+0000 7f2a0a1b7640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29f006b4d0 0x7f29f006d990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.507+0000 7f2a0a1b7640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a04157ac0 0x7f2a0415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.507+0000 7f2a0a1b7640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a0415edf0 0x7f2a0406d1c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.507+0000 7f2a0a1b7640 1 --2- 172.21.15.104:0/1594308404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a04070c70 0x7f2a04149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.507+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/1594308404 >> 172.21.15.104:0/1594308404 conn(0x7f2a040b3450 msgr2=0x7f2a040b4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:14.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.507+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/1594308404 shutdown_connections 2024-05-08T04:21:14.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.507+0000 7f2a0a1b7640 1 -- 172.21.15.104:0/1594308404 wait complete. 2024-05-08T04:21:14.519 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-08T04:21:12.637999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219692,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755028,"statfs":{"total":773094113280,"available":772869148672,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000826"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-08T04:21:00.772916+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:21:00.772916+0000","last_peered":"2024-05-08T04:21:00.772916+0000","last_clean":"2024-05-08T04:21:00.772916+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:21:00.772916+0000","last_undegraded":"2024-05-08T04:21:00.772916+0000","last_fullsized":"2024-05-08T04:21:00.772916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:09.778427+0000","last_change":"2024-05-08T04:21:09.778427+0000","last_active":"2024-05-08T04:21:09.778427+0000","last_peered":"2024-05-08T04:21:09.778427+0000","last_clean":"2024-05-08T04:21:09.778427+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:09.778427+0000","last_undegraded":"2024-05-08T04:21:09.778427+0000","last_fullsized":"2024-05-08T04:21:09.778427+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:21:08.772348+0000","last_change":"2024-05-08T04:21:08.772348+0000","last_active":"2024-05-08T04:21:08.772348+0000","last_peered":"2024-05-08T04:21:08.772348+0000","last_clean":"2024-05-08T04:21:08.772348+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:21:08.772348+0000","last_undegraded":"2024-05-08T04:21:08.772348+0000","last_fullsized":"2024-05-08T04:21:08.772348+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:21:14.522 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:21:14.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.659+0000 7f5e6c5e2640 1 Processor -- start 2024-05-08T04:21:14.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.659+0000 7f5e6c5e2640 1 -- start start 2024-05-08T04:21:14.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.660+0000 7f5e6c5e2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5e6406c590 0x7f5e64168db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.660+0000 7f5e6c5e2640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6406cb40 con 0x7f5e64099cb0 2024-05-08T04:21:14.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.660+0000 7f5e6c5e2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6406ce20 con 0x7f5e6409a090 2024-05-08T04:21:14.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.660+0000 7f5e6c5e2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6406fdc0 con 0x7f5e6406c590 2024-05-08T04:21:14.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6a37e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f5e64099cb0 0x7f5e6406be80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:40432/0 (socket says 172.21.15.104:40432) 2024-05-08T04:21:14.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6a37e640 1 -- 172.21.15.104:0/435907771 learned_addr learned my addr 172.21.15.104:0/435907771 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:14.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227764502 0 0) 0x7f5e6406cb40 con 0x7f5e64099cb0 2024-05-08T04:21:14.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6ab7f640 1 --2- 172.21.15.104:0/435907771 >> v2:172.21.15.183:3300/0 conn(0x7f5e6406c590 0x7f5e64168db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e4c003520 con 0x7f5e64099cb0 2024-05-08T04:21:14.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1974509186 0 0) 0x7f5e4c003520 con 0x7f5e64099cb0 2024-05-08T04:21:14.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 >> v2:172.21.15.183:3300/0 conn(0x7f5e6406c590 msgr2=0x7f5e64168db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:14.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 --2- 172.21.15.104:0/435907771 >> v2:172.21.15.183:3300/0 conn(0x7f5e6406c590 0x7f5e64168db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 >> v1:172.21.15.183:6789/0 conn(0x7f5e6409a090 legacy=0x7f5e6415dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e640700a0 con 0x7f5e64099cb0 2024-05-08T04:21:14.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f5e540019f0 con 0x7f5e64099cb0 2024-05-08T04:21:14.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6ab7f640 1 --2- 172.21.15.104:0/435907771 >> v2:172.21.15.183:3300/0 conn(0x7f5e6406c590 0x7f5e64168db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:14.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 >> v1:172.21.15.104:6789/0 conn(0x7f5e64099cb0 legacy=0x7f5e6406be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 --2- 172.21.15.104:0/435907771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e4c0039b0 0x7f5e4c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 --2- 172.21.15.104:0/435907771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e4c004800 0x7f5e4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 --2- 172.21.15.104:0/435907771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4c0051c0 0x7f5e4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6406fdc0 con 0x7f5e4c0051c0 2024-05-08T04:21:14.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c00c110 con 0x7f5e4c0039b0 2024-05-08T04:21:14.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c00c310 con 0x7f5e4c004800 2024-05-08T04:21:14.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6ab7f640 1 --2- 172.21.15.104:0/435907771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4c0051c0 0x7f5e4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6a37e640 1 --2- 172.21.15.104:0/435907771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e4c0039b0 0x7f5e4c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e69b7d640 1 --2- 172.21.15.104:0/435907771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e4c004800 0x7f5e4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6ab7f640 1 -- 172.21.15.104:0/435907771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e4c004800 msgr2=0x7f5e4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:14.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6ab7f640 1 --2- 172.21.15.104:0/435907771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e4c004800 0x7f5e4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6ab7f640 1 -- 172.21.15.104:0/435907771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e4c0039b0 msgr2=0x7f5e4c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:14.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6ab7f640 1 --2- 172.21.15.104:0/435907771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e4c0039b0 0x7f5e4c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e6ab7f640 1 -- 172.21.15.104:0/435907771 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c003520 con 0x7f5e4c0051c0 2024-05-08T04:21:14.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.661+0000 7f5e69b7d640 1 --2- 172.21.15.104:0/435907771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e4c004800 0x7f5e4c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:14.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.662+0000 7f5e6ab7f640 1 -- 172.21.15.104:0/435907771 reap_dead start 2024-05-08T04:21:14.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.662+0000 7f5e6ab7f640 1 --2- 172.21.15.104:0/435907771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4c0051c0 0x7f5e4c00b9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0098a0 tx=0x7f5e4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288404f3c4b2b5be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:14.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.662+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c00f040 con 0x7f5e4c0051c0 2024-05-08T04:21:14.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.662+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c02ad60 con 0x7f5e4c0051c0 2024-05-08T04:21:14.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.662+0000 7f5e6937c640 1 -- 172.21.15.104:0/435907771 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c004260 con 0x7f5e4c0051c0 2024-05-08T04:21:14.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.663+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/435907771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4c0051c0 msgr2=0x7f5e4c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.663+0000 7f5e6c5e2640 1 --2- 172.21.15.104:0/435907771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4c0051c0 0x7f5e4c00b9c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0098a0 tx=0x7f5e4c005830 comp rx=0 tx=0).stop 2024-05-08T04:21:14.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.663+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/435907771 shutdown_connections 2024-05-08T04:21:14.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.663+0000 7f5e6c5e2640 1 --2- 172.21.15.104:0/435907771 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e4c0051c0 0x7f5e4c00b9c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.663+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/435907771 >> 172.21.15.104:0/435907771 conn(0x7f5e640b32f0 msgr2=0x7f5e640b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:14.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.663+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/435907771 shutdown_connections 2024-05-08T04:21:14.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.663+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/435907771 wait complete. 2024-05-08T04:21:14.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.664+0000 7f5e6c5e2640 1 Processor -- start 2024-05-08T04:21:14.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.664+0000 7f5e6c5e2640 1 -- start start 2024-05-08T04:21:14.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e6c5e2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e4c0051c0 0x7f5e640c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e6c5e2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e640b5790 0x7f5e640b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e6c5e2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e640af850 0x7f5e64150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e6c5e2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640cbfd0 con 0x7f5e640b5790 2024-05-08T04:21:14.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e6c5e2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640cbe50 con 0x7f5e4c0051c0 2024-05-08T04:21:14.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e6c5e2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6406be80 con 0x7f5e640af850 2024-05-08T04:21:14.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e69b7d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e640b5790 0x7f5e640b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e69b7d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e640b5790 0x7f5e640b6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53194/0 (socket says 172.21.15.104:53194) 2024-05-08T04:21:14.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e69b7d640 1 -- 172.21.15.104:0/4146585998 learned_addr learned my addr 172.21.15.104:0/4146585998 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:14.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e6a37e640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e4c0051c0 0x7f5e640c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e6ab7f640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e640af850 0x7f5e64150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e69b7d640 1 -- 172.21.15.104:0/4146585998 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e640af850 msgr2=0x7f5e64150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e69b7d640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e640af850 0x7f5e64150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e69b7d640 1 -- 172.21.15.104:0/4146585998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e4c0051c0 msgr2=0x7f5e640c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e69b7d640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e4c0051c0 0x7f5e640c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e69b7d640 1 -- 172.21.15.104:0/4146585998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e640b5c20 con 0x7f5e640b5790 2024-05-08T04:21:14.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e69b7d640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e640b5790 0x7f5e640b6cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800e460 tx=0x7f5e5800e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:14.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e62ffd640 1 -- 172.21.15.104:0/4146585998 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580052e0 con 0x7f5e640b5790 2024-05-08T04:21:14.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e62ffd640 1 -- 172.21.15.104:0/4146585998 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e58018070 con 0x7f5e640b5790 2024-05-08T04:21:14.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/4146585998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e640b5f00 con 0x7f5e640b5790 2024-05-08T04:21:14.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e62ffd640 1 -- 172.21.15.104:0/4146585998 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58003830 con 0x7f5e640b5790 2024-05-08T04:21:14.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.665+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/4146585998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e640b64c0 con 0x7f5e640b5790 2024-05-08T04:21:14.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.666+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/4146585998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e64075010 con 0x7f5e640b5790 2024-05-08T04:21:14.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.667+0000 7f5e62ffd640 1 -- 172.21.15.104:0/4146585998 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5e580039d0 con 0x7f5e640b5790 2024-05-08T04:21:14.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.667+0000 7f5e62ffd640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5e5006b500 0x7f5e5006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:14.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.668+0000 7f5e6a37e640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5e5006b500 0x7f5e5006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:14.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.668+0000 7f5e62ffd640 1 -- 172.21.15.104:0/4146585998 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e58089e50 con 0x7f5e640b5790 2024-05-08T04:21:14.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.668+0000 7f5e6a37e640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5e5006b500 0x7f5e5006d9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5e54002230 tx=0x7f5e54006040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:14.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.672+0000 7f5e62ffd640 1 -- 172.21.15.104:0/4146585998 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5e58058cd0 con 0x7f5e640b5790 2024-05-08T04:21:14.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.840+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/4146585998 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e640cc5f0 con 0x7f5e5006b500 2024-05-08T04:21:14.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.846+0000 7f5e62ffd640 1 -- 172.21.15.104:0/4146585998 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251923 (secure 0 0 0) 0x7f5e640cc5f0 con 0x7f5e5006b500 2024-05-08T04:21:14.852 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:14.853 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:21:14.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.849+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/4146585998 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5e5006b500 msgr2=0x7f5e5006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.849+0000 7f5e6c5e2640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5e5006b500 0x7f5e5006d9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5e54002230 tx=0x7f5e54006040 comp rx=0 tx=0).stop 2024-05-08T04:21:14.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.849+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/4146585998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e640b5790 msgr2=0x7f5e640b6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:14.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.849+0000 7f5e6c5e2640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e640b5790 0x7f5e640b6cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800e460 tx=0x7f5e5800e920 comp rx=0 tx=0).stop 2024-05-08T04:21:14.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.849+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/4146585998 shutdown_connections 2024-05-08T04:21:14.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.849+0000 7f5e6c5e2640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5e5006b500 0x7f5e5006d9c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.849+0000 7f5e6c5e2640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e640af850 0x7f5e64150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.849+0000 7f5e6c5e2640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e640b5790 0x7f5e640b6cc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.849+0000 7f5e6c5e2640 1 --2- 172.21.15.104:0/4146585998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e4c0051c0 0x7f5e640c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:14.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.849+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/4146585998 >> 172.21.15.104:0/4146585998 conn(0x7f5e640b32f0 msgr2=0x7f5e64161790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:14.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.849+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/4146585998 shutdown_connections 2024-05-08T04:21:14.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.849+0000 7f5e6c5e2640 1 -- 172.21.15.104:0/4146585998 wait complete. 2024-05-08T04:21:14.861 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-08T04:21:14.638302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218976,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755744,"statfs":{"total":773094113280,"available":772869881856,"internally_reserved":0,"allocated":2842624,"data_stored":1727828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.859767"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806700+0000","last_change":"2024-05-08T04:21:10.815759+0000","last_active":"2024-05-08T04:21:11.806700+0000","last_peered":"2024-05-08T04:21:11.806700+0000","last_clean":"2024-05-08T04:21:11.806700+0000","last_became_active":"2024-05-08T04:21:10.815430+0000","last_became_peered":"2024-05-08T04:21:10.815430+0000","last_unstale":"2024-05-08T04:21:11.806700+0000","last_undegraded":"2024-05-08T04:21:11.806700+0000","last_fullsized":"2024-05-08T04:21:11.806700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:09:39.015637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799301+0000","last_change":"2024-05-08T04:21:10.799995+0000","last_active":"2024-05-08T04:21:11.799301+0000","last_peered":"2024-05-08T04:21:11.799301+0000","last_clean":"2024-05-08T04:21:11.799301+0000","last_became_active":"2024-05-08T04:21:10.799655+0000","last_became_peered":"2024-05-08T04:21:10.799655+0000","last_unstale":"2024-05-08T04:21:11.799301+0000","last_undegraded":"2024-05-08T04:21:11.799301+0000","last_fullsized":"2024-05-08T04:21:11.799301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:22.135893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798824+0000","last_change":"2024-05-08T04:21:10.807212+0000","last_active":"2024-05-08T04:21:11.798824+0000","last_peered":"2024-05-08T04:21:11.798824+0000","last_clean":"2024-05-08T04:21:11.798824+0000","last_became_active":"2024-05-08T04:21:10.806880+0000","last_became_peered":"2024-05-08T04:21:10.806880+0000","last_unstale":"2024-05-08T04:21:11.798824+0000","last_undegraded":"2024-05-08T04:21:11.798824+0000","last_fullsized":"2024-05-08T04:21:11.798824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.813337+0000","last_change":"2024-05-08T04:21:10.809736+0000","last_active":"2024-05-08T04:21:10.813337+0000","last_peered":"2024-05-08T04:21:10.813337+0000","last_clean":"2024-05-08T04:21:10.813337+0000","last_became_active":"2024-05-08T04:21:10.808825+0000","last_became_peered":"2024-05-08T04:21:10.808825+0000","last_unstale":"2024-05-08T04:21:10.813337+0000","last_undegraded":"2024-05-08T04:21:10.813337+0000","last_fullsized":"2024-05-08T04:21:10.813337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:19.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806396+0000","last_change":"2024-05-08T04:21:10.807971+0000","last_active":"2024-05-08T04:21:11.806396+0000","last_peered":"2024-05-08T04:21:11.806396+0000","last_clean":"2024-05-08T04:21:11.806396+0000","last_became_active":"2024-05-08T04:21:10.807525+0000","last_became_peered":"2024-05-08T04:21:10.807525+0000","last_unstale":"2024-05-08T04:21:11.806396+0000","last_undegraded":"2024-05-08T04:21:11.806396+0000","last_fullsized":"2024-05-08T04:21:11.806396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:33.787458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.810825+0000","last_change":"2024-05-08T04:21:10.808827+0000","last_active":"2024-05-08T04:21:10.810825+0000","last_peered":"2024-05-08T04:21:10.810825+0000","last_clean":"2024-05-08T04:21:10.810825+0000","last_became_active":"2024-05-08T04:21:10.808388+0000","last_became_peered":"2024-05-08T04:21:10.808388+0000","last_unstale":"2024-05-08T04:21:10.810825+0000","last_undegraded":"2024-05-08T04:21:10.810825+0000","last_fullsized":"2024-05-08T04:21:10.810825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:53.160738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806249+0000","last_change":"2024-05-08T04:21:10.806944+0000","last_active":"2024-05-08T04:21:11.806249+0000","last_peered":"2024-05-08T04:21:11.806249+0000","last_clean":"2024-05-08T04:21:11.806249+0000","last_became_active":"2024-05-08T04:21:10.806257+0000","last_became_peered":"2024-05-08T04:21:10.806257+0000","last_unstale":"2024-05-08T04:21:11.806249+0000","last_undegraded":"2024-05-08T04:21:11.806249+0000","last_fullsized":"2024-05-08T04:21:11.806249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798784+0000","last_change":"2024-05-08T04:21:10.808012+0000","last_active":"2024-05-08T04:21:11.798784+0000","last_peered":"2024-05-08T04:21:11.798784+0000","last_clean":"2024-05-08T04:21:11.798784+0000","last_became_active":"2024-05-08T04:21:10.807762+0000","last_became_peered":"2024-05-08T04:21:10.807762+0000","last_unstale":"2024-05-08T04:21:11.798784+0000","last_undegraded":"2024-05-08T04:21:11.798784+0000","last_fullsized":"2024-05-08T04:21:11.798784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797594+0000","last_change":"2024-05-08T04:21:10.813184+0000","last_active":"2024-05-08T04:21:11.797594+0000","last_peered":"2024-05-08T04:21:11.797594+0000","last_clean":"2024-05-08T04:21:11.797594+0000","last_became_active":"2024-05-08T04:21:10.812887+0000","last_became_peered":"2024-05-08T04:21:10.812887+0000","last_unstale":"2024-05-08T04:21:11.797594+0000","last_undegraded":"2024-05-08T04:21:11.797594+0000","last_fullsized":"2024-05-08T04:21:11.797594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:34.037163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806602+0000","last_change":"2024-05-08T04:21:10.808669+0000","last_active":"2024-05-08T04:21:11.806602+0000","last_peered":"2024-05-08T04:21:11.806602+0000","last_clean":"2024-05-08T04:21:11.806602+0000","last_became_active":"2024-05-08T04:21:10.807623+0000","last_became_peered":"2024-05-08T04:21:10.807623+0000","last_unstale":"2024-05-08T04:21:11.806602+0000","last_undegraded":"2024-05-08T04:21:11.806602+0000","last_fullsized":"2024-05-08T04:21:11.806602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:36.487747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806477+0000","last_change":"2024-05-08T04:21:10.815746+0000","last_active":"2024-05-08T04:21:11.806477+0000","last_peered":"2024-05-08T04:21:11.806477+0000","last_clean":"2024-05-08T04:21:11.806477+0000","last_became_active":"2024-05-08T04:21:10.815484+0000","last_became_peered":"2024-05-08T04:21:10.815484+0000","last_unstale":"2024-05-08T04:21:11.806477+0000","last_undegraded":"2024-05-08T04:21:11.806477+0000","last_fullsized":"2024-05-08T04:21:11.806477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:14.742480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806591+0000","last_change":"2024-05-08T04:21:10.809694+0000","last_active":"2024-05-08T04:21:11.806591+0000","last_peered":"2024-05-08T04:21:11.806591+0000","last_clean":"2024-05-08T04:21:11.806591+0000","last_became_active":"2024-05-08T04:21:10.809335+0000","last_became_peered":"2024-05-08T04:21:10.809335+0000","last_unstale":"2024-05-08T04:21:11.806591+0000","last_undegraded":"2024-05-08T04:21:11.806591+0000","last_fullsized":"2024-05-08T04:21:11.806591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:22.135893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.814987+0000","last_change":"2024-05-08T04:21:10.810243+0000","last_active":"2024-05-08T04:21:10.814987+0000","last_peered":"2024-05-08T04:21:10.814987+0000","last_clean":"2024-05-08T04:21:10.814987+0000","last_became_active":"2024-05-08T04:21:10.809954+0000","last_became_peered":"2024-05-08T04:21:10.809954+0000","last_unstale":"2024-05-08T04:21:10.814987+0000","last_undegraded":"2024-05-08T04:21:10.814987+0000","last_fullsized":"2024-05-08T04:21:10.814987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:11.466963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.807829+0000","last_change":"2024-05-08T04:21:10.803036+0000","last_active":"2024-05-08T04:21:10.807829+0000","last_peered":"2024-05-08T04:21:10.807829+0000","last_clean":"2024-05-08T04:21:10.807829+0000","last_became_active":"2024-05-08T04:21:10.801931+0000","last_became_peered":"2024-05-08T04:21:10.801931+0000","last_unstale":"2024-05-08T04:21:10.807829+0000","last_undegraded":"2024-05-08T04:21:10.807829+0000","last_fullsized":"2024-05-08T04:21:10.807829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:14.085078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798885+0000","last_change":"2024-05-08T04:21:10.810578+0000","last_active":"2024-05-08T04:21:11.798885+0000","last_peered":"2024-05-08T04:21:11.798885+0000","last_clean":"2024-05-08T04:21:11.798885+0000","last_became_active":"2024-05-08T04:21:10.809929+0000","last_became_peered":"2024-05-08T04:21:10.809929+0000","last_unstale":"2024-05-08T04:21:11.798885+0000","last_undegraded":"2024-05-08T04:21:11.798885+0000","last_fullsized":"2024-05-08T04:21:11.798885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997095+0000","last_change":"2024-05-08T04:21:10.809708+0000","last_active":"2024-05-08T04:21:11.997095+0000","last_peered":"2024-05-08T04:21:11.997095+0000","last_clean":"2024-05-08T04:21:11.997095+0000","last_became_active":"2024-05-08T04:21:10.809239+0000","last_became_peered":"2024-05-08T04:21:10.809239+0000","last_unstale":"2024-05-08T04:21:11.997095+0000","last_undegraded":"2024-05-08T04:21:11.997095+0000","last_fullsized":"2024-05-08T04:21:11.997095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:09:39.015637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997748+0000","last_change":"2024-05-08T04:21:10.813941+0000","last_active":"2024-05-08T04:21:11.997748+0000","last_peered":"2024-05-08T04:21:11.997748+0000","last_clean":"2024-05-08T04:21:11.997748+0000","last_became_active":"2024-05-08T04:21:10.813628+0000","last_became_peered":"2024-05-08T04:21:10.813628+0000","last_unstale":"2024-05-08T04:21:11.997748+0000","last_undegraded":"2024-05-08T04:21:11.997748+0000","last_fullsized":"2024-05-08T04:21:11.997748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:54:22.530212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.805018+0000","last_change":"2024-05-08T04:21:10.802243+0000","last_active":"2024-05-08T04:21:10.805018+0000","last_peered":"2024-05-08T04:21:10.805018+0000","last_clean":"2024-05-08T04:21:10.805018+0000","last_became_active":"2024-05-08T04:21:10.801990+0000","last_became_peered":"2024-05-08T04:21:10.801990+0000","last_unstale":"2024-05-08T04:21:10.805018+0000","last_undegraded":"2024-05-08T04:21:10.805018+0000","last_fullsized":"2024-05-08T04:21:10.805018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:19.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997557+0000","last_change":"2024-05-08T04:21:10.809257+0000","last_active":"2024-05-08T04:21:11.997557+0000","last_peered":"2024-05-08T04:21:11.997557+0000","last_clean":"2024-05-08T04:21:11.997557+0000","last_became_active":"2024-05-08T04:21:10.808961+0000","last_became_peered":"2024-05-08T04:21:10.808961+0000","last_unstale":"2024-05-08T04:21:11.997557+0000","last_undegraded":"2024-05-08T04:21:11.997557+0000","last_fullsized":"2024-05-08T04:21:11.997557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:47:28.393115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806508+0000","last_change":"2024-05-08T04:21:10.808294+0000","last_active":"2024-05-08T04:21:11.806508+0000","last_peered":"2024-05-08T04:21:11.806508+0000","last_clean":"2024-05-08T04:21:11.806508+0000","last_became_active":"2024-05-08T04:21:10.808032+0000","last_became_peered":"2024-05-08T04:21:10.808032+0000","last_unstale":"2024-05-08T04:21:11.806508+0000","last_undegraded":"2024-05-08T04:21:11.806508+0000","last_fullsized":"2024-05-08T04:21:11.806508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:33.067388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803850+0000","last_change":"2024-05-08T04:21:10.806239+0000","last_active":"2024-05-08T04:21:11.803850+0000","last_peered":"2024-05-08T04:21:11.803850+0000","last_clean":"2024-05-08T04:21:11.803850+0000","last_became_active":"2024-05-08T04:21:10.805369+0000","last_became_peered":"2024-05-08T04:21:10.805369+0000","last_unstale":"2024-05-08T04:21:11.803850+0000","last_undegraded":"2024-05-08T04:21:11.803850+0000","last_fullsized":"2024-05-08T04:21:11.803850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:55:41.627503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797390+0000","last_change":"2024-05-08T04:21:10.813103+0000","last_active":"2024-05-08T04:21:11.797390+0000","last_peered":"2024-05-08T04:21:11.797390+0000","last_clean":"2024-05-08T04:21:11.797390+0000","last_became_active":"2024-05-08T04:21:10.812833+0000","last_became_peered":"2024-05-08T04:21:10.812833+0000","last_unstale":"2024-05-08T04:21:11.797390+0000","last_undegraded":"2024-05-08T04:21:11.797390+0000","last_fullsized":"2024-05-08T04:21:11.797390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:35:00.954562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798758+0000","last_change":"2024-05-08T04:21:10.794976+0000","last_active":"2024-05-08T04:21:11.798758+0000","last_peered":"2024-05-08T04:21:11.798758+0000","last_clean":"2024-05-08T04:21:11.798758+0000","last_became_active":"2024-05-08T04:21:10.794594+0000","last_became_peered":"2024-05-08T04:21:10.794594+0000","last_unstale":"2024-05-08T04:21:11.798758+0000","last_undegraded":"2024-05-08T04:21:11.798758+0000","last_fullsized":"2024-05-08T04:21:11.798758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:29.958463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997065+0000","last_change":"2024-05-08T04:21:10.809601+0000","last_active":"2024-05-08T04:21:11.997065+0000","last_peered":"2024-05-08T04:21:11.997065+0000","last_clean":"2024-05-08T04:21:11.997065+0000","last_became_active":"2024-05-08T04:21:10.809257+0000","last_became_peered":"2024-05-08T04:21:10.809257+0000","last_unstale":"2024-05-08T04:21:11.997065+0000","last_undegraded":"2024-05-08T04:21:11.997065+0000","last_fullsized":"2024-05-08T04:21:11.997065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799293+0000","last_change":"2024-05-08T04:21:10.802281+0000","last_active":"2024-05-08T04:21:11.799293+0000","last_peered":"2024-05-08T04:21:11.799293+0000","last_clean":"2024-05-08T04:21:11.799293+0000","last_became_active":"2024-05-08T04:21:10.802003+0000","last_became_peered":"2024-05-08T04:21:10.802003+0000","last_unstale":"2024-05-08T04:21:11.799293+0000","last_undegraded":"2024-05-08T04:21:11.799293+0000","last_fullsized":"2024-05-08T04:21:11.799293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:01.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.819934+0000","last_change":"2024-05-08T04:21:10.817545+0000","last_active":"2024-05-08T04:21:10.819934+0000","last_peered":"2024-05-08T04:21:10.819934+0000","last_clean":"2024-05-08T04:21:10.819934+0000","last_became_active":"2024-05-08T04:21:10.817272+0000","last_became_peered":"2024-05-08T04:21:10.817272+0000","last_unstale":"2024-05-08T04:21:10.819934+0000","last_undegraded":"2024-05-08T04:21:10.819934+0000","last_fullsized":"2024-05-08T04:21:10.819934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:54.044618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.807828+0000","last_change":"2024-05-08T04:21:10.802074+0000","last_active":"2024-05-08T04:21:10.807828+0000","last_peered":"2024-05-08T04:21:10.807828+0000","last_clean":"2024-05-08T04:21:10.807828+0000","last_became_active":"2024-05-08T04:21:10.801792+0000","last_became_peered":"2024-05-08T04:21:10.801792+0000","last_unstale":"2024-05-08T04:21:10.807828+0000","last_undegraded":"2024-05-08T04:21:10.807828+0000","last_fullsized":"2024-05-08T04:21:10.807828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:19.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.814620+0000","last_change":"2024-05-08T04:21:10.810222+0000","last_active":"2024-05-08T04:21:10.814620+0000","last_peered":"2024-05-08T04:21:10.814620+0000","last_clean":"2024-05-08T04:21:10.814620+0000","last_became_active":"2024-05-08T04:21:10.809936+0000","last_became_peered":"2024-05-08T04:21:10.809936+0000","last_unstale":"2024-05-08T04:21:10.814620+0000","last_undegraded":"2024-05-08T04:21:10.814620+0000","last_fullsized":"2024-05-08T04:21:10.814620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:53.770709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799109+0000","last_change":"2024-05-08T04:21:10.801209+0000","last_active":"2024-05-08T04:21:11.799109+0000","last_peered":"2024-05-08T04:21:11.799109+0000","last_clean":"2024-05-08T04:21:11.799109+0000","last_became_active":"2024-05-08T04:21:10.800919+0000","last_became_peered":"2024-05-08T04:21:10.800919+0000","last_unstale":"2024-05-08T04:21:11.799109+0000","last_undegraded":"2024-05-08T04:21:11.799109+0000","last_fullsized":"2024-05-08T04:21:11.799109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:14.742480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997234+0000","last_change":"2024-05-08T04:21:10.812578+0000","last_active":"2024-05-08T04:21:11.997234+0000","last_peered":"2024-05-08T04:21:11.997234+0000","last_clean":"2024-05-08T04:21:11.997234+0000","last_became_active":"2024-05-08T04:21:10.811984+0000","last_became_peered":"2024-05-08T04:21:10.811984+0000","last_unstale":"2024-05-08T04:21:11.997234+0000","last_undegraded":"2024-05-08T04:21:11.997234+0000","last_fullsized":"2024-05-08T04:21:11.997234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:18.292078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.805869+0000","last_change":"2024-05-08T04:21:10.803704+0000","last_active":"2024-05-08T04:21:10.805869+0000","last_peered":"2024-05-08T04:21:10.805869+0000","last_clean":"2024-05-08T04:21:10.805869+0000","last_became_active":"2024-05-08T04:21:10.803362+0000","last_became_peered":"2024-05-08T04:21:10.803362+0000","last_unstale":"2024-05-08T04:21:10.805869+0000","last_undegraded":"2024-05-08T04:21:10.805869+0000","last_fullsized":"2024-05-08T04:21:10.805869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:32.235085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.808557+0000","last_change":"2024-05-08T04:21:10.803508+0000","last_active":"2024-05-08T04:21:10.808557+0000","last_peered":"2024-05-08T04:21:10.808557+0000","last_clean":"2024-05-08T04:21:10.808557+0000","last_became_active":"2024-05-08T04:21:10.803182+0000","last_became_peered":"2024-05-08T04:21:10.803182+0000","last_unstale":"2024-05-08T04:21:10.808557+0000","last_undegraded":"2024-05-08T04:21:10.808557+0000","last_fullsized":"2024-05-08T04:21:10.808557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:43.868339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797469+0000","last_change":"2024-05-08T04:21:10.806394+0000","last_active":"2024-05-08T04:21:11.797469+0000","last_peered":"2024-05-08T04:21:11.797469+0000","last_clean":"2024-05-08T04:21:11.797469+0000","last_became_active":"2024-05-08T04:21:10.806139+0000","last_became_peered":"2024-05-08T04:21:10.806139+0000","last_unstale":"2024-05-08T04:21:11.797469+0000","last_undegraded":"2024-05-08T04:21:11.797469+0000","last_fullsized":"2024-05-08T04:21:11.797469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:00.517242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799118+0000","last_change":"2024-05-08T04:21:09.799594+0000","last_active":"2024-05-08T04:21:11.799118+0000","last_peered":"2024-05-08T04:21:11.799118+0000","last_clean":"2024-05-08T04:21:11.799118+0000","last_became_active":"2024-05-08T04:21:09.798501+0000","last_became_peered":"2024-05-08T04:21:09.798501+0000","last_unstale":"2024-05-08T04:21:11.799118+0000","last_undegraded":"2024-05-08T04:21:11.799118+0000","last_fullsized":"2024-05-08T04:21:11.799118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804031+0000","last_change":"2024-05-08T04:21:10.812658+0000","last_active":"2024-05-08T04:21:11.804031+0000","last_peered":"2024-05-08T04:21:11.804031+0000","last_clean":"2024-05-08T04:21:11.804031+0000","last_became_active":"2024-05-08T04:21:10.812321+0000","last_became_peered":"2024-05-08T04:21:10.812321+0000","last_unstale":"2024-05-08T04:21:11.804031+0000","last_undegraded":"2024-05-08T04:21:11.804031+0000","last_fullsized":"2024-05-08T04:21:11.804031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997336+0000","last_change":"2024-05-08T04:21:09.805980+0000","last_active":"2024-05-08T04:21:11.997336+0000","last_peered":"2024-05-08T04:21:11.997336+0000","last_clean":"2024-05-08T04:21:11.997336+0000","last_became_active":"2024-05-08T04:21:09.805512+0000","last_became_peered":"2024-05-08T04:21:09.805512+0000","last_unstale":"2024-05-08T04:21:11.997336+0000","last_undegraded":"2024-05-08T04:21:11.997336+0000","last_fullsized":"2024-05-08T04:21:11.997336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:34:59.948483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.799241+0000","last_change":"2024-05-08T04:21:09.807091+0000","last_active":"2024-05-08T04:21:10.799241+0000","last_peered":"2024-05-08T04:21:10.799241+0000","last_clean":"2024-05-08T04:21:10.799241+0000","last_became_active":"2024-05-08T04:21:09.806790+0000","last_became_peered":"2024-05-08T04:21:09.806790+0000","last_unstale":"2024-05-08T04:21:10.799241+0000","last_undegraded":"2024-05-08T04:21:10.799241+0000","last_fullsized":"2024-05-08T04:21:10.799241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799252+0000","last_change":"2024-05-08T04:21:10.806542+0000","last_active":"2024-05-08T04:21:11.799252+0000","last_peered":"2024-05-08T04:21:11.799252+0000","last_clean":"2024-05-08T04:21:11.799252+0000","last_became_active":"2024-05-08T04:21:10.804525+0000","last_became_peered":"2024-05-08T04:21:10.804525+0000","last_unstale":"2024-05-08T04:21:11.799252+0000","last_undegraded":"2024-05-08T04:21:11.799252+0000","last_fullsized":"2024-05-08T04:21:11.799252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:33.067388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997177+0000","last_change":"2024-05-08T04:21:09.803521+0000","last_active":"2024-05-08T04:21:11.997177+0000","last_peered":"2024-05-08T04:21:11.997177+0000","last_clean":"2024-05-08T04:21:11.997177+0000","last_became_active":"2024-05-08T04:21:09.803237+0000","last_became_peered":"2024-05-08T04:21:09.803237+0000","last_unstale":"2024-05-08T04:21:11.997177+0000","last_undegraded":"2024-05-08T04:21:11.997177+0000","last_fullsized":"2024-05-08T04:21:11.997177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803821+0000","last_change":"2024-05-08T04:21:10.804293+0000","last_active":"2024-05-08T04:21:11.803821+0000","last_peered":"2024-05-08T04:21:11.803821+0000","last_clean":"2024-05-08T04:21:11.803821+0000","last_became_active":"2024-05-08T04:21:10.803978+0000","last_became_peered":"2024-05-08T04:21:10.803978+0000","last_unstale":"2024-05-08T04:21:11.803821+0000","last_undegraded":"2024-05-08T04:21:11.803821+0000","last_fullsized":"2024-05-08T04:21:11.803821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:00.315803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797658+0000","last_change":"2024-05-08T04:21:09.802555+0000","last_active":"2024-05-08T04:21:11.797658+0000","last_peered":"2024-05-08T04:21:11.797658+0000","last_clean":"2024-05-08T04:21:11.797658+0000","last_became_active":"2024-05-08T04:21:09.801729+0000","last_became_peered":"2024-05-08T04:21:09.801729+0000","last_unstale":"2024-05-08T04:21:11.797658+0000","last_undegraded":"2024-05-08T04:21:11.797658+0000","last_fullsized":"2024-05-08T04:21:11.797658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.819912+0000","last_change":"2024-05-08T04:21:10.817304+0000","last_active":"2024-05-08T04:21:10.819912+0000","last_peered":"2024-05-08T04:21:10.819912+0000","last_clean":"2024-05-08T04:21:10.819912+0000","last_became_active":"2024-05-08T04:21:10.817053+0000","last_became_peered":"2024-05-08T04:21:10.817053+0000","last_unstale":"2024-05-08T04:21:10.819912+0000","last_undegraded":"2024-05-08T04:21:10.819912+0000","last_fullsized":"2024-05-08T04:21:10.819912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:14.085078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806539+0000","last_change":"2024-05-08T04:21:09.808688+0000","last_active":"2024-05-08T04:21:11.806539+0000","last_peered":"2024-05-08T04:21:11.806539+0000","last_clean":"2024-05-08T04:21:11.806539+0000","last_became_active":"2024-05-08T04:21:09.808341+0000","last_became_peered":"2024-05-08T04:21:09.808341+0000","last_unstale":"2024-05-08T04:21:11.806539+0000","last_undegraded":"2024-05-08T04:21:11.806539+0000","last_fullsized":"2024-05-08T04:21:11.806539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:13.078999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799355+0000","last_change":"2024-05-08T04:21:10.812699+0000","last_active":"2024-05-08T04:21:11.799355+0000","last_peered":"2024-05-08T04:21:11.799355+0000","last_clean":"2024-05-08T04:21:11.799355+0000","last_became_active":"2024-05-08T04:21:10.812379+0000","last_became_peered":"2024-05-08T04:21:10.812379+0000","last_unstale":"2024-05-08T04:21:11.799355+0000","last_undegraded":"2024-05-08T04:21:11.799355+0000","last_fullsized":"2024-05-08T04:21:11.799355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.816662+0000","last_change":"2024-05-08T04:21:09.796581+0000","last_active":"2024-05-08T04:21:10.816662+0000","last_peered":"2024-05-08T04:21:10.816662+0000","last_clean":"2024-05-08T04:21:10.816662+0000","last_became_active":"2024-05-08T04:21:09.796288+0000","last_became_peered":"2024-05-08T04:21:09.796288+0000","last_unstale":"2024-05-08T04:21:10.816662+0000","last_undegraded":"2024-05-08T04:21:10.816662+0000","last_fullsized":"2024-05-08T04:21:10.816662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997394+0000","last_change":"2024-05-08T04:21:10.809585+0000","last_active":"2024-05-08T04:21:11.997394+0000","last_peered":"2024-05-08T04:21:11.997394+0000","last_clean":"2024-05-08T04:21:11.997394+0000","last_became_active":"2024-05-08T04:21:10.809208+0000","last_became_peered":"2024-05-08T04:21:10.809208+0000","last_unstale":"2024-05-08T04:21:11.997394+0000","last_undegraded":"2024-05-08T04:21:11.997394+0000","last_fullsized":"2024-05-08T04:21:11.997394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:53:26.704579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.821563+0000","last_change":"2024-05-08T04:21:09.798917+0000","last_active":"2024-05-08T04:21:10.821563+0000","last_peered":"2024-05-08T04:21:10.821563+0000","last_clean":"2024-05-08T04:21:10.821563+0000","last_became_active":"2024-05-08T04:21:09.798646+0000","last_became_peered":"2024-05-08T04:21:09.798646+0000","last_unstale":"2024-05-08T04:21:10.821563+0000","last_undegraded":"2024-05-08T04:21:10.821563+0000","last_fullsized":"2024-05-08T04:21:10.821563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:25.652092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806500+0000","last_change":"2024-05-08T04:21:10.806707+0000","last_active":"2024-05-08T04:21:11.806500+0000","last_peered":"2024-05-08T04:21:11.806500+0000","last_clean":"2024-05-08T04:21:11.806500+0000","last_became_active":"2024-05-08T04:21:10.806433+0000","last_became_peered":"2024-05-08T04:21:10.806433+0000","last_unstale":"2024-05-08T04:21:11.806500+0000","last_undegraded":"2024-05-08T04:21:11.806500+0000","last_fullsized":"2024-05-08T04:21:11.806500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:39.936653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.812250+0000","last_change":"2024-05-08T04:21:09.806965+0000","last_active":"2024-05-08T04:21:10.812250+0000","last_peered":"2024-05-08T04:21:10.812250+0000","last_clean":"2024-05-08T04:21:10.812250+0000","last_became_active":"2024-05-08T04:21:09.806616+0000","last_became_peered":"2024-05-08T04:21:09.806616+0000","last_unstale":"2024-05-08T04:21:10.812250+0000","last_undegraded":"2024-05-08T04:21:10.812250+0000","last_fullsized":"2024-05-08T04:21:10.812250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:09.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.816414+0000","last_change":"2024-05-08T04:21:10.814170+0000","last_active":"2024-05-08T04:21:10.816414+0000","last_peered":"2024-05-08T04:21:10.816414+0000","last_clean":"2024-05-08T04:21:10.816414+0000","last_became_active":"2024-05-08T04:21:10.813882+0000","last_became_peered":"2024-05-08T04:21:10.813882+0000","last_unstale":"2024-05-08T04:21:10.816414+0000","last_undegraded":"2024-05-08T04:21:10.816414+0000","last_fullsized":"2024-05-08T04:21:10.816414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:35:00.954562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997406+0000","last_change":"2024-05-08T04:21:09.799377+0000","last_active":"2024-05-08T04:21:11.997406+0000","last_peered":"2024-05-08T04:21:11.997406+0000","last_clean":"2024-05-08T04:21:11.997406+0000","last_became_active":"2024-05-08T04:21:09.799078+0000","last_became_peered":"2024-05-08T04:21:09.799078+0000","last_unstale":"2024-05-08T04:21:11.997406+0000","last_undegraded":"2024-05-08T04:21:11.997406+0000","last_fullsized":"2024-05-08T04:21:11.997406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:28:59.511163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997261+0000","last_change":"2024-05-08T04:21:10.814186+0000","last_active":"2024-05-08T04:21:11.997261+0000","last_peered":"2024-05-08T04:21:11.997261+0000","last_clean":"2024-05-08T04:21:11.997261+0000","last_became_active":"2024-05-08T04:21:10.813837+0000","last_became_peered":"2024-05-08T04:21:10.813837+0000","last_unstale":"2024-05-08T04:21:11.997261+0000","last_undegraded":"2024-05-08T04:21:11.997261+0000","last_fullsized":"2024-05-08T04:21:11.997261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:41:47.087907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806222+0000","last_change":"2024-05-08T04:21:09.809783+0000","last_active":"2024-05-08T04:21:11.806222+0000","last_peered":"2024-05-08T04:21:11.806222+0000","last_clean":"2024-05-08T04:21:11.806222+0000","last_became_active":"2024-05-08T04:21:09.809489+0000","last_became_peered":"2024-05-08T04:21:09.809489+0000","last_unstale":"2024-05-08T04:21:11.806222+0000","last_undegraded":"2024-05-08T04:21:11.806222+0000","last_fullsized":"2024-05-08T04:21:11.806222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797316+0000","last_change":"2024-05-08T04:21:10.802400+0000","last_active":"2024-05-08T04:21:11.797316+0000","last_peered":"2024-05-08T04:21:11.797316+0000","last_clean":"2024-05-08T04:21:11.797316+0000","last_became_active":"2024-05-08T04:21:10.801522+0000","last_became_peered":"2024-05-08T04:21:10.801522+0000","last_unstale":"2024-05-08T04:21:11.797316+0000","last_undegraded":"2024-05-08T04:21:11.797316+0000","last_fullsized":"2024-05-08T04:21:11.797316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:11.466963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803687+0000","last_change":"2024-05-08T04:21:09.795156+0000","last_active":"2024-05-08T04:21:11.803687+0000","last_peered":"2024-05-08T04:21:11.803687+0000","last_clean":"2024-05-08T04:21:11.803687+0000","last_became_active":"2024-05-08T04:21:09.794658+0000","last_became_peered":"2024-05-08T04:21:09.794658+0000","last_unstale":"2024-05-08T04:21:11.803687+0000","last_undegraded":"2024-05-08T04:21:11.803687+0000","last_fullsized":"2024-05-08T04:21:11.803687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997156+0000","last_change":"2024-05-08T04:21:10.810862+0000","last_active":"2024-05-08T04:21:11.997156+0000","last_peered":"2024-05-08T04:21:11.997156+0000","last_clean":"2024-05-08T04:21:11.997156+0000","last_became_active":"2024-05-08T04:21:10.810041+0000","last_became_peered":"2024-05-08T04:21:10.810041+0000","last_unstale":"2024-05-08T04:21:11.997156+0000","last_undegraded":"2024-05-08T04:21:11.997156+0000","last_fullsized":"2024-05-08T04:21:11.997156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:37:37.045065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806759+0000","last_change":"2024-05-08T04:21:09.805736+0000","last_active":"2024-05-08T04:21:11.806759+0000","last_peered":"2024-05-08T04:21:11.806759+0000","last_clean":"2024-05-08T04:21:11.806759+0000","last_became_active":"2024-05-08T04:21:09.805416+0000","last_became_peered":"2024-05-08T04:21:09.805416+0000","last_unstale":"2024-05-08T04:21:11.806759+0000","last_undegraded":"2024-05-08T04:21:11.806759+0000","last_fullsized":"2024-05-08T04:21:11.806759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:52.764630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.819785+0000","last_change":"2024-05-08T04:21:10.812910+0000","last_active":"2024-05-08T04:21:10.819785+0000","last_peered":"2024-05-08T04:21:10.819785+0000","last_clean":"2024-05-08T04:21:10.819785+0000","last_became_active":"2024-05-08T04:21:10.812514+0000","last_became_peered":"2024-05-08T04:21:10.812514+0000","last_unstale":"2024-05-08T04:21:10.819785+0000","last_undegraded":"2024-05-08T04:21:10.819785+0000","last_fullsized":"2024-05-08T04:21:10.819785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:32.235085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804208+0000","last_change":"2024-05-08T04:21:09.800590+0000","last_active":"2024-05-08T04:21:11.804208+0000","last_peered":"2024-05-08T04:21:11.804208+0000","last_clean":"2024-05-08T04:21:11.804208+0000","last_became_active":"2024-05-08T04:21:09.800287+0000","last_became_peered":"2024-05-08T04:21:09.800287+0000","last_unstale":"2024-05-08T04:21:11.804208+0000","last_undegraded":"2024-05-08T04:21:11.804208+0000","last_fullsized":"2024-05-08T04:21:11.804208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:13.078999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806581+0000","last_change":"2024-05-08T04:21:10.806772+0000","last_active":"2024-05-08T04:21:11.806581+0000","last_peered":"2024-05-08T04:21:11.806581+0000","last_clean":"2024-05-08T04:21:11.806581+0000","last_became_active":"2024-05-08T04:21:10.806521+0000","last_became_peered":"2024-05-08T04:21:10.806521+0000","last_unstale":"2024-05-08T04:21:11.806581+0000","last_undegraded":"2024-05-08T04:21:11.806581+0000","last_fullsized":"2024-05-08T04:21:11.806581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:01.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799154+0000","last_change":"2024-05-08T04:21:09.799358+0000","last_active":"2024-05-08T04:21:11.799154+0000","last_peered":"2024-05-08T04:21:11.799154+0000","last_clean":"2024-05-08T04:21:11.799154+0000","last_became_active":"2024-05-08T04:21:09.799071+0000","last_became_peered":"2024-05-08T04:21:09.799071+0000","last_unstale":"2024-05-08T04:21:11.799154+0000","last_undegraded":"2024-05-08T04:21:11.799154+0000","last_fullsized":"2024-05-08T04:21:11.799154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806649+0000","last_change":"2024-05-08T04:21:10.808148+0000","last_active":"2024-05-08T04:21:11.806649+0000","last_peered":"2024-05-08T04:21:11.806649+0000","last_clean":"2024-05-08T04:21:11.806649+0000","last_became_active":"2024-05-08T04:21:10.807665+0000","last_became_peered":"2024-05-08T04:21:10.807665+0000","last_unstale":"2024-05-08T04:21:11.806649+0000","last_undegraded":"2024-05-08T04:21:11.806649+0000","last_fullsized":"2024-05-08T04:21:11.806649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.798915+0000","last_change":"2024-05-08T04:21:09.808562+0000","last_active":"2024-05-08T04:21:10.798915+0000","last_peered":"2024-05-08T04:21:10.798915+0000","last_clean":"2024-05-08T04:21:10.798915+0000","last_became_active":"2024-05-08T04:21:09.808278+0000","last_became_peered":"2024-05-08T04:21:09.808278+0000","last_unstale":"2024-05-08T04:21:10.798915+0000","last_undegraded":"2024-05-08T04:21:10.798915+0000","last_fullsized":"2024-05-08T04:21:10.798915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:09.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997548+0000","last_change":"2024-05-08T04:21:10.811650+0000","last_active":"2024-05-08T04:21:11.997548+0000","last_peered":"2024-05-08T04:21:11.997548+0000","last_clean":"2024-05-08T04:21:11.997548+0000","last_became_active":"2024-05-08T04:21:10.811088+0000","last_became_peered":"2024-05-08T04:21:10.811088+0000","last_unstale":"2024-05-08T04:21:11.997548+0000","last_undegraded":"2024-05-08T04:21:11.997548+0000","last_fullsized":"2024-05-08T04:21:11.997548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:11:24.741018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797369+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:21:11.797369+0000","last_peered":"2024-05-08T04:21:11.797369+0000","last_clean":"2024-05-08T04:21:11.797369+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:21:11.797369+0000","last_undegraded":"2024-05-08T04:21:11.797369+0000","last_fullsized":"2024-05-08T04:21:11.797369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997368+0000","last_change":"2024-05-08T04:21:09.805253+0000","last_active":"2024-05-08T04:21:11.997368+0000","last_peered":"2024-05-08T04:21:11.997368+0000","last_clean":"2024-05-08T04:21:11.997368+0000","last_became_active":"2024-05-08T04:21:09.805004+0000","last_became_peered":"2024-05-08T04:21:09.805004+0000","last_unstale":"2024-05-08T04:21:11.997368+0000","last_undegraded":"2024-05-08T04:21:11.997368+0000","last_fullsized":"2024-05-08T04:21:11.997368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:52.552788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803933+0000","last_change":"2024-05-08T04:21:10.806073+0000","last_active":"2024-05-08T04:21:11.803933+0000","last_peered":"2024-05-08T04:21:11.803933+0000","last_clean":"2024-05-08T04:21:11.803933+0000","last_became_active":"2024-05-08T04:21:10.805314+0000","last_became_peered":"2024-05-08T04:21:10.805314+0000","last_unstale":"2024-05-08T04:21:11.803933+0000","last_undegraded":"2024-05-08T04:21:11.803933+0000","last_fullsized":"2024-05-08T04:21:11.803933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:29.958463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997207+0000","last_change":"2024-05-08T04:21:09.800131+0000","last_active":"2024-05-08T04:21:11.997207+0000","last_peered":"2024-05-08T04:21:11.997207+0000","last_clean":"2024-05-08T04:21:11.997207+0000","last_became_active":"2024-05-08T04:21:09.799704+0000","last_became_peered":"2024-05-08T04:21:09.799704+0000","last_unstale":"2024-05-08T04:21:11.997207+0000","last_undegraded":"2024-05-08T04:21:11.997207+0000","last_fullsized":"2024-05-08T04:21:11.997207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:52.764630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.807738+0000","last_change":"2024-05-08T04:21:10.802802+0000","last_active":"2024-05-08T04:21:10.807738+0000","last_peered":"2024-05-08T04:21:10.807738+0000","last_clean":"2024-05-08T04:21:10.807738+0000","last_became_active":"2024-05-08T04:21:10.802481+0000","last_became_peered":"2024-05-08T04:21:10.802481+0000","last_unstale":"2024-05-08T04:21:10.807738+0000","last_undegraded":"2024-05-08T04:21:10.807738+0000","last_fullsized":"2024-05-08T04:21:10.807738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:32.235085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.795108+0000","last_change":"2024-05-08T04:21:09.797811+0000","last_active":"2024-05-08T04:21:10.795108+0000","last_peered":"2024-05-08T04:21:10.795108+0000","last_clean":"2024-05-08T04:21:10.795108+0000","last_became_active":"2024-05-08T04:21:09.797499+0000","last_became_peered":"2024-05-08T04:21:09.797499+0000","last_unstale":"2024-05-08T04:21:10.795108+0000","last_undegraded":"2024-05-08T04:21:10.795108+0000","last_fullsized":"2024-05-08T04:21:10.795108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798975+0000","last_change":"2024-05-08T04:21:10.801647+0000","last_active":"2024-05-08T04:21:11.798975+0000","last_peered":"2024-05-08T04:21:11.798975+0000","last_clean":"2024-05-08T04:21:11.798975+0000","last_became_active":"2024-05-08T04:21:10.800875+0000","last_became_peered":"2024-05-08T04:21:10.800875+0000","last_unstale":"2024-05-08T04:21:11.798975+0000","last_undegraded":"2024-05-08T04:21:11.798975+0000","last_fullsized":"2024-05-08T04:21:11.798975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:33.787458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997455+0000","last_change":"2024-05-08T04:21:09.804263+0000","last_active":"2024-05-08T04:21:11.997455+0000","last_peered":"2024-05-08T04:21:11.997455+0000","last_clean":"2024-05-08T04:21:11.997455+0000","last_became_active":"2024-05-08T04:21:09.804011+0000","last_became_peered":"2024-05-08T04:21:09.804011+0000","last_unstale":"2024-05-08T04:21:11.997455+0000","last_undegraded":"2024-05-08T04:21:11.997455+0000","last_fullsized":"2024-05-08T04:21:11.997455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:01.499390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806394+0000","last_change":"2024-05-08T04:21:10.809139+0000","last_active":"2024-05-08T04:21:11.806394+0000","last_peered":"2024-05-08T04:21:11.806394+0000","last_clean":"2024-05-08T04:21:11.806394+0000","last_became_active":"2024-05-08T04:21:10.808801+0000","last_became_peered":"2024-05-08T04:21:10.808801+0000","last_unstale":"2024-05-08T04:21:11.806394+0000","last_undegraded":"2024-05-08T04:21:11.806394+0000","last_fullsized":"2024-05-08T04:21:11.806394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798765+0000","last_change":"2024-05-08T04:21:09.799028+0000","last_active":"2024-05-08T04:21:11.798765+0000","last_peered":"2024-05-08T04:21:11.798765+0000","last_clean":"2024-05-08T04:21:11.798765+0000","last_became_active":"2024-05-08T04:21:09.798761+0000","last_became_peered":"2024-05-08T04:21:09.798761+0000","last_unstale":"2024-05-08T04:21:11.798765+0000","last_undegraded":"2024-05-08T04:21:11.798765+0000","last_fullsized":"2024-05-08T04:21:11.798765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.801037+0000","last_change":"2024-05-08T04:21:10.799702+0000","last_active":"2024-05-08T04:21:10.801037+0000","last_peered":"2024-05-08T04:21:10.801037+0000","last_clean":"2024-05-08T04:21:10.801037+0000","last_became_active":"2024-05-08T04:21:10.799422+0000","last_became_peered":"2024-05-08T04:21:10.799422+0000","last_unstale":"2024-05-08T04:21:10.801037+0000","last_undegraded":"2024-05-08T04:21:10.801037+0000","last_fullsized":"2024-05-08T04:21:10.801037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:10.335725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997612+0000","last_change":"2024-05-08T04:21:09.798256+0000","last_active":"2024-05-08T04:21:11.997612+0000","last_peered":"2024-05-08T04:21:11.997612+0000","last_clean":"2024-05-08T04:21:11.997612+0000","last_became_active":"2024-05-08T04:21:09.796157+0000","last_became_peered":"2024-05-08T04:21:09.796157+0000","last_unstale":"2024-05-08T04:21:11.997612+0000","last_undegraded":"2024-05-08T04:21:11.997612+0000","last_fullsized":"2024-05-08T04:21:11.997612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:10.460883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.814594+0000","last_change":"2024-05-08T04:21:10.808794+0000","last_active":"2024-05-08T04:21:10.814594+0000","last_peered":"2024-05-08T04:21:10.814594+0000","last_clean":"2024-05-08T04:21:10.814594+0000","last_became_active":"2024-05-08T04:21:10.808339+0000","last_became_peered":"2024-05-08T04:21:10.808339+0000","last_unstale":"2024-05-08T04:21:10.814594+0000","last_undegraded":"2024-05-08T04:21:10.814594+0000","last_fullsized":"2024-05-08T04:21:10.814594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:54.044618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.807697+0000","last_change":"2024-05-08T04:21:09.806917+0000","last_active":"2024-05-08T04:21:11.807697+0000","last_peered":"2024-05-08T04:21:11.807697+0000","last_clean":"2024-05-08T04:21:11.807697+0000","last_became_active":"2024-05-08T04:21:09.806599+0000","last_became_peered":"2024-05-08T04:21:09.806599+0000","last_unstale":"2024-05-08T04:21:11.807697+0000","last_undegraded":"2024-05-08T04:21:11.807697+0000","last_fullsized":"2024-05-08T04:21:11.807697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804308+0000","last_change":"2024-05-08T04:21:10.809200+0000","last_active":"2024-05-08T04:21:11.804308+0000","last_peered":"2024-05-08T04:21:11.804308+0000","last_clean":"2024-05-08T04:21:11.804308+0000","last_became_active":"2024-05-08T04:21:10.808575+0000","last_became_peered":"2024-05-08T04:21:10.808575+0000","last_unstale":"2024-05-08T04:21:11.804308+0000","last_undegraded":"2024-05-08T04:21:11.804308+0000","last_fullsized":"2024-05-08T04:21:11.804308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997710+0000","last_change":"2024-05-08T04:21:09.807154+0000","last_active":"2024-05-08T04:21:11.997710+0000","last_peered":"2024-05-08T04:21:11.997710+0000","last_clean":"2024-05-08T04:21:11.997710+0000","last_became_active":"2024-05-08T04:21:09.806884+0000","last_became_peered":"2024-05-08T04:21:09.806884+0000","last_unstale":"2024-05-08T04:21:11.997710+0000","last_undegraded":"2024-05-08T04:21:11.997710+0000","last_fullsized":"2024-05-08T04:21:11.997710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:00.101724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804179+0000","last_change":"2024-05-08T04:21:10.805880+0000","last_active":"2024-05-08T04:21:11.804179+0000","last_peered":"2024-05-08T04:21:11.804179+0000","last_clean":"2024-05-08T04:21:11.804179+0000","last_became_active":"2024-05-08T04:21:10.805610+0000","last_became_peered":"2024-05-08T04:21:10.805610+0000","last_unstale":"2024-05-08T04:21:11.804179+0000","last_undegraded":"2024-05-08T04:21:11.804179+0000","last_fullsized":"2024-05-08T04:21:11.804179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806080+0000","last_change":"2024-05-08T04:21:09.805802+0000","last_active":"2024-05-08T04:21:11.806080+0000","last_peered":"2024-05-08T04:21:11.806080+0000","last_clean":"2024-05-08T04:21:11.806080+0000","last_became_active":"2024-05-08T04:21:09.805532+0000","last_became_peered":"2024-05-08T04:21:09.805532+0000","last_unstale":"2024-05-08T04:21:11.806080+0000","last_undegraded":"2024-05-08T04:21:11.806080+0000","last_fullsized":"2024-05-08T04:21:11.806080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997242+0000","last_change":"2024-05-08T04:21:10.810731+0000","last_active":"2024-05-08T04:21:11.997242+0000","last_peered":"2024-05-08T04:21:11.997242+0000","last_clean":"2024-05-08T04:21:11.997242+0000","last_became_active":"2024-05-08T04:21:10.810473+0000","last_became_peered":"2024-05-08T04:21:10.810473+0000","last_unstale":"2024-05-08T04:21:11.997242+0000","last_undegraded":"2024-05-08T04:21:11.997242+0000","last_fullsized":"2024-05-08T04:21:11.997242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:22.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803834+0000","last_change":"2024-05-08T04:21:09.808749+0000","last_active":"2024-05-08T04:21:11.803834+0000","last_peered":"2024-05-08T04:21:11.803834+0000","last_clean":"2024-05-08T04:21:11.803834+0000","last_became_active":"2024-05-08T04:21:09.808522+0000","last_became_peered":"2024-05-08T04:21:09.808522+0000","last_unstale":"2024-05-08T04:21:11.803834+0000","last_undegraded":"2024-05-08T04:21:11.803834+0000","last_fullsized":"2024-05-08T04:21:11.803834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803729+0000","last_change":"2024-05-08T04:21:10.803674+0000","last_active":"2024-05-08T04:21:11.803729+0000","last_peered":"2024-05-08T04:21:11.803729+0000","last_clean":"2024-05-08T04:21:11.803729+0000","last_became_active":"2024-05-08T04:21:10.802802+0000","last_became_peered":"2024-05-08T04:21:10.802802+0000","last_unstale":"2024-05-08T04:21:11.803729+0000","last_undegraded":"2024-05-08T04:21:11.803729+0000","last_fullsized":"2024-05-08T04:21:11.803729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:18:33.343054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.799102+0000","last_change":"2024-05-08T04:21:09.801923+0000","last_active":"2024-05-08T04:21:10.799102+0000","last_peered":"2024-05-08T04:21:10.799102+0000","last_clean":"2024-05-08T04:21:10.799102+0000","last_became_active":"2024-05-08T04:21:09.801620+0000","last_became_peered":"2024-05-08T04:21:09.801620+0000","last_unstale":"2024-05-08T04:21:10.799102+0000","last_undegraded":"2024-05-08T04:21:10.799102+0000","last_fullsized":"2024-05-08T04:21:10.799102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.808047+0000","last_change":"2024-05-08T04:21:10.806239+0000","last_active":"2024-05-08T04:21:10.808047+0000","last_peered":"2024-05-08T04:21:10.808047+0000","last_clean":"2024-05-08T04:21:10.808047+0000","last_became_active":"2024-05-08T04:21:10.805961+0000","last_became_peered":"2024-05-08T04:21:10.805961+0000","last_unstale":"2024-05-08T04:21:10.808047+0000","last_undegraded":"2024-05-08T04:21:10.808047+0000","last_fullsized":"2024-05-08T04:21:10.808047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:14.085078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997335+0000","last_change":"2024-05-08T04:21:09.805477+0000","last_active":"2024-05-08T04:21:11.997335+0000","last_peered":"2024-05-08T04:21:11.997335+0000","last_clean":"2024-05-08T04:21:11.997335+0000","last_became_active":"2024-05-08T04:21:09.805232+0000","last_became_peered":"2024-05-08T04:21:09.805232+0000","last_unstale":"2024-05-08T04:21:11.997335+0000","last_undegraded":"2024-05-08T04:21:11.997335+0000","last_fullsized":"2024-05-08T04:21:11.997335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:33.031084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997271+0000","last_change":"2024-05-08T04:21:10.812788+0000","last_active":"2024-05-08T04:21:11.997271+0000","last_peered":"2024-05-08T04:21:11.997271+0000","last_clean":"2024-05-08T04:21:11.997271+0000","last_became_active":"2024-05-08T04:21:10.812267+0000","last_became_peered":"2024-05-08T04:21:10.812267+0000","last_unstale":"2024-05-08T04:21:11.997271+0000","last_undegraded":"2024-05-08T04:21:11.997271+0000","last_fullsized":"2024-05-08T04:21:11.997271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:56:40.748736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997431+0000","last_change":"2024-05-08T04:21:10.814337+0000","last_active":"2024-05-08T04:21:11.997431+0000","last_peered":"2024-05-08T04:21:11.997431+0000","last_clean":"2024-05-08T04:21:11.997431+0000","last_became_active":"2024-05-08T04:21:10.814087+0000","last_became_peered":"2024-05-08T04:21:10.814087+0000","last_unstale":"2024-05-08T04:21:11.997431+0000","last_undegraded":"2024-05-08T04:21:11.997431+0000","last_fullsized":"2024-05-08T04:21:11.997431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:31.354097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806735+0000","last_change":"2024-05-08T04:21:09.808915+0000","last_active":"2024-05-08T04:21:11.806735+0000","last_peered":"2024-05-08T04:21:11.806735+0000","last_clean":"2024-05-08T04:21:11.806735+0000","last_became_active":"2024-05-08T04:21:09.808528+0000","last_became_peered":"2024-05-08T04:21:09.808528+0000","last_unstale":"2024-05-08T04:21:11.806735+0000","last_undegraded":"2024-05-08T04:21:11.806735+0000","last_fullsized":"2024-05-08T04:21:11.806735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:10.460883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797564+0000","last_change":"2024-05-08T04:21:10.814868+0000","last_active":"2024-05-08T04:21:11.797564+0000","last_peered":"2024-05-08T04:21:11.797564+0000","last_clean":"2024-05-08T04:21:11.797564+0000","last_became_active":"2024-05-08T04:21:10.814012+0000","last_became_peered":"2024-05-08T04:21:10.814012+0000","last_unstale":"2024-05-08T04:21:11.797564+0000","last_undegraded":"2024-05-08T04:21:11.797564+0000","last_fullsized":"2024-05-08T04:21:11.797564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:02.505469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806577+0000","last_change":"2024-05-08T04:21:09.806371+0000","last_active":"2024-05-08T04:21:11.806577+0000","last_peered":"2024-05-08T04:21:11.806577+0000","last_clean":"2024-05-08T04:21:11.806577+0000","last_became_active":"2024-05-08T04:21:09.806120+0000","last_became_peered":"2024-05-08T04:21:09.806120+0000","last_unstale":"2024-05-08T04:21:11.806577+0000","last_undegraded":"2024-05-08T04:21:11.806577+0000","last_fullsized":"2024-05-08T04:21:11.806577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799202+0000","last_change":"2024-05-08T04:21:10.799276+0000","last_active":"2024-05-08T04:21:11.799202+0000","last_peered":"2024-05-08T04:21:11.799202+0000","last_clean":"2024-05-08T04:21:11.799202+0000","last_became_active":"2024-05-08T04:21:10.798986+0000","last_became_peered":"2024-05-08T04:21:10.798986+0000","last_unstale":"2024-05-08T04:21:11.799202+0000","last_undegraded":"2024-05-08T04:21:11.799202+0000","last_fullsized":"2024-05-08T04:21:11.799202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:39.936653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799414+0000","last_change":"2024-05-08T04:21:09.795113+0000","last_active":"2024-05-08T04:21:11.799414+0000","last_peered":"2024-05-08T04:21:11.799414+0000","last_clean":"2024-05-08T04:21:11.799414+0000","last_became_active":"2024-05-08T04:21:09.794565+0000","last_became_peered":"2024-05-08T04:21:09.794565+0000","last_unstale":"2024-05-08T04:21:11.799414+0000","last_undegraded":"2024-05-08T04:21:11.799414+0000","last_fullsized":"2024-05-08T04:21:11.799414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799323+0000","last_change":"2024-05-08T04:21:10.794958+0000","last_active":"2024-05-08T04:21:11.799323+0000","last_peered":"2024-05-08T04:21:11.799323+0000","last_clean":"2024-05-08T04:21:11.799323+0000","last_became_active":"2024-05-08T04:21:10.794649+0000","last_became_peered":"2024-05-08T04:21:10.794649+0000","last_unstale":"2024-05-08T04:21:11.799323+0000","last_undegraded":"2024-05-08T04:21:11.799323+0000","last_fullsized":"2024-05-08T04:21:11.799323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:36.487747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804255+0000","last_change":"2024-05-08T04:21:09.802589+0000","last_active":"2024-05-08T04:21:11.804255+0000","last_peered":"2024-05-08T04:21:11.804255+0000","last_clean":"2024-05-08T04:21:11.804255+0000","last_became_active":"2024-05-08T04:21:09.802292+0000","last_became_peered":"2024-05-08T04:21:09.802292+0000","last_unstale":"2024-05-08T04:21:11.804255+0000","last_undegraded":"2024-05-08T04:21:11.804255+0000","last_fullsized":"2024-05-08T04:21:11.804255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":200704,"data_stored":64758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":661394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":73218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":200704,"data_stored":64690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:21:14.868 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-08T04:21:15.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.999+0000 7f2f1e6fc640 1 Processor -- start 2024-05-08T04:21:15.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:14.999+0000 7f2f1e6fc640 1 -- start start 2024-05-08T04:21:15.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f1e6fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2f1815dad0 0x7f2f180d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:15.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f1e6fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f180d35c0 0x7f2f180b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:15.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f1e6fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2f180d1fa0 0x7f2f180b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:15.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f1e6fc640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f180b9920 con 0x7f2f1815dad0 2024-05-08T04:21:15.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f1e6fc640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f180d2520 con 0x7f2f180d1fa0 2024-05-08T04:21:15.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f1e6fc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180d2800 con 0x7f2f180d35c0 2024-05-08T04:21:15.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f17fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2f1815dad0 0x7f2f180d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:15.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f17fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2f1815dad0 0x7f2f180d1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53206/0 (socket says 172.21.15.104:53206) 2024-05-08T04:21:15.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f17fff640 1 -- 172.21.15.104:0/429953913 learned_addr learned my addr 172.21.15.104:0/429953913 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:15.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f1cc99640 1 --2- 172.21.15.104:0/429953913 >> v2:172.21.15.183:3300/0 conn(0x7f2f180d1fa0 0x7f2f180b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:15.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f177fe640 1 --2- 172.21.15.104:0/429953913 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f180d35c0 0x7f2f180b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:15.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f17fff640 1 -- 172.21.15.104:0/429953913 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f180d35c0 msgr2=0x7f2f180b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f17fff640 1 --2- 172.21.15.104:0/429953913 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f180d35c0 0x7f2f180b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f17fff640 1 -- 172.21.15.104:0/429953913 >> v2:172.21.15.183:3300/0 conn(0x7f2f180d1fa0 msgr2=0x7f2f180b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f17fff640 1 --2- 172.21.15.104:0/429953913 >> v2:172.21.15.183:3300/0 conn(0x7f2f180d1fa0 0x7f2f180b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.000+0000 7f2f17fff640 1 -- 172.21.15.104:0/429953913 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f180d2ae0 con 0x7f2f1815dad0 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.001+0000 7f2f17fff640 1 --2- 172.21.15.104:0/429953913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f1815dad0 0x7f2f180d1a60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2f180cdfe0 tx=0x7f2f0802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3870f87c2007ec7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.001+0000 7f2f16ffd640 1 -- 172.21.15.104:0/429953913 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08037070 con 0x7f2f1815dad0 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.001+0000 7f2f16ffd640 1 -- 172.21.15.104:0/429953913 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f08032440 con 0x7f2f1815dad0 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.001+0000 7f2f16ffd640 1 -- 172.21.15.104:0/429953913 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08032810 con 0x7f2f1815dad0 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.001+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/429953913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f1815dad0 msgr2=0x7f2f180d1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.001+0000 7f2f1e6fc640 1 --2- 172.21.15.104:0/429953913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f1815dad0 0x7f2f180d1a60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2f180cdfe0 tx=0x7f2f0802a1e0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.001+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/429953913 shutdown_connections 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.001+0000 7f2f1e6fc640 1 --2- 172.21.15.104:0/429953913 >> v2:172.21.15.183:3300/0 conn(0x7f2f180d1fa0 0x7f2f180b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.001+0000 7f2f1e6fc640 1 --2- 172.21.15.104:0/429953913 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f180d35c0 0x7f2f180b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.001+0000 7f2f1e6fc640 1 --2- 172.21.15.104:0/429953913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f1815dad0 0x7f2f180d1a60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.001+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/429953913 >> 172.21.15.104:0/429953913 conn(0x7f2f1806c650 msgr2=0x7f2f180d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:15.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.002+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/429953913 shutdown_connections 2024-05-08T04:21:15.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.002+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/429953913 wait complete. 2024-05-08T04:21:15.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.003+0000 7f2f1e6fc640 1 Processor -- start 2024-05-08T04:21:15.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.003+0000 7f2f1e6fc640 1 -- start start 2024-05-08T04:21:15.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f1e6fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f180d1fa0 0x7f2f18160be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:15.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f1e6fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f180d35c0 0x7f2f181f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f1e6fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f1815dad0 0x7f2f180cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f1e6fc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1815deb0 con 0x7f2f180d1fa0 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f1e6fc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f180d30a0 con 0x7f2f1815dad0 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f1e6fc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1815e030 con 0x7f2f180d35c0 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f17fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f180d1fa0 0x7f2f18160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f17fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f180d1fa0 0x7f2f18160be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53210/0 (socket says 172.21.15.104:53210) 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f17fff640 1 -- 172.21.15.104:0/870433245 learned_addr learned my addr 172.21.15.104:0/870433245 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f177fe640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f180d35c0 0x7f2f181f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f1cc99640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f1815dad0 0x7f2f180cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f17fff640 1 -- 172.21.15.104:0/870433245 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f180d35c0 msgr2=0x7f2f181f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f17fff640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f180d35c0 0x7f2f181f72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f17fff640 1 -- 172.21.15.104:0/870433245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f1815dad0 msgr2=0x7f2f180cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f17fff640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f1815dad0 0x7f2f180cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f17fff640 1 -- 172.21.15.104:0/870433245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f18154d50 con 0x7f2f180d1fa0 2024-05-08T04:21:15.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f17fff640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f180d1fa0 0x7f2f18160be0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2f0802a220 tx=0x7f2f080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:15.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f14ff9640 1 -- 172.21.15.104:0/870433245 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08041020 con 0x7f2f180d1fa0 2024-05-08T04:21:15.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f14ff9640 1 -- 172.21.15.104:0/870433245 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f080306c0 con 0x7f2f180d1fa0 2024-05-08T04:21:15.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/870433245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f18155030 con 0x7f2f180d1fa0 2024-05-08T04:21:15.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f14ff9640 1 -- 172.21.15.104:0/870433245 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08037040 con 0x7f2f180d1fa0 2024-05-08T04:21:15.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.004+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/870433245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f181555f0 con 0x7f2f180d1fa0 2024-05-08T04:21:15.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.005+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/870433245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f18155a30 con 0x7f2f180d1fa0 2024-05-08T04:21:15.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.006+0000 7f2f14ff9640 1 -- 172.21.15.104:0/870433245 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2f08044020 con 0x7f2f180d1fa0 2024-05-08T04:21:15.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.006+0000 7f2f14ff9640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2f0406b4d0 0x7f2f0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:15.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.006+0000 7f2f14ff9640 1 -- 172.21.15.104:0/870433245 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f080aa9c0 con 0x7f2f180d1fa0 2024-05-08T04:21:15.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.006+0000 7f2f177fe640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2f0406b4d0 0x7f2f0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:15.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.006+0000 7f2f177fe640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2f0406b4d0 0x7f2f0406d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f180ccc20 tx=0x7f2f0c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:15.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.010+0000 7f2f14ff9640 1 -- 172.21.15.104:0/870433245 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f080ace20 con 0x7f2f180d1fa0 2024-05-08T04:21:15.239 INFO:tasks.ceph.mds.a.smithi104.stderr:2024-05-08T04:21:15.238+0000 7f239060e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T04:21:15.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.246+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/870433245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2f18075010 con 0x7f2f180d1fa0 2024-05-08T04:21:15.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.246+0000 7f2f14ff9640 1 -- 172.21.15.104:0/870433245 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1011 (secure 0 0 0) 0x7f2f0807f070 con 0x7f2f180d1fa0 2024-05-08T04:21:15.248 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:15.248 INFO:teuthology.orchestra.run.smithi104.stdout:{"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1715142057,"num_in_osds":8,"osd_in_since":1715142048,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":224231424,"bytes_avail":772869881856,"bytes_total":773094113280,"write_bytes_sec":2446,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4296}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-08T04:20:46.444064+0000","services":{}},"progress_events":{}} 2024-05-08T04:21:15.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.248+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/870433245 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2f0406b4d0 msgr2=0x7f2f0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:15.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.248+0000 7f2f1e6fc640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2f0406b4d0 0x7f2f0406d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f180ccc20 tx=0x7f2f0c008040 comp rx=0 tx=0).stop 2024-05-08T04:21:15.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.248+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/870433245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f180d1fa0 msgr2=0x7f2f18160be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:15.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.248+0000 7f2f1e6fc640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f180d1fa0 0x7f2f18160be0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2f0802a220 tx=0x7f2f080046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.248+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/870433245 shutdown_connections 2024-05-08T04:21:15.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.248+0000 7f2f1e6fc640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2f0406b4d0 0x7f2f0406d990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.248+0000 7f2f1e6fc640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f1815dad0 0x7f2f180cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.248+0000 7f2f1e6fc640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f180d35c0 0x7f2f181f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.248+0000 7f2f1e6fc640 1 --2- 172.21.15.104:0/870433245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f180d1fa0 0x7f2f18160be0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.248+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/870433245 >> 172.21.15.104:0/870433245 conn(0x7f2f1806c650 msgr2=0x7f2f180d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:15.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.249+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/870433245 shutdown_connections 2024-05-08T04:21:15.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.249+0000 7f2f1e6fc640 1 -- 172.21.15.104:0/870433245 wait complete. 2024-05-08T04:21:15.260 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-08T04:21:15.261 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:21:15.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.359+0000 7f119d612640 1 Processor -- start 2024-05-08T04:21:15.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.359+0000 7f119d612640 1 -- start start 2024-05-08T04:21:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.360+0000 7f119d612640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f119815de10 0x7f1198161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.360+0000 7f119d612640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f11980d07c0 0x7f11980d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.360+0000 7f119d612640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119815e1f0 con 0x7f11980ce5a0 2024-05-08T04:21:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.360+0000 7f119d612640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11980d0f50 con 0x7f11980d07c0 2024-05-08T04:21:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.360+0000 7f119d612640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1198161e60 con 0x7f119815de10 2024-05-08T04:21:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.360+0000 7f1196ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f119815de10 0x7f1198161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.360+0000 7f11977fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f11980d07c0 0x7f11980d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.360+0000 7f1196ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f119815de10 0x7f1198161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:39580/0 (socket says 172.21.15.104:39580) 2024-05-08T04:21:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.360+0000 7f1196ffd640 1 -- 172.21.15.104:0/3075901411 learned_addr learned my addr 172.21.15.104:0/3075901411 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.361+0000 7f1196ffd640 1 -- 172.21.15.104:0/3075901411 >> v2:172.21.15.183:3300/0 conn(0x7f11980d07c0 msgr2=0x7f11980d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.361+0000 7f1196ffd640 1 --2- 172.21.15.104:0/3075901411 >> v2:172.21.15.183:3300/0 conn(0x7f11980d07c0 0x7f11980d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.361+0000 7f1196ffd640 1 -- 172.21.15.104:0/3075901411 >> v1:172.21.15.183:6789/0 conn(0x7f11980ce5a0 legacy=0x7f11980d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:15.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.361+0000 7f1196ffd640 1 -- 172.21.15.104:0/3075901411 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1198162090 con 0x7f119815de10 2024-05-08T04:21:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.361+0000 7f1196ffd640 1 --2- 172.21.15.104:0/3075901411 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f119815de10 0x7f1198161920 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1188009e50 tx=0x7f118802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=684c176715fa2c00 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.361+0000 7f1195ffb640 1 -- 172.21.15.104:0/3075901411 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188036070 con 0x7f119815de10 2024-05-08T04:21:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.362+0000 7f1195ffb640 1 -- 172.21.15.104:0/3075901411 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1188031600 con 0x7f119815de10 2024-05-08T04:21:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.362+0000 7f1195ffb640 1 -- 172.21.15.104:0/3075901411 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11880319d0 con 0x7f119815de10 2024-05-08T04:21:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.362+0000 7f119d612640 1 -- 172.21.15.104:0/3075901411 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f119815de10 msgr2=0x7f1198161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.362+0000 7f119d612640 1 --2- 172.21.15.104:0/3075901411 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f119815de10 0x7f1198161920 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1188009e50 tx=0x7f118802a680 comp rx=0 tx=0).stop 2024-05-08T04:21:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.362+0000 7f119d612640 1 -- 172.21.15.104:0/3075901411 shutdown_connections 2024-05-08T04:21:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.362+0000 7f119d612640 1 --2- 172.21.15.104:0/3075901411 >> v2:172.21.15.183:3300/0 conn(0x7f11980d07c0 0x7f11980d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.362+0000 7f119d612640 1 --2- 172.21.15.104:0/3075901411 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f119815de10 0x7f1198161920 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.362+0000 7f119d612640 1 -- 172.21.15.104:0/3075901411 >> 172.21.15.104:0/3075901411 conn(0x7f1198072290 msgr2=0x7f1198072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.362+0000 7f119d612640 1 -- 172.21.15.104:0/3075901411 shutdown_connections 2024-05-08T04:21:15.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.362+0000 7f119d612640 1 -- 172.21.15.104:0/3075901411 wait complete. 2024-05-08T04:21:15.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.363+0000 7f119d612640 1 Processor -- start 2024-05-08T04:21:15.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.363+0000 7f119d612640 1 -- start start 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f119d612640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11980ce5a0 0x7f11980c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f119d612640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11980d07c0 0x7f11981f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f119d612640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f119815de10 0x7f11980b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f119d612640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1198162650 con 0x7f11980ce5a0 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f119d612640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11980d1a90 con 0x7f11980d07c0 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f119d612640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11980d1ce0 con 0x7f119815de10 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f1196ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11980ce5a0 0x7f11980c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f1196ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11980ce5a0 0x7f11980c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53224/0 (socket says 172.21.15.104:53224) 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f1196ffd640 1 -- 172.21.15.104:0/354722186 learned_addr learned my addr 172.21.15.104:0/354722186 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f11977fe640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f119815de10 0x7f11980b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f11967fc640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11980d07c0 0x7f11981f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f1196ffd640 1 -- 172.21.15.104:0/354722186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f119815de10 msgr2=0x7f11980b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f1196ffd640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f119815de10 0x7f11980b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f1196ffd640 1 -- 172.21.15.104:0/354722186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11980d07c0 msgr2=0x7f11981f7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:15.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f1196ffd640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11980d07c0 0x7f11981f7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.364+0000 7f1196ffd640 1 -- 172.21.15.104:0/354722186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11980b4d20 con 0x7f11980ce5a0 2024-05-08T04:21:15.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.365+0000 7f1196ffd640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11980ce5a0 0x7f11980c8d00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1188034040 tx=0x7f1188004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:15.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.365+0000 7f117f7fe640 1 -- 172.21.15.104:0/354722186 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118803f020 con 0x7f11980ce5a0 2024-05-08T04:21:15.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.365+0000 7f117f7fe640 1 -- 172.21.15.104:0/354722186 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1188037040 con 0x7f11980ce5a0 2024-05-08T04:21:15.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.365+0000 7f119d612640 1 -- 172.21.15.104:0/354722186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11981f8040 con 0x7f11980ce5a0 2024-05-08T04:21:15.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.365+0000 7f117f7fe640 1 -- 172.21.15.104:0/354722186 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188036070 con 0x7f11980ce5a0 2024-05-08T04:21:15.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.365+0000 7f119d612640 1 -- 172.21.15.104:0/354722186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11980b5270 con 0x7f11980ce5a0 2024-05-08T04:21:15.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.366+0000 7f119d612640 1 -- 172.21.15.104:0/354722186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1198075010 con 0x7f11980ce5a0 2024-05-08T04:21:15.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.366+0000 7f117f7fe640 1 -- 172.21.15.104:0/354722186 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1188042020 con 0x7f11980ce5a0 2024-05-08T04:21:15.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.366+0000 7f117f7fe640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f118406b4d0 0x7f118406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:15.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.367+0000 7f117f7fe640 1 -- 172.21.15.104:0/354722186 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11880aa670 con 0x7f11980ce5a0 2024-05-08T04:21:15.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.367+0000 7f11967fc640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f118406b4d0 0x7f118406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:15.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.367+0000 7f11967fc640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f118406b4d0 0x7f118406d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f11980c9240 tx=0x7f118c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:15.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.371+0000 7f117f7fe640 1 -- 172.21.15.104:0/354722186 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1188049030 con 0x7f11980ce5a0 2024-05-08T04:21:15.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.539+0000 7f119d612640 1 -- 172.21.15.104:0/354722186 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11980d1870 con 0x7f118406b4d0 2024-05-08T04:21:15.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.545+0000 7f117f7fe640 1 -- 172.21.15.104:0/354722186 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251923 (secure 0 0 0) 0x7f11980d1870 con 0x7f118406b4d0 2024-05-08T04:21:15.549 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:15.550 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:21:15.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.548+0000 7f119d612640 1 -- 172.21.15.104:0/354722186 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f118406b4d0 msgr2=0x7f118406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:15.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.548+0000 7f119d612640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f118406b4d0 0x7f118406d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f11980c9240 tx=0x7f118c009040 comp rx=0 tx=0).stop 2024-05-08T04:21:15.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.548+0000 7f119d612640 1 -- 172.21.15.104:0/354722186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11980ce5a0 msgr2=0x7f11980c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:15.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.548+0000 7f119d612640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11980ce5a0 0x7f11980c8d00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1188034040 tx=0x7f1188004a40 comp rx=0 tx=0).stop 2024-05-08T04:21:15.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.548+0000 7f119d612640 1 -- 172.21.15.104:0/354722186 shutdown_connections 2024-05-08T04:21:15.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.548+0000 7f119d612640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f118406b4d0 0x7f118406d990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.548+0000 7f119d612640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11980d07c0 0x7f11981f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.548+0000 7f119d612640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f119815de10 0x7f11980b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.548+0000 7f119d612640 1 --2- 172.21.15.104:0/354722186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11980ce5a0 0x7f11980c8d00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:15.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.548+0000 7f119d612640 1 -- 172.21.15.104:0/354722186 >> 172.21.15.104:0/354722186 conn(0x7f1198072290 msgr2=0x7f11980b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:15.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.548+0000 7f119d612640 1 -- 172.21.15.104:0/354722186 shutdown_connections 2024-05-08T04:21:15.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:15.548+0000 7f119d612640 1 -- 172.21.15.104:0/354722186 wait complete. 2024-05-08T04:21:15.560 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-08T04:21:14.638302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218976,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755744,"statfs":{"total":773094113280,"available":772869881856,"internally_reserved":0,"allocated":2842624,"data_stored":1727828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.859767"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806700+0000","last_change":"2024-05-08T04:21:10.815759+0000","last_active":"2024-05-08T04:21:11.806700+0000","last_peered":"2024-05-08T04:21:11.806700+0000","last_clean":"2024-05-08T04:21:11.806700+0000","last_became_active":"2024-05-08T04:21:10.815430+0000","last_became_peered":"2024-05-08T04:21:10.815430+0000","last_unstale":"2024-05-08T04:21:11.806700+0000","last_undegraded":"2024-05-08T04:21:11.806700+0000","last_fullsized":"2024-05-08T04:21:11.806700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:09:39.015637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799301+0000","last_change":"2024-05-08T04:21:10.799995+0000","last_active":"2024-05-08T04:21:11.799301+0000","last_peered":"2024-05-08T04:21:11.799301+0000","last_clean":"2024-05-08T04:21:11.799301+0000","last_became_active":"2024-05-08T04:21:10.799655+0000","last_became_peered":"2024-05-08T04:21:10.799655+0000","last_unstale":"2024-05-08T04:21:11.799301+0000","last_undegraded":"2024-05-08T04:21:11.799301+0000","last_fullsized":"2024-05-08T04:21:11.799301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:22.135893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798824+0000","last_change":"2024-05-08T04:21:10.807212+0000","last_active":"2024-05-08T04:21:11.798824+0000","last_peered":"2024-05-08T04:21:11.798824+0000","last_clean":"2024-05-08T04:21:11.798824+0000","last_became_active":"2024-05-08T04:21:10.806880+0000","last_became_peered":"2024-05-08T04:21:10.806880+0000","last_unstale":"2024-05-08T04:21:11.798824+0000","last_undegraded":"2024-05-08T04:21:11.798824+0000","last_fullsized":"2024-05-08T04:21:11.798824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.813337+0000","last_change":"2024-05-08T04:21:10.809736+0000","last_active":"2024-05-08T04:21:10.813337+0000","last_peered":"2024-05-08T04:21:10.813337+0000","last_clean":"2024-05-08T04:21:10.813337+0000","last_became_active":"2024-05-08T04:21:10.808825+0000","last_became_peered":"2024-05-08T04:21:10.808825+0000","last_unstale":"2024-05-08T04:21:10.813337+0000","last_undegraded":"2024-05-08T04:21:10.813337+0000","last_fullsized":"2024-05-08T04:21:10.813337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:19.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806396+0000","last_change":"2024-05-08T04:21:10.807971+0000","last_active":"2024-05-08T04:21:11.806396+0000","last_peered":"2024-05-08T04:21:11.806396+0000","last_clean":"2024-05-08T04:21:11.806396+0000","last_became_active":"2024-05-08T04:21:10.807525+0000","last_became_peered":"2024-05-08T04:21:10.807525+0000","last_unstale":"2024-05-08T04:21:11.806396+0000","last_undegraded":"2024-05-08T04:21:11.806396+0000","last_fullsized":"2024-05-08T04:21:11.806396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:33.787458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.810825+0000","last_change":"2024-05-08T04:21:10.808827+0000","last_active":"2024-05-08T04:21:10.810825+0000","last_peered":"2024-05-08T04:21:10.810825+0000","last_clean":"2024-05-08T04:21:10.810825+0000","last_became_active":"2024-05-08T04:21:10.808388+0000","last_became_peered":"2024-05-08T04:21:10.808388+0000","last_unstale":"2024-05-08T04:21:10.810825+0000","last_undegraded":"2024-05-08T04:21:10.810825+0000","last_fullsized":"2024-05-08T04:21:10.810825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:53.160738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806249+0000","last_change":"2024-05-08T04:21:10.806944+0000","last_active":"2024-05-08T04:21:11.806249+0000","last_peered":"2024-05-08T04:21:11.806249+0000","last_clean":"2024-05-08T04:21:11.806249+0000","last_became_active":"2024-05-08T04:21:10.806257+0000","last_became_peered":"2024-05-08T04:21:10.806257+0000","last_unstale":"2024-05-08T04:21:11.806249+0000","last_undegraded":"2024-05-08T04:21:11.806249+0000","last_fullsized":"2024-05-08T04:21:11.806249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798784+0000","last_change":"2024-05-08T04:21:10.808012+0000","last_active":"2024-05-08T04:21:11.798784+0000","last_peered":"2024-05-08T04:21:11.798784+0000","last_clean":"2024-05-08T04:21:11.798784+0000","last_became_active":"2024-05-08T04:21:10.807762+0000","last_became_peered":"2024-05-08T04:21:10.807762+0000","last_unstale":"2024-05-08T04:21:11.798784+0000","last_undegraded":"2024-05-08T04:21:11.798784+0000","last_fullsized":"2024-05-08T04:21:11.798784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797594+0000","last_change":"2024-05-08T04:21:10.813184+0000","last_active":"2024-05-08T04:21:11.797594+0000","last_peered":"2024-05-08T04:21:11.797594+0000","last_clean":"2024-05-08T04:21:11.797594+0000","last_became_active":"2024-05-08T04:21:10.812887+0000","last_became_peered":"2024-05-08T04:21:10.812887+0000","last_unstale":"2024-05-08T04:21:11.797594+0000","last_undegraded":"2024-05-08T04:21:11.797594+0000","last_fullsized":"2024-05-08T04:21:11.797594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:34.037163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806602+0000","last_change":"2024-05-08T04:21:10.808669+0000","last_active":"2024-05-08T04:21:11.806602+0000","last_peered":"2024-05-08T04:21:11.806602+0000","last_clean":"2024-05-08T04:21:11.806602+0000","last_became_active":"2024-05-08T04:21:10.807623+0000","last_became_peered":"2024-05-08T04:21:10.807623+0000","last_unstale":"2024-05-08T04:21:11.806602+0000","last_undegraded":"2024-05-08T04:21:11.806602+0000","last_fullsized":"2024-05-08T04:21:11.806602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:36.487747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806477+0000","last_change":"2024-05-08T04:21:10.815746+0000","last_active":"2024-05-08T04:21:11.806477+0000","last_peered":"2024-05-08T04:21:11.806477+0000","last_clean":"2024-05-08T04:21:11.806477+0000","last_became_active":"2024-05-08T04:21:10.815484+0000","last_became_peered":"2024-05-08T04:21:10.815484+0000","last_unstale":"2024-05-08T04:21:11.806477+0000","last_undegraded":"2024-05-08T04:21:11.806477+0000","last_fullsized":"2024-05-08T04:21:11.806477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:14.742480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806591+0000","last_change":"2024-05-08T04:21:10.809694+0000","last_active":"2024-05-08T04:21:11.806591+0000","last_peered":"2024-05-08T04:21:11.806591+0000","last_clean":"2024-05-08T04:21:11.806591+0000","last_became_active":"2024-05-08T04:21:10.809335+0000","last_became_peered":"2024-05-08T04:21:10.809335+0000","last_unstale":"2024-05-08T04:21:11.806591+0000","last_undegraded":"2024-05-08T04:21:11.806591+0000","last_fullsized":"2024-05-08T04:21:11.806591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:22.135893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.814987+0000","last_change":"2024-05-08T04:21:10.810243+0000","last_active":"2024-05-08T04:21:10.814987+0000","last_peered":"2024-05-08T04:21:10.814987+0000","last_clean":"2024-05-08T04:21:10.814987+0000","last_became_active":"2024-05-08T04:21:10.809954+0000","last_became_peered":"2024-05-08T04:21:10.809954+0000","last_unstale":"2024-05-08T04:21:10.814987+0000","last_undegraded":"2024-05-08T04:21:10.814987+0000","last_fullsized":"2024-05-08T04:21:10.814987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:11.466963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.807829+0000","last_change":"2024-05-08T04:21:10.803036+0000","last_active":"2024-05-08T04:21:10.807829+0000","last_peered":"2024-05-08T04:21:10.807829+0000","last_clean":"2024-05-08T04:21:10.807829+0000","last_became_active":"2024-05-08T04:21:10.801931+0000","last_became_peered":"2024-05-08T04:21:10.801931+0000","last_unstale":"2024-05-08T04:21:10.807829+0000","last_undegraded":"2024-05-08T04:21:10.807829+0000","last_fullsized":"2024-05-08T04:21:10.807829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:14.085078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798885+0000","last_change":"2024-05-08T04:21:10.810578+0000","last_active":"2024-05-08T04:21:11.798885+0000","last_peered":"2024-05-08T04:21:11.798885+0000","last_clean":"2024-05-08T04:21:11.798885+0000","last_became_active":"2024-05-08T04:21:10.809929+0000","last_became_peered":"2024-05-08T04:21:10.809929+0000","last_unstale":"2024-05-08T04:21:11.798885+0000","last_undegraded":"2024-05-08T04:21:11.798885+0000","last_fullsized":"2024-05-08T04:21:11.798885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997095+0000","last_change":"2024-05-08T04:21:10.809708+0000","last_active":"2024-05-08T04:21:11.997095+0000","last_peered":"2024-05-08T04:21:11.997095+0000","last_clean":"2024-05-08T04:21:11.997095+0000","last_became_active":"2024-05-08T04:21:10.809239+0000","last_became_peered":"2024-05-08T04:21:10.809239+0000","last_unstale":"2024-05-08T04:21:11.997095+0000","last_undegraded":"2024-05-08T04:21:11.997095+0000","last_fullsized":"2024-05-08T04:21:11.997095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:09:39.015637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997748+0000","last_change":"2024-05-08T04:21:10.813941+0000","last_active":"2024-05-08T04:21:11.997748+0000","last_peered":"2024-05-08T04:21:11.997748+0000","last_clean":"2024-05-08T04:21:11.997748+0000","last_became_active":"2024-05-08T04:21:10.813628+0000","last_became_peered":"2024-05-08T04:21:10.813628+0000","last_unstale":"2024-05-08T04:21:11.997748+0000","last_undegraded":"2024-05-08T04:21:11.997748+0000","last_fullsized":"2024-05-08T04:21:11.997748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:54:22.530212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.805018+0000","last_change":"2024-05-08T04:21:10.802243+0000","last_active":"2024-05-08T04:21:10.805018+0000","last_peered":"2024-05-08T04:21:10.805018+0000","last_clean":"2024-05-08T04:21:10.805018+0000","last_became_active":"2024-05-08T04:21:10.801990+0000","last_became_peered":"2024-05-08T04:21:10.801990+0000","last_unstale":"2024-05-08T04:21:10.805018+0000","last_undegraded":"2024-05-08T04:21:10.805018+0000","last_fullsized":"2024-05-08T04:21:10.805018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:19.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997557+0000","last_change":"2024-05-08T04:21:10.809257+0000","last_active":"2024-05-08T04:21:11.997557+0000","last_peered":"2024-05-08T04:21:11.997557+0000","last_clean":"2024-05-08T04:21:11.997557+0000","last_became_active":"2024-05-08T04:21:10.808961+0000","last_became_peered":"2024-05-08T04:21:10.808961+0000","last_unstale":"2024-05-08T04:21:11.997557+0000","last_undegraded":"2024-05-08T04:21:11.997557+0000","last_fullsized":"2024-05-08T04:21:11.997557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:47:28.393115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806508+0000","last_change":"2024-05-08T04:21:10.808294+0000","last_active":"2024-05-08T04:21:11.806508+0000","last_peered":"2024-05-08T04:21:11.806508+0000","last_clean":"2024-05-08T04:21:11.806508+0000","last_became_active":"2024-05-08T04:21:10.808032+0000","last_became_peered":"2024-05-08T04:21:10.808032+0000","last_unstale":"2024-05-08T04:21:11.806508+0000","last_undegraded":"2024-05-08T04:21:11.806508+0000","last_fullsized":"2024-05-08T04:21:11.806508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:33.067388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803850+0000","last_change":"2024-05-08T04:21:10.806239+0000","last_active":"2024-05-08T04:21:11.803850+0000","last_peered":"2024-05-08T04:21:11.803850+0000","last_clean":"2024-05-08T04:21:11.803850+0000","last_became_active":"2024-05-08T04:21:10.805369+0000","last_became_peered":"2024-05-08T04:21:10.805369+0000","last_unstale":"2024-05-08T04:21:11.803850+0000","last_undegraded":"2024-05-08T04:21:11.803850+0000","last_fullsized":"2024-05-08T04:21:11.803850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:55:41.627503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797390+0000","last_change":"2024-05-08T04:21:10.813103+0000","last_active":"2024-05-08T04:21:11.797390+0000","last_peered":"2024-05-08T04:21:11.797390+0000","last_clean":"2024-05-08T04:21:11.797390+0000","last_became_active":"2024-05-08T04:21:10.812833+0000","last_became_peered":"2024-05-08T04:21:10.812833+0000","last_unstale":"2024-05-08T04:21:11.797390+0000","last_undegraded":"2024-05-08T04:21:11.797390+0000","last_fullsized":"2024-05-08T04:21:11.797390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:35:00.954562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798758+0000","last_change":"2024-05-08T04:21:10.794976+0000","last_active":"2024-05-08T04:21:11.798758+0000","last_peered":"2024-05-08T04:21:11.798758+0000","last_clean":"2024-05-08T04:21:11.798758+0000","last_became_active":"2024-05-08T04:21:10.794594+0000","last_became_peered":"2024-05-08T04:21:10.794594+0000","last_unstale":"2024-05-08T04:21:11.798758+0000","last_undegraded":"2024-05-08T04:21:11.798758+0000","last_fullsized":"2024-05-08T04:21:11.798758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:29.958463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997065+0000","last_change":"2024-05-08T04:21:10.809601+0000","last_active":"2024-05-08T04:21:11.997065+0000","last_peered":"2024-05-08T04:21:11.997065+0000","last_clean":"2024-05-08T04:21:11.997065+0000","last_became_active":"2024-05-08T04:21:10.809257+0000","last_became_peered":"2024-05-08T04:21:10.809257+0000","last_unstale":"2024-05-08T04:21:11.997065+0000","last_undegraded":"2024-05-08T04:21:11.997065+0000","last_fullsized":"2024-05-08T04:21:11.997065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799293+0000","last_change":"2024-05-08T04:21:10.802281+0000","last_active":"2024-05-08T04:21:11.799293+0000","last_peered":"2024-05-08T04:21:11.799293+0000","last_clean":"2024-05-08T04:21:11.799293+0000","last_became_active":"2024-05-08T04:21:10.802003+0000","last_became_peered":"2024-05-08T04:21:10.802003+0000","last_unstale":"2024-05-08T04:21:11.799293+0000","last_undegraded":"2024-05-08T04:21:11.799293+0000","last_fullsized":"2024-05-08T04:21:11.799293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:01.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.819934+0000","last_change":"2024-05-08T04:21:10.817545+0000","last_active":"2024-05-08T04:21:10.819934+0000","last_peered":"2024-05-08T04:21:10.819934+0000","last_clean":"2024-05-08T04:21:10.819934+0000","last_became_active":"2024-05-08T04:21:10.817272+0000","last_became_peered":"2024-05-08T04:21:10.817272+0000","last_unstale":"2024-05-08T04:21:10.819934+0000","last_undegraded":"2024-05-08T04:21:10.819934+0000","last_fullsized":"2024-05-08T04:21:10.819934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:54.044618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.807828+0000","last_change":"2024-05-08T04:21:10.802074+0000","last_active":"2024-05-08T04:21:10.807828+0000","last_peered":"2024-05-08T04:21:10.807828+0000","last_clean":"2024-05-08T04:21:10.807828+0000","last_became_active":"2024-05-08T04:21:10.801792+0000","last_became_peered":"2024-05-08T04:21:10.801792+0000","last_unstale":"2024-05-08T04:21:10.807828+0000","last_undegraded":"2024-05-08T04:21:10.807828+0000","last_fullsized":"2024-05-08T04:21:10.807828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:19.821289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.814620+0000","last_change":"2024-05-08T04:21:10.810222+0000","last_active":"2024-05-08T04:21:10.814620+0000","last_peered":"2024-05-08T04:21:10.814620+0000","last_clean":"2024-05-08T04:21:10.814620+0000","last_became_active":"2024-05-08T04:21:10.809936+0000","last_became_peered":"2024-05-08T04:21:10.809936+0000","last_unstale":"2024-05-08T04:21:10.814620+0000","last_undegraded":"2024-05-08T04:21:10.814620+0000","last_fullsized":"2024-05-08T04:21:10.814620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:53.770709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799109+0000","last_change":"2024-05-08T04:21:10.801209+0000","last_active":"2024-05-08T04:21:11.799109+0000","last_peered":"2024-05-08T04:21:11.799109+0000","last_clean":"2024-05-08T04:21:11.799109+0000","last_became_active":"2024-05-08T04:21:10.800919+0000","last_became_peered":"2024-05-08T04:21:10.800919+0000","last_unstale":"2024-05-08T04:21:11.799109+0000","last_undegraded":"2024-05-08T04:21:11.799109+0000","last_fullsized":"2024-05-08T04:21:11.799109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:14.742480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997234+0000","last_change":"2024-05-08T04:21:10.812578+0000","last_active":"2024-05-08T04:21:11.997234+0000","last_peered":"2024-05-08T04:21:11.997234+0000","last_clean":"2024-05-08T04:21:11.997234+0000","last_became_active":"2024-05-08T04:21:10.811984+0000","last_became_peered":"2024-05-08T04:21:10.811984+0000","last_unstale":"2024-05-08T04:21:11.997234+0000","last_undegraded":"2024-05-08T04:21:11.997234+0000","last_fullsized":"2024-05-08T04:21:11.997234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:18.292078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.805869+0000","last_change":"2024-05-08T04:21:10.803704+0000","last_active":"2024-05-08T04:21:10.805869+0000","last_peered":"2024-05-08T04:21:10.805869+0000","last_clean":"2024-05-08T04:21:10.805869+0000","last_became_active":"2024-05-08T04:21:10.803362+0000","last_became_peered":"2024-05-08T04:21:10.803362+0000","last_unstale":"2024-05-08T04:21:10.805869+0000","last_undegraded":"2024-05-08T04:21:10.805869+0000","last_fullsized":"2024-05-08T04:21:10.805869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:32.235085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.808557+0000","last_change":"2024-05-08T04:21:10.803508+0000","last_active":"2024-05-08T04:21:10.808557+0000","last_peered":"2024-05-08T04:21:10.808557+0000","last_clean":"2024-05-08T04:21:10.808557+0000","last_became_active":"2024-05-08T04:21:10.803182+0000","last_became_peered":"2024-05-08T04:21:10.803182+0000","last_unstale":"2024-05-08T04:21:10.808557+0000","last_undegraded":"2024-05-08T04:21:10.808557+0000","last_fullsized":"2024-05-08T04:21:10.808557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:43.868339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797469+0000","last_change":"2024-05-08T04:21:10.806394+0000","last_active":"2024-05-08T04:21:11.797469+0000","last_peered":"2024-05-08T04:21:11.797469+0000","last_clean":"2024-05-08T04:21:11.797469+0000","last_became_active":"2024-05-08T04:21:10.806139+0000","last_became_peered":"2024-05-08T04:21:10.806139+0000","last_unstale":"2024-05-08T04:21:11.797469+0000","last_undegraded":"2024-05-08T04:21:11.797469+0000","last_fullsized":"2024-05-08T04:21:11.797469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:00.517242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799118+0000","last_change":"2024-05-08T04:21:09.799594+0000","last_active":"2024-05-08T04:21:11.799118+0000","last_peered":"2024-05-08T04:21:11.799118+0000","last_clean":"2024-05-08T04:21:11.799118+0000","last_became_active":"2024-05-08T04:21:09.798501+0000","last_became_peered":"2024-05-08T04:21:09.798501+0000","last_unstale":"2024-05-08T04:21:11.799118+0000","last_undegraded":"2024-05-08T04:21:11.799118+0000","last_fullsized":"2024-05-08T04:21:11.799118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804031+0000","last_change":"2024-05-08T04:21:10.812658+0000","last_active":"2024-05-08T04:21:11.804031+0000","last_peered":"2024-05-08T04:21:11.804031+0000","last_clean":"2024-05-08T04:21:11.804031+0000","last_became_active":"2024-05-08T04:21:10.812321+0000","last_became_peered":"2024-05-08T04:21:10.812321+0000","last_unstale":"2024-05-08T04:21:11.804031+0000","last_undegraded":"2024-05-08T04:21:11.804031+0000","last_fullsized":"2024-05-08T04:21:11.804031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997336+0000","last_change":"2024-05-08T04:21:09.805980+0000","last_active":"2024-05-08T04:21:11.997336+0000","last_peered":"2024-05-08T04:21:11.997336+0000","last_clean":"2024-05-08T04:21:11.997336+0000","last_became_active":"2024-05-08T04:21:09.805512+0000","last_became_peered":"2024-05-08T04:21:09.805512+0000","last_unstale":"2024-05-08T04:21:11.997336+0000","last_undegraded":"2024-05-08T04:21:11.997336+0000","last_fullsized":"2024-05-08T04:21:11.997336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:34:59.948483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.799241+0000","last_change":"2024-05-08T04:21:09.807091+0000","last_active":"2024-05-08T04:21:10.799241+0000","last_peered":"2024-05-08T04:21:10.799241+0000","last_clean":"2024-05-08T04:21:10.799241+0000","last_became_active":"2024-05-08T04:21:09.806790+0000","last_became_peered":"2024-05-08T04:21:09.806790+0000","last_unstale":"2024-05-08T04:21:10.799241+0000","last_undegraded":"2024-05-08T04:21:10.799241+0000","last_fullsized":"2024-05-08T04:21:10.799241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799252+0000","last_change":"2024-05-08T04:21:10.806542+0000","last_active":"2024-05-08T04:21:11.799252+0000","last_peered":"2024-05-08T04:21:11.799252+0000","last_clean":"2024-05-08T04:21:11.799252+0000","last_became_active":"2024-05-08T04:21:10.804525+0000","last_became_peered":"2024-05-08T04:21:10.804525+0000","last_unstale":"2024-05-08T04:21:11.799252+0000","last_undegraded":"2024-05-08T04:21:11.799252+0000","last_fullsized":"2024-05-08T04:21:11.799252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:33.067388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997177+0000","last_change":"2024-05-08T04:21:09.803521+0000","last_active":"2024-05-08T04:21:11.997177+0000","last_peered":"2024-05-08T04:21:11.997177+0000","last_clean":"2024-05-08T04:21:11.997177+0000","last_became_active":"2024-05-08T04:21:09.803237+0000","last_became_peered":"2024-05-08T04:21:09.803237+0000","last_unstale":"2024-05-08T04:21:11.997177+0000","last_undegraded":"2024-05-08T04:21:11.997177+0000","last_fullsized":"2024-05-08T04:21:11.997177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803821+0000","last_change":"2024-05-08T04:21:10.804293+0000","last_active":"2024-05-08T04:21:11.803821+0000","last_peered":"2024-05-08T04:21:11.803821+0000","last_clean":"2024-05-08T04:21:11.803821+0000","last_became_active":"2024-05-08T04:21:10.803978+0000","last_became_peered":"2024-05-08T04:21:10.803978+0000","last_unstale":"2024-05-08T04:21:11.803821+0000","last_undegraded":"2024-05-08T04:21:11.803821+0000","last_fullsized":"2024-05-08T04:21:11.803821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:00.315803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797658+0000","last_change":"2024-05-08T04:21:09.802555+0000","last_active":"2024-05-08T04:21:11.797658+0000","last_peered":"2024-05-08T04:21:11.797658+0000","last_clean":"2024-05-08T04:21:11.797658+0000","last_became_active":"2024-05-08T04:21:09.801729+0000","last_became_peered":"2024-05-08T04:21:09.801729+0000","last_unstale":"2024-05-08T04:21:11.797658+0000","last_undegraded":"2024-05-08T04:21:11.797658+0000","last_fullsized":"2024-05-08T04:21:11.797658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.819912+0000","last_change":"2024-05-08T04:21:10.817304+0000","last_active":"2024-05-08T04:21:10.819912+0000","last_peered":"2024-05-08T04:21:10.819912+0000","last_clean":"2024-05-08T04:21:10.819912+0000","last_became_active":"2024-05-08T04:21:10.817053+0000","last_became_peered":"2024-05-08T04:21:10.817053+0000","last_unstale":"2024-05-08T04:21:10.819912+0000","last_undegraded":"2024-05-08T04:21:10.819912+0000","last_fullsized":"2024-05-08T04:21:10.819912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:14.085078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806539+0000","last_change":"2024-05-08T04:21:09.808688+0000","last_active":"2024-05-08T04:21:11.806539+0000","last_peered":"2024-05-08T04:21:11.806539+0000","last_clean":"2024-05-08T04:21:11.806539+0000","last_became_active":"2024-05-08T04:21:09.808341+0000","last_became_peered":"2024-05-08T04:21:09.808341+0000","last_unstale":"2024-05-08T04:21:11.806539+0000","last_undegraded":"2024-05-08T04:21:11.806539+0000","last_fullsized":"2024-05-08T04:21:11.806539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:13.078999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799355+0000","last_change":"2024-05-08T04:21:10.812699+0000","last_active":"2024-05-08T04:21:11.799355+0000","last_peered":"2024-05-08T04:21:11.799355+0000","last_clean":"2024-05-08T04:21:11.799355+0000","last_became_active":"2024-05-08T04:21:10.812379+0000","last_became_peered":"2024-05-08T04:21:10.812379+0000","last_unstale":"2024-05-08T04:21:11.799355+0000","last_undegraded":"2024-05-08T04:21:11.799355+0000","last_fullsized":"2024-05-08T04:21:11.799355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.816662+0000","last_change":"2024-05-08T04:21:09.796581+0000","last_active":"2024-05-08T04:21:10.816662+0000","last_peered":"2024-05-08T04:21:10.816662+0000","last_clean":"2024-05-08T04:21:10.816662+0000","last_became_active":"2024-05-08T04:21:09.796288+0000","last_became_peered":"2024-05-08T04:21:09.796288+0000","last_unstale":"2024-05-08T04:21:10.816662+0000","last_undegraded":"2024-05-08T04:21:10.816662+0000","last_fullsized":"2024-05-08T04:21:10.816662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997394+0000","last_change":"2024-05-08T04:21:10.809585+0000","last_active":"2024-05-08T04:21:11.997394+0000","last_peered":"2024-05-08T04:21:11.997394+0000","last_clean":"2024-05-08T04:21:11.997394+0000","last_became_active":"2024-05-08T04:21:10.809208+0000","last_became_peered":"2024-05-08T04:21:10.809208+0000","last_unstale":"2024-05-08T04:21:11.997394+0000","last_undegraded":"2024-05-08T04:21:11.997394+0000","last_fullsized":"2024-05-08T04:21:11.997394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:53:26.704579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.821563+0000","last_change":"2024-05-08T04:21:09.798917+0000","last_active":"2024-05-08T04:21:10.821563+0000","last_peered":"2024-05-08T04:21:10.821563+0000","last_clean":"2024-05-08T04:21:10.821563+0000","last_became_active":"2024-05-08T04:21:09.798646+0000","last_became_peered":"2024-05-08T04:21:09.798646+0000","last_unstale":"2024-05-08T04:21:10.821563+0000","last_undegraded":"2024-05-08T04:21:10.821563+0000","last_fullsized":"2024-05-08T04:21:10.821563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:25.652092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806500+0000","last_change":"2024-05-08T04:21:10.806707+0000","last_active":"2024-05-08T04:21:11.806500+0000","last_peered":"2024-05-08T04:21:11.806500+0000","last_clean":"2024-05-08T04:21:11.806500+0000","last_became_active":"2024-05-08T04:21:10.806433+0000","last_became_peered":"2024-05-08T04:21:10.806433+0000","last_unstale":"2024-05-08T04:21:11.806500+0000","last_undegraded":"2024-05-08T04:21:11.806500+0000","last_fullsized":"2024-05-08T04:21:11.806500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:39.936653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.812250+0000","last_change":"2024-05-08T04:21:09.806965+0000","last_active":"2024-05-08T04:21:10.812250+0000","last_peered":"2024-05-08T04:21:10.812250+0000","last_clean":"2024-05-08T04:21:10.812250+0000","last_became_active":"2024-05-08T04:21:09.806616+0000","last_became_peered":"2024-05-08T04:21:09.806616+0000","last_unstale":"2024-05-08T04:21:10.812250+0000","last_undegraded":"2024-05-08T04:21:10.812250+0000","last_fullsized":"2024-05-08T04:21:10.812250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:09.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.816414+0000","last_change":"2024-05-08T04:21:10.814170+0000","last_active":"2024-05-08T04:21:10.816414+0000","last_peered":"2024-05-08T04:21:10.816414+0000","last_clean":"2024-05-08T04:21:10.816414+0000","last_became_active":"2024-05-08T04:21:10.813882+0000","last_became_peered":"2024-05-08T04:21:10.813882+0000","last_unstale":"2024-05-08T04:21:10.816414+0000","last_undegraded":"2024-05-08T04:21:10.816414+0000","last_fullsized":"2024-05-08T04:21:10.816414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:35:00.954562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997406+0000","last_change":"2024-05-08T04:21:09.799377+0000","last_active":"2024-05-08T04:21:11.997406+0000","last_peered":"2024-05-08T04:21:11.997406+0000","last_clean":"2024-05-08T04:21:11.997406+0000","last_became_active":"2024-05-08T04:21:09.799078+0000","last_became_peered":"2024-05-08T04:21:09.799078+0000","last_unstale":"2024-05-08T04:21:11.997406+0000","last_undegraded":"2024-05-08T04:21:11.997406+0000","last_fullsized":"2024-05-08T04:21:11.997406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:28:59.511163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997261+0000","last_change":"2024-05-08T04:21:10.814186+0000","last_active":"2024-05-08T04:21:11.997261+0000","last_peered":"2024-05-08T04:21:11.997261+0000","last_clean":"2024-05-08T04:21:11.997261+0000","last_became_active":"2024-05-08T04:21:10.813837+0000","last_became_peered":"2024-05-08T04:21:10.813837+0000","last_unstale":"2024-05-08T04:21:11.997261+0000","last_undegraded":"2024-05-08T04:21:11.997261+0000","last_fullsized":"2024-05-08T04:21:11.997261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:41:47.087907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806222+0000","last_change":"2024-05-08T04:21:09.809783+0000","last_active":"2024-05-08T04:21:11.806222+0000","last_peered":"2024-05-08T04:21:11.806222+0000","last_clean":"2024-05-08T04:21:11.806222+0000","last_became_active":"2024-05-08T04:21:09.809489+0000","last_became_peered":"2024-05-08T04:21:09.809489+0000","last_unstale":"2024-05-08T04:21:11.806222+0000","last_undegraded":"2024-05-08T04:21:11.806222+0000","last_fullsized":"2024-05-08T04:21:11.806222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797316+0000","last_change":"2024-05-08T04:21:10.802400+0000","last_active":"2024-05-08T04:21:11.797316+0000","last_peered":"2024-05-08T04:21:11.797316+0000","last_clean":"2024-05-08T04:21:11.797316+0000","last_became_active":"2024-05-08T04:21:10.801522+0000","last_became_peered":"2024-05-08T04:21:10.801522+0000","last_unstale":"2024-05-08T04:21:11.797316+0000","last_undegraded":"2024-05-08T04:21:11.797316+0000","last_fullsized":"2024-05-08T04:21:11.797316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:11.466963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803687+0000","last_change":"2024-05-08T04:21:09.795156+0000","last_active":"2024-05-08T04:21:11.803687+0000","last_peered":"2024-05-08T04:21:11.803687+0000","last_clean":"2024-05-08T04:21:11.803687+0000","last_became_active":"2024-05-08T04:21:09.794658+0000","last_became_peered":"2024-05-08T04:21:09.794658+0000","last_unstale":"2024-05-08T04:21:11.803687+0000","last_undegraded":"2024-05-08T04:21:11.803687+0000","last_fullsized":"2024-05-08T04:21:11.803687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997156+0000","last_change":"2024-05-08T04:21:10.810862+0000","last_active":"2024-05-08T04:21:11.997156+0000","last_peered":"2024-05-08T04:21:11.997156+0000","last_clean":"2024-05-08T04:21:11.997156+0000","last_became_active":"2024-05-08T04:21:10.810041+0000","last_became_peered":"2024-05-08T04:21:10.810041+0000","last_unstale":"2024-05-08T04:21:11.997156+0000","last_undegraded":"2024-05-08T04:21:11.997156+0000","last_fullsized":"2024-05-08T04:21:11.997156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:37:37.045065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806759+0000","last_change":"2024-05-08T04:21:09.805736+0000","last_active":"2024-05-08T04:21:11.806759+0000","last_peered":"2024-05-08T04:21:11.806759+0000","last_clean":"2024-05-08T04:21:11.806759+0000","last_became_active":"2024-05-08T04:21:09.805416+0000","last_became_peered":"2024-05-08T04:21:09.805416+0000","last_unstale":"2024-05-08T04:21:11.806759+0000","last_undegraded":"2024-05-08T04:21:11.806759+0000","last_fullsized":"2024-05-08T04:21:11.806759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:52.764630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.819785+0000","last_change":"2024-05-08T04:21:10.812910+0000","last_active":"2024-05-08T04:21:10.819785+0000","last_peered":"2024-05-08T04:21:10.819785+0000","last_clean":"2024-05-08T04:21:10.819785+0000","last_became_active":"2024-05-08T04:21:10.812514+0000","last_became_peered":"2024-05-08T04:21:10.812514+0000","last_unstale":"2024-05-08T04:21:10.819785+0000","last_undegraded":"2024-05-08T04:21:10.819785+0000","last_fullsized":"2024-05-08T04:21:10.819785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:32.235085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804208+0000","last_change":"2024-05-08T04:21:09.800590+0000","last_active":"2024-05-08T04:21:11.804208+0000","last_peered":"2024-05-08T04:21:11.804208+0000","last_clean":"2024-05-08T04:21:11.804208+0000","last_became_active":"2024-05-08T04:21:09.800287+0000","last_became_peered":"2024-05-08T04:21:09.800287+0000","last_unstale":"2024-05-08T04:21:11.804208+0000","last_undegraded":"2024-05-08T04:21:11.804208+0000","last_fullsized":"2024-05-08T04:21:11.804208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:13.078999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806581+0000","last_change":"2024-05-08T04:21:10.806772+0000","last_active":"2024-05-08T04:21:11.806581+0000","last_peered":"2024-05-08T04:21:11.806581+0000","last_clean":"2024-05-08T04:21:11.806581+0000","last_became_active":"2024-05-08T04:21:10.806521+0000","last_became_peered":"2024-05-08T04:21:10.806521+0000","last_unstale":"2024-05-08T04:21:11.806581+0000","last_undegraded":"2024-05-08T04:21:11.806581+0000","last_fullsized":"2024-05-08T04:21:11.806581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:01.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799154+0000","last_change":"2024-05-08T04:21:09.799358+0000","last_active":"2024-05-08T04:21:11.799154+0000","last_peered":"2024-05-08T04:21:11.799154+0000","last_clean":"2024-05-08T04:21:11.799154+0000","last_became_active":"2024-05-08T04:21:09.799071+0000","last_became_peered":"2024-05-08T04:21:09.799071+0000","last_unstale":"2024-05-08T04:21:11.799154+0000","last_undegraded":"2024-05-08T04:21:11.799154+0000","last_fullsized":"2024-05-08T04:21:11.799154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806649+0000","last_change":"2024-05-08T04:21:10.808148+0000","last_active":"2024-05-08T04:21:11.806649+0000","last_peered":"2024-05-08T04:21:11.806649+0000","last_clean":"2024-05-08T04:21:11.806649+0000","last_became_active":"2024-05-08T04:21:10.807665+0000","last_became_peered":"2024-05-08T04:21:10.807665+0000","last_unstale":"2024-05-08T04:21:11.806649+0000","last_undegraded":"2024-05-08T04:21:11.806649+0000","last_fullsized":"2024-05-08T04:21:11.806649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.798915+0000","last_change":"2024-05-08T04:21:09.808562+0000","last_active":"2024-05-08T04:21:10.798915+0000","last_peered":"2024-05-08T04:21:10.798915+0000","last_clean":"2024-05-08T04:21:10.798915+0000","last_became_active":"2024-05-08T04:21:09.808278+0000","last_became_peered":"2024-05-08T04:21:09.808278+0000","last_unstale":"2024-05-08T04:21:10.798915+0000","last_undegraded":"2024-05-08T04:21:10.798915+0000","last_fullsized":"2024-05-08T04:21:10.798915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:09.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997548+0000","last_change":"2024-05-08T04:21:10.811650+0000","last_active":"2024-05-08T04:21:11.997548+0000","last_peered":"2024-05-08T04:21:11.997548+0000","last_clean":"2024-05-08T04:21:11.997548+0000","last_became_active":"2024-05-08T04:21:10.811088+0000","last_became_peered":"2024-05-08T04:21:10.811088+0000","last_unstale":"2024-05-08T04:21:11.997548+0000","last_undegraded":"2024-05-08T04:21:11.997548+0000","last_fullsized":"2024-05-08T04:21:11.997548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:11:24.741018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797369+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:21:11.797369+0000","last_peered":"2024-05-08T04:21:11.797369+0000","last_clean":"2024-05-08T04:21:11.797369+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:21:11.797369+0000","last_undegraded":"2024-05-08T04:21:11.797369+0000","last_fullsized":"2024-05-08T04:21:11.797369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997368+0000","last_change":"2024-05-08T04:21:09.805253+0000","last_active":"2024-05-08T04:21:11.997368+0000","last_peered":"2024-05-08T04:21:11.997368+0000","last_clean":"2024-05-08T04:21:11.997368+0000","last_became_active":"2024-05-08T04:21:09.805004+0000","last_became_peered":"2024-05-08T04:21:09.805004+0000","last_unstale":"2024-05-08T04:21:11.997368+0000","last_undegraded":"2024-05-08T04:21:11.997368+0000","last_fullsized":"2024-05-08T04:21:11.997368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:52.552788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803933+0000","last_change":"2024-05-08T04:21:10.806073+0000","last_active":"2024-05-08T04:21:11.803933+0000","last_peered":"2024-05-08T04:21:11.803933+0000","last_clean":"2024-05-08T04:21:11.803933+0000","last_became_active":"2024-05-08T04:21:10.805314+0000","last_became_peered":"2024-05-08T04:21:10.805314+0000","last_unstale":"2024-05-08T04:21:11.803933+0000","last_undegraded":"2024-05-08T04:21:11.803933+0000","last_fullsized":"2024-05-08T04:21:11.803933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:29.958463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997207+0000","last_change":"2024-05-08T04:21:09.800131+0000","last_active":"2024-05-08T04:21:11.997207+0000","last_peered":"2024-05-08T04:21:11.997207+0000","last_clean":"2024-05-08T04:21:11.997207+0000","last_became_active":"2024-05-08T04:21:09.799704+0000","last_became_peered":"2024-05-08T04:21:09.799704+0000","last_unstale":"2024-05-08T04:21:11.997207+0000","last_undegraded":"2024-05-08T04:21:11.997207+0000","last_fullsized":"2024-05-08T04:21:11.997207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:52.764630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.807738+0000","last_change":"2024-05-08T04:21:10.802802+0000","last_active":"2024-05-08T04:21:10.807738+0000","last_peered":"2024-05-08T04:21:10.807738+0000","last_clean":"2024-05-08T04:21:10.807738+0000","last_became_active":"2024-05-08T04:21:10.802481+0000","last_became_peered":"2024-05-08T04:21:10.802481+0000","last_unstale":"2024-05-08T04:21:10.807738+0000","last_undegraded":"2024-05-08T04:21:10.807738+0000","last_fullsized":"2024-05-08T04:21:10.807738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:32.235085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.795108+0000","last_change":"2024-05-08T04:21:09.797811+0000","last_active":"2024-05-08T04:21:10.795108+0000","last_peered":"2024-05-08T04:21:10.795108+0000","last_clean":"2024-05-08T04:21:10.795108+0000","last_became_active":"2024-05-08T04:21:09.797499+0000","last_became_peered":"2024-05-08T04:21:09.797499+0000","last_unstale":"2024-05-08T04:21:10.795108+0000","last_undegraded":"2024-05-08T04:21:10.795108+0000","last_fullsized":"2024-05-08T04:21:10.795108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798975+0000","last_change":"2024-05-08T04:21:10.801647+0000","last_active":"2024-05-08T04:21:11.798975+0000","last_peered":"2024-05-08T04:21:11.798975+0000","last_clean":"2024-05-08T04:21:11.798975+0000","last_became_active":"2024-05-08T04:21:10.800875+0000","last_became_peered":"2024-05-08T04:21:10.800875+0000","last_unstale":"2024-05-08T04:21:11.798975+0000","last_undegraded":"2024-05-08T04:21:11.798975+0000","last_fullsized":"2024-05-08T04:21:11.798975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:33.787458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997455+0000","last_change":"2024-05-08T04:21:09.804263+0000","last_active":"2024-05-08T04:21:11.997455+0000","last_peered":"2024-05-08T04:21:11.997455+0000","last_clean":"2024-05-08T04:21:11.997455+0000","last_became_active":"2024-05-08T04:21:09.804011+0000","last_became_peered":"2024-05-08T04:21:09.804011+0000","last_unstale":"2024-05-08T04:21:11.997455+0000","last_undegraded":"2024-05-08T04:21:11.997455+0000","last_fullsized":"2024-05-08T04:21:11.997455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:01.499390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806394+0000","last_change":"2024-05-08T04:21:10.809139+0000","last_active":"2024-05-08T04:21:11.806394+0000","last_peered":"2024-05-08T04:21:11.806394+0000","last_clean":"2024-05-08T04:21:11.806394+0000","last_became_active":"2024-05-08T04:21:10.808801+0000","last_became_peered":"2024-05-08T04:21:10.808801+0000","last_unstale":"2024-05-08T04:21:11.806394+0000","last_undegraded":"2024-05-08T04:21:11.806394+0000","last_fullsized":"2024-05-08T04:21:11.806394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798765+0000","last_change":"2024-05-08T04:21:09.799028+0000","last_active":"2024-05-08T04:21:11.798765+0000","last_peered":"2024-05-08T04:21:11.798765+0000","last_clean":"2024-05-08T04:21:11.798765+0000","last_became_active":"2024-05-08T04:21:09.798761+0000","last_became_peered":"2024-05-08T04:21:09.798761+0000","last_unstale":"2024-05-08T04:21:11.798765+0000","last_undegraded":"2024-05-08T04:21:11.798765+0000","last_fullsized":"2024-05-08T04:21:11.798765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.801037+0000","last_change":"2024-05-08T04:21:10.799702+0000","last_active":"2024-05-08T04:21:10.801037+0000","last_peered":"2024-05-08T04:21:10.801037+0000","last_clean":"2024-05-08T04:21:10.801037+0000","last_became_active":"2024-05-08T04:21:10.799422+0000","last_became_peered":"2024-05-08T04:21:10.799422+0000","last_unstale":"2024-05-08T04:21:10.801037+0000","last_undegraded":"2024-05-08T04:21:10.801037+0000","last_fullsized":"2024-05-08T04:21:10.801037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:10.335725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997612+0000","last_change":"2024-05-08T04:21:09.798256+0000","last_active":"2024-05-08T04:21:11.997612+0000","last_peered":"2024-05-08T04:21:11.997612+0000","last_clean":"2024-05-08T04:21:11.997612+0000","last_became_active":"2024-05-08T04:21:09.796157+0000","last_became_peered":"2024-05-08T04:21:09.796157+0000","last_unstale":"2024-05-08T04:21:11.997612+0000","last_undegraded":"2024-05-08T04:21:11.997612+0000","last_fullsized":"2024-05-08T04:21:11.997612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:10.460883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.814594+0000","last_change":"2024-05-08T04:21:10.808794+0000","last_active":"2024-05-08T04:21:10.814594+0000","last_peered":"2024-05-08T04:21:10.814594+0000","last_clean":"2024-05-08T04:21:10.814594+0000","last_became_active":"2024-05-08T04:21:10.808339+0000","last_became_peered":"2024-05-08T04:21:10.808339+0000","last_unstale":"2024-05-08T04:21:10.814594+0000","last_undegraded":"2024-05-08T04:21:10.814594+0000","last_fullsized":"2024-05-08T04:21:10.814594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:54.044618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.807697+0000","last_change":"2024-05-08T04:21:09.806917+0000","last_active":"2024-05-08T04:21:11.807697+0000","last_peered":"2024-05-08T04:21:11.807697+0000","last_clean":"2024-05-08T04:21:11.807697+0000","last_became_active":"2024-05-08T04:21:09.806599+0000","last_became_peered":"2024-05-08T04:21:09.806599+0000","last_unstale":"2024-05-08T04:21:11.807697+0000","last_undegraded":"2024-05-08T04:21:11.807697+0000","last_fullsized":"2024-05-08T04:21:11.807697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804308+0000","last_change":"2024-05-08T04:21:10.809200+0000","last_active":"2024-05-08T04:21:11.804308+0000","last_peered":"2024-05-08T04:21:11.804308+0000","last_clean":"2024-05-08T04:21:11.804308+0000","last_became_active":"2024-05-08T04:21:10.808575+0000","last_became_peered":"2024-05-08T04:21:10.808575+0000","last_unstale":"2024-05-08T04:21:11.804308+0000","last_undegraded":"2024-05-08T04:21:11.804308+0000","last_fullsized":"2024-05-08T04:21:11.804308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997710+0000","last_change":"2024-05-08T04:21:09.807154+0000","last_active":"2024-05-08T04:21:11.997710+0000","last_peered":"2024-05-08T04:21:11.997710+0000","last_clean":"2024-05-08T04:21:11.997710+0000","last_became_active":"2024-05-08T04:21:09.806884+0000","last_became_peered":"2024-05-08T04:21:09.806884+0000","last_unstale":"2024-05-08T04:21:11.997710+0000","last_undegraded":"2024-05-08T04:21:11.997710+0000","last_fullsized":"2024-05-08T04:21:11.997710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:00.101724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804179+0000","last_change":"2024-05-08T04:21:10.805880+0000","last_active":"2024-05-08T04:21:11.804179+0000","last_peered":"2024-05-08T04:21:11.804179+0000","last_clean":"2024-05-08T04:21:11.804179+0000","last_became_active":"2024-05-08T04:21:10.805610+0000","last_became_peered":"2024-05-08T04:21:10.805610+0000","last_unstale":"2024-05-08T04:21:11.804179+0000","last_undegraded":"2024-05-08T04:21:11.804179+0000","last_fullsized":"2024-05-08T04:21:11.804179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806080+0000","last_change":"2024-05-08T04:21:09.805802+0000","last_active":"2024-05-08T04:21:11.806080+0000","last_peered":"2024-05-08T04:21:11.806080+0000","last_clean":"2024-05-08T04:21:11.806080+0000","last_became_active":"2024-05-08T04:21:09.805532+0000","last_became_peered":"2024-05-08T04:21:09.805532+0000","last_unstale":"2024-05-08T04:21:11.806080+0000","last_undegraded":"2024-05-08T04:21:11.806080+0000","last_fullsized":"2024-05-08T04:21:11.806080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997242+0000","last_change":"2024-05-08T04:21:10.810731+0000","last_active":"2024-05-08T04:21:11.997242+0000","last_peered":"2024-05-08T04:21:11.997242+0000","last_clean":"2024-05-08T04:21:11.997242+0000","last_became_active":"2024-05-08T04:21:10.810473+0000","last_became_peered":"2024-05-08T04:21:10.810473+0000","last_unstale":"2024-05-08T04:21:11.997242+0000","last_undegraded":"2024-05-08T04:21:11.997242+0000","last_fullsized":"2024-05-08T04:21:11.997242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:22.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803834+0000","last_change":"2024-05-08T04:21:09.808749+0000","last_active":"2024-05-08T04:21:11.803834+0000","last_peered":"2024-05-08T04:21:11.803834+0000","last_clean":"2024-05-08T04:21:11.803834+0000","last_became_active":"2024-05-08T04:21:09.808522+0000","last_became_peered":"2024-05-08T04:21:09.808522+0000","last_unstale":"2024-05-08T04:21:11.803834+0000","last_undegraded":"2024-05-08T04:21:11.803834+0000","last_fullsized":"2024-05-08T04:21:11.803834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803729+0000","last_change":"2024-05-08T04:21:10.803674+0000","last_active":"2024-05-08T04:21:11.803729+0000","last_peered":"2024-05-08T04:21:11.803729+0000","last_clean":"2024-05-08T04:21:11.803729+0000","last_became_active":"2024-05-08T04:21:10.802802+0000","last_became_peered":"2024-05-08T04:21:10.802802+0000","last_unstale":"2024-05-08T04:21:11.803729+0000","last_undegraded":"2024-05-08T04:21:11.803729+0000","last_fullsized":"2024-05-08T04:21:11.803729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:18:33.343054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.799102+0000","last_change":"2024-05-08T04:21:09.801923+0000","last_active":"2024-05-08T04:21:10.799102+0000","last_peered":"2024-05-08T04:21:10.799102+0000","last_clean":"2024-05-08T04:21:10.799102+0000","last_became_active":"2024-05-08T04:21:09.801620+0000","last_became_peered":"2024-05-08T04:21:09.801620+0000","last_unstale":"2024-05-08T04:21:10.799102+0000","last_undegraded":"2024-05-08T04:21:10.799102+0000","last_fullsized":"2024-05-08T04:21:10.799102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T04:21:10.808047+0000","last_change":"2024-05-08T04:21:10.806239+0000","last_active":"2024-05-08T04:21:10.808047+0000","last_peered":"2024-05-08T04:21:10.808047+0000","last_clean":"2024-05-08T04:21:10.808047+0000","last_became_active":"2024-05-08T04:21:10.805961+0000","last_became_peered":"2024-05-08T04:21:10.805961+0000","last_unstale":"2024-05-08T04:21:10.808047+0000","last_undegraded":"2024-05-08T04:21:10.808047+0000","last_fullsized":"2024-05-08T04:21:10.808047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:14.085078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997335+0000","last_change":"2024-05-08T04:21:09.805477+0000","last_active":"2024-05-08T04:21:11.997335+0000","last_peered":"2024-05-08T04:21:11.997335+0000","last_clean":"2024-05-08T04:21:11.997335+0000","last_became_active":"2024-05-08T04:21:09.805232+0000","last_became_peered":"2024-05-08T04:21:09.805232+0000","last_unstale":"2024-05-08T04:21:11.997335+0000","last_undegraded":"2024-05-08T04:21:11.997335+0000","last_fullsized":"2024-05-08T04:21:11.997335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:33.031084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997271+0000","last_change":"2024-05-08T04:21:10.812788+0000","last_active":"2024-05-08T04:21:11.997271+0000","last_peered":"2024-05-08T04:21:11.997271+0000","last_clean":"2024-05-08T04:21:11.997271+0000","last_became_active":"2024-05-08T04:21:10.812267+0000","last_became_peered":"2024-05-08T04:21:10.812267+0000","last_unstale":"2024-05-08T04:21:11.997271+0000","last_undegraded":"2024-05-08T04:21:11.997271+0000","last_fullsized":"2024-05-08T04:21:11.997271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:56:40.748736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997431+0000","last_change":"2024-05-08T04:21:10.814337+0000","last_active":"2024-05-08T04:21:11.997431+0000","last_peered":"2024-05-08T04:21:11.997431+0000","last_clean":"2024-05-08T04:21:11.997431+0000","last_became_active":"2024-05-08T04:21:10.814087+0000","last_became_peered":"2024-05-08T04:21:10.814087+0000","last_unstale":"2024-05-08T04:21:11.997431+0000","last_undegraded":"2024-05-08T04:21:11.997431+0000","last_fullsized":"2024-05-08T04:21:11.997431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:31.354097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806735+0000","last_change":"2024-05-08T04:21:09.808915+0000","last_active":"2024-05-08T04:21:11.806735+0000","last_peered":"2024-05-08T04:21:11.806735+0000","last_clean":"2024-05-08T04:21:11.806735+0000","last_became_active":"2024-05-08T04:21:09.808528+0000","last_became_peered":"2024-05-08T04:21:09.808528+0000","last_unstale":"2024-05-08T04:21:11.806735+0000","last_undegraded":"2024-05-08T04:21:11.806735+0000","last_fullsized":"2024-05-08T04:21:11.806735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:10.460883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797564+0000","last_change":"2024-05-08T04:21:10.814868+0000","last_active":"2024-05-08T04:21:11.797564+0000","last_peered":"2024-05-08T04:21:11.797564+0000","last_clean":"2024-05-08T04:21:11.797564+0000","last_became_active":"2024-05-08T04:21:10.814012+0000","last_became_peered":"2024-05-08T04:21:10.814012+0000","last_unstale":"2024-05-08T04:21:11.797564+0000","last_undegraded":"2024-05-08T04:21:11.797564+0000","last_fullsized":"2024-05-08T04:21:11.797564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:02.505469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806577+0000","last_change":"2024-05-08T04:21:09.806371+0000","last_active":"2024-05-08T04:21:11.806577+0000","last_peered":"2024-05-08T04:21:11.806577+0000","last_clean":"2024-05-08T04:21:11.806577+0000","last_became_active":"2024-05-08T04:21:09.806120+0000","last_became_peered":"2024-05-08T04:21:09.806120+0000","last_unstale":"2024-05-08T04:21:11.806577+0000","last_undegraded":"2024-05-08T04:21:11.806577+0000","last_fullsized":"2024-05-08T04:21:11.806577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799202+0000","last_change":"2024-05-08T04:21:10.799276+0000","last_active":"2024-05-08T04:21:11.799202+0000","last_peered":"2024-05-08T04:21:11.799202+0000","last_clean":"2024-05-08T04:21:11.799202+0000","last_became_active":"2024-05-08T04:21:10.798986+0000","last_became_peered":"2024-05-08T04:21:10.798986+0000","last_unstale":"2024-05-08T04:21:11.799202+0000","last_undegraded":"2024-05-08T04:21:11.799202+0000","last_fullsized":"2024-05-08T04:21:11.799202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:39.936653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799414+0000","last_change":"2024-05-08T04:21:09.795113+0000","last_active":"2024-05-08T04:21:11.799414+0000","last_peered":"2024-05-08T04:21:11.799414+0000","last_clean":"2024-05-08T04:21:11.799414+0000","last_became_active":"2024-05-08T04:21:09.794565+0000","last_became_peered":"2024-05-08T04:21:09.794565+0000","last_unstale":"2024-05-08T04:21:11.799414+0000","last_undegraded":"2024-05-08T04:21:11.799414+0000","last_fullsized":"2024-05-08T04:21:11.799414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799323+0000","last_change":"2024-05-08T04:21:10.794958+0000","last_active":"2024-05-08T04:21:11.799323+0000","last_peered":"2024-05-08T04:21:11.799323+0000","last_clean":"2024-05-08T04:21:11.799323+0000","last_became_active":"2024-05-08T04:21:10.794649+0000","last_became_peered":"2024-05-08T04:21:10.794649+0000","last_unstale":"2024-05-08T04:21:11.799323+0000","last_undegraded":"2024-05-08T04:21:11.799323+0000","last_fullsized":"2024-05-08T04:21:11.799323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:36.487747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804255+0000","last_change":"2024-05-08T04:21:09.802589+0000","last_active":"2024-05-08T04:21:11.804255+0000","last_peered":"2024-05-08T04:21:11.804255+0000","last_clean":"2024-05-08T04:21:11.804255+0000","last_became_active":"2024-05-08T04:21:09.802292+0000","last_became_peered":"2024-05-08T04:21:09.802292+0000","last_unstale":"2024-05-08T04:21:11.804255+0000","last_undegraded":"2024-05-08T04:21:11.804255+0000","last_fullsized":"2024-05-08T04:21:11.804255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":200704,"data_stored":64758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":661394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":73218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":200704,"data_stored":64690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:21:18.565 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:21:18.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.676+0000 7ffb44b4f640 1 Processor -- start 2024-05-08T04:21:18.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.676+0000 7ffb44b4f640 1 -- start start 2024-05-08T04:21:18.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb44b4f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb4015db30 0x7ffb4006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:18.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb44b4f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffb400b5b40 0x7ffb400d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:18.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb44b4f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb400b6b50 con 0x7ffb400b93b0 2024-05-08T04:21:18.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb44b4f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4006c800 con 0x7ffb400b5b40 2024-05-08T04:21:18.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb44b4f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4006cae0 con 0x7ffb4015db30 2024-05-08T04:21:18.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb3ed9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffb400b5b40 0x7ffb400d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:18.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb35d9b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ffb400b93b0 0x7ffb400b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53106/0 (socket says 172.21.15.104:53106) 2024-05-08T04:21:18.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb35d9b640 1 -- 172.21.15.104:0/2543985280 learned_addr learned my addr 172.21.15.104:0/2543985280 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:18.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb3e59c640 1 --2- 172.21.15.104:0/2543985280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb4015db30 0x7ffb4006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:18.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb3ed9d640 1 -- 172.21.15.104:0/2543985280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb4015db30 msgr2=0x7ffb4006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:18.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb3ed9d640 1 --2- 172.21.15.104:0/2543985280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb4015db30 0x7ffb4006bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:18.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb3ed9d640 1 -- 172.21.15.104:0/2543985280 >> v1:172.21.15.104:6789/0 conn(0x7ffb400b93b0 legacy=0x7ffb400b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:18.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb3dd9b640 1 -- 172.21.15.104:0/2543985280 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287064219 0 0) 0x7ffb28001110 con 0x7ffb400b93b0 2024-05-08T04:21:18.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.677+0000 7ffb3ed9d640 1 -- 172.21.15.104:0/2543985280 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4006cdc0 con 0x7ffb400b5b40 2024-05-08T04:21:18.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.678+0000 7ffb3ed9d640 1 --2- 172.21.15.104:0/2543985280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb400b5b40 0x7ffb400d24b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffb38009d90 tx=0x7ffb3802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f915c8c4262f49 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:18.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.678+0000 7ffb3dd9b640 1 -- 172.21.15.104:0/2543985280 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38007740 con 0x7ffb400b5b40 2024-05-08T04:21:18.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.678+0000 7ffb3dd9b640 1 -- 172.21.15.104:0/2543985280 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb380078e0 con 0x7ffb400b5b40 2024-05-08T04:21:18.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.678+0000 7ffb3dd9b640 1 -- 172.21.15.104:0/2543985280 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38007cb0 con 0x7ffb400b5b40 2024-05-08T04:21:18.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.679+0000 7ffb44b4f640 1 -- 172.21.15.104:0/2543985280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb400b5b40 msgr2=0x7ffb400d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:18.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.679+0000 7ffb44b4f640 1 --2- 172.21.15.104:0/2543985280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb400b5b40 0x7ffb400d24b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffb38009d90 tx=0x7ffb3802a660 comp rx=0 tx=0).stop 2024-05-08T04:21:18.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.679+0000 7ffb44b4f640 1 -- 172.21.15.104:0/2543985280 shutdown_connections 2024-05-08T04:21:18.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.679+0000 7ffb44b4f640 1 --2- 172.21.15.104:0/2543985280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb400b5b40 0x7ffb400d24b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:18.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.679+0000 7ffb44b4f640 1 --2- 172.21.15.104:0/2543985280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb4015db30 0x7ffb4006bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:18.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.679+0000 7ffb44b4f640 1 -- 172.21.15.104:0/2543985280 >> 172.21.15.104:0/2543985280 conn(0x7ffb400d0430 msgr2=0x7ffb400d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:18.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.679+0000 7ffb44b4f640 1 -- 172.21.15.104:0/2543985280 shutdown_connections 2024-05-08T04:21:18.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.679+0000 7ffb44b4f640 1 -- 172.21.15.104:0/2543985280 wait complete. 2024-05-08T04:21:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.680+0000 7ffb44b4f640 1 Processor -- start 2024-05-08T04:21:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.680+0000 7ffb44b4f640 1 -- start start 2024-05-08T04:21:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb44b4f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb400b5b40 0x7ffb401f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb44b4f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb400b93b0 0x7ffb401f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb44b4f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb4015db30 0x7ffb401f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb44b4f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4015df10 con 0x7ffb400b93b0 2024-05-08T04:21:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb44b4f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4006c4f0 con 0x7ffb4015db30 2024-05-08T04:21:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb44b4f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb40154100 con 0x7ffb400b5b40 2024-05-08T04:21:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb35d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb400b93b0 0x7ffb401f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb35d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb400b93b0 0x7ffb401f4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33732/0 (socket says 172.21.15.104:33732) 2024-05-08T04:21:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb35d9b640 1 -- 172.21.15.104:0/1904830566 learned_addr learned my addr 172.21.15.104:0/1904830566 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb3e59c640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb400b5b40 0x7ffb401f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb3ed9d640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb4015db30 0x7ffb401f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb35d9b640 1 -- 172.21.15.104:0/1904830566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb400b5b40 msgr2=0x7ffb401f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb35d9b640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb400b5b40 0x7ffb401f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb35d9b640 1 -- 172.21.15.104:0/1904830566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb4015db30 msgr2=0x7ffb401f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb35d9b640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb4015db30 0x7ffb401f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb35d9b640 1 -- 172.21.15.104:0/1904830566 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb401f4440 con 0x7ffb400b93b0 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.681+0000 7ffb3ed9d640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb4015db30 0x7ffb401f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.682+0000 7ffb35d9b640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb400b93b0 0x7ffb401f4640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800c780 tx=0x7ffb2800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.682+0000 7ffb377fe640 1 -- 172.21.15.104:0/1904830566 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28018070 con 0x7ffb400b93b0 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.682+0000 7ffb377fe640 1 -- 172.21.15.104:0/1904830566 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb280072d0 con 0x7ffb400b93b0 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.682+0000 7ffb44b4f640 1 -- 172.21.15.104:0/1904830566 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4015a920 con 0x7ffb400b93b0 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.682+0000 7ffb377fe640 1 -- 172.21.15.104:0/1904830566 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb280047e0 con 0x7ffb400b93b0 2024-05-08T04:21:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.682+0000 7ffb44b4f640 1 -- 172.21.15.104:0/1904830566 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4015aee0 con 0x7ffb400b93b0 2024-05-08T04:21:18.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.683+0000 7ffb44b4f640 1 -- 172.21.15.104:0/1904830566 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb40075010 con 0x7ffb400b93b0 2024-05-08T04:21:18.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.683+0000 7ffb377fe640 1 -- 172.21.15.104:0/1904830566 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffb2801b070 con 0x7ffb400b93b0 2024-05-08T04:21:18.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.684+0000 7ffb377fe640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffb2006b4d0 0x7ffb2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:18.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.684+0000 7ffb377fe640 1 -- 172.21.15.104:0/1904830566 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb28089480 con 0x7ffb400b93b0 2024-05-08T04:21:18.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.684+0000 7ffb3e59c640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffb2006b4d0 0x7ffb2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:18.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.684+0000 7ffb3e59c640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffb2006b4d0 0x7ffb2006d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffb30006fd0 tx=0x7ffb30008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:18.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.688+0000 7ffb377fe640 1 -- 172.21.15.104:0/1904830566 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffb401f4440 con 0x7ffb400b93b0 2024-05-08T04:21:18.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.860+0000 7ffb44b4f640 1 -- 172.21.15.104:0/1904830566 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb4015b280 con 0x7ffb2006b4d0 2024-05-08T04:21:18.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.866+0000 7ffb377fe640 1 -- 172.21.15.104:0/1904830566 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251868 (secure 0 0 0) 0x7ffb4015b280 con 0x7ffb2006b4d0 2024-05-08T04:21:18.870 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:18.871 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:21:18.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.869+0000 7ffb44b4f640 1 -- 172.21.15.104:0/1904830566 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffb2006b4d0 msgr2=0x7ffb2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:18.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.869+0000 7ffb44b4f640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffb2006b4d0 0x7ffb2006d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffb30006fd0 tx=0x7ffb30008040 comp rx=0 tx=0).stop 2024-05-08T04:21:18.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.869+0000 7ffb44b4f640 1 -- 172.21.15.104:0/1904830566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb400b93b0 msgr2=0x7ffb401f4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:18.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.869+0000 7ffb44b4f640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb400b93b0 0x7ffb401f4640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800c780 tx=0x7ffb2800cc40 comp rx=0 tx=0).stop 2024-05-08T04:21:18.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.869+0000 7ffb44b4f640 1 -- 172.21.15.104:0/1904830566 shutdown_connections 2024-05-08T04:21:18.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.869+0000 7ffb44b4f640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffb2006b4d0 0x7ffb2006d990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:18.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.869+0000 7ffb44b4f640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb4015db30 0x7ffb401f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:18.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.869+0000 7ffb44b4f640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb400b93b0 0x7ffb401f4640 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:18.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.869+0000 7ffb44b4f640 1 --2- 172.21.15.104:0/1904830566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb400b5b40 0x7ffb401f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:18.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.869+0000 7ffb44b4f640 1 -- 172.21.15.104:0/1904830566 >> 172.21.15.104:0/1904830566 conn(0x7ffb400d0430 msgr2=0x7ffb400b3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:18.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.869+0000 7ffb44b4f640 1 -- 172.21.15.104:0/1904830566 shutdown_connections 2024-05-08T04:21:18.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:18.869+0000 7ffb44b4f640 1 -- 172.21.15.104:0/1904830566 wait complete. 2024-05-08T04:21:18.881 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-05-08T04:21:18.639073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001423"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806700+0000","last_change":"2024-05-08T04:21:10.815759+0000","last_active":"2024-05-08T04:21:11.806700+0000","last_peered":"2024-05-08T04:21:11.806700+0000","last_clean":"2024-05-08T04:21:11.806700+0000","last_became_active":"2024-05-08T04:21:10.815430+0000","last_became_peered":"2024-05-08T04:21:10.815430+0000","last_unstale":"2024-05-08T04:21:11.806700+0000","last_undegraded":"2024-05-08T04:21:11.806700+0000","last_fullsized":"2024-05-08T04:21:11.806700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:09:39.015637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799301+0000","last_change":"2024-05-08T04:21:10.799995+0000","last_active":"2024-05-08T04:21:11.799301+0000","last_peered":"2024-05-08T04:21:11.799301+0000","last_clean":"2024-05-08T04:21:11.799301+0000","last_became_active":"2024-05-08T04:21:10.799655+0000","last_became_peered":"2024-05-08T04:21:10.799655+0000","last_unstale":"2024-05-08T04:21:11.799301+0000","last_undegraded":"2024-05-08T04:21:11.799301+0000","last_fullsized":"2024-05-08T04:21:11.799301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:22.135893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798824+0000","last_change":"2024-05-08T04:21:10.807212+0000","last_active":"2024-05-08T04:21:11.798824+0000","last_peered":"2024-05-08T04:21:11.798824+0000","last_clean":"2024-05-08T04:21:11.798824+0000","last_became_active":"2024-05-08T04:21:10.806880+0000","last_became_peered":"2024-05-08T04:21:10.806880+0000","last_unstale":"2024-05-08T04:21:11.798824+0000","last_undegraded":"2024-05-08T04:21:11.798824+0000","last_fullsized":"2024-05-08T04:21:11.798824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683814+0000","last_change":"2024-05-08T04:21:10.809736+0000","last_active":"2024-05-08T04:21:12.683814+0000","last_peered":"2024-05-08T04:21:12.683814+0000","last_clean":"2024-05-08T04:21:12.683814+0000","last_became_active":"2024-05-08T04:21:10.808825+0000","last_became_peered":"2024-05-08T04:21:10.808825+0000","last_unstale":"2024-05-08T04:21:12.683814+0000","last_undegraded":"2024-05-08T04:21:12.683814+0000","last_fullsized":"2024-05-08T04:21:12.683814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:00.517242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806396+0000","last_change":"2024-05-08T04:21:10.807971+0000","last_active":"2024-05-08T04:21:11.806396+0000","last_peered":"2024-05-08T04:21:11.806396+0000","last_clean":"2024-05-08T04:21:11.806396+0000","last_became_active":"2024-05-08T04:21:10.807525+0000","last_became_peered":"2024-05-08T04:21:10.807525+0000","last_unstale":"2024-05-08T04:21:11.806396+0000","last_undegraded":"2024-05-08T04:21:11.806396+0000","last_fullsized":"2024-05-08T04:21:11.806396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:33.787458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683680+0000","last_change":"2024-05-08T04:21:10.808827+0000","last_active":"2024-05-08T04:21:12.683680+0000","last_peered":"2024-05-08T04:21:12.683680+0000","last_clean":"2024-05-08T04:21:12.683680+0000","last_became_active":"2024-05-08T04:21:10.808388+0000","last_became_peered":"2024-05-08T04:21:10.808388+0000","last_unstale":"2024-05-08T04:21:12.683680+0000","last_undegraded":"2024-05-08T04:21:12.683680+0000","last_fullsized":"2024-05-08T04:21:12.683680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:11.466963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806249+0000","last_change":"2024-05-08T04:21:10.806944+0000","last_active":"2024-05-08T04:21:11.806249+0000","last_peered":"2024-05-08T04:21:11.806249+0000","last_clean":"2024-05-08T04:21:11.806249+0000","last_became_active":"2024-05-08T04:21:10.806257+0000","last_became_peered":"2024-05-08T04:21:10.806257+0000","last_unstale":"2024-05-08T04:21:11.806249+0000","last_undegraded":"2024-05-08T04:21:11.806249+0000","last_fullsized":"2024-05-08T04:21:11.806249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798784+0000","last_change":"2024-05-08T04:21:10.808012+0000","last_active":"2024-05-08T04:21:11.798784+0000","last_peered":"2024-05-08T04:21:11.798784+0000","last_clean":"2024-05-08T04:21:11.798784+0000","last_became_active":"2024-05-08T04:21:10.807762+0000","last_became_peered":"2024-05-08T04:21:10.807762+0000","last_unstale":"2024-05-08T04:21:11.798784+0000","last_undegraded":"2024-05-08T04:21:11.798784+0000","last_fullsized":"2024-05-08T04:21:11.798784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797594+0000","last_change":"2024-05-08T04:21:10.813184+0000","last_active":"2024-05-08T04:21:11.797594+0000","last_peered":"2024-05-08T04:21:11.797594+0000","last_clean":"2024-05-08T04:21:11.797594+0000","last_became_active":"2024-05-08T04:21:10.812887+0000","last_became_peered":"2024-05-08T04:21:10.812887+0000","last_unstale":"2024-05-08T04:21:11.797594+0000","last_undegraded":"2024-05-08T04:21:11.797594+0000","last_fullsized":"2024-05-08T04:21:11.797594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:34.037163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806602+0000","last_change":"2024-05-08T04:21:10.808669+0000","last_active":"2024-05-08T04:21:11.806602+0000","last_peered":"2024-05-08T04:21:11.806602+0000","last_clean":"2024-05-08T04:21:11.806602+0000","last_became_active":"2024-05-08T04:21:10.807623+0000","last_became_peered":"2024-05-08T04:21:10.807623+0000","last_unstale":"2024-05-08T04:21:11.806602+0000","last_undegraded":"2024-05-08T04:21:11.806602+0000","last_fullsized":"2024-05-08T04:21:11.806602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:36.487747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806477+0000","last_change":"2024-05-08T04:21:10.815746+0000","last_active":"2024-05-08T04:21:11.806477+0000","last_peered":"2024-05-08T04:21:11.806477+0000","last_clean":"2024-05-08T04:21:11.806477+0000","last_became_active":"2024-05-08T04:21:10.815484+0000","last_became_peered":"2024-05-08T04:21:10.815484+0000","last_unstale":"2024-05-08T04:21:11.806477+0000","last_undegraded":"2024-05-08T04:21:11.806477+0000","last_fullsized":"2024-05-08T04:21:11.806477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:14.742480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806591+0000","last_change":"2024-05-08T04:21:10.809694+0000","last_active":"2024-05-08T04:21:11.806591+0000","last_peered":"2024-05-08T04:21:11.806591+0000","last_clean":"2024-05-08T04:21:11.806591+0000","last_became_active":"2024-05-08T04:21:10.809335+0000","last_became_peered":"2024-05-08T04:21:10.809335+0000","last_unstale":"2024-05-08T04:21:11.806591+0000","last_undegraded":"2024-05-08T04:21:11.806591+0000","last_fullsized":"2024-05-08T04:21:11.806591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:22.135893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684183+0000","last_change":"2024-05-08T04:21:10.810243+0000","last_active":"2024-05-08T04:21:12.684183+0000","last_peered":"2024-05-08T04:21:12.684183+0000","last_clean":"2024-05-08T04:21:12.684183+0000","last_became_active":"2024-05-08T04:21:10.809954+0000","last_became_peered":"2024-05-08T04:21:10.809954+0000","last_unstale":"2024-05-08T04:21:12.684183+0000","last_undegraded":"2024-05-08T04:21:12.684183+0000","last_fullsized":"2024-05-08T04:21:12.684183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:18:33.343054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684014+0000","last_change":"2024-05-08T04:21:10.803036+0000","last_active":"2024-05-08T04:21:12.684014+0000","last_peered":"2024-05-08T04:21:12.684014+0000","last_clean":"2024-05-08T04:21:12.684014+0000","last_became_active":"2024-05-08T04:21:10.801931+0000","last_became_peered":"2024-05-08T04:21:10.801931+0000","last_unstale":"2024-05-08T04:21:12.684014+0000","last_undegraded":"2024-05-08T04:21:12.684014+0000","last_fullsized":"2024-05-08T04:21:12.684014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:53.558867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798885+0000","last_change":"2024-05-08T04:21:10.810578+0000","last_active":"2024-05-08T04:21:11.798885+0000","last_peered":"2024-05-08T04:21:11.798885+0000","last_clean":"2024-05-08T04:21:11.798885+0000","last_became_active":"2024-05-08T04:21:10.809929+0000","last_became_peered":"2024-05-08T04:21:10.809929+0000","last_unstale":"2024-05-08T04:21:11.798885+0000","last_undegraded":"2024-05-08T04:21:11.798885+0000","last_fullsized":"2024-05-08T04:21:11.798885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997095+0000","last_change":"2024-05-08T04:21:10.809708+0000","last_active":"2024-05-08T04:21:11.997095+0000","last_peered":"2024-05-08T04:21:11.997095+0000","last_clean":"2024-05-08T04:21:11.997095+0000","last_became_active":"2024-05-08T04:21:10.809239+0000","last_became_peered":"2024-05-08T04:21:10.809239+0000","last_unstale":"2024-05-08T04:21:11.997095+0000","last_undegraded":"2024-05-08T04:21:11.997095+0000","last_fullsized":"2024-05-08T04:21:11.997095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:09:39.015637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997748+0000","last_change":"2024-05-08T04:21:10.813941+0000","last_active":"2024-05-08T04:21:11.997748+0000","last_peered":"2024-05-08T04:21:11.997748+0000","last_clean":"2024-05-08T04:21:11.997748+0000","last_became_active":"2024-05-08T04:21:10.813628+0000","last_became_peered":"2024-05-08T04:21:10.813628+0000","last_unstale":"2024-05-08T04:21:11.997748+0000","last_undegraded":"2024-05-08T04:21:11.997748+0000","last_fullsized":"2024-05-08T04:21:11.997748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:54:22.530212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684324+0000","last_change":"2024-05-08T04:21:10.802243+0000","last_active":"2024-05-08T04:21:12.684324+0000","last_peered":"2024-05-08T04:21:12.684324+0000","last_clean":"2024-05-08T04:21:12.684324+0000","last_became_active":"2024-05-08T04:21:10.801990+0000","last_became_peered":"2024-05-08T04:21:10.801990+0000","last_unstale":"2024-05-08T04:21:12.684324+0000","last_undegraded":"2024-05-08T04:21:12.684324+0000","last_fullsized":"2024-05-08T04:21:12.684324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:11.466963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997557+0000","last_change":"2024-05-08T04:21:10.809257+0000","last_active":"2024-05-08T04:21:11.997557+0000","last_peered":"2024-05-08T04:21:11.997557+0000","last_clean":"2024-05-08T04:21:11.997557+0000","last_became_active":"2024-05-08T04:21:10.808961+0000","last_became_peered":"2024-05-08T04:21:10.808961+0000","last_unstale":"2024-05-08T04:21:11.997557+0000","last_undegraded":"2024-05-08T04:21:11.997557+0000","last_fullsized":"2024-05-08T04:21:11.997557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:47:28.393115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806508+0000","last_change":"2024-05-08T04:21:10.808294+0000","last_active":"2024-05-08T04:21:11.806508+0000","last_peered":"2024-05-08T04:21:11.806508+0000","last_clean":"2024-05-08T04:21:11.806508+0000","last_became_active":"2024-05-08T04:21:10.808032+0000","last_became_peered":"2024-05-08T04:21:10.808032+0000","last_unstale":"2024-05-08T04:21:11.806508+0000","last_undegraded":"2024-05-08T04:21:11.806508+0000","last_fullsized":"2024-05-08T04:21:11.806508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:33.067388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803850+0000","last_change":"2024-05-08T04:21:10.806239+0000","last_active":"2024-05-08T04:21:11.803850+0000","last_peered":"2024-05-08T04:21:11.803850+0000","last_clean":"2024-05-08T04:21:11.803850+0000","last_became_active":"2024-05-08T04:21:10.805369+0000","last_became_peered":"2024-05-08T04:21:10.805369+0000","last_unstale":"2024-05-08T04:21:11.803850+0000","last_undegraded":"2024-05-08T04:21:11.803850+0000","last_fullsized":"2024-05-08T04:21:11.803850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:55:41.627503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797390+0000","last_change":"2024-05-08T04:21:10.813103+0000","last_active":"2024-05-08T04:21:11.797390+0000","last_peered":"2024-05-08T04:21:11.797390+0000","last_clean":"2024-05-08T04:21:11.797390+0000","last_became_active":"2024-05-08T04:21:10.812833+0000","last_became_peered":"2024-05-08T04:21:10.812833+0000","last_unstale":"2024-05-08T04:21:11.797390+0000","last_undegraded":"2024-05-08T04:21:11.797390+0000","last_fullsized":"2024-05-08T04:21:11.797390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:35:00.954562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798758+0000","last_change":"2024-05-08T04:21:10.794976+0000","last_active":"2024-05-08T04:21:11.798758+0000","last_peered":"2024-05-08T04:21:11.798758+0000","last_clean":"2024-05-08T04:21:11.798758+0000","last_became_active":"2024-05-08T04:21:10.794594+0000","last_became_peered":"2024-05-08T04:21:10.794594+0000","last_unstale":"2024-05-08T04:21:11.798758+0000","last_undegraded":"2024-05-08T04:21:11.798758+0000","last_fullsized":"2024-05-08T04:21:11.798758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:29.958463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997065+0000","last_change":"2024-05-08T04:21:10.809601+0000","last_active":"2024-05-08T04:21:11.997065+0000","last_peered":"2024-05-08T04:21:11.997065+0000","last_clean":"2024-05-08T04:21:11.997065+0000","last_became_active":"2024-05-08T04:21:10.809257+0000","last_became_peered":"2024-05-08T04:21:10.809257+0000","last_unstale":"2024-05-08T04:21:11.997065+0000","last_undegraded":"2024-05-08T04:21:11.997065+0000","last_fullsized":"2024-05-08T04:21:11.997065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799293+0000","last_change":"2024-05-08T04:21:10.802281+0000","last_active":"2024-05-08T04:21:11.799293+0000","last_peered":"2024-05-08T04:21:11.799293+0000","last_clean":"2024-05-08T04:21:11.799293+0000","last_became_active":"2024-05-08T04:21:10.802003+0000","last_became_peered":"2024-05-08T04:21:10.802003+0000","last_unstale":"2024-05-08T04:21:11.799293+0000","last_undegraded":"2024-05-08T04:21:11.799293+0000","last_fullsized":"2024-05-08T04:21:11.799293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:01.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683844+0000","last_change":"2024-05-08T04:21:10.817545+0000","last_active":"2024-05-08T04:21:12.683844+0000","last_peered":"2024-05-08T04:21:12.683844+0000","last_clean":"2024-05-08T04:21:12.683844+0000","last_became_active":"2024-05-08T04:21:10.817272+0000","last_became_peered":"2024-05-08T04:21:10.817272+0000","last_unstale":"2024-05-08T04:21:12.683844+0000","last_undegraded":"2024-05-08T04:21:12.683844+0000","last_fullsized":"2024-05-08T04:21:12.683844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:02.505469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684138+0000","last_change":"2024-05-08T04:21:10.802074+0000","last_active":"2024-05-08T04:21:12.684138+0000","last_peered":"2024-05-08T04:21:12.684138+0000","last_clean":"2024-05-08T04:21:12.684138+0000","last_became_active":"2024-05-08T04:21:10.801792+0000","last_became_peered":"2024-05-08T04:21:10.801792+0000","last_unstale":"2024-05-08T04:21:12.684138+0000","last_undegraded":"2024-05-08T04:21:12.684138+0000","last_fullsized":"2024-05-08T04:21:12.684138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:01.107803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683976+0000","last_change":"2024-05-08T04:21:10.810222+0000","last_active":"2024-05-08T04:21:12.683976+0000","last_peered":"2024-05-08T04:21:12.683976+0000","last_clean":"2024-05-08T04:21:12.683976+0000","last_became_active":"2024-05-08T04:21:10.809936+0000","last_became_peered":"2024-05-08T04:21:10.809936+0000","last_unstale":"2024-05-08T04:21:12.683976+0000","last_undegraded":"2024-05-08T04:21:12.683976+0000","last_fullsized":"2024-05-08T04:21:12.683976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:34.037163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799109+0000","last_change":"2024-05-08T04:21:10.801209+0000","last_active":"2024-05-08T04:21:11.799109+0000","last_peered":"2024-05-08T04:21:11.799109+0000","last_clean":"2024-05-08T04:21:11.799109+0000","last_became_active":"2024-05-08T04:21:10.800919+0000","last_became_peered":"2024-05-08T04:21:10.800919+0000","last_unstale":"2024-05-08T04:21:11.799109+0000","last_undegraded":"2024-05-08T04:21:11.799109+0000","last_fullsized":"2024-05-08T04:21:11.799109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:14.742480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997234+0000","last_change":"2024-05-08T04:21:10.812578+0000","last_active":"2024-05-08T04:21:11.997234+0000","last_peered":"2024-05-08T04:21:11.997234+0000","last_clean":"2024-05-08T04:21:11.997234+0000","last_became_active":"2024-05-08T04:21:10.811984+0000","last_became_peered":"2024-05-08T04:21:10.811984+0000","last_unstale":"2024-05-08T04:21:11.997234+0000","last_undegraded":"2024-05-08T04:21:11.997234+0000","last_fullsized":"2024-05-08T04:21:11.997234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:18.292078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683815+0000","last_change":"2024-05-08T04:21:10.803704+0000","last_active":"2024-05-08T04:21:12.683815+0000","last_peered":"2024-05-08T04:21:12.683815+0000","last_clean":"2024-05-08T04:21:12.683815+0000","last_became_active":"2024-05-08T04:21:10.803362+0000","last_became_peered":"2024-05-08T04:21:10.803362+0000","last_unstale":"2024-05-08T04:21:12.683815+0000","last_undegraded":"2024-05-08T04:21:12.683815+0000","last_fullsized":"2024-05-08T04:21:12.683815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:54.044618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683628+0000","last_change":"2024-05-08T04:21:10.803508+0000","last_active":"2024-05-08T04:21:12.683628+0000","last_peered":"2024-05-08T04:21:12.683628+0000","last_clean":"2024-05-08T04:21:12.683628+0000","last_became_active":"2024-05-08T04:21:10.803182+0000","last_became_peered":"2024-05-08T04:21:10.803182+0000","last_unstale":"2024-05-08T04:21:12.683628+0000","last_undegraded":"2024-05-08T04:21:12.683628+0000","last_fullsized":"2024-05-08T04:21:12.683628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:53.770709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797469+0000","last_change":"2024-05-08T04:21:10.806394+0000","last_active":"2024-05-08T04:21:11.797469+0000","last_peered":"2024-05-08T04:21:11.797469+0000","last_clean":"2024-05-08T04:21:11.797469+0000","last_became_active":"2024-05-08T04:21:10.806139+0000","last_became_peered":"2024-05-08T04:21:10.806139+0000","last_unstale":"2024-05-08T04:21:11.797469+0000","last_undegraded":"2024-05-08T04:21:11.797469+0000","last_fullsized":"2024-05-08T04:21:11.797469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:00.517242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799118+0000","last_change":"2024-05-08T04:21:09.799594+0000","last_active":"2024-05-08T04:21:11.799118+0000","last_peered":"2024-05-08T04:21:11.799118+0000","last_clean":"2024-05-08T04:21:11.799118+0000","last_became_active":"2024-05-08T04:21:09.798501+0000","last_became_peered":"2024-05-08T04:21:09.798501+0000","last_unstale":"2024-05-08T04:21:11.799118+0000","last_undegraded":"2024-05-08T04:21:11.799118+0000","last_fullsized":"2024-05-08T04:21:11.799118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804031+0000","last_change":"2024-05-08T04:21:10.812658+0000","last_active":"2024-05-08T04:21:11.804031+0000","last_peered":"2024-05-08T04:21:11.804031+0000","last_clean":"2024-05-08T04:21:11.804031+0000","last_became_active":"2024-05-08T04:21:10.812321+0000","last_became_peered":"2024-05-08T04:21:10.812321+0000","last_unstale":"2024-05-08T04:21:11.804031+0000","last_undegraded":"2024-05-08T04:21:11.804031+0000","last_fullsized":"2024-05-08T04:21:11.804031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997336+0000","last_change":"2024-05-08T04:21:09.805980+0000","last_active":"2024-05-08T04:21:11.997336+0000","last_peered":"2024-05-08T04:21:11.997336+0000","last_clean":"2024-05-08T04:21:11.997336+0000","last_became_active":"2024-05-08T04:21:09.805512+0000","last_became_peered":"2024-05-08T04:21:09.805512+0000","last_unstale":"2024-05-08T04:21:11.997336+0000","last_undegraded":"2024-05-08T04:21:11.997336+0000","last_fullsized":"2024-05-08T04:21:11.997336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:34:59.948483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683927+0000","last_change":"2024-05-08T04:21:09.807091+0000","last_active":"2024-05-08T04:21:12.683927+0000","last_peered":"2024-05-08T04:21:12.683927+0000","last_clean":"2024-05-08T04:21:12.683927+0000","last_became_active":"2024-05-08T04:21:09.806790+0000","last_became_peered":"2024-05-08T04:21:09.806790+0000","last_unstale":"2024-05-08T04:21:12.683927+0000","last_undegraded":"2024-05-08T04:21:12.683927+0000","last_fullsized":"2024-05-08T04:21:12.683927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799252+0000","last_change":"2024-05-08T04:21:10.806542+0000","last_active":"2024-05-08T04:21:11.799252+0000","last_peered":"2024-05-08T04:21:11.799252+0000","last_clean":"2024-05-08T04:21:11.799252+0000","last_became_active":"2024-05-08T04:21:10.804525+0000","last_became_peered":"2024-05-08T04:21:10.804525+0000","last_unstale":"2024-05-08T04:21:11.799252+0000","last_undegraded":"2024-05-08T04:21:11.799252+0000","last_fullsized":"2024-05-08T04:21:11.799252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:33.067388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997177+0000","last_change":"2024-05-08T04:21:09.803521+0000","last_active":"2024-05-08T04:21:11.997177+0000","last_peered":"2024-05-08T04:21:11.997177+0000","last_clean":"2024-05-08T04:21:11.997177+0000","last_became_active":"2024-05-08T04:21:09.803237+0000","last_became_peered":"2024-05-08T04:21:09.803237+0000","last_unstale":"2024-05-08T04:21:11.997177+0000","last_undegraded":"2024-05-08T04:21:11.997177+0000","last_fullsized":"2024-05-08T04:21:11.997177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803821+0000","last_change":"2024-05-08T04:21:10.804293+0000","last_active":"2024-05-08T04:21:11.803821+0000","last_peered":"2024-05-08T04:21:11.803821+0000","last_clean":"2024-05-08T04:21:11.803821+0000","last_became_active":"2024-05-08T04:21:10.803978+0000","last_became_peered":"2024-05-08T04:21:10.803978+0000","last_unstale":"2024-05-08T04:21:11.803821+0000","last_undegraded":"2024-05-08T04:21:11.803821+0000","last_fullsized":"2024-05-08T04:21:11.803821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:00.315803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797658+0000","last_change":"2024-05-08T04:21:09.802555+0000","last_active":"2024-05-08T04:21:11.797658+0000","last_peered":"2024-05-08T04:21:11.797658+0000","last_clean":"2024-05-08T04:21:11.797658+0000","last_became_active":"2024-05-08T04:21:09.801729+0000","last_became_peered":"2024-05-08T04:21:09.801729+0000","last_unstale":"2024-05-08T04:21:11.797658+0000","last_undegraded":"2024-05-08T04:21:11.797658+0000","last_fullsized":"2024-05-08T04:21:11.797658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683856+0000","last_change":"2024-05-08T04:21:10.817304+0000","last_active":"2024-05-08T04:21:12.683856+0000","last_peered":"2024-05-08T04:21:12.683856+0000","last_clean":"2024-05-08T04:21:12.683856+0000","last_became_active":"2024-05-08T04:21:10.817053+0000","last_became_peered":"2024-05-08T04:21:10.817053+0000","last_unstale":"2024-05-08T04:21:12.683856+0000","last_undegraded":"2024-05-08T04:21:12.683856+0000","last_fullsized":"2024-05-08T04:21:12.683856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:34.037163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806539+0000","last_change":"2024-05-08T04:21:09.808688+0000","last_active":"2024-05-08T04:21:11.806539+0000","last_peered":"2024-05-08T04:21:11.806539+0000","last_clean":"2024-05-08T04:21:11.806539+0000","last_became_active":"2024-05-08T04:21:09.808341+0000","last_became_peered":"2024-05-08T04:21:09.808341+0000","last_unstale":"2024-05-08T04:21:11.806539+0000","last_undegraded":"2024-05-08T04:21:11.806539+0000","last_fullsized":"2024-05-08T04:21:11.806539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:13.078999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799355+0000","last_change":"2024-05-08T04:21:10.812699+0000","last_active":"2024-05-08T04:21:11.799355+0000","last_peered":"2024-05-08T04:21:11.799355+0000","last_clean":"2024-05-08T04:21:11.799355+0000","last_became_active":"2024-05-08T04:21:10.812379+0000","last_became_peered":"2024-05-08T04:21:10.812379+0000","last_unstale":"2024-05-08T04:21:11.799355+0000","last_undegraded":"2024-05-08T04:21:11.799355+0000","last_fullsized":"2024-05-08T04:21:11.799355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684382+0000","last_change":"2024-05-08T04:21:09.796581+0000","last_active":"2024-05-08T04:21:12.684382+0000","last_peered":"2024-05-08T04:21:12.684382+0000","last_clean":"2024-05-08T04:21:12.684382+0000","last_became_active":"2024-05-08T04:21:09.796288+0000","last_became_peered":"2024-05-08T04:21:09.796288+0000","last_unstale":"2024-05-08T04:21:12.684382+0000","last_undegraded":"2024-05-08T04:21:12.684382+0000","last_fullsized":"2024-05-08T04:21:12.684382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997394+0000","last_change":"2024-05-08T04:21:10.809585+0000","last_active":"2024-05-08T04:21:11.997394+0000","last_peered":"2024-05-08T04:21:11.997394+0000","last_clean":"2024-05-08T04:21:11.997394+0000","last_became_active":"2024-05-08T04:21:10.809208+0000","last_became_peered":"2024-05-08T04:21:10.809208+0000","last_unstale":"2024-05-08T04:21:11.997394+0000","last_undegraded":"2024-05-08T04:21:11.997394+0000","last_fullsized":"2024-05-08T04:21:11.997394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:53:26.704579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683714+0000","last_change":"2024-05-08T04:21:09.798917+0000","last_active":"2024-05-08T04:21:12.683714+0000","last_peered":"2024-05-08T04:21:12.683714+0000","last_clean":"2024-05-08T04:21:12.683714+0000","last_became_active":"2024-05-08T04:21:09.798646+0000","last_became_peered":"2024-05-08T04:21:09.798646+0000","last_unstale":"2024-05-08T04:21:12.683714+0000","last_undegraded":"2024-05-08T04:21:12.683714+0000","last_fullsized":"2024-05-08T04:21:12.683714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:25.652092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806500+0000","last_change":"2024-05-08T04:21:10.806707+0000","last_active":"2024-05-08T04:21:11.806500+0000","last_peered":"2024-05-08T04:21:11.806500+0000","last_clean":"2024-05-08T04:21:11.806500+0000","last_became_active":"2024-05-08T04:21:10.806433+0000","last_became_peered":"2024-05-08T04:21:10.806433+0000","last_unstale":"2024-05-08T04:21:11.806500+0000","last_undegraded":"2024-05-08T04:21:11.806500+0000","last_fullsized":"2024-05-08T04:21:11.806500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:39.936653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684111+0000","last_change":"2024-05-08T04:21:09.806965+0000","last_active":"2024-05-08T04:21:12.684111+0000","last_peered":"2024-05-08T04:21:12.684111+0000","last_clean":"2024-05-08T04:21:12.684111+0000","last_became_active":"2024-05-08T04:21:09.806616+0000","last_became_peered":"2024-05-08T04:21:09.806616+0000","last_unstale":"2024-05-08T04:21:12.684111+0000","last_undegraded":"2024-05-08T04:21:12.684111+0000","last_fullsized":"2024-05-08T04:21:12.684111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:09.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684473+0000","last_change":"2024-05-08T04:21:10.814170+0000","last_active":"2024-05-08T04:21:12.684473+0000","last_peered":"2024-05-08T04:21:12.684473+0000","last_clean":"2024-05-08T04:21:12.684473+0000","last_became_active":"2024-05-08T04:21:10.813882+0000","last_became_peered":"2024-05-08T04:21:10.813882+0000","last_unstale":"2024-05-08T04:21:12.684473+0000","last_undegraded":"2024-05-08T04:21:12.684473+0000","last_fullsized":"2024-05-08T04:21:12.684473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:55:41.627503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997406+0000","last_change":"2024-05-08T04:21:09.799377+0000","last_active":"2024-05-08T04:21:11.997406+0000","last_peered":"2024-05-08T04:21:11.997406+0000","last_clean":"2024-05-08T04:21:11.997406+0000","last_became_active":"2024-05-08T04:21:09.799078+0000","last_became_peered":"2024-05-08T04:21:09.799078+0000","last_unstale":"2024-05-08T04:21:11.997406+0000","last_undegraded":"2024-05-08T04:21:11.997406+0000","last_fullsized":"2024-05-08T04:21:11.997406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:28:59.511163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997261+0000","last_change":"2024-05-08T04:21:10.814186+0000","last_active":"2024-05-08T04:21:11.997261+0000","last_peered":"2024-05-08T04:21:11.997261+0000","last_clean":"2024-05-08T04:21:11.997261+0000","last_became_active":"2024-05-08T04:21:10.813837+0000","last_became_peered":"2024-05-08T04:21:10.813837+0000","last_unstale":"2024-05-08T04:21:11.997261+0000","last_undegraded":"2024-05-08T04:21:11.997261+0000","last_fullsized":"2024-05-08T04:21:11.997261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:41:47.087907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806222+0000","last_change":"2024-05-08T04:21:09.809783+0000","last_active":"2024-05-08T04:21:11.806222+0000","last_peered":"2024-05-08T04:21:11.806222+0000","last_clean":"2024-05-08T04:21:11.806222+0000","last_became_active":"2024-05-08T04:21:09.809489+0000","last_became_peered":"2024-05-08T04:21:09.809489+0000","last_unstale":"2024-05-08T04:21:11.806222+0000","last_undegraded":"2024-05-08T04:21:11.806222+0000","last_fullsized":"2024-05-08T04:21:11.806222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797316+0000","last_change":"2024-05-08T04:21:10.802400+0000","last_active":"2024-05-08T04:21:11.797316+0000","last_peered":"2024-05-08T04:21:11.797316+0000","last_clean":"2024-05-08T04:21:11.797316+0000","last_became_active":"2024-05-08T04:21:10.801522+0000","last_became_peered":"2024-05-08T04:21:10.801522+0000","last_unstale":"2024-05-08T04:21:11.797316+0000","last_undegraded":"2024-05-08T04:21:11.797316+0000","last_fullsized":"2024-05-08T04:21:11.797316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:11.466963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803687+0000","last_change":"2024-05-08T04:21:09.795156+0000","last_active":"2024-05-08T04:21:11.803687+0000","last_peered":"2024-05-08T04:21:11.803687+0000","last_clean":"2024-05-08T04:21:11.803687+0000","last_became_active":"2024-05-08T04:21:09.794658+0000","last_became_peered":"2024-05-08T04:21:09.794658+0000","last_unstale":"2024-05-08T04:21:11.803687+0000","last_undegraded":"2024-05-08T04:21:11.803687+0000","last_fullsized":"2024-05-08T04:21:11.803687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997156+0000","last_change":"2024-05-08T04:21:10.810862+0000","last_active":"2024-05-08T04:21:11.997156+0000","last_peered":"2024-05-08T04:21:11.997156+0000","last_clean":"2024-05-08T04:21:11.997156+0000","last_became_active":"2024-05-08T04:21:10.810041+0000","last_became_peered":"2024-05-08T04:21:10.810041+0000","last_unstale":"2024-05-08T04:21:11.997156+0000","last_undegraded":"2024-05-08T04:21:11.997156+0000","last_fullsized":"2024-05-08T04:21:11.997156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:37:37.045065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806759+0000","last_change":"2024-05-08T04:21:09.805736+0000","last_active":"2024-05-08T04:21:11.806759+0000","last_peered":"2024-05-08T04:21:11.806759+0000","last_clean":"2024-05-08T04:21:11.806759+0000","last_became_active":"2024-05-08T04:21:09.805416+0000","last_became_peered":"2024-05-08T04:21:09.805416+0000","last_unstale":"2024-05-08T04:21:11.806759+0000","last_undegraded":"2024-05-08T04:21:11.806759+0000","last_fullsized":"2024-05-08T04:21:11.806759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:52.764630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683920+0000","last_change":"2024-05-08T04:21:10.812910+0000","last_active":"2024-05-08T04:21:12.683920+0000","last_peered":"2024-05-08T04:21:12.683920+0000","last_clean":"2024-05-08T04:21:12.683920+0000","last_became_active":"2024-05-08T04:21:10.812514+0000","last_became_peered":"2024-05-08T04:21:10.812514+0000","last_unstale":"2024-05-08T04:21:12.683920+0000","last_undegraded":"2024-05-08T04:21:12.683920+0000","last_fullsized":"2024-05-08T04:21:12.683920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:53.558867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804208+0000","last_change":"2024-05-08T04:21:09.800590+0000","last_active":"2024-05-08T04:21:11.804208+0000","last_peered":"2024-05-08T04:21:11.804208+0000","last_clean":"2024-05-08T04:21:11.804208+0000","last_became_active":"2024-05-08T04:21:09.800287+0000","last_became_peered":"2024-05-08T04:21:09.800287+0000","last_unstale":"2024-05-08T04:21:11.804208+0000","last_undegraded":"2024-05-08T04:21:11.804208+0000","last_fullsized":"2024-05-08T04:21:11.804208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:13.078999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806581+0000","last_change":"2024-05-08T04:21:10.806772+0000","last_active":"2024-05-08T04:21:11.806581+0000","last_peered":"2024-05-08T04:21:11.806581+0000","last_clean":"2024-05-08T04:21:11.806581+0000","last_became_active":"2024-05-08T04:21:10.806521+0000","last_became_peered":"2024-05-08T04:21:10.806521+0000","last_unstale":"2024-05-08T04:21:11.806581+0000","last_undegraded":"2024-05-08T04:21:11.806581+0000","last_fullsized":"2024-05-08T04:21:11.806581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:01.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799154+0000","last_change":"2024-05-08T04:21:09.799358+0000","last_active":"2024-05-08T04:21:11.799154+0000","last_peered":"2024-05-08T04:21:11.799154+0000","last_clean":"2024-05-08T04:21:11.799154+0000","last_became_active":"2024-05-08T04:21:09.799071+0000","last_became_peered":"2024-05-08T04:21:09.799071+0000","last_unstale":"2024-05-08T04:21:11.799154+0000","last_undegraded":"2024-05-08T04:21:11.799154+0000","last_fullsized":"2024-05-08T04:21:11.799154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806649+0000","last_change":"2024-05-08T04:21:10.808148+0000","last_active":"2024-05-08T04:21:11.806649+0000","last_peered":"2024-05-08T04:21:11.806649+0000","last_clean":"2024-05-08T04:21:11.806649+0000","last_became_active":"2024-05-08T04:21:10.807665+0000","last_became_peered":"2024-05-08T04:21:10.807665+0000","last_unstale":"2024-05-08T04:21:11.806649+0000","last_undegraded":"2024-05-08T04:21:11.806649+0000","last_fullsized":"2024-05-08T04:21:11.806649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684338+0000","last_change":"2024-05-08T04:21:09.808562+0000","last_active":"2024-05-08T04:21:12.684338+0000","last_peered":"2024-05-08T04:21:12.684338+0000","last_clean":"2024-05-08T04:21:12.684338+0000","last_became_active":"2024-05-08T04:21:09.808278+0000","last_became_peered":"2024-05-08T04:21:09.808278+0000","last_unstale":"2024-05-08T04:21:12.684338+0000","last_undegraded":"2024-05-08T04:21:12.684338+0000","last_fullsized":"2024-05-08T04:21:12.684338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:09.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997548+0000","last_change":"2024-05-08T04:21:10.811650+0000","last_active":"2024-05-08T04:21:11.997548+0000","last_peered":"2024-05-08T04:21:11.997548+0000","last_clean":"2024-05-08T04:21:11.997548+0000","last_became_active":"2024-05-08T04:21:10.811088+0000","last_became_peered":"2024-05-08T04:21:10.811088+0000","last_unstale":"2024-05-08T04:21:11.997548+0000","last_undegraded":"2024-05-08T04:21:11.997548+0000","last_fullsized":"2024-05-08T04:21:11.997548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:11:24.741018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797369+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:21:11.797369+0000","last_peered":"2024-05-08T04:21:11.797369+0000","last_clean":"2024-05-08T04:21:11.797369+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:21:11.797369+0000","last_undegraded":"2024-05-08T04:21:11.797369+0000","last_fullsized":"2024-05-08T04:21:11.797369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997368+0000","last_change":"2024-05-08T04:21:09.805253+0000","last_active":"2024-05-08T04:21:11.997368+0000","last_peered":"2024-05-08T04:21:11.997368+0000","last_clean":"2024-05-08T04:21:11.997368+0000","last_became_active":"2024-05-08T04:21:09.805004+0000","last_became_peered":"2024-05-08T04:21:09.805004+0000","last_unstale":"2024-05-08T04:21:11.997368+0000","last_undegraded":"2024-05-08T04:21:11.997368+0000","last_fullsized":"2024-05-08T04:21:11.997368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:52.552788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803933+0000","last_change":"2024-05-08T04:21:10.806073+0000","last_active":"2024-05-08T04:21:11.803933+0000","last_peered":"2024-05-08T04:21:11.803933+0000","last_clean":"2024-05-08T04:21:11.803933+0000","last_became_active":"2024-05-08T04:21:10.805314+0000","last_became_peered":"2024-05-08T04:21:10.805314+0000","last_unstale":"2024-05-08T04:21:11.803933+0000","last_undegraded":"2024-05-08T04:21:11.803933+0000","last_fullsized":"2024-05-08T04:21:11.803933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:29.958463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997207+0000","last_change":"2024-05-08T04:21:09.800131+0000","last_active":"2024-05-08T04:21:11.997207+0000","last_peered":"2024-05-08T04:21:11.997207+0000","last_clean":"2024-05-08T04:21:11.997207+0000","last_became_active":"2024-05-08T04:21:09.799704+0000","last_became_peered":"2024-05-08T04:21:09.799704+0000","last_unstale":"2024-05-08T04:21:11.997207+0000","last_undegraded":"2024-05-08T04:21:11.997207+0000","last_fullsized":"2024-05-08T04:21:11.997207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:52.764630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683807+0000","last_change":"2024-05-08T04:21:10.802802+0000","last_active":"2024-05-08T04:21:12.683807+0000","last_peered":"2024-05-08T04:21:12.683807+0000","last_clean":"2024-05-08T04:21:12.683807+0000","last_became_active":"2024-05-08T04:21:10.802481+0000","last_became_peered":"2024-05-08T04:21:10.802481+0000","last_unstale":"2024-05-08T04:21:12.683807+0000","last_undegraded":"2024-05-08T04:21:12.683807+0000","last_fullsized":"2024-05-08T04:21:12.683807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:02.505469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683669+0000","last_change":"2024-05-08T04:21:09.797811+0000","last_active":"2024-05-08T04:21:12.683669+0000","last_peered":"2024-05-08T04:21:12.683669+0000","last_clean":"2024-05-08T04:21:12.683669+0000","last_became_active":"2024-05-08T04:21:09.797499+0000","last_became_peered":"2024-05-08T04:21:09.797499+0000","last_unstale":"2024-05-08T04:21:12.683669+0000","last_undegraded":"2024-05-08T04:21:12.683669+0000","last_fullsized":"2024-05-08T04:21:12.683669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798975+0000","last_change":"2024-05-08T04:21:10.801647+0000","last_active":"2024-05-08T04:21:11.798975+0000","last_peered":"2024-05-08T04:21:11.798975+0000","last_clean":"2024-05-08T04:21:11.798975+0000","last_became_active":"2024-05-08T04:21:10.800875+0000","last_became_peered":"2024-05-08T04:21:10.800875+0000","last_unstale":"2024-05-08T04:21:11.798975+0000","last_undegraded":"2024-05-08T04:21:11.798975+0000","last_fullsized":"2024-05-08T04:21:11.798975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:33.787458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997455+0000","last_change":"2024-05-08T04:21:09.804263+0000","last_active":"2024-05-08T04:21:11.997455+0000","last_peered":"2024-05-08T04:21:11.997455+0000","last_clean":"2024-05-08T04:21:11.997455+0000","last_became_active":"2024-05-08T04:21:09.804011+0000","last_became_peered":"2024-05-08T04:21:09.804011+0000","last_unstale":"2024-05-08T04:21:11.997455+0000","last_undegraded":"2024-05-08T04:21:11.997455+0000","last_fullsized":"2024-05-08T04:21:11.997455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:01.499390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806394+0000","last_change":"2024-05-08T04:21:10.809139+0000","last_active":"2024-05-08T04:21:11.806394+0000","last_peered":"2024-05-08T04:21:11.806394+0000","last_clean":"2024-05-08T04:21:11.806394+0000","last_became_active":"2024-05-08T04:21:10.808801+0000","last_became_peered":"2024-05-08T04:21:10.808801+0000","last_unstale":"2024-05-08T04:21:11.806394+0000","last_undegraded":"2024-05-08T04:21:11.806394+0000","last_fullsized":"2024-05-08T04:21:11.806394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798765+0000","last_change":"2024-05-08T04:21:09.799028+0000","last_active":"2024-05-08T04:21:11.798765+0000","last_peered":"2024-05-08T04:21:11.798765+0000","last_clean":"2024-05-08T04:21:11.798765+0000","last_became_active":"2024-05-08T04:21:09.798761+0000","last_became_peered":"2024-05-08T04:21:09.798761+0000","last_unstale":"2024-05-08T04:21:11.798765+0000","last_undegraded":"2024-05-08T04:21:11.798765+0000","last_fullsized":"2024-05-08T04:21:11.798765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683765+0000","last_change":"2024-05-08T04:21:10.799702+0000","last_active":"2024-05-08T04:21:12.683765+0000","last_peered":"2024-05-08T04:21:12.683765+0000","last_clean":"2024-05-08T04:21:12.683765+0000","last_became_active":"2024-05-08T04:21:10.799422+0000","last_became_peered":"2024-05-08T04:21:10.799422+0000","last_unstale":"2024-05-08T04:21:12.683765+0000","last_undegraded":"2024-05-08T04:21:12.683765+0000","last_fullsized":"2024-05-08T04:21:12.683765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:35:00.954562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997612+0000","last_change":"2024-05-08T04:21:09.798256+0000","last_active":"2024-05-08T04:21:11.997612+0000","last_peered":"2024-05-08T04:21:11.997612+0000","last_clean":"2024-05-08T04:21:11.997612+0000","last_became_active":"2024-05-08T04:21:09.796157+0000","last_became_peered":"2024-05-08T04:21:09.796157+0000","last_unstale":"2024-05-08T04:21:11.997612+0000","last_undegraded":"2024-05-08T04:21:11.997612+0000","last_fullsized":"2024-05-08T04:21:11.997612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:10.460883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684326+0000","last_change":"2024-05-08T04:21:10.808794+0000","last_active":"2024-05-08T04:21:12.684326+0000","last_peered":"2024-05-08T04:21:12.684326+0000","last_clean":"2024-05-08T04:21:12.684326+0000","last_became_active":"2024-05-08T04:21:10.808339+0000","last_became_peered":"2024-05-08T04:21:10.808339+0000","last_unstale":"2024-05-08T04:21:12.684326+0000","last_undegraded":"2024-05-08T04:21:12.684326+0000","last_fullsized":"2024-05-08T04:21:12.684326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:00.315803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.807697+0000","last_change":"2024-05-08T04:21:09.806917+0000","last_active":"2024-05-08T04:21:11.807697+0000","last_peered":"2024-05-08T04:21:11.807697+0000","last_clean":"2024-05-08T04:21:11.807697+0000","last_became_active":"2024-05-08T04:21:09.806599+0000","last_became_peered":"2024-05-08T04:21:09.806599+0000","last_unstale":"2024-05-08T04:21:11.807697+0000","last_undegraded":"2024-05-08T04:21:11.807697+0000","last_fullsized":"2024-05-08T04:21:11.807697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804308+0000","last_change":"2024-05-08T04:21:10.809200+0000","last_active":"2024-05-08T04:21:11.804308+0000","last_peered":"2024-05-08T04:21:11.804308+0000","last_clean":"2024-05-08T04:21:11.804308+0000","last_became_active":"2024-05-08T04:21:10.808575+0000","last_became_peered":"2024-05-08T04:21:10.808575+0000","last_unstale":"2024-05-08T04:21:11.804308+0000","last_undegraded":"2024-05-08T04:21:11.804308+0000","last_fullsized":"2024-05-08T04:21:11.804308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997710+0000","last_change":"2024-05-08T04:21:09.807154+0000","last_active":"2024-05-08T04:21:11.997710+0000","last_peered":"2024-05-08T04:21:11.997710+0000","last_clean":"2024-05-08T04:21:11.997710+0000","last_became_active":"2024-05-08T04:21:09.806884+0000","last_became_peered":"2024-05-08T04:21:09.806884+0000","last_unstale":"2024-05-08T04:21:11.997710+0000","last_undegraded":"2024-05-08T04:21:11.997710+0000","last_fullsized":"2024-05-08T04:21:11.997710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:00.101724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804179+0000","last_change":"2024-05-08T04:21:10.805880+0000","last_active":"2024-05-08T04:21:11.804179+0000","last_peered":"2024-05-08T04:21:11.804179+0000","last_clean":"2024-05-08T04:21:11.804179+0000","last_became_active":"2024-05-08T04:21:10.805610+0000","last_became_peered":"2024-05-08T04:21:10.805610+0000","last_unstale":"2024-05-08T04:21:11.804179+0000","last_undegraded":"2024-05-08T04:21:11.804179+0000","last_fullsized":"2024-05-08T04:21:11.804179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806080+0000","last_change":"2024-05-08T04:21:09.805802+0000","last_active":"2024-05-08T04:21:11.806080+0000","last_peered":"2024-05-08T04:21:11.806080+0000","last_clean":"2024-05-08T04:21:11.806080+0000","last_became_active":"2024-05-08T04:21:09.805532+0000","last_became_peered":"2024-05-08T04:21:09.805532+0000","last_unstale":"2024-05-08T04:21:11.806080+0000","last_undegraded":"2024-05-08T04:21:11.806080+0000","last_fullsized":"2024-05-08T04:21:11.806080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997242+0000","last_change":"2024-05-08T04:21:10.810731+0000","last_active":"2024-05-08T04:21:11.997242+0000","last_peered":"2024-05-08T04:21:11.997242+0000","last_clean":"2024-05-08T04:21:11.997242+0000","last_became_active":"2024-05-08T04:21:10.810473+0000","last_became_peered":"2024-05-08T04:21:10.810473+0000","last_unstale":"2024-05-08T04:21:11.997242+0000","last_undegraded":"2024-05-08T04:21:11.997242+0000","last_fullsized":"2024-05-08T04:21:11.997242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:22.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803834+0000","last_change":"2024-05-08T04:21:09.808749+0000","last_active":"2024-05-08T04:21:11.803834+0000","last_peered":"2024-05-08T04:21:11.803834+0000","last_clean":"2024-05-08T04:21:11.803834+0000","last_became_active":"2024-05-08T04:21:09.808522+0000","last_became_peered":"2024-05-08T04:21:09.808522+0000","last_unstale":"2024-05-08T04:21:11.803834+0000","last_undegraded":"2024-05-08T04:21:11.803834+0000","last_fullsized":"2024-05-08T04:21:11.803834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803729+0000","last_change":"2024-05-08T04:21:10.803674+0000","last_active":"2024-05-08T04:21:11.803729+0000","last_peered":"2024-05-08T04:21:11.803729+0000","last_clean":"2024-05-08T04:21:11.803729+0000","last_became_active":"2024-05-08T04:21:10.802802+0000","last_became_peered":"2024-05-08T04:21:10.802802+0000","last_unstale":"2024-05-08T04:21:11.803729+0000","last_undegraded":"2024-05-08T04:21:11.803729+0000","last_fullsized":"2024-05-08T04:21:11.803729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:18:33.343054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684231+0000","last_change":"2024-05-08T04:21:09.801923+0000","last_active":"2024-05-08T04:21:12.684231+0000","last_peered":"2024-05-08T04:21:12.684231+0000","last_clean":"2024-05-08T04:21:12.684231+0000","last_became_active":"2024-05-08T04:21:09.801620+0000","last_became_peered":"2024-05-08T04:21:09.801620+0000","last_unstale":"2024-05-08T04:21:12.684231+0000","last_undegraded":"2024-05-08T04:21:12.684231+0000","last_fullsized":"2024-05-08T04:21:12.684231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683884+0000","last_change":"2024-05-08T04:21:10.806239+0000","last_active":"2024-05-08T04:21:12.683884+0000","last_peered":"2024-05-08T04:21:12.683884+0000","last_clean":"2024-05-08T04:21:12.683884+0000","last_became_active":"2024-05-08T04:21:10.805961+0000","last_became_peered":"2024-05-08T04:21:10.805961+0000","last_unstale":"2024-05-08T04:21:12.683884+0000","last_undegraded":"2024-05-08T04:21:12.683884+0000","last_fullsized":"2024-05-08T04:21:12.683884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:53.770709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997335+0000","last_change":"2024-05-08T04:21:09.805477+0000","last_active":"2024-05-08T04:21:11.997335+0000","last_peered":"2024-05-08T04:21:11.997335+0000","last_clean":"2024-05-08T04:21:11.997335+0000","last_became_active":"2024-05-08T04:21:09.805232+0000","last_became_peered":"2024-05-08T04:21:09.805232+0000","last_unstale":"2024-05-08T04:21:11.997335+0000","last_undegraded":"2024-05-08T04:21:11.997335+0000","last_fullsized":"2024-05-08T04:21:11.997335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:33.031084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997271+0000","last_change":"2024-05-08T04:21:10.812788+0000","last_active":"2024-05-08T04:21:11.997271+0000","last_peered":"2024-05-08T04:21:11.997271+0000","last_clean":"2024-05-08T04:21:11.997271+0000","last_became_active":"2024-05-08T04:21:10.812267+0000","last_became_peered":"2024-05-08T04:21:10.812267+0000","last_unstale":"2024-05-08T04:21:11.997271+0000","last_undegraded":"2024-05-08T04:21:11.997271+0000","last_fullsized":"2024-05-08T04:21:11.997271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:56:40.748736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997431+0000","last_change":"2024-05-08T04:21:10.814337+0000","last_active":"2024-05-08T04:21:11.997431+0000","last_peered":"2024-05-08T04:21:11.997431+0000","last_clean":"2024-05-08T04:21:11.997431+0000","last_became_active":"2024-05-08T04:21:10.814087+0000","last_became_peered":"2024-05-08T04:21:10.814087+0000","last_unstale":"2024-05-08T04:21:11.997431+0000","last_undegraded":"2024-05-08T04:21:11.997431+0000","last_fullsized":"2024-05-08T04:21:11.997431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:31.354097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806735+0000","last_change":"2024-05-08T04:21:09.808915+0000","last_active":"2024-05-08T04:21:11.806735+0000","last_peered":"2024-05-08T04:21:11.806735+0000","last_clean":"2024-05-08T04:21:11.806735+0000","last_became_active":"2024-05-08T04:21:09.808528+0000","last_became_peered":"2024-05-08T04:21:09.808528+0000","last_unstale":"2024-05-08T04:21:11.806735+0000","last_undegraded":"2024-05-08T04:21:11.806735+0000","last_fullsized":"2024-05-08T04:21:11.806735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:10.460883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797564+0000","last_change":"2024-05-08T04:21:10.814868+0000","last_active":"2024-05-08T04:21:11.797564+0000","last_peered":"2024-05-08T04:21:11.797564+0000","last_clean":"2024-05-08T04:21:11.797564+0000","last_became_active":"2024-05-08T04:21:10.814012+0000","last_became_peered":"2024-05-08T04:21:10.814012+0000","last_unstale":"2024-05-08T04:21:11.797564+0000","last_undegraded":"2024-05-08T04:21:11.797564+0000","last_fullsized":"2024-05-08T04:21:11.797564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:02.505469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806577+0000","last_change":"2024-05-08T04:21:09.806371+0000","last_active":"2024-05-08T04:21:11.806577+0000","last_peered":"2024-05-08T04:21:11.806577+0000","last_clean":"2024-05-08T04:21:11.806577+0000","last_became_active":"2024-05-08T04:21:09.806120+0000","last_became_peered":"2024-05-08T04:21:09.806120+0000","last_unstale":"2024-05-08T04:21:11.806577+0000","last_undegraded":"2024-05-08T04:21:11.806577+0000","last_fullsized":"2024-05-08T04:21:11.806577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799202+0000","last_change":"2024-05-08T04:21:10.799276+0000","last_active":"2024-05-08T04:21:11.799202+0000","last_peered":"2024-05-08T04:21:11.799202+0000","last_clean":"2024-05-08T04:21:11.799202+0000","last_became_active":"2024-05-08T04:21:10.798986+0000","last_became_peered":"2024-05-08T04:21:10.798986+0000","last_unstale":"2024-05-08T04:21:11.799202+0000","last_undegraded":"2024-05-08T04:21:11.799202+0000","last_fullsized":"2024-05-08T04:21:11.799202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:39.936653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799414+0000","last_change":"2024-05-08T04:21:09.795113+0000","last_active":"2024-05-08T04:21:11.799414+0000","last_peered":"2024-05-08T04:21:11.799414+0000","last_clean":"2024-05-08T04:21:11.799414+0000","last_became_active":"2024-05-08T04:21:09.794565+0000","last_became_peered":"2024-05-08T04:21:09.794565+0000","last_unstale":"2024-05-08T04:21:11.799414+0000","last_undegraded":"2024-05-08T04:21:11.799414+0000","last_fullsized":"2024-05-08T04:21:11.799414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799323+0000","last_change":"2024-05-08T04:21:10.794958+0000","last_active":"2024-05-08T04:21:11.799323+0000","last_peered":"2024-05-08T04:21:11.799323+0000","last_clean":"2024-05-08T04:21:11.799323+0000","last_became_active":"2024-05-08T04:21:10.794649+0000","last_became_peered":"2024-05-08T04:21:10.794649+0000","last_unstale":"2024-05-08T04:21:11.799323+0000","last_undegraded":"2024-05-08T04:21:11.799323+0000","last_fullsized":"2024-05-08T04:21:11.799323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:36.487747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804255+0000","last_change":"2024-05-08T04:21:09.802589+0000","last_active":"2024-05-08T04:21:11.804255+0000","last_peered":"2024-05-08T04:21:11.804255+0000","last_clean":"2024-05-08T04:21:11.804255+0000","last_became_active":"2024-05-08T04:21:09.802292+0000","last_became_peered":"2024-05-08T04:21:09.802292+0000","last_unstale":"2024-05-08T04:21:11.804255+0000","last_undegraded":"2024-05-08T04:21:11.804255+0000","last_fullsized":"2024-05-08T04:21:11.804255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":661394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":73218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":70990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:21:18.885 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-08T04:21:18.885 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T04:21:18.885 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T04:21:18.885 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T04:21:18.886 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T04:21:19.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.019+0000 7f5949fc1640 1 Processor -- start 2024-05-08T04:21:19.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.019+0000 7f5949fc1640 1 -- start start 2024-05-08T04:21:19.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.020+0000 7f5949fc1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f594415b650 0x7f594406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.020+0000 7f5949fc1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f594415ffd0 0x7f594406b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.020+0000 7f5949fc1640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59440cdd00 con 0x7f594415ba30 2024-05-08T04:21:19.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.020+0000 7f5949fc1640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59440cb0b0 con 0x7f594415ffd0 2024-05-08T04:21:19.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.020+0000 7f5949fc1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f594415f4f0 con 0x7f594415b650 2024-05-08T04:21:19.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.020+0000 7f5942ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f594415ba30 0x7f59440cd020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53110/0 (socket says 172.21.15.104:53110) 2024-05-08T04:21:19.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.020+0000 7f5942ffd640 1 -- 172.21.15.104:0/321720903 learned_addr learned my addr 172.21.15.104:0/321720903 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:19.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638262213 0 0) 0x7f59440cdd00 con 0x7f594415ba30 2024-05-08T04:21:19.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f592c003520 con 0x7f594415ba30 2024-05-08T04:21:19.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59437fe640 1 --2- 172.21.15.104:0/321720903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f594415b650 0x7f594406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f5943fff640 1 --2- 172.21.15.104:0/321720903 >> v2:172.21.15.183:3300/0 conn(0x7f594415ffd0 0x7f594406b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2669777022 0 0) 0x7f592c003520 con 0x7f594415ba30 2024-05-08T04:21:19.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f594415b650 msgr2=0x7f594406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 --2- 172.21.15.104:0/321720903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f594415b650 0x7f594406ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 >> v2:172.21.15.183:3300/0 conn(0x7f594415ffd0 msgr2=0x7f594406b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 --2- 172.21.15.104:0/321720903 >> v2:172.21.15.183:3300/0 conn(0x7f594415ffd0 0x7f594406b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594415f7d0 con 0x7f594415ba30 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f5938001670 con 0x7f594415ba30 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59437fe640 1 --2- 172.21.15.104:0/321720903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f594415b650 0x7f594406ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 >> v1:172.21.15.104:6789/0 conn(0x7f594415ba30 legacy=0x7f59440cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 --2- 172.21.15.104:0/321720903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f592c0039b0 0x7f592c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 --2- 172.21.15.104:0/321720903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c004800 0x7f592c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 --2- 172.21.15.104:0/321720903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f594415b650 0x7f592c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594415f4f0 con 0x7f592c004800 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c00ba70 con 0x7f592c0039b0 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c00bc70 con 0x7f594415b650 2024-05-08T04:21:19.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f5942ffd640 1 --2- 172.21.15.104:0/321720903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c004800 0x7f592c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f59437fe640 1 --2- 172.21.15.104:0/321720903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f592c0039b0 0x7f592c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f5943fff640 1 --2- 172.21.15.104:0/321720903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f594415b650 0x7f592c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f5942ffd640 1 -- 172.21.15.104:0/321720903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f594415b650 msgr2=0x7f592c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f5942ffd640 1 --2- 172.21.15.104:0/321720903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f594415b650 0x7f592c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f5942ffd640 1 -- 172.21.15.104:0/321720903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f592c0039b0 msgr2=0x7f592c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f5942ffd640 1 --2- 172.21.15.104:0/321720903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f592c0039b0 0x7f592c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.021+0000 7f5942ffd640 1 -- 172.21.15.104:0/321720903 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c003520 con 0x7f592c004800 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.022+0000 7f5942ffd640 1 --2- 172.21.15.104:0/321720903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c004800 0x7f592c004c80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f594415be10 tx=0x7f592c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5a4c489b23d94d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.022+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938007d50 con 0x7f592c004800 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.022+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5938005af0 con 0x7f592c004800 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.022+0000 7f59427fc640 1 -- 172.21.15.104:0/321720903 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938007070 con 0x7f592c004800 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.023+0000 7f5949fc1640 1 -- 172.21.15.104:0/321720903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c004800 msgr2=0x7f592c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.023+0000 7f5949fc1640 1 --2- 172.21.15.104:0/321720903 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c004800 0x7f592c004c80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f594415be10 tx=0x7f592c005830 comp rx=0 tx=0).stop 2024-05-08T04:21:19.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.023+0000 7f5943fff640 1 -- 172.21.15.104:0/321720903 reap_dead start 2024-05-08T04:21:19.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.023+0000 7f5949fc1640 1 -- 172.21.15.104:0/321720903 shutdown_connections 2024-05-08T04:21:19.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.023+0000 7f5949fc1640 1 -- 172.21.15.104:0/321720903 >> 172.21.15.104:0/321720903 conn(0x7f59440b23e0 msgr2=0x7f59440b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:19.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.023+0000 7f5949fc1640 1 -- 172.21.15.104:0/321720903 shutdown_connections 2024-05-08T04:21:19.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.023+0000 7f5949fc1640 1 -- 172.21.15.104:0/321720903 wait complete. 2024-05-08T04:21:19.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.024+0000 7f5949fc1640 1 Processor -- start 2024-05-08T04:21:19.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.024+0000 7f5949fc1640 1 -- start start 2024-05-08T04:21:19.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5949fc1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f592c004800 0x7f59441f2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5949fc1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5944152540 0x7f59441f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5949fc1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59441529a0 0x7f59441f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5949fc1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59440cd8b0 con 0x7f5944152540 2024-05-08T04:21:19.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5949fc1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59440cd730 con 0x7f59441529a0 2024-05-08T04:21:19.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5949fc1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59440cda30 con 0x7f592c004800 2024-05-08T04:21:19.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5942ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5944152540 0x7f59441f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5942ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5944152540 0x7f59441f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33754/0 (socket says 172.21.15.104:33754) 2024-05-08T04:21:19.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5942ffd640 1 -- 172.21.15.104:0/26067909 learned_addr learned my addr 172.21.15.104:0/26067909 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:19.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5942ffd640 1 -- 172.21.15.104:0/26067909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f592c004800 msgr2=0x7f59441f2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f59437fe640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f592c004800 0x7f59441f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5943fff640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59441529a0 0x7f59441f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5942ffd640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f592c004800 0x7f59441f2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5942ffd640 1 -- 172.21.15.104:0/26067909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59441529a0 msgr2=0x7f59441f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5942ffd640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59441529a0 0x7f59441f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5942ffd640 1 -- 172.21.15.104:0/26067909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59441f16b0 con 0x7f5944152540 2024-05-08T04:21:19.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5943fff640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59441529a0 0x7f59441f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:19.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f59437fe640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f592c004800 0x7f59441f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:19.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.025+0000 7f5942ffd640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5944152540 0x7f59441f4b90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f593800c350 tx=0x7f594415f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:19.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.026+0000 7f592bfff640 1 -- 172.21.15.104:0/26067909 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938041020 con 0x7f5944152540 2024-05-08T04:21:19.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.026+0000 7f592bfff640 1 -- 172.21.15.104:0/26067909 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5938001430 con 0x7f5944152540 2024-05-08T04:21:19.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.026+0000 7f592bfff640 1 -- 172.21.15.104:0/26067909 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938007070 con 0x7f5944152540 2024-05-08T04:21:19.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.026+0000 7f5949fc1640 1 -- 172.21.15.104:0/26067909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59441f5730 con 0x7f5944152540 2024-05-08T04:21:19.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.026+0000 7f5949fc1640 1 -- 172.21.15.104:0/26067909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59441f1c00 con 0x7f5944152540 2024-05-08T04:21:19.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.027+0000 7f5949fc1640 1 -- 172.21.15.104:0/26067909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5944075010 con 0x7f5944152540 2024-05-08T04:21:19.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.027+0000 7f592bfff640 1 -- 172.21.15.104:0/26067909 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5938044020 con 0x7f5944152540 2024-05-08T04:21:19.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.028+0000 7f592bfff640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f593006b4d0 0x7f593006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.028+0000 7f59437fe640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f593006b4d0 0x7f593006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.028+0000 7f592bfff640 1 -- 172.21.15.104:0/26067909 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59380aa4b0 con 0x7f5944152540 2024-05-08T04:21:19.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.028+0000 7f59437fe640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f593006b4d0 0x7f593006d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5934007300 tx=0x7f593400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:19.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.032+0000 7f592bfff640 1 -- 172.21.15.104:0/26067909 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f59380794e0 con 0x7f5944152540 2024-05-08T04:21:19.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.251+0000 7f5949fc1640 1 -- 172.21.15.104:0/26067909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f5944070330 con 0x7f5944152540 2024-05-08T04:21:19.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.254+0000 7f592bfff640 1 -- 172.21.15.104:0/26067909 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171791 (secure 0 0 0) 0x7f5938078de0 con 0x7f5944152540 2024-05-08T04:21:19.257 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.257+0000 7f5949fc1640 1 -- 172.21.15.104:0/26067909 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f593006b4d0 msgr2=0x7f593006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.257+0000 7f5949fc1640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f593006b4d0 0x7f593006d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5934007300 tx=0x7f593400b040 comp rx=0 tx=0).stop 2024-05-08T04:21:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.257+0000 7f5949fc1640 1 -- 172.21.15.104:0/26067909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5944152540 msgr2=0x7f59441f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.257+0000 7f5949fc1640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5944152540 0x7f59441f4b90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f593800c350 tx=0x7f594415f9a0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.257+0000 7f5949fc1640 1 -- 172.21.15.104:0/26067909 shutdown_connections 2024-05-08T04:21:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.257+0000 7f5949fc1640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f593006b4d0 0x7f593006d990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.257+0000 7f5949fc1640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59441529a0 0x7f59441f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.257+0000 7f5949fc1640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5944152540 0x7f59441f4b90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.257+0000 7f5949fc1640 1 --2- 172.21.15.104:0/26067909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f592c004800 0x7f59441f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.257+0000 7f5949fc1640 1 -- 172.21.15.104:0/26067909 >> 172.21.15.104:0/26067909 conn(0x7f59440b23e0 msgr2=0x7f59441562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:19.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.257+0000 7f5949fc1640 1 -- 172.21.15.104:0/26067909 shutdown_connections 2024-05-08T04:21:19.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.257+0000 7f5949fc1640 1 -- 172.21.15.104:0/26067909 wait complete. 2024-05-08T04:21:19.269 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2468818054},{"type":"v1","addr":"172.21.15.104:6833","nonce":2468818054}]},"active_addr":"172.21.15.104:6833/2468818054","active_change":"2024-05-08T04:20:50.629243+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":2045316666}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":495018202}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":3506235940}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.104:0","nonce":2133224421}]}]} 2024-05-08T04:21:19.272 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T04:21:19.272 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T04:21:19.272 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:19.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.370+0000 7f489f49e640 1 Processor -- start 2024-05-08T04:21:19.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.370+0000 7f489f49e640 1 -- start start 2024-05-08T04:21:19.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.371+0000 7f489f49e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f489815dad0 0x7f48980d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.371+0000 7f489f49e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48980d35c0 0x7f48980b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.371+0000 7f489f49e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f48980d1fa0 0x7f48980b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.371+0000 7f489f49e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48980b9920 con 0x7f489815dad0 2024-05-08T04:21:19.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.371+0000 7f489f49e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48980d2520 con 0x7f48980d1fa0 2024-05-08T04:21:19.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.371+0000 7f489f49e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48980d2800 con 0x7f48980d35c0 2024-05-08T04:21:19.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.371+0000 7f489d23a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f489815dad0 0x7f48980d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.371+0000 7f489d23a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f489815dad0 0x7f48980d1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33764/0 (socket says 172.21.15.104:33764) 2024-05-08T04:21:19.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.371+0000 7f489d23a640 1 -- 172.21.15.104:0/1353542355 learned_addr learned my addr 172.21.15.104:0/1353542355 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:19.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.371+0000 7f489ca39640 1 --2- 172.21.15.104:0/1353542355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48980d35c0 0x7f48980b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.371+0000 7f489da3b640 1 --2- 172.21.15.104:0/1353542355 >> v2:172.21.15.183:3300/0 conn(0x7f48980d1fa0 0x7f48980b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.372+0000 7f489d23a640 1 -- 172.21.15.104:0/1353542355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48980d35c0 msgr2=0x7f48980b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:19.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.372+0000 7f489d23a640 1 --2- 172.21.15.104:0/1353542355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48980d35c0 0x7f48980b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.372+0000 7f489d23a640 1 -- 172.21.15.104:0/1353542355 >> v2:172.21.15.183:3300/0 conn(0x7f48980d1fa0 msgr2=0x7f48980b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:19.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.372+0000 7f489d23a640 1 --2- 172.21.15.104:0/1353542355 >> v2:172.21.15.183:3300/0 conn(0x7f48980d1fa0 0x7f48980b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.372+0000 7f489d23a640 1 -- 172.21.15.104:0/1353542355 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48980d2ae0 con 0x7f489815dad0 2024-05-08T04:21:19.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.372+0000 7f489da3b640 1 --2- 172.21.15.104:0/1353542355 >> v2:172.21.15.183:3300/0 conn(0x7f48980d1fa0 0x7f48980b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:19.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.372+0000 7f489d23a640 1 --2- 172.21.15.104:0/1353542355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f489815dad0 0x7f48980d1a60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48980cdfe0 tx=0x7f489402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c64031b028067a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:19.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.372+0000 7f488ffff640 1 -- 172.21.15.104:0/1353542355 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894037070 con 0x7f489815dad0 2024-05-08T04:21:19.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.372+0000 7f488ffff640 1 -- 172.21.15.104:0/1353542355 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4894032440 con 0x7f489815dad0 2024-05-08T04:21:19.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.372+0000 7f488ffff640 1 -- 172.21.15.104:0/1353542355 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894032810 con 0x7f489815dad0 2024-05-08T04:21:19.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.373+0000 7f489f49e640 1 -- 172.21.15.104:0/1353542355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f489815dad0 msgr2=0x7f48980d1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.373+0000 7f489f49e640 1 --2- 172.21.15.104:0/1353542355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f489815dad0 0x7f48980d1a60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f48980cdfe0 tx=0x7f489402a1e0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.373+0000 7f489f49e640 1 -- 172.21.15.104:0/1353542355 shutdown_connections 2024-05-08T04:21:19.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.373+0000 7f489f49e640 1 --2- 172.21.15.104:0/1353542355 >> v2:172.21.15.183:3300/0 conn(0x7f48980d1fa0 0x7f48980b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.373+0000 7f489f49e640 1 --2- 172.21.15.104:0/1353542355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48980d35c0 0x7f48980b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.373+0000 7f489f49e640 1 --2- 172.21.15.104:0/1353542355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f489815dad0 0x7f48980d1a60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.373+0000 7f489f49e640 1 -- 172.21.15.104:0/1353542355 >> 172.21.15.104:0/1353542355 conn(0x7f489806c650 msgr2=0x7f48980d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:19.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.373+0000 7f489f49e640 1 -- 172.21.15.104:0/1353542355 shutdown_connections 2024-05-08T04:21:19.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.373+0000 7f489f49e640 1 -- 172.21.15.104:0/1353542355 wait complete. 2024-05-08T04:21:19.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.374+0000 7f489f49e640 1 Processor -- start 2024-05-08T04:21:19.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.374+0000 7f489f49e640 1 -- start start 2024-05-08T04:21:19.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489f49e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48980d1fa0 0x7f48981577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489f49e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48980d35c0 0x7f4898153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489f49e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f489815dad0 0x7f48980cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489f49e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489815deb0 con 0x7f48980d35c0 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489f49e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48980d30a0 con 0x7f489815dad0 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489f49e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489815e030 con 0x7f48980d1fa0 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489ca39640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48980d35c0 0x7f4898153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489ca39640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48980d35c0 0x7f4898153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33772/0 (socket says 172.21.15.104:33772) 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489ca39640 1 -- 172.21.15.104:0/1499686239 learned_addr learned my addr 172.21.15.104:0/1499686239 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489ca39640 1 -- 172.21.15.104:0/1499686239 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48980d1fa0 msgr2=0x7f48981577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489ca39640 1 --2- 172.21.15.104:0/1499686239 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48980d1fa0 0x7f48981577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489ca39640 1 -- 172.21.15.104:0/1499686239 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f489815dad0 msgr2=0x7f48980cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489ca39640 1 --2- 172.21.15.104:0/1499686239 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f489815dad0 0x7f48980cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489ca39640 1 -- 172.21.15.104:0/1499686239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48981544e0 con 0x7f48980d35c0 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f489ca39640 1 --2- 172.21.15.104:0/1499686239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48980d35c0 0x7f4898153fa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f488800d800 tx=0x7f488800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:19.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.375+0000 7f488dffb640 1 -- 172.21.15.104:0/1499686239 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488800b6c0 con 0x7f48980d35c0 2024-05-08T04:21:19.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.376+0000 7f488dffb640 1 -- 172.21.15.104:0/1499686239 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4888019070 con 0x7f48980d35c0 2024-05-08T04:21:19.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.376+0000 7f489f49e640 1 -- 172.21.15.104:0/1499686239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48981606c0 con 0x7f48980d35c0 2024-05-08T04:21:19.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.376+0000 7f488dffb640 1 -- 172.21.15.104:0/1499686239 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488800ba80 con 0x7f48980d35c0 2024-05-08T04:21:19.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.376+0000 7f489f49e640 1 -- 172.21.15.104:0/1499686239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4898160c80 con 0x7f48980d35c0 2024-05-08T04:21:19.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.377+0000 7f489f49e640 1 -- 172.21.15.104:0/1499686239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4898075010 con 0x7f48980d35c0 2024-05-08T04:21:19.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.377+0000 7f488dffb640 1 -- 172.21.15.104:0/1499686239 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f488800bc20 con 0x7f48980d35c0 2024-05-08T04:21:19.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.378+0000 7f488dffb640 1 --2- 172.21.15.104:0/1499686239 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f487c06b4d0 0x7f487c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.378+0000 7f488dffb640 1 -- 172.21.15.104:0/1499686239 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f488808a6b0 con 0x7f48980d35c0 2024-05-08T04:21:19.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.378+0000 7f489d23a640 1 --2- 172.21.15.104:0/1499686239 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f487c06b4d0 0x7f487c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.378+0000 7f489d23a640 1 --2- 172.21.15.104:0/1499686239 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f487c06b4d0 0x7f487c06d990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4894034000 tx=0x7f489402c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:19.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.382+0000 7f488dffb640 1 -- 172.21.15.104:0/1499686239 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f48981544e0 con 0x7f48980d35c0 2024-05-08T04:21:19.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.552+0000 7f489f49e640 1 -- 172.21.15.104:0/1499686239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f489815cf70 con 0x7f48980d35c0 2024-05-08T04:21:19.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.553+0000 7f488dffb640 1 -- 172.21.15.104:0/1499686239 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f4888059530 con 0x7f48980d35c0 2024-05-08T04:21:19.555 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:19.555 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.555+0000 7f489f49e640 1 -- 172.21.15.104:0/1499686239 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f487c06b4d0 msgr2=0x7f487c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.555+0000 7f489f49e640 1 --2- 172.21.15.104:0/1499686239 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f487c06b4d0 0x7f487c06d990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4894034000 tx=0x7f489402c000 comp rx=0 tx=0).stop 2024-05-08T04:21:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.555+0000 7f489f49e640 1 -- 172.21.15.104:0/1499686239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48980d35c0 msgr2=0x7f4898153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.555+0000 7f489f49e640 1 --2- 172.21.15.104:0/1499686239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48980d35c0 0x7f4898153fa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f488800d800 tx=0x7f488800dcc0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.556+0000 7f489f49e640 1 -- 172.21.15.104:0/1499686239 shutdown_connections 2024-05-08T04:21:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.556+0000 7f489f49e640 1 --2- 172.21.15.104:0/1499686239 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f487c06b4d0 0x7f487c06d990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.556+0000 7f489f49e640 1 --2- 172.21.15.104:0/1499686239 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f489815dad0 0x7f48980cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.556+0000 7f489f49e640 1 --2- 172.21.15.104:0/1499686239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48980d35c0 0x7f4898153fa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.556+0000 7f489f49e640 1 --2- 172.21.15.104:0/1499686239 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48980d1fa0 0x7f48981577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.556+0000 7f489f49e640 1 -- 172.21.15.104:0/1499686239 >> 172.21.15.104:0/1499686239 conn(0x7f489806c650 msgr2=0x7f48980d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.556+0000 7f489f49e640 1 -- 172.21.15.104:0/1499686239 shutdown_connections 2024-05-08T04:21:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.556+0000 7f489f49e640 1 -- 172.21.15.104:0/1499686239 wait complete. 2024-05-08T04:21:19.568 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T04:21:19.568 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:19.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.666+0000 7f64c0d22640 1 Processor -- start 2024-05-08T04:21:19.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.666+0000 7f64c0d22640 1 -- start start 2024-05-08T04:21:19.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.667+0000 7f64c0d22640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f64bc15db30 0x7f64bc06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.667+0000 7f64c0d22640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc0b93b0 0x7f64bc0b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.667+0000 7f64c0d22640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64bc0b6b50 con 0x7f64bc0b5970 2024-05-08T04:21:19.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.667+0000 7f64c0d22640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64bc06c800 con 0x7f64bc15db30 2024-05-08T04:21:19.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.667+0000 7f64c0d22640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc06cae0 con 0x7f64bc0b93b0 2024-05-08T04:21:19.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.667+0000 7f64ba59c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f64bc15db30 0x7f64bc06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.667+0000 7f64bad9d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f64bc0b5970 0x7f64bc161720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53116/0 (socket says 172.21.15.104:53116) 2024-05-08T04:21:19.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.667+0000 7f64bad9d640 1 -- 172.21.15.104:0/3631548013 learned_addr learned my addr 172.21.15.104:0/3631548013 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:19.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.667+0000 7f64b9d9b640 1 --2- 172.21.15.104:0/3631548013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc0b93b0 0x7f64bc0b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.667+0000 7f64ba59c640 1 -- 172.21.15.104:0/3631548013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc0b93b0 msgr2=0x7f64bc0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:19.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.668+0000 7f64ba59c640 1 --2- 172.21.15.104:0/3631548013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc0b93b0 0x7f64bc0b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.668+0000 7f64ba59c640 1 -- 172.21.15.104:0/3631548013 >> v1:172.21.15.104:6789/0 conn(0x7f64bc0b5970 legacy=0x7f64bc161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.668+0000 7f64ba59c640 1 -- 172.21.15.104:0/3631548013 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc06cdc0 con 0x7f64bc15db30 2024-05-08T04:21:19.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.668+0000 7f64b959a640 1 -- 172.21.15.104:0/3631548013 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351508510 0 0) 0x7f64b4001490 con 0x7f64bc0b5970 2024-05-08T04:21:19.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.668+0000 7f64ba59c640 1 --2- 172.21.15.104:0/3631548013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc15db30 0x7f64bc06bfb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0097a0 tx=0x7f64ac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fb130d0b5509e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:19.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.668+0000 7f64b959a640 1 -- 172.21.15.104:0/3631548013 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac037070 con 0x7f64bc15db30 2024-05-08T04:21:19.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.668+0000 7f64b959a640 1 -- 172.21.15.104:0/3631548013 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac032440 con 0x7f64bc15db30 2024-05-08T04:21:19.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.668+0000 7f64b959a640 1 -- 172.21.15.104:0/3631548013 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac032810 con 0x7f64bc15db30 2024-05-08T04:21:19.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.669+0000 7f64c0d22640 1 -- 172.21.15.104:0/3631548013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc15db30 msgr2=0x7f64bc06bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.669+0000 7f64c0d22640 1 --2- 172.21.15.104:0/3631548013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc15db30 0x7f64bc06bfb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0097a0 tx=0x7f64ac02a180 comp rx=0 tx=0).stop 2024-05-08T04:21:19.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.669+0000 7f64c0d22640 1 -- 172.21.15.104:0/3631548013 shutdown_connections 2024-05-08T04:21:19.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.669+0000 7f64c0d22640 1 --2- 172.21.15.104:0/3631548013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc0b93b0 0x7f64bc0b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.669+0000 7f64c0d22640 1 --2- 172.21.15.104:0/3631548013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc15db30 0x7f64bc06bfb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.669+0000 7f64c0d22640 1 -- 172.21.15.104:0/3631548013 >> 172.21.15.104:0/3631548013 conn(0x7f64bc0d0430 msgr2=0x7f64bc0d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:19.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.669+0000 7f64c0d22640 1 -- 172.21.15.104:0/3631548013 shutdown_connections 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.669+0000 7f64c0d22640 1 -- 172.21.15.104:0/3631548013 wait complete. 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.670+0000 7f64c0d22640 1 Processor -- start 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.670+0000 7f64c0d22640 1 -- start start 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64c0d22640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64bc0b5970 0x7f64bc1562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64c0d22640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc0b93b0 0x7f64bc14a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64c0d22640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc15db30 0x7f64bc159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64c0d22640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc15df10 con 0x7f64bc0b93b0 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64c0d22640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc06c4f0 con 0x7f64bc0b5970 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64c0d22640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc156820 con 0x7f64bc15db30 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64b9d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc0b93b0 0x7f64bc14a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64b9d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc0b93b0 0x7f64bc14a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33792/0 (socket says 172.21.15.104:33792) 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64b9d9b640 1 -- 172.21.15.104:0/2497054800 learned_addr learned my addr 172.21.15.104:0/2497054800 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64ba59c640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64bc0b5970 0x7f64bc1562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64bad9d640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc15db30 0x7f64bc159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64b9d9b640 1 -- 172.21.15.104:0/2497054800 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc15db30 msgr2=0x7f64bc159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64b9d9b640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc15db30 0x7f64bc159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64b9d9b640 1 -- 172.21.15.104:0/2497054800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64bc0b5970 msgr2=0x7f64bc1562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64b9d9b640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64bc0b5970 0x7f64bc1562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.671+0000 7f64b9d9b640 1 -- 172.21.15.104:0/2497054800 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc156ad0 con 0x7f64bc0b93b0 2024-05-08T04:21:19.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.672+0000 7f64b9d9b640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc0b93b0 0x7f64bc14a9b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f64b000d830 tx=0x7f64b000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:19.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.672+0000 7f64aaffd640 1 -- 172.21.15.104:0/2497054800 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b000b6c0 con 0x7f64bc0b93b0 2024-05-08T04:21:19.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.672+0000 7f64aaffd640 1 -- 172.21.15.104:0/2497054800 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b0019070 con 0x7f64bc0b93b0 2024-05-08T04:21:19.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.672+0000 7f64c0d22640 1 -- 172.21.15.104:0/2497054800 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64bc156db0 con 0x7f64bc0b93b0 2024-05-08T04:21:19.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.672+0000 7f64aaffd640 1 -- 172.21.15.104:0/2497054800 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b000ba80 con 0x7f64bc0b93b0 2024-05-08T04:21:19.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.672+0000 7f64c0d22640 1 -- 172.21.15.104:0/2497054800 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64bc157650 con 0x7f64bc0b93b0 2024-05-08T04:21:19.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.673+0000 7f64c0d22640 1 -- 172.21.15.104:0/2497054800 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64bc075010 con 0x7f64bc0b93b0 2024-05-08T04:21:19.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.673+0000 7f64aaffd640 1 -- 172.21.15.104:0/2497054800 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f64b000bc20 con 0x7f64bc0b93b0 2024-05-08T04:21:19.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.674+0000 7f64aaffd640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f649c06b4d0 0x7f649c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:19.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.674+0000 7f64ba59c640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f649c06b4d0 0x7f649c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:19.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.674+0000 7f64aaffd640 1 -- 172.21.15.104:0/2497054800 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64b008a770 con 0x7f64bc0b93b0 2024-05-08T04:21:19.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.674+0000 7f64ba59c640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f649c06b4d0 0x7f649c06d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64ac034000 tx=0x7f64ac02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:19.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.678+0000 7f64aaffd640 1 -- 172.21.15.104:0/2497054800 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f64b001c360 con 0x7f64bc0b93b0 2024-05-08T04:21:19.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.848+0000 7f64c0d22640 1 -- 172.21.15.104:0/2497054800 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64bc0b6d30 con 0x7f64bc0b93b0 2024-05-08T04:21:19.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.849+0000 7f64aaffd640 1 -- 172.21.15.104:0/2497054800 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f64b0059560 con 0x7f64bc0b93b0 2024-05-08T04:21:19.850 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:19.850 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:19.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.851+0000 7f64c0d22640 1 -- 172.21.15.104:0/2497054800 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f649c06b4d0 msgr2=0x7f649c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.851+0000 7f64c0d22640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f649c06b4d0 0x7f649c06d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64ac034000 tx=0x7f64ac02e000 comp rx=0 tx=0).stop 2024-05-08T04:21:19.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.851+0000 7f64c0d22640 1 -- 172.21.15.104:0/2497054800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc0b93b0 msgr2=0x7f64bc14a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:19.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.851+0000 7f64c0d22640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc0b93b0 0x7f64bc14a9b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f64b000d830 tx=0x7f64b000dcf0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.851+0000 7f64c0d22640 1 -- 172.21.15.104:0/2497054800 shutdown_connections 2024-05-08T04:21:19.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.851+0000 7f64c0d22640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f649c06b4d0 0x7f649c06d990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.851+0000 7f64c0d22640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc15db30 0x7f64bc159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.851+0000 7f64c0d22640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64bc0b93b0 0x7f64bc14a9b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.851+0000 7f64c0d22640 1 --2- 172.21.15.104:0/2497054800 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64bc0b5970 0x7f64bc1562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:19.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.851+0000 7f64c0d22640 1 -- 172.21.15.104:0/2497054800 >> 172.21.15.104:0/2497054800 conn(0x7f64bc0d0430 msgr2=0x7f64bc0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:19.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.851+0000 7f64c0d22640 1 -- 172.21.15.104:0/2497054800 shutdown_connections 2024-05-08T04:21:19.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:19.851+0000 7f64c0d22640 1 -- 172.21.15.104:0/2497054800 wait complete. 2024-05-08T04:21:19.863 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T04:21:19.864 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T04:21:19.864 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T04:21:19.864 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T04:21:19.865 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-08T04:21:19.865 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-08T04:21:19.866 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-08T04:21:19.866 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-08T04:21:20.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.033+0000 7f56ace1f640 1 Processor -- start 2024-05-08T04:21:20.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.033+0000 7f56ace1f640 1 -- start start 2024-05-08T04:21:20.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.035+0000 7f56ace1f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56a00df130 0x7f56a004fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.035+0000 7f56ace1f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f56a000aad0 0x7f56a00df510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.035+0000 7f56ace1f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a00e5e30 con 0x7f56a0054690 2024-05-08T04:21:20.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.035+0000 7f56ace1f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a0053310 con 0x7f56a000aad0 2024-05-08T04:21:20.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.035+0000 7f56ace1f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00535f0 con 0x7f56a00df130 2024-05-08T04:21:20.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.034+0000 7fe9684fc640 1 Processor -- start 2024-05-08T04:21:20.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.034+0000 7fe9684fc640 1 -- start start 2024-05-08T04:21:20.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.035+0000 7f49aaa51640 1 Processor -- start 2024-05-08T04:21:20.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.035+0000 7f56a6d9d640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f56a0054690 0x7f56a00dfa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:35090/0 (socket says 172.21.15.104:35090) 2024-05-08T04:21:20.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.035+0000 7f56a6d9d640 1 -- 172.21.15.104:0/4294550207 learned_addr learned my addr 172.21.15.104:0/4294550207 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:20.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773208160 0 0) 0x7f56a00e5e30 con 0x7f56a0054690 2024-05-08T04:21:20.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5690003520 con 0x7f56a0054690 2024-05-08T04:21:20.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a659c640 1 --2- 172.21.15.104:0/4294550207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56a00df130 0x7f56a004fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7fe9684fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe9580eacf0 0x7fe95804fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7fe9684fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe95804ffc0 0x7fe958037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f49aaa51640 1 -- start start 2024-05-08T04:21:20.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7fe9684fc640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe958053710 con 0x7fe958038100 2024-05-08T04:21:20.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7fe9684fc640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe958054320 con 0x7fe9580eacf0 2024-05-08T04:21:20.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7fe9684fc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580539f0 con 0x7fe95804ffc0 2024-05-08T04:21:20.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 402322477 0 0) 0x7f5690003520 con 0x7f56a0054690 2024-05-08T04:21:20.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56a00df130 msgr2=0x7f56a004fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 --2- 172.21.15.104:0/4294550207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56a00df130 0x7f56a004fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 >> v2:172.21.15.183:3300/0 conn(0x7f56a000aad0 msgr2=0x7f56a00df510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 --2- 172.21.15.104:0/4294550207 >> v2:172.21.15.183:3300/0 conn(0x7f56a000aad0 0x7f56a00df510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00538d0 con 0x7f56a0054690 2024-05-08T04:21:20.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f56a804f770 con 0x7f56a0054690 2024-05-08T04:21:20.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7fe966298640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe9580eacf0 0x7fe95804fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7fe966298640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe9580eacf0 0x7fe95804fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:53006/0 (socket says 172.21.15.104:53006) 2024-05-08T04:21:20.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7fe966298640 1 -- 172.21.15.104:0/1254045215 learned_addr learned my addr 172.21.15.104:0/1254045215 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7fe965a97640 1 --2- 172.21.15.104:0/1254045215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe95804ffc0 0x7fe958037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 >> v1:172.21.15.183:6789/0 conn(0x7f56a0054690 legacy=0x7f56a00dfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 --2- 172.21.15.104:0/4294550207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56900039b0 0x7f5690003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 --2- 172.21.15.104:0/4294550207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5690004350 0x7f5690004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 --2- 172.21.15.104:0/4294550207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5690004fd0 0x7f569000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0053310 con 0x7f5690004350 2024-05-08T04:21:20.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00535f0 con 0x7f56900039b0 2024-05-08T04:21:20.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.036+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569000bf00 con 0x7f5690004fd0 2024-05-08T04:21:20.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f18d13f8640 1 Processor -- start 2024-05-08T04:21:20.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f894cfb0640 1 Processor -- start 2024-05-08T04:21:20.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f18d13f8640 1 -- start start 2024-05-08T04:21:20.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f49aaa51640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f499c0df800 0x7f499c055d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f49aaa51640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f499c03a0a0 0x7f499c03a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f49aaa51640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499c03a9f0 con 0x7f499c0366a0 2024-05-08T04:21:20.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f49aaa51640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499c050150 con 0x7f499c0df800 2024-05-08T04:21:20.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f49aaa51640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c006c30 con 0x7f499c03a0a0 2024-05-08T04:21:20.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f49aa250640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f499c03a0a0 0x7f499c03a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f894cfb0640 1 -- start start 2024-05-08T04:21:20.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f56a6d9d640 1 --2- 172.21.15.104:0/4294550207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5690004fd0 0x7f569000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f56a5d9b640 1 --2- 172.21.15.104:0/4294550207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5690004350 0x7f5690004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f56a659c640 1 --2- 172.21.15.104:0/4294550207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56900039b0 0x7f5690003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f56a6d9d640 1 -- 172.21.15.104:0/4294550207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56900039b0 msgr2=0x7f5690003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f56a6d9d640 1 --2- 172.21.15.104:0/4294550207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56900039b0 0x7f5690003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f56a6d9d640 1 -- 172.21.15.104:0/4294550207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5690004350 msgr2=0x7f5690004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f56a6d9d640 1 --2- 172.21.15.104:0/4294550207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5690004350 0x7f5690004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7f56a6d9d640 1 -- 172.21.15.104:0/4294550207 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00538d0 con 0x7f5690004fd0 2024-05-08T04:21:20.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f49aa250640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f499c03a0a0 0x7f499c03a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:55910/0 (socket says 172.21.15.104:55910) 2024-05-08T04:21:20.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f49aa250640 1 -- 172.21.15.104:0/1177451033 learned_addr learned my addr 172.21.15.104:0/1177451033 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f49a9a4f640 1 --2- 172.21.15.104:0/1177451033 >> v2:172.21.15.104:3300/0 conn(0x7f499c0df800 0x7f499c055d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7fe966298640 1 -- 172.21.15.104:0/1254045215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe95804ffc0 msgr2=0x7fe958037bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7fe966298640 1 --2- 172.21.15.104:0/1254045215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe95804ffc0 0x7fe958037bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7fe966298640 1 -- 172.21.15.104:0/1254045215 >> v1:172.21.15.183:6789/0 conn(0x7fe958038100 legacy=0x7fe958038590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.037+0000 7fe966298640 1 -- 172.21.15.104:0/1254045215 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe958053cd0 con 0x7fe9580eacf0 2024-05-08T04:21:20.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f894cfb0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f894004fa80 0x7f894004fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f894cfb0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8940054260 0x7f89400389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f894cfb0640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89400503a0 con 0x7f89400df410 2024-05-08T04:21:20.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f894cfb0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8940006890 con 0x7f894004fa80 2024-05-08T04:21:20.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f894cfb0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8940006ae0 con 0x7f8940054260 2024-05-08T04:21:20.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f49aa250640 1 -- 172.21.15.104:0/1177451033 >> v2:172.21.15.104:3300/0 conn(0x7f499c0df800 msgr2=0x7f499c055d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f49aa250640 1 --2- 172.21.15.104:0/1177451033 >> v2:172.21.15.104:3300/0 conn(0x7f499c0df800 0x7f499c055d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f49aa250640 1 -- 172.21.15.104:0/1177451033 >> v1:172.21.15.104:6789/0 conn(0x7f499c0366a0 legacy=0x7f499c04fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f8945d9b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f89400df410 0x7f89400382b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53134/0 (socket says 172.21.15.104:53134) 2024-05-08T04:21:20.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f8945d9b640 1 -- 172.21.15.104:0/4188313945 learned_addr learned my addr 172.21.15.104:0/4188313945 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:20.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f49aa250640 1 -- 172.21.15.104:0/1177451033 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c006f10 con 0x7f499c03a0a0 2024-05-08T04:21:20.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f894659c640 1 --2- 172.21.15.104:0/4188313945 >> v2:172.21.15.183:3300/0 conn(0x7f894004fa80 0x7f894004fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f8946d9d640 1 --2- 172.21.15.104:0/4188313945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8940054260 0x7f89400389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f49a9a4f640 1 --2- 172.21.15.104:0/1177451033 >> v2:172.21.15.104:3300/0 conn(0x7f499c0df800 0x7f499c055d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:20.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.038+0000 7f53ab59e640 1 Processor -- start 2024-05-08T04:21:20.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f53ab59e640 1 -- start start 2024-05-08T04:21:20.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f894559a640 1 -- 172.21.15.104:0/4188313945 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105764811 0 0) 0x7f89400503a0 con 0x7f89400df410 2024-05-08T04:21:20.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f894559a640 1 -- 172.21.15.104:0/4188313945 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8930003520 con 0x7f89400df410 2024-05-08T04:21:20.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f894659c640 1 -- 172.21.15.104:0/4188313945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8940054260 msgr2=0x7f89400389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f894659c640 1 --2- 172.21.15.104:0/4188313945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8940054260 0x7f89400389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f894659c640 1 -- 172.21.15.104:0/4188313945 >> v1:172.21.15.104:6789/0 conn(0x7f89400df410 legacy=0x7f89400382b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f894659c640 1 -- 172.21.15.104:0/4188313945 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8940006dc0 con 0x7f894004fa80 2024-05-08T04:21:20.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f18d13f8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f18c403e800 0x7f18c4053bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f18d13f8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f18c40540f0 0x7f18c4006890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f18d13f8640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c4058530 con 0x7f18c40e3080 2024-05-08T04:21:20.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f18d13f8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c4054560 con 0x7f18c403e800 2024-05-08T04:21:20.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f18d13f8640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c4058810 con 0x7f18c40540f0 2024-05-08T04:21:20.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f56a6d9d640 1 --2- 172.21.15.104:0/4294550207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5690004fd0 0x7f569000b9c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f56a8068be0 tx=0x7f5690005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a57d3e06ed07340 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f49aa250640 1 --2- 172.21.15.104:0/1177451033 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f499c03a0a0 0x7f499c03a4b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f49a0009870 tx=0x7f49a002c5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8d9339fb436e91d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a806cb80 con 0x7f5690004fd0 2024-05-08T04:21:20.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a806c070 con 0x7f5690004fd0 2024-05-08T04:21:20.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f56a559a640 1 -- 172.21.15.104:0/4294550207 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a806c520 con 0x7f5690004fd0 2024-05-08T04:21:20.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.039+0000 7f18cb7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f18c403e800 0x7f18c4053bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7fe966298640 1 --2- 172.21.15.104:0/1254045215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9580eacf0 0x7fe95804fa80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009870 tx=0x7fe95c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=214b6bf6380cbc8f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f49a8a4d640 1 -- 172.21.15.104:0/1177451033 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0038070 con 0x7f499c03a0a0 2024-05-08T04:21:20.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f18cb7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f18c403e800 0x7f18c4053bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33820/0 (socket says 172.21.15.104:33820) 2024-05-08T04:21:20.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f18cb7fe640 1 -- 172.21.15.104:0/3836805136 learned_addr learned my addr 172.21.15.104:0/3836805136 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f49a8a4d640 1 -- 172.21.15.104:0/1177451033 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a0031710 con 0x7f499c03a0a0 2024-05-08T04:21:20.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f18d0bf7640 1 --2- 172.21.15.104:0/3836805136 >> v2:172.21.15.183:3300/0 conn(0x7f18c40540f0 0x7f18c4006890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7fe965296640 1 -- 172.21.15.104:0/1254045215 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c037070 con 0x7fe9580eacf0 2024-05-08T04:21:20.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7fe965296640 1 -- 172.21.15.104:0/1254045215 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c032440 con 0x7fe9580eacf0 2024-05-08T04:21:20.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7fe965296640 1 -- 172.21.15.104:0/1254045215 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c032810 con 0x7fe9580eacf0 2024-05-08T04:21:20.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f18cb7fe640 1 -- 172.21.15.104:0/3836805136 >> v2:172.21.15.183:3300/0 conn(0x7f18c40540f0 msgr2=0x7f18c4006890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f53ab59e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f53a4050190 0x7f53a4038070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f18cb7fe640 1 --2- 172.21.15.104:0/3836805136 >> v2:172.21.15.183:3300/0 conn(0x7f18c40540f0 0x7f18c4006890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f18cb7fe640 1 -- 172.21.15.104:0/3836805136 >> v1:172.21.15.183:6789/0 conn(0x7f18c40e3080 legacy=0x7f18c4057d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f18cb7fe640 1 -- 172.21.15.104:0/3836805136 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4058af0 con 0x7f18c403e800 2024-05-08T04:21:20.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f0b8f59e640 1 Processor -- start 2024-05-08T04:21:20.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f318a3c8640 1 Processor -- start 2024-05-08T04:21:20.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f894659c640 1 --2- 172.21.15.104:0/4188313945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894004fa80 0x7f894004fe60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f893c00a8c0 tx=0x7f893c02b250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cb33f90655bba6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f894559a640 1 -- 172.21.15.104:0/4188313945 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c038070 con 0x7f894004fa80 2024-05-08T04:21:20.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f53ab59e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a40544b0 con 0x7f53a4053c60 2024-05-08T04:21:20.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f53aa59c640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f53a40df210 0x7f53a404fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:35114/0 (socket says 172.21.15.104:35114) 2024-05-08T04:21:20.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f53aa59c640 1 -- 172.21.15.104:0/2061430580 learned_addr learned my addr 172.21.15.104:0/2061430580 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:20.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f53a9d9b640 1 --2- 172.21.15.104:0/2061430580 >> v2:172.21.15.104:3300/0 conn(0x7f53a4050190 0x7f53a4038070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f0b8f59e640 1 -- start start 2024-05-08T04:21:20.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f318a3c8640 1 -- start start 2024-05-08T04:21:20.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f49a8a4d640 1 -- 172.21.15.104:0/1177451033 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0031ae0 con 0x7f499c03a0a0 2024-05-08T04:21:20.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f56ace1f640 1 -- 172.21.15.104:0/4294550207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5690004fd0 msgr2=0x7f569000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f49aaa51640 1 -- 172.21.15.104:0/1177451033 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f499c03a0a0 msgr2=0x7f499c03a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f49aaa51640 1 --2- 172.21.15.104:0/1177451033 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f499c03a0a0 0x7f499c03a4b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f49a0009870 tx=0x7f49a002c5f0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f53ab59e640 1 -- 172.21.15.104:0/2061430580 --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a40541d0 con 0x7f53a40df210 2024-05-08T04:21:20.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f53ab59e640 1 -- 172.21.15.104:0/2061430580 --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a4005f20 con 0x7f53a4050190 2024-05-08T04:21:20.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f56ace1f640 1 --2- 172.21.15.104:0/4294550207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5690004fd0 0x7f569000b9c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f56a8068be0 tx=0x7f5690005830 comp rx=0 tx=0).stop 2024-05-08T04:21:20.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.040+0000 7f56a6d9d640 1 -- 172.21.15.104:0/4294550207 reap_dead start 2024-05-08T04:21:20.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f56ace1f640 1 -- 172.21.15.104:0/4294550207 shutdown_connections 2024-05-08T04:21:20.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f56ace1f640 1 -- 172.21.15.104:0/4294550207 >> 172.21.15.104:0/4294550207 conn(0x7f56a0009fe0 msgr2=0x7f56a000a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f53a959a640 1 -- 172.21.15.104:0/2061430580 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061082240 0 0) 0x7f53a40544b0 con 0x7f53a4053c60 2024-05-08T04:21:20.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f49aaa51640 1 -- 172.21.15.104:0/1177451033 shutdown_connections 2024-05-08T04:21:20.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f49aaa51640 1 --2- 172.21.15.104:0/1177451033 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f499c03a0a0 0x7f499c03a4b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f49aaa51640 1 --2- 172.21.15.104:0/1177451033 >> v2:172.21.15.104:3300/0 conn(0x7f499c0df800 0x7f499c055d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f49aaa51640 1 -- 172.21.15.104:0/1177451033 >> 172.21.15.104:0/1177451033 conn(0x7f499c01e6c0 msgr2=0x7f499c0553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f56ace1f640 1 -- 172.21.15.104:0/4294550207 shutdown_connections 2024-05-08T04:21:20.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f56ace1f640 1 -- 172.21.15.104:0/4294550207 wait complete. 2024-05-08T04:21:20.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f53a959a640 1 -- 172.21.15.104:0/2061430580 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5394003520 con 0x7f53a4053c60 2024-05-08T04:21:20.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f53a959a640 1 -- 172.21.15.104:0/2061430580 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712808410 0 0) 0x7f53a40541d0 con 0x7f53a40df210 2024-05-08T04:21:20.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f53a959a640 1 -- 172.21.15.104:0/2061430580 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a40544b0 con 0x7f53a40df210 2024-05-08T04:21:20.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7fe9684fc640 1 -- 172.21.15.104:0/1254045215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9580eacf0 msgr2=0x7fe95804fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7fe9684fc640 1 --2- 172.21.15.104:0/1254045215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9580eacf0 0x7fe95804fa80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009870 tx=0x7fe95c02a210 comp rx=0 tx=0).stop 2024-05-08T04:21:20.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f53a9d9b640 1 -- 172.21.15.104:0/2061430580 >> v1:172.21.15.183:6789/0 conn(0x7f53a40df210 legacy=0x7f53a404fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f49aaa51640 1 -- 172.21.15.104:0/1177451033 shutdown_connections 2024-05-08T04:21:20.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f49aaa51640 1 -- 172.21.15.104:0/1177451033 wait complete. 2024-05-08T04:21:20.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f53a959a640 1 -- 172.21.15.104:0/2061430580 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2440234125 0 0) 0x7f5394003520 con 0x7f53a4053c60 2024-05-08T04:21:20.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f53a9d9b640 1 -- 172.21.15.104:0/2061430580 >> v1:172.21.15.104:6789/0 conn(0x7f53a4053c60 legacy=0x7f53a4006a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f0b8f59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b900cdee0 0x7f0b900cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f53a9d9b640 1 -- 172.21.15.104:0/2061430580 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a4006200 con 0x7f53a4050190 2024-05-08T04:21:20.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f318a3c8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f317c0e30b0 0x7f317c057d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f318a3c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f317c03e830 0x7f317c053be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f318a3c8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f317c054120 0x7f317c0e6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f318a3c8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c0582c0 con 0x7f317c03e830 2024-05-08T04:21:20.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f318a3c8640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c058560 con 0x7f317c054120 2024-05-08T04:21:20.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f318a3c8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c058840 con 0x7f317c0e30b0 2024-05-08T04:21:20.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f0b8f59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0b900b5310 0x7f0b900b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f0b8f59e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b900d1f00 con 0x7f0b9015e080 2024-05-08T04:21:20.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f0b8f59e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b900d3610 con 0x7f0b900b5310 2024-05-08T04:21:20.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f0b8f59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900d1cb0 con 0x7f0b900cdee0 2024-05-08T04:21:20.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f894559a640 1 -- 172.21.15.104:0/4188313945 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c033440 con 0x7f894004fa80 2024-05-08T04:21:20.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.041+0000 7f894559a640 1 -- 172.21.15.104:0/4188313945 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c0337f0 con 0x7f894004fa80 2024-05-08T04:21:20.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f31893c6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f317c0e30b0 0x7f317c057d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f0b8e59c640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f0b9015e080 0x7f0b900b6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:35126/0 (socket says 172.21.15.104:35126) 2024-05-08T04:21:20.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f0b8dd9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b900cdee0 0x7f0b900cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f0b8ed9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0b900b5310 0x7f0b900b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f0b8dd9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b900cdee0 0x7f0b900cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:55934/0 (socket says 172.21.15.104:55934) 2024-05-08T04:21:20.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f0b8dd9b640 1 -- 172.21.15.104:0/3097043977 learned_addr learned my addr 172.21.15.104:0/3097043977 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f3189bc7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f317c054120 0x7f317c0e6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f894cfb0640 1 -- 172.21.15.104:0/4188313945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894004fa80 msgr2=0x7f894004fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f894cfb0640 1 --2- 172.21.15.104:0/4188313945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894004fa80 0x7f894004fe60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f893c00a8c0 tx=0x7f893c02b250 comp rx=0 tx=0).stop 2024-05-08T04:21:20.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f31893c6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f317c0e30b0 0x7f317c057d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:55940/0 (socket says 172.21.15.104:55940) 2024-05-08T04:21:20.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f894cfb0640 1 -- 172.21.15.104:0/4188313945 shutdown_connections 2024-05-08T04:21:20.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f31893c6640 1 -- 172.21.15.104:0/3981175672 learned_addr learned my addr 172.21.15.104:0/3981175672 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f894cfb0640 1 --2- 172.21.15.104:0/4188313945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8940054260 0x7f89400389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f894cfb0640 1 --2- 172.21.15.104:0/4188313945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894004fa80 0x7f894004fe60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f3188bc5640 1 --2- 172.21.15.104:0/3981175672 >> v2:172.21.15.104:3300/0 conn(0x7f317c03e830 0x7f317c053be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f31893c6640 1 -- 172.21.15.104:0/3981175672 >> v2:172.21.15.183:3300/0 conn(0x7f317c054120 msgr2=0x7f317c0e6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7fe9684fc640 1 -- 172.21.15.104:0/1254045215 shutdown_connections 2024-05-08T04:21:20.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f31893c6640 1 --2- 172.21.15.104:0/3981175672 >> v2:172.21.15.183:3300/0 conn(0x7f317c054120 0x7f317c0e6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7fe9684fc640 1 --2- 172.21.15.104:0/1254045215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe95804ffc0 0x7fe958037bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7fe9684fc640 1 --2- 172.21.15.104:0/1254045215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9580eacf0 0x7fe95804fa80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7fe9684fc640 1 -- 172.21.15.104:0/1254045215 >> 172.21.15.104:0/1254045215 conn(0x7fe958009fa0 msgr2=0x7fe95800a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.042+0000 7f894cfb0640 1 -- 172.21.15.104:0/4188313945 >> 172.21.15.104:0/4188313945 conn(0x7f8940009fa0 msgr2=0x7f894000a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f894cfb0640 1 -- 172.21.15.104:0/4188313945 shutdown_connections 2024-05-08T04:21:20.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f894cfb0640 1 -- 172.21.15.104:0/4188313945 wait complete. 2024-05-08T04:21:20.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f31893c6640 1 -- 172.21.15.104:0/3981175672 >> v2:172.21.15.104:3300/0 conn(0x7f317c03e830 msgr2=0x7f317c053be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f31893c6640 1 --2- 172.21.15.104:0/3981175672 >> v2:172.21.15.104:3300/0 conn(0x7f317c03e830 0x7f317c053be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f31893c6640 1 -- 172.21.15.104:0/3981175672 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c058b20 con 0x7f317c0e30b0 2024-05-08T04:21:20.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f3189bc7640 1 --2- 172.21.15.104:0/3981175672 >> v2:172.21.15.183:3300/0 conn(0x7f317c054120 0x7f317c0e6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:20.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f3188bc5640 1 --2- 172.21.15.104:0/3981175672 >> v2:172.21.15.104:3300/0 conn(0x7f317c03e830 0x7f317c053be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:20.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f18cb7fe640 1 --2- 172.21.15.104:0/3836805136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18c403e800 0x7f18c4053bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f18c40e7c90 tx=0x7f18b802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83054c48159336c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f49aaa51640 1 Processor -- start 2024-05-08T04:21:20.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f56ace1f640 1 Processor -- start 2024-05-08T04:21:20.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f53a9d9b640 1 --2- 172.21.15.104:0/2061430580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53a4050190 0x7f53a4038070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f53a00097a0 tx=0x7f53a002a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd50340103cefeca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f49aaa51640 1 -- start start 2024-05-08T04:21:20.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f18caffd640 1 -- 172.21.15.104:0/3836805136 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b8036070 con 0x7f18c403e800 2024-05-08T04:21:20.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f18caffd640 1 -- 172.21.15.104:0/3836805136 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b8031600 con 0x7f18c403e800 2024-05-08T04:21:20.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f18caffd640 1 -- 172.21.15.104:0/3836805136 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b80319d0 con 0x7f18c403e800 2024-05-08T04:21:20.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f0b8dd9b640 1 -- 172.21.15.104:0/3097043977 >> v2:172.21.15.183:3300/0 conn(0x7f0b900b5310 msgr2=0x7f0b900b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f56ace1f640 1 -- start start 2024-05-08T04:21:20.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f0b8dd9b640 1 --2- 172.21.15.104:0/3097043977 >> v2:172.21.15.183:3300/0 conn(0x7f0b900b5310 0x7f0b900b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f0b8dd9b640 1 -- 172.21.15.104:0/3097043977 >> v1:172.21.15.183:6789/0 conn(0x7f0b9015e080 legacy=0x7f0b900b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.043+0000 7f0b8dd9b640 1 -- 172.21.15.104:0/3097043977 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b900d21e0 con 0x7f0b900cdee0 2024-05-08T04:21:20.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7f53a959a640 1 -- 172.21.15.104:0/2061430580 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a0037070 con 0x7f53a4050190 2024-05-08T04:21:20.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7fe9684fc640 1 -- 172.21.15.104:0/1254045215 shutdown_connections 2024-05-08T04:21:20.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7f53a959a640 1 -- 172.21.15.104:0/2061430580 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a002ab00 con 0x7f53a4050190 2024-05-08T04:21:20.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7fe9684fc640 1 -- 172.21.15.104:0/1254045215 wait complete. 2024-05-08T04:21:20.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7f53a959a640 1 -- 172.21.15.104:0/2061430580 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a0037070 con 0x7f53a4050190 2024-05-08T04:21:20.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7f0b8dd9b640 1 --2- 172.21.15.104:0/3097043977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b900cdee0 0x7f0b900cf220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009870 tx=0x7f0b8002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d17be0e971e9e75d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7f31893c6640 1 --2- 172.21.15.104:0/3981175672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f317c0e30b0 0x7f317c057d80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f318402d370 tx=0x7f31840a52e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6ebecbffa5b67e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7f0b8d59a640 1 -- 172.21.15.104:0/3097043977 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80037070 con 0x7f0b900cdee0 2024-05-08T04:21:20.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7f0b8d59a640 1 -- 172.21.15.104:0/3097043977 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b80032440 con 0x7f0b900cdee0 2024-05-08T04:21:20.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7f0b8d59a640 1 -- 172.21.15.104:0/3097043977 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b800327f0 con 0x7f0b900cdee0 2024-05-08T04:21:20.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7f317bfff640 1 -- 172.21.15.104:0/3981175672 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840b2070 con 0x7f317c0e30b0 2024-05-08T04:21:20.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7f317bfff640 1 -- 172.21.15.104:0/3981175672 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31840ad680 con 0x7f317c0e30b0 2024-05-08T04:21:20.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7f317bfff640 1 -- 172.21.15.104:0/3981175672 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840adaf0 con 0x7f317c0e30b0 2024-05-08T04:21:20.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.044+0000 7f56ace1f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5690004fd0 0x7f56a0047250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f56ace1f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56a00d5a60 0x7f56a00c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f56ace1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56a00d2260 0x7f56a004a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f49aaa51640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f499c0366a0 0x7f499c0dd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f894cfb0640 1 Processor -- start 2024-05-08T04:21:20.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f56ace1f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0054170 con 0x7f56a00d2260 2024-05-08T04:21:20.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f56ace1f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0053e90 con 0x7f56a00d5a60 2024-05-08T04:21:20.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f49aaa51640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f499c03a0a0 0x7f499c1858b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f56ace1f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00e04e0 con 0x7f5690004fd0 2024-05-08T04:21:20.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f53ab59e640 1 -- 172.21.15.104:0/2061430580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53a4050190 msgr2=0x7f53a4038070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f49aaa51640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f499c0df800 0x7f499c032250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f53ab59e640 1 --2- 172.21.15.104:0/2061430580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53a4050190 0x7f53a4038070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f53a00097a0 tx=0x7f53a002a030 comp rx=0 tx=0).stop 2024-05-08T04:21:20.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f49aaa51640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c036b10 con 0x7f499c0366a0 2024-05-08T04:21:20.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f49a924e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f499c03a0a0 0x7f499c1858b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f49aaa51640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0074d0 con 0x7f499c0df800 2024-05-08T04:21:20.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f49aaa51640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0dfbe0 con 0x7f499c03a0a0 2024-05-08T04:21:20.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f49a924e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f499c03a0a0 0x7f499c1858b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:55966/0 (socket says 172.21.15.104:55966) 2024-05-08T04:21:20.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f49a924e640 1 -- 172.21.15.104:0/2965273542 learned_addr learned my addr 172.21.15.104:0/2965273542 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f49aa250640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f499c0df800 0x7f499c032250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f56a6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56a00d2260 0x7f56a004a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f0b8f59e640 1 -- 172.21.15.104:0/3097043977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b900cdee0 msgr2=0x7f0b900cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f0b8f59e640 1 --2- 172.21.15.104:0/3097043977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b900cdee0 0x7f0b900cf220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009870 tx=0x7f0b8002a270 comp rx=0 tx=0).stop 2024-05-08T04:21:20.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f56a5d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56a00d5a60 0x7f56a00c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f56a659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5690004fd0 0x7f56a0047250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f56a5d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56a00d5a60 0x7f56a00c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:53056/0 (socket says 172.21.15.104:53056) 2024-05-08T04:21:20.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f56a5d9b640 1 -- 172.21.15.104:0/4256052347 learned_addr learned my addr 172.21.15.104:0/4256052347 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f56a6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56a00d2260 0x7f56a004a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33842/0 (socket says 172.21.15.104:33842) 2024-05-08T04:21:20.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f894cfb0640 1 -- start start 2024-05-08T04:21:20.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f0b8f59e640 1 -- 172.21.15.104:0/3097043977 shutdown_connections 2024-05-08T04:21:20.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f0b8f59e640 1 --2- 172.21.15.104:0/3097043977 >> v2:172.21.15.183:3300/0 conn(0x7f0b900b5310 0x7f0b900b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f0b8f59e640 1 --2- 172.21.15.104:0/3097043977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b900cdee0 0x7f0b900cf220 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f318a3c8640 1 -- 172.21.15.104:0/3981175672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f317c0e30b0 msgr2=0x7f317c057d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.045+0000 7f318a3c8640 1 --2- 172.21.15.104:0/3981175672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f317c0e30b0 0x7f317c057d80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f318402d370 tx=0x7f31840a52e0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f0b8f59e640 1 -- 172.21.15.104:0/3097043977 >> 172.21.15.104:0/3097043977 conn(0x7f0b900d04f0 msgr2=0x7f0b900d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f318a3c8640 1 -- 172.21.15.104:0/3981175672 shutdown_connections 2024-05-08T04:21:20.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f318a3c8640 1 --2- 172.21.15.104:0/3981175672 >> v2:172.21.15.183:3300/0 conn(0x7f317c054120 0x7f317c0e6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f318a3c8640 1 --2- 172.21.15.104:0/3981175672 >> v2:172.21.15.104:3300/0 conn(0x7f317c03e830 0x7f317c053be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f318a3c8640 1 --2- 172.21.15.104:0/3981175672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f317c0e30b0 0x7f317c057d80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f318a3c8640 1 -- 172.21.15.104:0/3981175672 >> 172.21.15.104:0/3981175672 conn(0x7f317c0559d0 msgr2=0x7f317c055de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f49a924e640 1 -- 172.21.15.104:0/2965273542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f499c0df800 msgr2=0x7f499c032250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7fe9684fc640 1 Processor -- start 2024-05-08T04:21:20.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f0b8f59e640 1 -- 172.21.15.104:0/3097043977 shutdown_connections 2024-05-08T04:21:20.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f0b8f59e640 1 -- 172.21.15.104:0/3097043977 wait complete. 2024-05-08T04:21:20.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7fe9684fc640 1 -- start start 2024-05-08T04:21:20.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f894cfb0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894004fa80 0x7f89400d6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f894cfb0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8940054260 0x7f89400365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f56a5d9b640 1 -- 172.21.15.104:0/4256052347 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5690004fd0 msgr2=0x7f56a0047250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f56a5d9b640 1 --2- 172.21.15.104:0/4256052347 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5690004fd0 0x7f56a0047250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f56a5d9b640 1 -- 172.21.15.104:0/4256052347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56a00d2260 msgr2=0x7f56a004a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f56a5d9b640 1 --2- 172.21.15.104:0/4256052347 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56a00d2260 0x7f56a004a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f56a5d9b640 1 -- 172.21.15.104:0/4256052347 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00d5680 con 0x7f56a00d5a60 2024-05-08T04:21:20.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f894cfb0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89400df410 0x7f8940036b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f18d13f8640 1 -- 172.21.15.104:0/3836805136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18c403e800 msgr2=0x7f18c4053bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f18d13f8640 1 --2- 172.21.15.104:0/3836805136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18c403e800 0x7f18c4053bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f18c40e7c90 tx=0x7f18b802a560 comp rx=0 tx=0).stop 2024-05-08T04:21:20.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f53ab59e640 1 -- 172.21.15.104:0/2061430580 shutdown_connections 2024-05-08T04:21:20.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f894cfb0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89400546f0 con 0x7f8940054260 2024-05-08T04:21:20.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f894cfb0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8940007380 con 0x7f894004fa80 2024-05-08T04:21:20.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f894cfb0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8940054870 con 0x7f89400df410 2024-05-08T04:21:20.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f53ab59e640 1 --2- 172.21.15.104:0/2061430580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53a4050190 0x7f53a4038070 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f894659c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894004fa80 0x7f89400d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f53ab59e640 1 -- 172.21.15.104:0/2061430580 >> 172.21.15.104:0/2061430580 conn(0x7f53a4009fa0 msgr2=0x7f53a400a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f49a924e640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f499c0df800 0x7f499c032250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f49a924e640 1 -- 172.21.15.104:0/2965273542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f499c0366a0 msgr2=0x7f499c0dd6f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T04:21:20.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f49a9a4f640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f499c0366a0 0x7f499c0dd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f49a924e640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f499c0366a0 0x7f499c0dd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f49a924e640 1 -- 172.21.15.104:0/2965273542 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c0329a0 con 0x7f499c03a0a0 2024-05-08T04:21:20.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f894659c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894004fa80 0x7f89400d6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:53064/0 (socket says 172.21.15.104:53064) 2024-05-08T04:21:20.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f894659c640 1 -- 172.21.15.104:0/2779299853 learned_addr learned my addr 172.21.15.104:0/2779299853 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f8946d9d640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89400df410 0x7f8940036b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f8945d9b640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8940054260 0x7f89400365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f53ab59e640 1 -- 172.21.15.104:0/2061430580 shutdown_connections 2024-05-08T04:21:20.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f53ab59e640 1 -- 172.21.15.104:0/2061430580 wait complete. 2024-05-08T04:21:20.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f18d13f8640 1 -- 172.21.15.104:0/3836805136 shutdown_connections 2024-05-08T04:21:20.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f18d13f8640 1 --2- 172.21.15.104:0/3836805136 >> v2:172.21.15.183:3300/0 conn(0x7f18c40540f0 0x7f18c4006890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f18d13f8640 1 --2- 172.21.15.104:0/3836805136 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18c403e800 0x7f18c4053bb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f18d13f8640 1 -- 172.21.15.104:0/3836805136 >> 172.21.15.104:0/3836805136 conn(0x7f18c40559a0 msgr2=0x7f18c4055db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f18d13f8640 1 -- 172.21.15.104:0/3836805136 shutdown_connections 2024-05-08T04:21:20.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f18d13f8640 1 -- 172.21.15.104:0/3836805136 wait complete. 2024-05-08T04:21:20.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f318a3c8640 1 -- 172.21.15.104:0/3981175672 shutdown_connections 2024-05-08T04:21:20.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f318a3c8640 1 -- 172.21.15.104:0/3981175672 wait complete. 2024-05-08T04:21:20.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f8946d9d640 1 -- 172.21.15.104:0/2779299853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894004fa80 msgr2=0x7f89400d6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.046+0000 7f56a5d9b640 1 --2- 172.21.15.104:0/4256052347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56a00d5a60 0x7f56a00c8520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f569c00e870 tx=0x7f569c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f8946d9d640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894004fa80 0x7f89400d6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f5696ffd640 1 -- 172.21.15.104:0/4256052347 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c017070 con 0x7f56a00d5a60 2024-05-08T04:21:20.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f8946d9d640 1 -- 172.21.15.104:0/2779299853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8940054260 msgr2=0x7f89400365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f8946d9d640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8940054260 0x7f89400365e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f8946d9d640 1 -- 172.21.15.104:0/2779299853 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89400d6580 con 0x7f89400df410 2024-05-08T04:21:20.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7fe9684fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe958038100 0x7fe9580e1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f56ace1f640 1 -- 172.21.15.104:0/4256052347 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a00e1f30 con 0x7f56a00d5a60 2024-05-08T04:21:20.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7fe9684fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe95804ffc0 0x7fe95817d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7fe9684fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9580eacf0 0x7fe95804a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7fe9684fc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580547b0 con 0x7fe958038100 2024-05-08T04:21:20.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7fe9684fc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe958038ca0 con 0x7fe95804ffc0 2024-05-08T04:21:20.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7fe9684fc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe958054930 con 0x7fe9580eacf0 2024-05-08T04:21:20.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f8946d9d640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89400df410 0x7f8940036b20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f893800e820 tx=0x7f893800ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f56ace1f640 1 -- 172.21.15.104:0/4256052347 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a0049fa0 con 0x7f56a00d5a60 2024-05-08T04:21:20.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7fe965a97640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe95804ffc0 0x7fe95817d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7fe966a99640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9580eacf0 0x7fe95804a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7fe966a99640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9580eacf0 0x7fe95804a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:55992/0 (socket says 172.21.15.104:55992) 2024-05-08T04:21:20.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7fe966a99640 1 -- 172.21.15.104:0/4089550888 learned_addr learned my addr 172.21.15.104:0/4089550888 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7fe966a99640 1 -- 172.21.15.104:0/4089550888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe95804ffc0 msgr2=0x7fe95817d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7fe966a99640 1 --2- 172.21.15.104:0/4089550888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe95804ffc0 0x7fe95817d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7fe966a99640 1 -- 172.21.15.104:0/4089550888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe958038100 msgr2=0x7fe9580e1960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T04:21:20.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7fe966a99640 1 --2- 172.21.15.104:0/4089550888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe958038100 0x7fe9580e1960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7fe966a99640 1 -- 172.21.15.104:0/4089550888 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9580e1ea0 con 0x7fe9580eacf0 2024-05-08T04:21:20.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7fe966a99640 1 --2- 172.21.15.104:0/4089550888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9580eacf0 0x7fe95804a880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe9600690a0 tx=0x7fe960074370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7f18d13f8640 1 Processor -- start 2024-05-08T04:21:20.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7f318a3c8640 1 Processor -- start 2024-05-08T04:21:20.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7f318a3c8640 1 -- start start 2024-05-08T04:21:20.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7f0b8f59e640 1 Processor -- start 2024-05-08T04:21:20.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7f0b8f59e640 1 -- start start 2024-05-08T04:21:20.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f8936ffd640 1 -- 172.21.15.104:0/2779299853 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938017070 con 0x7f89400df410 2024-05-08T04:21:20.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f8936ffd640 1 -- 172.21.15.104:0/2779299853 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893800c940 con 0x7f89400df410 2024-05-08T04:21:20.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f8936ffd640 1 -- 172.21.15.104:0/2779299853 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893800cd10 con 0x7f89400df410 2024-05-08T04:21:20.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f894cfb0640 1 -- 172.21.15.104:0/2779299853 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894004d8c0 con 0x7f89400df410 2024-05-08T04:21:20.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7f894cfb0640 1 -- 172.21.15.104:0/2779299853 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894004de80 con 0x7f89400df410 2024-05-08T04:21:20.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7f18d13f8640 1 -- start start 2024-05-08T04:21:20.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7f5696ffd640 1 -- 172.21.15.104:0/4256052347 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c009e40 con 0x7f56a00d5a60 2024-05-08T04:21:20.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7f5696ffd640 1 -- 172.21.15.104:0/4256052347 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c004260 con 0x7f56a00d5a60 2024-05-08T04:21:20.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f49a924e640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f499c03a0a0 0x7f499c1858b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f49a4069860 tx=0x7f49a4074370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f499a7fc640 1 -- 172.21.15.104:0/2965273542 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a40685b0 con 0x7f499c03a0a0 2024-05-08T04:21:20.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.047+0000 7f499a7fc640 1 -- 172.21.15.104:0/2965273542 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a4068750 con 0x7f499c03a0a0 2024-05-08T04:21:20.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.048+0000 7f499a7fc640 1 -- 172.21.15.104:0/2965273542 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4092400 con 0x7f499c03a0a0 2024-05-08T04:21:20.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7f49aaa51640 1 -- 172.21.15.104:0/2965273542 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c032c80 con 0x7f499c03a0a0 2024-05-08T04:21:20.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7f49aaa51640 1 -- 172.21.15.104:0/2965273542 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c033240 con 0x7f499c03a0a0 2024-05-08T04:21:20.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7fe956ffd640 1 -- 172.21.15.104:0/4089550888 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960068690 con 0x7fe9580eacf0 2024-05-08T04:21:20.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7fe956ffd640 1 -- 172.21.15.104:0/4089550888 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe960092400 con 0x7fe9580eacf0 2024-05-08T04:21:20.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7fe956ffd640 1 -- 172.21.15.104:0/4089550888 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960092670 con 0x7fe9580eacf0 2024-05-08T04:21:20.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7f53ab59e640 1 Processor -- start 2024-05-08T04:21:20.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7fe9684fc640 1 -- 172.21.15.104:0/4089550888 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95817da40 con 0x7fe9580eacf0 2024-05-08T04:21:20.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7f53ab59e640 1 -- start start 2024-05-08T04:21:20.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7fe9684fc640 1 -- 172.21.15.104:0/4089550888 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95817e000 con 0x7fe9580eacf0 2024-05-08T04:21:20.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7f318a3c8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f317c03e830 0x7f317c050200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7f318a3c8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f317c054120 0x7f317c0516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7f318a3c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f317c0e30b0 0x7f317c051c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7f0b8f59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b900b5310 0x7f0b90160f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7f318a3c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c0e3490 con 0x7f317c0e30b0 2024-05-08T04:21:20.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.049+0000 7f0b8f59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b900cdee0 0x7f0b901510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f318a3c8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c03bfb0 con 0x7f317c03e830 2024-05-08T04:21:20.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f0b8f59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9015e080 0x7f0b901e8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f318a3c8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c0e7160 con 0x7f317c054120 2024-05-08T04:21:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f3189bc7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f317c0e30b0 0x7f317c051c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f31893c6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f317c03e830 0x7f317c050200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f18d13f8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18c403e800 0x7f18c4178d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f31893c6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f317c03e830 0x7f317c050200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:53080/0 (socket says 172.21.15.104:53080) 2024-05-08T04:21:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f31893c6640 1 -- 172.21.15.104:0/717617397 learned_addr learned my addr 172.21.15.104:0/717617397 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f0b8dd9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b900cdee0 0x7f0b901510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f3188bc5640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f317c054120 0x7f317c0516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f0b8f59e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900d2a80 con 0x7f0b9015e080 2024-05-08T04:21:20.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f0b8f59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900d27a0 con 0x7f0b900b5310 2024-05-08T04:21:20.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f0b8f59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b90161d70 con 0x7f0b900cdee0 2024-05-08T04:21:20.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f0b8dd9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b900cdee0 0x7f0b901510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:55998/0 (socket says 172.21.15.104:55998) 2024-05-08T04:21:20.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f0b8dd9b640 1 -- 172.21.15.104:0/2675790302 learned_addr learned my addr 172.21.15.104:0/2675790302 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f0b8e59c640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b900b5310 0x7f0b90160f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7fe954ff9640 1 -- 172.21.15.104:0/4089550888 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe958005380 con 0x7fe9580eacf0 2024-05-08T04:21:20.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f53ab59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53a4050190 0x7f53a41758f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f18d13f8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18c40540f0 0x7f18c40ddb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f18d13f8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18c40e3080 0x7f18c40daf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f18d13f8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c40e3460 con 0x7f18c403e800 2024-05-08T04:21:20.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f18d13f8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c403bf80 con 0x7f18c40540f0 2024-05-08T04:21:20.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f18d13f8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c4006dd0 con 0x7f18c40e3080 2024-05-08T04:21:20.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f0b8ed9d640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9015e080 0x7f0b901e8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f18d0bf7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18c40e3080 0x7f18c40daf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f53ab59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53a4053c60 0x7f53a40491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f49aaa51640 1 -- 172.21.15.104:0/2965273542 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f499c0057e0 con 0x7f499c03a0a0 2024-05-08T04:21:20.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f53aa59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53a4050190 0x7f53a41758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f31893c6640 1 -- 172.21.15.104:0/717617397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f317c054120 msgr2=0x7f317c0516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f31893c6640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f317c054120 0x7f317c0516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f31893c6640 1 -- 172.21.15.104:0/717617397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f317c0e30b0 msgr2=0x7f317c051c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f31893c6640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f317c0e30b0 0x7f317c051c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f31893c6640 1 -- 172.21.15.104:0/717617397 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c0d57c0 con 0x7f317c03e830 2024-05-08T04:21:20.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f3188bc5640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f317c054120 0x7f317c0516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:20.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f18cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18c403e800 0x7f18c4178d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f18cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18c403e800 0x7f18c4178d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33884/0 (socket says 172.21.15.104:33884) 2024-05-08T04:21:20.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.050+0000 7f18cbfff640 1 -- 172.21.15.104:0/1401788092 learned_addr learned my addr 172.21.15.104:0/1401788092 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f18cb7fe640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18c40540f0 0x7f18c40ddb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f0b8ed9d640 1 -- 172.21.15.104:0/2675790302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b900cdee0 msgr2=0x7f0b901510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f53aa59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53a4050190 0x7f53a41758f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33896/0 (socket says 172.21.15.104:33896) 2024-05-08T04:21:20.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f31893c6640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f317c03e830 0x7f317c050200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f318406a1d0 tx=0x7f318406a9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f0b8ed9d640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b900cdee0 0x7f0b901510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f53aa59c640 1 -- 172.21.15.104:0/2827759773 learned_addr learned my addr 172.21.15.104:0/2827759773 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7fe956ffd640 1 -- 172.21.15.104:0/4089550888 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe960092810 con 0x7fe9580eacf0 2024-05-08T04:21:20.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f0b8ed9d640 1 -- 172.21.15.104:0/2675790302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b900b5310 msgr2=0x7f0b90160f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f53ab59e640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53a40df210 0x7f53a40354e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f0b8ed9d640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b900b5310 0x7f0b90160f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f53a9d9b640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53a4053c60 0x7f53a40491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f0b8ed9d640 1 -- 172.21.15.104:0/2675790302 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9015f080 con 0x7f0b9015e080 2024-05-08T04:21:20.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4037a80 con 0x7f53a4050190 2024-05-08T04:21:20.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4037900 con 0x7f53a40df210 2024-05-08T04:21:20.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f5696ffd640 1 -- 172.21.15.104:0/4256052347 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f569c00c940 con 0x7f56a00d5a60 2024-05-08T04:21:20.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f499a7fc640 1 -- 172.21.15.104:0/2965273542 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f49a4092680 con 0x7f499c03a0a0 2024-05-08T04:21:20.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f499a7fc640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f498806b4d0 0x7f498806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f53aad9d640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53a40df210 0x7f53a40354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40df5f0 con 0x7f53a4053c60 2024-05-08T04:21:20.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f18cb7fe640 1 -- 172.21.15.104:0/1401788092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18c40e3080 msgr2=0x7f18c40daf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f18cb7fe640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18c40e3080 0x7f18c40daf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f18cb7fe640 1 -- 172.21.15.104:0/1401788092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18c403e800 msgr2=0x7f18c4178d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f18cb7fe640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18c403e800 0x7f18c4178d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f18cb7fe640 1 -- 172.21.15.104:0/1401788092 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c416cbd0 con 0x7f18c40540f0 2024-05-08T04:21:20.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f18cbfff640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18c403e800 0x7f18c4178d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:20.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f3179ffb640 1 -- 172.21.15.104:0/717617397 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840b2050 con 0x7f317c03e830 2024-05-08T04:21:20.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f499a7fc640 1 -- 172.21.15.104:0/2965273542 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49a41049d0 con 0x7f499c03a0a0 2024-05-08T04:21:20.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f5694ff9640 1 -- 172.21.15.104:0/4256052347 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f568c001030 con 0x7f56a00d5a60 2024-05-08T04:21:20.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7fe956ffd640 1 --2- 172.21.15.104:0/4089550888 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe94406b520 0x7fe94406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f18cb7fe640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18c40540f0 0x7f18c40ddb00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f18b8031000 tx=0x7f18b80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7fe956ffd640 1 -- 172.21.15.104:0/4089550888 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe960104b30 con 0x7fe9580eacf0 2024-05-08T04:21:20.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7fe956ffd640 1 --2- 172.21.15.104:0/4089550888 >> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] conn(0x7fe9440736c0 0x7fe944075ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7fe956ffd640 1 -- 172.21.15.104:0/4089550888 --> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe944076190 con 0x7fe9440736c0 2024-05-08T04:21:20.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7fe956ffd640 1 -- 172.21.15.104:0/4089550888 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9600cf4a0 con 0x7fe9580eacf0 2024-05-08T04:21:20.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f5696ffd640 1 --2- 172.21.15.104:0/4256052347 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f568806b5a0 0x7f568806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f5696ffd640 1 -- 172.21.15.104:0/4256052347 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f569c089e30 con 0x7f56a00d5a60 2024-05-08T04:21:20.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f5696ffd640 1 --2- 172.21.15.104:0/4256052347 >> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] conn(0x7f5688073820 0x7f5688075c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f5696ffd640 1 -- 172.21.15.104:0/4256052347 --> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56880762f0 con 0x7f5688073820 2024-05-08T04:21:20.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f5696ffd640 1 -- 172.21.15.104:0/4256052347 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f569c08f420 con 0x7f56a00d5a60 2024-05-08T04:21:20.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7fe966298640 1 --2- 172.21.15.104:0/4089550888 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe94406b520 0x7fe94406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7fe965a97640 1 --2- 172.21.15.104:0/4089550888 >> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] conn(0x7fe9440736c0 0x7fe944075ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f8936ffd640 1 -- 172.21.15.104:0/2779299853 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f893801a070 con 0x7f89400df410 2024-05-08T04:21:20.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f499a7fc640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] conn(0x7f4988073670 0x7f4988075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f0b8ed9d640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9015e080 0x7f0b901e8c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800efc0 tx=0x7f0b8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.051+0000 7f318a3c8640 1 -- 172.21.15.104:0/717617397 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c052e70 con 0x7f317c03e830 2024-05-08T04:21:20.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f318a3c8640 1 -- 172.21.15.104:0/717617397 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317c052b90 con 0x7f317c03e830 2024-05-08T04:21:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f499a7fc640 1 -- 172.21.15.104:0/2965273542 --> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49a4071e50 con 0x7f4988073670 2024-05-08T04:21:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f49aa250640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] conn(0x7f4988073670 0x7f4988075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f3179ffb640 1 -- 172.21.15.104:0/717617397 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31840b3040 con 0x7f317c03e830 2024-05-08T04:21:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7fe966298640 1 --2- 172.21.15.104:0/4089550888 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe94406b520 0x7fe94406d9e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe95c034000 tx=0x7fe95c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f318a3c8640 1 -- 172.21.15.104:0/717617397 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f317c050f40 con 0x7f317c03e830 2024-05-08T04:21:20.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f0b7effd640 1 -- 172.21.15.104:0/2675790302 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88018020 con 0x7f0b9015e080 2024-05-08T04:21:20.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f56a659c640 1 --2- 172.21.15.104:0/4256052347 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f568806b5a0 0x7f568806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f0b7effd640 1 -- 172.21.15.104:0/2675790302 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88014480 con 0x7f0b9015e080 2024-05-08T04:21:20.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7fe965a97640 1 --2- 172.21.15.104:0/4089550888 >> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] conn(0x7fe9440736c0 0x7fe944075ae0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f894cfb0640 1 -- 172.21.15.104:0/2779299853 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8940005380 con 0x7f89400df410 2024-05-08T04:21:20.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f49a9a4f640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f498806b4d0 0x7f498806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.052+0000 7f499a7fc640 1 -- 172.21.15.104:0/2965273542 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49a40cf3e0 con 0x7f499c03a0a0 2024-05-08T04:21:20.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f49aa250640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] conn(0x7f4988073670 0x7f4988075a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f49a9a4f640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f498806b4d0 0x7f498806d990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f499c039a00 tx=0x7f4994008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f53aa59c640 1 -- 172.21.15.104:0/2827759773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53a4053c60 msgr2=0x7f53a40491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f8936ffd640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f892806b4d0 0x7f892806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f53aa59c640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53a4053c60 0x7f53a40491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f53aa59c640 1 -- 172.21.15.104:0/2827759773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53a40df210 msgr2=0x7f53a40354e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f18c8ff9640 1 -- 172.21.15.104:0/1401788092 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b8040070 con 0x7f18c40540f0 2024-05-08T04:21:20.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f18c8ff9640 1 -- 172.21.15.104:0/1401788092 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b803b870 con 0x7f18c40540f0 2024-05-08T04:21:20.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f53aa59c640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53a40df210 0x7f53a40354e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f53aa59c640 1 -- 172.21.15.104:0/2827759773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a40e1630 con 0x7f53a4050190 2024-05-08T04:21:20.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f53aa59c640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53a4050190 0x7f53a41758f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f539c00c440 tx=0x7f539c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f8936ffd640 1 -- 172.21.15.104:0/2779299853 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f893808a120 con 0x7f89400df410 2024-05-08T04:21:20.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f894659c640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f892806b4d0 0x7f892806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f56a659c640 1 --2- 172.21.15.104:0/4256052347 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f568806b5a0 0x7f568806da60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56a0007a60 tx=0x7f5698008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f539affd640 1 -- 172.21.15.104:0/2827759773 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c017070 con 0x7f53a4050190 2024-05-08T04:21:20.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f8936ffd640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] conn(0x7f8928073670 0x7f8928075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f0b7effd640 1 -- 172.21.15.104:0/2675790302 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88014870 con 0x7f0b9015e080 2024-05-08T04:21:20.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.053+0000 7f0b8f59e640 1 -- 172.21.15.104:0/2675790302 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9015f360 con 0x7f0b9015e080 2024-05-08T04:21:20.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f0b8f59e640 1 -- 172.21.15.104:0/2675790302 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9015f920 con 0x7f0b9015e080 2024-05-08T04:21:20.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f3179ffb640 1 -- 172.21.15.104:0/717617397 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840b7810 con 0x7f317c03e830 2024-05-08T04:21:20.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f18c8ff9640 1 -- 172.21.15.104:0/1401788092 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b8036040 con 0x7f18c40540f0 2024-05-08T04:21:20.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f18d13f8640 1 -- 172.21.15.104:0/1401788092 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c416ceb0 con 0x7f18c40540f0 2024-05-08T04:21:20.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f18d13f8640 1 -- 172.21.15.104:0/1401788092 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c417d540 con 0x7f18c40540f0 2024-05-08T04:21:20.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f8945d9b640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] conn(0x7f8928073670 0x7f8928075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f894659c640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f892806b4d0 0x7f892806d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f893c00a8c0 tx=0x7f893c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.055+0000 7f8936ffd640 1 -- 172.21.15.104:0/2779299853 --> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8928076140 con 0x7f8928073670 2024-05-08T04:21:20.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.055+0000 7f8936ffd640 1 -- 172.21.15.104:0/2779299853 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8938091050 con 0x7f89400df410 2024-05-08T04:21:20.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7fe956ffd640 1 -- 172.21.15.104:0/4089550888 <== osd.6 v2:172.21.15.183:6824/1610978569 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe944076190 con 0x7fe9440736c0 2024-05-08T04:21:20.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.055+0000 7f56a6d9d640 1 --2- 172.21.15.104:0/4256052347 >> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] conn(0x7f5688073820 0x7f5688075c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.055+0000 7f499a7fc640 1 -- 172.21.15.104:0/2965273542 <== osd.0 v2:172.21.15.104:6808/3224694674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f49a4071e50 con 0x7f4988073670 2024-05-08T04:21:20.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f539affd640 1 -- 172.21.15.104:0/2827759773 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c005ce0 con 0x7f53a4050190 2024-05-08T04:21:20.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.054+0000 7f539affd640 1 -- 172.21.15.104:0/2827759773 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c007310 con 0x7f53a4050190 2024-05-08T04:21:20.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.055+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a4048710 con 0x7f53a4050190 2024-05-08T04:21:20.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.055+0000 7f18d13f8640 1 -- 172.21.15.104:0/1401788092 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18c404f330 con 0x7f18c40540f0 2024-05-08T04:21:20.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.055+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a4049730 con 0x7f53a4050190 2024-05-08T04:21:20.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.055+0000 7f0b8f59e640 1 -- 172.21.15.104:0/2675790302 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0b90074fa0 con 0x7f0b9015e080 2024-05-08T04:21:20.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.055+0000 7f56a6d9d640 1 --2- 172.21.15.104:0/4256052347 >> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] conn(0x7f5688073820 0x7f5688075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.055+0000 7f8945d9b640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] conn(0x7f8928073670 0x7f8928075a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.056+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f53a40e1910 con 0x7f53a4050190 2024-05-08T04:21:20.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.056+0000 7f3179ffb640 1 -- 172.21.15.104:0/717617397 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f31840c0030 con 0x7f317c03e830 2024-05-08T04:21:20.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.056+0000 7f5696ffd640 1 -- 172.21.15.104:0/4256052347 <== osd.4 v2:172.21.15.183:6800/3103695044 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f56880762f0 con 0x7f5688073820 2024-05-08T04:21:20.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.056+0000 7f0b7effd640 1 -- 172.21.15.104:0/2675790302 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0b88005d10 con 0x7f0b9015e080 2024-05-08T04:21:20.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.057+0000 7f8936ffd640 1 -- 172.21.15.104:0/2779299853 <== osd.1 v2:172.21.15.104:6800/3900877386 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8928076140 con 0x7f8928073670 2024-05-08T04:21:20.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.057+0000 7f0b7effd640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0b7006b5a0 0x7f0b7006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.057+0000 7f3179ffb640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f316806b5a0 0x7f316806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.057+0000 7f0b7effd640 1 -- 172.21.15.104:0/2675790302 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b8808aea0 con 0x7f0b9015e080 2024-05-08T04:21:20.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.057+0000 7f0b7effd640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] conn(0x7f0b700737c0 0x7f0b70075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.057+0000 7f3179ffb640 1 -- 172.21.15.104:0/717617397 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3184125bf0 con 0x7f317c03e830 2024-05-08T04:21:20.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.057+0000 7f3179ffb640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] conn(0x7f31680737c0 0x7f3168075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.057+0000 7f3179ffb640 1 -- 172.21.15.104:0/717617397 --> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3184070f30 con 0x7f31680737c0 2024-05-08T04:21:20.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.057+0000 7f3179ffb640 1 -- 172.21.15.104:0/717617397 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3184125fe0 con 0x7f317c03e830 2024-05-08T04:21:20.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.057+0000 7f18c8ff9640 1 -- 172.21.15.104:0/1401788092 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f18b8043070 con 0x7f18c40540f0 2024-05-08T04:21:20.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.057+0000 7f0b8e59c640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0b7006b5a0 0x7f0b7006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.057+0000 7f3188bc5640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f316806b5a0 0x7f316806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.058+0000 7f539affd640 1 -- 172.21.15.104:0/2827759773 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f539c01a070 con 0x7f53a4050190 2024-05-08T04:21:20.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.058+0000 7f18c8ff9640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f18b006b5a0 0x7f18b006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.058+0000 7f18c8ff9640 1 -- 172.21.15.104:0/1401788092 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18b80ab110 con 0x7f18c40540f0 2024-05-08T04:21:20.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.058+0000 7f18c8ff9640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] conn(0x7f18b0073820 0x7f18b0075c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.058+0000 7f18cbfff640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f18b006b5a0 0x7f18b006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.058+0000 7f18c8ff9640 1 -- 172.21.15.104:0/1401788092 --> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18b00762f0 con 0x7f18b0073820 2024-05-08T04:21:20.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.058+0000 7f18c8ff9640 1 -- 172.21.15.104:0/1401788092 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18b80ab500 con 0x7f18c40540f0 2024-05-08T04:21:20.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.058+0000 7f18d0bf7640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] conn(0x7f18b0073820 0x7f18b0075c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.058+0000 7f3188bc5640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f316806b5a0 0x7f316806da60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3174006fd0 tx=0x7f3174008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.059+0000 7f18d0bf7640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] conn(0x7f18b0073820 0x7f18b0075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.059+0000 7f18cbfff640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f18b006b5a0 0x7f18b006da60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18cc06a1d0 tx=0x7f18cc073ee0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.058+0000 7f539affd640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f538c06b520 0x7f538c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.059+0000 7f539affd640 1 -- 172.21.15.104:0/2827759773 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f539c089510 con 0x7f53a4050190 2024-05-08T04:21:20.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.059+0000 7f53a9d9b640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f538c06b520 0x7f538c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.059+0000 7f539affd640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] conn(0x7f538c073740 0x7f538c075b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.059+0000 7f539affd640 1 -- 172.21.15.104:0/2827759773 --> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f539c010e50 con 0x7f538c073740 2024-05-08T04:21:20.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.059+0000 7f539affd640 1 -- 172.21.15.104:0/2827759773 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f539c090050 con 0x7f53a4050190 2024-05-08T04:21:20.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.059+0000 7f53aad9d640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] conn(0x7f538c073740 0x7f538c075b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.059+0000 7f53aad9d640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] conn(0x7f538c073740 0x7f538c075b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.060+0000 7f18c8ff9640 1 -- 172.21.15.104:0/1401788092 <== osd.3 v2:172.21.15.104:6816/2847992975 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f18b00762f0 con 0x7f18b0073820 2024-05-08T04:21:20.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.060+0000 7f53a9d9b640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f538c06b520 0x7f538c06d9e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53a0034000 tx=0x7f53a002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.060+0000 7f3189bc7640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] conn(0x7f31680737c0 0x7f3168075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.060+0000 7f0b7effd640 1 -- 172.21.15.104:0/2675790302 --> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b8801ee50 con 0x7f0b700737c0 2024-05-08T04:21:20.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.060+0000 7f0b7effd640 1 -- 172.21.15.104:0/2675790302 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b8808d500 con 0x7f0b9015e080 2024-05-08T04:21:20.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.060+0000 7f0b8dd9b640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] conn(0x7f0b700737c0 0x7f0b70075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.060+0000 7f3189bc7640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] conn(0x7f31680737c0 0x7f3168075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.060+0000 7f0b8dd9b640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] conn(0x7f0b700737c0 0x7f0b70075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.061+0000 7f539affd640 1 -- 172.21.15.104:0/2827759773 <== osd.2 v2:172.21.15.104:6824/2587310492 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f539c010e50 con 0x7f538c073740 2024-05-08T04:21:20.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.061+0000 7f0b8e59c640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0b7006b5a0 0x7f0b7006da60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0b84007fd0 tx=0x7f0b84007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.061+0000 7f3179ffb640 1 -- 172.21.15.104:0/717617397 <== osd.7 v2:172.21.15.183:6816/2951178506 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3184070f30 con 0x7f31680737c0 2024-05-08T04:21:20.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.061+0000 7f0b7effd640 1 -- 172.21.15.104:0/2675790302 <== osd.5 v2:172.21.15.183:6808/1596442327 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0b8801ee50 con 0x7f0b700737c0 2024-05-08T04:21:20.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.084+0000 7fe954ff9640 1 -- 172.21.15.104:0/4089550888 --> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe958048a10 con 0x7fe9440736c0 2024-05-08T04:21:20.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.084+0000 7fe956ffd640 1 -- 172.21.15.104:0/4089550888 <== osd.6 v2:172.21.15.183:6824/1610978569 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe958048a10 con 0x7fe9440736c0 2024-05-08T04:21:20.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.085+0000 7fe9684fc640 1 -- 172.21.15.104:0/4089550888 >> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] conn(0x7fe9440736c0 msgr2=0x7fe944075ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.085+0000 7fe9684fc640 1 --2- 172.21.15.104:0/4089550888 >> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] conn(0x7fe9440736c0 0x7fe944075ae0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.085+0000 7fe9684fc640 1 -- 172.21.15.104:0/4089550888 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe94406b520 msgr2=0x7fe94406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.085+0000 7fe9684fc640 1 --2- 172.21.15.104:0/4089550888 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe94406b520 0x7fe94406d9e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe95c034000 tx=0x7fe95c02e000 comp rx=0 tx=0).stop 2024-05-08T04:21:20.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.086+0000 7fe9684fc640 1 -- 172.21.15.104:0/4089550888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9580eacf0 msgr2=0x7fe95804a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.086+0000 7fe9684fc640 1 --2- 172.21.15.104:0/4089550888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9580eacf0 0x7fe95804a880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe9600690a0 tx=0x7fe960074370 comp rx=0 tx=0).stop 2024-05-08T04:21:20.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.086+0000 7fe966a99640 1 -- 172.21.15.104:0/4089550888 reap_dead start 2024-05-08T04:21:20.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.086+0000 7fe9684fc640 1 -- 172.21.15.104:0/4089550888 shutdown_connections 2024-05-08T04:21:20.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.086+0000 7fe9684fc640 1 -- 172.21.15.104:0/4089550888 >> 172.21.15.104:0/4089550888 conn(0x7fe958009fa0 msgr2=0x7fe958052c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.086+0000 7f49aaa51640 1 -- 172.21.15.104:0/2965273542 --> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f499c033cc0 con 0x7f4988073670 2024-05-08T04:21:20.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.086+0000 7fe9684fc640 1 -- 172.21.15.104:0/4089550888 shutdown_connections 2024-05-08T04:21:20.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.086+0000 7fe9684fc640 1 -- 172.21.15.104:0/4089550888 wait complete. 2024-05-08T04:21:20.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.086+0000 7f499a7fc640 1 -- 172.21.15.104:0/2965273542 <== osd.0 v2:172.21.15.104:6808/3224694674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f499c033cc0 con 0x7f4988073670 2024-05-08T04:21:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.088+0000 7f49aaa51640 1 -- 172.21.15.104:0/2965273542 >> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] conn(0x7f4988073670 msgr2=0x7f4988075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.088+0000 7f49aaa51640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] conn(0x7f4988073670 0x7f4988075a90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.088+0000 7f49aaa51640 1 -- 172.21.15.104:0/2965273542 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f498806b4d0 msgr2=0x7f498806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.088+0000 7f49aaa51640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f498806b4d0 0x7f498806d990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f499c039a00 tx=0x7f4994008040 comp rx=0 tx=0).stop 2024-05-08T04:21:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.088+0000 7f49aaa51640 1 -- 172.21.15.104:0/2965273542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f499c03a0a0 msgr2=0x7f499c1858b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.088+0000 7f49aaa51640 1 --2- 172.21.15.104:0/2965273542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f499c03a0a0 0x7f499c1858b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f49a4069860 tx=0x7f49a4074370 comp rx=0 tx=0).stop 2024-05-08T04:21:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.088+0000 7f49aa250640 1 -- 172.21.15.104:0/2965273542 reap_dead start 2024-05-08T04:21:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.089+0000 7f49aaa51640 1 -- 172.21.15.104:0/2965273542 shutdown_connections 2024-05-08T04:21:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.089+0000 7f49aaa51640 1 -- 172.21.15.104:0/2965273542 >> 172.21.15.104:0/2965273542 conn(0x7f499c01e6c0 msgr2=0x7f499c037810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.090+0000 7f5694ff9640 1 -- 172.21.15.104:0/4256052347 --> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f568c002dd0 con 0x7f5688073820 2024-05-08T04:21:20.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.090+0000 7f49aaa51640 1 -- 172.21.15.104:0/2965273542 shutdown_connections 2024-05-08T04:21:20.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.090+0000 7f49aaa51640 1 -- 172.21.15.104:0/2965273542 wait complete. 2024-05-08T04:21:20.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.090+0000 7f5696ffd640 1 -- 172.21.15.104:0/4256052347 <== osd.4 v2:172.21.15.183:6800/3103695044 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f568c002dd0 con 0x7f5688073820 2024-05-08T04:21:20.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.091+0000 7f5694ff9640 1 -- 172.21.15.104:0/4256052347 >> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] conn(0x7f5688073820 msgr2=0x7f5688075c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.091+0000 7f894cfb0640 1 -- 172.21.15.104:0/2779299853 --> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f894004f370 con 0x7f8928073670 2024-05-08T04:21:20.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.091+0000 7f5694ff9640 1 --2- 172.21.15.104:0/4256052347 >> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] conn(0x7f5688073820 0x7f5688075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.091+0000 7f5694ff9640 1 -- 172.21.15.104:0/4256052347 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f568806b5a0 msgr2=0x7f568806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.091+0000 7f5694ff9640 1 --2- 172.21.15.104:0/4256052347 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f568806b5a0 0x7f568806da60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56a0007a60 tx=0x7f5698008040 comp rx=0 tx=0).stop 2024-05-08T04:21:20.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.091+0000 7f0b8f59e640 1 -- 172.21.15.104:0/2675790302 --> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0b90074610 con 0x7f0b700737c0 2024-05-08T04:21:20.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.091+0000 7f5694ff9640 1 -- 172.21.15.104:0/4256052347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56a00d5a60 msgr2=0x7f56a00c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.091+0000 7f5694ff9640 1 --2- 172.21.15.104:0/4256052347 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56a00d5a60 0x7f56a00c8520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f569c00e870 tx=0x7f569c00ed30 comp rx=0 tx=0).stop 2024-05-08T04:21:20.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.091+0000 7f56a6d9d640 1 -- 172.21.15.104:0/4256052347 reap_dead start 2024-05-08T04:21:20.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.091+0000 7f18d13f8640 1 -- 172.21.15.104:0/1401788092 --> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18c404f330 con 0x7f18b0073820 2024-05-08T04:21:20.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.091+0000 7f5694ff9640 1 -- 172.21.15.104:0/4256052347 shutdown_connections 2024-05-08T04:21:20.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.091+0000 7f5694ff9640 1 -- 172.21.15.104:0/4256052347 >> 172.21.15.104:0/4256052347 conn(0x7f56a0009fe0 msgr2=0x7f56a00e3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f8936ffd640 1 -- 172.21.15.104:0/2779299853 <== osd.1 v2:172.21.15.104:6800/3900877386 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f894004f370 con 0x7f8928073670 2024-05-08T04:21:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f0b7effd640 1 -- 172.21.15.104:0/2675790302 <== osd.5 v2:172.21.15.183:6808/1596442327 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0b90074610 con 0x7f0b700737c0 2024-05-08T04:21:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f5694ff9640 1 -- 172.21.15.104:0/4256052347 shutdown_connections 2024-05-08T04:21:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f18c8ff9640 1 -- 172.21.15.104:0/1401788092 <== osd.3 v2:172.21.15.104:6816/2847992975 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f18c0009800 con 0x7f18b0073820 2024-05-08T04:21:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f894cfb0640 1 -- 172.21.15.104:0/2779299853 >> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] conn(0x7f8928073670 msgr2=0x7f8928075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f894cfb0640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] conn(0x7f8928073670 0x7f8928075a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f5694ff9640 1 -- 172.21.15.104:0/4256052347 wait complete. 2024-05-08T04:21:20.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f318a3c8640 1 -- 172.21.15.104:0/717617397 --> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f317c0057d0 con 0x7f31680737c0 2024-05-08T04:21:20.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f894cfb0640 1 -- 172.21.15.104:0/2779299853 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f892806b4d0 msgr2=0x7f892806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f894cfb0640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f892806b4d0 0x7f892806d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f893c00a8c0 tx=0x7f893c02f000 comp rx=0 tx=0).stop 2024-05-08T04:21:20.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f894cfb0640 1 -- 172.21.15.104:0/2779299853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89400df410 msgr2=0x7f8940036b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f894cfb0640 1 --2- 172.21.15.104:0/2779299853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89400df410 0x7f8940036b20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f893800e820 tx=0x7f893800ece0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f0b8f59e640 1 -- 172.21.15.104:0/2675790302 >> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] conn(0x7f0b700737c0 msgr2=0x7f0b70075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f0b8f59e640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] conn(0x7f0b700737c0 0x7f0b70075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.092+0000 7f8946d9d640 1 -- 172.21.15.104:0/2779299853 reap_dead start 2024-05-08T04:21:20.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f894cfb0640 1 -- 172.21.15.104:0/2779299853 shutdown_connections 2024-05-08T04:21:20.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f894cfb0640 1 -- 172.21.15.104:0/2779299853 >> 172.21.15.104:0/2779299853 conn(0x7f8940009fa0 msgr2=0x7f8940035d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f3179ffb640 1 -- 172.21.15.104:0/717617397 <== osd.7 v2:172.21.15.183:6816/2951178506 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f317c0057d0 con 0x7f31680737c0 2024-05-08T04:21:20.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f894cfb0640 1 -- 172.21.15.104:0/2779299853 shutdown_connections 2024-05-08T04:21:20.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f894cfb0640 1 -- 172.21.15.104:0/2779299853 wait complete. 2024-05-08T04:21:20.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f0b8f59e640 1 -- 172.21.15.104:0/2675790302 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0b7006b5a0 msgr2=0x7f0b7006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f0b8f59e640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0b7006b5a0 0x7f0b7006da60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0b84007fd0 tx=0x7f0b84007e80 comp rx=0 tx=0).stop 2024-05-08T04:21:20.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f0b8f59e640 1 -- 172.21.15.104:0/2675790302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9015e080 msgr2=0x7f0b901e8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f0b8f59e640 1 --2- 172.21.15.104:0/2675790302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b9015e080 0x7f0b901e8c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800efc0 tx=0x7f0b8800c490 comp rx=0 tx=0).stop 2024-05-08T04:21:20.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f0b8ed9d640 1 -- 172.21.15.104:0/2675790302 reap_dead start 2024-05-08T04:21:20.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f0b8f59e640 1 -- 172.21.15.104:0/2675790302 shutdown_connections 2024-05-08T04:21:20.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f0b8f59e640 1 -- 172.21.15.104:0/2675790302 >> 172.21.15.104:0/2675790302 conn(0x7f0b900d04f0 msgr2=0x7f0b900b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f0b8f59e640 1 -- 172.21.15.104:0/2675790302 shutdown_connections 2024-05-08T04:21:20.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f0b8f59e640 1 -- 172.21.15.104:0/2675790302 wait complete. 2024-05-08T04:21:20.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f18b67fc640 1 -- 172.21.15.104:0/1401788092 >> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] conn(0x7f18b0073820 msgr2=0x7f18b0075c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f18b67fc640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] conn(0x7f18b0073820 0x7f18b0075c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f18b67fc640 1 -- 172.21.15.104:0/1401788092 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f18b006b5a0 msgr2=0x7f18b006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f18b67fc640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f18b006b5a0 0x7f18b006da60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18cc06a1d0 tx=0x7f18cc073ee0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f18b67fc640 1 -- 172.21.15.104:0/1401788092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18c40540f0 msgr2=0x7f18c40ddb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f18b67fc640 1 --2- 172.21.15.104:0/1401788092 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18c40540f0 0x7f18c40ddb00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f18b8031000 tx=0x7f18b80046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f316f7fe640 1 -- 172.21.15.104:0/717617397 >> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] conn(0x7f31680737c0 msgr2=0x7f3168075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f316f7fe640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] conn(0x7f31680737c0 0x7f3168075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.093+0000 7f18d0bf7640 1 -- 172.21.15.104:0/1401788092 reap_dead start 2024-05-08T04:21:20.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.094+0000 7f18b67fc640 1 -- 172.21.15.104:0/1401788092 shutdown_connections 2024-05-08T04:21:20.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.094+0000 7f18b67fc640 1 -- 172.21.15.104:0/1401788092 >> 172.21.15.104:0/1401788092 conn(0x7f18c40559a0 msgr2=0x7f18c4057890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.094+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 --> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f53a40499c0 con 0x7f538c073740 2024-05-08T04:21:20.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.094+0000 7f316f7fe640 1 -- 172.21.15.104:0/717617397 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f316806b5a0 msgr2=0x7f316806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.094+0000 7f316f7fe640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f316806b5a0 0x7f316806da60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3174006fd0 tx=0x7f3174008040 comp rx=0 tx=0).stop 2024-05-08T04:21:20.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.094+0000 7f316f7fe640 1 -- 172.21.15.104:0/717617397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f317c03e830 msgr2=0x7f317c050200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.094+0000 7f316f7fe640 1 --2- 172.21.15.104:0/717617397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f317c03e830 0x7f317c050200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f318406a1d0 tx=0x7f318406a9a0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.094+0000 7f3189bc7640 1 -- 172.21.15.104:0/717617397 reap_dead start 2024-05-08T04:21:20.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.094+0000 7f316f7fe640 1 -- 172.21.15.104:0/717617397 shutdown_connections 2024-05-08T04:21:20.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.094+0000 7f316f7fe640 1 -- 172.21.15.104:0/717617397 >> 172.21.15.104:0/717617397 conn(0x7f317c0559d0 msgr2=0x7f317c039f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.094+0000 7f316f7fe640 1 -- 172.21.15.104:0/717617397 shutdown_connections 2024-05-08T04:21:20.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.094+0000 7f316f7fe640 1 -- 172.21.15.104:0/717617397 wait complete. 2024-05-08T04:21:20.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.095+0000 7f539affd640 1 -- 172.21.15.104:0/2827759773 <== osd.2 v2:172.21.15.104:6824/2587310492 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f53a40499c0 con 0x7f538c073740 2024-05-08T04:21:20.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.095+0000 7f18b67fc640 1 -- 172.21.15.104:0/1401788092 shutdown_connections 2024-05-08T04:21:20.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.095+0000 7f18b67fc640 1 -- 172.21.15.104:0/1401788092 wait complete. 2024-05-08T04:21:20.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.096+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 >> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] conn(0x7f538c073740 msgr2=0x7f538c075b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.096+0000 7f53ab59e640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] conn(0x7f538c073740 0x7f538c075b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.097+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f538c06b520 msgr2=0x7f538c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.097+0000 7f53ab59e640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f538c06b520 0x7f538c06d9e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53a0034000 tx=0x7f53a002e000 comp rx=0 tx=0).stop 2024-05-08T04:21:20.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.097+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53a4050190 msgr2=0x7f53a41758f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.097+0000 7f53ab59e640 1 --2- 172.21.15.104:0/2827759773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53a4050190 0x7f53a41758f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f539c00c440 tx=0x7f539c00c840 comp rx=0 tx=0).stop 2024-05-08T04:21:20.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.098+0000 7f53aad9d640 1 -- 172.21.15.104:0/2827759773 reap_dead start 2024-05-08T04:21:20.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.098+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 shutdown_connections 2024-05-08T04:21:20.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.098+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 >> 172.21.15.104:0/2827759773 conn(0x7f53a4009fa0 msgr2=0x7f53a40db6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.098+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 shutdown_connections 2024-05-08T04:21:20.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.098+0000 7f53ab59e640 1 -- 172.21.15.104:0/2827759773 wait complete. 2024-05-08T04:21:20.187 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2024-05-08T04:21:20.187 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T04:21:20.188 INFO:teuthology.orchestra.run.smithi104.stdout:55834574856 2024-05-08T04:21:20.188 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T04:21:20.189 INFO:teuthology.orchestra.run.smithi104.stdout:55834574857 2024-05-08T04:21:20.190 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T04:21:20.191 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2024-05-08T04:21:20.191 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T04:21:20.192 INFO:teuthology.orchestra.run.smithi104.stdout:55834574856 2024-05-08T04:21:20.192 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T04:21:20.193 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2024-05-08T04:21:20.193 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T04:21:20.194 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2024-05-08T04:21:20.194 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T04:21:20.195 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2024-05-08T04:21:20.196 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T04:21:20.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.398+0000 7fdc756bc640 1 Processor -- start 2024-05-08T04:21:20.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.396+0000 7f5dc6458640 1 Processor -- start 2024-05-08T04:21:20.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.396+0000 7f5dc6458640 1 -- start start 2024-05-08T04:21:20.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.398+0000 7f5dc6458640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5dc008a830 0x7f5dc00b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.398+0000 7f5dc6458640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc00b3850 con 0x7f5dc0071490 2024-05-08T04:21:20.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.398+0000 7f5dc6458640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc00b2470 con 0x7f5dc0071000 2024-05-08T04:21:20.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.398+0000 7f5dc6458640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc00b2a30 con 0x7f5dc008a830 2024-05-08T04:21:20.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.398+0000 7f9c679b7640 1 Processor -- start 2024-05-08T04:21:20.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.398+0000 7f9c679b7640 1 -- start start 2024-05-08T04:21:20.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.398+0000 7f5dbffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5dc008a830 0x7f5dc00b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.398+0000 7f5dbf7fe640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f5dc0071000 0x7f5dc016b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:35134/0 (socket says 172.21.15.104:35134) 2024-05-08T04:21:20.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.398+0000 7f5dbf7fe640 1 -- 172.21.15.104:0/1744333022 learned_addr learned my addr 172.21.15.104:0/1744333022 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:20.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.399+0000 7fdc756bc640 1 -- start start 2024-05-08T04:21:20.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.399+0000 7f5dbeffd640 1 -- 172.21.15.104:0/1744333022 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218281527 0 0) 0x7f5dc00b2470 con 0x7f5dc0071000 2024-05-08T04:21:20.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.399+0000 7f5dbeffd640 1 -- 172.21.15.104:0/1744333022 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5da8003520 con 0x7f5dc0071000 2024-05-08T04:21:20.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.399+0000 7f5dbeffd640 1 -- 172.21.15.104:0/1744333022 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3525469139 0 0) 0x7f5da8003520 con 0x7f5dc0071000 2024-05-08T04:21:20.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.399+0000 7f5dbffff640 1 -- 172.21.15.104:0/1744333022 >> v1:172.21.15.183:6789/0 conn(0x7f5dc0071000 legacy=0x7f5dc016b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.399+0000 7f5dbffff640 1 -- 172.21.15.104:0/1744333022 >> v1:172.21.15.104:6789/0 conn(0x7f5dc0071490 legacy=0x7f5dc016c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.399+0000 7f5dbffff640 1 -- 172.21.15.104:0/1744333022 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc0171150 con 0x7f5dc008a830 2024-05-08T04:21:20.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.399+0000 7f0dc5453640 1 Processor -- start 2024-05-08T04:21:20.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f43da109640 1 Processor -- start 2024-05-08T04:21:20.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7fd160a06640 1 Processor -- start 2024-05-08T04:21:20.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f9c679b7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9c58050210 0x7f9c58050670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f82c2fe2640 1 Processor -- start 2024-05-08T04:21:20.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f82c2fe2640 1 -- start start 2024-05-08T04:21:20.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f9c679b7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c58008990 0x7f9c58008e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f9c679b7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5803a240 con 0x7f9c580085b0 2024-05-08T04:21:20.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f9c679b7640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5803ae50 con 0x7f9c58050210 2024-05-08T04:21:20.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f9c679b7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5803a520 con 0x7f9c58008990 2024-05-08T04:21:20.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f9c65753640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f9c580085b0 0x7f9c5803b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:35142/0 (socket says 172.21.15.104:35142) 2024-05-08T04:21:20.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f9c65753640 1 -- 172.21.15.104:0/4225322566 learned_addr learned my addr 172.21.15.104:0/4225322566 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:20.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f9c64f52640 1 --2- 172.21.15.104:0/4225322566 >> v2:172.21.15.104:3300/0 conn(0x7f9c58050210 0x7f9c58050670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7fd160a06640 1 -- start start 2024-05-08T04:21:20.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f0dc5453640 1 -- start start 2024-05-08T04:21:20.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f0dc5453640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0db80e30b0 0x7f0db8057d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f0dc5453640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0db80542f0 0x7f0db80068c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f0dc5453640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db80582c0 con 0x7f0db803e830 2024-05-08T04:21:20.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f0dc5453640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db8058560 con 0x7f0db80e30b0 2024-05-08T04:21:20.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f0dc5453640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db8058840 con 0x7f0db80542f0 2024-05-08T04:21:20.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f9c65f54640 1 --2- 172.21.15.104:0/4225322566 >> v2:172.21.15.183:3300/0 conn(0x7f9c58008990 0x7f9c58008e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f0dbeffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0db80e30b0 0x7f0db8057d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f0dbeffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0db80e30b0 0x7f0db8057d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33938/0 (socket says 172.21.15.104:33938) 2024-05-08T04:21:20.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f0dbeffd640 1 -- 172.21.15.104:0/1112756084 learned_addr learned my addr 172.21.15.104:0/1112756084 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f9c57fff640 1 -- 172.21.15.104:0/4225322566 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949005923 0 0) 0x7f9c5803a240 con 0x7f9c580085b0 2024-05-08T04:21:20.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f9c57fff640 1 -- 172.21.15.104:0/4225322566 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c4c00bd30 con 0x7f9c580085b0 2024-05-08T04:21:20.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f9c65f54640 1 -- 172.21.15.104:0/4225322566 >> v2:172.21.15.104:3300/0 conn(0x7f9c58050210 msgr2=0x7f9c58050670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f9c65f54640 1 --2- 172.21.15.104:0/4225322566 >> v2:172.21.15.104:3300/0 conn(0x7f9c58050210 0x7f9c58050670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f9c65f54640 1 -- 172.21.15.104:0/4225322566 >> v1:172.21.15.183:6789/0 conn(0x7f9c580085b0 legacy=0x7f9c5803b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f9c65f54640 1 -- 172.21.15.104:0/4225322566 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5803a800 con 0x7f9c58008990 2024-05-08T04:21:20.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7f43da109640 1 -- start start 2024-05-08T04:21:20.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f5dbffff640 1 --2- 172.21.15.104:0/1744333022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc008a830 0x7f5dc00b2f80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009720 tx=0x7f5db402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2d1684158e46c0c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f5dbeffd640 1 -- 172.21.15.104:0/1744333022 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4037070 con 0x7f5dc008a830 2024-05-08T04:21:20.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f5dbeffd640 1 -- 172.21.15.104:0/1744333022 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db402aaf0 con 0x7f5dc008a830 2024-05-08T04:21:20.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f5dbeffd640 1 -- 172.21.15.104:0/1744333022 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4037070 con 0x7f5dc008a830 2024-05-08T04:21:20.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f0dbf7fe640 1 --2- 172.21.15.104:0/1112756084 >> v2:172.21.15.183:3300/0 conn(0x7f0db80542f0 0x7f0db80068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f0dbeffd640 1 -- 172.21.15.104:0/1112756084 >> v2:172.21.15.183:3300/0 conn(0x7f0db80542f0 msgr2=0x7f0db80068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f43da109640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f43d40d4380 0x7f43d40d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7f43da109640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f43d40d0760 0x7f43d40b7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7fdc756bc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc700ce000 0x7fdc700ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7fdc756bc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdc700b1460 0x7fdc700b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7fdc756bc640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc700b2190 con 0x7fdc7015b940 2024-05-08T04:21:20.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7fdc756bc640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc700ce9a0 con 0x7fdc700b1460 2024-05-08T04:21:20.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7fdc756bc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700b2470 con 0x7fdc700ce000 2024-05-08T04:21:20.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.400+0000 7fdc6f7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdc700b1460 0x7fdc700b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7fdc6e7fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc700ce000 0x7fdc700ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7fdc6e7fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc700ce000 0x7fdc700ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:56038/0 (socket says 172.21.15.104:56038) 2024-05-08T04:21:20.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.401+0000 7fdc6e7fc640 1 -- 172.21.15.104:0/3653112107 learned_addr learned my addr 172.21.15.104:0/3653112107 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f0dbeffd640 1 --2- 172.21.15.104:0/1112756084 >> v2:172.21.15.183:3300/0 conn(0x7f0db80542f0 0x7f0db80068c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f0dbeffd640 1 -- 172.21.15.104:0/1112756084 >> v1:172.21.15.183:6789/0 conn(0x7f0db803e830 legacy=0x7f0db8053be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f0dbeffd640 1 -- 172.21.15.104:0/1112756084 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8058b20 con 0x7f0db80e30b0 2024-05-08T04:21:20.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f0dbf7fe640 1 --2- 172.21.15.104:0/1112756084 >> v2:172.21.15.183:3300/0 conn(0x7f0db80542f0 0x7f0db80068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:20.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f43d37fe640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f43d415dab0 0x7f43d40d1e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:35160/0 (socket says 172.21.15.104:35160) 2024-05-08T04:21:20.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f43d37fe640 1 -- 172.21.15.104:0/1062693212 learned_addr learned my addr 172.21.15.104:0/1062693212 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:20.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f82c2fe2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f82b403e870 0x7f82b4053c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f43d3fff640 1 --2- 172.21.15.104:0/1062693212 >> v2:172.21.15.183:3300/0 conn(0x7f43d40d0760 0x7f43d40b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f43da109640 1 -- 172.21.15.104:0/1062693212 --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40d2660 con 0x7f43d415dab0 2024-05-08T04:21:20.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f82c2fe2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82b4054160 0x7f82b4006900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f43da109640 1 -- 172.21.15.104:0/1062693212 --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d40b6e70 con 0x7f43d40d4380 2024-05-08T04:21:20.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f43da109640 1 -- 172.21.15.104:0/1062693212 --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d40d0b90 con 0x7f43d40d0760 2024-05-08T04:21:20.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f82bbfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f82b403e870 0x7f82b4053c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f1feb59e640 1 Processor -- start 2024-05-08T04:21:20.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7fd160a06640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd15c06d7e0 0x7fd15c0cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7fd160a06640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd15c06dc40 0x7fd15c0cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7fd160a06640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15c1623a0 con 0x7fd15c161fc0 2024-05-08T04:21:20.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7fd160a06640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15c0b2680 con 0x7fd15c06dc40 2024-05-08T04:21:20.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7fd160a06640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0b2960 con 0x7fd15c06d7e0 2024-05-08T04:21:20.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f1feb59e640 1 -- start start 2024-05-08T04:21:20.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f43d2ffd640 1 --2- 172.21.15.104:0/1062693212 >> v2:172.21.15.104:3300/0 conn(0x7f43d40d4380 0x7f43d40d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7fdc6f7fe640 1 -- 172.21.15.104:0/3653112107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc700ce000 msgr2=0x7fdc700ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7fd15ad9d640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fd15c161fc0 0x7fd15c06d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:35170/0 (socket says 172.21.15.104:35170) 2024-05-08T04:21:20.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7fd15ad9d640 1 -- 172.21.15.104:0/3616796660 learned_addr learned my addr 172.21.15.104:0/3616796660 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:20.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7fd15a59c640 1 --2- 172.21.15.104:0/3616796660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd15c06d7e0 0x7fd15c0cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f5dc6458640 1 -- 172.21.15.104:0/1744333022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc008a830 msgr2=0x7f5dc00b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f82bbfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f82b403e870 0x7f82b4053c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:53160/0 (socket says 172.21.15.104:53160) 2024-05-08T04:21:20.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f82c0d7e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f82b40e30f0 0x7f82b4057dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53170/0 (socket says 172.21.15.104:53170) 2024-05-08T04:21:20.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f82c2fe2640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b40585a0 con 0x7f82b40e30f0 2024-05-08T04:21:20.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f82c2fe2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b4058880 con 0x7f82b403e870 2024-05-08T04:21:20.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f43d2ffd640 1 -- 172.21.15.104:0/1062693212 >> v2:172.21.15.183:3300/0 conn(0x7f43d40d0760 msgr2=0x7f43d40b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f43d2ffd640 1 --2- 172.21.15.104:0/1062693212 >> v2:172.21.15.183:3300/0 conn(0x7f43d40d0760 0x7f43d40b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f43d2ffd640 1 -- 172.21.15.104:0/1062693212 >> v1:172.21.15.183:6789/0 conn(0x7f43d415dab0 legacy=0x7f43d40d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f43d2ffd640 1 -- 172.21.15.104:0/1062693212 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40b6820 con 0x7f43d40d4380 2024-05-08T04:21:20.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7fdc6f7fe640 1 --2- 172.21.15.104:0/3653112107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc700ce000 0x7fdc700ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7fdc6f7fe640 1 -- 172.21.15.104:0/3653112107 >> v1:172.21.15.104:6789/0 conn(0x7fdc7015b940 legacy=0x7fdc700cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f82c2fe2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b4058b60 con 0x7f82b4054160 2024-05-08T04:21:20.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f82bbfff640 1 -- 172.21.15.104:0/3667850703 learned_addr learned my addr 172.21.15.104:0/3667850703 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f82c157f640 1 --2- 172.21.15.104:0/3667850703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82b4054160 0x7f82b4006900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f9c65f54640 1 --2- 172.21.15.104:0/4225322566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c58008990 0x7f9c58008e20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9c60069a00 tx=0x7f9c600a51f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1b9cb03929ad0b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f9c57fff640 1 -- 172.21.15.104:0/4225322566 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c600b2070 con 0x7f9c58008990 2024-05-08T04:21:20.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f9c57fff640 1 -- 172.21.15.104:0/4225322566 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c600ad440 con 0x7f9c58008990 2024-05-08T04:21:20.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f9c57fff640 1 -- 172.21.15.104:0/4225322566 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c600ad8b0 con 0x7f9c58008990 2024-05-08T04:21:20.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7fd15a59c640 1 -- 172.21.15.104:0/3616796660 >> v2:172.21.15.104:3300/0 conn(0x7fd15c06dc40 msgr2=0x7fd15c0cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7f5dc6458640 1 --2- 172.21.15.104:0/1744333022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc008a830 0x7f5dc00b2f80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009720 tx=0x7f5db402a060 comp rx=0 tx=0).stop 2024-05-08T04:21:20.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.402+0000 7fd15b59e640 1 --2- 172.21.15.104:0/3616796660 >> v2:172.21.15.104:3300/0 conn(0x7fd15c06dc40 0x7fd15c0cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7f82bb7fe640 1 -- 172.21.15.104:0/3667850703 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037663217 0 0) 0x7f82b40585a0 con 0x7f82b40e30f0 2024-05-08T04:21:20.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7f82bb7fe640 1 -- 172.21.15.104:0/3667850703 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82ac003520 con 0x7f82b40e30f0 2024-05-08T04:21:20.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7fd159d9b640 1 -- 172.21.15.104:0/3616796660 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157748703 0 0) 0x7fd15c1623a0 con 0x7fd15c161fc0 2024-05-08T04:21:20.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7f5dc6458640 1 -- 172.21.15.104:0/1744333022 shutdown_connections 2024-05-08T04:21:20.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7f5dc6458640 1 --2- 172.21.15.104:0/1744333022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc008a830 0x7f5dc00b2f80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7f5dc6458640 1 -- 172.21.15.104:0/1744333022 >> 172.21.15.104:0/1744333022 conn(0x7f5dc0066d10 msgr2=0x7f5dc006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7f5dc6458640 1 -- 172.21.15.104:0/1744333022 shutdown_connections 2024-05-08T04:21:20.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7f82bbfff640 1 -- 172.21.15.104:0/3667850703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82b4054160 msgr2=0x7f82b4006900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7f82bbfff640 1 --2- 172.21.15.104:0/3667850703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82b4054160 0x7f82b4006900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7f82bbfff640 1 -- 172.21.15.104:0/3667850703 >> v1:172.21.15.104:6789/0 conn(0x7f82b40e30f0 legacy=0x7f82b4057dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7f82bbfff640 1 -- 172.21.15.104:0/3667850703 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b40063e0 con 0x7f82b403e870 2024-05-08T04:21:20.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7f0dbeffd640 1 --2- 172.21.15.104:0/1112756084 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db80e30b0 0x7f0db8057d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0db8056950 tx=0x7f0db002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff1575edb7992f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7f43d2ffd640 1 --2- 172.21.15.104:0/1062693212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43d40d4380 0x7f43d40d0220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43d40cde10 tx=0x7f43c802a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32e1429dfa71db8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f1feb59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fe403e830 0x7f1fe4053be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f1feb59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1fe4054120 0x7f1fe40068c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7f5dc6458640 1 -- 172.21.15.104:0/1744333022 wait complete. 2024-05-08T04:21:20.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7fd15a59c640 1 --2- 172.21.15.104:0/3616796660 >> v2:172.21.15.104:3300/0 conn(0x7fd15c06dc40 0x7fd15c0cd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7fd15a59c640 1 -- 172.21.15.104:0/3616796660 >> v1:172.21.15.183:6789/0 conn(0x7fd15c161fc0 legacy=0x7fd15c06d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7fd15a59c640 1 -- 172.21.15.104:0/3616796660 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c0b2c40 con 0x7fd15c06d7e0 2024-05-08T04:21:20.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7fd15b59e640 1 --2- 172.21.15.104:0/3616796660 >> v2:172.21.15.104:3300/0 conn(0x7fd15c06dc40 0x7fd15c0cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:20.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f1fe9d9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fe403e830 0x7f1fe4053be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f1fe9d9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fe403e830 0x7f1fe4053be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:56062/0 (socket says 172.21.15.104:56062) 2024-05-08T04:21:20.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f43d27fc640 1 -- 172.21.15.104:0/1062693212 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8037070 con 0x7f43d40d4380 2024-05-08T04:21:20.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f43d27fc640 1 -- 172.21.15.104:0/1062693212 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c802ade0 con 0x7f43d40d4380 2024-05-08T04:21:20.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f43d27fc640 1 -- 172.21.15.104:0/1062693212 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8037070 con 0x7f43d40d4380 2024-05-08T04:21:20.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f9c679b7640 1 -- 172.21.15.104:0/4225322566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c58008990 msgr2=0x7f9c58008e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f9c679b7640 1 --2- 172.21.15.104:0/4225322566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c58008990 0x7f9c58008e20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9c60069a00 tx=0x7f9c600a51f0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7fd15a59c640 1 --2- 172.21.15.104:0/3616796660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd15c06d7e0 0x7fd15c0cd450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1440097a0 tx=0x7fd14402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60c642dd6d881664 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.403+0000 7fdc6f7fe640 1 -- 172.21.15.104:0/3653112107 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc700cf2a0 con 0x7fdc700b1460 2024-05-08T04:21:20.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f9c679b7640 1 -- 172.21.15.104:0/4225322566 shutdown_connections 2024-05-08T04:21:20.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f9c679b7640 1 --2- 172.21.15.104:0/4225322566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c58008990 0x7f9c58008e20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f9c679b7640 1 --2- 172.21.15.104:0/4225322566 >> v2:172.21.15.104:3300/0 conn(0x7f9c58050210 0x7f9c58050670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f9c679b7640 1 -- 172.21.15.104:0/4225322566 >> 172.21.15.104:0/4225322566 conn(0x7f9c58055bc0 msgr2=0x7f9c58055fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f82bbfff640 1 --2- 172.21.15.104:0/3667850703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b403e870 0x7f82b4053c20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82a8013150 tx=0x7f82a8032920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2960aae96d6791bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7fd159d9b640 1 -- 172.21.15.104:0/3616796660 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144037070 con 0x7fd15c06d7e0 2024-05-08T04:21:20.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f0dbdffb640 1 -- 172.21.15.104:0/1112756084 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0037070 con 0x7f0db80e30b0 2024-05-08T04:21:20.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f0dbdffb640 1 -- 172.21.15.104:0/1112756084 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db0032440 con 0x7f0db80e30b0 2024-05-08T04:21:20.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f43d3fff640 1 --2- 172.21.15.104:0/1062693212 >> v2:172.21.15.183:3300/0 conn(0x7f43d40d0760 0x7f43d40b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:20.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7fd159d9b640 1 -- 172.21.15.104:0/3616796660 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd144032440 con 0x7fd15c06d7e0 2024-05-08T04:21:20.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f82bb7fe640 1 -- 172.21.15.104:0/3667850703 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a80114e0 con 0x7f82b403e870 2024-05-08T04:21:20.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7fdc6f7fe640 1 --2- 172.21.15.104:0/3653112107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc700b1460 0x7fdc700b18f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009d90 tx=0x7fdc6802a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57d65a101448113 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7fdc6dffb640 1 -- 172.21.15.104:0/3653112107 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68007740 con 0x7fdc700b1460 2024-05-08T04:21:20.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7fdc6dffb640 1 -- 172.21.15.104:0/3653112107 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc680078e0 con 0x7fdc700b1460 2024-05-08T04:21:20.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7fdc6dffb640 1 -- 172.21.15.104:0/3653112107 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68007cb0 con 0x7fdc700b1460 2024-05-08T04:21:20.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7fdc756bc640 1 -- 172.21.15.104:0/3653112107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc700b1460 msgr2=0x7fdc700b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7fdc756bc640 1 --2- 172.21.15.104:0/3653112107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc700b1460 0x7fdc700b18f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009d90 tx=0x7fdc6802a570 comp rx=0 tx=0).stop 2024-05-08T04:21:20.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f5dc6458640 1 Processor -- start 2024-05-08T04:21:20.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f5dc6458640 1 -- start start 2024-05-08T04:21:20.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f82bb7fe640 1 -- 172.21.15.104:0/3667850703 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a803d070 con 0x7f82b403e870 2024-05-08T04:21:20.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f82bb7fe640 1 -- 172.21.15.104:0/3667850703 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a80114e0 con 0x7f82b403e870 2024-05-08T04:21:20.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f82c2fe2640 1 -- 172.21.15.104:0/3667850703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b403e870 msgr2=0x7f82b4053c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f82c2fe2640 1 --2- 172.21.15.104:0/3667850703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b403e870 0x7f82b4053c20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82a8013150 tx=0x7f82a8032920 comp rx=0 tx=0).stop 2024-05-08T04:21:20.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f9c679b7640 1 -- 172.21.15.104:0/4225322566 shutdown_connections 2024-05-08T04:21:20.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f9c679b7640 1 -- 172.21.15.104:0/4225322566 wait complete. 2024-05-08T04:21:20.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f0dc5453640 1 -- 172.21.15.104:0/1112756084 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db80e30b0 msgr2=0x7f0db8057d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f0dc5453640 1 --2- 172.21.15.104:0/1112756084 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db80e30b0 0x7f0db8057d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0db8056950 tx=0x7f0db002a2a0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f0dc5453640 1 -- 172.21.15.104:0/1112756084 shutdown_connections 2024-05-08T04:21:20.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f0dc5453640 1 --2- 172.21.15.104:0/1112756084 >> v2:172.21.15.183:3300/0 conn(0x7f0db80542f0 0x7f0db80068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f0dc5453640 1 --2- 172.21.15.104:0/1112756084 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db80e30b0 0x7f0db8057d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f0dc5453640 1 -- 172.21.15.104:0/1112756084 >> 172.21.15.104:0/1112756084 conn(0x7f0db80559d0 msgr2=0x7f0db8055de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7fd159d9b640 1 -- 172.21.15.104:0/3616796660 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144032810 con 0x7fd15c06d7e0 2024-05-08T04:21:20.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7fd160a06640 1 -- 172.21.15.104:0/3616796660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd15c06d7e0 msgr2=0x7fd15c0cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7fd160a06640 1 --2- 172.21.15.104:0/3616796660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd15c06d7e0 0x7fd15c0cd450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1440097a0 tx=0x7fd14402a180 comp rx=0 tx=0).stop 2024-05-08T04:21:20.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7fd160a06640 1 -- 172.21.15.104:0/3616796660 shutdown_connections 2024-05-08T04:21:20.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7fd160a06640 1 --2- 172.21.15.104:0/3616796660 >> v2:172.21.15.104:3300/0 conn(0x7fd15c06dc40 0x7fd15c0cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7fd160a06640 1 --2- 172.21.15.104:0/3616796660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd15c06d7e0 0x7fd15c0cd450 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7fd160a06640 1 -- 172.21.15.104:0/3616796660 >> 172.21.15.104:0/3616796660 conn(0x7fd15c06ab60 msgr2=0x7fd15c06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7fd160a06640 1 -- 172.21.15.104:0/3616796660 shutdown_connections 2024-05-08T04:21:20.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f43da109640 1 -- 172.21.15.104:0/1062693212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43d40d4380 msgr2=0x7f43d40d0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f43da109640 1 --2- 172.21.15.104:0/1062693212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43d40d4380 0x7f43d40d0220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43d40cde10 tx=0x7f43c802a090 comp rx=0 tx=0).stop 2024-05-08T04:21:20.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f43da109640 1 -- 172.21.15.104:0/1062693212 shutdown_connections 2024-05-08T04:21:20.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f43da109640 1 --2- 172.21.15.104:0/1062693212 >> v2:172.21.15.183:3300/0 conn(0x7f43d40d0760 0x7f43d40b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f43da109640 1 --2- 172.21.15.104:0/1062693212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43d40d4380 0x7f43d40d0220 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f43da109640 1 -- 172.21.15.104:0/1062693212 >> 172.21.15.104:0/1062693212 conn(0x7f43d408afd0 msgr2=0x7f43d40d3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f43da109640 1 -- 172.21.15.104:0/1062693212 shutdown_connections 2024-05-08T04:21:20.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f1feb59e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe4058560 con 0x7f1fe40e30b0 2024-05-08T04:21:20.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f1feb59e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe4058840 con 0x7f1fe4054120 2024-05-08T04:21:20.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f1feb59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4058b20 con 0x7f1fe403e830 2024-05-08T04:21:20.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f1fea59c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f1fe40e30b0 0x7f1fe4057d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53190/0 (socket says 172.21.15.104:53190) 2024-05-08T04:21:20.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.404+0000 7f1fea59c640 1 -- 172.21.15.104:0/2403149939 learned_addr learned my addr 172.21.15.104:0/2403149939 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:20.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898971320 0 0) 0x7f1fe4058560 con 0x7f1fe40e30b0 2024-05-08T04:21:20.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fd4003520 con 0x7f1fe40e30b0 2024-05-08T04:21:20.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fead9d640 1 --2- 172.21.15.104:0/2403149939 >> v2:172.21.15.183:3300/0 conn(0x7f1fe4054120 0x7f1fe40068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 283709111 0 0) 0x7f1fd4003520 con 0x7f1fe40e30b0 2024-05-08T04:21:20.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fe403e830 msgr2=0x7f1fe4053be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 --2- 172.21.15.104:0/2403149939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fe403e830 0x7f1fe4053be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 >> v2:172.21.15.183:3300/0 conn(0x7f1fe4054120 msgr2=0x7f1fe40068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 --2- 172.21.15.104:0/2403149939 >> v2:172.21.15.183:3300/0 conn(0x7f1fe4054120 0x7f1fe40068c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40063a0 con 0x7f1fe40e30b0 2024-05-08T04:21:20.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fead9d640 1 --2- 172.21.15.104:0/2403149939 >> v2:172.21.15.183:3300/0 conn(0x7f1fe4054120 0x7f1fe40068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:20.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f1fec0627f0 con 0x7f1fe40e30b0 2024-05-08T04:21:20.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 >> v1:172.21.15.104:6789/0 conn(0x7f1fe40e30b0 legacy=0x7f1fe4057d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 --2- 172.21.15.104:0/2403149939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fd40039b0 0x7f1fd4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 --2- 172.21.15.104:0/2403149939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd4004800 0x7f1fd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 --2- 172.21.15.104:0/2403149939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fd40051c0 0x7f1fd400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4058840 con 0x7f1fd4004800 2024-05-08T04:21:20.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4058b20 con 0x7f1fd40051c0 2024-05-08T04:21:20.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.405+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd400c0f0 con 0x7f1fd40039b0 2024-05-08T04:21:20.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f1fea59c640 1 --2- 172.21.15.104:0/2403149939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fd40039b0 0x7f1fd4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f1fead9d640 1 --2- 172.21.15.104:0/2403149939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fd40051c0 0x7f1fd400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f1fead9d640 1 -- 172.21.15.104:0/2403149939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fd40039b0 msgr2=0x7f1fd4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:20.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f1fead9d640 1 --2- 172.21.15.104:0/2403149939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fd40039b0 0x7f1fd4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f1fead9d640 1 -- 172.21.15.104:0/2403149939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd4004800 msgr2=0x7f1fd4004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T04:21:20.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f1fead9d640 1 --2- 172.21.15.104:0/2403149939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd4004800 0x7f1fd4004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f1fead9d640 1 -- 172.21.15.104:0/2403149939 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd4003520 con 0x7f1fd40051c0 2024-05-08T04:21:20.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7fdc756bc640 1 -- 172.21.15.104:0/3653112107 shutdown_connections 2024-05-08T04:21:20.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7fdc756bc640 1 --2- 172.21.15.104:0/3653112107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc700b1460 0x7fdc700b18f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7fdc756bc640 1 --2- 172.21.15.104:0/3653112107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc700ce000 0x7fdc700ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7fdc756bc640 1 -- 172.21.15.104:0/3653112107 >> 172.21.15.104:0/3653112107 conn(0x7fdc700d1630 msgr2=0x7fdc700d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7fdc756bc640 1 -- 172.21.15.104:0/3653112107 shutdown_connections 2024-05-08T04:21:20.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7fdc756bc640 1 -- 172.21.15.104:0/3653112107 wait complete. 2024-05-08T04:21:20.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7fd160a06640 1 -- 172.21.15.104:0/3616796660 wait complete. 2024-05-08T04:21:20.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f43da109640 1 -- 172.21.15.104:0/1062693212 wait complete. 2024-05-08T04:21:20.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f1fea59c640 1 --2- 172.21.15.104:0/2403149939 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fd40039b0 0x7f1fd4003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:20.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f9c679b7640 1 Processor -- start 2024-05-08T04:21:20.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f82c2fe2640 1 -- 172.21.15.104:0/3667850703 shutdown_connections 2024-05-08T04:21:20.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f82c2fe2640 1 --2- 172.21.15.104:0/3667850703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82b4054160 0x7f82b4006900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f82c2fe2640 1 --2- 172.21.15.104:0/3667850703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b403e870 0x7f82b4053c20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f82c2fe2640 1 -- 172.21.15.104:0/3667850703 >> 172.21.15.104:0/3667850703 conn(0x7f82b4055a10 msgr2=0x7f82b4055e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f0dc5453640 1 -- 172.21.15.104:0/1112756084 shutdown_connections 2024-05-08T04:21:20.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f1fead9d640 1 --2- 172.21.15.104:0/2403149939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fd40051c0 0x7f1fd400b9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00aa80 tx=0x7f1fd4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31b4d05be4e404e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f5dc6458640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc0071000 0x7f5dc01699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f5dc6458640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc0071490 0x7f5dc0172d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f5dc6458640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc008a830 0x7f5dc00cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f5dc6458640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc016a880 con 0x7f5dc0071490 2024-05-08T04:21:20.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f5dc6458640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc00718c0 con 0x7f5dc0071000 2024-05-08T04:21:20.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f5dc6458640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc016aa00 con 0x7f5dc008a830 2024-05-08T04:21:20.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f0dc5453640 1 -- 172.21.15.104:0/1112756084 wait complete. 2024-05-08T04:21:20.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f43da109640 1 Processor -- start 2024-05-08T04:21:20.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.406+0000 7f9c679b7640 1 -- start start 2024-05-08T04:21:20.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc037070 con 0x7f1fd40051c0 2024-05-08T04:21:20.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc02ac70 con 0x7f1fd40051c0 2024-05-08T04:21:20.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f43da109640 1 -- start start 2024-05-08T04:21:20.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f5dbffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc0071000 0x7f5dc01699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f5dbffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc0071000 0x7f5dc01699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:53186/0 (socket says 172.21.15.104:53186) 2024-05-08T04:21:20.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.407+0000 7f5dbffff640 1 -- 172.21.15.104:0/1797293538 learned_addr learned my addr 172.21.15.104:0/1797293538 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f5dbf7fe640 1 --2- 172.21.15.104:0/1797293538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc0071490 0x7f5dc0172d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f1fe959a640 1 -- 172.21.15.104:0/2403149939 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc037070 con 0x7f1fd40051c0 2024-05-08T04:21:20.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7fd160a06640 1 Processor -- start 2024-05-08T04:21:20.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f5dbffff640 1 -- 172.21.15.104:0/1797293538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc008a830 msgr2=0x7f5dc00cd280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T04:21:20.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f5dbffff640 1 --2- 172.21.15.104:0/1797293538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc008a830 0x7f5dc00cd280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f5dbffff640 1 -- 172.21.15.104:0/1797293538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc0071490 msgr2=0x7f5dc0172d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f5dbffff640 1 --2- 172.21.15.104:0/1797293538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc0071490 0x7f5dc0172d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7fdc756bc640 1 Processor -- start 2024-05-08T04:21:20.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7fd160a06640 1 -- start start 2024-05-08T04:21:20.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f5dbffff640 1 -- 172.21.15.104:0/1797293538 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc0171ca0 con 0x7f5dc0071000 2024-05-08T04:21:20.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7fdc756bc640 1 -- start start 2024-05-08T04:21:20.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f9c679b7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c580085b0 0x7f9c5804e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f9c679b7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c58008990 0x7f9c580ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f9c679b7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c58050210 0x7f9c580cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f9c679b7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c58050bb0 con 0x7f9c58050210 2024-05-08T04:21:20.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f9c679b7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c58039ef0 con 0x7f9c58008990 2024-05-08T04:21:20.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f9c679b7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c580e1210 con 0x7f9c580085b0 2024-05-08T04:21:20.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f9c64f52640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c58008990 0x7f9c580ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f5dbffff640 1 --2- 172.21.15.104:0/1797293538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc0071000 0x7f5dc01699e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009840 tx=0x7f5db40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f5dbcff9640 1 -- 172.21.15.104:0/1797293538 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4043070 con 0x7f5dc0071000 2024-05-08T04:21:20.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f5dbcff9640 1 -- 172.21.15.104:0/1797293538 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db403c470 con 0x7f5dc0071000 2024-05-08T04:21:20.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f5dbcff9640 1 -- 172.21.15.104:0/1797293538 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4037070 con 0x7f5dc0071000 2024-05-08T04:21:20.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f5dc6458640 1 -- 172.21.15.104:0/1797293538 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc0171f40 con 0x7f5dc0071000 2024-05-08T04:21:20.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f82c2fe2640 1 -- 172.21.15.104:0/3667850703 shutdown_connections 2024-05-08T04:21:20.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f82c2fe2640 1 -- 172.21.15.104:0/3667850703 wait complete. 2024-05-08T04:21:20.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.408+0000 7f9c65753640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c580085b0 0x7f9c5804e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f9c65753640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c580085b0 0x7f9c5804e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:56074/0 (socket says 172.21.15.104:56074) 2024-05-08T04:21:20.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f9c65753640 1 -- 172.21.15.104:0/1274657361 learned_addr learned my addr 172.21.15.104:0/1274657361 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f9c65f54640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c58050210 0x7f9c580cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f9c65753640 1 -- 172.21.15.104:0/1274657361 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c58008990 msgr2=0x7f9c580ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f9c65753640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c58008990 0x7f9c580ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f9c65753640 1 -- 172.21.15.104:0/1274657361 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c58050210 msgr2=0x7f9c580cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f0dc5453640 1 Processor -- start 2024-05-08T04:21:20.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f0dc5453640 1 -- start start 2024-05-08T04:21:20.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f43da109640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43d40d0760 0x7f43d40c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f1feb59e640 1 -- 172.21.15.104:0/2403149939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fd40051c0 msgr2=0x7f1fd400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f1feb59e640 1 --2- 172.21.15.104:0/2403149939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fd40051c0 0x7f1fd400b9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00aa80 tx=0x7f1fd4005830 comp rx=0 tx=0).stop 2024-05-08T04:21:20.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f1fead9d640 1 -- 172.21.15.104:0/2403149939 reap_dead start 2024-05-08T04:21:20.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f5dc6458640 1 -- 172.21.15.104:0/1797293538 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc0172500 con 0x7f5dc0071000 2024-05-08T04:21:20.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7fdc756bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc700b1460 0x7fdc700b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f43d37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43d40d0760 0x7f43d40c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f43d37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43d40d0760 0x7f43d40c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33988/0 (socket says 172.21.15.104:33988) 2024-05-08T04:21:20.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7fdc756bc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc700ce000 0x7fdc7015c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7fdc756bc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc7015b940 0x7fdc700af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7fdc756bc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700b1e30 con 0x7fdc700b1460 2024-05-08T04:21:20.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f43d37fe640 1 -- 172.21.15.104:0/674530674 learned_addr learned my addr 172.21.15.104:0/674530674 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7fdc756bc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc700b2750 con 0x7fdc7015b940 2024-05-08T04:21:20.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7fdc756bc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7015bd20 con 0x7fdc700ce000 2024-05-08T04:21:20.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f43da109640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43d40d4380 0x7f43d4152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f43da109640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43d415dab0 0x7f43d4152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7fdc6e7fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc700ce000 0x7fdc7015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7fd160a06640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd15c06d7e0 0x7fd15c142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f43da109640 1 -- 172.21.15.104:0/674530674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d415e010 con 0x7f43d40d0760 2024-05-08T04:21:20.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7fdc6f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc7015b940 0x7fdc700af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7fdc6e7fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc700ce000 0x7fdc7015c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:56086/0 (socket says 172.21.15.104:56086) 2024-05-08T04:21:20.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7fdc6e7fc640 1 -- 172.21.15.104:0/765875423 learned_addr learned my addr 172.21.15.104:0/765875423 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.409+0000 7f43da109640 1 -- 172.21.15.104:0/674530674 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d415de90 con 0x7f43d40d4380 2024-05-08T04:21:20.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd160a06640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd15c06dc40 0x7fd15c1569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7f43d3fff640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43d415dab0 0x7f43d4152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7f43da109640 1 -- 172.21.15.104:0/674530674 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40b7840 con 0x7f43d415dab0 2024-05-08T04:21:20.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd160a06640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd15c161fc0 0x7fd15c15b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd15ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd15c06d7e0 0x7fd15c142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd15ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd15c06d7e0 0x7fd15c142f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34004/0 (socket says 172.21.15.104:34004) 2024-05-08T04:21:20.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd15ad9d640 1 -- 172.21.15.104:0/1218960653 learned_addr learned my addr 172.21.15.104:0/1218960653 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7f43d2ffd640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43d40d4380 0x7f43d4152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd160a06640 1 -- 172.21.15.104:0/1218960653 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0721a0 con 0x7fd15c06d7e0 2024-05-08T04:21:20.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd160a06640 1 -- 172.21.15.104:0/1218960653 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0b3200 con 0x7fd15c06dc40 2024-05-08T04:21:20.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd15b59e640 1 --2- 172.21.15.104:0/1218960653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd15c161fc0 0x7fd15c15b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd160a06640 1 -- 172.21.15.104:0/1218960653 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c072320 con 0x7fd15c161fc0 2024-05-08T04:21:20.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7f1feb59e640 1 -- 172.21.15.104:0/2403149939 shutdown_connections 2024-05-08T04:21:20.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7f1feb59e640 1 -- 172.21.15.104:0/2403149939 >> 172.21.15.104:0/2403149939 conn(0x7f1fe40559d0 msgr2=0x7f1fe4055de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7f1feb59e640 1 -- 172.21.15.104:0/2403149939 shutdown_connections 2024-05-08T04:21:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7f43d37fe640 1 -- 172.21.15.104:0/674530674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43d415dab0 msgr2=0x7f43d4152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7f43d37fe640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43d415dab0 0x7f43d4152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7f43d37fe640 1 -- 172.21.15.104:0/674530674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43d40d4380 msgr2=0x7f43d4152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7f43d37fe640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43d40d4380 0x7f43d4152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7f43d37fe640 1 -- 172.21.15.104:0/674530674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40cc6d0 con 0x7f43d40d0760 2024-05-08T04:21:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7f1feb59e640 1 -- 172.21.15.104:0/2403149939 wait complete. 2024-05-08T04:21:20.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fdc6effd640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc700b1460 0x7fdc700b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd15b59e640 1 -- 172.21.15.104:0/1218960653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd15c06dc40 msgr2=0x7fd15c1569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd15b59e640 1 --2- 172.21.15.104:0/1218960653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd15c06dc40 0x7fd15c1569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd15b59e640 1 -- 172.21.15.104:0/1218960653 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd15c06d7e0 msgr2=0x7fd15c142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd15b59e640 1 --2- 172.21.15.104:0/1218960653 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd15c06d7e0 0x7fd15c142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.410+0000 7fd15b59e640 1 -- 172.21.15.104:0/1218960653 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c159710 con 0x7fd15c161fc0 2024-05-08T04:21:20.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f82c2fe2640 1 Processor -- start 2024-05-08T04:21:20.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f9c65753640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c58050210 0x7f9c580cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7fd15b59e640 1 --2- 172.21.15.104:0/1218960653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd15c161fc0 0x7fd15c15b210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00ce10 tx=0x7fd14c00a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f5dc6458640 1 -- 172.21.15.104:0/1797293538 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc0074950 con 0x7f5dc0071000 2024-05-08T04:21:20.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7fdc6effd640 1 -- 172.21.15.104:0/765875423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc700ce000 msgr2=0x7fdc7015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7fdc6effd640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc700ce000 0x7fdc7015c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7fdc6effd640 1 -- 172.21.15.104:0/765875423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc7015b940 msgr2=0x7fdc700af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7fdc6effd640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc7015b940 0x7fdc700af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7fdc6effd640 1 -- 172.21.15.104:0/765875423 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc701550d0 con 0x7fdc700b1460 2024-05-08T04:21:20.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7fd1537fe640 1 -- 172.21.15.104:0/1218960653 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c003b90 con 0x7fd15c161fc0 2024-05-08T04:21:20.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7fdc6e7fc640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc700ce000 0x7fdc7015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7fd160a06640 1 -- 172.21.15.104:0/1218960653 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15c1599f0 con 0x7fd15c161fc0 2024-05-08T04:21:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f9c65753640 1 -- 172.21.15.104:0/1274657361 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c580cee50 con 0x7f9c580085b0 2024-05-08T04:21:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f9c65f54640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c58050210 0x7f9c580cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f0dc5453640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0db803e830 0x7f0db80c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7fdc6effd640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc700b1460 0x7fdc700b4250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400c410 tx=0x7fdc6400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f9c65753640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c580085b0 0x7f9c5804e390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c500015a0 tx=0x7f9c50001a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f0dc5453640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0db80542f0 0x7f0db817c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f0dbeffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0db803e830 0x7f0db80c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f0dbeffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0db803e830 0x7f0db80c9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:53224/0 (socket says 172.21.15.104:53224) 2024-05-08T04:21:20.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f0dbeffd640 1 -- 172.21.15.104:0/1711177149 learned_addr learned my addr 172.21.15.104:0/1711177149 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7fdc577fe640 1 -- 172.21.15.104:0/765875423 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc64011790 con 0x7fdc700b1460 2024-05-08T04:21:20.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7fdc577fe640 1 -- 172.21.15.104:0/765875423 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc64017070 con 0x7fdc700b1460 2024-05-08T04:21:20.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7fdc577fe640 1 -- 172.21.15.104:0/765875423 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc64011b70 con 0x7fdc700b1460 2024-05-08T04:21:20.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f5dbcff9640 1 -- 172.21.15.104:0/1797293538 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5db4046070 con 0x7f5dc0071000 2024-05-08T04:21:20.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7fdc756bc640 1 -- 172.21.15.104:0/765875423 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc700b50d0 con 0x7fdc700b1460 2024-05-08T04:21:20.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7f0dbe7fc640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0db80542f0 0x7f0db817c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7f0dc5453640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db80e30b0 0x7f0db804e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f43d37fe640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43d40d0760 0x7f43d40c9bb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43c400c3c0 tx=0x7f43c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f43bbfff640 1 -- 172.21.15.104:0/674530674 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4017070 con 0x7f43d40d0760 2024-05-08T04:21:20.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f43bbfff640 1 -- 172.21.15.104:0/674530674 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4005ce0 con 0x7f43d40d0760 2024-05-08T04:21:20.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7f0dbf7fe640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db80e30b0 0x7f0db804e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7f0dc5453640 1 -- 172.21.15.104:0/1711177149 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80e3490 con 0x7f0db80e30b0 2024-05-08T04:21:20.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7f0dc5453640 1 -- 172.21.15.104:0/1711177149 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db803bfb0 con 0x7f0db803e830 2024-05-08T04:21:20.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7f0dc5453640 1 -- 172.21.15.104:0/1711177149 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8006e00 con 0x7f0db80542f0 2024-05-08T04:21:20.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7f5dbcff9640 1 --2- 172.21.15.104:0/1797293538 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5dac06b4d0 0x7f5dac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7f5dbcff9640 1 -- 172.21.15.104:0/1797293538 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5db40aa1b0 con 0x7f5dc0071000 2024-05-08T04:21:20.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7fdc756bc640 1 -- 172.21.15.104:0/765875423 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc700b4b10 con 0x7fdc700b1460 2024-05-08T04:21:20.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7fd1537fe640 1 -- 172.21.15.104:0/1218960653 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c003d30 con 0x7fd15c161fc0 2024-05-08T04:21:20.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7f43bbfff640 1 -- 172.21.15.104:0/674530674 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40072f0 con 0x7f43d40d0760 2024-05-08T04:21:20.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7f1feb59e640 1 Processor -- start 2024-05-08T04:21:20.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7f1feb59e640 1 -- start start 2024-05-08T04:21:20.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.412+0000 7fd160a06640 1 -- 172.21.15.104:0/1218960653 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15c15aa10 con 0x7fd15c161fc0 2024-05-08T04:21:20.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f5dbf7fe640 1 --2- 172.21.15.104:0/1797293538 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5dac06b4d0 0x7f5dac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.411+0000 7f82c2fe2640 1 -- start start 2024-05-08T04:21:20.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f82c2fe2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82b403e870 0x7f82b40e24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f82c2fe2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b4054160 0x7f82b40d54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f82c2fe2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82b40e30f0 0x7f82b4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f82c0d7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82b403e870 0x7f82b40e24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f82c0d7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82b403e870 0x7f82b40e24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34014/0 (socket says 172.21.15.104:34014) 2024-05-08T04:21:20.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f43da109640 1 -- 172.21.15.104:0/674530674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d40cc9b0 con 0x7f43d40d0760 2024-05-08T04:21:20.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f43da109640 1 -- 172.21.15.104:0/674530674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d40ccf70 con 0x7f43d40d0760 2024-05-08T04:21:20.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f82c2fe2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b4006e40 con 0x7f82b403e870 2024-05-08T04:21:20.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f82c2fe2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b40e34d0 con 0x7f82b4054160 2024-05-08T04:21:20.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f82c2fe2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b4006fc0 con 0x7f82b40e30f0 2024-05-08T04:21:20.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f82c0d7e640 1 -- 172.21.15.104:0/1438732863 learned_addr learned my addr 172.21.15.104:0/1438732863 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f5dbf7fe640 1 --2- 172.21.15.104:0/1797293538 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5dac06b4d0 0x7f5dac06d990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5db0001d90 tx=0x7f5db0001d20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f9c55ffb640 1 -- 172.21.15.104:0/1274657361 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c50018070 con 0x7f9c580085b0 2024-05-08T04:21:20.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f9c55ffb640 1 -- 172.21.15.104:0/1274657361 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c50007170 con 0x7f9c580085b0 2024-05-08T04:21:20.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f9c55ffb640 1 -- 172.21.15.104:0/1274657361 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c50007520 con 0x7f9c580085b0 2024-05-08T04:21:20.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f0dbeffd640 1 -- 172.21.15.104:0/1711177149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0db80542f0 msgr2=0x7f0db817c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f0dbeffd640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0db80542f0 0x7f0db817c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f0dbeffd640 1 -- 172.21.15.104:0/1711177149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db80e30b0 msgr2=0x7f0db804e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.413+0000 7f9c679b7640 1 -- 172.21.15.104:0/1274657361 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c580cbb60 con 0x7f9c580085b0 2024-05-08T04:21:20.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7f9c679b7640 1 -- 172.21.15.104:0/1274657361 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5804ece0 con 0x7f9c580085b0 2024-05-08T04:21:20.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7fd1537fe640 1 -- 172.21.15.104:0/1218960653 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c004260 con 0x7fd15c161fc0 2024-05-08T04:21:20.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7f1feb59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd40051c0 0x7f1fe40db5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7f0dbeffd640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db80e30b0 0x7f0db804e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7f0dbeffd640 1 -- 172.21.15.104:0/1711177149 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db8178b60 con 0x7f0db803e830 2024-05-08T04:21:20.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7f0dbf7fe640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db80e30b0 0x7f0db804e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:20.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7f1feb59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fe416dcd0 0x7f1fe416e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7f1feb59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fe40c5d10 0x7f1fe40c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7f1feb59e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4053be0 con 0x7f1fd40051c0 2024-05-08T04:21:20.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7f0dbeffd640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0db803e830 0x7f0db80c9970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0db0000c00 tx=0x7f0db00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7f1feb59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40e3490 con 0x7f1fe416dcd0 2024-05-08T04:21:20.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7f1feb59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4053d60 con 0x7f1fe40c5d10 2024-05-08T04:21:20.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7f1fea59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd40051c0 0x7f1fe40db5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.414+0000 7f1fea59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd40051c0 0x7f1fe40db5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34022/0 (socket says 172.21.15.104:34022) 2024-05-08T04:21:20.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f1fea59c640 1 -- 172.21.15.104:0/3022449058 learned_addr learned my addr 172.21.15.104:0/3022449058 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:20.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f1fe9d9b640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fe416dcd0 0x7f1fe416e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f1fead9d640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fe40c5d10 0x7f1fe40c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7fdc756bc640 1 -- 172.21.15.104:0/765875423 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc70074fa0 con 0x7fdc700b1460 2024-05-08T04:21:20.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f82c157f640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82b40e30f0 0x7f82b4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f82bbfff640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b4054160 0x7f82b40d54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f82c0d7e640 1 -- 172.21.15.104:0/1438732863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82b40e30f0 msgr2=0x7f82b4057900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f82c0d7e640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82b40e30f0 0x7f82b4057900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f82c0d7e640 1 -- 172.21.15.104:0/1438732863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b4054160 msgr2=0x7f82b40d54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f82c0d7e640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b4054160 0x7f82b40d54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f82c0d7e640 1 -- 172.21.15.104:0/1438732863 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b40d6400 con 0x7f82b403e870 2024-05-08T04:21:20.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f1fe9d9b640 1 -- 172.21.15.104:0/3022449058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fe40c5d10 msgr2=0x7f1fe40c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f1fe9d9b640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fe40c5d10 0x7f1fe40c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f1fe9d9b640 1 -- 172.21.15.104:0/3022449058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd40051c0 msgr2=0x7f1fe40db5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f1fe9d9b640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd40051c0 0x7f1fe40db5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f1fe9d9b640 1 -- 172.21.15.104:0/3022449058 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40e3860 con 0x7f1fe416dcd0 2024-05-08T04:21:20.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7fdc577fe640 1 -- 172.21.15.104:0/765875423 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdc64011d10 con 0x7fdc700b1460 2024-05-08T04:21:20.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7fd1537fe640 1 -- 172.21.15.104:0/1218960653 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd14c004480 con 0x7fd15c161fc0 2024-05-08T04:21:20.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7fd1517fa640 1 -- 172.21.15.104:0/1218960653 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15c15a800 con 0x7fd15c161fc0 2024-05-08T04:21:20.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f43da109640 1 -- 172.21.15.104:0/674530674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d40a1800 con 0x7f43d40d0760 2024-05-08T04:21:20.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.415+0000 7f82c0d7e640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82b403e870 0x7f82b40e24e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82b000c440 tx=0x7f82b000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7f9c55ffb640 1 -- 172.21.15.104:0/1274657361 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c500047e0 con 0x7f9c580085b0 2024-05-08T04:21:20.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7f1fe9d9b640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fe416dcd0 0x7f1fe416e150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4058490 tx=0x7f1fe000d8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7fdc577fe640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc5c06b4d0 0x7fdc5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7fd1537fe640 1 --2- 172.21.15.104:0/1218960653 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd13c06b520 0x7fd13c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7fdc577fe640 1 -- 172.21.15.104:0/765875423 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc64089f30 con 0x7fdc700b1460 2024-05-08T04:21:20.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7fd15ad9d640 1 --2- 172.21.15.104:0/1218960653 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd13c06b520 0x7fd13c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7fd1537fe640 1 -- 172.21.15.104:0/1218960653 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd14c08a8f0 con 0x7fd15c161fc0 2024-05-08T04:21:20.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7f9c55ffb640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c4406b520 0x7f9c4406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7f1fea59c640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd40051c0 0x7f1fe40db5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:20.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7f9c679b7640 1 -- 172.21.15.104:0/1274657361 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c40005290 con 0x7f9c580085b0 2024-05-08T04:21:20.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7f9c55ffb640 1 -- 172.21.15.104:0/1274657361 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c50089510 con 0x7f9c580085b0 2024-05-08T04:21:20.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7f43bbfff640 1 -- 172.21.15.104:0/674530674 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f43c401a070 con 0x7f43d40d0760 2024-05-08T04:21:20.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7fdc6e7fc640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc5c06b4d0 0x7fdc5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7f9c64f52640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c4406b520 0x7f9c4406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7fd15ad9d640 1 --2- 172.21.15.104:0/1218960653 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd13c06b520 0x7fd13c06d9e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd154007b10 tx=0x7fd154007a60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.416+0000 7f43bbfff640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f43c006b5a0 0x7f43c006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7f43bbfff640 1 -- 172.21.15.104:0/674530674 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43c4089490 con 0x7f43d40d0760 2024-05-08T04:21:20.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7f43d2ffd640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f43c006b5a0 0x7f43c006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7fdc6e7fc640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc5c06b4d0 0x7fdc5c06d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdc700711f0 tx=0x7fdc60009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7f9c64f52640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c4406b520 0x7f9c4406d9e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9c5804b3d0 tx=0x7f9c5c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7f43d2ffd640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f43c006b5a0 0x7f43c006da60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f43c8034000 tx=0x7f43c802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7f0da77fe640 1 -- 172.21.15.104:0/1711177149 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0041020 con 0x7f0db803e830 2024-05-08T04:21:20.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7f1fdaffd640 1 -- 172.21.15.104:0/3022449058 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0004020 con 0x7f1fe416dcd0 2024-05-08T04:21:20.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7f0da77fe640 1 -- 172.21.15.104:0/1711177149 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db0030d30 con 0x7f0db803e830 2024-05-08T04:21:20.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7f0dc5453640 1 -- 172.21.15.104:0/1711177149 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db817c690 con 0x7f0db803e830 2024-05-08T04:21:20.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7f0da77fe640 1 -- 172.21.15.104:0/1711177149 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0041020 con 0x7f0db803e830 2024-05-08T04:21:20.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7f0dc5453640 1 -- 172.21.15.104:0/1711177149 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db817cc10 con 0x7f0db803e830 2024-05-08T04:21:20.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7f1feb59e640 1 -- 172.21.15.104:0/3022449058 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe40e3b40 con 0x7f1fe416dcd0 2024-05-08T04:21:20.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7f1fdaffd640 1 -- 172.21.15.104:0/3022449058 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe00041c0 con 0x7f1fe416dcd0 2024-05-08T04:21:20.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.417+0000 7f1feb59e640 1 -- 172.21.15.104:0/3022449058 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe40c66d0 con 0x7f1fe416dcd0 2024-05-08T04:21:20.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.418+0000 7f5dbcff9640 1 -- 172.21.15.104:0/1797293538 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5dc0074950 con 0x7f5dc0071000 2024-05-08T04:21:20.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.418+0000 7f1fdaffd640 1 -- 172.21.15.104:0/3022449058 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0004370 con 0x7f1fe416dcd0 2024-05-08T04:21:20.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.419+0000 7f1feb59e640 1 -- 172.21.15.104:0/3022449058 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd0005290 con 0x7f1fe416dcd0 2024-05-08T04:21:20.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.419+0000 7f0dc5453640 1 -- 172.21.15.104:0/1711177149 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db80057d0 con 0x7f0db803e830 2024-05-08T04:21:20.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.419+0000 7f1fdaffd640 1 -- 172.21.15.104:0/3022449058 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1fe001a020 con 0x7f1fe416dcd0 2024-05-08T04:21:20.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.419+0000 7f0da77fe640 1 -- 172.21.15.104:0/1711177149 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0db0044020 con 0x7f0db803e830 2024-05-08T04:21:20.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.420+0000 7f1fdaffd640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1fcc06b500 0x7f1fcc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.420+0000 7f1fdaffd640 1 -- 172.21.15.104:0/3022449058 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fe0089a40 con 0x7f1fe416dcd0 2024-05-08T04:21:20.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.420+0000 7f0da77fe640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0dac06b6d0 0x7f0dac06db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.420+0000 7f1fea59c640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1fcc06b500 0x7f1fcc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.420+0000 7f0da77fe640 1 -- 172.21.15.104:0/1711177149 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0db00aa7b0 con 0x7f0db803e830 2024-05-08T04:21:20.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.420+0000 7f0dbe7fc640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0dac06b6d0 0x7f0dac06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.420+0000 7f1fea59c640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1fcc06b500 0x7f1fcc06d9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1fec06a0b0 tx=0x7f1fec06e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.420+0000 7f0dbe7fc640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0dac06b6d0 0x7f0dac06db90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0db8007820 tx=0x7f0db4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.421+0000 7fd1537fe640 1 -- 172.21.15.104:0/1218960653 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd14c059290 con 0x7fd15c161fc0 2024-05-08T04:21:20.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.423+0000 7fdc577fe640 1 -- 172.21.15.104:0/765875423 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdc701550d0 con 0x7fdc700b1460 2024-05-08T04:21:20.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.423+0000 7f82b97fa640 1 -- 172.21.15.104:0/1438732863 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0018070 con 0x7f82b403e870 2024-05-08T04:21:20.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.423+0000 7f82c2fe2640 1 -- 172.21.15.104:0/1438732863 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b40dbc40 con 0x7f82b403e870 2024-05-08T04:21:20.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.424+0000 7f82c2fe2640 1 -- 172.21.15.104:0/1438732863 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b40dc200 con 0x7f82b403e870 2024-05-08T04:21:20.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.424+0000 7f1fdaffd640 1 -- 172.21.15.104:0/3022449058 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1fe0058930 con 0x7f1fe416dcd0 2024-05-08T04:21:20.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.425+0000 7f82c2fe2640 1 -- 172.21.15.104:0/1438732863 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b4005810 con 0x7f82b403e870 2024-05-08T04:21:20.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.425+0000 7f9c55ffb640 1 -- 172.21.15.104:0/1274657361 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9c580cee50 con 0x7f9c580085b0 2024-05-08T04:21:20.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.428+0000 7f0da77fe640 1 -- 172.21.15.104:0/1711177149 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0db004b030 con 0x7f0db803e830 2024-05-08T04:21:20.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.433+0000 7f43bbfff640 1 -- 172.21.15.104:0/674530674 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f43c4057d30 con 0x7f43d40d0760 2024-05-08T04:21:20.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.433+0000 7f82b97fa640 1 -- 172.21.15.104:0/1438732863 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b0007480 con 0x7f82b403e870 2024-05-08T04:21:20.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.433+0000 7f82b97fa640 1 -- 172.21.15.104:0/1438732863 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0022060 con 0x7f82b403e870 2024-05-08T04:21:20.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.434+0000 7f82b97fa640 1 -- 172.21.15.104:0/1438732863 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f82b001b070 con 0x7f82b403e870 2024-05-08T04:21:20.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.435+0000 7f82b97fa640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f82a006b4d0 0x7f82a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:20.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.435+0000 7f82b97fa640 1 -- 172.21.15.104:0/1438732863 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82b00899c0 con 0x7f82b403e870 2024-05-08T04:21:20.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.435+0000 7f82bbfff640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f82a006b4d0 0x7f82a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:20.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.436+0000 7f82bbfff640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f82a006b4d0 0x7f82a006d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f82a803c000 tx=0x7f82a8011000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:20.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.441+0000 7f82b97fa640 1 -- 172.21.15.104:0/1438732863 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f82b40d6400 con 0x7f82b403e870 2024-05-08T04:21:20.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.832+0000 7f5dc6458640 1 -- 172.21.15.104:0/1797293538 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5dc004f000 con 0x7f5dc0071000 2024-05-08T04:21:20.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.833+0000 7f5dbcff9640 1 -- 172.21.15.104:0/1797293538 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5dc0074950 con 0x7f5dc0071000 2024-05-08T04:21:20.932 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2024-05-08T04:21:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.834+0000 7fdc756bc640 1 -- 172.21.15.104:0/765875423 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdc70070e60 con 0x7fdc700b1460 2024-05-08T04:21:20.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.835+0000 7fdc577fe640 1 -- 172.21.15.104:0/765875423 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdc64058d10 con 0x7fdc700b1460 2024-05-08T04:21:20.933 INFO:teuthology.orchestra.run.smithi104.stdout:55834574856 2024-05-08T04:21:20.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.836+0000 7f5da6ffd640 1 -- 172.21.15.104:0/1797293538 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5dac06b4d0 msgr2=0x7f5dac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.836+0000 7f5da6ffd640 1 --2- 172.21.15.104:0/1797293538 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5dac06b4d0 0x7f5dac06d990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5db0001d90 tx=0x7f5db0001d20 comp rx=0 tx=0).stop 2024-05-08T04:21:20.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.836+0000 7f5da6ffd640 1 -- 172.21.15.104:0/1797293538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc0071000 msgr2=0x7f5dc01699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.836+0000 7f5da6ffd640 1 --2- 172.21.15.104:0/1797293538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc0071000 0x7f5dc01699e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009840 tx=0x7f5db40046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.837+0000 7f5da6ffd640 1 -- 172.21.15.104:0/1797293538 shutdown_connections 2024-05-08T04:21:20.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.837+0000 7f5da6ffd640 1 --2- 172.21.15.104:0/1797293538 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5dac06b4d0 0x7f5dac06d990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.837+0000 7f5da6ffd640 1 --2- 172.21.15.104:0/1797293538 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc008a830 0x7f5dc00cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.837+0000 7f5da6ffd640 1 --2- 172.21.15.104:0/1797293538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc0071490 0x7f5dc0172d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.837+0000 7f5da6ffd640 1 --2- 172.21.15.104:0/1797293538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc0071000 0x7f5dc01699e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.837+0000 7f5da6ffd640 1 -- 172.21.15.104:0/1797293538 >> 172.21.15.104:0/1797293538 conn(0x7f5dc0066d10 msgr2=0x7f5dc006e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.837+0000 7f5da6ffd640 1 -- 172.21.15.104:0/1797293538 shutdown_connections 2024-05-08T04:21:20.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.837+0000 7f5da6ffd640 1 -- 172.21.15.104:0/1797293538 wait complete. 2024-05-08T04:21:20.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.837+0000 7f9c679b7640 1 -- 172.21.15.104:0/1274657361 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9c40005580 con 0x7f9c580085b0 2024-05-08T04:21:20.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.838+0000 7fdc756bc640 1 -- 172.21.15.104:0/765875423 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc5c06b4d0 msgr2=0x7fdc5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.936 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2024-05-08T04:21:20.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.838+0000 7f9c55ffb640 1 -- 172.21.15.104:0/1274657361 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c50057db0 con 0x7f9c580085b0 2024-05-08T04:21:20.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.838+0000 7fdc756bc640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc5c06b4d0 0x7fdc5c06d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdc700711f0 tx=0x7fdc60009240 comp rx=0 tx=0).stop 2024-05-08T04:21:20.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.838+0000 7fdc756bc640 1 -- 172.21.15.104:0/765875423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc700b1460 msgr2=0x7fdc700b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.838+0000 7fdc756bc640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc700b1460 0x7fdc700b4250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400c410 tx=0x7fdc6400c8d0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.840+0000 7fdc756bc640 1 -- 172.21.15.104:0/765875423 shutdown_connections 2024-05-08T04:21:20.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.840+0000 7fdc756bc640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc5c06b4d0 0x7fdc5c06d990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.840+0000 7fdc756bc640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc7015b940 0x7fdc700af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.840+0000 7fdc756bc640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc700ce000 0x7fdc7015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.840+0000 7fdc756bc640 1 --2- 172.21.15.104:0/765875423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc700b1460 0x7fdc700b4250 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.840+0000 7fdc756bc640 1 -- 172.21.15.104:0/765875423 >> 172.21.15.104:0/765875423 conn(0x7fdc700d1630 msgr2=0x7fdc70156a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.840+0000 7fdc756bc640 1 -- 172.21.15.104:0/765875423 shutdown_connections 2024-05-08T04:21:20.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.840+0000 7fdc756bc640 1 -- 172.21.15.104:0/765875423 wait complete. 2024-05-08T04:21:20.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.841+0000 7f9c679b7640 1 -- 172.21.15.104:0/1274657361 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c4406b520 msgr2=0x7f9c4406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.842+0000 7f0dc5453640 1 -- 172.21.15.104:0/1711177149 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0db8008ff0 con 0x7f0db803e830 2024-05-08T04:21:20.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.842+0000 7f9c679b7640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c4406b520 0x7f9c4406d9e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9c5804b3d0 tx=0x7f9c5c008040 comp rx=0 tx=0).stop 2024-05-08T04:21:20.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.842+0000 7f9c679b7640 1 -- 172.21.15.104:0/1274657361 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c580085b0 msgr2=0x7f9c5804e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.842+0000 7f9c679b7640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c580085b0 0x7f9c5804e390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c500015a0 tx=0x7f9c50001a60 comp rx=0 tx=0).stop 2024-05-08T04:21:20.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.842+0000 7f0da77fe640 1 -- 172.21.15.104:0/1711177149 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0db004b030 con 0x7f0db803e830 2024-05-08T04:21:20.940 INFO:teuthology.orchestra.run.smithi104.stdout:55834574856 2024-05-08T04:21:20.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.843+0000 7f1feb59e640 1 -- 172.21.15.104:0/3022449058 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1fd0005850 con 0x7f1fe416dcd0 2024-05-08T04:21:20.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.843+0000 7f1fdaffd640 1 -- 172.21.15.104:0/3022449058 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1fe0058230 con 0x7f1fe416dcd0 2024-05-08T04:21:20.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.843+0000 7fd1517fa640 1 -- 172.21.15.104:0/1218960653 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd15c074fa0 con 0x7fd15c161fc0 2024-05-08T04:21:20.941 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2024-05-08T04:21:20.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.844+0000 7f9c679b7640 1 -- 172.21.15.104:0/1274657361 shutdown_connections 2024-05-08T04:21:20.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.844+0000 7f9c679b7640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c4406b520 0x7f9c4406d9e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.844+0000 7f9c679b7640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c58008990 0x7f9c580ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.844+0000 7f9c679b7640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c58050210 0x7f9c580cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.844+0000 7f9c679b7640 1 --2- 172.21.15.104:0/1274657361 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c580085b0 0x7f9c5804e390 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.844+0000 7f9c679b7640 1 -- 172.21.15.104:0/1274657361 >> 172.21.15.104:0/1274657361 conn(0x7f9c58055bc0 msgr2=0x7f9c58034820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.844+0000 7f9c679b7640 1 -- 172.21.15.104:0/1274657361 shutdown_connections 2024-05-08T04:21:20.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.844+0000 7f9c679b7640 1 -- 172.21.15.104:0/1274657361 wait complete. 2024-05-08T04:21:20.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.844+0000 7fd1537fe640 1 -- 172.21.15.104:0/1218960653 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd14c05d330 con 0x7fd15c161fc0 2024-05-08T04:21:20.943 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2024-05-08T04:21:20.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.845+0000 7f43da109640 1 -- 172.21.15.104:0/674530674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f43d409ea60 con 0x7f43d40d0760 2024-05-08T04:21:20.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f0dc5453640 1 -- 172.21.15.104:0/1711177149 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0dac06b6d0 msgr2=0x7f0dac06db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f0dc5453640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0dac06b6d0 0x7f0dac06db90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0db8007820 tx=0x7f0db4009040 comp rx=0 tx=0).stop 2024-05-08T04:21:20.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f0dc5453640 1 -- 172.21.15.104:0/1711177149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0db803e830 msgr2=0x7f0db80c9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f0dc5453640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0db803e830 0x7f0db80c9970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0db0000c00 tx=0x7f0db00046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f0dc5453640 1 -- 172.21.15.104:0/1711177149 shutdown_connections 2024-05-08T04:21:20.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f0dc5453640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0dac06b6d0 0x7f0dac06db90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f0dc5453640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0db80e30b0 0x7f0db804e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f0dc5453640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0db80542f0 0x7f0db817c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f0dc5453640 1 --2- 172.21.15.104:0/1711177149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0db803e830 0x7f0db80c9970 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f0dc5453640 1 -- 172.21.15.104:0/1711177149 >> 172.21.15.104:0/1711177149 conn(0x7f0db80559d0 msgr2=0x7f0db8039d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f43bbfff640 1 -- 172.21.15.104:0/674530674 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f43c405bdd0 con 0x7f43d40d0760 2024-05-08T04:21:20.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f1feb59e640 1 -- 172.21.15.104:0/3022449058 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1fcc06b500 msgr2=0x7f1fcc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f1feb59e640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1fcc06b500 0x7f1fcc06d9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1fec06a0b0 tx=0x7f1fec06e040 comp rx=0 tx=0).stop 2024-05-08T04:21:20.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f0dc5453640 1 -- 172.21.15.104:0/1711177149 shutdown_connections 2024-05-08T04:21:20.946 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2024-05-08T04:21:20.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.847+0000 7f0dc5453640 1 -- 172.21.15.104:0/1711177149 wait complete. 2024-05-08T04:21:20.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f1feb59e640 1 -- 172.21.15.104:0/3022449058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fe416dcd0 msgr2=0x7f1fe416e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.846+0000 7f1feb59e640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fe416dcd0 0x7f1fe416e150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4058490 tx=0x7f1fe000d8f0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.847+0000 7f1feb59e640 1 -- 172.21.15.104:0/3022449058 shutdown_connections 2024-05-08T04:21:20.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.847+0000 7f1feb59e640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1fcc06b500 0x7f1fcc06d9c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.847+0000 7f1feb59e640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fe416dcd0 0x7f1fe416e150 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.847+0000 7f1feb59e640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fe40c5d10 0x7f1fe40c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.847+0000 7f1feb59e640 1 --2- 172.21.15.104:0/3022449058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fd40051c0 0x7f1fe40db5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.847+0000 7f1feb59e640 1 -- 172.21.15.104:0/3022449058 >> 172.21.15.104:0/3022449058 conn(0x7f1fe40559d0 msgr2=0x7f1fe40e1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.847+0000 7f1feb59e640 1 -- 172.21.15.104:0/3022449058 shutdown_connections 2024-05-08T04:21:20.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.847+0000 7f1feb59e640 1 -- 172.21.15.104:0/3022449058 wait complete. 2024-05-08T04:21:20.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.848+0000 7fd1517fa640 1 -- 172.21.15.104:0/1218960653 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd13c06b520 msgr2=0x7fd13c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.848+0000 7fd1517fa640 1 --2- 172.21.15.104:0/1218960653 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd13c06b520 0x7fd13c06d9e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd154007b10 tx=0x7fd154007a60 comp rx=0 tx=0).stop 2024-05-08T04:21:20.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.848+0000 7fd1517fa640 1 -- 172.21.15.104:0/1218960653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd15c161fc0 msgr2=0x7fd15c15b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.848+0000 7fd1517fa640 1 --2- 172.21.15.104:0/1218960653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd15c161fc0 0x7fd15c15b210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00ce10 tx=0x7fd14c00a710 comp rx=0 tx=0).stop 2024-05-08T04:21:20.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7fd1517fa640 1 -- 172.21.15.104:0/1218960653 shutdown_connections 2024-05-08T04:21:20.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7f43da109640 1 -- 172.21.15.104:0/674530674 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f43c006b5a0 msgr2=0x7f43c006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7f43da109640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f43c006b5a0 0x7f43c006da60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f43c8034000 tx=0x7f43c802e000 comp rx=0 tx=0).stop 2024-05-08T04:21:20.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7fd1517fa640 1 --2- 172.21.15.104:0/1218960653 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd13c06b520 0x7fd13c06d9e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7fd1517fa640 1 --2- 172.21.15.104:0/1218960653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd15c06dc40 0x7fd15c1569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7f43da109640 1 -- 172.21.15.104:0/674530674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43d40d0760 msgr2=0x7f43d40c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7f43da109640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43d40d0760 0x7f43d40c9bb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f43c400c3c0 tx=0x7f43c400c880 comp rx=0 tx=0).stop 2024-05-08T04:21:20.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7fd1517fa640 1 --2- 172.21.15.104:0/1218960653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd15c161fc0 0x7fd15c15b210 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7fd1517fa640 1 --2- 172.21.15.104:0/1218960653 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd15c06d7e0 0x7fd15c142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7fd1517fa640 1 -- 172.21.15.104:0/1218960653 >> 172.21.15.104:0/1218960653 conn(0x7fd15c06ab60 msgr2=0x7fd15c1605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7f43da109640 1 -- 172.21.15.104:0/674530674 shutdown_connections 2024-05-08T04:21:20.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7f43da109640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f43c006b5a0 0x7f43c006da60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7f43da109640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43d40d4380 0x7f43d4152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7f43da109640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43d415dab0 0x7f43d4152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7f43da109640 1 --2- 172.21.15.104:0/674530674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f43d40d0760 0x7f43d40c9bb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7f43da109640 1 -- 172.21.15.104:0/674530674 >> 172.21.15.104:0/674530674 conn(0x7f43d408afd0 msgr2=0x7f43d406be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7fd1517fa640 1 -- 172.21.15.104:0/1218960653 shutdown_connections 2024-05-08T04:21:20.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7f43da109640 1 -- 172.21.15.104:0/674530674 shutdown_connections 2024-05-08T04:21:20.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.850+0000 7f43da109640 1 -- 172.21.15.104:0/674530674 wait complete. 2024-05-08T04:21:20.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.853+0000 7f82c2fe2640 1 -- 172.21.15.104:0/1438732863 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f82b40d71e0 con 0x7f82b403e870 2024-05-08T04:21:20.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.853+0000 7f82b97fa640 1 -- 172.21.15.104:0/1438732863 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82b0058270 con 0x7f82b403e870 2024-05-08T04:21:20.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.853+0000 7fd1517fa640 1 -- 172.21.15.104:0/1218960653 wait complete. 2024-05-08T04:21:20.954 INFO:teuthology.orchestra.run.smithi104.stdout:55834574857 2024-05-08T04:21:20.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.857+0000 7f82c2fe2640 1 -- 172.21.15.104:0/1438732863 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f82a006b4d0 msgr2=0x7f82a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.857+0000 7f82c2fe2640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f82a006b4d0 0x7f82a006d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f82a803c000 tx=0x7f82a8011000 comp rx=0 tx=0).stop 2024-05-08T04:21:20.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.857+0000 7f82c2fe2640 1 -- 172.21.15.104:0/1438732863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82b403e870 msgr2=0x7f82b40e24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:20.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.857+0000 7f82c2fe2640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82b403e870 0x7f82b40e24e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82b000c440 tx=0x7f82b000c900 comp rx=0 tx=0).stop 2024-05-08T04:21:20.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.858+0000 7f82c2fe2640 1 -- 172.21.15.104:0/1438732863 shutdown_connections 2024-05-08T04:21:20.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.858+0000 7f82c2fe2640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f82a006b4d0 0x7f82a006d990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-05-08T04:21:20.957 DEBUG:teuthology.parallel:result is None 2024-05-08T04:21:20.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.858+0000 7f82c2fe2640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82b4054160 0x7f82b40d54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.858+0000 7f82c2fe2640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82b40e30f0 0x7f82b4057900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.858+0000 7f82c2fe2640 1 --2- 172.21.15.104:0/1438732863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82b403e870 0x7f82b40e24e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:20.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.858+0000 7f82c2fe2640 1 -- 172.21.15.104:0/1438732863 >> 172.21.15.104:0/1438732863 conn(0x7f82b4055a10 msgr2=0x7f82b40d9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:20.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.858+0000 7f82c2fe2640 1 -- 172.21.15.104:0/1438732863 shutdown_connections 2024-05-08T04:21:20.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:20.858+0000 7f82c2fe2640 1 -- 172.21.15.104:0/1438732863 wait complete. 2024-05-08T04:21:20.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-05-08T04:21:20.959 DEBUG:teuthology.parallel:result is None 2024-05-08T04:21:20.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-05-08T04:21:20.960 DEBUG:teuthology.parallel:result is None 2024-05-08T04:21:20.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-05-08T04:21:20.961 DEBUG:teuthology.parallel:result is None 2024-05-08T04:21:20.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-05-08T04:21:20.962 DEBUG:teuthology.parallel:result is None 2024-05-08T04:21:20.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-05-08T04:21:20.962 DEBUG:teuthology.parallel:result is None 2024-05-08T04:21:20.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-05-08T04:21:20.963 DEBUG:teuthology.parallel:result is None 2024-05-08T04:21:20.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-05-08T04:21:20.964 DEBUG:teuthology.parallel:result is None 2024-05-08T04:21:20.964 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T04:21:20.964 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:21:21.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.063+0000 7fea0bf0a640 1 Processor -- start 2024-05-08T04:21:21.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.063+0000 7fea0bf0a640 1 -- start start 2024-05-08T04:21:21.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.064+0000 7fea0bf0a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fea0415edf0 0x7fea040b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.064+0000 7fea0bf0a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea04157ac0 0x7fea04157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.064+0000 7fea0bf0a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea040d15c0 con 0x7fea04070c70 2024-05-08T04:21:21.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.064+0000 7fea0bf0a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea0406bc70 con 0x7fea0415edf0 2024-05-08T04:21:21.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.064+0000 7fea0bf0a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0415f550 con 0x7fea04157ac0 2024-05-08T04:21:21.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.064+0000 7fea0a4a7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea04157ac0 0x7fea04157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.064+0000 7fea094a5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fea0415edf0 0x7fea040b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.064+0000 7fea0a4a7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea04157ac0 0x7fea04157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:56150/0 (socket says 172.21.15.104:56150) 2024-05-08T04:21:21.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.064+0000 7fea0a4a7640 1 -- 172.21.15.104:0/3008601652 learned_addr learned my addr 172.21.15.104:0/3008601652 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:21.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.064+0000 7fea094a5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fea0415edf0 0x7fea040b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:53256/0 (socket says 172.21.15.104:53256) 2024-05-08T04:21:21.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.064+0000 7fea09ca6640 1 --1- 172.21.15.104:0/3008601652 >> v1:172.21.15.183:6789/0 conn(0x7fea04070c70 0x7fea04071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:35184/0 (socket says 172.21.15.104:35184) 2024-05-08T04:21:21.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.065+0000 7fea0a4a7640 1 -- 172.21.15.104:0/3008601652 >> v2:172.21.15.183:3300/0 conn(0x7fea0415edf0 msgr2=0x7fea040b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:21.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.065+0000 7fea0a4a7640 1 --2- 172.21.15.104:0/3008601652 >> v2:172.21.15.183:3300/0 conn(0x7fea0415edf0 0x7fea040b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.065+0000 7fea0a4a7640 1 -- 172.21.15.104:0/3008601652 >> v1:172.21.15.183:6789/0 conn(0x7fea04070c70 legacy=0x7fea04071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.065+0000 7fea0a4a7640 1 -- 172.21.15.104:0/3008601652 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0415f830 con 0x7fea04157ac0 2024-05-08T04:21:21.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.065+0000 7fea094a5640 1 --2- 172.21.15.104:0/3008601652 >> v2:172.21.15.183:3300/0 conn(0x7fea0415edf0 0x7fea040b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:21.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.065+0000 7fea0a4a7640 1 --2- 172.21.15.104:0/3008601652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea04157ac0 0x7fea04157f50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc009e50 tx=0x7fe9fc02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ea85ff245c5972b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:21.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.065+0000 7fea08ca4640 1 -- 172.21.15.104:0/3008601652 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc036070 con 0x7fea04157ac0 2024-05-08T04:21:21.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.065+0000 7fea08ca4640 1 -- 172.21.15.104:0/3008601652 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9fc031600 con 0x7fea04157ac0 2024-05-08T04:21:21.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.065+0000 7fea08ca4640 1 -- 172.21.15.104:0/3008601652 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc0319d0 con 0x7fea04157ac0 2024-05-08T04:21:21.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.066+0000 7fea0bf0a640 1 -- 172.21.15.104:0/3008601652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea04157ac0 msgr2=0x7fea04157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.066+0000 7fea0bf0a640 1 --2- 172.21.15.104:0/3008601652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea04157ac0 0x7fea04157f50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc009e50 tx=0x7fe9fc02a710 comp rx=0 tx=0).stop 2024-05-08T04:21:21.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.066+0000 7fea0bf0a640 1 -- 172.21.15.104:0/3008601652 shutdown_connections 2024-05-08T04:21:21.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.066+0000 7fea0bf0a640 1 --2- 172.21.15.104:0/3008601652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea04157ac0 0x7fea04157f50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.066+0000 7fea0bf0a640 1 --2- 172.21.15.104:0/3008601652 >> v2:172.21.15.183:3300/0 conn(0x7fea0415edf0 0x7fea040b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.066+0000 7fea0bf0a640 1 -- 172.21.15.104:0/3008601652 >> 172.21.15.104:0/3008601652 conn(0x7fea040b3450 msgr2=0x7fea040b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:21.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.066+0000 7fea0bf0a640 1 -- 172.21.15.104:0/3008601652 shutdown_connections 2024-05-08T04:21:21.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.066+0000 7fea0bf0a640 1 -- 172.21.15.104:0/3008601652 wait complete. 2024-05-08T04:21:21.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.067+0000 7fea0bf0a640 1 Processor -- start 2024-05-08T04:21:21.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.067+0000 7fea0bf0a640 1 -- start start 2024-05-08T04:21:21.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0bf0a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea04070c70 0x7fea041f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0bf0a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea04157ac0 0x7fea041588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0bf0a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea0415edf0 0x7fea041611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0bf0a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea040b57e0 con 0x7fea0415edf0 2024-05-08T04:21:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0bf0a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea040b5b80 con 0x7fea04157ac0 2024-05-08T04:21:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0bf0a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea040b5960 con 0x7fea04070c70 2024-05-08T04:21:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0a4a7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea0415edf0 0x7fea041611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0a4a7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea0415edf0 0x7fea041611b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34026/0 (socket says 172.21.15.104:34026) 2024-05-08T04:21:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0a4a7640 1 -- 172.21.15.104:0/2849135241 learned_addr learned my addr 172.21.15.104:0/2849135241 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea094a5640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea04157ac0 0x7fea041588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea09ca6640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea04070c70 0x7fea041f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0a4a7640 1 -- 172.21.15.104:0/2849135241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea04070c70 msgr2=0x7fea041f6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0a4a7640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea04070c70 0x7fea041f6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0a4a7640 1 -- 172.21.15.104:0/2849135241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea04157ac0 msgr2=0x7fea041588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0a4a7640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea04157ac0 0x7fea041588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0a4a7640 1 -- 172.21.15.104:0/2849135241 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea040cd710 con 0x7fea0415edf0 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.068+0000 7fea0a4a7640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea0415edf0 0x7fea041611b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc009e50 tx=0x7fe9fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.069+0000 7fe9fa7fc640 1 -- 172.21.15.104:0/2849135241 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc036050 con 0x7fea0415edf0 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.069+0000 7fe9fa7fc640 1 -- 172.21.15.104:0/2849135241 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9fc042070 con 0x7fea0415edf0 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.069+0000 7fea0bf0a640 1 -- 172.21.15.104:0/2849135241 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea041f7830 con 0x7fea0415edf0 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.069+0000 7fe9fa7fc640 1 -- 172.21.15.104:0/2849135241 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc009510 con 0x7fea0415edf0 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.069+0000 7fea0bf0a640 1 -- 172.21.15.104:0/2849135241 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea04158e10 con 0x7fea0415edf0 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.070+0000 7fea0bf0a640 1 -- 172.21.15.104:0/2849135241 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea04075010 con 0x7fea0415edf0 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.070+0000 7fe9fa7fc640 1 -- 172.21.15.104:0/2849135241 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe9fc007bf0 con 0x7fea0415edf0 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.071+0000 7fe9fa7fc640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe9e806b4d0 0x7fe9e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.071+0000 7fe9fa7fc640 1 -- 172.21.15.104:0/2849135241 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9fc0aaff0 con 0x7fea0415edf0 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.071+0000 7fea09ca6640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe9e806b4d0 0x7fe9e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.071+0000 7fea09ca6640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe9e806b4d0 0x7fe9e806d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fea00000f60 tx=0x7fea00007cc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:21.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.075+0000 7fe9fa7fc640 1 -- 172.21.15.104:0/2849135241 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe9fc07a020 con 0x7fea0415edf0 2024-05-08T04:21:21.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.242+0000 7fea0bf0a640 1 -- 172.21.15.104:0/2849135241 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea040683d0 con 0x7fe9e806b4d0 2024-05-08T04:21:21.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.248+0000 7fe9fa7fc640 1 -- 172.21.15.104:0/2849135241 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251832 (secure 0 0 0) 0x7fea000074e0 con 0x7fe9e806b4d0 2024-05-08T04:21:21.253 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:21.254 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:21:21.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.251+0000 7fea0bf0a640 1 -- 172.21.15.104:0/2849135241 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe9e806b4d0 msgr2=0x7fe9e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.251+0000 7fea0bf0a640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe9e806b4d0 0x7fe9e806d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fea00000f60 tx=0x7fea00007cc0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.251+0000 7fea0bf0a640 1 -- 172.21.15.104:0/2849135241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea0415edf0 msgr2=0x7fea041611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.251+0000 7fea0bf0a640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea0415edf0 0x7fea041611b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc009e50 tx=0x7fe9fc004a40 comp rx=0 tx=0).stop 2024-05-08T04:21:21.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.251+0000 7fea0bf0a640 1 -- 172.21.15.104:0/2849135241 shutdown_connections 2024-05-08T04:21:21.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.251+0000 7fea0bf0a640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe9e806b4d0 0x7fe9e806d990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.251+0000 7fea0bf0a640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea04157ac0 0x7fea041588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.251+0000 7fea0bf0a640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea0415edf0 0x7fea041611b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.251+0000 7fea0bf0a640 1 --2- 172.21.15.104:0/2849135241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea04070c70 0x7fea041f6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.251+0000 7fea0bf0a640 1 -- 172.21.15.104:0/2849135241 >> 172.21.15.104:0/2849135241 conn(0x7fea040b3450 msgr2=0x7fea0415bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:21.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.251+0000 7fea0bf0a640 1 -- 172.21.15.104:0/2849135241 shutdown_connections 2024-05-08T04:21:21.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.251+0000 7fea0bf0a640 1 -- 172.21.15.104:0/2849135241 wait complete. 2024-05-08T04:21:21.263 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-08T04:21:20.639518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.851168"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806700+0000","last_change":"2024-05-08T04:21:10.815759+0000","last_active":"2024-05-08T04:21:11.806700+0000","last_peered":"2024-05-08T04:21:11.806700+0000","last_clean":"2024-05-08T04:21:11.806700+0000","last_became_active":"2024-05-08T04:21:10.815430+0000","last_became_peered":"2024-05-08T04:21:10.815430+0000","last_unstale":"2024-05-08T04:21:11.806700+0000","last_undegraded":"2024-05-08T04:21:11.806700+0000","last_fullsized":"2024-05-08T04:21:11.806700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:09:39.015637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799301+0000","last_change":"2024-05-08T04:21:10.799995+0000","last_active":"2024-05-08T04:21:11.799301+0000","last_peered":"2024-05-08T04:21:11.799301+0000","last_clean":"2024-05-08T04:21:11.799301+0000","last_became_active":"2024-05-08T04:21:10.799655+0000","last_became_peered":"2024-05-08T04:21:10.799655+0000","last_unstale":"2024-05-08T04:21:11.799301+0000","last_undegraded":"2024-05-08T04:21:11.799301+0000","last_fullsized":"2024-05-08T04:21:11.799301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:22.135893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798824+0000","last_change":"2024-05-08T04:21:10.807212+0000","last_active":"2024-05-08T04:21:11.798824+0000","last_peered":"2024-05-08T04:21:11.798824+0000","last_clean":"2024-05-08T04:21:11.798824+0000","last_became_active":"2024-05-08T04:21:10.806880+0000","last_became_peered":"2024-05-08T04:21:10.806880+0000","last_unstale":"2024-05-08T04:21:11.798824+0000","last_undegraded":"2024-05-08T04:21:11.798824+0000","last_fullsized":"2024-05-08T04:21:11.798824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683814+0000","last_change":"2024-05-08T04:21:10.809736+0000","last_active":"2024-05-08T04:21:12.683814+0000","last_peered":"2024-05-08T04:21:12.683814+0000","last_clean":"2024-05-08T04:21:12.683814+0000","last_became_active":"2024-05-08T04:21:10.808825+0000","last_became_peered":"2024-05-08T04:21:10.808825+0000","last_unstale":"2024-05-08T04:21:12.683814+0000","last_undegraded":"2024-05-08T04:21:12.683814+0000","last_fullsized":"2024-05-08T04:21:12.683814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:00.517242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806396+0000","last_change":"2024-05-08T04:21:10.807971+0000","last_active":"2024-05-08T04:21:11.806396+0000","last_peered":"2024-05-08T04:21:11.806396+0000","last_clean":"2024-05-08T04:21:11.806396+0000","last_became_active":"2024-05-08T04:21:10.807525+0000","last_became_peered":"2024-05-08T04:21:10.807525+0000","last_unstale":"2024-05-08T04:21:11.806396+0000","last_undegraded":"2024-05-08T04:21:11.806396+0000","last_fullsized":"2024-05-08T04:21:11.806396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:33.787458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683680+0000","last_change":"2024-05-08T04:21:10.808827+0000","last_active":"2024-05-08T04:21:12.683680+0000","last_peered":"2024-05-08T04:21:12.683680+0000","last_clean":"2024-05-08T04:21:12.683680+0000","last_became_active":"2024-05-08T04:21:10.808388+0000","last_became_peered":"2024-05-08T04:21:10.808388+0000","last_unstale":"2024-05-08T04:21:12.683680+0000","last_undegraded":"2024-05-08T04:21:12.683680+0000","last_fullsized":"2024-05-08T04:21:12.683680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:11.466963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806249+0000","last_change":"2024-05-08T04:21:10.806944+0000","last_active":"2024-05-08T04:21:11.806249+0000","last_peered":"2024-05-08T04:21:11.806249+0000","last_clean":"2024-05-08T04:21:11.806249+0000","last_became_active":"2024-05-08T04:21:10.806257+0000","last_became_peered":"2024-05-08T04:21:10.806257+0000","last_unstale":"2024-05-08T04:21:11.806249+0000","last_undegraded":"2024-05-08T04:21:11.806249+0000","last_fullsized":"2024-05-08T04:21:11.806249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798784+0000","last_change":"2024-05-08T04:21:10.808012+0000","last_active":"2024-05-08T04:21:11.798784+0000","last_peered":"2024-05-08T04:21:11.798784+0000","last_clean":"2024-05-08T04:21:11.798784+0000","last_became_active":"2024-05-08T04:21:10.807762+0000","last_became_peered":"2024-05-08T04:21:10.807762+0000","last_unstale":"2024-05-08T04:21:11.798784+0000","last_undegraded":"2024-05-08T04:21:11.798784+0000","last_fullsized":"2024-05-08T04:21:11.798784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797594+0000","last_change":"2024-05-08T04:21:10.813184+0000","last_active":"2024-05-08T04:21:11.797594+0000","last_peered":"2024-05-08T04:21:11.797594+0000","last_clean":"2024-05-08T04:21:11.797594+0000","last_became_active":"2024-05-08T04:21:10.812887+0000","last_became_peered":"2024-05-08T04:21:10.812887+0000","last_unstale":"2024-05-08T04:21:11.797594+0000","last_undegraded":"2024-05-08T04:21:11.797594+0000","last_fullsized":"2024-05-08T04:21:11.797594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:34.037163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806602+0000","last_change":"2024-05-08T04:21:10.808669+0000","last_active":"2024-05-08T04:21:11.806602+0000","last_peered":"2024-05-08T04:21:11.806602+0000","last_clean":"2024-05-08T04:21:11.806602+0000","last_became_active":"2024-05-08T04:21:10.807623+0000","last_became_peered":"2024-05-08T04:21:10.807623+0000","last_unstale":"2024-05-08T04:21:11.806602+0000","last_undegraded":"2024-05-08T04:21:11.806602+0000","last_fullsized":"2024-05-08T04:21:11.806602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:36.487747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806477+0000","last_change":"2024-05-08T04:21:10.815746+0000","last_active":"2024-05-08T04:21:11.806477+0000","last_peered":"2024-05-08T04:21:11.806477+0000","last_clean":"2024-05-08T04:21:11.806477+0000","last_became_active":"2024-05-08T04:21:10.815484+0000","last_became_peered":"2024-05-08T04:21:10.815484+0000","last_unstale":"2024-05-08T04:21:11.806477+0000","last_undegraded":"2024-05-08T04:21:11.806477+0000","last_fullsized":"2024-05-08T04:21:11.806477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:14.742480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806591+0000","last_change":"2024-05-08T04:21:10.809694+0000","last_active":"2024-05-08T04:21:11.806591+0000","last_peered":"2024-05-08T04:21:11.806591+0000","last_clean":"2024-05-08T04:21:11.806591+0000","last_became_active":"2024-05-08T04:21:10.809335+0000","last_became_peered":"2024-05-08T04:21:10.809335+0000","last_unstale":"2024-05-08T04:21:11.806591+0000","last_undegraded":"2024-05-08T04:21:11.806591+0000","last_fullsized":"2024-05-08T04:21:11.806591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:22.135893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684183+0000","last_change":"2024-05-08T04:21:10.810243+0000","last_active":"2024-05-08T04:21:12.684183+0000","last_peered":"2024-05-08T04:21:12.684183+0000","last_clean":"2024-05-08T04:21:12.684183+0000","last_became_active":"2024-05-08T04:21:10.809954+0000","last_became_peered":"2024-05-08T04:21:10.809954+0000","last_unstale":"2024-05-08T04:21:12.684183+0000","last_undegraded":"2024-05-08T04:21:12.684183+0000","last_fullsized":"2024-05-08T04:21:12.684183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:18:33.343054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684014+0000","last_change":"2024-05-08T04:21:10.803036+0000","last_active":"2024-05-08T04:21:12.684014+0000","last_peered":"2024-05-08T04:21:12.684014+0000","last_clean":"2024-05-08T04:21:12.684014+0000","last_became_active":"2024-05-08T04:21:10.801931+0000","last_became_peered":"2024-05-08T04:21:10.801931+0000","last_unstale":"2024-05-08T04:21:12.684014+0000","last_undegraded":"2024-05-08T04:21:12.684014+0000","last_fullsized":"2024-05-08T04:21:12.684014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:53.558867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798885+0000","last_change":"2024-05-08T04:21:10.810578+0000","last_active":"2024-05-08T04:21:11.798885+0000","last_peered":"2024-05-08T04:21:11.798885+0000","last_clean":"2024-05-08T04:21:11.798885+0000","last_became_active":"2024-05-08T04:21:10.809929+0000","last_became_peered":"2024-05-08T04:21:10.809929+0000","last_unstale":"2024-05-08T04:21:11.798885+0000","last_undegraded":"2024-05-08T04:21:11.798885+0000","last_fullsized":"2024-05-08T04:21:11.798885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997095+0000","last_change":"2024-05-08T04:21:10.809708+0000","last_active":"2024-05-08T04:21:11.997095+0000","last_peered":"2024-05-08T04:21:11.997095+0000","last_clean":"2024-05-08T04:21:11.997095+0000","last_became_active":"2024-05-08T04:21:10.809239+0000","last_became_peered":"2024-05-08T04:21:10.809239+0000","last_unstale":"2024-05-08T04:21:11.997095+0000","last_undegraded":"2024-05-08T04:21:11.997095+0000","last_fullsized":"2024-05-08T04:21:11.997095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:09:39.015637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997748+0000","last_change":"2024-05-08T04:21:10.813941+0000","last_active":"2024-05-08T04:21:11.997748+0000","last_peered":"2024-05-08T04:21:11.997748+0000","last_clean":"2024-05-08T04:21:11.997748+0000","last_became_active":"2024-05-08T04:21:10.813628+0000","last_became_peered":"2024-05-08T04:21:10.813628+0000","last_unstale":"2024-05-08T04:21:11.997748+0000","last_undegraded":"2024-05-08T04:21:11.997748+0000","last_fullsized":"2024-05-08T04:21:11.997748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:54:22.530212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684324+0000","last_change":"2024-05-08T04:21:10.802243+0000","last_active":"2024-05-08T04:21:12.684324+0000","last_peered":"2024-05-08T04:21:12.684324+0000","last_clean":"2024-05-08T04:21:12.684324+0000","last_became_active":"2024-05-08T04:21:10.801990+0000","last_became_peered":"2024-05-08T04:21:10.801990+0000","last_unstale":"2024-05-08T04:21:12.684324+0000","last_undegraded":"2024-05-08T04:21:12.684324+0000","last_fullsized":"2024-05-08T04:21:12.684324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:11.466963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997557+0000","last_change":"2024-05-08T04:21:10.809257+0000","last_active":"2024-05-08T04:21:11.997557+0000","last_peered":"2024-05-08T04:21:11.997557+0000","last_clean":"2024-05-08T04:21:11.997557+0000","last_became_active":"2024-05-08T04:21:10.808961+0000","last_became_peered":"2024-05-08T04:21:10.808961+0000","last_unstale":"2024-05-08T04:21:11.997557+0000","last_undegraded":"2024-05-08T04:21:11.997557+0000","last_fullsized":"2024-05-08T04:21:11.997557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:47:28.393115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806508+0000","last_change":"2024-05-08T04:21:10.808294+0000","last_active":"2024-05-08T04:21:11.806508+0000","last_peered":"2024-05-08T04:21:11.806508+0000","last_clean":"2024-05-08T04:21:11.806508+0000","last_became_active":"2024-05-08T04:21:10.808032+0000","last_became_peered":"2024-05-08T04:21:10.808032+0000","last_unstale":"2024-05-08T04:21:11.806508+0000","last_undegraded":"2024-05-08T04:21:11.806508+0000","last_fullsized":"2024-05-08T04:21:11.806508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:33.067388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803850+0000","last_change":"2024-05-08T04:21:10.806239+0000","last_active":"2024-05-08T04:21:11.803850+0000","last_peered":"2024-05-08T04:21:11.803850+0000","last_clean":"2024-05-08T04:21:11.803850+0000","last_became_active":"2024-05-08T04:21:10.805369+0000","last_became_peered":"2024-05-08T04:21:10.805369+0000","last_unstale":"2024-05-08T04:21:11.803850+0000","last_undegraded":"2024-05-08T04:21:11.803850+0000","last_fullsized":"2024-05-08T04:21:11.803850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:55:41.627503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797390+0000","last_change":"2024-05-08T04:21:10.813103+0000","last_active":"2024-05-08T04:21:11.797390+0000","last_peered":"2024-05-08T04:21:11.797390+0000","last_clean":"2024-05-08T04:21:11.797390+0000","last_became_active":"2024-05-08T04:21:10.812833+0000","last_became_peered":"2024-05-08T04:21:10.812833+0000","last_unstale":"2024-05-08T04:21:11.797390+0000","last_undegraded":"2024-05-08T04:21:11.797390+0000","last_fullsized":"2024-05-08T04:21:11.797390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:35:00.954562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798758+0000","last_change":"2024-05-08T04:21:10.794976+0000","last_active":"2024-05-08T04:21:11.798758+0000","last_peered":"2024-05-08T04:21:11.798758+0000","last_clean":"2024-05-08T04:21:11.798758+0000","last_became_active":"2024-05-08T04:21:10.794594+0000","last_became_peered":"2024-05-08T04:21:10.794594+0000","last_unstale":"2024-05-08T04:21:11.798758+0000","last_undegraded":"2024-05-08T04:21:11.798758+0000","last_fullsized":"2024-05-08T04:21:11.798758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:29.958463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997065+0000","last_change":"2024-05-08T04:21:10.809601+0000","last_active":"2024-05-08T04:21:11.997065+0000","last_peered":"2024-05-08T04:21:11.997065+0000","last_clean":"2024-05-08T04:21:11.997065+0000","last_became_active":"2024-05-08T04:21:10.809257+0000","last_became_peered":"2024-05-08T04:21:10.809257+0000","last_unstale":"2024-05-08T04:21:11.997065+0000","last_undegraded":"2024-05-08T04:21:11.997065+0000","last_fullsized":"2024-05-08T04:21:11.997065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799293+0000","last_change":"2024-05-08T04:21:10.802281+0000","last_active":"2024-05-08T04:21:11.799293+0000","last_peered":"2024-05-08T04:21:11.799293+0000","last_clean":"2024-05-08T04:21:11.799293+0000","last_became_active":"2024-05-08T04:21:10.802003+0000","last_became_peered":"2024-05-08T04:21:10.802003+0000","last_unstale":"2024-05-08T04:21:11.799293+0000","last_undegraded":"2024-05-08T04:21:11.799293+0000","last_fullsized":"2024-05-08T04:21:11.799293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:01.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683844+0000","last_change":"2024-05-08T04:21:10.817545+0000","last_active":"2024-05-08T04:21:12.683844+0000","last_peered":"2024-05-08T04:21:12.683844+0000","last_clean":"2024-05-08T04:21:12.683844+0000","last_became_active":"2024-05-08T04:21:10.817272+0000","last_became_peered":"2024-05-08T04:21:10.817272+0000","last_unstale":"2024-05-08T04:21:12.683844+0000","last_undegraded":"2024-05-08T04:21:12.683844+0000","last_fullsized":"2024-05-08T04:21:12.683844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:02.505469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684138+0000","last_change":"2024-05-08T04:21:10.802074+0000","last_active":"2024-05-08T04:21:12.684138+0000","last_peered":"2024-05-08T04:21:12.684138+0000","last_clean":"2024-05-08T04:21:12.684138+0000","last_became_active":"2024-05-08T04:21:10.801792+0000","last_became_peered":"2024-05-08T04:21:10.801792+0000","last_unstale":"2024-05-08T04:21:12.684138+0000","last_undegraded":"2024-05-08T04:21:12.684138+0000","last_fullsized":"2024-05-08T04:21:12.684138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:01.107803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683976+0000","last_change":"2024-05-08T04:21:10.810222+0000","last_active":"2024-05-08T04:21:12.683976+0000","last_peered":"2024-05-08T04:21:12.683976+0000","last_clean":"2024-05-08T04:21:12.683976+0000","last_became_active":"2024-05-08T04:21:10.809936+0000","last_became_peered":"2024-05-08T04:21:10.809936+0000","last_unstale":"2024-05-08T04:21:12.683976+0000","last_undegraded":"2024-05-08T04:21:12.683976+0000","last_fullsized":"2024-05-08T04:21:12.683976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:34.037163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799109+0000","last_change":"2024-05-08T04:21:10.801209+0000","last_active":"2024-05-08T04:21:11.799109+0000","last_peered":"2024-05-08T04:21:11.799109+0000","last_clean":"2024-05-08T04:21:11.799109+0000","last_became_active":"2024-05-08T04:21:10.800919+0000","last_became_peered":"2024-05-08T04:21:10.800919+0000","last_unstale":"2024-05-08T04:21:11.799109+0000","last_undegraded":"2024-05-08T04:21:11.799109+0000","last_fullsized":"2024-05-08T04:21:11.799109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:14.742480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997234+0000","last_change":"2024-05-08T04:21:10.812578+0000","last_active":"2024-05-08T04:21:11.997234+0000","last_peered":"2024-05-08T04:21:11.997234+0000","last_clean":"2024-05-08T04:21:11.997234+0000","last_became_active":"2024-05-08T04:21:10.811984+0000","last_became_peered":"2024-05-08T04:21:10.811984+0000","last_unstale":"2024-05-08T04:21:11.997234+0000","last_undegraded":"2024-05-08T04:21:11.997234+0000","last_fullsized":"2024-05-08T04:21:11.997234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:18.292078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683815+0000","last_change":"2024-05-08T04:21:10.803704+0000","last_active":"2024-05-08T04:21:12.683815+0000","last_peered":"2024-05-08T04:21:12.683815+0000","last_clean":"2024-05-08T04:21:12.683815+0000","last_became_active":"2024-05-08T04:21:10.803362+0000","last_became_peered":"2024-05-08T04:21:10.803362+0000","last_unstale":"2024-05-08T04:21:12.683815+0000","last_undegraded":"2024-05-08T04:21:12.683815+0000","last_fullsized":"2024-05-08T04:21:12.683815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:54.044618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683628+0000","last_change":"2024-05-08T04:21:10.803508+0000","last_active":"2024-05-08T04:21:12.683628+0000","last_peered":"2024-05-08T04:21:12.683628+0000","last_clean":"2024-05-08T04:21:12.683628+0000","last_became_active":"2024-05-08T04:21:10.803182+0000","last_became_peered":"2024-05-08T04:21:10.803182+0000","last_unstale":"2024-05-08T04:21:12.683628+0000","last_undegraded":"2024-05-08T04:21:12.683628+0000","last_fullsized":"2024-05-08T04:21:12.683628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:53.770709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797469+0000","last_change":"2024-05-08T04:21:10.806394+0000","last_active":"2024-05-08T04:21:11.797469+0000","last_peered":"2024-05-08T04:21:11.797469+0000","last_clean":"2024-05-08T04:21:11.797469+0000","last_became_active":"2024-05-08T04:21:10.806139+0000","last_became_peered":"2024-05-08T04:21:10.806139+0000","last_unstale":"2024-05-08T04:21:11.797469+0000","last_undegraded":"2024-05-08T04:21:11.797469+0000","last_fullsized":"2024-05-08T04:21:11.797469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:00.517242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799118+0000","last_change":"2024-05-08T04:21:09.799594+0000","last_active":"2024-05-08T04:21:11.799118+0000","last_peered":"2024-05-08T04:21:11.799118+0000","last_clean":"2024-05-08T04:21:11.799118+0000","last_became_active":"2024-05-08T04:21:09.798501+0000","last_became_peered":"2024-05-08T04:21:09.798501+0000","last_unstale":"2024-05-08T04:21:11.799118+0000","last_undegraded":"2024-05-08T04:21:11.799118+0000","last_fullsized":"2024-05-08T04:21:11.799118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804031+0000","last_change":"2024-05-08T04:21:10.812658+0000","last_active":"2024-05-08T04:21:11.804031+0000","last_peered":"2024-05-08T04:21:11.804031+0000","last_clean":"2024-05-08T04:21:11.804031+0000","last_became_active":"2024-05-08T04:21:10.812321+0000","last_became_peered":"2024-05-08T04:21:10.812321+0000","last_unstale":"2024-05-08T04:21:11.804031+0000","last_undegraded":"2024-05-08T04:21:11.804031+0000","last_fullsized":"2024-05-08T04:21:11.804031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997336+0000","last_change":"2024-05-08T04:21:09.805980+0000","last_active":"2024-05-08T04:21:11.997336+0000","last_peered":"2024-05-08T04:21:11.997336+0000","last_clean":"2024-05-08T04:21:11.997336+0000","last_became_active":"2024-05-08T04:21:09.805512+0000","last_became_peered":"2024-05-08T04:21:09.805512+0000","last_unstale":"2024-05-08T04:21:11.997336+0000","last_undegraded":"2024-05-08T04:21:11.997336+0000","last_fullsized":"2024-05-08T04:21:11.997336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:34:59.948483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683927+0000","last_change":"2024-05-08T04:21:09.807091+0000","last_active":"2024-05-08T04:21:12.683927+0000","last_peered":"2024-05-08T04:21:12.683927+0000","last_clean":"2024-05-08T04:21:12.683927+0000","last_became_active":"2024-05-08T04:21:09.806790+0000","last_became_peered":"2024-05-08T04:21:09.806790+0000","last_unstale":"2024-05-08T04:21:12.683927+0000","last_undegraded":"2024-05-08T04:21:12.683927+0000","last_fullsized":"2024-05-08T04:21:12.683927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799252+0000","last_change":"2024-05-08T04:21:10.806542+0000","last_active":"2024-05-08T04:21:11.799252+0000","last_peered":"2024-05-08T04:21:11.799252+0000","last_clean":"2024-05-08T04:21:11.799252+0000","last_became_active":"2024-05-08T04:21:10.804525+0000","last_became_peered":"2024-05-08T04:21:10.804525+0000","last_unstale":"2024-05-08T04:21:11.799252+0000","last_undegraded":"2024-05-08T04:21:11.799252+0000","last_fullsized":"2024-05-08T04:21:11.799252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:33.067388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997177+0000","last_change":"2024-05-08T04:21:09.803521+0000","last_active":"2024-05-08T04:21:11.997177+0000","last_peered":"2024-05-08T04:21:11.997177+0000","last_clean":"2024-05-08T04:21:11.997177+0000","last_became_active":"2024-05-08T04:21:09.803237+0000","last_became_peered":"2024-05-08T04:21:09.803237+0000","last_unstale":"2024-05-08T04:21:11.997177+0000","last_undegraded":"2024-05-08T04:21:11.997177+0000","last_fullsized":"2024-05-08T04:21:11.997177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803821+0000","last_change":"2024-05-08T04:21:10.804293+0000","last_active":"2024-05-08T04:21:11.803821+0000","last_peered":"2024-05-08T04:21:11.803821+0000","last_clean":"2024-05-08T04:21:11.803821+0000","last_became_active":"2024-05-08T04:21:10.803978+0000","last_became_peered":"2024-05-08T04:21:10.803978+0000","last_unstale":"2024-05-08T04:21:11.803821+0000","last_undegraded":"2024-05-08T04:21:11.803821+0000","last_fullsized":"2024-05-08T04:21:11.803821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:00.315803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797658+0000","last_change":"2024-05-08T04:21:09.802555+0000","last_active":"2024-05-08T04:21:11.797658+0000","last_peered":"2024-05-08T04:21:11.797658+0000","last_clean":"2024-05-08T04:21:11.797658+0000","last_became_active":"2024-05-08T04:21:09.801729+0000","last_became_peered":"2024-05-08T04:21:09.801729+0000","last_unstale":"2024-05-08T04:21:11.797658+0000","last_undegraded":"2024-05-08T04:21:11.797658+0000","last_fullsized":"2024-05-08T04:21:11.797658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683856+0000","last_change":"2024-05-08T04:21:10.817304+0000","last_active":"2024-05-08T04:21:12.683856+0000","last_peered":"2024-05-08T04:21:12.683856+0000","last_clean":"2024-05-08T04:21:12.683856+0000","last_became_active":"2024-05-08T04:21:10.817053+0000","last_became_peered":"2024-05-08T04:21:10.817053+0000","last_unstale":"2024-05-08T04:21:12.683856+0000","last_undegraded":"2024-05-08T04:21:12.683856+0000","last_fullsized":"2024-05-08T04:21:12.683856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:34.037163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806539+0000","last_change":"2024-05-08T04:21:09.808688+0000","last_active":"2024-05-08T04:21:11.806539+0000","last_peered":"2024-05-08T04:21:11.806539+0000","last_clean":"2024-05-08T04:21:11.806539+0000","last_became_active":"2024-05-08T04:21:09.808341+0000","last_became_peered":"2024-05-08T04:21:09.808341+0000","last_unstale":"2024-05-08T04:21:11.806539+0000","last_undegraded":"2024-05-08T04:21:11.806539+0000","last_fullsized":"2024-05-08T04:21:11.806539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:13.078999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799355+0000","last_change":"2024-05-08T04:21:10.812699+0000","last_active":"2024-05-08T04:21:11.799355+0000","last_peered":"2024-05-08T04:21:11.799355+0000","last_clean":"2024-05-08T04:21:11.799355+0000","last_became_active":"2024-05-08T04:21:10.812379+0000","last_became_peered":"2024-05-08T04:21:10.812379+0000","last_unstale":"2024-05-08T04:21:11.799355+0000","last_undegraded":"2024-05-08T04:21:11.799355+0000","last_fullsized":"2024-05-08T04:21:11.799355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684382+0000","last_change":"2024-05-08T04:21:09.796581+0000","last_active":"2024-05-08T04:21:12.684382+0000","last_peered":"2024-05-08T04:21:12.684382+0000","last_clean":"2024-05-08T04:21:12.684382+0000","last_became_active":"2024-05-08T04:21:09.796288+0000","last_became_peered":"2024-05-08T04:21:09.796288+0000","last_unstale":"2024-05-08T04:21:12.684382+0000","last_undegraded":"2024-05-08T04:21:12.684382+0000","last_fullsized":"2024-05-08T04:21:12.684382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997394+0000","last_change":"2024-05-08T04:21:10.809585+0000","last_active":"2024-05-08T04:21:11.997394+0000","last_peered":"2024-05-08T04:21:11.997394+0000","last_clean":"2024-05-08T04:21:11.997394+0000","last_became_active":"2024-05-08T04:21:10.809208+0000","last_became_peered":"2024-05-08T04:21:10.809208+0000","last_unstale":"2024-05-08T04:21:11.997394+0000","last_undegraded":"2024-05-08T04:21:11.997394+0000","last_fullsized":"2024-05-08T04:21:11.997394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:53:26.704579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683714+0000","last_change":"2024-05-08T04:21:09.798917+0000","last_active":"2024-05-08T04:21:12.683714+0000","last_peered":"2024-05-08T04:21:12.683714+0000","last_clean":"2024-05-08T04:21:12.683714+0000","last_became_active":"2024-05-08T04:21:09.798646+0000","last_became_peered":"2024-05-08T04:21:09.798646+0000","last_unstale":"2024-05-08T04:21:12.683714+0000","last_undegraded":"2024-05-08T04:21:12.683714+0000","last_fullsized":"2024-05-08T04:21:12.683714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:25.652092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806500+0000","last_change":"2024-05-08T04:21:10.806707+0000","last_active":"2024-05-08T04:21:11.806500+0000","last_peered":"2024-05-08T04:21:11.806500+0000","last_clean":"2024-05-08T04:21:11.806500+0000","last_became_active":"2024-05-08T04:21:10.806433+0000","last_became_peered":"2024-05-08T04:21:10.806433+0000","last_unstale":"2024-05-08T04:21:11.806500+0000","last_undegraded":"2024-05-08T04:21:11.806500+0000","last_fullsized":"2024-05-08T04:21:11.806500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:39.936653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684111+0000","last_change":"2024-05-08T04:21:09.806965+0000","last_active":"2024-05-08T04:21:12.684111+0000","last_peered":"2024-05-08T04:21:12.684111+0000","last_clean":"2024-05-08T04:21:12.684111+0000","last_became_active":"2024-05-08T04:21:09.806616+0000","last_became_peered":"2024-05-08T04:21:09.806616+0000","last_unstale":"2024-05-08T04:21:12.684111+0000","last_undegraded":"2024-05-08T04:21:12.684111+0000","last_fullsized":"2024-05-08T04:21:12.684111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:09.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684473+0000","last_change":"2024-05-08T04:21:10.814170+0000","last_active":"2024-05-08T04:21:12.684473+0000","last_peered":"2024-05-08T04:21:12.684473+0000","last_clean":"2024-05-08T04:21:12.684473+0000","last_became_active":"2024-05-08T04:21:10.813882+0000","last_became_peered":"2024-05-08T04:21:10.813882+0000","last_unstale":"2024-05-08T04:21:12.684473+0000","last_undegraded":"2024-05-08T04:21:12.684473+0000","last_fullsized":"2024-05-08T04:21:12.684473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:55:41.627503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997406+0000","last_change":"2024-05-08T04:21:09.799377+0000","last_active":"2024-05-08T04:21:11.997406+0000","last_peered":"2024-05-08T04:21:11.997406+0000","last_clean":"2024-05-08T04:21:11.997406+0000","last_became_active":"2024-05-08T04:21:09.799078+0000","last_became_peered":"2024-05-08T04:21:09.799078+0000","last_unstale":"2024-05-08T04:21:11.997406+0000","last_undegraded":"2024-05-08T04:21:11.997406+0000","last_fullsized":"2024-05-08T04:21:11.997406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:28:59.511163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997261+0000","last_change":"2024-05-08T04:21:10.814186+0000","last_active":"2024-05-08T04:21:11.997261+0000","last_peered":"2024-05-08T04:21:11.997261+0000","last_clean":"2024-05-08T04:21:11.997261+0000","last_became_active":"2024-05-08T04:21:10.813837+0000","last_became_peered":"2024-05-08T04:21:10.813837+0000","last_unstale":"2024-05-08T04:21:11.997261+0000","last_undegraded":"2024-05-08T04:21:11.997261+0000","last_fullsized":"2024-05-08T04:21:11.997261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:41:47.087907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806222+0000","last_change":"2024-05-08T04:21:09.809783+0000","last_active":"2024-05-08T04:21:11.806222+0000","last_peered":"2024-05-08T04:21:11.806222+0000","last_clean":"2024-05-08T04:21:11.806222+0000","last_became_active":"2024-05-08T04:21:09.809489+0000","last_became_peered":"2024-05-08T04:21:09.809489+0000","last_unstale":"2024-05-08T04:21:11.806222+0000","last_undegraded":"2024-05-08T04:21:11.806222+0000","last_fullsized":"2024-05-08T04:21:11.806222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797316+0000","last_change":"2024-05-08T04:21:10.802400+0000","last_active":"2024-05-08T04:21:11.797316+0000","last_peered":"2024-05-08T04:21:11.797316+0000","last_clean":"2024-05-08T04:21:11.797316+0000","last_became_active":"2024-05-08T04:21:10.801522+0000","last_became_peered":"2024-05-08T04:21:10.801522+0000","last_unstale":"2024-05-08T04:21:11.797316+0000","last_undegraded":"2024-05-08T04:21:11.797316+0000","last_fullsized":"2024-05-08T04:21:11.797316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:11.466963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803687+0000","last_change":"2024-05-08T04:21:09.795156+0000","last_active":"2024-05-08T04:21:11.803687+0000","last_peered":"2024-05-08T04:21:11.803687+0000","last_clean":"2024-05-08T04:21:11.803687+0000","last_became_active":"2024-05-08T04:21:09.794658+0000","last_became_peered":"2024-05-08T04:21:09.794658+0000","last_unstale":"2024-05-08T04:21:11.803687+0000","last_undegraded":"2024-05-08T04:21:11.803687+0000","last_fullsized":"2024-05-08T04:21:11.803687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997156+0000","last_change":"2024-05-08T04:21:10.810862+0000","last_active":"2024-05-08T04:21:11.997156+0000","last_peered":"2024-05-08T04:21:11.997156+0000","last_clean":"2024-05-08T04:21:11.997156+0000","last_became_active":"2024-05-08T04:21:10.810041+0000","last_became_peered":"2024-05-08T04:21:10.810041+0000","last_unstale":"2024-05-08T04:21:11.997156+0000","last_undegraded":"2024-05-08T04:21:11.997156+0000","last_fullsized":"2024-05-08T04:21:11.997156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:37:37.045065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806759+0000","last_change":"2024-05-08T04:21:09.805736+0000","last_active":"2024-05-08T04:21:11.806759+0000","last_peered":"2024-05-08T04:21:11.806759+0000","last_clean":"2024-05-08T04:21:11.806759+0000","last_became_active":"2024-05-08T04:21:09.805416+0000","last_became_peered":"2024-05-08T04:21:09.805416+0000","last_unstale":"2024-05-08T04:21:11.806759+0000","last_undegraded":"2024-05-08T04:21:11.806759+0000","last_fullsized":"2024-05-08T04:21:11.806759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:52.764630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683920+0000","last_change":"2024-05-08T04:21:10.812910+0000","last_active":"2024-05-08T04:21:12.683920+0000","last_peered":"2024-05-08T04:21:12.683920+0000","last_clean":"2024-05-08T04:21:12.683920+0000","last_became_active":"2024-05-08T04:21:10.812514+0000","last_became_peered":"2024-05-08T04:21:10.812514+0000","last_unstale":"2024-05-08T04:21:12.683920+0000","last_undegraded":"2024-05-08T04:21:12.683920+0000","last_fullsized":"2024-05-08T04:21:12.683920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:53.558867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804208+0000","last_change":"2024-05-08T04:21:09.800590+0000","last_active":"2024-05-08T04:21:11.804208+0000","last_peered":"2024-05-08T04:21:11.804208+0000","last_clean":"2024-05-08T04:21:11.804208+0000","last_became_active":"2024-05-08T04:21:09.800287+0000","last_became_peered":"2024-05-08T04:21:09.800287+0000","last_unstale":"2024-05-08T04:21:11.804208+0000","last_undegraded":"2024-05-08T04:21:11.804208+0000","last_fullsized":"2024-05-08T04:21:11.804208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:13.078999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806581+0000","last_change":"2024-05-08T04:21:10.806772+0000","last_active":"2024-05-08T04:21:11.806581+0000","last_peered":"2024-05-08T04:21:11.806581+0000","last_clean":"2024-05-08T04:21:11.806581+0000","last_became_active":"2024-05-08T04:21:10.806521+0000","last_became_peered":"2024-05-08T04:21:10.806521+0000","last_unstale":"2024-05-08T04:21:11.806581+0000","last_undegraded":"2024-05-08T04:21:11.806581+0000","last_fullsized":"2024-05-08T04:21:11.806581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:01.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799154+0000","last_change":"2024-05-08T04:21:09.799358+0000","last_active":"2024-05-08T04:21:11.799154+0000","last_peered":"2024-05-08T04:21:11.799154+0000","last_clean":"2024-05-08T04:21:11.799154+0000","last_became_active":"2024-05-08T04:21:09.799071+0000","last_became_peered":"2024-05-08T04:21:09.799071+0000","last_unstale":"2024-05-08T04:21:11.799154+0000","last_undegraded":"2024-05-08T04:21:11.799154+0000","last_fullsized":"2024-05-08T04:21:11.799154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806649+0000","last_change":"2024-05-08T04:21:10.808148+0000","last_active":"2024-05-08T04:21:11.806649+0000","last_peered":"2024-05-08T04:21:11.806649+0000","last_clean":"2024-05-08T04:21:11.806649+0000","last_became_active":"2024-05-08T04:21:10.807665+0000","last_became_peered":"2024-05-08T04:21:10.807665+0000","last_unstale":"2024-05-08T04:21:11.806649+0000","last_undegraded":"2024-05-08T04:21:11.806649+0000","last_fullsized":"2024-05-08T04:21:11.806649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684338+0000","last_change":"2024-05-08T04:21:09.808562+0000","last_active":"2024-05-08T04:21:12.684338+0000","last_peered":"2024-05-08T04:21:12.684338+0000","last_clean":"2024-05-08T04:21:12.684338+0000","last_became_active":"2024-05-08T04:21:09.808278+0000","last_became_peered":"2024-05-08T04:21:09.808278+0000","last_unstale":"2024-05-08T04:21:12.684338+0000","last_undegraded":"2024-05-08T04:21:12.684338+0000","last_fullsized":"2024-05-08T04:21:12.684338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:09.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997548+0000","last_change":"2024-05-08T04:21:10.811650+0000","last_active":"2024-05-08T04:21:11.997548+0000","last_peered":"2024-05-08T04:21:11.997548+0000","last_clean":"2024-05-08T04:21:11.997548+0000","last_became_active":"2024-05-08T04:21:10.811088+0000","last_became_peered":"2024-05-08T04:21:10.811088+0000","last_unstale":"2024-05-08T04:21:11.997548+0000","last_undegraded":"2024-05-08T04:21:11.997548+0000","last_fullsized":"2024-05-08T04:21:11.997548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:11:24.741018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797369+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:21:11.797369+0000","last_peered":"2024-05-08T04:21:11.797369+0000","last_clean":"2024-05-08T04:21:11.797369+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:21:11.797369+0000","last_undegraded":"2024-05-08T04:21:11.797369+0000","last_fullsized":"2024-05-08T04:21:11.797369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997368+0000","last_change":"2024-05-08T04:21:09.805253+0000","last_active":"2024-05-08T04:21:11.997368+0000","last_peered":"2024-05-08T04:21:11.997368+0000","last_clean":"2024-05-08T04:21:11.997368+0000","last_became_active":"2024-05-08T04:21:09.805004+0000","last_became_peered":"2024-05-08T04:21:09.805004+0000","last_unstale":"2024-05-08T04:21:11.997368+0000","last_undegraded":"2024-05-08T04:21:11.997368+0000","last_fullsized":"2024-05-08T04:21:11.997368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:52.552788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803933+0000","last_change":"2024-05-08T04:21:10.806073+0000","last_active":"2024-05-08T04:21:11.803933+0000","last_peered":"2024-05-08T04:21:11.803933+0000","last_clean":"2024-05-08T04:21:11.803933+0000","last_became_active":"2024-05-08T04:21:10.805314+0000","last_became_peered":"2024-05-08T04:21:10.805314+0000","last_unstale":"2024-05-08T04:21:11.803933+0000","last_undegraded":"2024-05-08T04:21:11.803933+0000","last_fullsized":"2024-05-08T04:21:11.803933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:29.958463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997207+0000","last_change":"2024-05-08T04:21:09.800131+0000","last_active":"2024-05-08T04:21:11.997207+0000","last_peered":"2024-05-08T04:21:11.997207+0000","last_clean":"2024-05-08T04:21:11.997207+0000","last_became_active":"2024-05-08T04:21:09.799704+0000","last_became_peered":"2024-05-08T04:21:09.799704+0000","last_unstale":"2024-05-08T04:21:11.997207+0000","last_undegraded":"2024-05-08T04:21:11.997207+0000","last_fullsized":"2024-05-08T04:21:11.997207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:52.764630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683807+0000","last_change":"2024-05-08T04:21:10.802802+0000","last_active":"2024-05-08T04:21:12.683807+0000","last_peered":"2024-05-08T04:21:12.683807+0000","last_clean":"2024-05-08T04:21:12.683807+0000","last_became_active":"2024-05-08T04:21:10.802481+0000","last_became_peered":"2024-05-08T04:21:10.802481+0000","last_unstale":"2024-05-08T04:21:12.683807+0000","last_undegraded":"2024-05-08T04:21:12.683807+0000","last_fullsized":"2024-05-08T04:21:12.683807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:02.505469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683669+0000","last_change":"2024-05-08T04:21:09.797811+0000","last_active":"2024-05-08T04:21:12.683669+0000","last_peered":"2024-05-08T04:21:12.683669+0000","last_clean":"2024-05-08T04:21:12.683669+0000","last_became_active":"2024-05-08T04:21:09.797499+0000","last_became_peered":"2024-05-08T04:21:09.797499+0000","last_unstale":"2024-05-08T04:21:12.683669+0000","last_undegraded":"2024-05-08T04:21:12.683669+0000","last_fullsized":"2024-05-08T04:21:12.683669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798975+0000","last_change":"2024-05-08T04:21:10.801647+0000","last_active":"2024-05-08T04:21:11.798975+0000","last_peered":"2024-05-08T04:21:11.798975+0000","last_clean":"2024-05-08T04:21:11.798975+0000","last_became_active":"2024-05-08T04:21:10.800875+0000","last_became_peered":"2024-05-08T04:21:10.800875+0000","last_unstale":"2024-05-08T04:21:11.798975+0000","last_undegraded":"2024-05-08T04:21:11.798975+0000","last_fullsized":"2024-05-08T04:21:11.798975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:33.787458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997455+0000","last_change":"2024-05-08T04:21:09.804263+0000","last_active":"2024-05-08T04:21:11.997455+0000","last_peered":"2024-05-08T04:21:11.997455+0000","last_clean":"2024-05-08T04:21:11.997455+0000","last_became_active":"2024-05-08T04:21:09.804011+0000","last_became_peered":"2024-05-08T04:21:09.804011+0000","last_unstale":"2024-05-08T04:21:11.997455+0000","last_undegraded":"2024-05-08T04:21:11.997455+0000","last_fullsized":"2024-05-08T04:21:11.997455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:01.499390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806394+0000","last_change":"2024-05-08T04:21:10.809139+0000","last_active":"2024-05-08T04:21:11.806394+0000","last_peered":"2024-05-08T04:21:11.806394+0000","last_clean":"2024-05-08T04:21:11.806394+0000","last_became_active":"2024-05-08T04:21:10.808801+0000","last_became_peered":"2024-05-08T04:21:10.808801+0000","last_unstale":"2024-05-08T04:21:11.806394+0000","last_undegraded":"2024-05-08T04:21:11.806394+0000","last_fullsized":"2024-05-08T04:21:11.806394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798765+0000","last_change":"2024-05-08T04:21:09.799028+0000","last_active":"2024-05-08T04:21:11.798765+0000","last_peered":"2024-05-08T04:21:11.798765+0000","last_clean":"2024-05-08T04:21:11.798765+0000","last_became_active":"2024-05-08T04:21:09.798761+0000","last_became_peered":"2024-05-08T04:21:09.798761+0000","last_unstale":"2024-05-08T04:21:11.798765+0000","last_undegraded":"2024-05-08T04:21:11.798765+0000","last_fullsized":"2024-05-08T04:21:11.798765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683765+0000","last_change":"2024-05-08T04:21:10.799702+0000","last_active":"2024-05-08T04:21:12.683765+0000","last_peered":"2024-05-08T04:21:12.683765+0000","last_clean":"2024-05-08T04:21:12.683765+0000","last_became_active":"2024-05-08T04:21:10.799422+0000","last_became_peered":"2024-05-08T04:21:10.799422+0000","last_unstale":"2024-05-08T04:21:12.683765+0000","last_undegraded":"2024-05-08T04:21:12.683765+0000","last_fullsized":"2024-05-08T04:21:12.683765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:35:00.954562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997612+0000","last_change":"2024-05-08T04:21:09.798256+0000","last_active":"2024-05-08T04:21:11.997612+0000","last_peered":"2024-05-08T04:21:11.997612+0000","last_clean":"2024-05-08T04:21:11.997612+0000","last_became_active":"2024-05-08T04:21:09.796157+0000","last_became_peered":"2024-05-08T04:21:09.796157+0000","last_unstale":"2024-05-08T04:21:11.997612+0000","last_undegraded":"2024-05-08T04:21:11.997612+0000","last_fullsized":"2024-05-08T04:21:11.997612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:10.460883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684326+0000","last_change":"2024-05-08T04:21:10.808794+0000","last_active":"2024-05-08T04:21:12.684326+0000","last_peered":"2024-05-08T04:21:12.684326+0000","last_clean":"2024-05-08T04:21:12.684326+0000","last_became_active":"2024-05-08T04:21:10.808339+0000","last_became_peered":"2024-05-08T04:21:10.808339+0000","last_unstale":"2024-05-08T04:21:12.684326+0000","last_undegraded":"2024-05-08T04:21:12.684326+0000","last_fullsized":"2024-05-08T04:21:12.684326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:00.315803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.807697+0000","last_change":"2024-05-08T04:21:09.806917+0000","last_active":"2024-05-08T04:21:11.807697+0000","last_peered":"2024-05-08T04:21:11.807697+0000","last_clean":"2024-05-08T04:21:11.807697+0000","last_became_active":"2024-05-08T04:21:09.806599+0000","last_became_peered":"2024-05-08T04:21:09.806599+0000","last_unstale":"2024-05-08T04:21:11.807697+0000","last_undegraded":"2024-05-08T04:21:11.807697+0000","last_fullsized":"2024-05-08T04:21:11.807697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804308+0000","last_change":"2024-05-08T04:21:10.809200+0000","last_active":"2024-05-08T04:21:11.804308+0000","last_peered":"2024-05-08T04:21:11.804308+0000","last_clean":"2024-05-08T04:21:11.804308+0000","last_became_active":"2024-05-08T04:21:10.808575+0000","last_became_peered":"2024-05-08T04:21:10.808575+0000","last_unstale":"2024-05-08T04:21:11.804308+0000","last_undegraded":"2024-05-08T04:21:11.804308+0000","last_fullsized":"2024-05-08T04:21:11.804308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997710+0000","last_change":"2024-05-08T04:21:09.807154+0000","last_active":"2024-05-08T04:21:11.997710+0000","last_peered":"2024-05-08T04:21:11.997710+0000","last_clean":"2024-05-08T04:21:11.997710+0000","last_became_active":"2024-05-08T04:21:09.806884+0000","last_became_peered":"2024-05-08T04:21:09.806884+0000","last_unstale":"2024-05-08T04:21:11.997710+0000","last_undegraded":"2024-05-08T04:21:11.997710+0000","last_fullsized":"2024-05-08T04:21:11.997710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:00.101724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804179+0000","last_change":"2024-05-08T04:21:10.805880+0000","last_active":"2024-05-08T04:21:11.804179+0000","last_peered":"2024-05-08T04:21:11.804179+0000","last_clean":"2024-05-08T04:21:11.804179+0000","last_became_active":"2024-05-08T04:21:10.805610+0000","last_became_peered":"2024-05-08T04:21:10.805610+0000","last_unstale":"2024-05-08T04:21:11.804179+0000","last_undegraded":"2024-05-08T04:21:11.804179+0000","last_fullsized":"2024-05-08T04:21:11.804179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806080+0000","last_change":"2024-05-08T04:21:09.805802+0000","last_active":"2024-05-08T04:21:11.806080+0000","last_peered":"2024-05-08T04:21:11.806080+0000","last_clean":"2024-05-08T04:21:11.806080+0000","last_became_active":"2024-05-08T04:21:09.805532+0000","last_became_peered":"2024-05-08T04:21:09.805532+0000","last_unstale":"2024-05-08T04:21:11.806080+0000","last_undegraded":"2024-05-08T04:21:11.806080+0000","last_fullsized":"2024-05-08T04:21:11.806080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997242+0000","last_change":"2024-05-08T04:21:10.810731+0000","last_active":"2024-05-08T04:21:11.997242+0000","last_peered":"2024-05-08T04:21:11.997242+0000","last_clean":"2024-05-08T04:21:11.997242+0000","last_became_active":"2024-05-08T04:21:10.810473+0000","last_became_peered":"2024-05-08T04:21:10.810473+0000","last_unstale":"2024-05-08T04:21:11.997242+0000","last_undegraded":"2024-05-08T04:21:11.997242+0000","last_fullsized":"2024-05-08T04:21:11.997242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:22.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803834+0000","last_change":"2024-05-08T04:21:09.808749+0000","last_active":"2024-05-08T04:21:11.803834+0000","last_peered":"2024-05-08T04:21:11.803834+0000","last_clean":"2024-05-08T04:21:11.803834+0000","last_became_active":"2024-05-08T04:21:09.808522+0000","last_became_peered":"2024-05-08T04:21:09.808522+0000","last_unstale":"2024-05-08T04:21:11.803834+0000","last_undegraded":"2024-05-08T04:21:11.803834+0000","last_fullsized":"2024-05-08T04:21:11.803834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803729+0000","last_change":"2024-05-08T04:21:10.803674+0000","last_active":"2024-05-08T04:21:11.803729+0000","last_peered":"2024-05-08T04:21:11.803729+0000","last_clean":"2024-05-08T04:21:11.803729+0000","last_became_active":"2024-05-08T04:21:10.802802+0000","last_became_peered":"2024-05-08T04:21:10.802802+0000","last_unstale":"2024-05-08T04:21:11.803729+0000","last_undegraded":"2024-05-08T04:21:11.803729+0000","last_fullsized":"2024-05-08T04:21:11.803729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:18:33.343054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684231+0000","last_change":"2024-05-08T04:21:09.801923+0000","last_active":"2024-05-08T04:21:12.684231+0000","last_peered":"2024-05-08T04:21:12.684231+0000","last_clean":"2024-05-08T04:21:12.684231+0000","last_became_active":"2024-05-08T04:21:09.801620+0000","last_became_peered":"2024-05-08T04:21:09.801620+0000","last_unstale":"2024-05-08T04:21:12.684231+0000","last_undegraded":"2024-05-08T04:21:12.684231+0000","last_fullsized":"2024-05-08T04:21:12.684231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683884+0000","last_change":"2024-05-08T04:21:10.806239+0000","last_active":"2024-05-08T04:21:12.683884+0000","last_peered":"2024-05-08T04:21:12.683884+0000","last_clean":"2024-05-08T04:21:12.683884+0000","last_became_active":"2024-05-08T04:21:10.805961+0000","last_became_peered":"2024-05-08T04:21:10.805961+0000","last_unstale":"2024-05-08T04:21:12.683884+0000","last_undegraded":"2024-05-08T04:21:12.683884+0000","last_fullsized":"2024-05-08T04:21:12.683884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:53.770709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997335+0000","last_change":"2024-05-08T04:21:09.805477+0000","last_active":"2024-05-08T04:21:11.997335+0000","last_peered":"2024-05-08T04:21:11.997335+0000","last_clean":"2024-05-08T04:21:11.997335+0000","last_became_active":"2024-05-08T04:21:09.805232+0000","last_became_peered":"2024-05-08T04:21:09.805232+0000","last_unstale":"2024-05-08T04:21:11.997335+0000","last_undegraded":"2024-05-08T04:21:11.997335+0000","last_fullsized":"2024-05-08T04:21:11.997335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:33.031084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997271+0000","last_change":"2024-05-08T04:21:10.812788+0000","last_active":"2024-05-08T04:21:11.997271+0000","last_peered":"2024-05-08T04:21:11.997271+0000","last_clean":"2024-05-08T04:21:11.997271+0000","last_became_active":"2024-05-08T04:21:10.812267+0000","last_became_peered":"2024-05-08T04:21:10.812267+0000","last_unstale":"2024-05-08T04:21:11.997271+0000","last_undegraded":"2024-05-08T04:21:11.997271+0000","last_fullsized":"2024-05-08T04:21:11.997271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:56:40.748736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997431+0000","last_change":"2024-05-08T04:21:10.814337+0000","last_active":"2024-05-08T04:21:11.997431+0000","last_peered":"2024-05-08T04:21:11.997431+0000","last_clean":"2024-05-08T04:21:11.997431+0000","last_became_active":"2024-05-08T04:21:10.814087+0000","last_became_peered":"2024-05-08T04:21:10.814087+0000","last_unstale":"2024-05-08T04:21:11.997431+0000","last_undegraded":"2024-05-08T04:21:11.997431+0000","last_fullsized":"2024-05-08T04:21:11.997431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:31.354097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806735+0000","last_change":"2024-05-08T04:21:09.808915+0000","last_active":"2024-05-08T04:21:11.806735+0000","last_peered":"2024-05-08T04:21:11.806735+0000","last_clean":"2024-05-08T04:21:11.806735+0000","last_became_active":"2024-05-08T04:21:09.808528+0000","last_became_peered":"2024-05-08T04:21:09.808528+0000","last_unstale":"2024-05-08T04:21:11.806735+0000","last_undegraded":"2024-05-08T04:21:11.806735+0000","last_fullsized":"2024-05-08T04:21:11.806735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:10.460883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797564+0000","last_change":"2024-05-08T04:21:10.814868+0000","last_active":"2024-05-08T04:21:11.797564+0000","last_peered":"2024-05-08T04:21:11.797564+0000","last_clean":"2024-05-08T04:21:11.797564+0000","last_became_active":"2024-05-08T04:21:10.814012+0000","last_became_peered":"2024-05-08T04:21:10.814012+0000","last_unstale":"2024-05-08T04:21:11.797564+0000","last_undegraded":"2024-05-08T04:21:11.797564+0000","last_fullsized":"2024-05-08T04:21:11.797564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:02.505469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806577+0000","last_change":"2024-05-08T04:21:09.806371+0000","last_active":"2024-05-08T04:21:11.806577+0000","last_peered":"2024-05-08T04:21:11.806577+0000","last_clean":"2024-05-08T04:21:11.806577+0000","last_became_active":"2024-05-08T04:21:09.806120+0000","last_became_peered":"2024-05-08T04:21:09.806120+0000","last_unstale":"2024-05-08T04:21:11.806577+0000","last_undegraded":"2024-05-08T04:21:11.806577+0000","last_fullsized":"2024-05-08T04:21:11.806577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799202+0000","last_change":"2024-05-08T04:21:10.799276+0000","last_active":"2024-05-08T04:21:11.799202+0000","last_peered":"2024-05-08T04:21:11.799202+0000","last_clean":"2024-05-08T04:21:11.799202+0000","last_became_active":"2024-05-08T04:21:10.798986+0000","last_became_peered":"2024-05-08T04:21:10.798986+0000","last_unstale":"2024-05-08T04:21:11.799202+0000","last_undegraded":"2024-05-08T04:21:11.799202+0000","last_fullsized":"2024-05-08T04:21:11.799202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:39.936653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799414+0000","last_change":"2024-05-08T04:21:09.795113+0000","last_active":"2024-05-08T04:21:11.799414+0000","last_peered":"2024-05-08T04:21:11.799414+0000","last_clean":"2024-05-08T04:21:11.799414+0000","last_became_active":"2024-05-08T04:21:09.794565+0000","last_became_peered":"2024-05-08T04:21:09.794565+0000","last_unstale":"2024-05-08T04:21:11.799414+0000","last_undegraded":"2024-05-08T04:21:11.799414+0000","last_fullsized":"2024-05-08T04:21:11.799414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799323+0000","last_change":"2024-05-08T04:21:10.794958+0000","last_active":"2024-05-08T04:21:11.799323+0000","last_peered":"2024-05-08T04:21:11.799323+0000","last_clean":"2024-05-08T04:21:11.799323+0000","last_became_active":"2024-05-08T04:21:10.794649+0000","last_became_peered":"2024-05-08T04:21:10.794649+0000","last_unstale":"2024-05-08T04:21:11.799323+0000","last_undegraded":"2024-05-08T04:21:11.799323+0000","last_fullsized":"2024-05-08T04:21:11.799323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:36.487747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804255+0000","last_change":"2024-05-08T04:21:09.802589+0000","last_active":"2024-05-08T04:21:11.804255+0000","last_peered":"2024-05-08T04:21:11.804255+0000","last_clean":"2024-05-08T04:21:11.804255+0000","last_became_active":"2024-05-08T04:21:09.802292+0000","last_became_peered":"2024-05-08T04:21:09.802292+0000","last_unstale":"2024-05-08T04:21:11.804255+0000","last_undegraded":"2024-05-08T04:21:11.804255+0000","last_fullsized":"2024-05-08T04:21:11.804255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":661394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":73218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":70990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:21:21.267 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:21:21.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.401+0000 7f173c9e0640 1 Processor -- start 2024-05-08T04:21:21.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.402+0000 7f173c9e0640 1 -- start start 2024-05-08T04:21:21.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.402+0000 7f173c9e0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f173815de10 0x7f1738161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.402+0000 7f173c9e0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380ce5a0 0x7f17380d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.402+0000 7f173c9e0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17380d3210 con 0x7f17380d05f0 2024-05-08T04:21:21.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.402+0000 7f173c9e0640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17380d0f50 con 0x7f173815de10 2024-05-08T04:21:21.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.402+0000 7f173c9e0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1738161e60 con 0x7f17380ce5a0 2024-05-08T04:21:21.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.403+0000 7f173659c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f173815de10 0x7f1738161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.403+0000 7f173659c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f173815de10 0x7f1738161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34042/0 (socket says 172.21.15.104:34042) 2024-05-08T04:21:21.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.403+0000 7f173659c640 1 -- 172.21.15.104:0/3141566057 learned_addr learned my addr 172.21.15.104:0/3141566057 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:21.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.403+0000 7f1735d9b640 1 --2- 172.21.15.104:0/3141566057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380ce5a0 0x7f17380d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.403+0000 7f173659c640 1 -- 172.21.15.104:0/3141566057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380ce5a0 msgr2=0x7f17380d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:21.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.403+0000 7f173659c640 1 --2- 172.21.15.104:0/3141566057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380ce5a0 0x7f17380d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.403+0000 7f173659c640 1 -- 172.21.15.104:0/3141566057 >> v1:172.21.15.183:6789/0 conn(0x7f17380d05f0 legacy=0x7f17380b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.403+0000 7f173659c640 1 -- 172.21.15.104:0/3141566057 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173815e1f0 con 0x7f173815de10 2024-05-08T04:21:21.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.404+0000 7f173659c640 1 --2- 172.21.15.104:0/3141566057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f173815de10 0x7f1738161920 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1730009e50 tx=0x7f173002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1669a7810b41c6ee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:21.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.404+0000 7f173559a640 1 -- 172.21.15.104:0/3141566057 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730036070 con 0x7f173815de10 2024-05-08T04:21:21.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.404+0000 7f173559a640 1 -- 172.21.15.104:0/3141566057 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1730031600 con 0x7f173815de10 2024-05-08T04:21:21.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.404+0000 7f173559a640 1 -- 172.21.15.104:0/3141566057 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17300319d0 con 0x7f173815de10 2024-05-08T04:21:21.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.404+0000 7f173c9e0640 1 -- 172.21.15.104:0/3141566057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f173815de10 msgr2=0x7f1738161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.404+0000 7f173c9e0640 1 --2- 172.21.15.104:0/3141566057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f173815de10 0x7f1738161920 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1730009e50 tx=0x7f173002a680 comp rx=0 tx=0).stop 2024-05-08T04:21:21.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.404+0000 7f173c9e0640 1 -- 172.21.15.104:0/3141566057 shutdown_connections 2024-05-08T04:21:21.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.404+0000 7f173c9e0640 1 --2- 172.21.15.104:0/3141566057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17380ce5a0 0x7f17380d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.404+0000 7f173c9e0640 1 --2- 172.21.15.104:0/3141566057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f173815de10 0x7f1738161920 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.404+0000 7f173c9e0640 1 -- 172.21.15.104:0/3141566057 >> 172.21.15.104:0/3141566057 conn(0x7f1738072290 msgr2=0x7f1738072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:21.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.404+0000 7f173c9e0640 1 -- 172.21.15.104:0/3141566057 shutdown_connections 2024-05-08T04:21:21.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.404+0000 7f173c9e0640 1 -- 172.21.15.104:0/3141566057 wait complete. 2024-05-08T04:21:21.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.406+0000 7f173c9e0640 1 Processor -- start 2024-05-08T04:21:21.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.406+0000 7f173c9e0640 1 -- start start 2024-05-08T04:21:21.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.406+0000 7f173c9e0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17380ce5a0 0x7f1738157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.406+0000 7f173c9e0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17380d05f0 0x7f17380c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.406+0000 7f173c9e0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f173815de10 0x7f17380c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.406+0000 7f173c9e0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1738162090 con 0x7f17380ce5a0 2024-05-08T04:21:21.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.406+0000 7f173c9e0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17380d1a90 con 0x7f17380d05f0 2024-05-08T04:21:21.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.406+0000 7f173c9e0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1738162370 con 0x7f173815de10 2024-05-08T04:21:21.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f173659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17380ce5a0 0x7f1738157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f173659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17380ce5a0 0x7f1738157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34050/0 (socket says 172.21.15.104:34050) 2024-05-08T04:21:21.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f173659c640 1 -- 172.21.15.104:0/2400866555 learned_addr learned my addr 172.21.15.104:0/2400866555 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:21.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f1735d9b640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17380d05f0 0x7f17380c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f1736d9d640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f173815de10 0x7f17380c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f173659c640 1 -- 172.21.15.104:0/2400866555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f173815de10 msgr2=0x7f17380c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f173659c640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f173815de10 0x7f17380c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f173659c640 1 -- 172.21.15.104:0/2400866555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17380d05f0 msgr2=0x7f17380c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f173659c640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17380d05f0 0x7f17380c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f173659c640 1 -- 172.21.15.104:0/2400866555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17381f4d30 con 0x7f17380ce5a0 2024-05-08T04:21:21.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f1736d9d640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f173815de10 0x7f17380c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:21.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f173659c640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17380ce5a0 0x7f1738157150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1730034040 tx=0x7f1730004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:21.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f172effd640 1 -- 172.21.15.104:0/2400866555 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173003f020 con 0x7f17380ce5a0 2024-05-08T04:21:21.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f172effd640 1 -- 172.21.15.104:0/2400866555 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1730037040 con 0x7f17380ce5a0 2024-05-08T04:21:21.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f173c9e0640 1 -- 172.21.15.104:0/2400866555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17381f4fa0 con 0x7f17380ce5a0 2024-05-08T04:21:21.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f172effd640 1 -- 172.21.15.104:0/2400866555 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730036070 con 0x7f17380ce5a0 2024-05-08T04:21:21.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.407+0000 7f173c9e0640 1 -- 172.21.15.104:0/2400866555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17380b4da0 con 0x7f17380ce5a0 2024-05-08T04:21:21.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.408+0000 7f173c9e0640 1 -- 172.21.15.104:0/2400866555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1738075010 con 0x7f17380ce5a0 2024-05-08T04:21:21.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.409+0000 7f172effd640 1 -- 172.21.15.104:0/2400866555 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1730042020 con 0x7f17380ce5a0 2024-05-08T04:21:21.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.409+0000 7f172effd640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f171806b4d0 0x7f171806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.409+0000 7f172effd640 1 -- 172.21.15.104:0/2400866555 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17300aa620 con 0x7f17380ce5a0 2024-05-08T04:21:21.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.409+0000 7f1735d9b640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f171806b4d0 0x7f171806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.409+0000 7f1735d9b640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f171806b4d0 0x7f171806d990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f17380b5130 tx=0x7f1720008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:21.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.413+0000 7f172effd640 1 -- 172.21.15.104:0/2400866555 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1730049030 con 0x7f17380ce5a0 2024-05-08T04:21:21.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.581+0000 7f173c9e0640 1 -- 172.21.15.104:0/2400866555 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17381f57a0 con 0x7f171806b4d0 2024-05-08T04:21:21.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.587+0000 7f172effd640 1 -- 172.21.15.104:0/2400866555 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251832 (secure 0 0 0) 0x7f17381f57a0 con 0x7f171806b4d0 2024-05-08T04:21:21.591 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:21.592 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:21:21.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.590+0000 7f173c9e0640 1 -- 172.21.15.104:0/2400866555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f171806b4d0 msgr2=0x7f171806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.590+0000 7f173c9e0640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f171806b4d0 0x7f171806d990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f17380b5130 tx=0x7f1720008040 comp rx=0 tx=0).stop 2024-05-08T04:21:21.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.590+0000 7f173c9e0640 1 -- 172.21.15.104:0/2400866555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17380ce5a0 msgr2=0x7f1738157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.590+0000 7f173c9e0640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17380ce5a0 0x7f1738157150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1730034040 tx=0x7f1730004a40 comp rx=0 tx=0).stop 2024-05-08T04:21:21.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.590+0000 7f173c9e0640 1 -- 172.21.15.104:0/2400866555 shutdown_connections 2024-05-08T04:21:21.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.590+0000 7f173c9e0640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f171806b4d0 0x7f171806d990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.590+0000 7f173c9e0640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17380d05f0 0x7f17380c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.590+0000 7f173c9e0640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f173815de10 0x7f17380c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.590+0000 7f173c9e0640 1 --2- 172.21.15.104:0/2400866555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17380ce5a0 0x7f1738157150 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.590+0000 7f173c9e0640 1 -- 172.21.15.104:0/2400866555 >> 172.21.15.104:0/2400866555 conn(0x7f1738072290 msgr2=0x7f17380d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:21.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.590+0000 7f173c9e0640 1 -- 172.21.15.104:0/2400866555 shutdown_connections 2024-05-08T04:21:21.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.590+0000 7f173c9e0640 1 -- 172.21.15.104:0/2400866555 wait complete. 2024-05-08T04:21:21.602 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-08T04:21:20.639518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.851168"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806700+0000","last_change":"2024-05-08T04:21:10.815759+0000","last_active":"2024-05-08T04:21:11.806700+0000","last_peered":"2024-05-08T04:21:11.806700+0000","last_clean":"2024-05-08T04:21:11.806700+0000","last_became_active":"2024-05-08T04:21:10.815430+0000","last_became_peered":"2024-05-08T04:21:10.815430+0000","last_unstale":"2024-05-08T04:21:11.806700+0000","last_undegraded":"2024-05-08T04:21:11.806700+0000","last_fullsized":"2024-05-08T04:21:11.806700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:09:39.015637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799301+0000","last_change":"2024-05-08T04:21:10.799995+0000","last_active":"2024-05-08T04:21:11.799301+0000","last_peered":"2024-05-08T04:21:11.799301+0000","last_clean":"2024-05-08T04:21:11.799301+0000","last_became_active":"2024-05-08T04:21:10.799655+0000","last_became_peered":"2024-05-08T04:21:10.799655+0000","last_unstale":"2024-05-08T04:21:11.799301+0000","last_undegraded":"2024-05-08T04:21:11.799301+0000","last_fullsized":"2024-05-08T04:21:11.799301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:22.135893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798824+0000","last_change":"2024-05-08T04:21:10.807212+0000","last_active":"2024-05-08T04:21:11.798824+0000","last_peered":"2024-05-08T04:21:11.798824+0000","last_clean":"2024-05-08T04:21:11.798824+0000","last_became_active":"2024-05-08T04:21:10.806880+0000","last_became_peered":"2024-05-08T04:21:10.806880+0000","last_unstale":"2024-05-08T04:21:11.798824+0000","last_undegraded":"2024-05-08T04:21:11.798824+0000","last_fullsized":"2024-05-08T04:21:11.798824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683814+0000","last_change":"2024-05-08T04:21:10.809736+0000","last_active":"2024-05-08T04:21:12.683814+0000","last_peered":"2024-05-08T04:21:12.683814+0000","last_clean":"2024-05-08T04:21:12.683814+0000","last_became_active":"2024-05-08T04:21:10.808825+0000","last_became_peered":"2024-05-08T04:21:10.808825+0000","last_unstale":"2024-05-08T04:21:12.683814+0000","last_undegraded":"2024-05-08T04:21:12.683814+0000","last_fullsized":"2024-05-08T04:21:12.683814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:00.517242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806396+0000","last_change":"2024-05-08T04:21:10.807971+0000","last_active":"2024-05-08T04:21:11.806396+0000","last_peered":"2024-05-08T04:21:11.806396+0000","last_clean":"2024-05-08T04:21:11.806396+0000","last_became_active":"2024-05-08T04:21:10.807525+0000","last_became_peered":"2024-05-08T04:21:10.807525+0000","last_unstale":"2024-05-08T04:21:11.806396+0000","last_undegraded":"2024-05-08T04:21:11.806396+0000","last_fullsized":"2024-05-08T04:21:11.806396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:33.787458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683680+0000","last_change":"2024-05-08T04:21:10.808827+0000","last_active":"2024-05-08T04:21:12.683680+0000","last_peered":"2024-05-08T04:21:12.683680+0000","last_clean":"2024-05-08T04:21:12.683680+0000","last_became_active":"2024-05-08T04:21:10.808388+0000","last_became_peered":"2024-05-08T04:21:10.808388+0000","last_unstale":"2024-05-08T04:21:12.683680+0000","last_undegraded":"2024-05-08T04:21:12.683680+0000","last_fullsized":"2024-05-08T04:21:12.683680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:11.466963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806249+0000","last_change":"2024-05-08T04:21:10.806944+0000","last_active":"2024-05-08T04:21:11.806249+0000","last_peered":"2024-05-08T04:21:11.806249+0000","last_clean":"2024-05-08T04:21:11.806249+0000","last_became_active":"2024-05-08T04:21:10.806257+0000","last_became_peered":"2024-05-08T04:21:10.806257+0000","last_unstale":"2024-05-08T04:21:11.806249+0000","last_undegraded":"2024-05-08T04:21:11.806249+0000","last_fullsized":"2024-05-08T04:21:11.806249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798784+0000","last_change":"2024-05-08T04:21:10.808012+0000","last_active":"2024-05-08T04:21:11.798784+0000","last_peered":"2024-05-08T04:21:11.798784+0000","last_clean":"2024-05-08T04:21:11.798784+0000","last_became_active":"2024-05-08T04:21:10.807762+0000","last_became_peered":"2024-05-08T04:21:10.807762+0000","last_unstale":"2024-05-08T04:21:11.798784+0000","last_undegraded":"2024-05-08T04:21:11.798784+0000","last_fullsized":"2024-05-08T04:21:11.798784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797594+0000","last_change":"2024-05-08T04:21:10.813184+0000","last_active":"2024-05-08T04:21:11.797594+0000","last_peered":"2024-05-08T04:21:11.797594+0000","last_clean":"2024-05-08T04:21:11.797594+0000","last_became_active":"2024-05-08T04:21:10.812887+0000","last_became_peered":"2024-05-08T04:21:10.812887+0000","last_unstale":"2024-05-08T04:21:11.797594+0000","last_undegraded":"2024-05-08T04:21:11.797594+0000","last_fullsized":"2024-05-08T04:21:11.797594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:34.037163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806602+0000","last_change":"2024-05-08T04:21:10.808669+0000","last_active":"2024-05-08T04:21:11.806602+0000","last_peered":"2024-05-08T04:21:11.806602+0000","last_clean":"2024-05-08T04:21:11.806602+0000","last_became_active":"2024-05-08T04:21:10.807623+0000","last_became_peered":"2024-05-08T04:21:10.807623+0000","last_unstale":"2024-05-08T04:21:11.806602+0000","last_undegraded":"2024-05-08T04:21:11.806602+0000","last_fullsized":"2024-05-08T04:21:11.806602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:36.487747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806477+0000","last_change":"2024-05-08T04:21:10.815746+0000","last_active":"2024-05-08T04:21:11.806477+0000","last_peered":"2024-05-08T04:21:11.806477+0000","last_clean":"2024-05-08T04:21:11.806477+0000","last_became_active":"2024-05-08T04:21:10.815484+0000","last_became_peered":"2024-05-08T04:21:10.815484+0000","last_unstale":"2024-05-08T04:21:11.806477+0000","last_undegraded":"2024-05-08T04:21:11.806477+0000","last_fullsized":"2024-05-08T04:21:11.806477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:14.742480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806591+0000","last_change":"2024-05-08T04:21:10.809694+0000","last_active":"2024-05-08T04:21:11.806591+0000","last_peered":"2024-05-08T04:21:11.806591+0000","last_clean":"2024-05-08T04:21:11.806591+0000","last_became_active":"2024-05-08T04:21:10.809335+0000","last_became_peered":"2024-05-08T04:21:10.809335+0000","last_unstale":"2024-05-08T04:21:11.806591+0000","last_undegraded":"2024-05-08T04:21:11.806591+0000","last_fullsized":"2024-05-08T04:21:11.806591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:15:22.135893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684183+0000","last_change":"2024-05-08T04:21:10.810243+0000","last_active":"2024-05-08T04:21:12.684183+0000","last_peered":"2024-05-08T04:21:12.684183+0000","last_clean":"2024-05-08T04:21:12.684183+0000","last_became_active":"2024-05-08T04:21:10.809954+0000","last_became_peered":"2024-05-08T04:21:10.809954+0000","last_unstale":"2024-05-08T04:21:12.684183+0000","last_undegraded":"2024-05-08T04:21:12.684183+0000","last_fullsized":"2024-05-08T04:21:12.684183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:18:33.343054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684014+0000","last_change":"2024-05-08T04:21:10.803036+0000","last_active":"2024-05-08T04:21:12.684014+0000","last_peered":"2024-05-08T04:21:12.684014+0000","last_clean":"2024-05-08T04:21:12.684014+0000","last_became_active":"2024-05-08T04:21:10.801931+0000","last_became_peered":"2024-05-08T04:21:10.801931+0000","last_unstale":"2024-05-08T04:21:12.684014+0000","last_undegraded":"2024-05-08T04:21:12.684014+0000","last_fullsized":"2024-05-08T04:21:12.684014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:53.558867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798885+0000","last_change":"2024-05-08T04:21:10.810578+0000","last_active":"2024-05-08T04:21:11.798885+0000","last_peered":"2024-05-08T04:21:11.798885+0000","last_clean":"2024-05-08T04:21:11.798885+0000","last_became_active":"2024-05-08T04:21:10.809929+0000","last_became_peered":"2024-05-08T04:21:10.809929+0000","last_unstale":"2024-05-08T04:21:11.798885+0000","last_undegraded":"2024-05-08T04:21:11.798885+0000","last_fullsized":"2024-05-08T04:21:11.798885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997095+0000","last_change":"2024-05-08T04:21:10.809708+0000","last_active":"2024-05-08T04:21:11.997095+0000","last_peered":"2024-05-08T04:21:11.997095+0000","last_clean":"2024-05-08T04:21:11.997095+0000","last_became_active":"2024-05-08T04:21:10.809239+0000","last_became_peered":"2024-05-08T04:21:10.809239+0000","last_unstale":"2024-05-08T04:21:11.997095+0000","last_undegraded":"2024-05-08T04:21:11.997095+0000","last_fullsized":"2024-05-08T04:21:11.997095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:09:39.015637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997748+0000","last_change":"2024-05-08T04:21:10.813941+0000","last_active":"2024-05-08T04:21:11.997748+0000","last_peered":"2024-05-08T04:21:11.997748+0000","last_clean":"2024-05-08T04:21:11.997748+0000","last_became_active":"2024-05-08T04:21:10.813628+0000","last_became_peered":"2024-05-08T04:21:10.813628+0000","last_unstale":"2024-05-08T04:21:11.997748+0000","last_undegraded":"2024-05-08T04:21:11.997748+0000","last_fullsized":"2024-05-08T04:21:11.997748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:54:22.530212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684324+0000","last_change":"2024-05-08T04:21:10.802243+0000","last_active":"2024-05-08T04:21:12.684324+0000","last_peered":"2024-05-08T04:21:12.684324+0000","last_clean":"2024-05-08T04:21:12.684324+0000","last_became_active":"2024-05-08T04:21:10.801990+0000","last_became_peered":"2024-05-08T04:21:10.801990+0000","last_unstale":"2024-05-08T04:21:12.684324+0000","last_undegraded":"2024-05-08T04:21:12.684324+0000","last_fullsized":"2024-05-08T04:21:12.684324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:11.466963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997557+0000","last_change":"2024-05-08T04:21:10.809257+0000","last_active":"2024-05-08T04:21:11.997557+0000","last_peered":"2024-05-08T04:21:11.997557+0000","last_clean":"2024-05-08T04:21:11.997557+0000","last_became_active":"2024-05-08T04:21:10.808961+0000","last_became_peered":"2024-05-08T04:21:10.808961+0000","last_unstale":"2024-05-08T04:21:11.997557+0000","last_undegraded":"2024-05-08T04:21:11.997557+0000","last_fullsized":"2024-05-08T04:21:11.997557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:47:28.393115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806508+0000","last_change":"2024-05-08T04:21:10.808294+0000","last_active":"2024-05-08T04:21:11.806508+0000","last_peered":"2024-05-08T04:21:11.806508+0000","last_clean":"2024-05-08T04:21:11.806508+0000","last_became_active":"2024-05-08T04:21:10.808032+0000","last_became_peered":"2024-05-08T04:21:10.808032+0000","last_unstale":"2024-05-08T04:21:11.806508+0000","last_undegraded":"2024-05-08T04:21:11.806508+0000","last_fullsized":"2024-05-08T04:21:11.806508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:33.067388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803850+0000","last_change":"2024-05-08T04:21:10.806239+0000","last_active":"2024-05-08T04:21:11.803850+0000","last_peered":"2024-05-08T04:21:11.803850+0000","last_clean":"2024-05-08T04:21:11.803850+0000","last_became_active":"2024-05-08T04:21:10.805369+0000","last_became_peered":"2024-05-08T04:21:10.805369+0000","last_unstale":"2024-05-08T04:21:11.803850+0000","last_undegraded":"2024-05-08T04:21:11.803850+0000","last_fullsized":"2024-05-08T04:21:11.803850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:55:41.627503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797390+0000","last_change":"2024-05-08T04:21:10.813103+0000","last_active":"2024-05-08T04:21:11.797390+0000","last_peered":"2024-05-08T04:21:11.797390+0000","last_clean":"2024-05-08T04:21:11.797390+0000","last_became_active":"2024-05-08T04:21:10.812833+0000","last_became_peered":"2024-05-08T04:21:10.812833+0000","last_unstale":"2024-05-08T04:21:11.797390+0000","last_undegraded":"2024-05-08T04:21:11.797390+0000","last_fullsized":"2024-05-08T04:21:11.797390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:35:00.954562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798758+0000","last_change":"2024-05-08T04:21:10.794976+0000","last_active":"2024-05-08T04:21:11.798758+0000","last_peered":"2024-05-08T04:21:11.798758+0000","last_clean":"2024-05-08T04:21:11.798758+0000","last_became_active":"2024-05-08T04:21:10.794594+0000","last_became_peered":"2024-05-08T04:21:10.794594+0000","last_unstale":"2024-05-08T04:21:11.798758+0000","last_undegraded":"2024-05-08T04:21:11.798758+0000","last_fullsized":"2024-05-08T04:21:11.798758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:29.958463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997065+0000","last_change":"2024-05-08T04:21:10.809601+0000","last_active":"2024-05-08T04:21:11.997065+0000","last_peered":"2024-05-08T04:21:11.997065+0000","last_clean":"2024-05-08T04:21:11.997065+0000","last_became_active":"2024-05-08T04:21:10.809257+0000","last_became_peered":"2024-05-08T04:21:10.809257+0000","last_unstale":"2024-05-08T04:21:11.997065+0000","last_undegraded":"2024-05-08T04:21:11.997065+0000","last_fullsized":"2024-05-08T04:21:11.997065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799293+0000","last_change":"2024-05-08T04:21:10.802281+0000","last_active":"2024-05-08T04:21:11.799293+0000","last_peered":"2024-05-08T04:21:11.799293+0000","last_clean":"2024-05-08T04:21:11.799293+0000","last_became_active":"2024-05-08T04:21:10.802003+0000","last_became_peered":"2024-05-08T04:21:10.802003+0000","last_unstale":"2024-05-08T04:21:11.799293+0000","last_undegraded":"2024-05-08T04:21:11.799293+0000","last_fullsized":"2024-05-08T04:21:11.799293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:01.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683844+0000","last_change":"2024-05-08T04:21:10.817545+0000","last_active":"2024-05-08T04:21:12.683844+0000","last_peered":"2024-05-08T04:21:12.683844+0000","last_clean":"2024-05-08T04:21:12.683844+0000","last_became_active":"2024-05-08T04:21:10.817272+0000","last_became_peered":"2024-05-08T04:21:10.817272+0000","last_unstale":"2024-05-08T04:21:12.683844+0000","last_undegraded":"2024-05-08T04:21:12.683844+0000","last_fullsized":"2024-05-08T04:21:12.683844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:02.505469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684138+0000","last_change":"2024-05-08T04:21:10.802074+0000","last_active":"2024-05-08T04:21:12.684138+0000","last_peered":"2024-05-08T04:21:12.684138+0000","last_clean":"2024-05-08T04:21:12.684138+0000","last_became_active":"2024-05-08T04:21:10.801792+0000","last_became_peered":"2024-05-08T04:21:10.801792+0000","last_unstale":"2024-05-08T04:21:12.684138+0000","last_undegraded":"2024-05-08T04:21:12.684138+0000","last_fullsized":"2024-05-08T04:21:12.684138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:01.107803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683976+0000","last_change":"2024-05-08T04:21:10.810222+0000","last_active":"2024-05-08T04:21:12.683976+0000","last_peered":"2024-05-08T04:21:12.683976+0000","last_clean":"2024-05-08T04:21:12.683976+0000","last_became_active":"2024-05-08T04:21:10.809936+0000","last_became_peered":"2024-05-08T04:21:10.809936+0000","last_unstale":"2024-05-08T04:21:12.683976+0000","last_undegraded":"2024-05-08T04:21:12.683976+0000","last_fullsized":"2024-05-08T04:21:12.683976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:34.037163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799109+0000","last_change":"2024-05-08T04:21:10.801209+0000","last_active":"2024-05-08T04:21:11.799109+0000","last_peered":"2024-05-08T04:21:11.799109+0000","last_clean":"2024-05-08T04:21:11.799109+0000","last_became_active":"2024-05-08T04:21:10.800919+0000","last_became_peered":"2024-05-08T04:21:10.800919+0000","last_unstale":"2024-05-08T04:21:11.799109+0000","last_undegraded":"2024-05-08T04:21:11.799109+0000","last_fullsized":"2024-05-08T04:21:11.799109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:14.742480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997234+0000","last_change":"2024-05-08T04:21:10.812578+0000","last_active":"2024-05-08T04:21:11.997234+0000","last_peered":"2024-05-08T04:21:11.997234+0000","last_clean":"2024-05-08T04:21:11.997234+0000","last_became_active":"2024-05-08T04:21:10.811984+0000","last_became_peered":"2024-05-08T04:21:10.811984+0000","last_unstale":"2024-05-08T04:21:11.997234+0000","last_undegraded":"2024-05-08T04:21:11.997234+0000","last_fullsized":"2024-05-08T04:21:11.997234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:18.292078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683815+0000","last_change":"2024-05-08T04:21:10.803704+0000","last_active":"2024-05-08T04:21:12.683815+0000","last_peered":"2024-05-08T04:21:12.683815+0000","last_clean":"2024-05-08T04:21:12.683815+0000","last_became_active":"2024-05-08T04:21:10.803362+0000","last_became_peered":"2024-05-08T04:21:10.803362+0000","last_unstale":"2024-05-08T04:21:12.683815+0000","last_undegraded":"2024-05-08T04:21:12.683815+0000","last_fullsized":"2024-05-08T04:21:12.683815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:54.044618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683628+0000","last_change":"2024-05-08T04:21:10.803508+0000","last_active":"2024-05-08T04:21:12.683628+0000","last_peered":"2024-05-08T04:21:12.683628+0000","last_clean":"2024-05-08T04:21:12.683628+0000","last_became_active":"2024-05-08T04:21:10.803182+0000","last_became_peered":"2024-05-08T04:21:10.803182+0000","last_unstale":"2024-05-08T04:21:12.683628+0000","last_undegraded":"2024-05-08T04:21:12.683628+0000","last_fullsized":"2024-05-08T04:21:12.683628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:53.770709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797469+0000","last_change":"2024-05-08T04:21:10.806394+0000","last_active":"2024-05-08T04:21:11.797469+0000","last_peered":"2024-05-08T04:21:11.797469+0000","last_clean":"2024-05-08T04:21:11.797469+0000","last_became_active":"2024-05-08T04:21:10.806139+0000","last_became_peered":"2024-05-08T04:21:10.806139+0000","last_unstale":"2024-05-08T04:21:11.797469+0000","last_undegraded":"2024-05-08T04:21:11.797469+0000","last_fullsized":"2024-05-08T04:21:11.797469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:29:00.517242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799118+0000","last_change":"2024-05-08T04:21:09.799594+0000","last_active":"2024-05-08T04:21:11.799118+0000","last_peered":"2024-05-08T04:21:11.799118+0000","last_clean":"2024-05-08T04:21:11.799118+0000","last_became_active":"2024-05-08T04:21:09.798501+0000","last_became_peered":"2024-05-08T04:21:09.798501+0000","last_unstale":"2024-05-08T04:21:11.799118+0000","last_undegraded":"2024-05-08T04:21:11.799118+0000","last_fullsized":"2024-05-08T04:21:11.799118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804031+0000","last_change":"2024-05-08T04:21:10.812658+0000","last_active":"2024-05-08T04:21:11.804031+0000","last_peered":"2024-05-08T04:21:11.804031+0000","last_clean":"2024-05-08T04:21:11.804031+0000","last_became_active":"2024-05-08T04:21:10.812321+0000","last_became_peered":"2024-05-08T04:21:10.812321+0000","last_unstale":"2024-05-08T04:21:11.804031+0000","last_undegraded":"2024-05-08T04:21:11.804031+0000","last_fullsized":"2024-05-08T04:21:11.804031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997336+0000","last_change":"2024-05-08T04:21:09.805980+0000","last_active":"2024-05-08T04:21:11.997336+0000","last_peered":"2024-05-08T04:21:11.997336+0000","last_clean":"2024-05-08T04:21:11.997336+0000","last_became_active":"2024-05-08T04:21:09.805512+0000","last_became_peered":"2024-05-08T04:21:09.805512+0000","last_unstale":"2024-05-08T04:21:11.997336+0000","last_undegraded":"2024-05-08T04:21:11.997336+0000","last_fullsized":"2024-05-08T04:21:11.997336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:34:59.948483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683927+0000","last_change":"2024-05-08T04:21:09.807091+0000","last_active":"2024-05-08T04:21:12.683927+0000","last_peered":"2024-05-08T04:21:12.683927+0000","last_clean":"2024-05-08T04:21:12.683927+0000","last_became_active":"2024-05-08T04:21:09.806790+0000","last_became_peered":"2024-05-08T04:21:09.806790+0000","last_unstale":"2024-05-08T04:21:12.683927+0000","last_undegraded":"2024-05-08T04:21:12.683927+0000","last_fullsized":"2024-05-08T04:21:12.683927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799252+0000","last_change":"2024-05-08T04:21:10.806542+0000","last_active":"2024-05-08T04:21:11.799252+0000","last_peered":"2024-05-08T04:21:11.799252+0000","last_clean":"2024-05-08T04:21:11.799252+0000","last_became_active":"2024-05-08T04:21:10.804525+0000","last_became_peered":"2024-05-08T04:21:10.804525+0000","last_unstale":"2024-05-08T04:21:11.799252+0000","last_undegraded":"2024-05-08T04:21:11.799252+0000","last_fullsized":"2024-05-08T04:21:11.799252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:33.067388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997177+0000","last_change":"2024-05-08T04:21:09.803521+0000","last_active":"2024-05-08T04:21:11.997177+0000","last_peered":"2024-05-08T04:21:11.997177+0000","last_clean":"2024-05-08T04:21:11.997177+0000","last_became_active":"2024-05-08T04:21:09.803237+0000","last_became_peered":"2024-05-08T04:21:09.803237+0000","last_unstale":"2024-05-08T04:21:11.997177+0000","last_undegraded":"2024-05-08T04:21:11.997177+0000","last_fullsized":"2024-05-08T04:21:11.997177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803821+0000","last_change":"2024-05-08T04:21:10.804293+0000","last_active":"2024-05-08T04:21:11.803821+0000","last_peered":"2024-05-08T04:21:11.803821+0000","last_clean":"2024-05-08T04:21:11.803821+0000","last_became_active":"2024-05-08T04:21:10.803978+0000","last_became_peered":"2024-05-08T04:21:10.803978+0000","last_unstale":"2024-05-08T04:21:11.803821+0000","last_undegraded":"2024-05-08T04:21:11.803821+0000","last_fullsized":"2024-05-08T04:21:11.803821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:00.315803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797658+0000","last_change":"2024-05-08T04:21:09.802555+0000","last_active":"2024-05-08T04:21:11.797658+0000","last_peered":"2024-05-08T04:21:11.797658+0000","last_clean":"2024-05-08T04:21:11.797658+0000","last_became_active":"2024-05-08T04:21:09.801729+0000","last_became_peered":"2024-05-08T04:21:09.801729+0000","last_unstale":"2024-05-08T04:21:11.797658+0000","last_undegraded":"2024-05-08T04:21:11.797658+0000","last_fullsized":"2024-05-08T04:21:11.797658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683856+0000","last_change":"2024-05-08T04:21:10.817304+0000","last_active":"2024-05-08T04:21:12.683856+0000","last_peered":"2024-05-08T04:21:12.683856+0000","last_clean":"2024-05-08T04:21:12.683856+0000","last_became_active":"2024-05-08T04:21:10.817053+0000","last_became_peered":"2024-05-08T04:21:10.817053+0000","last_unstale":"2024-05-08T04:21:12.683856+0000","last_undegraded":"2024-05-08T04:21:12.683856+0000","last_fullsized":"2024-05-08T04:21:12.683856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:34.037163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806539+0000","last_change":"2024-05-08T04:21:09.808688+0000","last_active":"2024-05-08T04:21:11.806539+0000","last_peered":"2024-05-08T04:21:11.806539+0000","last_clean":"2024-05-08T04:21:11.806539+0000","last_became_active":"2024-05-08T04:21:09.808341+0000","last_became_peered":"2024-05-08T04:21:09.808341+0000","last_unstale":"2024-05-08T04:21:11.806539+0000","last_undegraded":"2024-05-08T04:21:11.806539+0000","last_fullsized":"2024-05-08T04:21:11.806539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:13.078999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799355+0000","last_change":"2024-05-08T04:21:10.812699+0000","last_active":"2024-05-08T04:21:11.799355+0000","last_peered":"2024-05-08T04:21:11.799355+0000","last_clean":"2024-05-08T04:21:11.799355+0000","last_became_active":"2024-05-08T04:21:10.812379+0000","last_became_peered":"2024-05-08T04:21:10.812379+0000","last_unstale":"2024-05-08T04:21:11.799355+0000","last_undegraded":"2024-05-08T04:21:11.799355+0000","last_fullsized":"2024-05-08T04:21:11.799355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684382+0000","last_change":"2024-05-08T04:21:09.796581+0000","last_active":"2024-05-08T04:21:12.684382+0000","last_peered":"2024-05-08T04:21:12.684382+0000","last_clean":"2024-05-08T04:21:12.684382+0000","last_became_active":"2024-05-08T04:21:09.796288+0000","last_became_peered":"2024-05-08T04:21:09.796288+0000","last_unstale":"2024-05-08T04:21:12.684382+0000","last_undegraded":"2024-05-08T04:21:12.684382+0000","last_fullsized":"2024-05-08T04:21:12.684382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997394+0000","last_change":"2024-05-08T04:21:10.809585+0000","last_active":"2024-05-08T04:21:11.997394+0000","last_peered":"2024-05-08T04:21:11.997394+0000","last_clean":"2024-05-08T04:21:11.997394+0000","last_became_active":"2024-05-08T04:21:10.809208+0000","last_became_peered":"2024-05-08T04:21:10.809208+0000","last_unstale":"2024-05-08T04:21:11.997394+0000","last_undegraded":"2024-05-08T04:21:11.997394+0000","last_fullsized":"2024-05-08T04:21:11.997394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:53:26.704579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683714+0000","last_change":"2024-05-08T04:21:09.798917+0000","last_active":"2024-05-08T04:21:12.683714+0000","last_peered":"2024-05-08T04:21:12.683714+0000","last_clean":"2024-05-08T04:21:12.683714+0000","last_became_active":"2024-05-08T04:21:09.798646+0000","last_became_peered":"2024-05-08T04:21:09.798646+0000","last_unstale":"2024-05-08T04:21:12.683714+0000","last_undegraded":"2024-05-08T04:21:12.683714+0000","last_fullsized":"2024-05-08T04:21:12.683714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:25.652092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806500+0000","last_change":"2024-05-08T04:21:10.806707+0000","last_active":"2024-05-08T04:21:11.806500+0000","last_peered":"2024-05-08T04:21:11.806500+0000","last_clean":"2024-05-08T04:21:11.806500+0000","last_became_active":"2024-05-08T04:21:10.806433+0000","last_became_peered":"2024-05-08T04:21:10.806433+0000","last_unstale":"2024-05-08T04:21:11.806500+0000","last_undegraded":"2024-05-08T04:21:11.806500+0000","last_fullsized":"2024-05-08T04:21:11.806500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:39.936653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684111+0000","last_change":"2024-05-08T04:21:09.806965+0000","last_active":"2024-05-08T04:21:12.684111+0000","last_peered":"2024-05-08T04:21:12.684111+0000","last_clean":"2024-05-08T04:21:12.684111+0000","last_became_active":"2024-05-08T04:21:09.806616+0000","last_became_peered":"2024-05-08T04:21:09.806616+0000","last_unstale":"2024-05-08T04:21:12.684111+0000","last_undegraded":"2024-05-08T04:21:12.684111+0000","last_fullsized":"2024-05-08T04:21:12.684111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:09.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684473+0000","last_change":"2024-05-08T04:21:10.814170+0000","last_active":"2024-05-08T04:21:12.684473+0000","last_peered":"2024-05-08T04:21:12.684473+0000","last_clean":"2024-05-08T04:21:12.684473+0000","last_became_active":"2024-05-08T04:21:10.813882+0000","last_became_peered":"2024-05-08T04:21:10.813882+0000","last_unstale":"2024-05-08T04:21:12.684473+0000","last_undegraded":"2024-05-08T04:21:12.684473+0000","last_fullsized":"2024-05-08T04:21:12.684473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:55:41.627503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997406+0000","last_change":"2024-05-08T04:21:09.799377+0000","last_active":"2024-05-08T04:21:11.997406+0000","last_peered":"2024-05-08T04:21:11.997406+0000","last_clean":"2024-05-08T04:21:11.997406+0000","last_became_active":"2024-05-08T04:21:09.799078+0000","last_became_peered":"2024-05-08T04:21:09.799078+0000","last_unstale":"2024-05-08T04:21:11.997406+0000","last_undegraded":"2024-05-08T04:21:11.997406+0000","last_fullsized":"2024-05-08T04:21:11.997406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:28:59.511163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997261+0000","last_change":"2024-05-08T04:21:10.814186+0000","last_active":"2024-05-08T04:21:11.997261+0000","last_peered":"2024-05-08T04:21:11.997261+0000","last_clean":"2024-05-08T04:21:11.997261+0000","last_became_active":"2024-05-08T04:21:10.813837+0000","last_became_peered":"2024-05-08T04:21:10.813837+0000","last_unstale":"2024-05-08T04:21:11.997261+0000","last_undegraded":"2024-05-08T04:21:11.997261+0000","last_fullsized":"2024-05-08T04:21:11.997261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:41:47.087907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806222+0000","last_change":"2024-05-08T04:21:09.809783+0000","last_active":"2024-05-08T04:21:11.806222+0000","last_peered":"2024-05-08T04:21:11.806222+0000","last_clean":"2024-05-08T04:21:11.806222+0000","last_became_active":"2024-05-08T04:21:09.809489+0000","last_became_peered":"2024-05-08T04:21:09.809489+0000","last_unstale":"2024-05-08T04:21:11.806222+0000","last_undegraded":"2024-05-08T04:21:11.806222+0000","last_fullsized":"2024-05-08T04:21:11.806222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797316+0000","last_change":"2024-05-08T04:21:10.802400+0000","last_active":"2024-05-08T04:21:11.797316+0000","last_peered":"2024-05-08T04:21:11.797316+0000","last_clean":"2024-05-08T04:21:11.797316+0000","last_became_active":"2024-05-08T04:21:10.801522+0000","last_became_peered":"2024-05-08T04:21:10.801522+0000","last_unstale":"2024-05-08T04:21:11.797316+0000","last_undegraded":"2024-05-08T04:21:11.797316+0000","last_fullsized":"2024-05-08T04:21:11.797316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:11.466963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803687+0000","last_change":"2024-05-08T04:21:09.795156+0000","last_active":"2024-05-08T04:21:11.803687+0000","last_peered":"2024-05-08T04:21:11.803687+0000","last_clean":"2024-05-08T04:21:11.803687+0000","last_became_active":"2024-05-08T04:21:09.794658+0000","last_became_peered":"2024-05-08T04:21:09.794658+0000","last_unstale":"2024-05-08T04:21:11.803687+0000","last_undegraded":"2024-05-08T04:21:11.803687+0000","last_fullsized":"2024-05-08T04:21:11.803687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997156+0000","last_change":"2024-05-08T04:21:10.810862+0000","last_active":"2024-05-08T04:21:11.997156+0000","last_peered":"2024-05-08T04:21:11.997156+0000","last_clean":"2024-05-08T04:21:11.997156+0000","last_became_active":"2024-05-08T04:21:10.810041+0000","last_became_peered":"2024-05-08T04:21:10.810041+0000","last_unstale":"2024-05-08T04:21:11.997156+0000","last_undegraded":"2024-05-08T04:21:11.997156+0000","last_fullsized":"2024-05-08T04:21:11.997156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:37:37.045065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806759+0000","last_change":"2024-05-08T04:21:09.805736+0000","last_active":"2024-05-08T04:21:11.806759+0000","last_peered":"2024-05-08T04:21:11.806759+0000","last_clean":"2024-05-08T04:21:11.806759+0000","last_became_active":"2024-05-08T04:21:09.805416+0000","last_became_peered":"2024-05-08T04:21:09.805416+0000","last_unstale":"2024-05-08T04:21:11.806759+0000","last_undegraded":"2024-05-08T04:21:11.806759+0000","last_fullsized":"2024-05-08T04:21:11.806759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:52.764630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683920+0000","last_change":"2024-05-08T04:21:10.812910+0000","last_active":"2024-05-08T04:21:12.683920+0000","last_peered":"2024-05-08T04:21:12.683920+0000","last_clean":"2024-05-08T04:21:12.683920+0000","last_became_active":"2024-05-08T04:21:10.812514+0000","last_became_peered":"2024-05-08T04:21:10.812514+0000","last_unstale":"2024-05-08T04:21:12.683920+0000","last_undegraded":"2024-05-08T04:21:12.683920+0000","last_fullsized":"2024-05-08T04:21:12.683920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:53.558867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804208+0000","last_change":"2024-05-08T04:21:09.800590+0000","last_active":"2024-05-08T04:21:11.804208+0000","last_peered":"2024-05-08T04:21:11.804208+0000","last_clean":"2024-05-08T04:21:11.804208+0000","last_became_active":"2024-05-08T04:21:09.800287+0000","last_became_peered":"2024-05-08T04:21:09.800287+0000","last_unstale":"2024-05-08T04:21:11.804208+0000","last_undegraded":"2024-05-08T04:21:11.804208+0000","last_fullsized":"2024-05-08T04:21:11.804208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:13.078999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806581+0000","last_change":"2024-05-08T04:21:10.806772+0000","last_active":"2024-05-08T04:21:11.806581+0000","last_peered":"2024-05-08T04:21:11.806581+0000","last_clean":"2024-05-08T04:21:11.806581+0000","last_became_active":"2024-05-08T04:21:10.806521+0000","last_became_peered":"2024-05-08T04:21:10.806521+0000","last_unstale":"2024-05-08T04:21:11.806581+0000","last_undegraded":"2024-05-08T04:21:11.806581+0000","last_fullsized":"2024-05-08T04:21:11.806581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:01.167023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799154+0000","last_change":"2024-05-08T04:21:09.799358+0000","last_active":"2024-05-08T04:21:11.799154+0000","last_peered":"2024-05-08T04:21:11.799154+0000","last_clean":"2024-05-08T04:21:11.799154+0000","last_became_active":"2024-05-08T04:21:09.799071+0000","last_became_peered":"2024-05-08T04:21:09.799071+0000","last_unstale":"2024-05-08T04:21:11.799154+0000","last_undegraded":"2024-05-08T04:21:11.799154+0000","last_fullsized":"2024-05-08T04:21:11.799154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806649+0000","last_change":"2024-05-08T04:21:10.808148+0000","last_active":"2024-05-08T04:21:11.806649+0000","last_peered":"2024-05-08T04:21:11.806649+0000","last_clean":"2024-05-08T04:21:11.806649+0000","last_became_active":"2024-05-08T04:21:10.807665+0000","last_became_peered":"2024-05-08T04:21:10.807665+0000","last_unstale":"2024-05-08T04:21:11.806649+0000","last_undegraded":"2024-05-08T04:21:11.806649+0000","last_fullsized":"2024-05-08T04:21:11.806649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:44.202186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684338+0000","last_change":"2024-05-08T04:21:09.808562+0000","last_active":"2024-05-08T04:21:12.684338+0000","last_peered":"2024-05-08T04:21:12.684338+0000","last_clean":"2024-05-08T04:21:12.684338+0000","last_became_active":"2024-05-08T04:21:09.808278+0000","last_became_peered":"2024-05-08T04:21:09.808278+0000","last_unstale":"2024-05-08T04:21:12.684338+0000","last_undegraded":"2024-05-08T04:21:12.684338+0000","last_fullsized":"2024-05-08T04:21:12.684338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:09.329646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997548+0000","last_change":"2024-05-08T04:21:10.811650+0000","last_active":"2024-05-08T04:21:11.997548+0000","last_peered":"2024-05-08T04:21:11.997548+0000","last_clean":"2024-05-08T04:21:11.997548+0000","last_became_active":"2024-05-08T04:21:10.811088+0000","last_became_peered":"2024-05-08T04:21:10.811088+0000","last_unstale":"2024-05-08T04:21:11.997548+0000","last_undegraded":"2024-05-08T04:21:11.997548+0000","last_fullsized":"2024-05-08T04:21:11.997548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:11:24.741018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797369+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:21:11.797369+0000","last_peered":"2024-05-08T04:21:11.797369+0000","last_clean":"2024-05-08T04:21:11.797369+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:21:11.797369+0000","last_undegraded":"2024-05-08T04:21:11.797369+0000","last_fullsized":"2024-05-08T04:21:11.797369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997368+0000","last_change":"2024-05-08T04:21:09.805253+0000","last_active":"2024-05-08T04:21:11.997368+0000","last_peered":"2024-05-08T04:21:11.997368+0000","last_clean":"2024-05-08T04:21:11.997368+0000","last_became_active":"2024-05-08T04:21:09.805004+0000","last_became_peered":"2024-05-08T04:21:09.805004+0000","last_unstale":"2024-05-08T04:21:11.997368+0000","last_undegraded":"2024-05-08T04:21:11.997368+0000","last_fullsized":"2024-05-08T04:21:11.997368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:52.552788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803933+0000","last_change":"2024-05-08T04:21:10.806073+0000","last_active":"2024-05-08T04:21:11.803933+0000","last_peered":"2024-05-08T04:21:11.803933+0000","last_clean":"2024-05-08T04:21:11.803933+0000","last_became_active":"2024-05-08T04:21:10.805314+0000","last_became_peered":"2024-05-08T04:21:10.805314+0000","last_unstale":"2024-05-08T04:21:11.803933+0000","last_undegraded":"2024-05-08T04:21:11.803933+0000","last_fullsized":"2024-05-08T04:21:11.803933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:29.958463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997207+0000","last_change":"2024-05-08T04:21:09.800131+0000","last_active":"2024-05-08T04:21:11.997207+0000","last_peered":"2024-05-08T04:21:11.997207+0000","last_clean":"2024-05-08T04:21:11.997207+0000","last_became_active":"2024-05-08T04:21:09.799704+0000","last_became_peered":"2024-05-08T04:21:09.799704+0000","last_unstale":"2024-05-08T04:21:11.997207+0000","last_undegraded":"2024-05-08T04:21:11.997207+0000","last_fullsized":"2024-05-08T04:21:11.997207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:52.764630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683807+0000","last_change":"2024-05-08T04:21:10.802802+0000","last_active":"2024-05-08T04:21:12.683807+0000","last_peered":"2024-05-08T04:21:12.683807+0000","last_clean":"2024-05-08T04:21:12.683807+0000","last_became_active":"2024-05-08T04:21:10.802481+0000","last_became_peered":"2024-05-08T04:21:10.802481+0000","last_unstale":"2024-05-08T04:21:12.683807+0000","last_undegraded":"2024-05-08T04:21:12.683807+0000","last_fullsized":"2024-05-08T04:21:12.683807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:02.505469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683669+0000","last_change":"2024-05-08T04:21:09.797811+0000","last_active":"2024-05-08T04:21:12.683669+0000","last_peered":"2024-05-08T04:21:12.683669+0000","last_clean":"2024-05-08T04:21:12.683669+0000","last_became_active":"2024-05-08T04:21:09.797499+0000","last_became_peered":"2024-05-08T04:21:09.797499+0000","last_unstale":"2024-05-08T04:21:12.683669+0000","last_undegraded":"2024-05-08T04:21:12.683669+0000","last_fullsized":"2024-05-08T04:21:12.683669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798975+0000","last_change":"2024-05-08T04:21:10.801647+0000","last_active":"2024-05-08T04:21:11.798975+0000","last_peered":"2024-05-08T04:21:11.798975+0000","last_clean":"2024-05-08T04:21:11.798975+0000","last_became_active":"2024-05-08T04:21:10.800875+0000","last_became_peered":"2024-05-08T04:21:10.800875+0000","last_unstale":"2024-05-08T04:21:11.798975+0000","last_undegraded":"2024-05-08T04:21:11.798975+0000","last_fullsized":"2024-05-08T04:21:11.798975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:33.787458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997455+0000","last_change":"2024-05-08T04:21:09.804263+0000","last_active":"2024-05-08T04:21:11.997455+0000","last_peered":"2024-05-08T04:21:11.997455+0000","last_clean":"2024-05-08T04:21:11.997455+0000","last_became_active":"2024-05-08T04:21:09.804011+0000","last_became_peered":"2024-05-08T04:21:09.804011+0000","last_unstale":"2024-05-08T04:21:11.997455+0000","last_undegraded":"2024-05-08T04:21:11.997455+0000","last_fullsized":"2024-05-08T04:21:11.997455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:01.499390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806394+0000","last_change":"2024-05-08T04:21:10.809139+0000","last_active":"2024-05-08T04:21:11.806394+0000","last_peered":"2024-05-08T04:21:11.806394+0000","last_clean":"2024-05-08T04:21:11.806394+0000","last_became_active":"2024-05-08T04:21:10.808801+0000","last_became_peered":"2024-05-08T04:21:10.808801+0000","last_unstale":"2024-05-08T04:21:11.806394+0000","last_undegraded":"2024-05-08T04:21:11.806394+0000","last_fullsized":"2024-05-08T04:21:11.806394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.798765+0000","last_change":"2024-05-08T04:21:09.799028+0000","last_active":"2024-05-08T04:21:11.798765+0000","last_peered":"2024-05-08T04:21:11.798765+0000","last_clean":"2024-05-08T04:21:11.798765+0000","last_became_active":"2024-05-08T04:21:09.798761+0000","last_became_peered":"2024-05-08T04:21:09.798761+0000","last_unstale":"2024-05-08T04:21:11.798765+0000","last_undegraded":"2024-05-08T04:21:11.798765+0000","last_fullsized":"2024-05-08T04:21:11.798765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683765+0000","last_change":"2024-05-08T04:21:10.799702+0000","last_active":"2024-05-08T04:21:12.683765+0000","last_peered":"2024-05-08T04:21:12.683765+0000","last_clean":"2024-05-08T04:21:12.683765+0000","last_became_active":"2024-05-08T04:21:10.799422+0000","last_became_peered":"2024-05-08T04:21:10.799422+0000","last_unstale":"2024-05-08T04:21:12.683765+0000","last_undegraded":"2024-05-08T04:21:12.683765+0000","last_fullsized":"2024-05-08T04:21:12.683765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:35:00.954562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997612+0000","last_change":"2024-05-08T04:21:09.798256+0000","last_active":"2024-05-08T04:21:11.997612+0000","last_peered":"2024-05-08T04:21:11.997612+0000","last_clean":"2024-05-08T04:21:11.997612+0000","last_became_active":"2024-05-08T04:21:09.796157+0000","last_became_peered":"2024-05-08T04:21:09.796157+0000","last_unstale":"2024-05-08T04:21:11.997612+0000","last_undegraded":"2024-05-08T04:21:11.997612+0000","last_fullsized":"2024-05-08T04:21:11.997612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:10.460883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684326+0000","last_change":"2024-05-08T04:21:10.808794+0000","last_active":"2024-05-08T04:21:12.684326+0000","last_peered":"2024-05-08T04:21:12.684326+0000","last_clean":"2024-05-08T04:21:12.684326+0000","last_became_active":"2024-05-08T04:21:10.808339+0000","last_became_peered":"2024-05-08T04:21:10.808339+0000","last_unstale":"2024-05-08T04:21:12.684326+0000","last_undegraded":"2024-05-08T04:21:12.684326+0000","last_fullsized":"2024-05-08T04:21:12.684326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:00.315803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.807697+0000","last_change":"2024-05-08T04:21:09.806917+0000","last_active":"2024-05-08T04:21:11.807697+0000","last_peered":"2024-05-08T04:21:11.807697+0000","last_clean":"2024-05-08T04:21:11.807697+0000","last_became_active":"2024-05-08T04:21:09.806599+0000","last_became_peered":"2024-05-08T04:21:09.806599+0000","last_unstale":"2024-05-08T04:21:11.807697+0000","last_undegraded":"2024-05-08T04:21:11.807697+0000","last_fullsized":"2024-05-08T04:21:11.807697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804308+0000","last_change":"2024-05-08T04:21:10.809200+0000","last_active":"2024-05-08T04:21:11.804308+0000","last_peered":"2024-05-08T04:21:11.804308+0000","last_clean":"2024-05-08T04:21:11.804308+0000","last_became_active":"2024-05-08T04:21:10.808575+0000","last_became_peered":"2024-05-08T04:21:10.808575+0000","last_unstale":"2024-05-08T04:21:11.804308+0000","last_undegraded":"2024-05-08T04:21:11.804308+0000","last_fullsized":"2024-05-08T04:21:11.804308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:28.772190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997710+0000","last_change":"2024-05-08T04:21:09.807154+0000","last_active":"2024-05-08T04:21:11.997710+0000","last_peered":"2024-05-08T04:21:11.997710+0000","last_clean":"2024-05-08T04:21:11.997710+0000","last_became_active":"2024-05-08T04:21:09.806884+0000","last_became_peered":"2024-05-08T04:21:09.806884+0000","last_unstale":"2024-05-08T04:21:11.997710+0000","last_undegraded":"2024-05-08T04:21:11.997710+0000","last_fullsized":"2024-05-08T04:21:11.997710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:00.101724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804179+0000","last_change":"2024-05-08T04:21:10.805880+0000","last_active":"2024-05-08T04:21:11.804179+0000","last_peered":"2024-05-08T04:21:11.804179+0000","last_clean":"2024-05-08T04:21:11.804179+0000","last_became_active":"2024-05-08T04:21:10.805610+0000","last_became_peered":"2024-05-08T04:21:10.805610+0000","last_unstale":"2024-05-08T04:21:11.804179+0000","last_undegraded":"2024-05-08T04:21:11.804179+0000","last_fullsized":"2024-05-08T04:21:11.804179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:05:32.612930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806080+0000","last_change":"2024-05-08T04:21:09.805802+0000","last_active":"2024-05-08T04:21:11.806080+0000","last_peered":"2024-05-08T04:21:11.806080+0000","last_clean":"2024-05-08T04:21:11.806080+0000","last_became_active":"2024-05-08T04:21:09.805532+0000","last_became_peered":"2024-05-08T04:21:09.805532+0000","last_unstale":"2024-05-08T04:21:11.806080+0000","last_undegraded":"2024-05-08T04:21:11.806080+0000","last_fullsized":"2024-05-08T04:21:11.806080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997242+0000","last_change":"2024-05-08T04:21:10.810731+0000","last_active":"2024-05-08T04:21:11.997242+0000","last_peered":"2024-05-08T04:21:11.997242+0000","last_clean":"2024-05-08T04:21:11.997242+0000","last_became_active":"2024-05-08T04:21:10.810473+0000","last_became_peered":"2024-05-08T04:21:10.810473+0000","last_unstale":"2024-05-08T04:21:11.997242+0000","last_undegraded":"2024-05-08T04:21:11.997242+0000","last_fullsized":"2024-05-08T04:21:11.997242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:22.397948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803834+0000","last_change":"2024-05-08T04:21:09.808749+0000","last_active":"2024-05-08T04:21:11.803834+0000","last_peered":"2024-05-08T04:21:11.803834+0000","last_clean":"2024-05-08T04:21:11.803834+0000","last_became_active":"2024-05-08T04:21:09.808522+0000","last_became_peered":"2024-05-08T04:21:09.808522+0000","last_unstale":"2024-05-08T04:21:11.803834+0000","last_undegraded":"2024-05-08T04:21:11.803834+0000","last_fullsized":"2024-05-08T04:21:11.803834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:18:52.154658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.803729+0000","last_change":"2024-05-08T04:21:10.803674+0000","last_active":"2024-05-08T04:21:11.803729+0000","last_peered":"2024-05-08T04:21:11.803729+0000","last_clean":"2024-05-08T04:21:11.803729+0000","last_became_active":"2024-05-08T04:21:10.802802+0000","last_became_peered":"2024-05-08T04:21:10.802802+0000","last_unstale":"2024-05-08T04:21:11.803729+0000","last_undegraded":"2024-05-08T04:21:11.803729+0000","last_fullsized":"2024-05-08T04:21:11.803729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:18:33.343054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.684231+0000","last_change":"2024-05-08T04:21:09.801923+0000","last_active":"2024-05-08T04:21:12.684231+0000","last_peered":"2024-05-08T04:21:12.684231+0000","last_clean":"2024-05-08T04:21:12.684231+0000","last_became_active":"2024-05-08T04:21:09.801620+0000","last_became_peered":"2024-05-08T04:21:09.801620+0000","last_unstale":"2024-05-08T04:21:12.684231+0000","last_undegraded":"2024-05-08T04:21:12.684231+0000","last_fullsized":"2024-05-08T04:21:12.684231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:17:42.862260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:12.683884+0000","last_change":"2024-05-08T04:21:10.806239+0000","last_active":"2024-05-08T04:21:12.683884+0000","last_peered":"2024-05-08T04:21:12.683884+0000","last_clean":"2024-05-08T04:21:12.683884+0000","last_became_active":"2024-05-08T04:21:10.805961+0000","last_became_peered":"2024-05-08T04:21:10.805961+0000","last_unstale":"2024-05-08T04:21:12.683884+0000","last_undegraded":"2024-05-08T04:21:12.683884+0000","last_fullsized":"2024-05-08T04:21:12.683884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:35:53.770709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997335+0000","last_change":"2024-05-08T04:21:09.805477+0000","last_active":"2024-05-08T04:21:11.997335+0000","last_peered":"2024-05-08T04:21:11.997335+0000","last_clean":"2024-05-08T04:21:11.997335+0000","last_became_active":"2024-05-08T04:21:09.805232+0000","last_became_peered":"2024-05-08T04:21:09.805232+0000","last_unstale":"2024-05-08T04:21:11.997335+0000","last_undegraded":"2024-05-08T04:21:11.997335+0000","last_fullsized":"2024-05-08T04:21:11.997335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:33.031084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997271+0000","last_change":"2024-05-08T04:21:10.812788+0000","last_active":"2024-05-08T04:21:11.997271+0000","last_peered":"2024-05-08T04:21:11.997271+0000","last_clean":"2024-05-08T04:21:11.997271+0000","last_became_active":"2024-05-08T04:21:10.812267+0000","last_became_peered":"2024-05-08T04:21:10.812267+0000","last_unstale":"2024-05-08T04:21:11.997271+0000","last_undegraded":"2024-05-08T04:21:11.997271+0000","last_fullsized":"2024-05-08T04:21:11.997271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:56:40.748736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.997431+0000","last_change":"2024-05-08T04:21:10.814337+0000","last_active":"2024-05-08T04:21:11.997431+0000","last_peered":"2024-05-08T04:21:11.997431+0000","last_clean":"2024-05-08T04:21:11.997431+0000","last_became_active":"2024-05-08T04:21:10.814087+0000","last_became_peered":"2024-05-08T04:21:10.814087+0000","last_unstale":"2024-05-08T04:21:11.997431+0000","last_undegraded":"2024-05-08T04:21:11.997431+0000","last_fullsized":"2024-05-08T04:21:11.997431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:40:31.354097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806735+0000","last_change":"2024-05-08T04:21:09.808915+0000","last_active":"2024-05-08T04:21:11.806735+0000","last_peered":"2024-05-08T04:21:11.806735+0000","last_clean":"2024-05-08T04:21:11.806735+0000","last_became_active":"2024-05-08T04:21:09.808528+0000","last_became_peered":"2024-05-08T04:21:09.808528+0000","last_unstale":"2024-05-08T04:21:11.806735+0000","last_undegraded":"2024-05-08T04:21:11.806735+0000","last_fullsized":"2024-05-08T04:21:11.806735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:15:10.460883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.797564+0000","last_change":"2024-05-08T04:21:10.814868+0000","last_active":"2024-05-08T04:21:11.797564+0000","last_peered":"2024-05-08T04:21:11.797564+0000","last_clean":"2024-05-08T04:21:11.797564+0000","last_became_active":"2024-05-08T04:21:10.814012+0000","last_became_peered":"2024-05-08T04:21:10.814012+0000","last_unstale":"2024-05-08T04:21:11.797564+0000","last_undegraded":"2024-05-08T04:21:11.797564+0000","last_fullsized":"2024-05-08T04:21:11.797564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:02.505469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.806577+0000","last_change":"2024-05-08T04:21:09.806371+0000","last_active":"2024-05-08T04:21:11.806577+0000","last_peered":"2024-05-08T04:21:11.806577+0000","last_clean":"2024-05-08T04:21:11.806577+0000","last_became_active":"2024-05-08T04:21:09.806120+0000","last_became_peered":"2024-05-08T04:21:09.806120+0000","last_unstale":"2024-05-08T04:21:11.806577+0000","last_undegraded":"2024-05-08T04:21:11.806577+0000","last_fullsized":"2024-05-08T04:21:11.806577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:53.038538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799202+0000","last_change":"2024-05-08T04:21:10.799276+0000","last_active":"2024-05-08T04:21:11.799202+0000","last_peered":"2024-05-08T04:21:11.799202+0000","last_clean":"2024-05-08T04:21:11.799202+0000","last_became_active":"2024-05-08T04:21:10.798986+0000","last_became_peered":"2024-05-08T04:21:10.798986+0000","last_unstale":"2024-05-08T04:21:11.799202+0000","last_undegraded":"2024-05-08T04:21:11.799202+0000","last_fullsized":"2024-05-08T04:21:11.799202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:39.936653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799414+0000","last_change":"2024-05-08T04:21:09.795113+0000","last_active":"2024-05-08T04:21:11.799414+0000","last_peered":"2024-05-08T04:21:11.799414+0000","last_clean":"2024-05-08T04:21:11.799414+0000","last_became_active":"2024-05-08T04:21:09.794565+0000","last_became_peered":"2024-05-08T04:21:09.794565+0000","last_unstale":"2024-05-08T04:21:11.799414+0000","last_undegraded":"2024-05-08T04:21:11.799414+0000","last_fullsized":"2024-05-08T04:21:11.799414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:18.815210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.799323+0000","last_change":"2024-05-08T04:21:10.794958+0000","last_active":"2024-05-08T04:21:11.799323+0000","last_peered":"2024-05-08T04:21:11.799323+0000","last_clean":"2024-05-08T04:21:11.799323+0000","last_became_active":"2024-05-08T04:21:10.794649+0000","last_became_peered":"2024-05-08T04:21:10.794649+0000","last_unstale":"2024-05-08T04:21:11.799323+0000","last_undegraded":"2024-05-08T04:21:11.799323+0000","last_fullsized":"2024-05-08T04:21:11.799323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:09.778427+0000","last_clean_scrub_stamp":"2024-05-08T04:21:09.778427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:36.487747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T04:21:11.804255+0000","last_change":"2024-05-08T04:21:09.802589+0000","last_active":"2024-05-08T04:21:11.804255+0000","last_peered":"2024-05-08T04:21:11.804255+0000","last_clean":"2024-05-08T04:21:11.804255+0000","last_became_active":"2024-05-08T04:21:09.802292+0000","last_became_peered":"2024-05-08T04:21:09.802292+0000","last_unstale":"2024-05-08T04:21:11.804255+0000","last_undegraded":"2024-05-08T04:21:11.804255+0000","last_fullsized":"2024-05-08T04:21:11.804255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:21:08.772348+0000","last_clean_scrub_stamp":"2024-05-08T04:21:08.772348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:31.229006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":661394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":73218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":70990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:21:21.605 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T04:21:21.606 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T04:21:21.606 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T04:21:21.606 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T04:21:21.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.739+0000 7f8f75370640 1 Processor -- start 2024-05-08T04:21:21.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.739+0000 7f8f75370640 1 -- start start 2024-05-08T04:21:21.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.740+0000 7f8f75370640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7015de10 0x7f8f70161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.740+0000 7f8f75370640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8f700ce5a0 0x7f8f700d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.740+0000 7f8f75370640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f700d3210 con 0x7f8f700d05f0 2024-05-08T04:21:21.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.740+0000 7f8f75370640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f700d0f50 con 0x7f8f700ce5a0 2024-05-08T04:21:21.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.740+0000 7f8f75370640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f70161e60 con 0x7f8f7015de10 2024-05-08T04:21:21.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.740+0000 7f8f6e7fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8f700ce5a0 0x7f8f700d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.740+0000 7f8f6effd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7015de10 0x7f8f70161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.740+0000 7f8f6e7fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8f700ce5a0 0x7f8f700d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:53282/0 (socket says 172.21.15.104:53282) 2024-05-08T04:21:21.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.740+0000 7f8f6f7fe640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f8f700d05f0 0x7f8f700b54a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:35204/0 (socket says 172.21.15.104:35204) 2024-05-08T04:21:21.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.740+0000 7f8f6e7fc640 1 -- 172.21.15.104:0/287459730 learned_addr learned my addr 172.21.15.104:0/287459730 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:21.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.741+0000 7f8f6e7fc640 1 -- 172.21.15.104:0/287459730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7015de10 msgr2=0x7f8f70161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:21.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.741+0000 7f8f6e7fc640 1 --2- 172.21.15.104:0/287459730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7015de10 0x7f8f70161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.741+0000 7f8f6e7fc640 1 -- 172.21.15.104:0/287459730 >> v1:172.21.15.183:6789/0 conn(0x7f8f700d05f0 legacy=0x7f8f700b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.741+0000 7f8f6e7fc640 1 -- 172.21.15.104:0/287459730 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7015e1f0 con 0x7f8f700ce5a0 2024-05-08T04:21:21.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.741+0000 7f8f6dffb640 1 -- 172.21.15.104:0/287459730 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774083339 0 0) 0x7f8f700d3210 con 0x7f8f700d05f0 2024-05-08T04:21:21.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.741+0000 7f8f6e7fc640 1 --2- 172.21.15.104:0/287459730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f700ce5a0 0x7f8f700d00b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009870 tx=0x7f8f6402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb608c9191daea8b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:21.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.741+0000 7f8f6dffb640 1 -- 172.21.15.104:0/287459730 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64037070 con 0x7f8f700ce5a0 2024-05-08T04:21:21.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.742+0000 7f8f6dffb640 1 -- 172.21.15.104:0/287459730 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f64032440 con 0x7f8f700ce5a0 2024-05-08T04:21:21.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.742+0000 7f8f6dffb640 1 -- 172.21.15.104:0/287459730 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64032810 con 0x7f8f700ce5a0 2024-05-08T04:21:21.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.742+0000 7f8f75370640 1 -- 172.21.15.104:0/287459730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f700ce5a0 msgr2=0x7f8f700d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.742+0000 7f8f75370640 1 --2- 172.21.15.104:0/287459730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f700ce5a0 0x7f8f700d00b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009870 tx=0x7f8f6402a1c0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.742+0000 7f8f75370640 1 -- 172.21.15.104:0/287459730 shutdown_connections 2024-05-08T04:21:21.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.742+0000 7f8f75370640 1 --2- 172.21.15.104:0/287459730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f700ce5a0 0x7f8f700d00b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.742+0000 7f8f75370640 1 --2- 172.21.15.104:0/287459730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f7015de10 0x7f8f70161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.742+0000 7f8f75370640 1 -- 172.21.15.104:0/287459730 >> 172.21.15.104:0/287459730 conn(0x7f8f70072290 msgr2=0x7f8f70072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:21.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.742+0000 7f8f75370640 1 -- 172.21.15.104:0/287459730 shutdown_connections 2024-05-08T04:21:21.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.742+0000 7f8f75370640 1 -- 172.21.15.104:0/287459730 wait complete. 2024-05-08T04:21:21.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.743+0000 7f8f75370640 1 Processor -- start 2024-05-08T04:21:21.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.743+0000 7f8f75370640 1 -- start start 2024-05-08T04:21:21.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.744+0000 7f8f75370640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f700ce5a0 0x7f8f700cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.744+0000 7f8f75370640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f700d05f0 0x7f8f7015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.744+0000 7f8f75370640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f7015de10 0x7f8f7015e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.744+0000 7f8f75370640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f70162090 con 0x7f8f7015de10 2024-05-08T04:21:21.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.744+0000 7f8f75370640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700d1a90 con 0x7f8f700ce5a0 2024-05-08T04:21:21.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.744+0000 7f8f75370640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f70162370 con 0x7f8f700d05f0 2024-05-08T04:21:21.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.744+0000 7f8f6f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f7015de10 0x7f8f7015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.744+0000 7f8f6f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f7015de10 0x7f8f7015e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34056/0 (socket says 172.21.15.104:34056) 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.744+0000 7f8f6f7fe640 1 -- 172.21.15.104:0/320279876 learned_addr learned my addr 172.21.15.104:0/320279876 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.744+0000 7f8f6e7fc640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f700d05f0 0x7f8f7015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.744+0000 7f8f6effd640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f700ce5a0 0x7f8f700cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.744+0000 7f8f6f7fe640 1 -- 172.21.15.104:0/320279876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f700d05f0 msgr2=0x7f8f7015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.744+0000 7f8f6f7fe640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f700d05f0 0x7f8f7015fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.745+0000 7f8f6f7fe640 1 -- 172.21.15.104:0/320279876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f700ce5a0 msgr2=0x7f8f700cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.745+0000 7f8f6f7fe640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f700ce5a0 0x7f8f700cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.745+0000 7f8f6f7fe640 1 -- 172.21.15.104:0/320279876 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7015ec50 con 0x7f8f7015de10 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.745+0000 7f8f6f7fe640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f7015de10 0x7f8f7015e420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800c7a0 tx=0x7f8f6800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.745+0000 7f8f577fe640 1 -- 172.21.15.104:0/320279876 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68018070 con 0x7f8f7015de10 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.745+0000 7f8f577fe640 1 -- 172.21.15.104:0/320279876 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6800a640 con 0x7f8f7015de10 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.745+0000 7f8f577fe640 1 -- 172.21.15.104:0/320279876 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6800aab0 con 0x7f8f7015de10 2024-05-08T04:21:21.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.745+0000 7f8f75370640 1 -- 172.21.15.104:0/320279876 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7015ef30 con 0x7f8f7015de10 2024-05-08T04:21:21.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.745+0000 7f8f75370640 1 -- 172.21.15.104:0/320279876 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7015f4f0 con 0x7f8f7015de10 2024-05-08T04:21:21.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.746+0000 7f8f75370640 1 -- 172.21.15.104:0/320279876 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f70075010 con 0x7f8f7015de10 2024-05-08T04:21:21.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.746+0000 7f8f577fe640 1 -- 172.21.15.104:0/320279876 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8f6801b070 con 0x7f8f7015de10 2024-05-08T04:21:21.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.747+0000 7f8f577fe640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8f5c06b4d0 0x7f8f5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:21.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.747+0000 7f8f577fe640 1 -- 172.21.15.104:0/320279876 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f68089820 con 0x7f8f7015de10 2024-05-08T04:21:21.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.747+0000 7f8f6effd640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8f5c06b4d0 0x7f8f5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:21.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.747+0000 7f8f6effd640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8f5c06b4d0 0x7f8f5c06d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009b40 tx=0x7f8f60009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:21.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.751+0000 7f8f577fe640 1 -- 172.21.15.104:0/320279876 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8f68057fc0 con 0x7f8f7015de10 2024-05-08T04:21:21.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.959+0000 7f8f75370640 1 -- 172.21.15.104:0/320279876 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8f700cecb0 con 0x7f8f7015de10 2024-05-08T04:21:21.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.959+0000 7f8f577fe640 1 -- 172.21.15.104:0/320279876 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8f6805c060 con 0x7f8f7015de10 2024-05-08T04:21:21.960 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:21.960 INFO:teuthology.orchestra.run.smithi104.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T04:21:21.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.961+0000 7f8f75370640 1 -- 172.21.15.104:0/320279876 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8f5c06b4d0 msgr2=0x7f8f5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.961+0000 7f8f75370640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8f5c06b4d0 0x7f8f5c06d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009b40 tx=0x7f8f60009190 comp rx=0 tx=0).stop 2024-05-08T04:21:21.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.961+0000 7f8f75370640 1 -- 172.21.15.104:0/320279876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f7015de10 msgr2=0x7f8f7015e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:21.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.961+0000 7f8f75370640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f7015de10 0x7f8f7015e420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800c7a0 tx=0x7f8f6800cc60 comp rx=0 tx=0).stop 2024-05-08T04:21:21.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.961+0000 7f8f75370640 1 -- 172.21.15.104:0/320279876 shutdown_connections 2024-05-08T04:21:21.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.961+0000 7f8f75370640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8f5c06b4d0 0x7f8f5c06d990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.961+0000 7f8f75370640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f7015de10 0x7f8f7015e420 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.961+0000 7f8f75370640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f700d05f0 0x7f8f7015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.961+0000 7f8f75370640 1 --2- 172.21.15.104:0/320279876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f700ce5a0 0x7f8f700cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:21.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.961+0000 7f8f75370640 1 -- 172.21.15.104:0/320279876 >> 172.21.15.104:0/320279876 conn(0x7f8f70072290 msgr2=0x7f8f7015cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:21.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.961+0000 7f8f75370640 1 -- 172.21.15.104:0/320279876 shutdown_connections 2024-05-08T04:21:21.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:21.961+0000 7f8f75370640 1 -- 172.21.15.104:0/320279876 wait complete. 2024-05-08T04:21:21.973 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T04:21:21.973 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:22.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.072+0000 7fcf2eae1640 1 Processor -- start 2024-05-08T04:21:22.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.072+0000 7fcf2eae1640 1 -- start start 2024-05-08T04:21:22.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.072+0000 7fcf2eae1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcf280ce5a0 0x7fcf28161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.072+0000 7fcf2eae1640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2815e1f0 con 0x7fcf280d07c0 2024-05-08T04:21:22.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.072+0000 7fcf2eae1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf28162090 con 0x7fcf2815de10 2024-05-08T04:21:22.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.072+0000 7fcf2eae1640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf280d0f50 con 0x7fcf280ce5a0 2024-05-08T04:21:22.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.072+0000 7fcf27fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcf280ce5a0 0x7fcf28161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.072+0000 7fcf2d07e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fcf280d07c0 0x7fcf280d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53200/0 (socket says 172.21.15.104:53200) 2024-05-08T04:21:22.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.073+0000 7fcf2d07e640 1 -- 172.21.15.104:0/2901433056 learned_addr learned my addr 172.21.15.104:0/2901433056 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.073+0000 7fcf27fff640 1 -- 172.21.15.104:0/2901433056 >> v1:172.21.15.183:6789/0 conn(0x7fcf2815de10 legacy=0x7fcf280d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.073+0000 7fcf27fff640 1 -- 172.21.15.104:0/2901433056 >> v1:172.21.15.104:6789/0 conn(0x7fcf280d07c0 legacy=0x7fcf280d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.073+0000 7fcf27fff640 1 -- 172.21.15.104:0/2901433056 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28162370 con 0x7fcf280ce5a0 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.073+0000 7fcf277fe640 1 -- 172.21.15.104:0/2901433056 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359668706 0 0) 0x7fcf2815e1f0 con 0x7fcf280d07c0 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.073+0000 7fcf27fff640 1 --2- 172.21.15.104:0/2901433056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf280ce5a0 0x7fcf28161920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcf140097a0 tx=0x7fcf1402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e90e176594226f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.074+0000 7fcf277fe640 1 -- 172.21.15.104:0/2901433056 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14037070 con 0x7fcf280ce5a0 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.074+0000 7fcf277fe640 1 -- 172.21.15.104:0/2901433056 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf14032440 con 0x7fcf280ce5a0 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.074+0000 7fcf277fe640 1 -- 172.21.15.104:0/2901433056 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14032810 con 0x7fcf280ce5a0 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.074+0000 7fcf2eae1640 1 -- 172.21.15.104:0/2901433056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf280ce5a0 msgr2=0x7fcf28161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.074+0000 7fcf2eae1640 1 --2- 172.21.15.104:0/2901433056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf280ce5a0 0x7fcf28161920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcf140097a0 tx=0x7fcf1402a1a0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.074+0000 7fcf2eae1640 1 -- 172.21.15.104:0/2901433056 shutdown_connections 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.074+0000 7fcf2eae1640 1 --2- 172.21.15.104:0/2901433056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf280ce5a0 0x7fcf28161920 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.074+0000 7fcf2eae1640 1 -- 172.21.15.104:0/2901433056 >> 172.21.15.104:0/2901433056 conn(0x7fcf28072290 msgr2=0x7fcf28072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:22.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.074+0000 7fcf2eae1640 1 -- 172.21.15.104:0/2901433056 shutdown_connections 2024-05-08T04:21:22.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.074+0000 7fcf2eae1640 1 -- 172.21.15.104:0/2901433056 wait complete. 2024-05-08T04:21:22.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.075+0000 7fcf2eae1640 1 Processor -- start 2024-05-08T04:21:22.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.075+0000 7fcf2eae1640 1 -- start start 2024-05-08T04:21:22.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.076+0000 7fcf2eae1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf280ce5a0 0x7fcf280cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.076+0000 7fcf2eae1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf280d07c0 0x7fcf2815f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.076+0000 7fcf2eae1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf2815de10 0x7fcf280b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.076+0000 7fcf2eae1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280d1a90 con 0x7fcf280d07c0 2024-05-08T04:21:22.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.076+0000 7fcf2eae1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280d1ce0 con 0x7fcf280ce5a0 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.076+0000 7fcf2eae1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280b6dc0 con 0x7fcf2815de10 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.076+0000 7fcf27fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf280d07c0 0x7fcf2815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.076+0000 7fcf27fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf280d07c0 0x7fcf2815f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34084/0 (socket says 172.21.15.104:34084) 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.076+0000 7fcf27fff640 1 -- 172.21.15.104:0/462109938 learned_addr learned my addr 172.21.15.104:0/462109938 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.076+0000 7fcf2c87d640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf280ce5a0 0x7fcf280cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.076+0000 7fcf2d07e640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf2815de10 0x7fcf280b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.076+0000 7fcf27fff640 1 -- 172.21.15.104:0/462109938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf2815de10 msgr2=0x7fcf280b8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.076+0000 7fcf27fff640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf2815de10 0x7fcf280b8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.077+0000 7fcf27fff640 1 -- 172.21.15.104:0/462109938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf280ce5a0 msgr2=0x7fcf280cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.077+0000 7fcf27fff640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf280ce5a0 0x7fcf280cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.077+0000 7fcf27fff640 1 -- 172.21.15.104:0/462109938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2815fcb0 con 0x7fcf280d07c0 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.077+0000 7fcf27fff640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf280d07c0 0x7fcf2815f460 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcf14000c00 tx=0x7fcf140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.077+0000 7fcf257fa640 1 -- 172.21.15.104:0/462109938 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14037040 con 0x7fcf280d07c0 2024-05-08T04:21:22.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.077+0000 7fcf257fa640 1 -- 172.21.15.104:0/462109938 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf14042070 con 0x7fcf280d07c0 2024-05-08T04:21:22.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.077+0000 7fcf257fa640 1 -- 172.21.15.104:0/462109938 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14030a70 con 0x7fcf280d07c0 2024-05-08T04:21:22.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.077+0000 7fcf2eae1640 1 -- 172.21.15.104:0/462109938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf280cac20 con 0x7fcf280d07c0 2024-05-08T04:21:22.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.077+0000 7fcf2eae1640 1 -- 172.21.15.104:0/462109938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2815f9a0 con 0x7fcf280d07c0 2024-05-08T04:21:22.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.078+0000 7fcf2eae1640 1 -- 172.21.15.104:0/462109938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf28075010 con 0x7fcf280d07c0 2024-05-08T04:21:22.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.078+0000 7fcf257fa640 1 -- 172.21.15.104:0/462109938 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcf14030c10 con 0x7fcf280d07c0 2024-05-08T04:21:22.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.079+0000 7fcf257fa640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcf0c06b4d0 0x7fcf0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.079+0000 7fcf2c87d640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcf0c06b4d0 0x7fcf0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.079+0000 7fcf257fa640 1 -- 172.21.15.104:0/462109938 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf140aac10 con 0x7fcf280d07c0 2024-05-08T04:21:22.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.079+0000 7fcf2c87d640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcf0c06b4d0 0x7fcf0c06d990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c000f60 tx=0x7fcf1c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:22.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.083+0000 7fcf257fa640 1 -- 172.21.15.104:0/462109938 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf14045360 con 0x7fcf280d07c0 2024-05-08T04:21:22.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.253+0000 7fcf2eae1640 1 -- 172.21.15.104:0/462109938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf280d1870 con 0x7fcf280d07c0 2024-05-08T04:21:22.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.254+0000 7fcf257fa640 1 -- 172.21.15.104:0/462109938 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7fcf14079b20 con 0x7fcf280d07c0 2024-05-08T04:21:22.255 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:22.255 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:22.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.255+0000 7fcf2eae1640 1 -- 172.21.15.104:0/462109938 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcf0c06b4d0 msgr2=0x7fcf0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.255+0000 7fcf2eae1640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcf0c06b4d0 0x7fcf0c06d990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c000f60 tx=0x7fcf1c009040 comp rx=0 tx=0).stop 2024-05-08T04:21:22.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.256+0000 7fcf2eae1640 1 -- 172.21.15.104:0/462109938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf280d07c0 msgr2=0x7fcf2815f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.256+0000 7fcf2eae1640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf280d07c0 0x7fcf2815f460 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcf14000c00 tx=0x7fcf140046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.256+0000 7fcf2eae1640 1 -- 172.21.15.104:0/462109938 shutdown_connections 2024-05-08T04:21:22.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.256+0000 7fcf2eae1640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcf0c06b4d0 0x7fcf0c06d990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.256+0000 7fcf2eae1640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf2815de10 0x7fcf280b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.256+0000 7fcf2eae1640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf280d07c0 0x7fcf2815f460 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.256+0000 7fcf2eae1640 1 --2- 172.21.15.104:0/462109938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf280ce5a0 0x7fcf280cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.256+0000 7fcf2eae1640 1 -- 172.21.15.104:0/462109938 >> 172.21.15.104:0/462109938 conn(0x7fcf28072290 msgr2=0x7fcf280d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:22.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.256+0000 7fcf2eae1640 1 -- 172.21.15.104:0/462109938 shutdown_connections 2024-05-08T04:21:22.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.256+0000 7fcf2eae1640 1 -- 172.21.15.104:0/462109938 wait complete. 2024-05-08T04:21:22.268 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:22.268 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:22.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.369+0000 7fde1014f640 1 Processor -- start 2024-05-08T04:21:22.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.369+0000 7fde1014f640 1 -- start start 2024-05-08T04:21:22.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.370+0000 7fde1014f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde08144c80 0x7fde0806df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.370+0000 7fde1014f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde08071fb0 con 0x7fde080711c0 2024-05-08T04:21:22.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.370+0000 7fde1014f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde08071710 con 0x7fde080cc930 2024-05-08T04:21:22.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.370+0000 7fde1014f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde080719f0 con 0x7fde08144c80 2024-05-08T04:21:22.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.370+0000 7fde0d6ea640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fde080711c0 0x7fde0806d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53216/0 (socket says 172.21.15.104:53216) 2024-05-08T04:21:22.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.370+0000 7fde0d6ea640 1 -- 172.21.15.104:0/2031557327 learned_addr learned my addr 172.21.15.104:0/2031557327 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:22.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0e6ec640 1 --2- 172.21.15.104:0/2031557327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde08144c80 0x7fde0806df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239154755 0 0) 0x7fde08071fb0 con 0x7fde080711c0 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf4003520 con 0x7fde080711c0 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1856300018 0 0) 0x7fddf4003520 con 0x7fde080711c0 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde08144c80 msgr2=0x7fde0806df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 --2- 172.21.15.104:0/2031557327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde08144c80 0x7fde0806df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 >> v1:172.21.15.183:6789/0 conn(0x7fde080cc930 legacy=0x7fde080ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde08071cd0 con 0x7fde080711c0 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fddf8001670 con 0x7fde080711c0 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 >> v1:172.21.15.104:6789/0 conn(0x7fde080711c0 legacy=0x7fde0806d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 --2- 172.21.15.104:0/2031557327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf40039e0 0x7fddf4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 --2- 172.21.15.104:0/2031557327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fddf4004390 0x7fddf4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 --2- 172.21.15.104:0/2031557327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde08144c80 0x7fddf4005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde080719f0 con 0x7fddf4004390 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf400ba70 con 0x7fddf40039e0 2024-05-08T04:21:22.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf400bc70 con 0x7fde08144c80 2024-05-08T04:21:22.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0d6ea640 1 --2- 172.21.15.104:0/2031557327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fddf4004390 0x7fddf4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0deeb640 1 --2- 172.21.15.104:0/2031557327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf40039e0 0x7fddf4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0d6ea640 1 -- 172.21.15.104:0/2031557327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde08144c80 msgr2=0x7fddf4005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:22.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0d6ea640 1 --2- 172.21.15.104:0/2031557327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde08144c80 0x7fddf4005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0d6ea640 1 -- 172.21.15.104:0/2031557327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf40039e0 msgr2=0x7fddf4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:22.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0d6ea640 1 --2- 172.21.15.104:0/2031557327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf40039e0 0x7fddf4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.371+0000 7fde0d6ea640 1 -- 172.21.15.104:0/2031557327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf4003520 con 0x7fddf4004390 2024-05-08T04:21:22.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.372+0000 7fde0d6ea640 1 --2- 172.21.15.104:0/2031557327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fddf4004390 0x7fddf4004860 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fddf800c190 tx=0x7fddf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec24c8b295591f75 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:22.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.372+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf8007cc0 con 0x7fddf4004390 2024-05-08T04:21:22.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.372+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf8005ad0 con 0x7fddf4004390 2024-05-08T04:21:22.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.372+0000 7fde0cee9640 1 -- 172.21.15.104:0/2031557327 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf8007070 con 0x7fddf4004390 2024-05-08T04:21:22.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.373+0000 7fde1014f640 1 -- 172.21.15.104:0/2031557327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fddf4004390 msgr2=0x7fddf4004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.373+0000 7fde1014f640 1 --2- 172.21.15.104:0/2031557327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fddf4004390 0x7fddf4004860 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fddf800c190 tx=0x7fddf4005830 comp rx=0 tx=0).stop 2024-05-08T04:21:22.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.373+0000 7fde0e6ec640 1 -- 172.21.15.104:0/2031557327 reap_dead start 2024-05-08T04:21:22.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.373+0000 7fde1014f640 1 -- 172.21.15.104:0/2031557327 shutdown_connections 2024-05-08T04:21:22.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.373+0000 7fde1014f640 1 -- 172.21.15.104:0/2031557327 >> 172.21.15.104:0/2031557327 conn(0x7fde080b13f0 msgr2=0x7fde080b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:22.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.373+0000 7fde1014f640 1 -- 172.21.15.104:0/2031557327 shutdown_connections 2024-05-08T04:21:22.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.373+0000 7fde1014f640 1 -- 172.21.15.104:0/2031557327 wait complete. 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.374+0000 7fde1014f640 1 Processor -- start 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.374+0000 7fde1014f640 1 -- start start 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.374+0000 7fde1014f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fddf4004390 0x7fde081f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde1014f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde081f7b80 0x7fde080b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde1014f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde080adcf0 0x7fde081f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde1014f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde081453f0 con 0x7fde081f7b80 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde1014f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde080cf3b0 con 0x7fde080adcf0 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde1014f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0806df60 con 0x7fddf4004390 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde0d6ea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde081f7b80 0x7fde080b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde0d6ea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde081f7b80 0x7fde080b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34112/0 (socket says 172.21.15.104:34112) 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde0d6ea640 1 -- 172.21.15.104:0/3776848938 learned_addr learned my addr 172.21.15.104:0/3776848938 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde0deeb640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fddf4004390 0x7fde081f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde0e6ec640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde080adcf0 0x7fde081f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde0d6ea640 1 -- 172.21.15.104:0/3776848938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fddf4004390 msgr2=0x7fde081f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde0d6ea640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fddf4004390 0x7fde081f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde0d6ea640 1 -- 172.21.15.104:0/3776848938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde080adcf0 msgr2=0x7fde081f2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde0d6ea640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde080adcf0 0x7fde081f2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde0d6ea640 1 -- 172.21.15.104:0/3776848938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0813d4b0 con 0x7fde081f7b80 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde0deeb640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fddf4004390 0x7fde081f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde0d6ea640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde081f7b80 0x7fde080b41c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fddf800c1f0 tx=0x7fddf80019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fddfe7fc640 1 -- 172.21.15.104:0/3776848938 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf8041030 con 0x7fde081f7b80 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fddfe7fc640 1 -- 172.21.15.104:0/3776848938 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf8038040 con 0x7fde081f7b80 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde1014f640 1 -- 172.21.15.104:0/3776848938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde081f47f0 con 0x7fde081f7b80 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fddfe7fc640 1 -- 172.21.15.104:0/3776848938 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf8001670 con 0x7fde081f7b80 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.375+0000 7fde1014f640 1 -- 172.21.15.104:0/3776848938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde081f3ab0 con 0x7fde081f7b80 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.376+0000 7fde1014f640 1 -- 172.21.15.104:0/3776848938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde08075010 con 0x7fde081f7b80 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.377+0000 7fddfe7fc640 1 -- 172.21.15.104:0/3776848938 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fddf8044070 con 0x7fde081f7b80 2024-05-08T04:21:22.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.377+0000 7fddfe7fc640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fddec06b4d0 0x7fddec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.377+0000 7fde0deeb640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fddec06b4d0 0x7fddec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.377+0000 7fddfe7fc640 1 -- 172.21.15.104:0/3776848938 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddf80a9be0 con 0x7fde081f7b80 2024-05-08T04:21:22.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.378+0000 7fde0deeb640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fddec06b4d0 0x7fddec06d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde080aefe0 tx=0x7fde04009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:22.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.381+0000 7fddfe7fc640 1 -- 172.21.15.104:0/3776848938 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fddf804b020 con 0x7fde081f7b80 2024-05-08T04:21:22.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.554+0000 7fde1014f640 1 -- 172.21.15.104:0/3776848938 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde080af040 con 0x7fde081f7b80 2024-05-08T04:21:22.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.554+0000 7fddfe7fc640 1 -- 172.21.15.104:0/3776848938 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fddf8078af0 con 0x7fde081f7b80 2024-05-08T04:21:22.555 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:22.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.556+0000 7fde1014f640 1 -- 172.21.15.104:0/3776848938 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fddec06b4d0 msgr2=0x7fddec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.556+0000 7fde1014f640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fddec06b4d0 0x7fddec06d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde080aefe0 tx=0x7fde04009040 comp rx=0 tx=0).stop 2024-05-08T04:21:22.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.556+0000 7fde1014f640 1 -- 172.21.15.104:0/3776848938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde081f7b80 msgr2=0x7fde080b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.556+0000 7fde1014f640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde081f7b80 0x7fde080b41c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fddf800c1f0 tx=0x7fddf80019c0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.556+0000 7fde1014f640 1 -- 172.21.15.104:0/3776848938 shutdown_connections 2024-05-08T04:21:22.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.556+0000 7fde1014f640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fddec06b4d0 0x7fddec06d990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.556+0000 7fde1014f640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde080adcf0 0x7fde081f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.556+0000 7fde1014f640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde081f7b80 0x7fde080b41c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.556+0000 7fde1014f640 1 --2- 172.21.15.104:0/3776848938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fddf4004390 0x7fde081f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.556+0000 7fde1014f640 1 -- 172.21.15.104:0/3776848938 >> 172.21.15.104:0/3776848938 conn(0x7fde080b13f0 msgr2=0x7fde080b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:22.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.556+0000 7fde1014f640 1 -- 172.21.15.104:0/3776848938 shutdown_connections 2024-05-08T04:21:22.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.556+0000 7fde1014f640 1 -- 172.21.15.104:0/3776848938 wait complete. 2024-05-08T04:21:22.568 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:22.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.668+0000 7f3d0d23a640 1 Processor -- start 2024-05-08T04:21:22.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.668+0000 7f3d0d23a640 1 -- start start 2024-05-08T04:21:22.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.669+0000 7f3d0d23a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d0806ab60 0x7f3d08070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.669+0000 7f3d0d23a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d080d0450 con 0x7f3d0815de30 2024-05-08T04:21:22.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.669+0000 7f3d0d23a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d08072ab0 con 0x7f3d080cff50 2024-05-08T04:21:22.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.669+0000 7f3d0d23a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08161630 con 0x7f3d0806ab60 2024-05-08T04:21:22.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.669+0000 7f3d0759e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f3d0815de30 0x7f3d08161ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53228/0 (socket says 172.21.15.104:53228) 2024-05-08T04:21:22.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.669+0000 7f3d0759e640 1 -- 172.21.15.104:0/1610073581 learned_addr learned my addr 172.21.15.104:0/1610073581 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:22.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d06d9d640 1 --2- 172.21.15.104:0/1610073581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d0806ab60 0x7f3d08070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735603850 0 0) 0x7f3d080d0450 con 0x7f3d0815de30 2024-05-08T04:21:22.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf4003520 con 0x7f3d0815de30 2024-05-08T04:21:22.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727100994 0 0) 0x7f3d08072ab0 con 0x7f3d080cff50 2024-05-08T04:21:22.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d080d0450 con 0x7f3d080cff50 2024-05-08T04:21:22.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1551551293 0 0) 0x7f3cf4003520 con 0x7f3d0815de30 2024-05-08T04:21:22.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d0806ab60 msgr2=0x7f3d08070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 --2- 172.21.15.104:0/1610073581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d0806ab60 0x7f3d08070820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 >> v1:172.21.15.183:6789/0 conn(0x7f3d080cff50 legacy=0x7f3d0806af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d08072d90 con 0x7f3d0815de30 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f3d000019f0 con 0x7f3d0815de30 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d06d9d640 1 --2- 172.21.15.104:0/1610073581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d0806ab60 0x7f3d08070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 >> v1:172.21.15.104:6789/0 conn(0x7f3d0815de30 legacy=0x7f3d08161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 --2- 172.21.15.104:0/1610073581 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4003b70 0x7f3cf4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 --2- 172.21.15.104:0/1610073581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d0806ab60 0x7f3cf4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 --2- 172.21.15.104:0/1610073581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf4004d40 0x7f3cf40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08161630 con 0x7f3cf4004d40 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf400bad0 con 0x7f3cf4003b70 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf400bcd0 con 0x7f3d0806ab60 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d0759e640 1 --2- 172.21.15.104:0/1610073581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf4004d40 0x7f3cf40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d06d9d640 1 --2- 172.21.15.104:0/1610073581 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4003b70 0x7f3cf4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d0659c640 1 --2- 172.21.15.104:0/1610073581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d0806ab60 0x7f3cf4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d0759e640 1 -- 172.21.15.104:0/1610073581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d0806ab60 msgr2=0x7f3cf4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d0759e640 1 --2- 172.21.15.104:0/1610073581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d0806ab60 0x7f3cf4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d0759e640 1 -- 172.21.15.104:0/1610073581 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4003b70 msgr2=0x7f3cf4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d0759e640 1 --2- 172.21.15.104:0/1610073581 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4003b70 0x7f3cf4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.670+0000 7f3d0759e640 1 -- 172.21.15.104:0/1610073581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf4003520 con 0x7f3cf4004d40 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.671+0000 7f3d0759e640 1 --2- 172.21.15.104:0/1610073581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf4004d40 0x7f3cf40051c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000a720 tx=0x7f3cf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5715784128f332c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.671+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000a370 con 0x7f3cf4004d40 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.671+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0002f070 con 0x7f3cf4004d40 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.671+0000 7f3d05d9b640 1 -- 172.21.15.104:0/1610073581 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0002bb90 con 0x7f3cf4004d40 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.672+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1610073581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf4004d40 msgr2=0x7f3cf40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.672+0000 7f3d0d23a640 1 --2- 172.21.15.104:0/1610073581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cf4004d40 0x7f3cf40051c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000a720 tx=0x7f3cf4005830 comp rx=0 tx=0).stop 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.672+0000 7f3d0759e640 1 -- 172.21.15.104:0/1610073581 reap_dead start 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.672+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1610073581 shutdown_connections 2024-05-08T04:21:22.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.672+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1610073581 >> 172.21.15.104:0/1610073581 conn(0x7f3d080b23e0 msgr2=0x7f3d080b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:22.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.672+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1610073581 shutdown_connections 2024-05-08T04:21:22.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.672+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1610073581 wait complete. 2024-05-08T04:21:22.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.673+0000 7f3d0d23a640 1 Processor -- start 2024-05-08T04:21:22.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.673+0000 7f3d0d23a640 1 -- start start 2024-05-08T04:21:22.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0d23a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4004d40 0x7f3d0815af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0d23a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d08155eb0 0x7f3d080cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0d23a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d080cb1d0 0x7f3d08143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0d23a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08070820 con 0x7f3d08155eb0 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0d23a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08070370 con 0x7f3cf4004d40 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0d23a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d080709a0 con 0x7f3d080cb1d0 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d08155eb0 0x7f3d080cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d06d9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4004d40 0x7f3d0815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d06d9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4004d40 0x7f3d0815af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:53334/0 (socket says 172.21.15.104:53334) 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d08155eb0 0x7f3d080cac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34124/0 (socket says 172.21.15.104:34124) 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d06d9d640 1 -- 172.21.15.104:0/1833337683 learned_addr learned my addr 172.21.15.104:0/1833337683 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0759e640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d080cb1d0 0x7f3d08143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0659c640 1 -- 172.21.15.104:0/1833337683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d080cb1d0 msgr2=0x7f3d08143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0659c640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d080cb1d0 0x7f3d08143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0659c640 1 -- 172.21.15.104:0/1833337683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4004d40 msgr2=0x7f3d0815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0659c640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4004d40 0x7f3d0815af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0659c640 1 -- 172.21.15.104:0/1833337683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d081f7c90 con 0x7f3d08155eb0 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d06d9d640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4004d40 0x7f3d0815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.674+0000 7f3d0659c640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d08155eb0 0x7f3d080cac90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000f7a0 tx=0x7f3cf000fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.675+0000 7f3cff7fe640 1 -- 172.21.15.104:0/1833337683 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf001a070 con 0x7f3d08155eb0 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.675+0000 7f3cff7fe640 1 -- 172.21.15.104:0/1833337683 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf000fe50 con 0x7f3d08155eb0 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.675+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1833337683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d081f7f70 con 0x7f3d08155eb0 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.675+0000 7f3cff7fe640 1 -- 172.21.15.104:0/1833337683 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0007050 con 0x7f3d08155eb0 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.675+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1833337683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d081f8530 con 0x7f3d08155eb0 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.676+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1833337683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d08075010 con 0x7f3d08155eb0 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.676+0000 7f3cff7fe640 1 -- 172.21.15.104:0/1833337683 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3cf001d070 con 0x7f3d08155eb0 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.677+0000 7f3cff7fe640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3ce806b4d0 0x7f3ce806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.677+0000 7f3cff7fe640 1 -- 172.21.15.104:0/1833337683 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cf00899c0 con 0x7f3d08155eb0 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.677+0000 7f3d06d9d640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3ce806b4d0 0x7f3ce806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.677+0000 7f3d06d9d640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3ce806b4d0 0x7f3ce806d990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8014470 tx=0x7f3cf8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:22.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.681+0000 7f3cff7fe640 1 -- 172.21.15.104:0/1833337683 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3cf008be20 con 0x7f3d08155eb0 2024-05-08T04:21:22.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.853+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1833337683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d080afe20 con 0x7f3d08155eb0 2024-05-08T04:21:22.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.853+0000 7f3cff7fe640 1 -- 172.21.15.104:0/1833337683 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3cf005e030 con 0x7f3d08155eb0 2024-05-08T04:21:22.854 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:22.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.855+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1833337683 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3ce806b4d0 msgr2=0x7f3ce806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.855+0000 7f3d0d23a640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3ce806b4d0 0x7f3ce806d990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8014470 tx=0x7f3cf8009190 comp rx=0 tx=0).stop 2024-05-08T04:21:22.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.855+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1833337683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d08155eb0 msgr2=0x7f3d080cac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.855+0000 7f3d0d23a640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d08155eb0 0x7f3d080cac90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000f7a0 tx=0x7f3cf000fc60 comp rx=0 tx=0).stop 2024-05-08T04:21:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.855+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1833337683 shutdown_connections 2024-05-08T04:21:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.855+0000 7f3d0d23a640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3ce806b4d0 0x7f3ce806d990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.855+0000 7f3d0d23a640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d080cb1d0 0x7f3d08143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.855+0000 7f3d0d23a640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d08155eb0 0x7f3d080cac90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.855+0000 7f3d0d23a640 1 --2- 172.21.15.104:0/1833337683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf4004d40 0x7f3d0815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.855+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1833337683 >> 172.21.15.104:0/1833337683 conn(0x7f3d080b23e0 msgr2=0x7f3d0815ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.855+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1833337683 shutdown_connections 2024-05-08T04:21:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.855+0000 7f3d0d23a640 1 -- 172.21.15.104:0/1833337683 wait complete. 2024-05-08T04:21:22.867 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:22.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.967+0000 7f345f530640 1 Processor -- start 2024-05-08T04:21:22.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.967+0000 7f345f530640 1 -- start start 2024-05-08T04:21:22.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.968+0000 7f345f530640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345815edf0 0x7f34580b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.968+0000 7f345f530640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3458157ac0 0x7f3458157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.968+0000 7f345f530640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34580d15c0 con 0x7f3458070c70 2024-05-08T04:21:22.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.968+0000 7f345f530640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345806bc70 con 0x7f3458157ac0 2024-05-08T04:21:22.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.968+0000 7f345f530640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345815f550 con 0x7f345815edf0 2024-05-08T04:21:22.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.968+0000 7f345cacb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345815edf0 0x7f34580b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.968+0000 7f345dacd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3458157ac0 0x7f3458157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.968+0000 7f345cacb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345815edf0 0x7f34580b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:56290/0 (socket says 172.21.15.104:56290) 2024-05-08T04:21:22.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.968+0000 7f345d2cc640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f3458070c70 0x7f3458071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:35234/0 (socket says 172.21.15.104:35234) 2024-05-08T04:21:22.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.968+0000 7f345dacd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3458157ac0 0x7f3458157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:53336/0 (socket says 172.21.15.104:53336) 2024-05-08T04:21:22.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.968+0000 7f345cacb640 1 -- 172.21.15.104:0/3099816953 learned_addr learned my addr 172.21.15.104:0/3099816953 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:22.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.969+0000 7f3457fff640 1 -- 172.21.15.104:0/3099816953 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229637033 0 0) 0x7f34580d15c0 con 0x7f3458070c70 2024-05-08T04:21:22.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.969+0000 7f3457fff640 1 -- 172.21.15.104:0/3099816953 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3440003520 con 0x7f3458070c70 2024-05-08T04:21:22.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.969+0000 7f345cacb640 1 -- 172.21.15.104:0/3099816953 >> v2:172.21.15.183:3300/0 conn(0x7f3458157ac0 msgr2=0x7f3458157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:22.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.969+0000 7f345cacb640 1 --2- 172.21.15.104:0/3099816953 >> v2:172.21.15.183:3300/0 conn(0x7f3458157ac0 0x7f3458157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.969+0000 7f345cacb640 1 -- 172.21.15.104:0/3099816953 >> v1:172.21.15.183:6789/0 conn(0x7f3458070c70 legacy=0x7f3458071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.969+0000 7f345cacb640 1 -- 172.21.15.104:0/3099816953 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345815f830 con 0x7f345815edf0 2024-05-08T04:21:22.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.969+0000 7f345dacd640 1 --2- 172.21.15.104:0/3099816953 >> v2:172.21.15.183:3300/0 conn(0x7f3458157ac0 0x7f3458157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:22.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.969+0000 7f345cacb640 1 --2- 172.21.15.104:0/3099816953 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345815edf0 0x7f34580b52a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f344c009870 tx=0x7f344c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c612ed63f0f62692 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:22.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.970+0000 7f3457fff640 1 -- 172.21.15.104:0/3099816953 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c037070 con 0x7f345815edf0 2024-05-08T04:21:22.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.970+0000 7f3457fff640 1 -- 172.21.15.104:0/3099816953 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c032440 con 0x7f345815edf0 2024-05-08T04:21:22.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.970+0000 7f3457fff640 1 -- 172.21.15.104:0/3099816953 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c0327f0 con 0x7f345815edf0 2024-05-08T04:21:22.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.970+0000 7f345f530640 1 -- 172.21.15.104:0/3099816953 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345815edf0 msgr2=0x7f34580b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.970+0000 7f345f530640 1 --2- 172.21.15.104:0/3099816953 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345815edf0 0x7f34580b52a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f344c009870 tx=0x7f344c02a250 comp rx=0 tx=0).stop 2024-05-08T04:21:22.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.970+0000 7f345f530640 1 -- 172.21.15.104:0/3099816953 shutdown_connections 2024-05-08T04:21:22.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.970+0000 7f345f530640 1 --2- 172.21.15.104:0/3099816953 >> v2:172.21.15.183:3300/0 conn(0x7f3458157ac0 0x7f3458157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.970+0000 7f345f530640 1 --2- 172.21.15.104:0/3099816953 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345815edf0 0x7f34580b52a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.970+0000 7f345f530640 1 -- 172.21.15.104:0/3099816953 >> 172.21.15.104:0/3099816953 conn(0x7f34580b3450 msgr2=0x7f34580b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:22.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.970+0000 7f345f530640 1 -- 172.21.15.104:0/3099816953 shutdown_connections 2024-05-08T04:21:22.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.970+0000 7f345f530640 1 -- 172.21.15.104:0/3099816953 wait complete. 2024-05-08T04:21:22.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.971+0000 7f345f530640 1 Processor -- start 2024-05-08T04:21:22.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.971+0000 7f345f530640 1 -- start start 2024-05-08T04:21:22.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345f530640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3458070c70 0x7f34580cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345f530640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3458157ac0 0x7f3458149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345f530640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345815edf0 0x7f34581f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345f530640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34580b57e0 con 0x7f3458157ac0 2024-05-08T04:21:22.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345f530640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34580b5b80 con 0x7f3458070c70 2024-05-08T04:21:22.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345f530640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34580b5960 con 0x7f345815edf0 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345cacb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3458157ac0 0x7f3458149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345cacb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3458157ac0 0x7f3458149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34132/0 (socket says 172.21.15.104:34132) 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345cacb640 1 -- 172.21.15.104:0/489527319 learned_addr learned my addr 172.21.15.104:0/489527319 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345dacd640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345815edf0 0x7f34581f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345d2cc640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3458070c70 0x7f34580cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345cacb640 1 -- 172.21.15.104:0/489527319 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345815edf0 msgr2=0x7f34581f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345cacb640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345815edf0 0x7f34581f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345cacb640 1 -- 172.21.15.104:0/489527319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3458070c70 msgr2=0x7f34580cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345cacb640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3458070c70 0x7f34580cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345cacb640 1 -- 172.21.15.104:0/489527319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3458161900 con 0x7f3458157ac0 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.972+0000 7f345d2cc640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3458070c70 0x7f34580cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.973+0000 7f345cacb640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3458157ac0 0x7f3458149190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f344c009870 tx=0x7f344c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.973+0000 7f3455ffb640 1 -- 172.21.15.104:0/489527319 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c041070 con 0x7f3458157ac0 2024-05-08T04:21:22.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.973+0000 7f3455ffb640 1 -- 172.21.15.104:0/489527319 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c032e50 con 0x7f3458157ac0 2024-05-08T04:21:22.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.973+0000 7f345f530640 1 -- 172.21.15.104:0/489527319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3458161be0 con 0x7f3458157ac0 2024-05-08T04:21:22.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.973+0000 7f3455ffb640 1 -- 172.21.15.104:0/489527319 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c037040 con 0x7f3458157ac0 2024-05-08T04:21:22.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.973+0000 7f345f530640 1 -- 172.21.15.104:0/489527319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34581621a0 con 0x7f3458157ac0 2024-05-08T04:21:22.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.974+0000 7f345f530640 1 -- 172.21.15.104:0/489527319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3458075010 con 0x7f3458157ac0 2024-05-08T04:21:22.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.974+0000 7f3455ffb640 1 -- 172.21.15.104:0/489527319 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f344c044070 con 0x7f3458157ac0 2024-05-08T04:21:22.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.975+0000 7f3455ffb640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f344406b4d0 0x7f344406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:22.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.975+0000 7f3455ffb640 1 -- 172.21.15.104:0/489527319 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f344c0aab60 con 0x7f3458157ac0 2024-05-08T04:21:22.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.975+0000 7f345d2cc640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f344406b4d0 0x7f344406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:22.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.975+0000 7f345d2cc640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f344406b4d0 0x7f344406d990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3458157f60 tx=0x7f3448009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:22.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:22.979+0000 7f3455ffb640 1 -- 172.21.15.104:0/489527319 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f344c0799e0 con 0x7f3458157ac0 2024-05-08T04:21:23.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.147+0000 7f345f530640 1 -- 172.21.15.104:0/489527319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3458071a50 con 0x7f3458157ac0 2024-05-08T04:21:23.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.148+0000 7f3455ffb640 1 -- 172.21.15.104:0/489527319 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f344c0792e0 con 0x7f3458157ac0 2024-05-08T04:21:23.149 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:23.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.150+0000 7f345f530640 1 -- 172.21.15.104:0/489527319 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f344406b4d0 msgr2=0x7f344406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.150+0000 7f345f530640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f344406b4d0 0x7f344406d990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3458157f60 tx=0x7f3448009040 comp rx=0 tx=0).stop 2024-05-08T04:21:23.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.150+0000 7f345f530640 1 -- 172.21.15.104:0/489527319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3458157ac0 msgr2=0x7f3458149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.150+0000 7f345f530640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3458157ac0 0x7f3458149190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f344c009870 tx=0x7f344c0046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.150+0000 7f345f530640 1 -- 172.21.15.104:0/489527319 shutdown_connections 2024-05-08T04:21:23.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.150+0000 7f345f530640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f344406b4d0 0x7f344406d990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.150+0000 7f345f530640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345815edf0 0x7f34581f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.150+0000 7f345f530640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3458157ac0 0x7f3458149190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.150+0000 7f345f530640 1 --2- 172.21.15.104:0/489527319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3458070c70 0x7f34580cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.150+0000 7f345f530640 1 -- 172.21.15.104:0/489527319 >> 172.21.15.104:0/489527319 conn(0x7f34580b3450 msgr2=0x7f345815bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.150+0000 7f345f530640 1 -- 172.21.15.104:0/489527319 shutdown_connections 2024-05-08T04:21:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.150+0000 7f345f530640 1 -- 172.21.15.104:0/489527319 wait complete. 2024-05-08T04:21:23.162 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:21:23.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.260+0000 7fa21b342640 1 Processor -- start 2024-05-08T04:21:23.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.260+0000 7fa21b342640 1 -- start start 2024-05-08T04:21:23.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa21b342640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa2140cd370 0x7fa2140cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa21b342640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa21409a150 0x7fa2140b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa21b342640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2140cfb70 con 0x7fa2140cf600 2024-05-08T04:21:23.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa21b342640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2140d0860 con 0x7fa2140cd370 2024-05-08T04:21:23.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa21b342640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2140cff30 con 0x7fa21409a150 2024-05-08T04:21:23.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa2190de640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa2140cd370 0x7fa2140cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa2190de640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa2140cd370 0x7fa2140cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34138/0 (socket says 172.21.15.104:34138) 2024-05-08T04:21:23.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa2190de640 1 -- 172.21.15.104:0/1372183839 learned_addr learned my addr 172.21.15.104:0/1372183839 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:23.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa2190de640 1 -- 172.21.15.104:0/1372183839 >> v2:172.21.15.183:3300/0 conn(0x7fa21409a150 msgr2=0x7fa2140b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:23.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa2198df640 1 --2- 172.21.15.104:0/1372183839 >> v2:172.21.15.183:3300/0 conn(0x7fa21409a150 0x7fa2140b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa2190de640 1 --2- 172.21.15.104:0/1372183839 >> v2:172.21.15.183:3300/0 conn(0x7fa21409a150 0x7fa2140b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa2190de640 1 -- 172.21.15.104:0/1372183839 >> v1:172.21.15.183:6789/0 conn(0x7fa2140cf600 legacy=0x7fa214099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:23.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa2190de640 1 -- 172.21.15.104:0/1372183839 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2140d0210 con 0x7fa2140cd370 2024-05-08T04:21:23.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.261+0000 7fa2198df640 1 --2- 172.21.15.104:0/1372183839 >> v2:172.21.15.183:3300/0 conn(0x7fa21409a150 0x7fa2140b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:23.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.262+0000 7fa2190de640 1 --2- 172.21.15.104:0/1372183839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2140cd370 0x7fa2140cc4a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa2140cf2b0 tx=0x7fa21002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19a3f1344dff981 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:23.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.262+0000 7fa20bfff640 1 -- 172.21.15.104:0/1372183839 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210037070 con 0x7fa2140cd370 2024-05-08T04:21:23.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.262+0000 7fa20bfff640 1 -- 172.21.15.104:0/1372183839 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21002ae20 con 0x7fa2140cd370 2024-05-08T04:21:23.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.262+0000 7fa20bfff640 1 -- 172.21.15.104:0/1372183839 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210032660 con 0x7fa2140cd370 2024-05-08T04:21:23.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.263+0000 7fa21b342640 1 -- 172.21.15.104:0/1372183839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2140cd370 msgr2=0x7fa2140cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.263+0000 7fa21b342640 1 --2- 172.21.15.104:0/1372183839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2140cd370 0x7fa2140cc4a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa2140cf2b0 tx=0x7fa21002a110 comp rx=0 tx=0).stop 2024-05-08T04:21:23.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.263+0000 7fa21b342640 1 -- 172.21.15.104:0/1372183839 shutdown_connections 2024-05-08T04:21:23.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.263+0000 7fa21b342640 1 --2- 172.21.15.104:0/1372183839 >> v2:172.21.15.183:3300/0 conn(0x7fa21409a150 0x7fa2140b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.263+0000 7fa21b342640 1 --2- 172.21.15.104:0/1372183839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2140cd370 0x7fa2140cc4a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.263+0000 7fa21b342640 1 -- 172.21.15.104:0/1372183839 >> 172.21.15.104:0/1372183839 conn(0x7fa2140b3310 msgr2=0x7fa2140b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:23.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.263+0000 7fa21b342640 1 -- 172.21.15.104:0/1372183839 shutdown_connections 2024-05-08T04:21:23.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.263+0000 7fa21b342640 1 -- 172.21.15.104:0/1372183839 wait complete. 2024-05-08T04:21:23.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.264+0000 7fa21b342640 1 Processor -- start 2024-05-08T04:21:23.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.264+0000 7fa21b342640 1 -- start start 2024-05-08T04:21:23.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.264+0000 7fa21b342640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa21409a150 0x7fa2141e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.264+0000 7fa21b342640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2140cd370 0x7fa2140c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.264+0000 7fa21b342640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2140cf600 0x7fa21415ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.264+0000 7fa21b342640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2140b2a30 con 0x7fa2140cd370 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.264+0000 7fa21b342640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2140cd750 con 0x7fa2140cf600 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.264+0000 7fa21b342640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2140b2bb0 con 0x7fa21409a150 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa2188dd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2140cd370 0x7fa2140c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa2188dd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2140cd370 0x7fa2140c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34152/0 (socket says 172.21.15.104:34152) 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa2188dd640 1 -- 172.21.15.104:0/3246129063 learned_addr learned my addr 172.21.15.104:0/3246129063 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa2190de640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa21409a150 0x7fa2141e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa2198df640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2140cf600 0x7fa21415ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa2188dd640 1 -- 172.21.15.104:0/3246129063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa21409a150 msgr2=0x7fa2141e73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa2188dd640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa21409a150 0x7fa2141e73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa2188dd640 1 -- 172.21.15.104:0/3246129063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2140cf600 msgr2=0x7fa21415ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa2188dd640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2140cf600 0x7fa21415ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa2188dd640 1 -- 172.21.15.104:0/3246129063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2140c6640 con 0x7fa2140cd370 2024-05-08T04:21:23.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa2188dd640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2140cd370 0x7fa2140c5350 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa20400c460 tx=0x7fa20400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:23.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa209ffb640 1 -- 172.21.15.104:0/3246129063 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204016020 con 0x7fa2140cd370 2024-05-08T04:21:23.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa209ffb640 1 -- 172.21.15.104:0/3246129063 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa204012870 con 0x7fa2140cd370 2024-05-08T04:21:23.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa209ffb640 1 -- 172.21.15.104:0/3246129063 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204012c60 con 0x7fa2140cd370 2024-05-08T04:21:23.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa21b342640 1 -- 172.21.15.104:0/3246129063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2140c5ac0 con 0x7fa2140cd370 2024-05-08T04:21:23.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.265+0000 7fa21b342640 1 -- 172.21.15.104:0/3246129063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2140c6080 con 0x7fa2140cd370 2024-05-08T04:21:23.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.266+0000 7fa21b342640 1 -- 172.21.15.104:0/3246129063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa214075010 con 0x7fa2140cd370 2024-05-08T04:21:23.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.267+0000 7fa209ffb640 1 -- 172.21.15.104:0/3246129063 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa204019020 con 0x7fa2140cd370 2024-05-08T04:21:23.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.267+0000 7fa209ffb640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa1f806b500 0x7fa1f806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.267+0000 7fa209ffb640 1 -- 172.21.15.104:0/3246129063 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa20408a210 con 0x7fa2140cd370 2024-05-08T04:21:23.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.267+0000 7fa2190de640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa1f806b500 0x7fa1f806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.267+0000 7fa2190de640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa1f806b500 0x7fa1f806d9c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa210034000 tx=0x7fa21002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:23.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.271+0000 7fa209ffb640 1 -- 172.21.15.104:0/3246129063 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa204020020 con 0x7fa2140cd370 2024-05-08T04:21:23.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.477+0000 7fa21b342640 1 -- 172.21.15.104:0/3246129063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2140ce080 con 0x7fa2140cd370 2024-05-08T04:21:23.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.478+0000 7fa209ffb640 1 -- 172.21.15.104:0/3246129063 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7fa2040182c0 con 0x7fa2140cd370 2024-05-08T04:21:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:23.479 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/446112297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":446112297},{"type":"v1","addr":"172.21.15.183:6834","nonce":446112297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/702726775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":702726775},{"type":"v1","addr":"172.21.15.183:6835","nonce":702726775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/1820805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1820805788},{"type":"v1","addr":"172.21.15.104:6836","nonce":1820805788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:21:10.133307+0000","modified":"2024-05-08T04:21:12.575912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/610189872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":610189872},{"type":"v1","addr":"172.21.15.104:6837","nonce":610189872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T04:21:23.480 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-05-08T04:21:23.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.480+0000 7fa21b342640 1 -- 172.21.15.104:0/3246129063 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa1f806b500 msgr2=0x7fa1f806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.480+0000 7fa21b342640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa1f806b500 0x7fa1f806d9c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa210034000 tx=0x7fa21002e000 comp rx=0 tx=0).stop 2024-05-08T04:21:23.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.480+0000 7fa21b342640 1 -- 172.21.15.104:0/3246129063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2140cd370 msgr2=0x7fa2140c5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.480+0000 7fa21b342640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2140cd370 0x7fa2140c5350 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa20400c460 tx=0x7fa20400c920 comp rx=0 tx=0).stop 2024-05-08T04:21:23.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.480+0000 7fa21b342640 1 -- 172.21.15.104:0/3246129063 shutdown_connections 2024-05-08T04:21:23.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.480+0000 7fa21b342640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa1f806b500 0x7fa1f806d9c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.480+0000 7fa21b342640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2140cf600 0x7fa21415ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.480+0000 7fa21b342640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2140cd370 0x7fa2140c5350 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.480+0000 7fa21b342640 1 --2- 172.21.15.104:0/3246129063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa21409a150 0x7fa2141e73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.480+0000 7fa21b342640 1 -- 172.21.15.104:0/3246129063 >> 172.21.15.104:0/3246129063 conn(0x7fa2140b3310 msgr2=0x7fa214099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:23.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.480+0000 7fa21b342640 1 -- 172.21.15.104:0/3246129063 shutdown_connections 2024-05-08T04:21:23.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.480+0000 7fa21b342640 1 -- 172.21.15.104:0/3246129063 wait complete. 2024-05-08T04:21:23.493 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:23.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.590+0000 7fdca3134640 1 Processor -- start 2024-05-08T04:21:23.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.590+0000 7fdca3134640 1 -- start start 2024-05-08T04:21:23.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.591+0000 7fdca3134640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdc9c15ebf0 0x7fdc9c166830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.591+0000 7fdca3134640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9c15d420 con 0x7fdc9c070c70 2024-05-08T04:21:23.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.591+0000 7fdca3134640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9c0d0e20 con 0x7fdc9c0d0970 2024-05-08T04:21:23.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.591+0000 7fdca3134640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc9c0d16a0 con 0x7fdc9c15ebf0 2024-05-08T04:21:23.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.591+0000 7fdca0ed0640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fdc9c070c70 0x7fdc9c071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53232/0 (socket says 172.21.15.104:53232) 2024-05-08T04:21:23.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.591+0000 7fdca0ed0640 1 -- 172.21.15.104:0/2172664030 learned_addr learned my addr 172.21.15.104:0/2172664030 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:23.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.591+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931633472 0 0) 0x7fdc9c15d420 con 0x7fdc9c070c70 2024-05-08T04:21:23.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.591+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc88003520 con 0x7fdc9c070c70 2024-05-08T04:21:23.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.591+0000 7fdca16d1640 1 --2- 172.21.15.104:0/2172664030 >> v2:172.21.15.183:3300/0 conn(0x7fdc9c15ebf0 0x7fdc9c166830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3830785757 0 0) 0x7fdc88003520 con 0x7fdc9c070c70 2024-05-08T04:21:23.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 >> v2:172.21.15.183:3300/0 conn(0x7fdc9c15ebf0 msgr2=0x7fdc9c166830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:23.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9b7fe640 1 --2- 172.21.15.104:0/2172664030 >> v2:172.21.15.183:3300/0 conn(0x7fdc9c15ebf0 0x7fdc9c166830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 >> v1:172.21.15.183:6789/0 conn(0x7fdc9c0d0970 legacy=0x7fdc9c15c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c0d10e0 con 0x7fdc9c070c70 2024-05-08T04:21:23.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fdc8c001690 con 0x7fdc9c070c70 2024-05-08T04:21:23.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 >> v1:172.21.15.104:6789/0 conn(0x7fdc9c070c70 legacy=0x7fdc9c071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9b7fe640 1 --2- 172.21.15.104:0/2172664030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc880039b0 0x7fdc88003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9b7fe640 1 --2- 172.21.15.104:0/2172664030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc88004800 0x7fdc88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9b7fe640 1 --2- 172.21.15.104:0/2172664030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc880051c0 0x7fdc8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c0d16a0 con 0x7fdc880051c0 2024-05-08T04:21:23.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8800c160 con 0x7fdc88004800 2024-05-08T04:21:23.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8800c360 con 0x7fdc880039b0 2024-05-08T04:21:23.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdca16d1640 1 --2- 172.21.15.104:0/2172664030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc880051c0 0x7fdc8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdca0ed0640 1 --2- 172.21.15.104:0/2172664030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc880039b0 0x7fdc88003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdc9bfff640 1 --2- 172.21.15.104:0/2172664030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc88004800 0x7fdc88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdca16d1640 1 -- 172.21.15.104:0/2172664030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc880039b0 msgr2=0x7fdc88003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:23.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdca16d1640 1 --2- 172.21.15.104:0/2172664030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc880039b0 0x7fdc88003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdca16d1640 1 -- 172.21.15.104:0/2172664030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc88004800 msgr2=0x7fdc88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:23.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdca16d1640 1 --2- 172.21.15.104:0/2172664030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc88004800 0x7fdc88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.592+0000 7fdca16d1640 1 -- 172.21.15.104:0/2172664030 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc88003520 con 0x7fdc880051c0 2024-05-08T04:21:23.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.593+0000 7fdca16d1640 1 -- 172.21.15.104:0/2172664030 reap_dead start 2024-05-08T04:21:23.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.593+0000 7fdca16d1640 1 --2- 172.21.15.104:0/2172664030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc880051c0 0x7fdc8800b9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009ac0 tx=0x7fdc88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cb9a3766c6ac3b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:23.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.593+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94009690 con 0x7fdc880051c0 2024-05-08T04:21:23.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.593+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc94004020 con 0x7fdc880051c0 2024-05-08T04:21:23.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.593+0000 7fdc9b7fe640 1 -- 172.21.15.104:0/2172664030 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940043d0 con 0x7fdc880051c0 2024-05-08T04:21:23.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.593+0000 7fdca3134640 1 -- 172.21.15.104:0/2172664030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc880051c0 msgr2=0x7fdc8800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.593+0000 7fdca3134640 1 --2- 172.21.15.104:0/2172664030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc880051c0 0x7fdc8800b9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009ac0 tx=0x7fdc88005830 comp rx=0 tx=0).stop 2024-05-08T04:21:23.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.593+0000 7fdca3134640 1 -- 172.21.15.104:0/2172664030 shutdown_connections 2024-05-08T04:21:23.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.593+0000 7fdca3134640 1 --2- 172.21.15.104:0/2172664030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc880051c0 0x7fdc8800b9c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.593+0000 7fdca3134640 1 -- 172.21.15.104:0/2172664030 >> 172.21.15.104:0/2172664030 conn(0x7fdc9c0b3450 msgr2=0x7fdc9c0b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:23.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.593+0000 7fdca3134640 1 -- 172.21.15.104:0/2172664030 shutdown_connections 2024-05-08T04:21:23.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.593+0000 7fdca3134640 1 -- 172.21.15.104:0/2172664030 wait complete. 2024-05-08T04:21:23.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.595+0000 7fdca3134640 1 Processor -- start 2024-05-08T04:21:23.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.595+0000 7fdca3134640 1 -- start start 2024-05-08T04:21:23.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.595+0000 7fdca3134640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc880051c0 0x7fdc9c1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.595+0000 7fdca3134640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc9c1f1020 0x7fdc9c1f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.595+0000 7fdca3134640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc9c155060 0x7fdc9c155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.595+0000 7fdca3134640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c071050 con 0x7fdc9c155060 2024-05-08T04:21:23.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca3134640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c15d6c0 con 0x7fdc9c1f1020 2024-05-08T04:21:23.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca3134640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c0711d0 con 0x7fdc880051c0 2024-05-08T04:21:23.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca16d1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc9c155060 0x7fdc9c155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca16d1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc9c155060 0x7fdc9c155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34160/0 (socket says 172.21.15.104:34160) 2024-05-08T04:21:23.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca16d1640 1 -- 172.21.15.104:0/3932546847 learned_addr learned my addr 172.21.15.104:0/3932546847 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:23.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdc9bfff640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc9c1f1020 0x7fdc9c1f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca0ed0640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc880051c0 0x7fdc9c1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca16d1640 1 -- 172.21.15.104:0/3932546847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc880051c0 msgr2=0x7fdc9c1481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca16d1640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc880051c0 0x7fdc9c1481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca16d1640 1 -- 172.21.15.104:0/3932546847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc9c1f1020 msgr2=0x7fdc9c1f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca16d1640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc9c1f1020 0x7fdc9c1f14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca16d1640 1 -- 172.21.15.104:0/3932546847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c1f1b00 con 0x7fdc9c155060 2024-05-08T04:21:23.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca0ed0640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc880051c0 0x7fdc9c1481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:23.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca16d1640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc9c155060 0x7fdc9c155510 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdc9402abe0 tx=0x7fdc94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:23.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdc997fa640 1 -- 172.21.15.104:0/3932546847 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94036040 con 0x7fdc9c155060 2024-05-08T04:21:23.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdc997fa640 1 -- 172.21.15.104:0/3932546847 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc94040070 con 0x7fdc9c155060 2024-05-08T04:21:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca3134640 1 -- 172.21.15.104:0/3932546847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9c1f1de0 con 0x7fdc9c155060 2024-05-08T04:21:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdc997fa640 1 -- 172.21.15.104:0/3932546847 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94003d90 con 0x7fdc9c155060 2024-05-08T04:21:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.596+0000 7fdca3134640 1 -- 172.21.15.104:0/3932546847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9c1f23a0 con 0x7fdc9c155060 2024-05-08T04:21:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.597+0000 7fdca3134640 1 -- 172.21.15.104:0/3932546847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9c075010 con 0x7fdc9c155060 2024-05-08T04:21:23.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.598+0000 7fdc997fa640 1 -- 172.21.15.104:0/3932546847 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdc94039070 con 0x7fdc9c155060 2024-05-08T04:21:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.598+0000 7fdc997fa640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc7c06b4d0 0x7fdc7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.598+0000 7fdc997fa640 1 -- 172.21.15.104:0/3932546847 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc940a9590 con 0x7fdc9c155060 2024-05-08T04:21:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.598+0000 7fdca0ed0640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc7c06b4d0 0x7fdc7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.598+0000 7fdca0ed0640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc7c06b4d0 0x7fdc7c06d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c1f4ba0 tx=0x7fdc8c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:23.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.602+0000 7fdc997fa640 1 -- 172.21.15.104:0/3932546847 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdc94049020 con 0x7fdc9c155060 2024-05-08T04:21:23.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.776+0000 7fdca3134640 1 -- 172.21.15.104:0/3932546847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc9c0b4180 con 0x7fdc9c155060 2024-05-08T04:21:23.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.777+0000 7fdc997fa640 1 -- 172.21.15.104:0/3932546847 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7fdc940784a0 con 0x7fdc9c155060 2024-05-08T04:21:23.778 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:23.779 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.779+0000 7fdca3134640 1 -- 172.21.15.104:0/3932546847 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc7c06b4d0 msgr2=0x7fdc7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.779+0000 7fdca3134640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc7c06b4d0 0x7fdc7c06d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c1f4ba0 tx=0x7fdc8c009040 comp rx=0 tx=0).stop 2024-05-08T04:21:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.779+0000 7fdca3134640 1 -- 172.21.15.104:0/3932546847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc9c155060 msgr2=0x7fdc9c155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.779+0000 7fdca3134640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc9c155060 0x7fdc9c155510 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdc9402abe0 tx=0x7fdc94004730 comp rx=0 tx=0).stop 2024-05-08T04:21:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.779+0000 7fdca3134640 1 -- 172.21.15.104:0/3932546847 shutdown_connections 2024-05-08T04:21:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.779+0000 7fdca3134640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc7c06b4d0 0x7fdc7c06d990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.779+0000 7fdca3134640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc9c1f1020 0x7fdc9c1f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.779+0000 7fdca3134640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc9c155060 0x7fdc9c155510 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.779+0000 7fdca3134640 1 --2- 172.21.15.104:0/3932546847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc880051c0 0x7fdc9c1481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.779+0000 7fdca3134640 1 -- 172.21.15.104:0/3932546847 >> 172.21.15.104:0/3932546847 conn(0x7fdc9c0b3450 msgr2=0x7fdc9c0b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.779+0000 7fdca3134640 1 -- 172.21.15.104:0/3932546847 shutdown_connections 2024-05-08T04:21:23.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.779+0000 7fdca3134640 1 -- 172.21.15.104:0/3932546847 wait complete. 2024-05-08T04:21:23.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:23.792 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:23.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.894+0000 7f382fd63640 1 Processor -- start 2024-05-08T04:21:23.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.894+0000 7f382fd63640 1 -- start start 2024-05-08T04:21:23.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382fd63640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38280d35c0 0x7f38280b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382fd63640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38280b9920 con 0x7f382815dad0 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382fd63640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38280d2520 con 0x7f38280b59c0 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382fd63640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38280b5e10 con 0x7f38280d35c0 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382daff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f382815dad0 0x7f38280d1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53248/0 (socket says 172.21.15.104:53248) 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382daff640 1 -- 172.21.15.104:0/1674640329 learned_addr learned my addr 172.21.15.104:0/1674640329 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382d2fe640 1 --2- 172.21.15.104:0/1674640329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38280d35c0 0x7f38280b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025625537 0 0) 0x7f38280b9920 con 0x7f382815dad0 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3814003520 con 0x7f382815dad0 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050018005 0 0) 0x7f38280d2520 con 0x7f38280b59c0 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38280b9920 con 0x7f38280b59c0 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 496921782 0 0) 0x7f3814003520 con 0x7f382815dad0 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38280d35c0 msgr2=0x7f38280b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 --2- 172.21.15.104:0/1674640329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38280d35c0 0x7f38280b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 >> v1:172.21.15.183:6789/0 conn(0x7f38280b59c0 legacy=0x7f38280b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38280d2800 con 0x7f382815dad0 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f38240019f0 con 0x7f382815dad0 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 >> v1:172.21.15.104:6789/0 conn(0x7f382815dad0 legacy=0x7f38280d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 --2- 172.21.15.104:0/1674640329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3814003b70 0x7f3814003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 --2- 172.21.15.104:0/1674640329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38280d35c0 0x7f3814004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 --2- 172.21.15.104:0/1674640329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3814004d40 0x7f38140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.895+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38280b5e10 con 0x7f3814003b70 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.896+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381400bb50 con 0x7f3814004d40 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.896+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381400bd50 con 0x7f38280d35c0 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.896+0000 7f382daff640 1 --2- 172.21.15.104:0/1674640329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3814003b70 0x7f3814003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.896+0000 7f382d2fe640 1 --2- 172.21.15.104:0/1674640329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38280d35c0 0x7f3814004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.896+0000 7f382e300640 1 --2- 172.21.15.104:0/1674640329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3814004d40 0x7f38140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.896+0000 7f382daff640 1 -- 172.21.15.104:0/1674640329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38280d35c0 msgr2=0x7f3814004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.896+0000 7f382daff640 1 --2- 172.21.15.104:0/1674640329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38280d35c0 0x7f3814004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.896+0000 7f382daff640 1 -- 172.21.15.104:0/1674640329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3814004d40 msgr2=0x7f38140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.896+0000 7f382daff640 1 --2- 172.21.15.104:0/1674640329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3814004d40 0x7f38140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.896+0000 7f382daff640 1 -- 172.21.15.104:0/1674640329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3814003520 con 0x7f3814003b70 2024-05-08T04:21:23.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.896+0000 7f382daff640 1 --2- 172.21.15.104:0/1674640329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3814003b70 0x7f3814003f70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f382400a710 tx=0x7f3814005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430173671c7a5c1a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:23.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.897+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382400a330 con 0x7f3814003b70 2024-05-08T04:21:23.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.897+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382402f070 con 0x7f3814003b70 2024-05-08T04:21:23.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.897+0000 7f382cafd640 1 -- 172.21.15.104:0/1674640329 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382402bb90 con 0x7f3814003b70 2024-05-08T04:21:23.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.897+0000 7f382fd63640 1 -- 172.21.15.104:0/1674640329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3814003b70 msgr2=0x7f3814003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.897+0000 7f382fd63640 1 --2- 172.21.15.104:0/1674640329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3814003b70 0x7f3814003f70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f382400a710 tx=0x7f3814005830 comp rx=0 tx=0).stop 2024-05-08T04:21:23.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.897+0000 7f382e300640 1 -- 172.21.15.104:0/1674640329 reap_dead start 2024-05-08T04:21:23.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.897+0000 7f382fd63640 1 -- 172.21.15.104:0/1674640329 shutdown_connections 2024-05-08T04:21:23.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.897+0000 7f382fd63640 1 -- 172.21.15.104:0/1674640329 >> 172.21.15.104:0/1674640329 conn(0x7f382806c650 msgr2=0x7f38280d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:23.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.897+0000 7f382fd63640 1 -- 172.21.15.104:0/1674640329 shutdown_connections 2024-05-08T04:21:23.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.897+0000 7f382fd63640 1 -- 172.21.15.104:0/1674640329 wait complete. 2024-05-08T04:21:23.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.898+0000 7f382fd63640 1 Processor -- start 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.898+0000 7f382fd63640 1 -- start start 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382fd63640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3814003b70 0x7f382815e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382fd63640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3828160db0 0x7f38280cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382fd63640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38281f3ba0 0x7f38281f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382fd63640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38280d30a0 con 0x7f3828160db0 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382fd63640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38280d2e00 con 0x7f38281f3ba0 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382fd63640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38280d2170 con 0x7f3814003b70 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382d2fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3828160db0 0x7f38280cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382d2fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3828160db0 0x7f38280cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34180/0 (socket says 172.21.15.104:34180) 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382d2fe640 1 -- 172.21.15.104:0/3959167009 learned_addr learned my addr 172.21.15.104:0/3959167009 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382d2fe640 1 -- 172.21.15.104:0/3959167009 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3814003b70 msgr2=0x7f382815e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382d2fe640 1 --2- 172.21.15.104:0/3959167009 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3814003b70 0x7f382815e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382d2fe640 1 -- 172.21.15.104:0/3959167009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38281f3ba0 msgr2=0x7f38281f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382d2fe640 1 --2- 172.21.15.104:0/3959167009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38281f3ba0 0x7f38281f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.899+0000 7f382d2fe640 1 -- 172.21.15.104:0/3959167009 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382815f210 con 0x7f3828160db0 2024-05-08T04:21:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.900+0000 7f382d2fe640 1 --2- 172.21.15.104:0/3959167009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3828160db0 0x7f38280cc330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f38180119d0 tx=0x7f3818011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.900+0000 7f381e7fc640 1 -- 172.21.15.104:0/3959167009 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800fad0 con 0x7f3828160db0 2024-05-08T04:21:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.900+0000 7f381e7fc640 1 -- 172.21.15.104:0/3959167009 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381800fc70 con 0x7f3828160db0 2024-05-08T04:21:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.900+0000 7f381e7fc640 1 -- 172.21.15.104:0/3959167009 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818014440 con 0x7f3828160db0 2024-05-08T04:21:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.900+0000 7f382fd63640 1 -- 172.21.15.104:0/3959167009 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3828155ab0 con 0x7f3828160db0 2024-05-08T04:21:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.900+0000 7f382fd63640 1 -- 172.21.15.104:0/3959167009 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382815ee90 con 0x7f3828160db0 2024-05-08T04:21:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.901+0000 7f382fd63640 1 -- 172.21.15.104:0/3959167009 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3828075010 con 0x7f3828160db0 2024-05-08T04:21:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.901+0000 7f381e7fc640 1 -- 172.21.15.104:0/3959167009 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3818012040 con 0x7f3828160db0 2024-05-08T04:21:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.901+0000 7f381e7fc640 1 --2- 172.21.15.104:0/3959167009 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f380c06b4d0 0x7f380c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.902+0000 7f381e7fc640 1 -- 172.21.15.104:0/3959167009 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f381808a840 con 0x7f3828160db0 2024-05-08T04:21:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.902+0000 7f382daff640 1 --2- 172.21.15.104:0/3959167009 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f380c06b4d0 0x7f380c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.902+0000 7f382daff640 1 --2- 172.21.15.104:0/3959167009 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f380c06b4d0 0x7f380c06d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f382400a710 tx=0x7f3824038040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:23.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:23.906+0000 7f381e7fc640 1 -- 172.21.15.104:0/3959167009 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3818019030 con 0x7f3828160db0 2024-05-08T04:21:24.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.076+0000 7f382fd63640 1 -- 172.21.15.104:0/3959167009 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f382815cc20 con 0x7f3828160db0 2024-05-08T04:21:24.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.076+0000 7f381e7fc640 1 -- 172.21.15.104:0/3959167009 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38180596c0 con 0x7f3828160db0 2024-05-08T04:21:24.078 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:24.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.078+0000 7f382fd63640 1 -- 172.21.15.104:0/3959167009 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f380c06b4d0 msgr2=0x7f380c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.078+0000 7f382fd63640 1 --2- 172.21.15.104:0/3959167009 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f380c06b4d0 0x7f380c06d990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f382400a710 tx=0x7f3824038040 comp rx=0 tx=0).stop 2024-05-08T04:21:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.078+0000 7f382fd63640 1 -- 172.21.15.104:0/3959167009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3828160db0 msgr2=0x7f38280cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.078+0000 7f382fd63640 1 --2- 172.21.15.104:0/3959167009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3828160db0 0x7f38280cc330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f38180119d0 tx=0x7f3818011e90 comp rx=0 tx=0).stop 2024-05-08T04:21:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.078+0000 7f382fd63640 1 -- 172.21.15.104:0/3959167009 shutdown_connections 2024-05-08T04:21:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.078+0000 7f382fd63640 1 --2- 172.21.15.104:0/3959167009 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f380c06b4d0 0x7f380c06d990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.078+0000 7f382fd63640 1 --2- 172.21.15.104:0/3959167009 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38281f3ba0 0x7f38281f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.078+0000 7f382fd63640 1 --2- 172.21.15.104:0/3959167009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3828160db0 0x7f38280cc330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.078+0000 7f382fd63640 1 --2- 172.21.15.104:0/3959167009 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3814003b70 0x7f382815e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.078+0000 7f382fd63640 1 -- 172.21.15.104:0/3959167009 >> 172.21.15.104:0/3959167009 conn(0x7f382806c650 msgr2=0x7f382815b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.078+0000 7f382fd63640 1 -- 172.21.15.104:0/3959167009 shutdown_connections 2024-05-08T04:21:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.078+0000 7f382fd63640 1 -- 172.21.15.104:0/3959167009 wait complete. 2024-05-08T04:21:24.090 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:24.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.191+0000 7fb896b29640 1 Processor -- start 2024-05-08T04:21:24.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.191+0000 7fb896b29640 1 -- start start 2024-05-08T04:21:24.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.192+0000 7fb896b29640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890099a40 0x7fb890099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.192+0000 7fb896b29640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8900cd940 con 0x7fb89015d490 2024-05-08T04:21:24.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.192+0000 7fb896b29640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8900cc8a0 con 0x7fb8900b2b80 2024-05-08T04:21:24.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.192+0000 7fb896b29640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89009a3e0 con 0x7fb890099a40 2024-05-08T04:21:24.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.192+0000 7fb8950c6640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb89015d490 0x7fb89015d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53256/0 (socket says 172.21.15.104:53256) 2024-05-08T04:21:24.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.192+0000 7fb8950c6640 1 -- 172.21.15.104:0/1981265187 learned_addr learned my addr 172.21.15.104:0/1981265187 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:24.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.192+0000 7fb88ffff640 1 --2- 172.21.15.104:0/1981265187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890099a40 0x7fb890099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.192+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951095762 0 0) 0x7fb8900cd940 con 0x7fb89015d490 2024-05-08T04:21:24.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.192+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb87c003520 con 0x7fb89015d490 2024-05-08T04:21:24.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2433026371 0 0) 0x7fb87c003520 con 0x7fb89015d490 2024-05-08T04:21:24.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890099a40 msgr2=0x7fb890099ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:24.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88f7fe640 1 --2- 172.21.15.104:0/1981265187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890099a40 0x7fb890099ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 >> v1:172.21.15.183:6789/0 conn(0x7fb8900b2b80 legacy=0x7fb89009a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8900ccb80 con 0x7fb89015d490 2024-05-08T04:21:24.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fb888001670 con 0x7fb89015d490 2024-05-08T04:21:24.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 >> v1:172.21.15.104:6789/0 conn(0x7fb89015d490 legacy=0x7fb89015d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88f7fe640 1 --2- 172.21.15.104:0/1981265187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb87c0039e0 0x7fb87c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88f7fe640 1 --2- 172.21.15.104:0/1981265187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890099a40 0x7fb87c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88f7fe640 1 --2- 172.21.15.104:0/1981265187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c004d40 0x7fb87c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c00bb00 con 0x7fb87c0039e0 2024-05-08T04:21:24.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c00bc80 con 0x7fb87c004d40 2024-05-08T04:21:24.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c00be80 con 0x7fb890099a40 2024-05-08T04:21:24.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb8948c5640 1 --2- 172.21.15.104:0/1981265187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb87c0039e0 0x7fb87c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb88ffff640 1 --2- 172.21.15.104:0/1981265187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890099a40 0x7fb87c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb8950c6640 1 --2- 172.21.15.104:0/1981265187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c004d40 0x7fb87c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb8948c5640 1 -- 172.21.15.104:0/1981265187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890099a40 msgr2=0x7fb87c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:24.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb8948c5640 1 --2- 172.21.15.104:0/1981265187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890099a40 0x7fb87c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb8948c5640 1 -- 172.21.15.104:0/1981265187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c004d40 msgr2=0x7fb87c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:24.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb8948c5640 1 --2- 172.21.15.104:0/1981265187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c004d40 0x7fb87c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb8948c5640 1 -- 172.21.15.104:0/1981265187 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c003520 con 0x7fb87c0039e0 2024-05-08T04:21:24.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.193+0000 7fb8950c6640 1 --2- 172.21.15.104:0/1981265187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c004d40 0x7fb87c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:24.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.194+0000 7fb8948c5640 1 --2- 172.21.15.104:0/1981265187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb87c0039e0 0x7fb87c003e00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb880001e20 tx=0x7fb87c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9697ac23252212a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:24.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.194+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880001a70 con 0x7fb87c0039e0 2024-05-08T04:21:24.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.194+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88002ae40 con 0x7fb87c0039e0 2024-05-08T04:21:24.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.194+0000 7fb88f7fe640 1 -- 172.21.15.104:0/1981265187 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880003bb0 con 0x7fb87c0039e0 2024-05-08T04:21:24.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.194+0000 7fb896b29640 1 -- 172.21.15.104:0/1981265187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb87c0039e0 msgr2=0x7fb87c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.194+0000 7fb896b29640 1 --2- 172.21.15.104:0/1981265187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb87c0039e0 0x7fb87c003e00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb880001e20 tx=0x7fb87c005830 comp rx=0 tx=0).stop 2024-05-08T04:21:24.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.194+0000 7fb8950c6640 1 -- 172.21.15.104:0/1981265187 reap_dead start 2024-05-08T04:21:24.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.194+0000 7fb896b29640 1 -- 172.21.15.104:0/1981265187 shutdown_connections 2024-05-08T04:21:24.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.194+0000 7fb896b29640 1 -- 172.21.15.104:0/1981265187 >> 172.21.15.104:0/1981265187 conn(0x7fb8900b3310 msgr2=0x7fb8900b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:24.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.195+0000 7fb896b29640 1 -- 172.21.15.104:0/1981265187 shutdown_connections 2024-05-08T04:21:24.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.195+0000 7fb896b29640 1 -- 172.21.15.104:0/1981265187 wait complete. 2024-05-08T04:21:24.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.196+0000 7fb896b29640 1 Processor -- start 2024-05-08T04:21:24.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.196+0000 7fb896b29640 1 -- start start 2024-05-08T04:21:24.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.196+0000 7fb896b29640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c0039e0 0x7fb8900b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb896b29640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890143360 0x7fb8901437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb896b29640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb890143d20 0x7fb8901f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb896b29640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89006cc80 con 0x7fb890143d20 2024-05-08T04:21:24.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb896b29640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900cd140 con 0x7fb87c0039e0 2024-05-08T04:21:24.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb896b29640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900cf830 con 0x7fb890143360 2024-05-08T04:21:24.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb8950c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb890143d20 0x7fb8901f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb8950c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb890143d20 0x7fb8901f2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34190/0 (socket says 172.21.15.104:34190) 2024-05-08T04:21:24.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb8950c6640 1 -- 172.21.15.104:0/855693316 learned_addr learned my addr 172.21.15.104:0/855693316 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:24.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb8948c5640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c0039e0 0x7fb8900b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb88ffff640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890143360 0x7fb8901437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb8950c6640 1 -- 172.21.15.104:0/855693316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890143360 msgr2=0x7fb8901437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb8950c6640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890143360 0x7fb8901437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb8950c6640 1 -- 172.21.15.104:0/855693316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c0039e0 msgr2=0x7fb8900b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb8950c6640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c0039e0 0x7fb8900b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb8950c6640 1 -- 172.21.15.104:0/855693316 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8901441a0 con 0x7fb890143d20 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb88ffff640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890143360 0x7fb8901437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb8950c6640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb890143d20 0x7fb8901f2d50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb888001970 tx=0x7fb88800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb88d7fa640 1 -- 172.21.15.104:0/855693316 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88800c5b0 con 0x7fb890143d20 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb88d7fa640 1 -- 172.21.15.104:0/855693316 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb888018070 con 0x7fb890143d20 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb88d7fa640 1 -- 172.21.15.104:0/855693316 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88800c990 con 0x7fb890143d20 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb896b29640 1 -- 172.21.15.104:0/855693316 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8900b6520 con 0x7fb890143d20 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.197+0000 7fb896b29640 1 -- 172.21.15.104:0/855693316 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8900b6ae0 con 0x7fb890143d20 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.198+0000 7fb896b29640 1 -- 172.21.15.104:0/855693316 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb890075010 con 0x7fb890143d20 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.199+0000 7fb88d7fa640 1 -- 172.21.15.104:0/855693316 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb88800cb30 con 0x7fb890143d20 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.199+0000 7fb88d7fa640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb87006b500 0x7fb87006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.199+0000 7fb8948c5640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb87006b500 0x7fb87006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.199+0000 7fb88d7fa640 1 -- 172.21.15.104:0/855693316 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8880899a0 con 0x7fb890143d20 2024-05-08T04:21:24.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.200+0000 7fb8948c5640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb87006b500 0x7fb87006d9c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb880032000 tx=0x7fb88002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:24.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.203+0000 7fb88d7fa640 1 -- 172.21.15.104:0/855693316 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8880588b0 con 0x7fb890143d20 2024-05-08T04:21:24.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.374+0000 7fb896b29640 1 -- 172.21.15.104:0/855693316 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb89009acf0 con 0x7fb890143d20 2024-05-08T04:21:24.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.374+0000 7fb88d7fa640 1 -- 172.21.15.104:0/855693316 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8880581b0 con 0x7fb890143d20 2024-05-08T04:21:24.376 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:24.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.376+0000 7fb896b29640 1 -- 172.21.15.104:0/855693316 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb87006b500 msgr2=0x7fb87006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.376+0000 7fb896b29640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb87006b500 0x7fb87006d9c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb880032000 tx=0x7fb88002e000 comp rx=0 tx=0).stop 2024-05-08T04:21:24.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.376+0000 7fb896b29640 1 -- 172.21.15.104:0/855693316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb890143d20 msgr2=0x7fb8901f2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.376+0000 7fb896b29640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb890143d20 0x7fb8901f2d50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb888001970 tx=0x7fb88800eb20 comp rx=0 tx=0).stop 2024-05-08T04:21:24.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.376+0000 7fb896b29640 1 -- 172.21.15.104:0/855693316 shutdown_connections 2024-05-08T04:21:24.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.376+0000 7fb896b29640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb87006b500 0x7fb87006d9c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.376+0000 7fb896b29640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb890143d20 0x7fb8901f2d50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.376+0000 7fb896b29640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb890143360 0x7fb8901437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.376+0000 7fb896b29640 1 --2- 172.21.15.104:0/855693316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb87c0039e0 0x7fb8900b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.376+0000 7fb896b29640 1 -- 172.21.15.104:0/855693316 >> 172.21.15.104:0/855693316 conn(0x7fb8900b3310 msgr2=0x7fb890161eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:24.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.377+0000 7fb896b29640 1 -- 172.21.15.104:0/855693316 shutdown_connections 2024-05-08T04:21:24.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.377+0000 7fb896b29640 1 -- 172.21.15.104:0/855693316 wait complete. 2024-05-08T04:21:24.389 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:24.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.490+0000 7f74d2ca3640 1 Processor -- start 2024-05-08T04:21:24.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.490+0000 7f74d2ca3640 1 -- start start 2024-05-08T04:21:24.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74d2ca3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f74cc099ea0 0x7f74cc15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74d2ca3640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74cc0cd940 con 0x7f74cc099a40 2024-05-08T04:21:24.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74d2ca3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74cc0cc8a0 con 0x7f74cc0b2b80 2024-05-08T04:21:24.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74d2ca3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74cc0ccb80 con 0x7f74cc099ea0 2024-05-08T04:21:24.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74cbfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f74cc099a40 0x7f74cc15d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53262/0 (socket says 172.21.15.104:53262) 2024-05-08T04:21:24.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74cbfff640 1 -- 172.21.15.104:0/1047753973 learned_addr learned my addr 172.21.15.104:0/1047753973 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:24.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74d1240640 1 --2- 172.21.15.104:0/1047753973 >> v2:172.21.15.183:3300/0 conn(0x7f74cc099ea0 0x7f74cc15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74cb7fe640 1 -- 172.21.15.104:0/1047753973 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604263721 0 0) 0x7f74cc0cd940 con 0x7f74cc099a40 2024-05-08T04:21:24.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74cb7fe640 1 -- 172.21.15.104:0/1047753973 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74bc003520 con 0x7f74cc099a40 2024-05-08T04:21:24.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74cb7fe640 1 -- 172.21.15.104:0/1047753973 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931348057 0 0) 0x7f74cc0cc8a0 con 0x7f74cc0b2b80 2024-05-08T04:21:24.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74cb7fe640 1 -- 172.21.15.104:0/1047753973 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74cc0cd940 con 0x7f74cc0b2b80 2024-05-08T04:21:24.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74cb7fe640 1 -- 172.21.15.104:0/1047753973 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 168364218 0 0) 0x7f74bc003520 con 0x7f74cc099a40 2024-05-08T04:21:24.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74d1240640 1 -- 172.21.15.104:0/1047753973 >> v1:172.21.15.183:6789/0 conn(0x7f74cc0b2b80 legacy=0x7f74cc09a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74d1240640 1 -- 172.21.15.104:0/1047753973 >> v1:172.21.15.104:6789/0 conn(0x7f74cc099a40 legacy=0x7f74cc15d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.491+0000 7f74d1240640 1 -- 172.21.15.104:0/1047753973 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc0cce60 con 0x7f74cc099ea0 2024-05-08T04:21:24.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.492+0000 7f74d1240640 1 --2- 172.21.15.104:0/1047753973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc099ea0 0x7f74cc15dba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009d90 tx=0x7f74c402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9923152d3833b11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:24.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.492+0000 7f74cb7fe640 1 -- 172.21.15.104:0/1047753973 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8001670 con 0x7f74cc099ea0 2024-05-08T04:21:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.492+0000 7f74cb7fe640 1 -- 172.21.15.104:0/1047753973 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c4007540 con 0x7f74cc099ea0 2024-05-08T04:21:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.492+0000 7f74cb7fe640 1 -- 172.21.15.104:0/1047753973 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40078f0 con 0x7f74cc099ea0 2024-05-08T04:21:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.493+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1047753973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc099ea0 msgr2=0x7f74cc15dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.493+0000 7f74d2ca3640 1 --2- 172.21.15.104:0/1047753973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc099ea0 0x7f74cc15dba0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009d90 tx=0x7f74c402a710 comp rx=0 tx=0).stop 2024-05-08T04:21:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.493+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1047753973 shutdown_connections 2024-05-08T04:21:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.493+0000 7f74d2ca3640 1 --2- 172.21.15.104:0/1047753973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc099ea0 0x7f74cc15dba0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.493+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1047753973 >> 172.21.15.104:0/1047753973 conn(0x7f74cc0b3310 msgr2=0x7f74cc0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.493+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1047753973 shutdown_connections 2024-05-08T04:21:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.493+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1047753973 wait complete. 2024-05-08T04:21:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.494+0000 7f74d2ca3640 1 Processor -- start 2024-05-08T04:21:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.494+0000 7f74d2ca3640 1 -- start start 2024-05-08T04:21:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74d2ca3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc099a40 0x7f74cc14fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74d2ca3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74cc099ea0 0x7f74cc0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74d2ca3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0b2b80 0x7f74cc070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74d2ca3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc06cc80 con 0x7f74cc099ea0 2024-05-08T04:21:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74d2ca3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc09a310 con 0x7f74cc0b2b80 2024-05-08T04:21:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74d2ca3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc15e0e0 con 0x7f74cc099a40 2024-05-08T04:21:24.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74cc099ea0 0x7f74cc0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74cc099ea0 0x7f74cc0b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34192/0 (socket says 172.21.15.104:34192) 2024-05-08T04:21:24.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74cbfff640 1 -- 172.21.15.104:0/1656389868 learned_addr learned my addr 172.21.15.104:0/1656389868 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:24.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74cbfff640 1 -- 172.21.15.104:0/1656389868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc099a40 msgr2=0x7f74cc14fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74cbfff640 1 --2- 172.21.15.104:0/1656389868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc099a40 0x7f74cc14fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74cbfff640 1 -- 172.21.15.104:0/1656389868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0b2b80 msgr2=0x7f74cc070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74d1240640 1 --2- 172.21.15.104:0/1656389868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0b2b80 0x7f74cc070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74cbfff640 1 --2- 172.21.15.104:0/1656389868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0b2b80 0x7f74cc070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74cbfff640 1 -- 172.21.15.104:0/1656389868 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc15f400 con 0x7f74cc099ea0 2024-05-08T04:21:24.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74cbfff640 1 --2- 172.21.15.104:0/1656389868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74cc099ea0 0x7f74cc0b4970 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f74b800c5f0 tx=0x7f74b800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:24.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74c97fa640 1 -- 172.21.15.104:0/1656389868 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8017070 con 0x7f74cc099ea0 2024-05-08T04:21:24.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74c97fa640 1 -- 172.21.15.104:0/1656389868 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b8005d00 con 0x7f74cc099ea0 2024-05-08T04:21:24.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74c97fa640 1 -- 172.21.15.104:0/1656389868 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80072b0 con 0x7f74cc099ea0 2024-05-08T04:21:24.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1656389868 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74cc15f6a0 con 0x7f74cc099ea0 2024-05-08T04:21:24.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.495+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1656389868 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc15fc60 con 0x7f74cc099ea0 2024-05-08T04:21:24.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.496+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1656389868 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc075010 con 0x7f74cc099ea0 2024-05-08T04:21:24.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.497+0000 7f74c97fa640 1 -- 172.21.15.104:0/1656389868 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f74b801a070 con 0x7f74cc099ea0 2024-05-08T04:21:24.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.497+0000 7f74c97fa640 1 --2- 172.21.15.104:0/1656389868 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f74b006b4d0 0x7f74b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.497+0000 7f74c97fa640 1 -- 172.21.15.104:0/1656389868 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74b8089760 con 0x7f74cc099ea0 2024-05-08T04:21:24.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.497+0000 7f74d0a3f640 1 --2- 172.21.15.104:0/1656389868 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f74b006b4d0 0x7f74b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.498+0000 7f74d0a3f640 1 --2- 172.21.15.104:0/1656389868 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f74b006b4d0 0x7f74b006d990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f74c00010e0 tx=0x7f74c0007950 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:24.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.502+0000 7f74c97fa640 1 -- 172.21.15.104:0/1656389868 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f74b80585e0 con 0x7f74cc099ea0 2024-05-08T04:21:24.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.675+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1656389868 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74cc067de0 con 0x7f74cc099ea0 2024-05-08T04:21:24.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.675+0000 7f74c97fa640 1 -- 172.21.15.104:0/1656389868 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f74b8057ee0 con 0x7f74cc099ea0 2024-05-08T04:21:24.677 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.678+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1656389868 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f74b006b4d0 msgr2=0x7f74b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.678+0000 7f74d2ca3640 1 --2- 172.21.15.104:0/1656389868 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f74b006b4d0 0x7f74b006d990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f74c00010e0 tx=0x7f74c0007950 comp rx=0 tx=0).stop 2024-05-08T04:21:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.678+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1656389868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74cc099ea0 msgr2=0x7f74cc0b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.678+0000 7f74d2ca3640 1 --2- 172.21.15.104:0/1656389868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74cc099ea0 0x7f74cc0b4970 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f74b800c5f0 tx=0x7f74b800cab0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.678+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1656389868 shutdown_connections 2024-05-08T04:21:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.678+0000 7f74d2ca3640 1 --2- 172.21.15.104:0/1656389868 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f74b006b4d0 0x7f74b006d990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.678+0000 7f74d2ca3640 1 --2- 172.21.15.104:0/1656389868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0b2b80 0x7f74cc070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.678+0000 7f74d2ca3640 1 --2- 172.21.15.104:0/1656389868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74cc099ea0 0x7f74cc0b4970 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.678+0000 7f74d2ca3640 1 --2- 172.21.15.104:0/1656389868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc099a40 0x7f74cc14fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.678+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1656389868 >> 172.21.15.104:0/1656389868 conn(0x7f74cc0b3310 msgr2=0x7f74cc06fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:24.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.678+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1656389868 shutdown_connections 2024-05-08T04:21:24.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.678+0000 7f74d2ca3640 1 -- 172.21.15.104:0/1656389868 wait complete. 2024-05-08T04:21:24.690 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:21:24.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.787+0000 7fda4b0ea640 1 Processor -- start 2024-05-08T04:21:24.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.787+0000 7fda4b0ea640 1 -- start start 2024-05-08T04:21:24.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda4b0ea640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fda4415db30 0x7fda4406bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda4b0ea640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fda440b93b0 0x7fda440b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda4b0ea640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda440b5970 0x7fda44161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda4b0ea640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda440b5de0 con 0x7fda4415db30 2024-05-08T04:21:24.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda4b0ea640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda440b6b50 con 0x7fda440b93b0 2024-05-08T04:21:24.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda4b0ea640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4406c800 con 0x7fda440b5970 2024-05-08T04:21:24.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda48e86640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fda4415db30 0x7fda4406bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda48e86640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fda4415db30 0x7fda4406bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34196/0 (socket says 172.21.15.104:34196) 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda48e86640 1 -- 172.21.15.104:0/2418119410 learned_addr learned my addr 172.21.15.104:0/2418119410 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda43fff640 1 --2- 172.21.15.104:0/2418119410 >> v2:172.21.15.183:3300/0 conn(0x7fda440b93b0 0x7fda440b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda49687640 1 --2- 172.21.15.104:0/2418119410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda440b5970 0x7fda44161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda48e86640 1 -- 172.21.15.104:0/2418119410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda440b5970 msgr2=0x7fda44161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda48e86640 1 --2- 172.21.15.104:0/2418119410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda440b5970 0x7fda44161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda48e86640 1 -- 172.21.15.104:0/2418119410 >> v2:172.21.15.183:3300/0 conn(0x7fda440b93b0 msgr2=0x7fda440b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda48e86640 1 --2- 172.21.15.104:0/2418119410 >> v2:172.21.15.183:3300/0 conn(0x7fda440b93b0 0x7fda440b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda48e86640 1 -- 172.21.15.104:0/2418119410 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4406cae0 con 0x7fda4415db30 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.788+0000 7fda43fff640 1 --2- 172.21.15.104:0/2418119410 >> v2:172.21.15.183:3300/0 conn(0x7fda440b93b0 0x7fda440b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.789+0000 7fda48e86640 1 --2- 172.21.15.104:0/2418119410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda4415db30 0x7fda4406bfb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fda44161660 tx=0x7fda3802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cfe9e6a8ce5d61 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.789+0000 7fda437fe640 1 -- 172.21.15.104:0/2418119410 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda38037070 con 0x7fda4415db30 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.789+0000 7fda437fe640 1 -- 172.21.15.104:0/2418119410 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda38032440 con 0x7fda4415db30 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.789+0000 7fda437fe640 1 -- 172.21.15.104:0/2418119410 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda38032810 con 0x7fda4415db30 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.790+0000 7fda4b0ea640 1 -- 172.21.15.104:0/2418119410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda4415db30 msgr2=0x7fda4406bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.790+0000 7fda4b0ea640 1 --2- 172.21.15.104:0/2418119410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda4415db30 0x7fda4406bfb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fda44161660 tx=0x7fda3802a1e0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.790+0000 7fda4b0ea640 1 -- 172.21.15.104:0/2418119410 shutdown_connections 2024-05-08T04:21:24.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.790+0000 7fda4b0ea640 1 --2- 172.21.15.104:0/2418119410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda440b5970 0x7fda44161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.790+0000 7fda4b0ea640 1 --2- 172.21.15.104:0/2418119410 >> v2:172.21.15.183:3300/0 conn(0x7fda440b93b0 0x7fda440b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.790+0000 7fda4b0ea640 1 --2- 172.21.15.104:0/2418119410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda4415db30 0x7fda4406bfb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.790+0000 7fda4b0ea640 1 -- 172.21.15.104:0/2418119410 >> 172.21.15.104:0/2418119410 conn(0x7fda440d0430 msgr2=0x7fda440d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:24.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.790+0000 7fda4b0ea640 1 -- 172.21.15.104:0/2418119410 shutdown_connections 2024-05-08T04:21:24.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.790+0000 7fda4b0ea640 1 -- 172.21.15.104:0/2418119410 wait complete. 2024-05-08T04:21:24.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.791+0000 7fda4b0ea640 1 Processor -- start 2024-05-08T04:21:24.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.791+0000 7fda4b0ea640 1 -- start start 2024-05-08T04:21:24.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda4b0ea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda440b5970 0x7fda440c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda4b0ea640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda440b93b0 0x7fda4414d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda4b0ea640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda4415db30 0x7fda4415f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda4b0ea640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4406c4f0 con 0x7fda440b5970 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda4b0ea640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda440d1f90 con 0x7fda440b93b0 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda4b0ea640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4415df10 con 0x7fda4415db30 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda48e86640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda440b5970 0x7fda440c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda48e86640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda440b5970 0x7fda440c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34202/0 (socket says 172.21.15.104:34202) 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda48e86640 1 -- 172.21.15.104:0/4161833943 learned_addr learned my addr 172.21.15.104:0/4161833943 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda48e86640 1 -- 172.21.15.104:0/4161833943 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda4415db30 msgr2=0x7fda4415f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda48e86640 1 --2- 172.21.15.104:0/4161833943 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda4415db30 0x7fda4415f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda48e86640 1 -- 172.21.15.104:0/4161833943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda440b93b0 msgr2=0x7fda4414d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda48e86640 1 --2- 172.21.15.104:0/4161833943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda440b93b0 0x7fda4414d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda48e86640 1 -- 172.21.15.104:0/4161833943 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4414da90 con 0x7fda440b5970 2024-05-08T04:21:24.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda48e86640 1 --2- 172.21.15.104:0/4161833943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda440b5970 0x7fda440c96c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda3802a220 tx=0x7fda380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:24.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda417fa640 1 -- 172.21.15.104:0/4161833943 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda38041020 con 0x7fda440b5970 2024-05-08T04:21:24.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda417fa640 1 -- 172.21.15.104:0/4161833943 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda380306c0 con 0x7fda440b5970 2024-05-08T04:21:24.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda417fa640 1 -- 172.21.15.104:0/4161833943 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda38037040 con 0x7fda440b5970 2024-05-08T04:21:24.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda4b0ea640 1 -- 172.21.15.104:0/4161833943 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4414ae30 con 0x7fda440b5970 2024-05-08T04:21:24.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.792+0000 7fda4b0ea640 1 -- 172.21.15.104:0/4161833943 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4414b3f0 con 0x7fda440b5970 2024-05-08T04:21:24.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.793+0000 7fda4b0ea640 1 -- 172.21.15.104:0/4161833943 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda44075010 con 0x7fda440b5970 2024-05-08T04:21:24.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.794+0000 7fda417fa640 1 -- 172.21.15.104:0/4161833943 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fda38044020 con 0x7fda440b5970 2024-05-08T04:21:24.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.794+0000 7fda417fa640 1 --2- 172.21.15.104:0/4161833943 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fda2806b4d0 0x7fda2806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:24.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.795+0000 7fda43fff640 1 --2- 172.21.15.104:0/4161833943 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fda2806b4d0 0x7fda2806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:24.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.795+0000 7fda417fa640 1 -- 172.21.15.104:0/4161833943 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda380aaa50 con 0x7fda440b5970 2024-05-08T04:21:24.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.795+0000 7fda43fff640 1 --2- 172.21.15.104:0/4161833943 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fda2806b4d0 0x7fda2806d990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda30006fd0 tx=0x7fda30008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:24.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:24.799+0000 7fda417fa640 1 -- 172.21.15.104:0/4161833943 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda3804b030 con 0x7fda440b5970 2024-05-08T04:21:25.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.014+0000 7fda4b0ea640 1 -- 172.21.15.104:0/4161833943 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda440b8bc0 con 0x7fda440b5970 2024-05-08T04:21:25.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.015+0000 7fda417fa640 1 -- 172.21.15.104:0/4161833943 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7fda4414da90 con 0x7fda440b5970 2024-05-08T04:21:25.016 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:25.016 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/446112297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":446112297},{"type":"v1","addr":"172.21.15.183:6834","nonce":446112297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/702726775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":702726775},{"type":"v1","addr":"172.21.15.183:6835","nonce":702726775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/1820805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1820805788},{"type":"v1","addr":"172.21.15.104:6836","nonce":1820805788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:21:10.133307+0000","modified":"2024-05-08T04:21:12.575912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/610189872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":610189872},{"type":"v1","addr":"172.21.15.104:6837","nonce":610189872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T04:21:25.017 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-05-08T04:21:25.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.017+0000 7fda4b0ea640 1 -- 172.21.15.104:0/4161833943 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fda2806b4d0 msgr2=0x7fda2806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.017+0000 7fda4b0ea640 1 --2- 172.21.15.104:0/4161833943 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fda2806b4d0 0x7fda2806d990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda30006fd0 tx=0x7fda30008040 comp rx=0 tx=0).stop 2024-05-08T04:21:25.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.017+0000 7fda4b0ea640 1 -- 172.21.15.104:0/4161833943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda440b5970 msgr2=0x7fda440c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.017+0000 7fda4b0ea640 1 --2- 172.21.15.104:0/4161833943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda440b5970 0x7fda440c96c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda3802a220 tx=0x7fda380046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.017+0000 7fda4b0ea640 1 -- 172.21.15.104:0/4161833943 shutdown_connections 2024-05-08T04:21:25.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.017+0000 7fda4b0ea640 1 --2- 172.21.15.104:0/4161833943 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fda2806b4d0 0x7fda2806d990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.017+0000 7fda4b0ea640 1 --2- 172.21.15.104:0/4161833943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda440b93b0 0x7fda4414d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.017+0000 7fda4b0ea640 1 --2- 172.21.15.104:0/4161833943 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda4415db30 0x7fda4415f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.017+0000 7fda4b0ea640 1 --2- 172.21.15.104:0/4161833943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda440b5970 0x7fda440c96c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.017+0000 7fda4b0ea640 1 -- 172.21.15.104:0/4161833943 >> 172.21.15.104:0/4161833943 conn(0x7fda440d0430 msgr2=0x7fda440b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:25.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.017+0000 7fda4b0ea640 1 -- 172.21.15.104:0/4161833943 shutdown_connections 2024-05-08T04:21:25.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.017+0000 7fda4b0ea640 1 -- 172.21.15.104:0/4161833943 wait complete. 2024-05-08T04:21:25.030 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:25.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.128+0000 7f4601815640 1 Processor -- start 2024-05-08T04:21:25.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.128+0000 7f4601815640 1 -- start start 2024-05-08T04:21:25.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.129+0000 7f4601815640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f45fc15de10 0x7f45fc161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:25.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.129+0000 7f4601815640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc15e1f0 con 0x7f45fc0d07c0 2024-05-08T04:21:25.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.129+0000 7f4601815640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc162090 con 0x7f45fc0ce5a0 2024-05-08T04:21:25.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.129+0000 7f4601815640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc0d0f50 con 0x7f45fc15de10 2024-05-08T04:21:25.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.129+0000 7f45faffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f45fc15de10 0x7f45fc161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:25.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.129+0000 7f45fb7fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f45fc0d07c0 0x7f45fc0d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53268/0 (socket says 172.21.15.104:53268) 2024-05-08T04:21:25.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.129+0000 7f45fb7fe640 1 -- 172.21.15.104:0/2028891823 learned_addr learned my addr 172.21.15.104:0/2028891823 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:25.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.129+0000 7f45faffd640 1 -- 172.21.15.104:0/2028891823 >> v1:172.21.15.183:6789/0 conn(0x7f45fc0ce5a0 legacy=0x7f45fc0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:25.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.129+0000 7f45faffd640 1 -- 172.21.15.104:0/2028891823 >> v1:172.21.15.104:6789/0 conn(0x7f45fc0d07c0 legacy=0x7f45fc0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.129+0000 7f45fa7fc640 1 -- 172.21.15.104:0/2028891823 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199163646 0 0) 0x7f45fc15e1f0 con 0x7f45fc0d07c0 2024-05-08T04:21:25.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.129+0000 7f45faffd640 1 -- 172.21.15.104:0/2028891823 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc162370 con 0x7f45fc15de10 2024-05-08T04:21:25.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.130+0000 7f45faffd640 1 --2- 172.21.15.104:0/2028891823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45fc15de10 0x7f45fc161920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0097a0 tx=0x7f45ec02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b2db26dfd9aed4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:25.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.130+0000 7f45fa7fc640 1 -- 172.21.15.104:0/2028891823 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec037070 con 0x7f45fc15de10 2024-05-08T04:21:25.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.130+0000 7f45fa7fc640 1 -- 172.21.15.104:0/2028891823 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec02ae50 con 0x7f45fc15de10 2024-05-08T04:21:25.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.130+0000 7f45fa7fc640 1 -- 172.21.15.104:0/2028891823 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec032660 con 0x7f45fc15de10 2024-05-08T04:21:25.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.130+0000 7f4601815640 1 -- 172.21.15.104:0/2028891823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45fc15de10 msgr2=0x7f45fc161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.130+0000 7f4601815640 1 --2- 172.21.15.104:0/2028891823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45fc15de10 0x7f45fc161920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0097a0 tx=0x7f45ec02a140 comp rx=0 tx=0).stop 2024-05-08T04:21:25.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.131+0000 7f4601815640 1 -- 172.21.15.104:0/2028891823 shutdown_connections 2024-05-08T04:21:25.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.131+0000 7f4601815640 1 --2- 172.21.15.104:0/2028891823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45fc15de10 0x7f45fc161920 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.131+0000 7f4601815640 1 -- 172.21.15.104:0/2028891823 >> 172.21.15.104:0/2028891823 conn(0x7f45fc072290 msgr2=0x7f45fc072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:25.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.131+0000 7f4601815640 1 -- 172.21.15.104:0/2028891823 shutdown_connections 2024-05-08T04:21:25.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.131+0000 7f4601815640 1 -- 172.21.15.104:0/2028891823 wait complete. 2024-05-08T04:21:25.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.132+0000 7f4601815640 1 Processor -- start 2024-05-08T04:21:25.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.132+0000 7f4601815640 1 -- start start 2024-05-08T04:21:25.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f4601815640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45fc0ce5a0 0x7f45fc15fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f4601815640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45fc0d07c0 0x7f45fc15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f4601815640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45fc15de10 0x7f45fc0b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f4601815640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0d1a90 con 0x7f45fc0d07c0 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f4601815640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0d1ce0 con 0x7f45fc15de10 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f4601815640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0b6dc0 con 0x7f45fc0ce5a0 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45f27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45fc0d07c0 0x7f45fc15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45f27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45fc0d07c0 0x7f45fc15cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34222/0 (socket says 172.21.15.104:34222) 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45f27fc640 1 -- 172.21.15.104:0/2229751203 learned_addr learned my addr 172.21.15.104:0/2229751203 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45fb7fe640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45fc15de10 0x7f45fc0b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45faffd640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45fc0ce5a0 0x7f45fc15fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45f27fc640 1 -- 172.21.15.104:0/2229751203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45fc0ce5a0 msgr2=0x7f45fc15fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45f27fc640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45fc0ce5a0 0x7f45fc15fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45f27fc640 1 -- 172.21.15.104:0/2229751203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45fc15de10 msgr2=0x7f45fc0b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45f27fc640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45fc15de10 0x7f45fc0b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45f27fc640 1 -- 172.21.15.104:0/2229751203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc15bbd0 con 0x7f45fc0d07c0 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45fb7fe640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45fc15de10 0x7f45fc0b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45f27fc640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45fc0d07c0 0x7f45fc15cc70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c460 tx=0x7f45e400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45f8ff9640 1 -- 172.21.15.104:0/2229751203 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4016020 con 0x7f45fc0d07c0 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45f8ff9640 1 -- 172.21.15.104:0/2229751203 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e4012870 con 0x7f45fc0d07c0 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f45f8ff9640 1 -- 172.21.15.104:0/2229751203 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4012c60 con 0x7f45fc0d07c0 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f4601815640 1 -- 172.21.15.104:0/2229751203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc15beb0 con 0x7f45fc0d07c0 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.133+0000 7f4601815640 1 -- 172.21.15.104:0/2229751203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc15c470 con 0x7f45fc0d07c0 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.134+0000 7f4601815640 1 -- 172.21.15.104:0/2229751203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc075010 con 0x7f45fc0d07c0 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.135+0000 7f45f8ff9640 1 -- 172.21.15.104:0/2229751203 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f45e4019020 con 0x7f45fc0d07c0 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.135+0000 7f45f8ff9640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f45dc06b4d0 0x7f45dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.135+0000 7f45faffd640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f45dc06b4d0 0x7f45dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.135+0000 7f45f8ff9640 1 -- 172.21.15.104:0/2229751203 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45e4089f20 con 0x7f45fc0d07c0 2024-05-08T04:21:25.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.136+0000 7f45faffd640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f45dc06b4d0 0x7f45dc06d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f45ec034000 tx=0x7f45ec02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:25.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.139+0000 7f45f8ff9640 1 -- 172.21.15.104:0/2229751203 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f45e4020030 con 0x7f45fc0d07c0 2024-05-08T04:21:25.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.311+0000 7f4601815640 1 -- 172.21.15.104:0/2229751203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45fc0d1870 con 0x7f45fc0d07c0 2024-05-08T04:21:25.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.312+0000 7f45f8ff9640 1 -- 172.21.15.104:0/2229751203 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f45e4058da0 con 0x7f45fc0d07c0 2024-05-08T04:21:25.314 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:25.314 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:25.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.314+0000 7f4601815640 1 -- 172.21.15.104:0/2229751203 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f45dc06b4d0 msgr2=0x7f45dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.314+0000 7f4601815640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f45dc06b4d0 0x7f45dc06d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f45ec034000 tx=0x7f45ec02e000 comp rx=0 tx=0).stop 2024-05-08T04:21:25.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.314+0000 7f4601815640 1 -- 172.21.15.104:0/2229751203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45fc0d07c0 msgr2=0x7f45fc15cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.314+0000 7f4601815640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45fc0d07c0 0x7f45fc15cc70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c460 tx=0x7f45e400c920 comp rx=0 tx=0).stop 2024-05-08T04:21:25.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.314+0000 7f4601815640 1 -- 172.21.15.104:0/2229751203 shutdown_connections 2024-05-08T04:21:25.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.314+0000 7f4601815640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f45dc06b4d0 0x7f45dc06d990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.314+0000 7f4601815640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45fc15de10 0x7f45fc0b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.314+0000 7f4601815640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45fc0d07c0 0x7f45fc15cc70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.314+0000 7f4601815640 1 --2- 172.21.15.104:0/2229751203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45fc0ce5a0 0x7f45fc15fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.314+0000 7f4601815640 1 -- 172.21.15.104:0/2229751203 >> 172.21.15.104:0/2229751203 conn(0x7f45fc072290 msgr2=0x7f45fc0cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:25.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.314+0000 7f4601815640 1 -- 172.21.15.104:0/2229751203 shutdown_connections 2024-05-08T04:21:25.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.314+0000 7f4601815640 1 -- 172.21.15.104:0/2229751203 wait complete. 2024-05-08T04:21:25.327 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:21:25.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.424+0000 7f3103476640 1 Processor -- start 2024-05-08T04:21:25.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.424+0000 7f3103476640 1 -- start start 2024-05-08T04:21:25.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f3103476640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f30fc070c70 0x7f30fc0d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:25.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f3103476640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30fc071050 0x7f30fc15c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:25.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f3103476640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30fc15d420 con 0x7f30fc15cad0 2024-05-08T04:21:25.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f3103476640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30fc0d16a0 con 0x7f30fc070c70 2024-05-08T04:21:25.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f3103476640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0d0eb0 con 0x7f30fc071050 2024-05-08T04:21:25.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f3101212640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f30fc070c70 0x7f30fc0d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:25.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f3101a13640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f30fc15cad0 0x7f30fc15f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53278/0 (socket says 172.21.15.104:53278) 2024-05-08T04:21:25.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f3101a13640 1 -- 172.21.15.104:0/2020732896 learned_addr learned my addr 172.21.15.104:0/2020732896 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:25.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f3100a11640 1 --2- 172.21.15.104:0/2020732896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30fc071050 0x7f30fc15c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:25.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f30fbfff640 1 -- 172.21.15.104:0/2020732896 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284087139 0 0) 0x7f30fc15d420 con 0x7f30fc15cad0 2024-05-08T04:21:25.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f30fbfff640 1 -- 172.21.15.104:0/2020732896 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30e4003520 con 0x7f30fc15cad0 2024-05-08T04:21:25.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f3101212640 1 -- 172.21.15.104:0/2020732896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30fc071050 msgr2=0x7f30fc15c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:25.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f3101212640 1 --2- 172.21.15.104:0/2020732896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30fc071050 0x7f30fc15c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f3101212640 1 -- 172.21.15.104:0/2020732896 >> v1:172.21.15.104:6789/0 conn(0x7f30fc15cad0 legacy=0x7f30fc15f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.425+0000 7f3101212640 1 -- 172.21.15.104:0/2020732896 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc0d10e0 con 0x7f30fc070c70 2024-05-08T04:21:25.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.426+0000 7f3101212640 1 --2- 172.21.15.104:0/2020732896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30fc070c70 0x7f30fc0d0970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0097a0 tx=0x7f30ec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6419c5cc1fac3fe4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:25.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.426+0000 7f30fbfff640 1 -- 172.21.15.104:0/2020732896 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec037070 con 0x7f30fc070c70 2024-05-08T04:21:25.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.426+0000 7f30fbfff640 1 -- 172.21.15.104:0/2020732896 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec032440 con 0x7f30fc070c70 2024-05-08T04:21:25.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.426+0000 7f30fbfff640 1 -- 172.21.15.104:0/2020732896 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec032810 con 0x7f30fc070c70 2024-05-08T04:21:25.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.427+0000 7f3103476640 1 -- 172.21.15.104:0/2020732896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30fc070c70 msgr2=0x7f30fc0d0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.427+0000 7f3103476640 1 --2- 172.21.15.104:0/2020732896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30fc070c70 0x7f30fc0d0970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0097a0 tx=0x7f30ec02a180 comp rx=0 tx=0).stop 2024-05-08T04:21:25.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.427+0000 7f3103476640 1 -- 172.21.15.104:0/2020732896 shutdown_connections 2024-05-08T04:21:25.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.427+0000 7f3103476640 1 --2- 172.21.15.104:0/2020732896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30fc071050 0x7f30fc15c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.427+0000 7f3103476640 1 --2- 172.21.15.104:0/2020732896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30fc070c70 0x7f30fc0d0970 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.427+0000 7f3103476640 1 -- 172.21.15.104:0/2020732896 >> 172.21.15.104:0/2020732896 conn(0x7f30fc0b3450 msgr2=0x7f30fc0b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:25.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.427+0000 7f3103476640 1 -- 172.21.15.104:0/2020732896 shutdown_connections 2024-05-08T04:21:25.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.427+0000 7f3103476640 1 -- 172.21.15.104:0/2020732896 wait complete. 2024-05-08T04:21:25.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.428+0000 7f3103476640 1 Processor -- start 2024-05-08T04:21:25.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.428+0000 7f3103476640 1 -- start start 2024-05-08T04:21:25.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3103476640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30fc070c70 0x7f30fc1f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:25.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3103476640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30fc071050 0x7f30fc1e6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:25.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3103476640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30fc15cad0 0x7f30fc06cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:25.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3103476640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0714d0 con 0x7f30fc070c70 2024-05-08T04:21:25.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3103476640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc15d6c0 con 0x7f30fc071050 2024-05-08T04:21:25.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3103476640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc15ebf0 con 0x7f30fc15cad0 2024-05-08T04:21:25.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3101212640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30fc070c70 0x7f30fc1f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:25.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3101212640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30fc070c70 0x7f30fc1f3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34232/0 (socket says 172.21.15.104:34232) 2024-05-08T04:21:25.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3101212640 1 -- 172.21.15.104:0/2905993845 learned_addr learned my addr 172.21.15.104:0/2905993845 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:25.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3101a13640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30fc15cad0 0x7f30fc06cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:25.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3100a11640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30fc071050 0x7f30fc1e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:25.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3101212640 1 -- 172.21.15.104:0/2905993845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30fc15cad0 msgr2=0x7f30fc06cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3101212640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30fc15cad0 0x7f30fc06cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3101212640 1 -- 172.21.15.104:0/2905993845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30fc071050 msgr2=0x7f30fc1e6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3101212640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30fc071050 0x7f30fc1e6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3101212640 1 -- 172.21.15.104:0/2905993845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc1461c0 con 0x7f30fc070c70 2024-05-08T04:21:25.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3100a11640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30fc071050 0x7f30fc1e6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:25.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f3101212640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30fc070c70 0x7f30fc1f3ab0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f30ec035040 tx=0x7f30ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:25.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.429+0000 7f30f9ffb640 1 -- 172.21.15.104:0/2905993845 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec037040 con 0x7f30fc070c70 2024-05-08T04:21:25.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.430+0000 7f30f9ffb640 1 -- 172.21.15.104:0/2905993845 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec030500 con 0x7f30fc070c70 2024-05-08T04:21:25.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.430+0000 7f30f9ffb640 1 -- 172.21.15.104:0/2905993845 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec030910 con 0x7f30fc070c70 2024-05-08T04:21:25.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.430+0000 7f3103476640 1 -- 172.21.15.104:0/2905993845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30fc06d4e0 con 0x7f30fc070c70 2024-05-08T04:21:25.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.430+0000 7f3103476640 1 -- 172.21.15.104:0/2905993845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc146740 con 0x7f30fc070c70 2024-05-08T04:21:25.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.431+0000 7f3103476640 1 -- 172.21.15.104:0/2905993845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc075010 con 0x7f30fc070c70 2024-05-08T04:21:25.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.431+0000 7f30f9ffb640 1 -- 172.21.15.104:0/2905993845 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f30ec044020 con 0x7f30fc070c70 2024-05-08T04:21:25.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.431+0000 7f30f9ffb640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f30e806b4d0 0x7f30e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:25.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.432+0000 7f30f9ffb640 1 -- 172.21.15.104:0/2905993845 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30ec0aa450 con 0x7f30fc070c70 2024-05-08T04:21:25.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.432+0000 7f3100a11640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f30e806b4d0 0x7f30e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:25.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.432+0000 7f3100a11640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f30e806b4d0 0x7f30e806d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30fc146150 tx=0x7f30f0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.436+0000 7f30f9ffb640 1 -- 172.21.15.104:0/2905993845 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f30ec0792d0 con 0x7f30fc070c70 2024-05-08T04:21:25.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.641+0000 7f3103476640 1 -- 172.21.15.104:0/2905993845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30fc0b4180 con 0x7f30fc070c70 2024-05-08T04:21:25.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.642+0000 7f30f9ffb640 1 -- 172.21.15.104:0/2905993845 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f30ec078bd0 con 0x7f30fc070c70 2024-05-08T04:21:25.643 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:25.643 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/446112297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":446112297},{"type":"v1","addr":"172.21.15.183:6834","nonce":446112297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/702726775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":702726775},{"type":"v1","addr":"172.21.15.183:6835","nonce":702726775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/1820805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1820805788},{"type":"v1","addr":"172.21.15.104:6836","nonce":1820805788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:21:10.133307+0000","modified":"2024-05-08T04:21:12.575912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/610189872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":610189872},{"type":"v1","addr":"172.21.15.104:6837","nonce":610189872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T04:21:25.643 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-05-08T04:21:25.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.644+0000 7f3103476640 1 -- 172.21.15.104:0/2905993845 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f30e806b4d0 msgr2=0x7f30e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.644+0000 7f3103476640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f30e806b4d0 0x7f30e806d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30fc146150 tx=0x7f30f0008040 comp rx=0 tx=0).stop 2024-05-08T04:21:25.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.644+0000 7f3103476640 1 -- 172.21.15.104:0/2905993845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30fc070c70 msgr2=0x7f30fc1f3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:25.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.644+0000 7f3103476640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30fc070c70 0x7f30fc1f3ab0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f30ec035040 tx=0x7f30ec0046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.644+0000 7f3103476640 1 -- 172.21.15.104:0/2905993845 shutdown_connections 2024-05-08T04:21:25.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.644+0000 7f3103476640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f30e806b4d0 0x7f30e806d990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.644+0000 7f3103476640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30fc071050 0x7f30fc1e6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.644+0000 7f3103476640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30fc15cad0 0x7f30fc06cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.644+0000 7f3103476640 1 --2- 172.21.15.104:0/2905993845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30fc070c70 0x7f30fc1f3ab0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:25.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.644+0000 7f3103476640 1 -- 172.21.15.104:0/2905993845 >> 172.21.15.104:0/2905993845 conn(0x7f30fc0b3450 msgr2=0x7f30fc0b5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:25.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.644+0000 7f3103476640 1 -- 172.21.15.104:0/2905993845 shutdown_connections 2024-05-08T04:21:25.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:25.644+0000 7f3103476640 1 -- 172.21.15.104:0/2905993845 wait complete. 2024-05-08T04:21:26.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T04:21:10.133307+0000', 'modified': '2024-05-08T04:21:12.575912+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6837/610189872', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6835', 'nonce': 610189872}, {'type': 'v1', 'addr': '172.21.15.104:6837', 'nonce': 610189872}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T04:21:26.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T04:21:26.059 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-08T04:21:26.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.159+0000 7f61df422640 1 Processor -- start 2024-05-08T04:21:26.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.160+0000 7f61df422640 1 -- start start 2024-05-08T04:21:26.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.160+0000 7f61df422640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f61d815db30 0x7f61d806bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.160+0000 7f61df422640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61d80b93b0 0x7f61d80b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.160+0000 7f61df422640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f61d80b5970 0x7f61d8161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.160+0000 7f61df422640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d80b6b50 con 0x7f61d815db30 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.160+0000 7f61df422640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d806c800 con 0x7f61d80b5970 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.160+0000 7f61df422640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d806cae0 con 0x7f61d80b93b0 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.160+0000 7f61dd1be640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f61d815db30 0x7f61d806bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.160+0000 7f61dd1be640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f61d815db30 0x7f61d806bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34240/0 (socket says 172.21.15.104:34240) 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.160+0000 7f61dd1be640 1 -- 172.21.15.104:0/3135873259 learned_addr learned my addr 172.21.15.104:0/3135873259 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.161+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/3135873259 >> v2:172.21.15.183:3300/0 conn(0x7f61d80b5970 0x7f61d8161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.161+0000 7f61dc9bd640 1 --2- 172.21.15.104:0/3135873259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61d80b93b0 0x7f61d80b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.161+0000 7f61dd1be640 1 -- 172.21.15.104:0/3135873259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61d80b93b0 msgr2=0x7f61d80b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.161+0000 7f61dd1be640 1 --2- 172.21.15.104:0/3135873259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61d80b93b0 0x7f61d80b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.161+0000 7f61dd1be640 1 -- 172.21.15.104:0/3135873259 >> v2:172.21.15.183:3300/0 conn(0x7f61d80b5970 msgr2=0x7f61d8161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.161+0000 7f61dd1be640 1 --2- 172.21.15.104:0/3135873259 >> v2:172.21.15.183:3300/0 conn(0x7f61d80b5970 0x7f61d8161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.161+0000 7f61dd1be640 1 -- 172.21.15.104:0/3135873259 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d806cdc0 con 0x7f61d815db30 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.161+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/3135873259 >> v2:172.21.15.183:3300/0 conn(0x7f61d80b5970 0x7f61d8161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:26.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.162+0000 7f61dd1be640 1 --2- 172.21.15.104:0/3135873259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d815db30 0x7f61d806bfb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f61d80b6550 tx=0x7f61d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabc3b1becabca8a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:26.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.162+0000 7f61cffff640 1 -- 172.21.15.104:0/3135873259 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4037070 con 0x7f61d815db30 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.162+0000 7f61cffff640 1 -- 172.21.15.104:0/3135873259 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d4032440 con 0x7f61d815db30 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.162+0000 7f61cffff640 1 -- 172.21.15.104:0/3135873259 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4032810 con 0x7f61d815db30 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.162+0000 7f61df422640 1 -- 172.21.15.104:0/3135873259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d815db30 msgr2=0x7f61d806bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.162+0000 7f61df422640 1 --2- 172.21.15.104:0/3135873259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d815db30 0x7f61d806bfb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f61d80b6550 tx=0x7f61d402a1e0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.162+0000 7f61df422640 1 -- 172.21.15.104:0/3135873259 shutdown_connections 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.162+0000 7f61df422640 1 --2- 172.21.15.104:0/3135873259 >> v2:172.21.15.183:3300/0 conn(0x7f61d80b5970 0x7f61d8161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.162+0000 7f61df422640 1 --2- 172.21.15.104:0/3135873259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61d80b93b0 0x7f61d80b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.162+0000 7f61df422640 1 --2- 172.21.15.104:0/3135873259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d815db30 0x7f61d806bfb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.162+0000 7f61df422640 1 -- 172.21.15.104:0/3135873259 >> 172.21.15.104:0/3135873259 conn(0x7f61d80d0430 msgr2=0x7f61d80d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.162+0000 7f61df422640 1 -- 172.21.15.104:0/3135873259 shutdown_connections 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.162+0000 7f61df422640 1 -- 172.21.15.104:0/3135873259 wait complete. 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.164+0000 7f61df422640 1 Processor -- start 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.164+0000 7f61df422640 1 -- start start 2024-05-08T04:21:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.164+0000 7f61df422640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61d80b5970 0x7f61d80b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.164+0000 7f61df422640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61d80b93b0 0x7f61d80caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.164+0000 7f61df422640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d815db30 0x7f61d815fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.164+0000 7f61df422640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d815df10 con 0x7f61d815db30 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.164+0000 7f61df422640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d806c4f0 con 0x7f61d80b5970 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.164+0000 7f61df422640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80cb460 con 0x7f61d80b93b0 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.164+0000 7f61dd9bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d815db30 0x7f61d815fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.164+0000 7f61dd9bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d815db30 0x7f61d815fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34254/0 (socket says 172.21.15.104:34254) 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.164+0000 7f61dd9bf640 1 -- 172.21.15.104:0/3689963684 learned_addr learned my addr 172.21.15.104:0/3689963684 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.164+0000 7f61dc9bd640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61d80b93b0 0x7f61d80caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.165+0000 7f61dd1be640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61d80b5970 0x7f61d80b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.165+0000 7f61dd9bf640 1 -- 172.21.15.104:0/3689963684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61d80b93b0 msgr2=0x7f61d80caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.165+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61d80b93b0 0x7f61d80caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.165+0000 7f61dd9bf640 1 -- 172.21.15.104:0/3689963684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61d80b5970 msgr2=0x7f61d80b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.165+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61d80b5970 0x7f61d80b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.165+0000 7f61dd9bf640 1 -- 172.21.15.104:0/3689963684 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d80cb740 con 0x7f61d815db30 2024-05-08T04:21:26.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.165+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d815db30 0x7f61d815fb10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f61d000cdb0 tx=0x7f61d000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:26.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.165+0000 7f61cdffb640 1 -- 172.21.15.104:0/3689963684 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d001a070 con 0x7f61d815db30 2024-05-08T04:21:26.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.165+0000 7f61cdffb640 1 -- 172.21.15.104:0/3689963684 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d000d840 con 0x7f61d815db30 2024-05-08T04:21:26.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.165+0000 7f61df422640 1 -- 172.21.15.104:0/3689963684 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d80cba20 con 0x7f61d815db30 2024-05-08T04:21:26.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.165+0000 7f61cdffb640 1 -- 172.21.15.104:0/3689963684 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d000dc30 con 0x7f61d815db30 2024-05-08T04:21:26.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.165+0000 7f61df422640 1 -- 172.21.15.104:0/3689963684 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d80b74e0 con 0x7f61d815db30 2024-05-08T04:21:26.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.167+0000 7f61cdffb640 1 -- 172.21.15.104:0/3689963684 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f61d001d070 con 0x7f61d815db30 2024-05-08T04:21:26.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.167+0000 7f61cdffb640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f61bc06b4d0 0x7f61bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.167+0000 7f61cdffb640 1 -- 172.21.15.104:0/3689963684 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61d008a950 con 0x7f61d815db30 2024-05-08T04:21:26.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.167+0000 7f61dd1be640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f61bc06b4d0 0x7f61bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.168+0000 7f61dd1be640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f61bc06b4d0 0x7f61bc06d990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61d4034000 tx=0x7f61d402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.168+0000 7f61e21fd740 1 Processor -- start 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.168+0000 7f61e21fd740 1 -- start start 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61e21fd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 0x564b208d7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61e21fd740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 0x564b208f5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61e21fd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208acf10 0x564b208f3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61e21fd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2080fa10 con 0x564b208acf10 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61e21fd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b207b8b30 con 0x564b208d7230 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61e21fd740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b2080bc50 con 0x564b208f4ad0 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61dd9bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208acf10 0x564b208f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61dd9bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208acf10 0x564b208f3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34266/0 (socket says 172.21.15.104:34266) 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61dd9bf640 1 -- 172.21.15.104:0/132848108 learned_addr learned my addr 172.21.15.104:0/132848108 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61dd9bf640 1 -- 172.21.15.104:0/132848108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 msgr2=0x564b208f5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/132848108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 0x564b208f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61dd9bf640 1 -- 172.21.15.104:0/132848108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 msgr2=0x564b208d7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/132848108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 0x564b208d7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61dd9bf640 1 -- 172.21.15.104:0/132848108 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b207cde10 con 0x564b208acf10 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/132848108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208acf10 0x564b208f3190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f61d0088ea0 tx=0x7f61d00590d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70ade6678f68cab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61c2ffd640 1 -- 172.21.15.104:0/132848108 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0057170 con 0x564b208acf10 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61c2ffd640 1 -- 172.21.15.104:0/132848108 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0070030 con 0x564b208acf10 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.169+0000 7f61c2ffd640 1 -- 172.21.15.104:0/132848108 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00573d0 con 0x564b208acf10 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.170+0000 7f61e21fd740 1 -- 172.21.15.104:0/132848108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208acf10 msgr2=0x564b208f3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.170+0000 7f61e21fd740 1 --2- 172.21.15.104:0/132848108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208acf10 0x564b208f3190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f61d0088ea0 tx=0x7f61d00590d0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.170+0000 7f61e21fd740 1 -- 172.21.15.104:0/132848108 shutdown_connections 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.170+0000 7f61e21fd740 1 --2- 172.21.15.104:0/132848108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208acf10 0x564b208f3190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.170+0000 7f61e21fd740 1 --2- 172.21.15.104:0/132848108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 0x564b208f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.170+0000 7f61e21fd740 1 --2- 172.21.15.104:0/132848108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 0x564b208d7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.170+0000 7f61e21fd740 1 -- 172.21.15.104:0/132848108 >> 172.21.15.104:0/132848108 conn(0x564b208a9840 msgr2=0x564b208f2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:26.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.170+0000 7f61e21fd740 1 -- 172.21.15.104:0/132848108 shutdown_connections 2024-05-08T04:21:26.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.170+0000 7f61e21fd740 1 -- 172.21.15.104:0/132848108 wait complete. 2024-05-08T04:21:26.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.171+0000 7f61e21fd740 1 -- start start 2024-05-08T04:21:26.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.171+0000 7f61e21fd740 1 Processor -- start 2024-05-08T04:21:26.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61e21fd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 0x564b208e9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61e21fd740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 0x564b208a6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61e21fd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 0x564b208a6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61e21fd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b208adcb0 con 0x564b208ebdb0 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61e21fd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b207cc0c0 con 0x564b208d7230 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61e21fd740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b208a7770 con 0x564b208f4ad0 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61e21fd740 10 client.0 _ll_register_callbacks cb 0x564b207bfec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61dd9bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 0x564b208a6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61dd9bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 0x564b208a6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34278/0 (socket says 172.21.15.104:34278) 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61dd9bf640 1 -- 172.21.15.104:0/1439488273 learned_addr learned my addr 172.21.15.104:0/1439488273 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61dc9bd640 1 --2- 172.21.15.104:0/1439488273 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 0x564b208a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61dd1be640 1 --2- 172.21.15.104:0/1439488273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 0x564b208e9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61dd9bf640 1 -- 172.21.15.104:0/1439488273 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 msgr2=0x564b208a6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/1439488273 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 0x564b208a6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61dd9bf640 1 -- 172.21.15.104:0/1439488273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 msgr2=0x564b208e9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/1439488273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 0x564b208e9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61dd9bf640 1 -- 172.21.15.104:0/1439488273 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b205242d0 con 0x564b208ebdb0 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/1439488273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 0x564b208a6c70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f61d00612b0 tx=0x7f61d0021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ebd54fda560dd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61b7fff640 1 -- 172.21.15.104:0/1439488273 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0074020 con 0x564b208ebdb0 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61b7fff640 1 -- 172.21.15.104:0/1439488273 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61d000ad40 con 0x564b208ebdb0 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61e21fd740 1 -- 172.21.15.104:0/1439488273 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61d0070030 con 0x564b208ebdb0 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61b7fff640 1 -- 172.21.15.104:0/1439488273 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61d007e050 con 0x564b208ebdb0 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61e21fd740 10 client.4653 fetch_fsmap learned FSMap version 7 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61e21fd740 1 -- 172.21.15.104:0/1439488273 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x564b205ee6b0 con 0x564b208ebdb0 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.172+0000 7f61b7fff640 1 -- 172.21.15.104:0/1439488273 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0070030 con 0x564b208ebdb0 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.173+0000 7f61b7fff640 1 -- 172.21.15.104:0/1439488273 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f61d0081020 con 0x564b208ebdb0 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.173+0000 7f61e21fd740 10 client.4653 fetch_fsmap finished waiting for FSMap version 7 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.173+0000 7f61e21fd740 10 client.4653 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.173+0000 7f61e21fd740 20 client.4653 populate_metadata read hostname 'smithi104' 2024-05-08T04:21:26.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.173+0000 7f61e21fd740 1 --2- 172.21.15.104:0/1439488273 >> [v2:172.21.15.104:6835/610189872,v1:172.21.15.104:6837/610189872] conn(0x564b208edd50 0x564b208ee130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.173+0000 7f61e21fd740 4 client.4653 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.173+0000 7f61e21fd740 1 -- 172.21.15.104:0/1439488273 --> [v2:172.21.15.104:6835/610189872,v1:172.21.15.104:6837/610189872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b2086e920 con 0x564b208edd50 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.173+0000 7f61dd1be640 1 --2- 172.21.15.104:0/1439488273 >> [v2:172.21.15.104:6835/610189872,v1:172.21.15.104:6837/610189872] conn(0x564b208edd50 0x564b208ee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.173+0000 7f61dd1be640 1 --2- 172.21.15.104:0/1439488273 >> [v2:172.21.15.104:6835/610189872,v1:172.21.15.104:6837/610189872] conn(0x564b208edd50 0x564b208ee130 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f0f6231b9b30e80 server_cookie=3690004af5c731f2 in_seq=0 out_seq=0 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.173+0000 7f61b7fff640 10 client.4653 ms_handle_connect on v2:172.21.15.104:6835/610189872 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.173+0000 7f61b7fff640 1 -- 172.21.15.104:0/1439488273 <== mds.0 v2:172.21.15.104:6835/610189872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564b2086e920 con 0x564b208edd50 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.173+0000 7f61b7fff640 10 client.4653 handle_command_reply: tid=0 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.174+0000 7f61e21fd740 1 client.4653 shutdown 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.174+0000 7f61e21fd740 1 -- 172.21.15.104:0/1439488273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 msgr2=0x564b208a6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.174+0000 7f61e21fd740 1 --2- 172.21.15.104:0/1439488273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 0x564b208a6c70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f61d00612b0 tx=0x7f61d0021040 comp rx=0 tx=0).stop 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.174+0000 7f61e21fd740 1 -- 172.21.15.104:0/1439488273 shutdown_connections 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.174+0000 7f61e21fd740 1 --2- 172.21.15.104:0/1439488273 >> [v2:172.21.15.104:6835/610189872,v1:172.21.15.104:6837/610189872] conn(0x564b208edd50 0x564b208ee130 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.174+0000 7f61e21fd740 1 --2- 172.21.15.104:0/1439488273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 0x564b208a6c70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.174+0000 7f61e21fd740 1 --2- 172.21.15.104:0/1439488273 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 0x564b208a6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.174+0000 7f61b7fff640 0 client.4653 ms_handle_reset on v2:172.21.15.104:6835/610189872 2024-05-08T04:21:26.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.174+0000 7f61e21fd740 1 --2- 172.21.15.104:0/1439488273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 0x564b208e9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.174+0000 7f61e21fd740 1 -- 172.21.15.104:0/1439488273 >> 172.21.15.104:0/1439488273 conn(0x564b208acf10 msgr2=0x564b208f55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:26.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.174+0000 7f61e21fd740 1 -- 172.21.15.104:0/1439488273 shutdown_connections 2024-05-08T04:21:26.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.174+0000 7f61e21fd740 1 -- 172.21.15.104:0/1439488273 wait complete. 2024-05-08T04:21:26.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.174+0000 7f61e21fd740 20 client.4653 trim_cache size 0 max 16384 2024-05-08T04:21:26.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.189+0000 7f61e21fd740 1 Processor -- start 2024-05-08T04:21:26.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.189+0000 7f61e21fd740 1 -- start start 2024-05-08T04:21:26.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.190+0000 7f61e21fd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 0x564b208a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.190+0000 7f61e21fd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 0x564b208a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.190+0000 7f61e21fd740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 0x564b208ac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.190+0000 7f61e21fd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d81f7b70 con 0x564b208ebdb0 2024-05-08T04:21:26.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.190+0000 7f61e21fd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d81f6f70 con 0x564b208d7230 2024-05-08T04:21:26.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.190+0000 7f61e21fd740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d81f7570 con 0x564b208f4ad0 2024-05-08T04:21:26.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.190+0000 7f61dc9bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 0x564b208a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.190+0000 7f61dc9bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 0x564b208a69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34290/0 (socket says 172.21.15.104:34290) 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.190+0000 7f61dc9bd640 1 -- 172.21.15.104:0/1155583163 learned_addr learned my addr 172.21.15.104:0/1155583163 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.190+0000 7f61dd1be640 1 --2- 172.21.15.104:0/1155583163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 0x564b208a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.190+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/1155583163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 0x564b208ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61dc9bd640 1 -- 172.21.15.104:0/1155583163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 msgr2=0x564b208ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61dc9bd640 1 --2- 172.21.15.104:0/1155583163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 0x564b208ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61dc9bd640 1 -- 172.21.15.104:0/1155583163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 msgr2=0x564b208a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61dc9bd640 1 --2- 172.21.15.104:0/1155583163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 0x564b208a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61dc9bd640 1 -- 172.21.15.104:0/1155583163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b20905ac0 con 0x564b208ebdb0 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61dc9bd640 1 --2- 172.21.15.104:0/1155583163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 0x564b208a69e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f61c800e8a0 tx=0x7f61c800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2875541abbf48bf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61c27fc640 1 -- 172.21.15.104:0/1155583163 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c801a030 con 0x564b208ebdb0 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61c27fc640 1 -- 172.21.15.104:0/1155583163 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c8010a40 con 0x564b208ebdb0 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61c27fc640 1 -- 172.21.15.104:0/1155583163 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8010c30 con 0x564b208ebdb0 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61e21fd740 1 -- 172.21.15.104:0/1155583163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 msgr2=0x564b208a69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61e21fd740 1 --2- 172.21.15.104:0/1155583163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 0x564b208a69e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f61c800e8a0 tx=0x7f61c800ed60 comp rx=0 tx=0).stop 2024-05-08T04:21:26.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61e21fd740 1 -- 172.21.15.104:0/1155583163 shutdown_connections 2024-05-08T04:21:26.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61e21fd740 1 --2- 172.21.15.104:0/1155583163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208f4ad0 0x564b208ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61e21fd740 1 --2- 172.21.15.104:0/1155583163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208ebdb0 0x564b208a69e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61e21fd740 1 --2- 172.21.15.104:0/1155583163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208d7230 0x564b208a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61e21fd740 1 -- 172.21.15.104:0/1155583163 >> 172.21.15.104:0/1155583163 conn(0x564b208acf10 msgr2=0x564b208f1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:26.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61e21fd740 1 -- 172.21.15.104:0/1155583163 shutdown_connections 2024-05-08T04:21:26.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.191+0000 7f61e21fd740 1 -- 172.21.15.104:0/1155583163 wait complete. 2024-05-08T04:21:26.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.192+0000 7f61e21fd740 1 -- start start 2024-05-08T04:21:26.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.192+0000 7f61e21fd740 1 Processor -- start 2024-05-08T04:21:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61e21fd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208d7230 0x564b2095d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61e21fd740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208ebdb0 0x564b208f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61e21fd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208f4ad0 0x564b208a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61e21fd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b208adcb0 con 0x564b208d7230 2024-05-08T04:21:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61e21fd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b207cc0c0 con 0x564b208f4ad0 2024-05-08T04:21:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61e21fd740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b208d98f0 con 0x564b208ebdb0 2024-05-08T04:21:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61e21fd740 10 client.0 _ll_register_callbacks cb 0x564b208a7c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T04:21:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61dd1be640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208d7230 0x564b2095d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61dd1be640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208d7230 0x564b2095d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34294/0 (socket says 172.21.15.104:34294) 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61dd1be640 1 -- 172.21.15.104:0/4058984745 learned_addr learned my addr 172.21.15.104:0/4058984745 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61dc9bd640 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208ebdb0 0x564b208f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208f4ad0 0x564b208a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61dd1be640 1 -- 172.21.15.104:0/4058984745 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208ebdb0 msgr2=0x564b208f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61dd1be640 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208ebdb0 0x564b208f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61dd1be640 1 -- 172.21.15.104:0/4058984745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208f4ad0 msgr2=0x564b208a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61dd1be640 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208f4ad0 0x564b208a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61dd1be640 1 -- 172.21.15.104:0/4058984745 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b208e8750 con 0x564b208d7230 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61dc9bd640 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208ebdb0 0x564b208f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61dd9bf640 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208f4ad0 0x564b208a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61dd1be640 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208d7230 0x564b2095d2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009630 tx=0x7f61d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e292c90c9b57581 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.193+0000 7f61b7fff640 1 -- 172.21.15.104:0/4058984745 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4037040 con 0x564b208d7230 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61b7fff640 1 -- 172.21.15.104:0/4058984745 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61d404c310 con 0x564b208d7230 2024-05-08T04:21:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61e21fd740 1 -- 172.21.15.104:0/4058984745 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61c8010a40 con 0x564b208d7230 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61b7fff640 1 -- 172.21.15.104:0/4058984745 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61d405c050 con 0x564b208d7230 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61e21fd740 10 client.4659 fetch_fsmap learned FSMap version 7 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61e21fd740 1 -- 172.21.15.104:0/4058984745 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x564b208ac0f0 con 0x564b208d7230 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61b7fff640 1 -- 172.21.15.104:0/4058984745 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c8010a40 con 0x564b208d7230 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61b7fff640 1 -- 172.21.15.104:0/4058984745 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 7) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f61d405f020 con 0x564b208d7230 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61e21fd740 10 client.4659 fetch_fsmap finished waiting for FSMap version 7 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61e21fd740 10 client.4659 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61e21fd740 20 client.4659 populate_metadata read hostname 'smithi104' 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61e21fd740 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.104:6835/610189872,v1:172.21.15.104:6837/610189872] conn(0x564b208a6af0 0x564b208f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61e21fd740 4 client.4659 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61e21fd740 1 -- 172.21.15.104:0/4058984745 --> [v2:172.21.15.104:6835/610189872,v1:172.21.15.104:6837/610189872] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564b2081cf50 con 0x564b208a6af0 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61dc9bd640 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.104:6835/610189872,v1:172.21.15.104:6837/610189872] conn(0x564b208a6af0 0x564b208f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61b7fff640 10 client.4659 ms_handle_connect on v2:172.21.15.104:6835/610189872 2024-05-08T04:21:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.194+0000 7f61dc9bd640 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.104:6835/610189872,v1:172.21.15.104:6837/610189872] conn(0x564b208a6af0 0x564b208f1b20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e785ea09737c42de server_cookie=1fd19c32f585a208 in_seq=0 out_seq=0 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61b7fff640 1 -- 172.21.15.104:0/4058984745 <== mds.0 v2:172.21.15.104:6835/610189872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x564b2081cf50 con 0x564b208a6af0 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61b7fff640 10 client.4659 handle_command_reply: tid=0 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61e21fd740 1 client.4659 shutdown 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61e21fd740 1 -- 172.21.15.104:0/4058984745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208d7230 msgr2=0x564b2095d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61e21fd740 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208d7230 0x564b2095d2f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009630 tx=0x7f61d4004730 comp rx=0 tx=0).stop 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61e21fd740 1 -- 172.21.15.104:0/4058984745 shutdown_connections 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61e21fd740 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.104:6835/610189872,v1:172.21.15.104:6837/610189872] conn(0x564b208a6af0 0x564b208f1b20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61e21fd740 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564b208f4ad0 0x564b208a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61e21fd740 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564b208ebdb0 0x564b208f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61b7fff640 0 client.4659 ms_handle_reset on v2:172.21.15.104:6835/610189872 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61e21fd740 1 --2- 172.21.15.104:0/4058984745 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x564b208d7230 0x564b2095d2f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61e21fd740 1 -- 172.21.15.104:0/4058984745 >> 172.21.15.104:0/4058984745 conn(0x564b208acf10 msgr2=0x564b208ee250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61e21fd740 1 -- 172.21.15.104:0/4058984745 shutdown_connections 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61e21fd740 1 -- 172.21.15.104:0/4058984745 wait complete. 2024-05-08T04:21:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61e21fd740 20 client.4659 trim_cache size 0 max 16384 2024-05-08T04:21:26.204 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:21:26.204 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "c8b1f73b-90d2-40b8-ad3c-a036617abfed", 2024-05-08T04:21:26.204 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-05-08T04:21:26.204 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4296, 2024-05-08T04:21:26.204 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-05-08T04:21:26.204 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-05-08T04:21:26.204 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-05-08T04:21:26.204 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 15.398107816, 2024-05-08T04:21:26.204 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 7, 2024-05-08T04:21:26.204 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 20, 2024-05-08T04:21:26.205 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 20, 2024-05-08T04:21:26.205 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 21.968658306999998 2024-05-08T04:21:26.205 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:21:26.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61df422640 1 -- 172.21.15.104:0/3689963684 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f61bc06b4d0 msgr2=0x7f61bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61df422640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f61bc06b4d0 0x7f61bc06d990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61d4034000 tx=0x7f61d402e000 comp rx=0 tx=0).stop 2024-05-08T04:21:26.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61df422640 1 -- 172.21.15.104:0/3689963684 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d815db30 msgr2=0x7f61d815fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.195+0000 7f61df422640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d815db30 0x7f61d815fb10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f61d000cdb0 tx=0x7f61d000a710 comp rx=0 tx=0).stop 2024-05-08T04:21:26.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.196+0000 7f61df422640 1 -- 172.21.15.104:0/3689963684 shutdown_connections 2024-05-08T04:21:26.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.196+0000 7f61df422640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f61bc06b4d0 0x7f61bc06d990 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.196+0000 7f61df422640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d815db30 0x7f61d815fb10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.196+0000 7f61df422640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61d80b93b0 0x7f61d80caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.196+0000 7f61df422640 1 --2- 172.21.15.104:0/3689963684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61d80b5970 0x7f61d80b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.196+0000 7f61df422640 1 -- 172.21.15.104:0/3689963684 >> 172.21.15.104:0/3689963684 conn(0x7f61d80d0430 msgr2=0x7f61d80b7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:26.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.196+0000 7f61df422640 1 -- 172.21.15.104:0/3689963684 shutdown_connections 2024-05-08T04:21:26.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.196+0000 7f61df422640 1 -- 172.21.15.104:0/3689963684 wait complete. 2024-05-08T04:21:26.208 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-08T04:21:26.232 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-08T04:21:26.232 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-08T04:21:26.232 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-08T04:21:26.232 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T04:21:26.232 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T04:21:26.232 INFO:tasks.ceph_fuse:client.2 config is {} 2024-05-08T04:21:26.232 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T04:21:26.232 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-08T04:21:26.233 INFO:tasks.ceph_fuse:client.1 config is {} 2024-05-08T04:21:26.233 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T04:21:26.233 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T04:21:26.233 INFO:tasks.ceph_fuse:client.3 config is {} 2024-05-08T04:21:26.233 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T04:21:26.233 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-08T04:21:26.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:26.233 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-05-08T04:21:26.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:26.249 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-05-08T04:21:26.316 INFO:teuthology.orchestra.run.smithi104.stderr:Cannot find device "ceph-brx" 2024-05-08T04:21:26.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:21:26.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:26.318 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2024-05-08T04:21:26.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:26.338 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2024-05-08T04:21:26.409 INFO:teuthology.orchestra.run.smithi183.stderr:Cannot find device "ceph-brx" 2024-05-08T04:21:26.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:21:26.411 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-08T04:21:26.411 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T04:21:26.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.510+0000 7f1492438640 1 Processor -- start 2024-05-08T04:21:26.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.510+0000 7f1492438640 1 -- start start 2024-05-08T04:21:26.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.511+0000 7f1492438640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f148c070c70 0x7f148c0d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.511+0000 7f1492438640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f148c15dbe0 0x7f148c15e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.511+0000 7f1492438640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c15d420 con 0x7f148c071050 2024-05-08T04:21:26.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.511+0000 7f1492438640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c0d16a0 con 0x7f148c070c70 2024-05-08T04:21:26.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.511+0000 7f1492438640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0d0eb0 con 0x7f148c15dbe0 2024-05-08T04:21:26.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.512+0000 7f14909d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f148c15dbe0 0x7f148c15e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.512+0000 7f148bfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f148c070c70 0x7f148c0d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.512+0000 7f14909d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f148c15dbe0 0x7f148c15e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:56500/0 (socket says 172.21.15.104:56500) 2024-05-08T04:21:26.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.512+0000 7f1483fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f148c071050 0x7f148c15c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:35306/0 (socket says 172.21.15.104:35306) 2024-05-08T04:21:26.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.512+0000 7f148bfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f148c070c70 0x7f148c0d0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:53532/0 (socket says 172.21.15.104:53532) 2024-05-08T04:21:26.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.512+0000 7f14909d5640 1 -- 172.21.15.104:0/2556877181 learned_addr learned my addr 172.21.15.104:0/2556877181 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:26.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.512+0000 7f14909d5640 1 -- 172.21.15.104:0/2556877181 >> v2:172.21.15.183:3300/0 conn(0x7f148c070c70 msgr2=0x7f148c0d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:26.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.512+0000 7f14909d5640 1 --2- 172.21.15.104:0/2556877181 >> v2:172.21.15.183:3300/0 conn(0x7f148c070c70 0x7f148c0d0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.512+0000 7f14909d5640 1 -- 172.21.15.104:0/2556877181 >> v1:172.21.15.183:6789/0 conn(0x7f148c071050 legacy=0x7f148c15c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.512+0000 7f14909d5640 1 -- 172.21.15.104:0/2556877181 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0d10e0 con 0x7f148c15dbe0 2024-05-08T04:21:26.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.512+0000 7f148bfff640 1 --2- 172.21.15.104:0/2556877181 >> v2:172.21.15.183:3300/0 conn(0x7f148c070c70 0x7f148c0d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.513+0000 7f14909d5640 1 --2- 172.21.15.104:0/2556877181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f148c15dbe0 0x7f148c15e030 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1484009e50 tx=0x7f148402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7442fd2362e81643 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.513+0000 7f148b7fe640 1 -- 172.21.15.104:0/2556877181 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484036070 con 0x7f148c15dbe0 2024-05-08T04:21:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.513+0000 7f148b7fe640 1 -- 172.21.15.104:0/2556877181 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1484031600 con 0x7f148c15dbe0 2024-05-08T04:21:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.513+0000 7f148b7fe640 1 -- 172.21.15.104:0/2556877181 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14840319d0 con 0x7f148c15dbe0 2024-05-08T04:21:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.513+0000 7f1492438640 1 -- 172.21.15.104:0/2556877181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f148c15dbe0 msgr2=0x7f148c15e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.513+0000 7f1492438640 1 --2- 172.21.15.104:0/2556877181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f148c15dbe0 0x7f148c15e030 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1484009e50 tx=0x7f148402a710 comp rx=0 tx=0).stop 2024-05-08T04:21:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.513+0000 7f1492438640 1 -- 172.21.15.104:0/2556877181 shutdown_connections 2024-05-08T04:21:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.513+0000 7f1492438640 1 --2- 172.21.15.104:0/2556877181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f148c15dbe0 0x7f148c15e030 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.513+0000 7f1492438640 1 --2- 172.21.15.104:0/2556877181 >> v2:172.21.15.183:3300/0 conn(0x7f148c070c70 0x7f148c0d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.513+0000 7f1492438640 1 -- 172.21.15.104:0/2556877181 >> 172.21.15.104:0/2556877181 conn(0x7f148c0b3450 msgr2=0x7f148c0b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.513+0000 7f1492438640 1 -- 172.21.15.104:0/2556877181 shutdown_connections 2024-05-08T04:21:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.514+0000 7f1492438640 1 -- 172.21.15.104:0/2556877181 wait complete. 2024-05-08T04:21:26.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.515+0000 7f1492438640 1 Processor -- start 2024-05-08T04:21:26.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.515+0000 7f1492438640 1 -- start start 2024-05-08T04:21:26.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.515+0000 7f1492438640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f148c070c70 0x7f148c1e51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.515+0000 7f1492438640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f148c071050 0x7f148c0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.515+0000 7f1492438640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f148c15dbe0 0x7f148c0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.515+0000 7f1492438640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c071500 con 0x7f148c15dbe0 2024-05-08T04:21:26.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.515+0000 7f1492438640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c15d6c0 con 0x7f148c070c70 2024-05-08T04:21:26.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.515+0000 7f1492438640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c15cca0 con 0x7f148c071050 2024-05-08T04:21:26.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.515+0000 7f14909d5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f148c15dbe0 0x7f148c0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f14909d5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f148c15dbe0 0x7f148c0b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34298/0 (socket says 172.21.15.104:34298) 2024-05-08T04:21:26.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f14909d5640 1 -- 172.21.15.104:0/3401955088 learned_addr learned my addr 172.21.15.104:0/3401955088 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:26.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f1483fff640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f148c071050 0x7f148c0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f148bfff640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f148c070c70 0x7f148c1e51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f14909d5640 1 -- 172.21.15.104:0/3401955088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f148c071050 msgr2=0x7f148c0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f14909d5640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f148c071050 0x7f148c0b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f14909d5640 1 -- 172.21.15.104:0/3401955088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f148c070c70 msgr2=0x7f148c1e51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f14909d5640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f148c070c70 0x7f148c1e51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f14909d5640 1 -- 172.21.15.104:0/3401955088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c1e5ef0 con 0x7f148c15dbe0 2024-05-08T04:21:26.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f14909d5640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f148c15dbe0 0x7f148c0b5db0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1484009e50 tx=0x7f1484004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:26.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f14897fa640 1 -- 172.21.15.104:0/3401955088 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484036050 con 0x7f148c15dbe0 2024-05-08T04:21:26.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f14897fa640 1 -- 172.21.15.104:0/3401955088 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1484042070 con 0x7f148c15dbe0 2024-05-08T04:21:26.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f14897fa640 1 -- 172.21.15.104:0/3401955088 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484009510 con 0x7f148c15dbe0 2024-05-08T04:21:26.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f1492438640 1 -- 172.21.15.104:0/3401955088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148c1e61d0 con 0x7f148c15dbe0 2024-05-08T04:21:26.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.516+0000 7f1492438640 1 -- 172.21.15.104:0/3401955088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c1e6790 con 0x7f148c15dbe0 2024-05-08T04:21:26.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.517+0000 7f1492438640 1 -- 172.21.15.104:0/3401955088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c075010 con 0x7f148c15dbe0 2024-05-08T04:21:26.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.518+0000 7f14897fa640 1 -- 172.21.15.104:0/3401955088 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1484007bf0 con 0x7f148c15dbe0 2024-05-08T04:21:26.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.518+0000 7f14897fa640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f146c06b4d0 0x7f146c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:26.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.518+0000 7f14897fa640 1 -- 172.21.15.104:0/3401955088 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14840ab050 con 0x7f148c15dbe0 2024-05-08T04:21:26.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.518+0000 7f148bfff640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f146c06b4d0 0x7f146c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:26.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.519+0000 7f148bfff640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f146c06b4d0 0x7f146c06d990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f147c009560 tx=0x7f147c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:26.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.522+0000 7f14897fa640 1 -- 172.21.15.104:0/3401955088 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1484079a30 con 0x7f148c15dbe0 2024-05-08T04:21:26.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.732+0000 7f1492438640 1 -- 172.21.15.104:0/3401955088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f148c0b4180 con 0x7f148c15dbe0 2024-05-08T04:21:26.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.732+0000 7f14897fa640 1 -- 172.21.15.104:0/3401955088 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f148407dad0 con 0x7f148c15dbe0 2024-05-08T04:21:26.733 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T04:21:26.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.734+0000 7f1492438640 1 -- 172.21.15.104:0/3401955088 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f146c06b4d0 msgr2=0x7f146c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.734+0000 7f1492438640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f146c06b4d0 0x7f146c06d990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f147c009560 tx=0x7f147c009190 comp rx=0 tx=0).stop 2024-05-08T04:21:26.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.734+0000 7f1492438640 1 -- 172.21.15.104:0/3401955088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f148c15dbe0 msgr2=0x7f148c0b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:26.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.734+0000 7f1492438640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f148c15dbe0 0x7f148c0b5db0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1484009e50 tx=0x7f1484004a40 comp rx=0 tx=0).stop 2024-05-08T04:21:26.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.734+0000 7f1492438640 1 -- 172.21.15.104:0/3401955088 shutdown_connections 2024-05-08T04:21:26.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.734+0000 7f1492438640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f146c06b4d0 0x7f146c06d990 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.734+0000 7f1492438640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f148c15dbe0 0x7f148c0b5db0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.734+0000 7f1492438640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f148c071050 0x7f148c0b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.734+0000 7f1492438640 1 --2- 172.21.15.104:0/3401955088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f148c070c70 0x7f148c1e51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:26.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.734+0000 7f1492438640 1 -- 172.21.15.104:0/3401955088 >> 172.21.15.104:0/3401955088 conn(0x7f148c0b3450 msgr2=0x7f148c0b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:26.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.734+0000 7f1492438640 1 -- 172.21.15.104:0/3401955088 shutdown_connections 2024-05-08T04:21:26.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:26.734+0000 7f1492438640 1 -- 172.21.15.104:0/3401955088 wait complete. 2024-05-08T04:21:26.746 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T04:21:26.747 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T04:21:26.747 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-05-08T04:21:26.747 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T04:21:26.747 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T04:21:26.747 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T04:21:26.747 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T04:21:26.747 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T04:21:26.747 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T04:21:26.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:26.747 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-05-08T04:21:26.763 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:21:26.763 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:21:26.763 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:21:26.763 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:26.763 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-05-08T04:21:26.763 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:26.763 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:21:26.763 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:26.763 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-05-08T04:21:26.763 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:21:26.763 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:26.763 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-05-08T04:21:26.764 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:21:26.764 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:26.764 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T04:21:26.764 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:26.764 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T04:21:26.764 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42691sec preferred_lft 42691sec 2024-05-08T04:21:26.764 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link 2024-05-08T04:21:26.764 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:26.764 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T04:21:26.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:26.765 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-05-08T04:21:26.765 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-08T04:21:26.765 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add name ceph-brx type bridge 2024-05-08T04:21:26.765 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr flush dev ceph-brx 2024-05-08T04:21:26.765 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set ceph-brx up 2024-05-08T04:21:26.765 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T04:21:26.765 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-08T04:21:26.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:26.926 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T04:21:26.950 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-05-08T04:21:26.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:26.952 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-05-08T04:21:27.059 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-05-08T04:21:27.059 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T04:21:27.059 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T04:21:27.059 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T04:21:27.059 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T04:21:27.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:27.060 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-05-08T04:21:27.060 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-08T04:21:27.060 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T04:21:27.060 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T04:21:27.060 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T04:21:27.060 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-08T04:21:27.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:27.251 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-05-08T04:21:27.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:27.267 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2024-05-08T04:21:27.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:27.323 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-05-08T04:21:27.323 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-08T04:21:27.323 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:21:27.323 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-08T04:21:27.324 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-08T04:21:27.403 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-08T04:21:27.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:27.404 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-05-08T04:21:27.404 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-08T04:21:27.404 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-08T04:21:27.404 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T04:21:27.404 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-08T04:21:27.405 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-08T04:21:27.405 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-08T04:21:27.405 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-08T04:21:27.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:27.537 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-05-08T04:21:27.537 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-08T04:21:27.537 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-05-08T04:21:27.537 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T04:21:27.537 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-08T04:21:27.575 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-08T04:21:27.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:21:27.575 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T04:21:27.630 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T04:21:27.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:21:27.631 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T04:21:27.686 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-05-08T04:21:27.752 DEBUG:teuthology.orchestra.run.smithi104:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:21:27.809 INFO:teuthology.orchestra.run.smithi104.stdout:/proc 2024-05-08T04:21:27.809 INFO:teuthology.orchestra.run.smithi104.stdout:/sys 2024-05-08T04:21:27.809 INFO:teuthology.orchestra.run.smithi104.stdout:/dev 2024-05-08T04:21:27.809 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/security 2024-05-08T04:21:27.809 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/shm 2024-05-08T04:21:27.809 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/pts 2024-05-08T04:21:27.809 INFO:teuthology.orchestra.run.smithi104.stdout:/run 2024-05-08T04:21:27.810 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/cgroup 2024-05-08T04:21:27.810 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/pstore 2024-05-08T04:21:27.810 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/bpf 2024-05-08T04:21:27.810 INFO:teuthology.orchestra.run.smithi104.stdout:/ 2024-05-08T04:21:27.810 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/selinux 2024-05-08T04:21:27.810 INFO:teuthology.orchestra.run.smithi104.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:21:27.810 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/mqueue 2024-05-08T04:21:27.810 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/hugepages 2024-05-08T04:21:27.810 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/debug 2024-05-08T04:21:27.810 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/tracing 2024-05-08T04:21:27.810 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:21:27.810 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/fuse/connections 2024-05-08T04:21:27.810 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/config 2024-05-08T04:21:27.811 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:21:27.811 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:21:27.811 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:21:27.811 INFO:teuthology.orchestra.run.smithi104.stdout:/run/user/1000 2024-05-08T04:21:27.811 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph 2024-05-08T04:21:27.811 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-0 2024-05-08T04:21:27.811 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-1 2024-05-08T04:21:27.811 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-2 2024-05-08T04:21:27.811 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-3 2024-05-08T04:21:27.811 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns 2024-05-08T04:21:27.811 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:21:27.811 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:21:27.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:27.812 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-05-08T04:21:27.864 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T04:21:27.864 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-08T04:21:27.907 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-05-08T04:21:27.932 DEBUG:teuthology.orchestra.run.smithi104:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:21:27.990 INFO:teuthology.orchestra.run.smithi104.stdout:/proc 2024-05-08T04:21:27.990 INFO:teuthology.orchestra.run.smithi104.stdout:/sys 2024-05-08T04:21:27.990 INFO:teuthology.orchestra.run.smithi104.stdout:/dev 2024-05-08T04:21:27.990 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/security 2024-05-08T04:21:27.990 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/shm 2024-05-08T04:21:27.990 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/pts 2024-05-08T04:21:27.990 INFO:teuthology.orchestra.run.smithi104.stdout:/run 2024-05-08T04:21:27.990 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/cgroup 2024-05-08T04:21:27.990 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/pstore 2024-05-08T04:21:27.990 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/bpf 2024-05-08T04:21:27.990 INFO:teuthology.orchestra.run.smithi104.stdout:/ 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/selinux 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/mqueue 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/hugepages 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/debug 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/tracing 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/fuse/connections 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/config 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/run/user/1000 2024-05-08T04:21:27.991 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph 2024-05-08T04:21:27.992 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-0 2024-05-08T04:21:27.992 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-1 2024-05-08T04:21:27.992 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-2 2024-05-08T04:21:27.992 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-3 2024-05-08T04:21:27.992 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns 2024-05-08T04:21:27.992 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:21:27.992 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:21:27.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:27.992 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-05-08T04:21:27.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:2024-05-08T04:21:27.993+0000 7f5d687cc480 -1 init, newargv = 0x5616f7c97d10 newargc=15 2024-05-08T04:21:27.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[44489]: starting ceph client 2024-05-08T04:21:28.000 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[44489]: starting fuse 2024-05-08T04:21:28.014 INFO:teuthology.orchestra.run.smithi104.stdout:41 2024-05-08T04:21:28.014 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-05-08T04:21:28.014 DEBUG:teuthology.orchestra.run.smithi104:> sudo stdin-killer -- python3 -c ' 2024-05-08T04:21:28.014 DEBUG:teuthology.orchestra.run.smithi104:> import glob 2024-05-08T04:21:28.014 DEBUG:teuthology.orchestra.run.smithi104:> import re 2024-05-08T04:21:28.014 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-05-08T04:21:28.014 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2024-05-08T04:21:28.014 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> def _find_admin_socket(client_name): 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> files = glob.glob(asok_path) 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> # Given a non-glob path, it better be there 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> if "*" not in asok_path: 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> assert(len(files) == 1) 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> return files[0] 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> for f in files: 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> contents = proc_f.read() 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> if mountpoint in contents: 2024-05-08T04:21:28.015 DEBUG:teuthology.orchestra.run.smithi104:> return f 2024-05-08T04:21:28.016 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T04:21:28.016 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:21:28.016 DEBUG:teuthology.orchestra.run.smithi104:> print(_find_admin_socket("client.0")) 2024-05-08T04:21:28.016 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-05-08T04:21:28.132 INFO:teuthology.orchestra.run.smithi104.stdout:/var/run/ceph/ceph-client.0.44489.asok 2024-05-08T04:21:28.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T04:21:28.143 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44489.asok 2024-05-08T04:21:28.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:28.143 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44489.asok status 2024-05-08T04:21:28.280 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:21:28.280 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": { 2024-05-08T04:21:28.280 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", 2024-05-08T04:21:28.280 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", 2024-05-08T04:21:28.280 INFO:teuthology.orchestra.run.smithi104.stdout: "entity_id": "0", 2024-05-08T04:21:28.280 INFO:teuthology.orchestra.run.smithi104.stdout: "hostname": "smithi104", 2024-05-08T04:21:28.280 INFO:teuthology.orchestra.run.smithi104.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-08T04:21:28.280 INFO:teuthology.orchestra.run.smithi104.stdout: "pid": "44489", 2024-05-08T04:21:28.280 INFO:teuthology.orchestra.run.smithi104.stdout: "root": "/" 2024-05-08T04:21:28.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:21:28.280 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_count": 0, 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_pinned_count": 0, 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4671, 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: "inst": { 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: "name": { 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "client", 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: "num": 4671 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3624679041 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:21:28.281 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-05-08T04:21:28.282 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-05-08T04:21:28.282 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:21:28.282 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3624679041 2024-05-08T04:21:28.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:21:28.282 INFO:teuthology.orchestra.run.smithi104.stdout: "inst_str": "client.4671 192.168.0.1:0/3624679041", 2024-05-08T04:21:28.282 INFO:teuthology.orchestra.run.smithi104.stdout: "addr_str": "192.168.0.1:0/3624679041", 2024-05-08T04:21:28.282 INFO:teuthology.orchestra.run.smithi104.stdout: "inode_count": 1, 2024-05-08T04:21:28.282 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_epoch": 7, 2024-05-08T04:21:28.282 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch": 20, 2024-05-08T04:21:28.282 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch_barrier": 0, 2024-05-08T04:21:28.282 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklisted": false, 2024-05-08T04:21:28.282 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs" 2024-05-08T04:21:28.282 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:21:28.288 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T04:21:28.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.387+0000 7f719e1c8640 1 Processor -- start 2024-05-08T04:21:28.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.387+0000 7f719e1c8640 1 -- start start 2024-05-08T04:21:28.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.388+0000 7f719e1c8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f719815bac0 0x7f71980b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:28.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.388+0000 7f719e1c8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f719806ab60 0x7f719806afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:28.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.388+0000 7f719e1c8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71980b1e30 con 0x7f71980cc3a0 2024-05-08T04:21:28.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.388+0000 7f719e1c8640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71980b1c00 con 0x7f719806ab60 2024-05-08T04:21:28.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.388+0000 7f719e1c8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719806b500 con 0x7f719815bac0 2024-05-08T04:21:28.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.388+0000 7f7197fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f71980cc3a0 0x7f71980cc830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46836/0 (socket says 172.21.15.104:46836) 2024-05-08T04:21:28.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.388+0000 7f7197fff640 1 -- 172.21.15.104:0/672041437 learned_addr learned my addr 172.21.15.104:0/672041437 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:28.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.388+0000 7f71977fe640 1 --2- 172.21.15.104:0/672041437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f719815bac0 0x7f71980b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:28.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.388+0000 7f7196ffd640 1 --2- 172.21.15.104:0/672041437 >> v2:172.21.15.183:3300/0 conn(0x7f719806ab60 0x7f719806afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:28.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.388+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790075936 0 0) 0x7f71980b1e30 con 0x7f71980cc3a0 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.388+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7180003520 con 0x7f71980cc3a0 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3557679703 0 0) 0x7f7180003520 con 0x7f71980cc3a0 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f719815bac0 msgr2=0x7f71980b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 --2- 172.21.15.104:0/672041437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f719815bac0 0x7f71980b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 >> v2:172.21.15.183:3300/0 conn(0x7f719806ab60 msgr2=0x7f719806afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 --2- 172.21.15.104:0/672041437 >> v2:172.21.15.183:3300/0 conn(0x7f719806ab60 0x7f719806afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71980b36c0 con 0x7f71980cc3a0 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f71900019f0 con 0x7f71980cc3a0 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 >> v1:172.21.15.104:6789/0 conn(0x7f71980cc3a0 legacy=0x7f71980cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 --2- 172.21.15.104:0/672041437 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71800039e0 0x7f7180003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 --2- 172.21.15.104:0/672041437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f719815bac0 0x7f7180004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 --2- 172.21.15.104:0/672041437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7180004d40 0x7f71800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718000b9c0 con 0x7f71800039e0 2024-05-08T04:21:28.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718000bb40 con 0x7f7180004d40 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718000bcf0 con 0x7f719815bac0 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71977fe640 1 --2- 172.21.15.104:0/672041437 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71800039e0 0x7f7180003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f7196ffd640 1 --2- 172.21.15.104:0/672041437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f719815bac0 0x7f7180004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f7197fff640 1 --2- 172.21.15.104:0/672041437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7180004d40 0x7f71800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71977fe640 1 -- 172.21.15.104:0/672041437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f719815bac0 msgr2=0x7f7180004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71977fe640 1 --2- 172.21.15.104:0/672041437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f719815bac0 0x7f7180004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71977fe640 1 -- 172.21.15.104:0/672041437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7180004d40 msgr2=0x7f71800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71977fe640 1 --2- 172.21.15.104:0/672041437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7180004d40 0x7f71800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f71977fe640 1 -- 172.21.15.104:0/672041437 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180003520 con 0x7f71800039e0 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.389+0000 7f7197fff640 1 --2- 172.21.15.104:0/672041437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7180004d40 0x7f71800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.390+0000 7f71977fe640 1 --2- 172.21.15.104:0/672041437 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71800039e0 0x7f7180003e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7188009ac0 tx=0x7f7180005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380a4dd878d106dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.390+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188036070 con 0x7f71800039e0 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.390+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7188031400 con 0x7f71800039e0 2024-05-08T04:21:28.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.390+0000 7f71967fc640 1 -- 172.21.15.104:0/672041437 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188009690 con 0x7f71800039e0 2024-05-08T04:21:28.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.390+0000 7f719e1c8640 1 -- 172.21.15.104:0/672041437 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71800039e0 msgr2=0x7f7180003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:28.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.390+0000 7f719e1c8640 1 --2- 172.21.15.104:0/672041437 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71800039e0 0x7f7180003e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7188009ac0 tx=0x7f7180005830 comp rx=0 tx=0).stop 2024-05-08T04:21:28.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.390+0000 7f7197fff640 1 -- 172.21.15.104:0/672041437 reap_dead start 2024-05-08T04:21:28.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.391+0000 7f719e1c8640 1 -- 172.21.15.104:0/672041437 shutdown_connections 2024-05-08T04:21:28.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.391+0000 7f719e1c8640 1 -- 172.21.15.104:0/672041437 >> 172.21.15.104:0/672041437 conn(0x7f71980b2220 msgr2=0x7f71980b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:28.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.391+0000 7f719e1c8640 1 -- 172.21.15.104:0/672041437 shutdown_connections 2024-05-08T04:21:28.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.391+0000 7f719e1c8640 1 -- 172.21.15.104:0/672041437 wait complete. 2024-05-08T04:21:28.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.392+0000 7f719e1c8640 1 Processor -- start 2024-05-08T04:21:28.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.392+0000 7f719e1c8640 1 -- start start 2024-05-08T04:21:28.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f719e1c8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71800039e0 0x7f71981f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:28.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f719e1c8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71981f45b0 0x7f71981f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:28.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f719e1c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71980c8170 0x7f71980c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:28.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f719e1c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71980c3f00 con 0x7f71980c8170 2024-05-08T04:21:28.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f719e1c8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71980b3d10 con 0x7f71800039e0 2024-05-08T04:21:28.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f719e1c8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719815bea0 con 0x7f71981f45b0 2024-05-08T04:21:28.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f7197fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71980c8170 0x7f71980c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:28.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f7197fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71980c8170 0x7f71980c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38274/0 (socket says 172.21.15.104:38274) 2024-05-08T04:21:28.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f7197fff640 1 -- 172.21.15.104:0/1669008842 learned_addr learned my addr 172.21.15.104:0/1669008842 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:28.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f71977fe640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71800039e0 0x7f71981f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f7197fff640 1 -- 172.21.15.104:0/1669008842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71981f45b0 msgr2=0x7f71981f4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f7197fff640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71981f45b0 0x7f71981f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f7197fff640 1 -- 172.21.15.104:0/1669008842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71800039e0 msgr2=0x7f71981f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f7197fff640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71800039e0 0x7f71981f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f7197fff640 1 -- 172.21.15.104:0/1669008842 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71981f0ee0 con 0x7f71980c8170 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f71977fe640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71800039e0 0x7f71981f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f7197fff640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71980c8170 0x7f71980c85f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7190002040 tx=0x7f719000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f717ffff640 1 -- 172.21.15.104:0/1669008842 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719000ed40 con 0x7f71980c8170 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f717ffff640 1 -- 172.21.15.104:0/1669008842 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7190018070 con 0x7f71980c8170 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f719e1c8640 1 -- 172.21.15.104:0/1669008842 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71980c8e60 con 0x7f71980c8170 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f717ffff640 1 -- 172.21.15.104:0/1669008842 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190013640 con 0x7f71980c8170 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.393+0000 7f719e1c8640 1 -- 172.21.15.104:0/1669008842 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719809bf40 con 0x7f71980c8170 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.394+0000 7f719e1c8640 1 -- 172.21.15.104:0/1669008842 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7198075010 con 0x7f71980c8170 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.395+0000 7f717ffff640 1 -- 172.21.15.104:0/1669008842 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f71900137e0 con 0x7f71980c8170 2024-05-08T04:21:28.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.395+0000 7f717ffff640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f718406b500 0x7f718406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:28.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.396+0000 7f717ffff640 1 -- 172.21.15.104:0/1669008842 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f719008a560 con 0x7f71980c8170 2024-05-08T04:21:28.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.396+0000 7f71977fe640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f718406b500 0x7f718406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:28.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.396+0000 7f71977fe640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f718406b500 0x7f718406d9c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7188033000 tx=0x7f7188008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:28.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.400+0000 7f717ffff640 1 -- 172.21.15.104:0/1669008842 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f71900593e0 con 0x7f71980c8170 2024-05-08T04:21:28.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.606+0000 7f719e1c8640 1 -- 172.21.15.104:0/1669008842 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f719809ba30 con 0x7f71980c8170 2024-05-08T04:21:28.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.606+0000 7f717ffff640 1 -- 172.21.15.104:0/1669008842 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7190058ce0 con 0x7f71980c8170 2024-05-08T04:21:28.608 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T04:21:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.608+0000 7f719e1c8640 1 -- 172.21.15.104:0/1669008842 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f718406b500 msgr2=0x7f718406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.608+0000 7f719e1c8640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f718406b500 0x7f718406d9c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7188033000 tx=0x7f7188008030 comp rx=0 tx=0).stop 2024-05-08T04:21:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.608+0000 7f719e1c8640 1 -- 172.21.15.104:0/1669008842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71980c8170 msgr2=0x7f71980c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.608+0000 7f719e1c8640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71980c8170 0x7f71980c85f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7190002040 tx=0x7f719000e530 comp rx=0 tx=0).stop 2024-05-08T04:21:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.608+0000 7f719e1c8640 1 -- 172.21.15.104:0/1669008842 shutdown_connections 2024-05-08T04:21:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.608+0000 7f719e1c8640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f718406b500 0x7f718406d9c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.608+0000 7f719e1c8640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71980c8170 0x7f71980c85f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.608+0000 7f719e1c8640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71981f45b0 0x7f71981f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.608+0000 7f719e1c8640 1 --2- 172.21.15.104:0/1669008842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71800039e0 0x7f71981f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.608+0000 7f719e1c8640 1 -- 172.21.15.104:0/1669008842 >> 172.21.15.104:0/1669008842 conn(0x7f71980b2220 msgr2=0x7f71981599f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.608+0000 7f719e1c8640 1 -- 172.21.15.104:0/1669008842 shutdown_connections 2024-05-08T04:21:28.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:28.608+0000 7f719e1c8640 1 -- 172.21.15.104:0/1669008842 wait complete. 2024-05-08T04:21:28.620 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T04:21:28.620 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T04:21:28.620 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-05-08T04:21:28.620 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-08T04:21:28.620 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-08T04:21:28.620 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T04:21:28.621 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T04:21:28.621 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T04:21:28.621 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-08T04:21:28.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:28.621 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-05-08T04:21:28.637 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:21:28.637 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:21:28.637 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:21:28.637 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:28.637 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-05-08T04:21:28.637 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:28.637 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:21:28.637 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:28.637 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-05-08T04:21:28.638 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:21:28.638 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:28.638 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-05-08T04:21:28.638 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:21:28.638 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:28.638 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T04:21:28.638 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:28.638 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T04:21:28.638 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42689sec preferred_lft 42689sec 2024-05-08T04:21:28.638 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link 2024-05-08T04:21:28.638 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:28.639 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T04:21:28.639 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether ca:ef:a4:8b:34:e2 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:28.639 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T04:21:28.639 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:28.639 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::fc58:88ff:fed3:93d7/64 scope link 2024-05-08T04:21:28.639 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:28.639 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:21:28.639 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether ca:ef:a4:8b:34:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:21:28.639 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::c8ef:a4ff:fe8b:34e2/64 scope link tentative 2024-05-08T04:21:28.639 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:28.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:28.639 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T04:21:28.700 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-05-08T04:21:28.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:28.702 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-05-08T04:21:28.759 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-05-08T04:21:28.759 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T04:21:28.760 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T04:21:28.760 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T04:21:28.760 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T04:21:28.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:28.760 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-05-08T04:21:28.760 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-08T04:21:28.760 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T04:21:28.760 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T04:21:28.760 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T04:21:28.760 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-08T04:21:28.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:28.849 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-05-08T04:21:28.864 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T04:21:28.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:28.864 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2024-05-08T04:21:28.919 INFO:teuthology.orchestra.run.smithi104.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-08T04:21:28.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:28.920 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-05-08T04:21:28.920 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-08T04:21:28.920 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:21:28.920 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-08T04:21:28.920 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-08T04:21:28.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:28.997 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-08T04:21:29.063 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:21:29.063 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:21:29.063 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:21:29.063 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:29.063 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-05-08T04:21:29.063 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:29.063 INFO:teuthology.orchestra.run.smithi104.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T04:21:29.063 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 6e:2c:95:7d:34:43 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T04:21:29.063 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T04:21:29.063 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:29.063 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::6c2c:95ff:fe7d:3443/64 scope link 2024-05-08T04:21:29.063 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:29.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:29.065 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-08T04:21:29.129 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:21:29.129 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:21:29.129 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:21:29.129 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:29.129 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-05-08T04:21:29.130 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:29.130 INFO:teuthology.orchestra.run.smithi104.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T04:21:29.130 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 6e:2c:95:7d:34:43 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T04:21:29.130 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T04:21:29.130 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:29.130 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::6c2c:95ff:fe7d:3443/64 scope link 2024-05-08T04:21:29.130 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:29.132 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-08T04:21:29.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:29.132 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-05-08T04:21:29.132 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-08T04:21:29.132 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-08T04:21:29.132 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-08T04:21:29.132 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-08T04:21:29.132 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-08T04:21:29.132 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-08T04:21:29.132 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-08T04:21:29.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:29.245 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-05-08T04:21:29.245 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-08T04:21:29.245 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.1 up 2024-05-08T04:21:29.245 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.1 master ceph-brx 2024-05-08T04:21:29.245 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-08T04:21:29.283 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-05-08T04:21:29.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:21:29.283 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-08T04:21:29.338 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-08T04:21:29.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:21:29.339 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-08T04:21:29.394 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-05-08T04:21:29.459 DEBUG:teuthology.orchestra.run.smithi104:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:21:29.516 INFO:teuthology.orchestra.run.smithi104.stdout:/proc 2024-05-08T04:21:29.517 INFO:teuthology.orchestra.run.smithi104.stdout:/sys 2024-05-08T04:21:29.517 INFO:teuthology.orchestra.run.smithi104.stdout:/dev 2024-05-08T04:21:29.517 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/security 2024-05-08T04:21:29.517 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/shm 2024-05-08T04:21:29.517 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/pts 2024-05-08T04:21:29.517 INFO:teuthology.orchestra.run.smithi104.stdout:/run 2024-05-08T04:21:29.517 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/cgroup 2024-05-08T04:21:29.517 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/pstore 2024-05-08T04:21:29.517 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/bpf 2024-05-08T04:21:29.517 INFO:teuthology.orchestra.run.smithi104.stdout:/ 2024-05-08T04:21:29.518 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/selinux 2024-05-08T04:21:29.518 INFO:teuthology.orchestra.run.smithi104.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:21:29.518 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/mqueue 2024-05-08T04:21:29.518 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/hugepages 2024-05-08T04:21:29.518 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/debug 2024-05-08T04:21:29.518 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/tracing 2024-05-08T04:21:29.518 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:21:29.518 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/fuse/connections 2024-05-08T04:21:29.518 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/config 2024-05-08T04:21:29.518 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:21:29.518 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:21:29.518 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:21:29.519 INFO:teuthology.orchestra.run.smithi104.stdout:/run/user/1000 2024-05-08T04:21:29.519 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph 2024-05-08T04:21:29.519 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-0 2024-05-08T04:21:29.519 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-1 2024-05-08T04:21:29.519 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-2 2024-05-08T04:21:29.519 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-3 2024-05-08T04:21:29.519 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns 2024-05-08T04:21:29.519 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:21:29.519 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:21:29.519 INFO:teuthology.orchestra.run.smithi104.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-08T04:21:29.519 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:21:29.519 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:21:29.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:29.520 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-05-08T04:21:29.572 INFO:teuthology.orchestra.run.smithi104.stdout:41 2024-05-08T04:21:29.572 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-05-08T04:21:29.573 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-05-08T04:21:29.615 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-05-08T04:21:29.640 DEBUG:teuthology.orchestra.run.smithi104:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:21:29.697 INFO:teuthology.orchestra.run.smithi104.stdout:/proc 2024-05-08T04:21:29.697 INFO:teuthology.orchestra.run.smithi104.stdout:/sys 2024-05-08T04:21:29.697 INFO:teuthology.orchestra.run.smithi104.stdout:/dev 2024-05-08T04:21:29.697 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/security 2024-05-08T04:21:29.697 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/shm 2024-05-08T04:21:29.697 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/pts 2024-05-08T04:21:29.697 INFO:teuthology.orchestra.run.smithi104.stdout:/run 2024-05-08T04:21:29.697 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/cgroup 2024-05-08T04:21:29.697 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/pstore 2024-05-08T04:21:29.698 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/bpf 2024-05-08T04:21:29.698 INFO:teuthology.orchestra.run.smithi104.stdout:/ 2024-05-08T04:21:29.698 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/selinux 2024-05-08T04:21:29.698 INFO:teuthology.orchestra.run.smithi104.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:21:29.698 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/mqueue 2024-05-08T04:21:29.698 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/hugepages 2024-05-08T04:21:29.698 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/debug 2024-05-08T04:21:29.698 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/tracing 2024-05-08T04:21:29.699 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:21:29.699 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/fuse/connections 2024-05-08T04:21:29.699 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/config 2024-05-08T04:21:29.699 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:21:29.699 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:21:29.699 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:21:29.699 INFO:teuthology.orchestra.run.smithi104.stdout:/run/user/1000 2024-05-08T04:21:29.699 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph 2024-05-08T04:21:29.700 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-0 2024-05-08T04:21:29.700 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-1 2024-05-08T04:21:29.700 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-2 2024-05-08T04:21:29.700 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-3 2024-05-08T04:21:29.700 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns 2024-05-08T04:21:29.700 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:21:29.701 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:21:29.701 INFO:teuthology.orchestra.run.smithi104.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-08T04:21:29.701 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:21:29.701 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:21:29.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:29.701 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-05-08T04:21:29.702 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi104.stderr:2024-05-08T04:21:29.696+0000 7fd2ca157480 -1 init, newargv = 0x565490fe8280 newargc=15 2024-05-08T04:21:29.703 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi104.stderr:ceph-fuse[44984]: starting ceph client 2024-05-08T04:21:29.703 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi104.stderr:ceph-fuse[44984]: starting fuse 2024-05-08T04:21:29.717 INFO:teuthology.orchestra.run.smithi104.stdout:41 2024-05-08T04:21:29.717 INFO:teuthology.orchestra.run.smithi104.stdout:43 2024-05-08T04:21:29.717 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 43] 2024-05-08T04:21:29.717 DEBUG:teuthology.orchestra.run.smithi104:> sudo stdin-killer -- python3 -c ' 2024-05-08T04:21:29.717 DEBUG:teuthology.orchestra.run.smithi104:> import glob 2024-05-08T04:21:29.717 DEBUG:teuthology.orchestra.run.smithi104:> import re 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> def _find_admin_socket(client_name): 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> files = glob.glob(asok_path) 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> # Given a non-glob path, it better be there 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> if "*" not in asok_path: 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> assert(len(files) == 1) 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> return files[0] 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:21:29.718 DEBUG:teuthology.orchestra.run.smithi104:> for f in files: 2024-05-08T04:21:29.719 DEBUG:teuthology.orchestra.run.smithi104:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T04:21:29.719 DEBUG:teuthology.orchestra.run.smithi104:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T04:21:29.719 DEBUG:teuthology.orchestra.run.smithi104:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T04:21:29.719 DEBUG:teuthology.orchestra.run.smithi104:> contents = proc_f.read() 2024-05-08T04:21:29.719 DEBUG:teuthology.orchestra.run.smithi104:> if mountpoint in contents: 2024-05-08T04:21:29.719 DEBUG:teuthology.orchestra.run.smithi104:> return f 2024-05-08T04:21:29.719 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T04:21:29.719 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:21:29.719 DEBUG:teuthology.orchestra.run.smithi104:> print(_find_admin_socket("client.2")) 2024-05-08T04:21:29.719 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-05-08T04:21:29.835 INFO:teuthology.orchestra.run.smithi104.stdout:/var/run/ceph/ceph-client.2.44984.asok 2024-05-08T04:21:29.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T04:21:29.845 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44984.asok 2024-05-08T04:21:29.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:29.846 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44984.asok status 2024-05-08T04:21:29.980 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:21:29.980 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": { 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "entity_id": "2", 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "hostname": "smithi104", 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "pid": "44984", 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "root": "/" 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_count": 0, 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_pinned_count": 0, 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4683, 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "inst": { 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "name": { 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "client", 2024-05-08T04:21:29.981 INFO:teuthology.orchestra.run.smithi104.stdout: "num": 4683 2024-05-08T04:21:29.982 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:21:29.982 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-05-08T04:21:29.982 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-05-08T04:21:29.982 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.2:0", 2024-05-08T04:21:29.982 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 132007548 2024-05-08T04:21:29.982 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:21:29.982 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:21:29.982 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-05-08T04:21:29.982 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-05-08T04:21:29.982 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.2:0", 2024-05-08T04:21:29.983 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 132007548 2024-05-08T04:21:29.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:21:29.983 INFO:teuthology.orchestra.run.smithi104.stdout: "inst_str": "client.4683 192.168.0.2:0/132007548", 2024-05-08T04:21:29.983 INFO:teuthology.orchestra.run.smithi104.stdout: "addr_str": "192.168.0.2:0/132007548", 2024-05-08T04:21:29.983 INFO:teuthology.orchestra.run.smithi104.stdout: "inode_count": 1, 2024-05-08T04:21:29.983 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_epoch": 7, 2024-05-08T04:21:29.983 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch": 20, 2024-05-08T04:21:29.983 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch_barrier": 0, 2024-05-08T04:21:29.983 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklisted": false, 2024-05-08T04:21:29.983 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs" 2024-05-08T04:21:29.983 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:21:29.988 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T04:21:30.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.086+0000 7f9bac4d1640 1 Processor -- start 2024-05-08T04:21:30.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.086+0000 7f9bac4d1640 1 -- start start 2024-05-08T04:21:30.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9bac4d1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ba40d35c0 0x7f9ba40b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:30.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9bac4d1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9ba40b59c0 0x7f9ba40b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:30.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9bac4d1640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba40b9920 con 0x7f9ba415dad0 2024-05-08T04:21:30.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9bac4d1640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba40b5e10 con 0x7f9ba40b59c0 2024-05-08T04:21:30.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9bac4d1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40d2520 con 0x7f9ba40d35c0 2024-05-08T04:21:30.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9baa26d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9ba415dad0 0x7f9ba40d1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46844/0 (socket says 172.21.15.104:46844) 2024-05-08T04:21:30.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9baa26d640 1 -- 172.21.15.104:0/2736371145 learned_addr learned my addr 172.21.15.104:0/2736371145 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:30.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068854413 0 0) 0x7f9ba40b9920 con 0x7f9ba415dad0 2024-05-08T04:21:30.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9baaa6e640 1 --2- 172.21.15.104:0/2736371145 >> v2:172.21.15.183:3300/0 conn(0x7f9ba40b59c0 0x7f9ba40b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:30.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b90003520 con 0x7f9ba415dad0 2024-05-08T04:21:30.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9ba9a6c640 1 --2- 172.21.15.104:0/2736371145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ba40d35c0 0x7f9ba40b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:30.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3972442817 0 0) 0x7f9b90003520 con 0x7f9ba415dad0 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ba40d35c0 msgr2=0x7f9ba40b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9ba926b640 1 --2- 172.21.15.104:0/2736371145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ba40d35c0 0x7f9ba40b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 >> v2:172.21.15.183:3300/0 conn(0x7f9ba40b59c0 msgr2=0x7f9ba40b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9ba926b640 1 --2- 172.21.15.104:0/2736371145 >> v2:172.21.15.183:3300/0 conn(0x7f9ba40b59c0 0x7f9ba40b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40d2800 con 0x7f9ba415dad0 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f9ba0001670 con 0x7f9ba415dad0 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.087+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 >> v1:172.21.15.104:6789/0 conn(0x7f9ba415dad0 legacy=0x7f9ba40d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9ba926b640 1 --2- 172.21.15.104:0/2736371145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ba40d35c0 0x7f9b900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9ba926b640 1 --2- 172.21.15.104:0/2736371145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b90003f30 0x7f9b90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9ba926b640 1 --2- 172.21.15.104:0/2736371145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b90004d40 0x7f9b900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40b5e10 con 0x7f9b90003f30 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40d2520 con 0x7f9b90004d40 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9000ba10 con 0x7f9ba40d35c0 2024-05-08T04:21:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9ba9a6c640 1 --2- 172.21.15.104:0/2736371145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b90003f30 0x7f9b90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9baa26d640 1 --2- 172.21.15.104:0/2736371145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ba40d35c0 0x7f9b900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9baaa6e640 1 --2- 172.21.15.104:0/2736371145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b90004d40 0x7f9b900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9ba9a6c640 1 -- 172.21.15.104:0/2736371145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ba40d35c0 msgr2=0x7f9b900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9ba9a6c640 1 --2- 172.21.15.104:0/2736371145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ba40d35c0 0x7f9b900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9ba9a6c640 1 -- 172.21.15.104:0/2736371145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b90004d40 msgr2=0x7f9b900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9ba9a6c640 1 --2- 172.21.15.104:0/2736371145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b90004d40 0x7f9b900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.088+0000 7f9ba9a6c640 1 -- 172.21.15.104:0/2736371145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b90003520 con 0x7f9b90003f30 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.089+0000 7f9ba9a6c640 1 --2- 172.21.15.104:0/2736371145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b90003f30 0x7f9b90004800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009af0 tx=0x7f9b90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7909e31d8c15836d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.089+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94036070 con 0x7f9b90003f30 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.089+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b94031400 con 0x7f9b90003f30 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.089+0000 7f9ba926b640 1 -- 172.21.15.104:0/2736371145 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94009690 con 0x7f9b90003f30 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.089+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2736371145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b90003f30 msgr2=0x7f9b90004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.089+0000 7f9bac4d1640 1 --2- 172.21.15.104:0/2736371145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b90003f30 0x7f9b90004800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009af0 tx=0x7f9b90005830 comp rx=0 tx=0).stop 2024-05-08T04:21:30.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.089+0000 7f9baaa6e640 1 -- 172.21.15.104:0/2736371145 reap_dead start 2024-05-08T04:21:30.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.089+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2736371145 shutdown_connections 2024-05-08T04:21:30.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.089+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2736371145 >> 172.21.15.104:0/2736371145 conn(0x7f9ba406c650 msgr2=0x7f9ba40d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:30.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.089+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2736371145 shutdown_connections 2024-05-08T04:21:30.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.089+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2736371145 wait complete. 2024-05-08T04:21:30.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.091+0000 7f9bac4d1640 1 Processor -- start 2024-05-08T04:21:30.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.091+0000 7f9bac4d1640 1 -- start start 2024-05-08T04:21:30.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.091+0000 7f9bac4d1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b90003f30 0x7f9ba40aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.091+0000 7f9bac4d1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ba41e7bd0 0x7f9ba41f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.091+0000 7f9bac4d1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ba41f6790 0x7f9ba414c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.091+0000 7f9bac4d1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40d30a0 con 0x7f9ba41f6790 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.091+0000 7f9bac4d1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40d2dc0 con 0x7f9ba41e7bd0 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.091+0000 7f9bac4d1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40d2170 con 0x7f9b90003f30 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.091+0000 7f9baaa6e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ba41f6790 0x7f9ba414c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.091+0000 7f9baaa6e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ba41f6790 0x7f9ba414c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38282/0 (socket says 172.21.15.104:38282) 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.091+0000 7f9baaa6e640 1 -- 172.21.15.104:0/2949954770 learned_addr learned my addr 172.21.15.104:0/2949954770 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.092+0000 7f9baa26d640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b90003f30 0x7f9ba40aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.092+0000 7f9ba9a6c640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ba41e7bd0 0x7f9ba41f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.092+0000 7f9baaa6e640 1 -- 172.21.15.104:0/2949954770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b90003f30 msgr2=0x7f9ba40aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.092+0000 7f9baaa6e640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b90003f30 0x7f9ba40aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.092+0000 7f9baaa6e640 1 -- 172.21.15.104:0/2949954770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ba41e7bd0 msgr2=0x7f9ba41f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:30.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.092+0000 7f9baaa6e640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ba41e7bd0 0x7f9ba41f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:30.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.092+0000 7f9baaa6e640 1 -- 172.21.15.104:0/2949954770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba41e8400 con 0x7f9ba41f6790 2024-05-08T04:21:30.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.092+0000 7f9baaa6e640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ba41f6790 0x7f9ba414c540 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40caa80 tx=0x7f9b9c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:30.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.092+0000 7f9b9affd640 1 -- 172.21.15.104:0/2949954770 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c00fde0 con 0x7f9ba41f6790 2024-05-08T04:21:30.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.092+0000 7f9b9affd640 1 -- 172.21.15.104:0/2949954770 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c01d070 con 0x7f9ba41f6790 2024-05-08T04:21:30.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.092+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2949954770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba41e86e0 con 0x7f9ba41f6790 2024-05-08T04:21:30.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.092+0000 7f9b9affd640 1 -- 172.21.15.104:0/2949954770 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c015670 con 0x7f9ba41f6790 2024-05-08T04:21:30.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.092+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2949954770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba41e8ca0 con 0x7f9ba41f6790 2024-05-08T04:21:30.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.093+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2949954770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba4075010 con 0x7f9ba41f6790 2024-05-08T04:21:30.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.093+0000 7f9b9affd640 1 -- 172.21.15.104:0/2949954770 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9b9c015810 con 0x7f9ba41f6790 2024-05-08T04:21:30.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.094+0000 7f9b9affd640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b8806b4d0 0x7f9b8806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:30.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.094+0000 7f9b9affd640 1 -- 172.21.15.104:0/2949954770 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b9c08ac80 con 0x7f9ba41f6790 2024-05-08T04:21:30.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.094+0000 7f9baa26d640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b8806b4d0 0x7f9b8806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:30.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.094+0000 7f9baa26d640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b8806b4d0 0x7f9b8806d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00015d0 tx=0x7f9ba0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:30.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.098+0000 7f9b9affd640 1 -- 172.21.15.104:0/2949954770 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b9c091080 con 0x7f9ba41f6790 2024-05-08T04:21:30.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.305+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2949954770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9ba415cb60 con 0x7f9ba41f6790 2024-05-08T04:21:30.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.306+0000 7f9b9affd640 1 -- 172.21.15.104:0/2949954770 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9b9c010040 con 0x7f9ba41f6790 2024-05-08T04:21:30.307 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T04:21:30.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.307+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2949954770 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b8806b4d0 msgr2=0x7f9b8806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:30.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.307+0000 7f9bac4d1640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b8806b4d0 0x7f9b8806d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00015d0 tx=0x7f9ba0009040 comp rx=0 tx=0).stop 2024-05-08T04:21:30.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.307+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2949954770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ba41f6790 msgr2=0x7f9ba414c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:30.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.307+0000 7f9bac4d1640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ba41f6790 0x7f9ba414c540 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40caa80 tx=0x7f9b9c00f580 comp rx=0 tx=0).stop 2024-05-08T04:21:30.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.307+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2949954770 shutdown_connections 2024-05-08T04:21:30.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.307+0000 7f9bac4d1640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b8806b4d0 0x7f9b8806d990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:30.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.307+0000 7f9bac4d1640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ba41e7bd0 0x7f9ba41f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:30.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.307+0000 7f9bac4d1640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ba41f6790 0x7f9ba414c540 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:30.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.307+0000 7f9bac4d1640 1 --2- 172.21.15.104:0/2949954770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b90003f30 0x7f9ba40aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:30.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.307+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2949954770 >> 172.21.15.104:0/2949954770 conn(0x7f9ba406c650 msgr2=0x7f9ba40b8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:30.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.308+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2949954770 shutdown_connections 2024-05-08T04:21:30.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:30.308+0000 7f9bac4d1640 1 -- 172.21.15.104:0/2949954770 wait complete. 2024-05-08T04:21:30.319 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T04:21:30.319 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T04:21:30.320 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2024-05-08T04:21:30.320 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-08T04:21:30.320 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T04:21:30.320 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T04:21:30.320 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T04:21:30.320 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T04:21:30.320 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-08T04:21:30.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:30.320 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2024-05-08T04:21:30.339 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:21:30.339 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:21:30.339 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:21:30.339 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:30.339 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2024-05-08T04:21:30.339 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:30.339 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:21:30.340 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:30.340 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2024-05-08T04:21:30.340 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:21:30.340 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:30.340 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2024-05-08T04:21:30.340 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:21:30.340 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:30.340 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T04:21:30.340 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:30.340 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T04:21:30.340 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42735sec preferred_lft 42735sec 2024-05-08T04:21:30.340 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2024-05-08T04:21:30.340 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:30.341 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T04:21:30.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:30.341 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-05-08T04:21:30.341 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-05-08T04:21:30.341 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add name ceph-brx type bridge 2024-05-08T04:21:30.341 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip addr flush dev ceph-brx 2024-05-08T04:21:30.341 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set ceph-brx up 2024-05-08T04:21:30.341 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T04:21:30.341 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-05-08T04:21:30.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:30.494 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T04:21:30.521 INFO:teuthology.orchestra.run.smithi183.stdout:1 2024-05-08T04:21:30.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:30.523 DEBUG:teuthology.orchestra.run.smithi183:> route 2024-05-08T04:21:30.598 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2024-05-08T04:21:30.598 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T04:21:30.598 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T04:21:30.599 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T04:21:30.599 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T04:21:30.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:30.599 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-05-08T04:21:30.599 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-05-08T04:21:30.599 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T04:21:30.599 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T04:21:30.599 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T04:21:30.599 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-05-08T04:21:30.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:30.831 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2024-05-08T04:21:30.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:30.847 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list-id 2024-05-08T04:21:30.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:30.902 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-05-08T04:21:30.902 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-05-08T04:21:30.902 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:21:30.903 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-08T04:21:30.903 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-05-08T04:21:30.983 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-08T04:21:30.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:30.983 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-05-08T04:21:30.983 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-05-08T04:21:30.983 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-08T04:21:30.983 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T04:21:30.984 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-08T04:21:30.984 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-08T04:21:30.984 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-08T04:21:30.984 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-05-08T04:21:31.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:31.131 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-05-08T04:21:31.131 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-05-08T04:21:31.131 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2024-05-08T04:21:31.132 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T04:21:31.132 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-05-08T04:21:31.169 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-05-08T04:21:31.169 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:21:31.169 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-08T04:21:31.226 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-08T04:21:31.226 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:21:31.226 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-08T04:21:31.283 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2024-05-08T04:21:31.349 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:21:31.406 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2024-05-08T04:21:31.406 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2024-05-08T04:21:31.406 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2024-05-08T04:21:31.407 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2024-05-08T04:21:31.407 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2024-05-08T04:21:31.407 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2024-05-08T04:21:31.407 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2024-05-08T04:21:31.407 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2024-05-08T04:21:31.407 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2024-05-08T04:21:31.407 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/bpf 2024-05-08T04:21:31.407 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2024-05-08T04:21:31.407 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2024-05-08T04:21:31.407 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:21:31.407 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2024-05-08T04:21:31.407 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2024-05-08T04:21:31.408 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2024-05-08T04:21:31.408 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2024-05-08T04:21:31.408 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2024-05-08T04:21:31.408 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2024-05-08T04:21:31.408 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:21:31.408 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:21:31.408 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:21:31.408 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:21:31.408 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2024-05-08T04:21:31.408 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2024-05-08T04:21:31.408 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2024-05-08T04:21:31.408 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2024-05-08T04:21:31.409 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2024-05-08T04:21:31.409 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2024-05-08T04:21:31.409 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2024-05-08T04:21:31.409 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:21:31.409 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:21:31.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:31.409 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2024-05-08T04:21:31.462 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T04:21:31.462 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-05-08T04:21:31.505 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2024-05-08T04:21:31.530 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:21:31.585 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2024-05-08T04:21:31.585 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2024-05-08T04:21:31.585 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2024-05-08T04:21:31.586 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2024-05-08T04:21:31.586 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2024-05-08T04:21:31.586 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2024-05-08T04:21:31.586 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2024-05-08T04:21:31.586 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2024-05-08T04:21:31.586 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2024-05-08T04:21:31.586 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/bpf 2024-05-08T04:21:31.586 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2024-05-08T04:21:31.586 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2024-05-08T04:21:31.586 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:21:31.586 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2024-05-08T04:21:31.586 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2024-05-08T04:21:31.586 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2024-05-08T04:21:31.587 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2024-05-08T04:21:31.587 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2024-05-08T04:21:31.587 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2024-05-08T04:21:31.587 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:21:31.587 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:21:31.587 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:21:31.587 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:21:31.587 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2024-05-08T04:21:31.588 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2024-05-08T04:21:31.588 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2024-05-08T04:21:31.588 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2024-05-08T04:21:31.588 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2024-05-08T04:21:31.588 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2024-05-08T04:21:31.588 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2024-05-08T04:21:31.588 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:21:31.588 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:21:31.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:31.589 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2024-05-08T04:21:31.597 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:2024-05-08T04:21:31.595+0000 7f9fa0f1e480 -1 init, newargv = 0x563959cb7b00 newargc=15 2024-05-08T04:21:31.597 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[41695]: starting ceph client 2024-05-08T04:21:31.602 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[41695]: starting fuse 2024-05-08T04:21:31.613 INFO:teuthology.orchestra.run.smithi183.stdout:42 2024-05-08T04:21:31.614 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-08T04:21:31.614 DEBUG:teuthology.orchestra.run.smithi183:> sudo stdin-killer -- python3 -c ' 2024-05-08T04:21:31.614 DEBUG:teuthology.orchestra.run.smithi183:> import glob 2024-05-08T04:21:31.614 DEBUG:teuthology.orchestra.run.smithi183:> import re 2024-05-08T04:21:31.614 DEBUG:teuthology.orchestra.run.smithi183:> import os 2024-05-08T04:21:31.614 DEBUG:teuthology.orchestra.run.smithi183:> import subprocess 2024-05-08T04:21:31.614 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:21:31.614 DEBUG:teuthology.orchestra.run.smithi183:> def _find_admin_socket(client_name): 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> files = glob.glob(asok_path) 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> # Given a non-glob path, it better be there 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> if "*" not in asok_path: 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> assert(len(files) == 1) 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> return files[0] 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> for f in files: 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> contents = proc_f.read() 2024-05-08T04:21:31.615 DEBUG:teuthology.orchestra.run.smithi183:> if mountpoint in contents: 2024-05-08T04:21:31.616 DEBUG:teuthology.orchestra.run.smithi183:> return f 2024-05-08T04:21:31.616 DEBUG:teuthology.orchestra.run.smithi183:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T04:21:31.616 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:21:31.616 DEBUG:teuthology.orchestra.run.smithi183:> print(_find_admin_socket("client.1")) 2024-05-08T04:21:31.616 DEBUG:teuthology.orchestra.run.smithi183:> ' 2024-05-08T04:21:31.732 INFO:teuthology.orchestra.run.smithi183.stdout:/var/run/ceph/ceph-client.1.41695.asok 2024-05-08T04:21:31.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:21:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T04:21:31.743 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41695.asok 2024-05-08T04:21:31.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:31.744 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41695.asok status 2024-05-08T04:21:31.882 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-05-08T04:21:31.882 INFO:teuthology.orchestra.run.smithi183.stdout: "metadata": { 2024-05-08T04:21:31.882 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", 2024-05-08T04:21:31.882 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", 2024-05-08T04:21:31.882 INFO:teuthology.orchestra.run.smithi183.stdout: "entity_id": "1", 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: "hostname": "smithi183", 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: "pid": "41695", 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: "root": "/" 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_count": 0, 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_pinned_count": 0, 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: "id": 4505, 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: "inst": { 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: "name": { 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "client", 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: "num": 4505 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:21:31.883 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 2642801793 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 2642801793 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: "inst_str": "client.4505 192.168.0.1:0/2642801793", 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: "addr_str": "192.168.0.1:0/2642801793", 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: "inode_count": 1, 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_epoch": 7, 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch": 20, 2024-05-08T04:21:31.884 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch_barrier": 0, 2024-05-08T04:21:31.885 INFO:teuthology.orchestra.run.smithi183.stdout: "blocklisted": false, 2024-05-08T04:21:31.885 INFO:teuthology.orchestra.run.smithi183.stdout: "fs_name": "cephfs" 2024-05-08T04:21:31.885 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-05-08T04:21:31.889 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T04:21:32.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.000+0000 7ff3d9e1f640 1 Processor -- start 2024-05-08T04:21:32.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.000+0000 7ff3d9e1f640 1 -- start start 2024-05-08T04:21:32.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d9e1f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff3d415edf0 0x7ff3d40b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:32.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d9e1f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3d4157ac0 0x7ff3d4157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:32.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d9e1f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d40d15c0 con 0x7ff3d4070c70 2024-05-08T04:21:32.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d9e1f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d406bc70 con 0x7ff3d415edf0 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d9e1f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d415f550 con 0x7ff3d4157ac0 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d37fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff3d4070c70 0x7ff3d4071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46846/0 (socket says 172.21.15.104:46846) 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d37fe640 1 -- 172.21.15.104:0/3771774423 learned_addr learned my addr 172.21.15.104:0/3771774423 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750428335 0 0) 0x7ff3d40d15c0 con 0x7ff3d4070c70 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3bc003520 con 0x7ff3d4070c70 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d2ffd640 1 --2- 172.21.15.104:0/3771774423 >> v2:172.21.15.183:3300/0 conn(0x7ff3d415edf0 0x7ff3d40b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d3fff640 1 --2- 172.21.15.104:0/3771774423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3d4157ac0 0x7ff3d4157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1338907352 0 0) 0x7ff3bc003520 con 0x7ff3d4070c70 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3d4157ac0 msgr2=0x7ff3d4157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 --2- 172.21.15.104:0/3771774423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3d4157ac0 0x7ff3d4157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 >> v2:172.21.15.183:3300/0 conn(0x7ff3d415edf0 msgr2=0x7ff3d40b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 --2- 172.21.15.104:0/3771774423 >> v2:172.21.15.183:3300/0 conn(0x7ff3d415edf0 0x7ff3d40b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d415f830 con 0x7ff3d4070c70 2024-05-08T04:21:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7ff3c4001670 con 0x7ff3d4070c70 2024-05-08T04:21:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 >> v1:172.21.15.104:6789/0 conn(0x7ff3d4070c70 legacy=0x7ff3d4071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 --2- 172.21.15.104:0/3771774423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3d4157ac0 0x7ff3bc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 --2- 172.21.15.104:0/3771774423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3bc003fe0 0x7ff3bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 --2- 172.21.15.104:0/3771774423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3bc004d40 0x7ff3bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.001+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d415f550 con 0x7ff3bc003fe0 2024-05-08T04:21:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.002+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc00ba70 con 0x7ff3bc004d40 2024-05-08T04:21:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.002+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc00bc40 con 0x7ff3d4157ac0 2024-05-08T04:21:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.002+0000 7ff3d2ffd640 1 --2- 172.21.15.104:0/3771774423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3bc003fe0 0x7ff3bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.002+0000 7ff3d37fe640 1 --2- 172.21.15.104:0/3771774423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3d4157ac0 0x7ff3bc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.002+0000 7ff3d3fff640 1 --2- 172.21.15.104:0/3771774423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3bc004d40 0x7ff3bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.002+0000 7ff3d2ffd640 1 -- 172.21.15.104:0/3771774423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3d4157ac0 msgr2=0x7ff3bc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.002+0000 7ff3d2ffd640 1 --2- 172.21.15.104:0/3771774423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3d4157ac0 0x7ff3bc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.002+0000 7ff3d2ffd640 1 -- 172.21.15.104:0/3771774423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3bc004d40 msgr2=0x7ff3bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.002+0000 7ff3d2ffd640 1 --2- 172.21.15.104:0/3771774423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3bc004d40 0x7ff3bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.002+0000 7ff3d2ffd640 1 -- 172.21.15.104:0/3771774423 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc003520 con 0x7ff3bc003fe0 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.003+0000 7ff3d2ffd640 1 --2- 172.21.15.104:0/3771774423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3bc003fe0 0x7ff3bc004800 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800ba00 tx=0x7ff3bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35907e916c89c4cd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.003+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8030070 con 0x7ff3bc003fe0 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.003+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c802ade0 con 0x7ff3bc003fe0 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.003+0000 7ff3d27fc640 1 -- 172.21.15.104:0/3771774423 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800b600 con 0x7ff3bc003fe0 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.003+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/3771774423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3bc003fe0 msgr2=0x7ff3bc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.003+0000 7ff3d9e1f640 1 --2- 172.21.15.104:0/3771774423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3bc003fe0 0x7ff3bc004800 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800ba00 tx=0x7ff3bc005830 comp rx=0 tx=0).stop 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.003+0000 7ff3d3fff640 1 -- 172.21.15.104:0/3771774423 reap_dead start 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.003+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/3771774423 shutdown_connections 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.003+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/3771774423 >> 172.21.15.104:0/3771774423 conn(0x7ff3d40b3450 msgr2=0x7ff3d40b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.003+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/3771774423 shutdown_connections 2024-05-08T04:21:32.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.003+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/3771774423 wait complete. 2024-05-08T04:21:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.004+0000 7ff3d9e1f640 1 Processor -- start 2024-05-08T04:21:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.005+0000 7ff3d9e1f640 1 -- start start 2024-05-08T04:21:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.005+0000 7ff3d9e1f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3bc003fe0 0x7ff3d40cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.005+0000 7ff3d9e1f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3d40ccf70 0x7ff3d41f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.005+0000 7ff3d9e1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3d4155250 0x7ff3d415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.005+0000 7ff3d9e1f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40b57e0 con 0x7ff3d4155250 2024-05-08T04:21:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.005+0000 7ff3d9e1f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40b5b80 con 0x7ff3bc003fe0 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.005+0000 7ff3d9e1f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d40b5960 con 0x7ff3d40ccf70 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.005+0000 7ff3d3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3d4155250 0x7ff3d415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3d3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3d4155250 0x7ff3d415a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38292/0 (socket says 172.21.15.104:38292) 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3d3fff640 1 -- 172.21.15.104:0/247989822 learned_addr learned my addr 172.21.15.104:0/247989822 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3d37fe640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3bc003fe0 0x7ff3d40cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3d2ffd640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3d40ccf70 0x7ff3d41f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3d3fff640 1 -- 172.21.15.104:0/247989822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3d40ccf70 msgr2=0x7ff3d41f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3d3fff640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3d40ccf70 0x7ff3d41f4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3d3fff640 1 -- 172.21.15.104:0/247989822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3bc003fe0 msgr2=0x7ff3d40cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3d3fff640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3bc003fe0 0x7ff3d40cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3d3fff640 1 -- 172.21.15.104:0/247989822 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d40cc1b0 con 0x7ff3d4155250 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3d3fff640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3d4155250 0x7ff3d415a0e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40687d0 tx=0x7ff3cc007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3bbfff640 1 -- 172.21.15.104:0/247989822 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0046a0 con 0x7ff3d4155250 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3bbfff640 1 -- 172.21.15.104:0/247989822 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc01a070 con 0x7ff3d4155250 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/247989822 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d40cc490 con 0x7ff3d4155250 2024-05-08T04:21:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3bbfff640 1 -- 172.21.15.104:0/247989822 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc015640 con 0x7ff3d4155250 2024-05-08T04:21:32.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.006+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/247989822 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d40cbdf0 con 0x7ff3d4155250 2024-05-08T04:21:32.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.007+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/247989822 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d4075010 con 0x7ff3d4155250 2024-05-08T04:21:32.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.008+0000 7ff3bbfff640 1 -- 172.21.15.104:0/247989822 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff3cc0157e0 con 0x7ff3d4155250 2024-05-08T04:21:32.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.008+0000 7ff3bbfff640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff3c006b4d0 0x7ff3c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:32.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.008+0000 7ff3bbfff640 1 -- 172.21.15.104:0/247989822 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3cc08a890 con 0x7ff3d4155250 2024-05-08T04:21:32.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.008+0000 7ff3d37fe640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff3c006b4d0 0x7ff3c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:32.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.009+0000 7ff3d37fe640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff3c006b4d0 0x7ff3c006d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4007fd0 tx=0x7ff3c4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:32.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.012+0000 7ff3bbfff640 1 -- 172.21.15.104:0/247989822 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff3cc024020 con 0x7ff3d4155250 2024-05-08T04:21:32.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.219+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/247989822 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff3d40d15c0 con 0x7ff3d4155250 2024-05-08T04:21:32.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.220+0000 7ff3bbfff640 1 -- 172.21.15.104:0/247989822 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff3cc0597a0 con 0x7ff3d4155250 2024-05-08T04:21:32.221 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T04:21:32.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.221+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/247989822 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff3c006b4d0 msgr2=0x7ff3c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:32.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.221+0000 7ff3d9e1f640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff3c006b4d0 0x7ff3c006d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4007fd0 tx=0x7ff3c4009040 comp rx=0 tx=0).stop 2024-05-08T04:21:32.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.221+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/247989822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3d4155250 msgr2=0x7ff3d415a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:32.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.221+0000 7ff3d9e1f640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3d4155250 0x7ff3d415a0e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40687d0 tx=0x7ff3cc007700 comp rx=0 tx=0).stop 2024-05-08T04:21:32.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.222+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/247989822 shutdown_connections 2024-05-08T04:21:32.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.222+0000 7ff3d9e1f640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff3c006b4d0 0x7ff3c006d990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:32.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.222+0000 7ff3d9e1f640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3d4155250 0x7ff3d415a0e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:32.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.222+0000 7ff3d9e1f640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3d40ccf70 0x7ff3d41f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:32.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.222+0000 7ff3d9e1f640 1 --2- 172.21.15.104:0/247989822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3bc003fe0 0x7ff3d40cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:32.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.222+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/247989822 >> 172.21.15.104:0/247989822 conn(0x7ff3d40b3450 msgr2=0x7ff3d40b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:32.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.222+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/247989822 shutdown_connections 2024-05-08T04:21:32.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:32.222+0000 7ff3d9e1f640 1 -- 172.21.15.104:0/247989822 wait complete. 2024-05-08T04:21:32.234 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T04:21:32.234 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T04:21:32.234 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2024-05-08T04:21:32.234 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-08T04:21:32.234 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-08T04:21:32.234 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T04:21:32.234 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T04:21:32.234 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T04:21:32.235 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-08T04:21:32.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:32.235 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2024-05-08T04:21:32.251 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:21:32.251 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:21:32.251 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:21:32.251 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.252 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2024-05-08T04:21:32.252 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.252 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:21:32.252 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:32.252 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2024-05-08T04:21:32.252 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:21:32.252 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:32.252 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2024-05-08T04:21:32.252 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:21:32.252 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:32.252 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T04:21:32.252 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:32.252 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T04:21:32.253 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42733sec preferred_lft 42733sec 2024-05-08T04:21:32.253 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2024-05-08T04:21:32.253 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.253 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T04:21:32.253 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 8a:51:89:24:45:ec brd ff:ff:ff:ff:ff:ff 2024-05-08T04:21:32.253 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T04:21:32.253 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.253 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::b018:2eff:fef9:2486/64 scope link 2024-05-08T04:21:32.253 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.253 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:21:32.253 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 8a:51:89:24:45:ec brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:21:32.253 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::8851:89ff:fe24:45ec/64 scope link 2024-05-08T04:21:32.253 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:32.254 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T04:21:32.317 INFO:teuthology.orchestra.run.smithi183.stdout:1 2024-05-08T04:21:32.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:32.319 DEBUG:teuthology.orchestra.run.smithi183:> route 2024-05-08T04:21:32.377 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2024-05-08T04:21:32.377 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T04:21:32.377 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T04:21:32.377 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T04:21:32.378 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T04:21:32.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:32.378 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-05-08T04:21:32.378 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-05-08T04:21:32.379 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T04:21:32.379 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T04:21:32.379 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T04:21:32.379 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-05-08T04:21:32.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:32.463 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2024-05-08T04:21:32.478 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-08T04:21:32.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:32.479 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list-id 2024-05-08T04:21:32.534 INFO:teuthology.orchestra.run.smithi183.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-08T04:21:32.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:32.535 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-05-08T04:21:32.535 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-05-08T04:21:32.535 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:21:32.535 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-08T04:21:32.535 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-05-08T04:21:32.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:32.612 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-08T04:21:32.677 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:21:32.677 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:21:32.677 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:21:32.678 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.678 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2024-05-08T04:21:32.678 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.678 INFO:teuthology.orchestra.run.smithi183.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T04:21:32.678 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether fa:08:40:16:b6:38 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T04:21:32.678 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T04:21:32.678 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.678 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::f808:40ff:fe16:b638/64 scope link tentative 2024-05-08T04:21:32.678 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:32.680 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-08T04:21:32.744 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:21:32.745 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:21:32.745 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:21:32.745 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.745 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2024-05-08T04:21:32.745 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.745 INFO:teuthology.orchestra.run.smithi183.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T04:21:32.745 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether fa:08:40:16:b6:38 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T04:21:32.745 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T04:21:32.745 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.745 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::f808:40ff:fe16:b638/64 scope link 2024-05-08T04:21:32.745 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:21:32.746 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-08T04:21:32.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:32.747 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-05-08T04:21:32.747 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-05-08T04:21:32.747 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-08T04:21:32.747 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-08T04:21:32.747 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-08T04:21:32.747 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-08T04:21:32.747 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-08T04:21:32.747 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-05-08T04:21:32.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:32.860 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-05-08T04:21:32.860 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-05-08T04:21:32.860 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.1 up 2024-05-08T04:21:32.860 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set dev brx.1 master ceph-brx 2024-05-08T04:21:32.861 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-05-08T04:21:32.898 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-05-08T04:21:32.898 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:21:32.898 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-08T04:21:32.953 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-08T04:21:32.954 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:21:32.954 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-08T04:21:33.009 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2024-05-08T04:21:33.074 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:21:33.130 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2024-05-08T04:21:33.130 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2024-05-08T04:21:33.130 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2024-05-08T04:21:33.130 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2024-05-08T04:21:33.130 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2024-05-08T04:21:33.130 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2024-05-08T04:21:33.130 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2024-05-08T04:21:33.130 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2024-05-08T04:21:33.130 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2024-05-08T04:21:33.130 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/bpf 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:21:33.131 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2024-05-08T04:21:33.132 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2024-05-08T04:21:33.132 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2024-05-08T04:21:33.132 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2024-05-08T04:21:33.132 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2024-05-08T04:21:33.132 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2024-05-08T04:21:33.132 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2024-05-08T04:21:33.132 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:21:33.132 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:21:33.132 INFO:teuthology.orchestra.run.smithi183.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-08T04:21:33.132 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:21:33.132 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:21:33.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:33.133 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2024-05-08T04:21:33.185 INFO:teuthology.orchestra.run.smithi183.stdout:42 2024-05-08T04:21:33.185 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2024-05-08T04:21:33.185 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-05-08T04:21:33.227 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2024-05-08T04:21:33.251 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:21:33.308 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2024-05-08T04:21:33.308 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2024-05-08T04:21:33.308 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2024-05-08T04:21:33.308 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2024-05-08T04:21:33.308 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2024-05-08T04:21:33.308 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2024-05-08T04:21:33.308 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2024-05-08T04:21:33.308 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2024-05-08T04:21:33.308 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2024-05-08T04:21:33.308 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/bpf 2024-05-08T04:21:33.308 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2024-05-08T04:21:33.308 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2024-05-08T04:21:33.309 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:21:33.309 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2024-05-08T04:21:33.309 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2024-05-08T04:21:33.309 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2024-05-08T04:21:33.309 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2024-05-08T04:21:33.309 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2024-05-08T04:21:33.309 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2024-05-08T04:21:33.309 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:21:33.309 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:21:33.309 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:21:33.309 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:21:33.309 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2024-05-08T04:21:33.309 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2024-05-08T04:21:33.310 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2024-05-08T04:21:33.310 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2024-05-08T04:21:33.310 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2024-05-08T04:21:33.310 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2024-05-08T04:21:33.310 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2024-05-08T04:21:33.310 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:21:33.310 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:21:33.310 INFO:teuthology.orchestra.run.smithi183.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-08T04:21:33.310 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:21:33.310 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:21:33.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:33.311 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2024-05-08T04:21:33.311 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi183.stderr:2024-05-08T04:21:33.307+0000 7f06865e7480 -1 init, newargv = 0x5638ca2ecaa0 newargc=15 2024-05-08T04:21:33.311 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi183.stderr:ceph-fuse[42142]: starting ceph client 2024-05-08T04:21:33.313 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi183.stderr:ceph-fuse[42142]: starting fuse 2024-05-08T04:21:33.326 INFO:teuthology.orchestra.run.smithi183.stdout:42 2024-05-08T04:21:33.326 INFO:teuthology.orchestra.run.smithi183.stdout:43 2024-05-08T04:21:33.327 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2024-05-08T04:21:33.327 DEBUG:teuthology.orchestra.run.smithi183:> sudo stdin-killer -- python3 -c ' 2024-05-08T04:21:33.327 DEBUG:teuthology.orchestra.run.smithi183:> import glob 2024-05-08T04:21:33.327 DEBUG:teuthology.orchestra.run.smithi183:> import re 2024-05-08T04:21:33.327 DEBUG:teuthology.orchestra.run.smithi183:> import os 2024-05-08T04:21:33.327 DEBUG:teuthology.orchestra.run.smithi183:> import subprocess 2024-05-08T04:21:33.327 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:21:33.327 DEBUG:teuthology.orchestra.run.smithi183:> def _find_admin_socket(client_name): 2024-05-08T04:21:33.327 DEBUG:teuthology.orchestra.run.smithi183:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-05-08T04:21:33.327 DEBUG:teuthology.orchestra.run.smithi183:> files = glob.glob(asok_path) 2024-05-08T04:21:33.327 DEBUG:teuthology.orchestra.run.smithi183:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-05-08T04:21:33.327 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:21:33.327 DEBUG:teuthology.orchestra.run.smithi183:> # Given a non-glob path, it better be there 2024-05-08T04:21:33.327 DEBUG:teuthology.orchestra.run.smithi183:> if "*" not in asok_path: 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> assert(len(files) == 1) 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> return files[0] 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> for f in files: 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> contents = proc_f.read() 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> if mountpoint in contents: 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> return f 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> print(_find_admin_socket("client.3")) 2024-05-08T04:21:33.328 DEBUG:teuthology.orchestra.run.smithi183:> ' 2024-05-08T04:21:33.444 INFO:teuthology.orchestra.run.smithi183.stdout:/var/run/ceph/ceph-client.3.42142.asok 2024-05-08T04:21:33.447 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:21:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T04:21:33.454 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.42142.asok 2024-05-08T04:21:33.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:33.454 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.42142.asok status 2024-05-08T04:21:33.590 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-05-08T04:21:33.590 INFO:teuthology.orchestra.run.smithi183.stdout: "metadata": { 2024-05-08T04:21:33.590 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", 2024-05-08T04:21:33.590 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", 2024-05-08T04:21:33.590 INFO:teuthology.orchestra.run.smithi183.stdout: "entity_id": "3", 2024-05-08T04:21:33.590 INFO:teuthology.orchestra.run.smithi183.stdout: "hostname": "smithi183", 2024-05-08T04:21:33.590 INFO:teuthology.orchestra.run.smithi183.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-05-08T04:21:33.591 INFO:teuthology.orchestra.run.smithi183.stdout: "pid": "42142", 2024-05-08T04:21:33.591 INFO:teuthology.orchestra.run.smithi183.stdout: "root": "/" 2024-05-08T04:21:33.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:21:33.591 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_count": 0, 2024-05-08T04:21:33.591 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_pinned_count": 0, 2024-05-08T04:21:33.591 INFO:teuthology.orchestra.run.smithi183.stdout: "id": 4597, 2024-05-08T04:21:33.591 INFO:teuthology.orchestra.run.smithi183.stdout: "inst": { 2024-05-08T04:21:33.591 INFO:teuthology.orchestra.run.smithi183.stdout: "name": { 2024-05-08T04:21:33.591 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "client", 2024-05-08T04:21:33.591 INFO:teuthology.orchestra.run.smithi183.stdout: "num": 4597 2024-05-08T04:21:33.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:21:33.591 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-05-08T04:21:33.591 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-05-08T04:21:33.592 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.2:0", 2024-05-08T04:21:33.592 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 1383514745 2024-05-08T04:21:33.592 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-05-08T04:21:33.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:21:33.592 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-05-08T04:21:33.592 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-05-08T04:21:33.592 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.2:0", 2024-05-08T04:21:33.592 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 1383514745 2024-05-08T04:21:33.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:21:33.592 INFO:teuthology.orchestra.run.smithi183.stdout: "inst_str": "client.4597 192.168.0.2:0/1383514745", 2024-05-08T04:21:33.592 INFO:teuthology.orchestra.run.smithi183.stdout: "addr_str": "192.168.0.2:0/1383514745", 2024-05-08T04:21:33.592 INFO:teuthology.orchestra.run.smithi183.stdout: "inode_count": 1, 2024-05-08T04:21:33.593 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_epoch": 7, 2024-05-08T04:21:33.593 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch": 20, 2024-05-08T04:21:33.593 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch_barrier": 0, 2024-05-08T04:21:33.593 INFO:teuthology.orchestra.run.smithi183.stdout: "blocklisted": false, 2024-05-08T04:21:33.593 INFO:teuthology.orchestra.run.smithi183.stdout: "fs_name": "cephfs" 2024-05-08T04:21:33.593 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-05-08T04:21:33.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:33.599 DEBUG:teuthology.orchestra.run.smithi104:> stat --file-system '--printf=%T 2024-05-08T04:21:33.599 DEBUG:teuthology.orchestra.run.smithi104:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-08T04:21:33.618 INFO:teuthology.orchestra.run.smithi104.stdout:fuseblk 2024-05-08T04:21:33.618 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-08T04:21:33.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:33.619 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T04:21:33.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:33.690 DEBUG:teuthology.orchestra.run.smithi104:> stat --file-system '--printf=%T 2024-05-08T04:21:33.690 DEBUG:teuthology.orchestra.run.smithi104:> ' -- /home/ubuntu/cephtest/mnt.2 2024-05-08T04:21:33.748 INFO:teuthology.orchestra.run.smithi104.stdout:fuseblk 2024-05-08T04:21:33.748 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-05-08T04:21:33.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:33.749 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-08T04:21:33.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:33.821 DEBUG:teuthology.orchestra.run.smithi183:> stat --file-system '--printf=%T 2024-05-08T04:21:33.822 DEBUG:teuthology.orchestra.run.smithi183:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-08T04:21:33.838 INFO:teuthology.orchestra.run.smithi183.stdout:fuseblk 2024-05-08T04:21:33.838 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-08T04:21:33.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:33.839 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-08T04:21:33.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:33.906 DEBUG:teuthology.orchestra.run.smithi183:> stat --file-system '--printf=%T 2024-05-08T04:21:33.906 DEBUG:teuthology.orchestra.run.smithi183:> ' -- /home/ubuntu/cephtest/mnt.3 2024-05-08T04:21:33.964 INFO:teuthology.orchestra.run.smithi183.stdout:fuseblk 2024-05-08T04:21:33.964 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-05-08T04:21:33.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:33.965 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-08T04:21:34.030 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-08T04:21:34.046 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:34.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.154+0000 7f18f83ab640 1 Processor -- start 2024-05-08T04:21:34.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.154+0000 7f18f83ab640 1 -- start start 2024-05-08T04:21:34.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.155+0000 7f18f83ab640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18f015cd20 0x7f18f01668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.155+0000 7f18f83ab640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f00cf680 con 0x7f18f00725b0 2024-05-08T04:21:34.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.155+0000 7f18f83ab640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f015c240 con 0x7f18f00715d0 2024-05-08T04:21:34.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.155+0000 7f18f83ab640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f015c520 con 0x7f18f015cd20 2024-05-08T04:21:34.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.155+0000 7f18f5946640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f18f00725b0 0x7f18f00cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46856/0 (socket says 172.21.15.104:46856) 2024-05-08T04:21:34.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.155+0000 7f18f5946640 1 -- 172.21.15.104:0/4045817436 learned_addr learned my addr 172.21.15.104:0/4045817436 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:34.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.155+0000 7f18f6948640 1 --2- 172.21.15.104:0/4045817436 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18f015cd20 0x7f18f01668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.155+0000 7f18f5145640 1 -- 172.21.15.104:0/4045817436 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395146396 0 0) 0x7f18f00cf680 con 0x7f18f00725b0 2024-05-08T04:21:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.155+0000 7f18f5145640 1 -- 172.21.15.104:0/4045817436 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18dc003520 con 0x7f18f00725b0 2024-05-08T04:21:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.155+0000 7f18f5145640 1 -- 172.21.15.104:0/4045817436 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133007989 0 0) 0x7f18f015c240 con 0x7f18f00715d0 2024-05-08T04:21:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.155+0000 7f18f5145640 1 -- 172.21.15.104:0/4045817436 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18f00cf680 con 0x7f18f00715d0 2024-05-08T04:21:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.156+0000 7f18f6948640 1 -- 172.21.15.104:0/4045817436 >> v1:172.21.15.183:6789/0 conn(0x7f18f00715d0 legacy=0x7f18f00719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.156+0000 7f18f6948640 1 -- 172.21.15.104:0/4045817436 >> v1:172.21.15.104:6789/0 conn(0x7f18f00725b0 legacy=0x7f18f00cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.156+0000 7f18f6948640 1 -- 172.21.15.104:0/4045817436 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f015c800 con 0x7f18f015cd20 2024-05-08T04:21:34.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.156+0000 7f18f6948640 1 --2- 172.21.15.104:0/4045817436 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18f015cd20 0x7f18f01668f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f18e80097d0 tx=0x7f18e802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff5a52550843f5d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:34.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.156+0000 7f18f5145640 1 -- 172.21.15.104:0/4045817436 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8037070 con 0x7f18f015cd20 2024-05-08T04:21:34.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.157+0000 7f18f5145640 1 -- 172.21.15.104:0/4045817436 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e802ae50 con 0x7f18f015cd20 2024-05-08T04:21:34.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.157+0000 7f18f5145640 1 -- 172.21.15.104:0/4045817436 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8032660 con 0x7f18f015cd20 2024-05-08T04:21:34.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.157+0000 7f18f83ab640 1 -- 172.21.15.104:0/4045817436 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18f015cd20 msgr2=0x7f18f01668f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.157+0000 7f18f83ab640 1 --2- 172.21.15.104:0/4045817436 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18f015cd20 0x7f18f01668f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f18e80097d0 tx=0x7f18e802a100 comp rx=0 tx=0).stop 2024-05-08T04:21:34.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.157+0000 7f18f83ab640 1 -- 172.21.15.104:0/4045817436 shutdown_connections 2024-05-08T04:21:34.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.157+0000 7f18f83ab640 1 --2- 172.21.15.104:0/4045817436 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18f015cd20 0x7f18f01668f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.157+0000 7f18f83ab640 1 -- 172.21.15.104:0/4045817436 >> 172.21.15.104:0/4045817436 conn(0x7f18f00cfa60 msgr2=0x7f18f00cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:34.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.157+0000 7f18f83ab640 1 -- 172.21.15.104:0/4045817436 shutdown_connections 2024-05-08T04:21:34.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.157+0000 7f18f83ab640 1 -- 172.21.15.104:0/4045817436 wait complete. 2024-05-08T04:21:34.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.158+0000 7f18f83ab640 1 Processor -- start 2024-05-08T04:21:34.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.158+0000 7f18f83ab640 1 -- start start 2024-05-08T04:21:34.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.159+0000 7f18f83ab640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18f00715d0 0x7f18f01589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.159+0000 7f18f83ab640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f00725b0 0x7f18f0135d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.159+0000 7f18f83ab640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18f015cd20 0x7f18f013e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.159+0000 7f18f83ab640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0166fb0 con 0x7f18f00725b0 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.159+0000 7f18f83ab640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0166e30 con 0x7f18f015cd20 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.159+0000 7f18f83ab640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0167130 con 0x7f18f00715d0 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.159+0000 7f18f5946640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f00725b0 0x7f18f0135d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.159+0000 7f18f5946640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f00725b0 0x7f18f0135d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38302/0 (socket says 172.21.15.104:38302) 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.159+0000 7f18f5946640 1 -- 172.21.15.104:0/2633288790 learned_addr learned my addr 172.21.15.104:0/2633288790 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.159+0000 7f18f6948640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18f015cd20 0x7f18f013e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.159+0000 7f18f6147640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18f00715d0 0x7f18f01589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.160+0000 7f18f5946640 1 -- 172.21.15.104:0/2633288790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18f00715d0 msgr2=0x7f18f01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.160+0000 7f18f5946640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18f00715d0 0x7f18f01589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.160+0000 7f18f5946640 1 -- 172.21.15.104:0/2633288790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18f015cd20 msgr2=0x7f18f013e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.160+0000 7f18f5946640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18f015cd20 0x7f18f013e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.160+0000 7f18f5946640 1 -- 172.21.15.104:0/2633288790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f0142530 con 0x7f18f00725b0 2024-05-08T04:21:34.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.160+0000 7f18f5946640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f00725b0 0x7f18f0135d70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f18e000c500 tx=0x7f18e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:34.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.160+0000 7f18e6ffd640 1 -- 172.21.15.104:0/2633288790 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0017070 con 0x7f18f00725b0 2024-05-08T04:21:34.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.160+0000 7f18e6ffd640 1 -- 172.21.15.104:0/2633288790 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e0005ce0 con 0x7f18f00725b0 2024-05-08T04:21:34.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.160+0000 7f18e6ffd640 1 -- 172.21.15.104:0/2633288790 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e00072f0 con 0x7f18f00725b0 2024-05-08T04:21:34.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.160+0000 7f18f83ab640 1 -- 172.21.15.104:0/2633288790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f01427b0 con 0x7f18f00725b0 2024-05-08T04:21:34.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.160+0000 7f18f83ab640 1 -- 172.21.15.104:0/2633288790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f0136780 con 0x7f18f00725b0 2024-05-08T04:21:34.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.161+0000 7f18f83ab640 1 -- 172.21.15.104:0/2633288790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f0075010 con 0x7f18f00725b0 2024-05-08T04:21:34.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.161+0000 7f18e6ffd640 1 -- 172.21.15.104:0/2633288790 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f18e001a070 con 0x7f18f00725b0 2024-05-08T04:21:34.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.162+0000 7f18e6ffd640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f18d406b4d0 0x7f18d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.162+0000 7f18e6ffd640 1 -- 172.21.15.104:0/2633288790 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18e0089460 con 0x7f18f00725b0 2024-05-08T04:21:34.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.162+0000 7f18f6147640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f18d406b4d0 0x7f18d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.162+0000 7f18f6147640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f18d406b4d0 0x7f18d406d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18f01435c0 tx=0x7f18ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:34.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.166+0000 7f18e6ffd640 1 -- 172.21.15.104:0/2633288790 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f18f0142530 con 0x7f18f00725b0 2024-05-08T04:21:34.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.339+0000 7f18f83ab640 1 -- 172.21.15.104:0/2633288790 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18f00cca30 con 0x7f18f00725b0 2024-05-08T04:21:34.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.340+0000 7f18e6ffd640 1 -- 172.21.15.104:0/2633288790 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f18e0057d20 con 0x7f18f00725b0 2024-05-08T04:21:34.341 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:34.341 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:34.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.342+0000 7f18f83ab640 1 -- 172.21.15.104:0/2633288790 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f18d406b4d0 msgr2=0x7f18d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.342+0000 7f18f83ab640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f18d406b4d0 0x7f18d406d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18f01435c0 tx=0x7f18ec009040 comp rx=0 tx=0).stop 2024-05-08T04:21:34.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.342+0000 7f18f83ab640 1 -- 172.21.15.104:0/2633288790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f00725b0 msgr2=0x7f18f0135d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.342+0000 7f18f83ab640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f00725b0 0x7f18f0135d70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f18e000c500 tx=0x7f18e000c9c0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.342+0000 7f18f83ab640 1 -- 172.21.15.104:0/2633288790 shutdown_connections 2024-05-08T04:21:34.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.342+0000 7f18f83ab640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f18d406b4d0 0x7f18d406d990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.342+0000 7f18f83ab640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18f015cd20 0x7f18f013e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.342+0000 7f18f83ab640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18f00725b0 0x7f18f0135d70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.342+0000 7f18f83ab640 1 --2- 172.21.15.104:0/2633288790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18f00715d0 0x7f18f01589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.342+0000 7f18f83ab640 1 -- 172.21.15.104:0/2633288790 >> 172.21.15.104:0/2633288790 conn(0x7f18f00cfa60 msgr2=0x7f18f00ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:34.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.342+0000 7f18f83ab640 1 -- 172.21.15.104:0/2633288790 shutdown_connections 2024-05-08T04:21:34.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.342+0000 7f18f83ab640 1 -- 172.21.15.104:0/2633288790 wait complete. 2024-05-08T04:21:34.354 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:34.355 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:34.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.455+0000 7f05fcff4640 1 Processor -- start 2024-05-08T04:21:34.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.455+0000 7f05fcff4640 1 -- start start 2024-05-08T04:21:34.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05fcff4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f05f815db30 0x7f05f806bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05fcff4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f05f80b5b40 0x7f05f80d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05fcff4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f80b6b50 con 0x7f05f80b93b0 2024-05-08T04:21:34.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05fcff4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f806c800 con 0x7f05f80b5b40 2024-05-08T04:21:34.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05fcff4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f806cae0 con 0x7f05f815db30 2024-05-08T04:21:34.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05f6d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f05f80b5b40 0x7f05f80d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05f6d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f05f80b5b40 0x7f05f80d24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38306/0 (socket says 172.21.15.104:38306) 2024-05-08T04:21:34.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05f6d9d640 1 -- 172.21.15.104:0/2745499008 learned_addr learned my addr 172.21.15.104:0/2745499008 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:34.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05f659c640 1 --2- 172.21.15.104:0/2745499008 >> v2:172.21.15.183:3300/0 conn(0x7f05f815db30 0x7f05f806bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05f6d9d640 1 -- 172.21.15.104:0/2745499008 >> v2:172.21.15.183:3300/0 conn(0x7f05f815db30 msgr2=0x7f05f806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:34.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05f6d9d640 1 --2- 172.21.15.104:0/2745499008 >> v2:172.21.15.183:3300/0 conn(0x7f05f815db30 0x7f05f806bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05f6d9d640 1 -- 172.21.15.104:0/2745499008 >> v1:172.21.15.183:6789/0 conn(0x7f05f80b93b0 legacy=0x7f05f80b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:34.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05f6d9d640 1 -- 172.21.15.104:0/2745499008 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f806cdc0 con 0x7f05f80b5b40 2024-05-08T04:21:34.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.456+0000 7f05f659c640 1 --2- 172.21.15.104:0/2745499008 >> v2:172.21.15.183:3300/0 conn(0x7f05f815db30 0x7f05f806bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:34.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.457+0000 7f05f6d9d640 1 --2- 172.21.15.104:0/2745499008 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05f80b5b40 0x7f05f80d24b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f05f806d230 tx=0x7f05f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959e9d076a369faf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:34.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.457+0000 7f05f559a640 1 -- 172.21.15.104:0/2745499008 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0037070 con 0x7f05f80b5b40 2024-05-08T04:21:34.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.457+0000 7f05f559a640 1 -- 172.21.15.104:0/2745499008 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f0032440 con 0x7f05f80b5b40 2024-05-08T04:21:34.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.457+0000 7f05f559a640 1 -- 172.21.15.104:0/2745499008 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0032810 con 0x7f05f80b5b40 2024-05-08T04:21:34.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.458+0000 7f05fcff4640 1 -- 172.21.15.104:0/2745499008 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05f80b5b40 msgr2=0x7f05f80d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.458+0000 7f05fcff4640 1 --2- 172.21.15.104:0/2745499008 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05f80b5b40 0x7f05f80d24b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f05f806d230 tx=0x7f05f002a1a0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.458+0000 7f05fcff4640 1 -- 172.21.15.104:0/2745499008 shutdown_connections 2024-05-08T04:21:34.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.458+0000 7f05fcff4640 1 --2- 172.21.15.104:0/2745499008 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05f80b5b40 0x7f05f80d24b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.458+0000 7f05fcff4640 1 --2- 172.21.15.104:0/2745499008 >> v2:172.21.15.183:3300/0 conn(0x7f05f815db30 0x7f05f806bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.458+0000 7f05fcff4640 1 -- 172.21.15.104:0/2745499008 >> 172.21.15.104:0/2745499008 conn(0x7f05f80d0430 msgr2=0x7f05f80d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:34.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.458+0000 7f05fcff4640 1 -- 172.21.15.104:0/2745499008 shutdown_connections 2024-05-08T04:21:34.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.458+0000 7f05fcff4640 1 -- 172.21.15.104:0/2745499008 wait complete. 2024-05-08T04:21:34.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.459+0000 7f05fcff4640 1 Processor -- start 2024-05-08T04:21:34.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.459+0000 7f05fcff4640 1 -- start start 2024-05-08T04:21:34.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05fcff4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05f80b5b40 0x7f05f815cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05fcff4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05f80b93b0 0x7f05f80aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05fcff4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05f815db30 0x7f05f80aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05fcff4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f815df10 con 0x7f05f815db30 2024-05-08T04:21:34.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05fcff4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f806c4f0 con 0x7f05f80b5b40 2024-05-08T04:21:34.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05fcff4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f80abb90 con 0x7f05f80b93b0 2024-05-08T04:21:34.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05f6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05f815db30 0x7f05f80aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05f6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05f815db30 0x7f05f80aabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38308/0 (socket says 172.21.15.104:38308) 2024-05-08T04:21:34.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05f6d9d640 1 -- 172.21.15.104:0/2559594945 learned_addr learned my addr 172.21.15.104:0/2559594945 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05f659c640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05f80b5b40 0x7f05f815cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05f5d9b640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05f80b93b0 0x7f05f80aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05f6d9d640 1 -- 172.21.15.104:0/2559594945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05f80b93b0 msgr2=0x7f05f80aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05f6d9d640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05f80b93b0 0x7f05f80aa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05f6d9d640 1 -- 172.21.15.104:0/2559594945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05f80b5b40 msgr2=0x7f05f815cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05f6d9d640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05f80b5b40 0x7f05f815cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.460+0000 7f05f6d9d640 1 -- 172.21.15.104:0/2559594945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f80abe50 con 0x7f05f815db30 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.461+0000 7f05f6d9d640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05f815db30 0x7f05f80aabe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f05f002a1e0 tx=0x7f05f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.461+0000 7f05e6ffd640 1 -- 172.21.15.104:0/2559594945 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0041030 con 0x7f05f815db30 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.461+0000 7f05e6ffd640 1 -- 172.21.15.104:0/2559594945 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f0030600 con 0x7f05f815db30 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.461+0000 7f05fcff4640 1 -- 172.21.15.104:0/2559594945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f80ac130 con 0x7f05f815db30 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.461+0000 7f05e6ffd640 1 -- 172.21.15.104:0/2559594945 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f0037040 con 0x7f05f815db30 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.461+0000 7f05fcff4640 1 -- 172.21.15.104:0/2559594945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f80ac6f0 con 0x7f05f815db30 2024-05-08T04:21:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.462+0000 7f05fcff4640 1 -- 172.21.15.104:0/2559594945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f8075010 con 0x7f05f815db30 2024-05-08T04:21:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.462+0000 7f05e6ffd640 1 -- 172.21.15.104:0/2559594945 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f05f0044070 con 0x7f05f815db30 2024-05-08T04:21:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.463+0000 7f05e6ffd640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f05d806b4d0 0x7f05d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.463+0000 7f05f659c640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f05d806b4d0 0x7f05d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.463+0000 7f05e6ffd640 1 -- 172.21.15.104:0/2559594945 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05f00aa9c0 con 0x7f05f815db30 2024-05-08T04:21:34.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.463+0000 7f05f659c640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f05d806b4d0 0x7f05d806d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05e800f500 tx=0x7f05e8007770 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:34.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.467+0000 7f05e6ffd640 1 -- 172.21.15.104:0/2559594945 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f05f00ace20 con 0x7f05f815db30 2024-05-08T04:21:34.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.638+0000 7f05fcff4640 1 -- 172.21.15.104:0/2559594945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05f80b2fe0 con 0x7f05f815db30 2024-05-08T04:21:34.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.639+0000 7f05e6ffd640 1 -- 172.21.15.104:0/2559594945 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05f80b6b50 con 0x7f05f815db30 2024-05-08T04:21:34.641 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:34.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.641+0000 7f05fcff4640 1 -- 172.21.15.104:0/2559594945 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f05d806b4d0 msgr2=0x7f05d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.641+0000 7f05fcff4640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f05d806b4d0 0x7f05d806d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05e800f500 tx=0x7f05e8007770 comp rx=0 tx=0).stop 2024-05-08T04:21:34.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.641+0000 7f05fcff4640 1 -- 172.21.15.104:0/2559594945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05f815db30 msgr2=0x7f05f80aabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.641+0000 7f05fcff4640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05f815db30 0x7f05f80aabe0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f05f002a1e0 tx=0x7f05f00046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.641+0000 7f05fcff4640 1 -- 172.21.15.104:0/2559594945 shutdown_connections 2024-05-08T04:21:34.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.641+0000 7f05fcff4640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f05d806b4d0 0x7f05d806d990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.641+0000 7f05fcff4640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05f815db30 0x7f05f80aabe0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.641+0000 7f05fcff4640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05f80b93b0 0x7f05f80aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.641+0000 7f05fcff4640 1 --2- 172.21.15.104:0/2559594945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05f80b5b40 0x7f05f815cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.641+0000 7f05fcff4640 1 -- 172.21.15.104:0/2559594945 >> 172.21.15.104:0/2559594945 conn(0x7f05f80d0430 msgr2=0x7f05f80b75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:34.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.641+0000 7f05fcff4640 1 -- 172.21.15.104:0/2559594945 shutdown_connections 2024-05-08T04:21:34.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.641+0000 7f05fcff4640 1 -- 172.21.15.104:0/2559594945 wait complete. 2024-05-08T04:21:34.654 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:34.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.755+0000 7f44abb68640 1 Processor -- start 2024-05-08T04:21:34.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.755+0000 7f44abb68640 1 -- start start 2024-05-08T04:21:34.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.756+0000 7f44abb68640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44a40d0970 0x7f44a415c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.756+0000 7f44abb68640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f44a415cad0 0x7f44a415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.756+0000 7f44abb68640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a415d420 con 0x7f44a4070c70 2024-05-08T04:21:34.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.756+0000 7f44abb68640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a40d16a0 con 0x7f44a415cad0 2024-05-08T04:21:34.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.756+0000 7f44abb68640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40d10e0 con 0x7f44a40d0970 2024-05-08T04:21:34.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.756+0000 7f44aa105640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f44a415cad0 0x7f44a415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.756+0000 7f44a9904640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f44a4070c70 0x7f44a4071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46872/0 (socket says 172.21.15.104:46872) 2024-05-08T04:21:34.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.756+0000 7f44a9904640 1 -- 172.21.15.104:0/1441188037 learned_addr learned my addr 172.21.15.104:0/1441188037 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:34.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.756+0000 7f44aa105640 1 -- 172.21.15.104:0/1441188037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44a40d0970 msgr2=0x7f44a415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:34.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.756+0000 7f44a9103640 1 --2- 172.21.15.104:0/1441188037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44a40d0970 0x7f44a415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.757+0000 7f44aa105640 1 --2- 172.21.15.104:0/1441188037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44a40d0970 0x7f44a415c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.756+0000 7f44a8902640 1 -- 172.21.15.104:0/1441188037 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104206050 0 0) 0x7f44a415d420 con 0x7f44a4070c70 2024-05-08T04:21:34.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.757+0000 7f44aa105640 1 -- 172.21.15.104:0/1441188037 >> v1:172.21.15.104:6789/0 conn(0x7f44a4070c70 legacy=0x7f44a4071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.757+0000 7f44aa105640 1 -- 172.21.15.104:0/1441188037 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a40d13c0 con 0x7f44a415cad0 2024-05-08T04:21:34.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.757+0000 7f44a9103640 1 --2- 172.21.15.104:0/1441188037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44a40d0970 0x7f44a415c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:34.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.757+0000 7f44aa105640 1 --2- 172.21.15.104:0/1441188037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44a415cad0 0x7f44a415dbe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f449c0097a0 tx=0x7f449c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e808c5668f904346 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:34.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.757+0000 7f44a8902640 1 -- 172.21.15.104:0/1441188037 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c037070 con 0x7f44a415cad0 2024-05-08T04:21:34.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.757+0000 7f44a8902640 1 -- 172.21.15.104:0/1441188037 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c032440 con 0x7f44a415cad0 2024-05-08T04:21:34.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.757+0000 7f44a8902640 1 -- 172.21.15.104:0/1441188037 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c032810 con 0x7f44a415cad0 2024-05-08T04:21:34.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.758+0000 7f44abb68640 1 -- 172.21.15.104:0/1441188037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44a415cad0 msgr2=0x7f44a415dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.758+0000 7f44abb68640 1 --2- 172.21.15.104:0/1441188037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44a415cad0 0x7f44a415dbe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f449c0097a0 tx=0x7f449c02a180 comp rx=0 tx=0).stop 2024-05-08T04:21:34.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.758+0000 7f44abb68640 1 -- 172.21.15.104:0/1441188037 shutdown_connections 2024-05-08T04:21:34.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.758+0000 7f44abb68640 1 --2- 172.21.15.104:0/1441188037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44a415cad0 0x7f44a415dbe0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.758+0000 7f44abb68640 1 --2- 172.21.15.104:0/1441188037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44a40d0970 0x7f44a415c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.758+0000 7f44abb68640 1 -- 172.21.15.104:0/1441188037 >> 172.21.15.104:0/1441188037 conn(0x7f44a40b3450 msgr2=0x7f44a40b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:34.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.758+0000 7f44abb68640 1 -- 172.21.15.104:0/1441188037 shutdown_connections 2024-05-08T04:21:34.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.758+0000 7f44abb68640 1 -- 172.21.15.104:0/1441188037 wait complete. 2024-05-08T04:21:34.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.759+0000 7f44abb68640 1 Processor -- start 2024-05-08T04:21:34.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.759+0000 7f44abb68640 1 -- start start 2024-05-08T04:21:34.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44abb68640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44a4070c70 0x7f44a414c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44abb68640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44a40d0970 0x7f44a4152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44abb68640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44a415cad0 0x7f44a40b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44abb68640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a415e120 con 0x7f44a40d0970 2024-05-08T04:21:34.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44abb68640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40d0df0 con 0x7f44a4070c70 2024-05-08T04:21:34.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44abb68640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a415e2a0 con 0x7f44a415cad0 2024-05-08T04:21:34.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44a9103640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44a40d0970 0x7f44a4152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44a9103640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44a40d0970 0x7f44a4152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38330/0 (socket says 172.21.15.104:38330) 2024-05-08T04:21:34.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44a9103640 1 -- 172.21.15.104:0/3188925705 learned_addr learned my addr 172.21.15.104:0/3188925705 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:34.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44a9103640 1 -- 172.21.15.104:0/3188925705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44a415cad0 msgr2=0x7f44a40b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44aa105640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44a415cad0 0x7f44a40b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44a9103640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44a415cad0 0x7f44a40b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44a9103640 1 -- 172.21.15.104:0/3188925705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44a4070c70 msgr2=0x7f44a414c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44a9904640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44a4070c70 0x7f44a414c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44a9103640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44a4070c70 0x7f44a414c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.760+0000 7f44a9103640 1 -- 172.21.15.104:0/3188925705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a414c9a0 con 0x7f44a40d0970 2024-05-08T04:21:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.761+0000 7f44a9103640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44a40d0970 0x7f44a4152f00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f449800c7f0 tx=0x7f449800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.761+0000 7f44a27fc640 1 -- 172.21.15.104:0/3188925705 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498015070 con 0x7f44a40d0970 2024-05-08T04:21:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.761+0000 7f44a27fc640 1 -- 172.21.15.104:0/3188925705 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4498007a30 con 0x7f44a40d0970 2024-05-08T04:21:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.761+0000 7f44a27fc640 1 -- 172.21.15.104:0/3188925705 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498007e00 con 0x7f44a40d0970 2024-05-08T04:21:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.761+0000 7f44abb68640 1 -- 172.21.15.104:0/3188925705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a414cf80 con 0x7f44a40d0970 2024-05-08T04:21:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.761+0000 7f44abb68640 1 -- 172.21.15.104:0/3188925705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a414d540 con 0x7f44a40d0970 2024-05-08T04:21:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.762+0000 7f44abb68640 1 -- 172.21.15.104:0/3188925705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a4075010 con 0x7f44a40d0970 2024-05-08T04:21:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.762+0000 7f44a27fc640 1 -- 172.21.15.104:0/3188925705 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4498018070 con 0x7f44a40d0970 2024-05-08T04:21:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.763+0000 7f44a27fc640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f449006b4d0 0x7f449006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.763+0000 7f44a27fc640 1 -- 172.21.15.104:0/3188925705 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f449808a150 con 0x7f44a40d0970 2024-05-08T04:21:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.763+0000 7f44a9904640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f449006b4d0 0x7f449006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:34.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.763+0000 7f44a9904640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f449006b4d0 0x7f449006d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f44940012e0 tx=0x7f4494009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:34.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.767+0000 7f44a27fc640 1 -- 172.21.15.104:0/3188925705 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f44a414c9a0 con 0x7f44a40d0970 2024-05-08T04:21:34.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.940+0000 7f44abb68640 1 -- 172.21.15.104:0/3188925705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44a40b4180 con 0x7f44a40d0970 2024-05-08T04:21:34.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.941+0000 7f44a27fc640 1 -- 172.21.15.104:0/3188925705 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4498058fd0 con 0x7f44a40d0970 2024-05-08T04:21:34.942 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:34.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.942+0000 7f44abb68640 1 -- 172.21.15.104:0/3188925705 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f449006b4d0 msgr2=0x7f449006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.942+0000 7f44abb68640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f449006b4d0 0x7f449006d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f44940012e0 tx=0x7f4494009040 comp rx=0 tx=0).stop 2024-05-08T04:21:34.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.942+0000 7f44abb68640 1 -- 172.21.15.104:0/3188925705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44a40d0970 msgr2=0x7f44a4152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:34.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.942+0000 7f44abb68640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44a40d0970 0x7f44a4152f00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f449800c7f0 tx=0x7f449800cbf0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.943+0000 7f44abb68640 1 -- 172.21.15.104:0/3188925705 shutdown_connections 2024-05-08T04:21:34.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.943+0000 7f44abb68640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f449006b4d0 0x7f449006d990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.943+0000 7f44abb68640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44a415cad0 0x7f44a40b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.943+0000 7f44abb68640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44a40d0970 0x7f44a4152f00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.943+0000 7f44abb68640 1 --2- 172.21.15.104:0/3188925705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44a4070c70 0x7f44a414c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:34.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.943+0000 7f44abb68640 1 -- 172.21.15.104:0/3188925705 >> 172.21.15.104:0/3188925705 conn(0x7f44a40b3450 msgr2=0x7f44a415fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:34.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.943+0000 7f44abb68640 1 -- 172.21.15.104:0/3188925705 shutdown_connections 2024-05-08T04:21:34.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:34.943+0000 7f44abb68640 1 -- 172.21.15.104:0/3188925705 wait complete. 2024-05-08T04:21:34.955 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:35.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.055+0000 7ff717ee1640 1 Processor -- start 2024-05-08T04:21:35.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.056+0000 7ff717ee1640 1 -- start start 2024-05-08T04:21:35.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.056+0000 7ff717ee1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff710162150 0x7ff7100d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.056+0000 7ff717ee1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7100cee50 0x7ff7100b8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.056+0000 7ff717ee1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7100b5540 con 0x7ff710161780 2024-05-08T04:21:35.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.056+0000 7ff717ee1640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7100b57e0 con 0x7ff710162150 2024-05-08T04:21:35.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.056+0000 7ff717ee1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100b5ac0 con 0x7ff7100cee50 2024-05-08T04:21:35.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.057+0000 7ff715c7d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff710162150 0x7ff7100d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.057+0000 7ff715c7d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff710162150 0x7ff7100d2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38342/0 (socket says 172.21.15.104:38342) 2024-05-08T04:21:35.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.057+0000 7ff715c7d640 1 -- 172.21.15.104:0/2899020848 learned_addr learned my addr 172.21.15.104:0/2899020848 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:35.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.057+0000 7ff715c7d640 1 -- 172.21.15.104:0/2899020848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7100cee50 msgr2=0x7ff7100b8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:35.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.057+0000 7ff715c7d640 1 --2- 172.21.15.104:0/2899020848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7100cee50 0x7ff7100b8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.057+0000 7ff715c7d640 1 -- 172.21.15.104:0/2899020848 >> v1:172.21.15.183:6789/0 conn(0x7ff710161780 legacy=0x7ff7100ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:35.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.057+0000 7ff715c7d640 1 -- 172.21.15.104:0/2899020848 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7100b5da0 con 0x7ff710162150 2024-05-08T04:21:35.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.058+0000 7ff715c7d640 1 --2- 172.21.15.104:0/2899020848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff710162150 0x7ff7100d2c70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff7100d14c0 tx=0x7ff70802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f11068ff1496035 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:35.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.058+0000 7ff714c7b640 1 -- 172.21.15.104:0/2899020848 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708037070 con 0x7ff710162150 2024-05-08T04:21:35.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.058+0000 7ff714c7b640 1 -- 172.21.15.104:0/2899020848 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff708032440 con 0x7ff710162150 2024-05-08T04:21:35.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.058+0000 7ff714c7b640 1 -- 172.21.15.104:0/2899020848 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708032810 con 0x7ff710162150 2024-05-08T04:21:35.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.058+0000 7ff717ee1640 1 -- 172.21.15.104:0/2899020848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff710162150 msgr2=0x7ff7100d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.058+0000 7ff717ee1640 1 --2- 172.21.15.104:0/2899020848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff710162150 0x7ff7100d2c70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff7100d14c0 tx=0x7ff70802a160 comp rx=0 tx=0).stop 2024-05-08T04:21:35.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.058+0000 7ff717ee1640 1 -- 172.21.15.104:0/2899020848 shutdown_connections 2024-05-08T04:21:35.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.058+0000 7ff717ee1640 1 --2- 172.21.15.104:0/2899020848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7100cee50 0x7ff7100b8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.058+0000 7ff717ee1640 1 --2- 172.21.15.104:0/2899020848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff710162150 0x7ff7100d2c70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.058+0000 7ff717ee1640 1 -- 172.21.15.104:0/2899020848 >> 172.21.15.104:0/2899020848 conn(0x7ff71006c330 msgr2=0x7ff71006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:35.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.058+0000 7ff717ee1640 1 -- 172.21.15.104:0/2899020848 shutdown_connections 2024-05-08T04:21:35.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.058+0000 7ff717ee1640 1 -- 172.21.15.104:0/2899020848 wait complete. 2024-05-08T04:21:35.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.059+0000 7ff717ee1640 1 Processor -- start 2024-05-08T04:21:35.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.060+0000 7ff717ee1640 1 -- start start 2024-05-08T04:21:35.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.060+0000 7ff717ee1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7100cee50 0x7ff7100c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.060+0000 7ff717ee1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff710161780 0x7ff7100c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.060+0000 7ff717ee1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff710162150 0x7ff710159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.060+0000 7ff717ee1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7101626b0 con 0x7ff710162150 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.060+0000 7ff717ee1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff710162530 con 0x7ff7100cee50 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.060+0000 7ff717ee1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100d4010 con 0x7ff710161780 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.060+0000 7ff71647e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff710162150 0x7ff710159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.060+0000 7ff71647e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff710162150 0x7ff710159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38350/0 (socket says 172.21.15.104:38350) 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.060+0000 7ff71647e640 1 -- 172.21.15.104:0/1135599090 learned_addr learned my addr 172.21.15.104:0/1135599090 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff715c7d640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7100cee50 0x7ff7100c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff71547c640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff710161780 0x7ff7100c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff71647e640 1 -- 172.21.15.104:0/1135599090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff710161780 msgr2=0x7ff7100c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff71647e640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff710161780 0x7ff7100c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff71647e640 1 -- 172.21.15.104:0/1135599090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7100cee50 msgr2=0x7ff7100c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff71647e640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7100cee50 0x7ff7100c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff71647e640 1 -- 172.21.15.104:0/1135599090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7100c81b0 con 0x7ff710162150 2024-05-08T04:21:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff715c7d640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7100cee50 0x7ff7100c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff71547c640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff710161780 0x7ff7100c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff71647e640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff710162150 0x7ff710159ed0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff70000b9e0 tx=0x7ff70000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff70e7fc640 1 -- 172.21.15.104:0/1135599090 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700019070 con 0x7ff710162150 2024-05-08T04:21:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff70e7fc640 1 -- 172.21.15.104:0/1135599090 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70000cb40 con 0x7ff710162150 2024-05-08T04:21:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff717ee1640 1 -- 172.21.15.104:0/1135599090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7100c8490 con 0x7ff710162150 2024-05-08T04:21:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff70e7fc640 1 -- 172.21.15.104:0/1135599090 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700014440 con 0x7ff710162150 2024-05-08T04:21:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.061+0000 7ff717ee1640 1 -- 172.21.15.104:0/1135599090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7101f4180 con 0x7ff710162150 2024-05-08T04:21:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.062+0000 7ff717ee1640 1 -- 172.21.15.104:0/1135599090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7101f4380 con 0x7ff710162150 2024-05-08T04:21:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.062+0000 7ff70e7fc640 1 -- 172.21.15.104:0/1135599090 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff70001c070 con 0x7ff710162150 2024-05-08T04:21:35.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.063+0000 7ff70e7fc640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff6fc06b4d0 0x7ff6fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.063+0000 7ff70e7fc640 1 -- 172.21.15.104:0/1135599090 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff700089f30 con 0x7ff710162150 2024-05-08T04:21:35.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.063+0000 7ff715c7d640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff6fc06b4d0 0x7ff6fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.063+0000 7ff715c7d640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff6fc06b4d0 0x7ff6fc06d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff708034000 tx=0x7ff70802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:35.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.067+0000 7ff70e7fc640 1 -- 172.21.15.104:0/1135599090 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7101f4380 con 0x7ff710162150 2024-05-08T04:21:35.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.240+0000 7ff717ee1640 1 -- 172.21.15.104:0/1135599090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff710075010 con 0x7ff710162150 2024-05-08T04:21:35.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.240+0000 7ff70e7fc640 1 -- 172.21.15.104:0/1135599090 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff700058db0 con 0x7ff710162150 2024-05-08T04:21:35.241 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:35.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.242+0000 7ff717ee1640 1 -- 172.21.15.104:0/1135599090 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff6fc06b4d0 msgr2=0x7ff6fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.242+0000 7ff717ee1640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff6fc06b4d0 0x7ff6fc06d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff708034000 tx=0x7ff70802e000 comp rx=0 tx=0).stop 2024-05-08T04:21:35.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.242+0000 7ff717ee1640 1 -- 172.21.15.104:0/1135599090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff710162150 msgr2=0x7ff710159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.242+0000 7ff717ee1640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff710162150 0x7ff710159ed0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff70000b9e0 tx=0x7ff70000bea0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.242+0000 7ff717ee1640 1 -- 172.21.15.104:0/1135599090 shutdown_connections 2024-05-08T04:21:35.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.242+0000 7ff717ee1640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff6fc06b4d0 0x7ff6fc06d990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.242+0000 7ff717ee1640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff710162150 0x7ff710159ed0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.242+0000 7ff717ee1640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff710161780 0x7ff7100c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.242+0000 7ff717ee1640 1 --2- 172.21.15.104:0/1135599090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7100cee50 0x7ff7100c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.242+0000 7ff717ee1640 1 -- 172.21.15.104:0/1135599090 >> 172.21.15.104:0/1135599090 conn(0x7ff71006c330 msgr2=0x7ff7100d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:35.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.242+0000 7ff717ee1640 1 -- 172.21.15.104:0/1135599090 shutdown_connections 2024-05-08T04:21:35.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.242+0000 7ff717ee1640 1 -- 172.21.15.104:0/1135599090 wait complete. 2024-05-08T04:21:35.254 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:35.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.352+0000 7f85ac934640 1 Processor -- start 2024-05-08T04:21:35.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.352+0000 7f85ac934640 1 -- start start 2024-05-08T04:21:35.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.353+0000 7f85ac934640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85a815dad0 0x7f85a80d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.353+0000 7f85ac934640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a80d35c0 0x7f85a80b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.353+0000 7f85ac934640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f85a80d1fa0 0x7f85a80b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.353+0000 7f85ac934640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80b9920 con 0x7f85a80d1fa0 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.353+0000 7f85ac934640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80d2520 con 0x7f85a815dad0 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.353+0000 7f85ac934640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80d2800 con 0x7f85a80d35c0 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.353+0000 7f85a6d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f85a80d1fa0 0x7f85a80b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.353+0000 7f85a6d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f85a80d1fa0 0x7f85a80b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38364/0 (socket says 172.21.15.104:38364) 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.353+0000 7f85a6d9d640 1 -- 172.21.15.104:0/3892275811 learned_addr learned my addr 172.21.15.104:0/3892275811 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.354+0000 7f85a5d9b640 1 --2- 172.21.15.104:0/3892275811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a80d35c0 0x7f85a80b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.354+0000 7f85a659c640 1 --2- 172.21.15.104:0/3892275811 >> v2:172.21.15.183:3300/0 conn(0x7f85a815dad0 0x7f85a80d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.354+0000 7f85a6d9d640 1 -- 172.21.15.104:0/3892275811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a80d35c0 msgr2=0x7f85a80b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.354+0000 7f85a6d9d640 1 --2- 172.21.15.104:0/3892275811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a80d35c0 0x7f85a80b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.354+0000 7f85a6d9d640 1 -- 172.21.15.104:0/3892275811 >> v2:172.21.15.183:3300/0 conn(0x7f85a815dad0 msgr2=0x7f85a80d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.354+0000 7f85a6d9d640 1 --2- 172.21.15.104:0/3892275811 >> v2:172.21.15.183:3300/0 conn(0x7f85a815dad0 0x7f85a80d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.354+0000 7f85a6d9d640 1 -- 172.21.15.104:0/3892275811 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a80d2ae0 con 0x7f85a80d1fa0 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.354+0000 7f85a6d9d640 1 --2- 172.21.15.104:0/3892275811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a80d1fa0 0x7f85a80b59c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f85a80d4a10 tx=0x7f85a002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976d335926da0b3e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:35.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.355+0000 7f85a559a640 1 -- 172.21.15.104:0/3892275811 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0036070 con 0x7f85a80d1fa0 2024-05-08T04:21:35.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.355+0000 7f85a559a640 1 -- 172.21.15.104:0/3892275811 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a0031600 con 0x7f85a80d1fa0 2024-05-08T04:21:35.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.355+0000 7f85a559a640 1 -- 172.21.15.104:0/3892275811 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a00319d0 con 0x7f85a80d1fa0 2024-05-08T04:21:35.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.355+0000 7f85ac934640 1 -- 172.21.15.104:0/3892275811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a80d1fa0 msgr2=0x7f85a80b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.355+0000 7f85ac934640 1 --2- 172.21.15.104:0/3892275811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a80d1fa0 0x7f85a80b59c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f85a80d4a10 tx=0x7f85a002a6a0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.355+0000 7f85ac934640 1 -- 172.21.15.104:0/3892275811 shutdown_connections 2024-05-08T04:21:35.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.355+0000 7f85ac934640 1 --2- 172.21.15.104:0/3892275811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a80d1fa0 0x7f85a80b59c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.355+0000 7f85ac934640 1 --2- 172.21.15.104:0/3892275811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a80d35c0 0x7f85a80b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.355+0000 7f85ac934640 1 --2- 172.21.15.104:0/3892275811 >> v2:172.21.15.183:3300/0 conn(0x7f85a815dad0 0x7f85a80d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.355+0000 7f85ac934640 1 -- 172.21.15.104:0/3892275811 >> 172.21.15.104:0/3892275811 conn(0x7f85a806c650 msgr2=0x7f85a80d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:35.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.355+0000 7f85ac934640 1 -- 172.21.15.104:0/3892275811 shutdown_connections 2024-05-08T04:21:35.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.355+0000 7f85ac934640 1 -- 172.21.15.104:0/3892275811 wait complete. 2024-05-08T04:21:35.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.357+0000 7f85ac934640 1 Processor -- start 2024-05-08T04:21:35.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.357+0000 7f85ac934640 1 -- start start 2024-05-08T04:21:35.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.357+0000 7f85ac934640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a80d1fa0 0x7f85a815f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.357+0000 7f85ac934640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a80d35c0 0x7f85a814bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.357+0000 7f85ac934640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a815dad0 0x7f85a80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.357+0000 7f85ac934640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a815deb0 con 0x7f85a815dad0 2024-05-08T04:21:35.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.357+0000 7f85ac934640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80d30a0 con 0x7f85a80d35c0 2024-05-08T04:21:35.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.357+0000 7f85ac934640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a815e030 con 0x7f85a80d1fa0 2024-05-08T04:21:35.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.357+0000 7f85a6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a815dad0 0x7f85a80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.357+0000 7f85a6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a815dad0 0x7f85a80cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38378/0 (socket says 172.21.15.104:38378) 2024-05-08T04:21:35.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.357+0000 7f85a6d9d640 1 -- 172.21.15.104:0/859230590 learned_addr learned my addr 172.21.15.104:0/859230590 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.358+0000 7f85a659c640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a80d1fa0 0x7f85a815f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.358+0000 7f85a5d9b640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a80d35c0 0x7f85a814bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.358+0000 7f85a6d9d640 1 -- 172.21.15.104:0/859230590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a80d1fa0 msgr2=0x7f85a815f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.358+0000 7f85a6d9d640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a80d1fa0 0x7f85a815f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.358+0000 7f85a6d9d640 1 -- 172.21.15.104:0/859230590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a80d35c0 msgr2=0x7f85a814bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.358+0000 7f85a6d9d640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a80d35c0 0x7f85a814bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.358+0000 7f85a6d9d640 1 -- 172.21.15.104:0/859230590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a814c1c0 con 0x7f85a815dad0 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.358+0000 7f85a6d9d640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a815dad0 0x7f85a80cd320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009f40 tx=0x7f85a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.358+0000 7f8596ffd640 1 -- 172.21.15.104:0/859230590 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0036050 con 0x7f85a815dad0 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.358+0000 7f8596ffd640 1 -- 172.21.15.104:0/859230590 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a0042070 con 0x7f85a815dad0 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.358+0000 7f8596ffd640 1 -- 172.21.15.104:0/859230590 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0009510 con 0x7f85a815dad0 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.358+0000 7f85ac934640 1 -- 172.21.15.104:0/859230590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a815e3d0 con 0x7f85a815dad0 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.358+0000 7f85ac934640 1 -- 172.21.15.104:0/859230590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a815ec10 con 0x7f85a815dad0 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.359+0000 7f85ac934640 1 -- 172.21.15.104:0/859230590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a8075010 con 0x7f85a815dad0 2024-05-08T04:21:35.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.359+0000 7f8596ffd640 1 -- 172.21.15.104:0/859230590 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f85a0007bd0 con 0x7f85a815dad0 2024-05-08T04:21:35.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.360+0000 7f8596ffd640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f858806b4d0 0x7f858806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.360+0000 7f85a659c640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f858806b4d0 0x7f858806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.360+0000 7f8596ffd640 1 -- 172.21.15.104:0/859230590 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85a00ab0c0 con 0x7f85a815dad0 2024-05-08T04:21:35.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.360+0000 7f85a659c640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f858806b4d0 0x7f858806d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8598006fd0 tx=0x7f8598008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:35.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.364+0000 7f8596ffd640 1 -- 172.21.15.104:0/859230590 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f85a815e3d0 con 0x7f85a815dad0 2024-05-08T04:21:35.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.536+0000 7f85ac934640 1 -- 172.21.15.104:0/859230590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85a80ce5b0 con 0x7f85a815dad0 2024-05-08T04:21:35.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.537+0000 7f8596ffd640 1 -- 172.21.15.104:0/859230590 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f85a0079fd0 con 0x7f85a815dad0 2024-05-08T04:21:35.539 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:35.539 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:35.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.539+0000 7f85ac934640 1 -- 172.21.15.104:0/859230590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f858806b4d0 msgr2=0x7f858806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.539+0000 7f85ac934640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f858806b4d0 0x7f858806d990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8598006fd0 tx=0x7f8598008040 comp rx=0 tx=0).stop 2024-05-08T04:21:35.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.539+0000 7f85ac934640 1 -- 172.21.15.104:0/859230590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a815dad0 msgr2=0x7f85a80cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.539+0000 7f85ac934640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a815dad0 0x7f85a80cd320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009f40 tx=0x7f85a0004a40 comp rx=0 tx=0).stop 2024-05-08T04:21:35.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.539+0000 7f85ac934640 1 -- 172.21.15.104:0/859230590 shutdown_connections 2024-05-08T04:21:35.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.539+0000 7f85ac934640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f858806b4d0 0x7f858806d990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.540+0000 7f85ac934640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a80d35c0 0x7f85a814bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.540+0000 7f85ac934640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85a815dad0 0x7f85a80cd320 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.540+0000 7f85ac934640 1 --2- 172.21.15.104:0/859230590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a80d1fa0 0x7f85a815f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.540+0000 7f85ac934640 1 -- 172.21.15.104:0/859230590 >> 172.21.15.104:0/859230590 conn(0x7f85a806c650 msgr2=0x7f85a80cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:35.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.540+0000 7f85ac934640 1 -- 172.21.15.104:0/859230590 shutdown_connections 2024-05-08T04:21:35.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.540+0000 7f85ac934640 1 -- 172.21.15.104:0/859230590 wait complete. 2024-05-08T04:21:35.552 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:35.552 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:35.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.653+0000 7f7a7490a640 1 Processor -- start 2024-05-08T04:21:35.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.653+0000 7f7a7490a640 1 -- start start 2024-05-08T04:21:35.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.654+0000 7f7a7490a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7a700701a0 0x7f7a70070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.654+0000 7f7a7490a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a700cd120 0x7f7a700cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.654+0000 7f7a7490a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a70073030 con 0x7f7a70158540 2024-05-08T04:21:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.654+0000 7f7a7490a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a700cbf50 con 0x7f7a700701a0 2024-05-08T04:21:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.654+0000 7f7a7490a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a70072210 con 0x7f7a700cd120 2024-05-08T04:21:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.654+0000 7f7a65d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7a700701a0 0x7f7a70070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.654+0000 7f7a6e59c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f7a70158540 0x7f7a7015e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46884/0 (socket says 172.21.15.104:46884) 2024-05-08T04:21:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.654+0000 7f7a65d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7a700701a0 0x7f7a70070600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38386/0 (socket says 172.21.15.104:38386) 2024-05-08T04:21:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.654+0000 7f7a65d9b640 1 -- 172.21.15.104:0/91968212 learned_addr learned my addr 172.21.15.104:0/91968212 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.655+0000 7f7a65d9b640 1 -- 172.21.15.104:0/91968212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a700cd120 msgr2=0x7f7a700cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.655+0000 7f7a6ed9d640 1 --2- 172.21.15.104:0/91968212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a700cd120 0x7f7a700cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.655+0000 7f7a6dd9b640 1 -- 172.21.15.104:0/91968212 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781139147 0 0) 0x7f7a70073030 con 0x7f7a70158540 2024-05-08T04:21:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.655+0000 7f7a65d9b640 1 --2- 172.21.15.104:0/91968212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a700cd120 0x7f7a700cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.655+0000 7f7a65d9b640 1 -- 172.21.15.104:0/91968212 >> v1:172.21.15.104:6789/0 conn(0x7f7a70158540 legacy=0x7f7a7015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.655+0000 7f7a65d9b640 1 -- 172.21.15.104:0/91968212 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a700724b0 con 0x7f7a700701a0 2024-05-08T04:21:35.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.655+0000 7f7a6ed9d640 1 --2- 172.21.15.104:0/91968212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a700cd120 0x7f7a700cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:35.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.655+0000 7f7a65d9b640 1 --2- 172.21.15.104:0/91968212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a700701a0 0x7f7a70070600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009870 tx=0x7f7a5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58e862f69e0e63f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:35.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.655+0000 7f7a6dd9b640 1 -- 172.21.15.104:0/91968212 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a58037070 con 0x7f7a700701a0 2024-05-08T04:21:35.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.655+0000 7f7a6dd9b640 1 -- 172.21.15.104:0/91968212 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a58032440 con 0x7f7a700701a0 2024-05-08T04:21:35.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.655+0000 7f7a6dd9b640 1 -- 172.21.15.104:0/91968212 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a58032810 con 0x7f7a700701a0 2024-05-08T04:21:35.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.656+0000 7f7a7490a640 1 -- 172.21.15.104:0/91968212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a700701a0 msgr2=0x7f7a70070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.656+0000 7f7a7490a640 1 --2- 172.21.15.104:0/91968212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a700701a0 0x7f7a70070600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009870 tx=0x7f7a5802a270 comp rx=0 tx=0).stop 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.656+0000 7f7a7490a640 1 -- 172.21.15.104:0/91968212 shutdown_connections 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.656+0000 7f7a7490a640 1 --2- 172.21.15.104:0/91968212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a700cd120 0x7f7a700cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.656+0000 7f7a7490a640 1 --2- 172.21.15.104:0/91968212 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a700701a0 0x7f7a70070600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.656+0000 7f7a7490a640 1 -- 172.21.15.104:0/91968212 >> 172.21.15.104:0/91968212 conn(0x7f7a700b23e0 msgr2=0x7f7a700b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.656+0000 7f7a7490a640 1 -- 172.21.15.104:0/91968212 shutdown_connections 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.656+0000 7f7a7490a640 1 -- 172.21.15.104:0/91968212 wait complete. 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.657+0000 7f7a7490a640 1 Processor -- start 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.658+0000 7f7a7490a640 1 -- start start 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.658+0000 7f7a7490a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a700701a0 0x7f7a70147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.658+0000 7f7a7490a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a700cd120 0x7f7a700c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.658+0000 7f7a7490a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a70158540 0x7f7a700c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.658+0000 7f7a7490a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a70072d50 con 0x7f7a70158540 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.658+0000 7f7a7490a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a70072a70 con 0x7f7a700701a0 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.658+0000 7f7a7490a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700cc380 con 0x7f7a700cd120 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.658+0000 7f7a6ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a70158540 0x7f7a700c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.658+0000 7f7a6ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a70158540 0x7f7a700c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38400/0 (socket says 172.21.15.104:38400) 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.658+0000 7f7a6ed9d640 1 -- 172.21.15.104:0/1464443219 learned_addr learned my addr 172.21.15.104:0/1464443219 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.659+0000 7f7a65d9b640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a700cd120 0x7f7a700c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.659+0000 7f7a6e59c640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a700701a0 0x7f7a70147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.659+0000 7f7a6ed9d640 1 -- 172.21.15.104:0/1464443219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a700cd120 msgr2=0x7f7a700c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.659+0000 7f7a6ed9d640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a700cd120 0x7f7a700c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.659+0000 7f7a6ed9d640 1 -- 172.21.15.104:0/1464443219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a700701a0 msgr2=0x7f7a70147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.659+0000 7f7a6ed9d640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a700701a0 0x7f7a70147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.659+0000 7f7a6ed9d640 1 -- 172.21.15.104:0/1464443219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a700cfdb0 con 0x7f7a70158540 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.659+0000 7f7a6ed9d640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a70158540 0x7f7a700c9fa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800cf20 tx=0x7f7a6800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.659+0000 7f7a677fe640 1 -- 172.21.15.104:0/1464443219 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6801a070 con 0x7f7a70158540 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.659+0000 7f7a677fe640 1 -- 172.21.15.104:0/1464443219 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6800d840 con 0x7f7a70158540 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.659+0000 7f7a7490a640 1 -- 172.21.15.104:0/1464443219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a700d0090 con 0x7f7a70158540 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.659+0000 7f7a677fe640 1 -- 172.21.15.104:0/1464443219 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800dc30 con 0x7f7a70158540 2024-05-08T04:21:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.659+0000 7f7a7490a640 1 -- 172.21.15.104:0/1464443219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a700d0650 con 0x7f7a70158540 2024-05-08T04:21:35.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.660+0000 7f7a7490a640 1 -- 172.21.15.104:0/1464443219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a70075010 con 0x7f7a70158540 2024-05-08T04:21:35.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.661+0000 7f7a677fe640 1 -- 172.21.15.104:0/1464443219 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7a6801d070 con 0x7f7a70158540 2024-05-08T04:21:35.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.661+0000 7f7a677fe640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7a5006b500 0x7f7a5006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.661+0000 7f7a677fe640 1 -- 172.21.15.104:0/1464443219 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a6808aa30 con 0x7f7a70158540 2024-05-08T04:21:35.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.661+0000 7f7a6e59c640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7a5006b500 0x7f7a5006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.661+0000 7f7a6e59c640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7a5006b500 0x7f7a5006d9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7a60000f60 tx=0x7f7a60007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:35.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.665+0000 7f7a677fe640 1 -- 172.21.15.104:0/1464443219 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a68059940 con 0x7f7a70158540 2024-05-08T04:21:35.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.837+0000 7f7a7490a640 1 -- 172.21.15.104:0/1464443219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a70154690 con 0x7f7a70158540 2024-05-08T04:21:35.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.837+0000 7f7a677fe640 1 -- 172.21.15.104:0/1464443219 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a68059240 con 0x7f7a70158540 2024-05-08T04:21:35.838 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:35.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.839+0000 7f7a7490a640 1 -- 172.21.15.104:0/1464443219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7a5006b500 msgr2=0x7f7a5006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.839+0000 7f7a7490a640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7a5006b500 0x7f7a5006d9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7a60000f60 tx=0x7f7a60007c00 comp rx=0 tx=0).stop 2024-05-08T04:21:35.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.839+0000 7f7a7490a640 1 -- 172.21.15.104:0/1464443219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a70158540 msgr2=0x7f7a700c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.839+0000 7f7a7490a640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a70158540 0x7f7a700c9fa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800cf20 tx=0x7f7a6800a7d0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.839+0000 7f7a7490a640 1 -- 172.21.15.104:0/1464443219 shutdown_connections 2024-05-08T04:21:35.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.839+0000 7f7a7490a640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7a5006b500 0x7f7a5006d9c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.839+0000 7f7a7490a640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a70158540 0x7f7a700c9fa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.839+0000 7f7a7490a640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a700cd120 0x7f7a700c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.839+0000 7f7a7490a640 1 --2- 172.21.15.104:0/1464443219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a700701a0 0x7f7a70147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.839+0000 7f7a7490a640 1 -- 172.21.15.104:0/1464443219 >> 172.21.15.104:0/1464443219 conn(0x7f7a700b23e0 msgr2=0x7f7a700cc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:35.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.839+0000 7f7a7490a640 1 -- 172.21.15.104:0/1464443219 shutdown_connections 2024-05-08T04:21:35.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.839+0000 7f7a7490a640 1 -- 172.21.15.104:0/1464443219 wait complete. 2024-05-08T04:21:35.851 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:35.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.953+0000 7fcd59bb0640 1 Processor -- start 2024-05-08T04:21:35.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.953+0000 7fcd59bb0640 1 -- start start 2024-05-08T04:21:35.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.954+0000 7fcd59bb0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd540cfa40 0x7fcd540cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.954+0000 7fcd59bb0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcd540cb3e0 0x7fcd540cb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.954+0000 7fcd59bb0640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd540cd7a0 con 0x7fcd5415de20 2024-05-08T04:21:35.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.954+0000 7fcd59bb0640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd540caf50 con 0x7fcd540cb3e0 2024-05-08T04:21:35.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.954+0000 7fcd59bb0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd540cda80 con 0x7fcd540cfa40 2024-05-08T04:21:35.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.954+0000 7fcd53fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcd540cb3e0 0x7fcd540cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.954+0000 7fcd53fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcd540cb3e0 0x7fcd540cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38402/0 (socket says 172.21.15.104:38402) 2024-05-08T04:21:35.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.954+0000 7fcd53fff640 1 -- 172.21.15.104:0/1093835261 learned_addr learned my addr 172.21.15.104:0/1093835261 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:35.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.954+0000 7fcd537fe640 1 --1- 172.21.15.104:0/1093835261 >> v1:172.21.15.104:6789/0 conn(0x7fcd5415de20 0x7fcd540b1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46886/0 (socket says 172.21.15.104:46886) 2024-05-08T04:21:35.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.954+0000 7fcd52ffd640 1 --2- 172.21.15.104:0/1093835261 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd540cfa40 0x7fcd540cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.955+0000 7fcd53fff640 1 -- 172.21.15.104:0/1093835261 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd540cfa40 msgr2=0x7fcd540cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:35.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.955+0000 7fcd53fff640 1 --2- 172.21.15.104:0/1093835261 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd540cfa40 0x7fcd540cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.955+0000 7fcd53fff640 1 -- 172.21.15.104:0/1093835261 >> v1:172.21.15.104:6789/0 conn(0x7fcd5415de20 legacy=0x7fcd540b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.955+0000 7fcd53fff640 1 -- 172.21.15.104:0/1093835261 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd540cdd60 con 0x7fcd540cb3e0 2024-05-08T04:21:35.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.955+0000 7fcd527fc640 1 -- 172.21.15.104:0/1093835261 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726015465 0 0) 0x7fcd540cd7a0 con 0x7fcd5415de20 2024-05-08T04:21:35.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.955+0000 7fcd53fff640 1 --2- 172.21.15.104:0/1093835261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd540cb3e0 0x7fcd540cb850 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009870 tx=0x7fcd4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36401b4bfc8082ea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:35.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.955+0000 7fcd527fc640 1 -- 172.21.15.104:0/1093835261 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c037070 con 0x7fcd540cb3e0 2024-05-08T04:21:35.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.956+0000 7fcd527fc640 1 -- 172.21.15.104:0/1093835261 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c032440 con 0x7fcd540cb3e0 2024-05-08T04:21:35.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.956+0000 7fcd527fc640 1 -- 172.21.15.104:0/1093835261 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c032810 con 0x7fcd540cb3e0 2024-05-08T04:21:35.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.956+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1093835261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd540cb3e0 msgr2=0x7fcd540cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.956+0000 7fcd59bb0640 1 --2- 172.21.15.104:0/1093835261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd540cb3e0 0x7fcd540cb850 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009870 tx=0x7fcd4c02a270 comp rx=0 tx=0).stop 2024-05-08T04:21:35.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.956+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1093835261 shutdown_connections 2024-05-08T04:21:35.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.956+0000 7fcd59bb0640 1 --2- 172.21.15.104:0/1093835261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd540cb3e0 0x7fcd540cb850 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.956+0000 7fcd59bb0640 1 --2- 172.21.15.104:0/1093835261 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd540cfa40 0x7fcd540cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.956+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1093835261 >> 172.21.15.104:0/1093835261 conn(0x7fcd540b2220 msgr2=0x7fcd540b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:35.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.956+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1093835261 shutdown_connections 2024-05-08T04:21:35.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.956+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1093835261 wait complete. 2024-05-08T04:21:35.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.957+0000 7fcd59bb0640 1 Processor -- start 2024-05-08T04:21:35.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.957+0000 7fcd59bb0640 1 -- start start 2024-05-08T04:21:35.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.958+0000 7fcd59bb0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd540cb3e0 0x7fcd5406f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.958+0000 7fcd59bb0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd540cfa40 0x7fcd541f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.958+0000 7fcd59bb0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd5415de20 0x7fcd540ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.958+0000 7fcd59bb0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd540b1f20 con 0x7fcd5415de20 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.958+0000 7fcd59bb0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd540cd450 con 0x7fcd540cb3e0 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.958+0000 7fcd59bb0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5415e200 con 0x7fcd540cfa40 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.958+0000 7fcd53fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd5415de20 0x7fcd540ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.958+0000 7fcd53fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd5415de20 0x7fcd540ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38410/0 (socket says 172.21.15.104:38410) 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.958+0000 7fcd53fff640 1 -- 172.21.15.104:0/1083480065 learned_addr learned my addr 172.21.15.104:0/1083480065 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.958+0000 7fcd52ffd640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd540cfa40 0x7fcd541f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.959+0000 7fcd537fe640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd540cb3e0 0x7fcd5406f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.959+0000 7fcd53fff640 1 -- 172.21.15.104:0/1083480065 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd540cfa40 msgr2=0x7fcd541f2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.959+0000 7fcd53fff640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd540cfa40 0x7fcd541f2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.959+0000 7fcd53fff640 1 -- 172.21.15.104:0/1083480065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd540cb3e0 msgr2=0x7fcd5406f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.959+0000 7fcd53fff640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd540cb3e0 0x7fcd5406f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:35.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.959+0000 7fcd53fff640 1 -- 172.21.15.104:0/1083480065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5415f380 con 0x7fcd5415de20 2024-05-08T04:21:35.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.959+0000 7fcd537fe640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd540cb3e0 0x7fcd5406f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:35.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.959+0000 7fcd53fff640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd5415de20 0x7fcd540ad500 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009870 tx=0x7fcd4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:35.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.959+0000 7fcd3bfff640 1 -- 172.21.15.104:0/1083480065 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c037040 con 0x7fcd5415de20 2024-05-08T04:21:35.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.959+0000 7fcd3bfff640 1 -- 172.21.15.104:0/1083480065 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c004030 con 0x7fcd5415de20 2024-05-08T04:21:35.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.959+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1083480065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5415f660 con 0x7fcd5415de20 2024-05-08T04:21:35.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.959+0000 7fcd3bfff640 1 -- 172.21.15.104:0/1083480065 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c004400 con 0x7fcd5415de20 2024-05-08T04:21:35.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.959+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1083480065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5415fc20 con 0x7fcd5415de20 2024-05-08T04:21:35.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.960+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1083480065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd54075010 con 0x7fcd5415de20 2024-05-08T04:21:35.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.960+0000 7fcd3bfff640 1 -- 172.21.15.104:0/1083480065 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd4c03a070 con 0x7fcd5415de20 2024-05-08T04:21:35.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.961+0000 7fcd3bfff640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd4006b4d0 0x7fcd4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:35.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.961+0000 7fcd3bfff640 1 -- 172.21.15.104:0/1083480065 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd4c0aa8a0 con 0x7fcd5415de20 2024-05-08T04:21:35.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.961+0000 7fcd537fe640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd4006b4d0 0x7fcd4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:35.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.961+0000 7fcd537fe640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd4006b4d0 0x7fcd4006d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd44007fd0 tx=0x7fcd44009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:35.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:35.965+0000 7fcd3bfff640 1 -- 172.21.15.104:0/1083480065 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd4c041020 con 0x7fcd5415de20 2024-05-08T04:21:36.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.134+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1083480065 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd54160060 con 0x7fcd5415de20 2024-05-08T04:21:36.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.134+0000 7fcd3bfff640 1 -- 172.21.15.104:0/1083480065 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd4c079720 con 0x7fcd5415de20 2024-05-08T04:21:36.136 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:36.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.136+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1083480065 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd4006b4d0 msgr2=0x7fcd4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.136+0000 7fcd59bb0640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd4006b4d0 0x7fcd4006d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcd44007fd0 tx=0x7fcd44009040 comp rx=0 tx=0).stop 2024-05-08T04:21:36.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.136+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1083480065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd5415de20 msgr2=0x7fcd540ad500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.136+0000 7fcd59bb0640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd5415de20 0x7fcd540ad500 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009870 tx=0x7fcd4c0046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.136+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1083480065 shutdown_connections 2024-05-08T04:21:36.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.136+0000 7fcd59bb0640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd4006b4d0 0x7fcd4006d990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.136+0000 7fcd59bb0640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd5415de20 0x7fcd540ad500 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.136+0000 7fcd59bb0640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd540cfa40 0x7fcd541f2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.136+0000 7fcd59bb0640 1 --2- 172.21.15.104:0/1083480065 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd540cb3e0 0x7fcd5406f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.136+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1083480065 >> 172.21.15.104:0/1083480065 conn(0x7fcd540b2220 msgr2=0x7fcd540ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:36.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.136+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1083480065 shutdown_connections 2024-05-08T04:21:36.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.136+0000 7fcd59bb0640 1 -- 172.21.15.104:0/1083480065 wait complete. 2024-05-08T04:21:36.148 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:36.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.251+0000 7fda9e86f640 1 Processor -- start 2024-05-08T04:21:36.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.251+0000 7fda9e86f640 1 -- start start 2024-05-08T04:21:36.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.252+0000 7fda9e86f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fda980d0970 0x7fda9815c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.252+0000 7fda9e86f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9815d420 con 0x7fda9815cad0 2024-05-08T04:21:36.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.252+0000 7fda9e86f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda980d0e20 con 0x7fda98070c70 2024-05-08T04:21:36.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.252+0000 7fda9e86f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda980d16a0 con 0x7fda980d0970 2024-05-08T04:21:36.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.252+0000 7fda9ce0c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fda9815cad0 0x7fda9815dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46900/0 (socket says 172.21.15.104:46900) 2024-05-08T04:21:36.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.252+0000 7fda9ce0c640 1 -- 172.21.15.104:0/1611542709 learned_addr learned my addr 172.21.15.104:0/1611542709 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:36.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.252+0000 7fda8ffff640 1 --2- 172.21.15.104:0/1611542709 >> v2:172.21.15.183:3300/0 conn(0x7fda980d0970 0x7fda9815c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.252+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501163963 0 0) 0x7fda9815d420 con 0x7fda9815cad0 2024-05-08T04:21:36.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.252+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda84003520 con 0x7fda9815cad0 2024-05-08T04:21:36.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.252+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 165465320 0 0) 0x7fda84003520 con 0x7fda9815cad0 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.252+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 >> v2:172.21.15.183:3300/0 conn(0x7fda980d0970 msgr2=0x7fda9815c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.252+0000 7fda977fe640 1 --2- 172.21.15.104:0/1611542709 >> v2:172.21.15.183:3300/0 conn(0x7fda980d0970 0x7fda9815c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.252+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 >> v1:172.21.15.183:6789/0 conn(0x7fda98070c70 legacy=0x7fda98071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda980d10e0 con 0x7fda9815cad0 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fda90001a10 con 0x7fda9815cad0 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 >> v1:172.21.15.104:6789/0 conn(0x7fda9815cad0 legacy=0x7fda9815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda977fe640 1 --2- 172.21.15.104:0/1611542709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda840039b0 0x7fda84003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda977fe640 1 --2- 172.21.15.104:0/1611542709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda84004800 0x7fda84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda977fe640 1 --2- 172.21.15.104:0/1611542709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda840051c0 0x7fda8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda980d16a0 con 0x7fda840039b0 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8400c060 con 0x7fda84004800 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8400c260 con 0x7fda840051c0 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda97fff640 1 --2- 172.21.15.104:0/1611542709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda840039b0 0x7fda84003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda8ffff640 1 --2- 172.21.15.104:0/1611542709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda84004800 0x7fda84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda9ce0c640 1 --2- 172.21.15.104:0/1611542709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda840051c0 0x7fda8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda97fff640 1 -- 172.21.15.104:0/1611542709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda840051c0 msgr2=0x7fda8400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:36.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda97fff640 1 --2- 172.21.15.104:0/1611542709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda840051c0 0x7fda8400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda97fff640 1 -- 172.21.15.104:0/1611542709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda84004800 msgr2=0x7fda84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:36.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda97fff640 1 --2- 172.21.15.104:0/1611542709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda84004800 0x7fda84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda97fff640 1 -- 172.21.15.104:0/1611542709 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda84003520 con 0x7fda840039b0 2024-05-08T04:21:36.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda9ce0c640 1 --2- 172.21.15.104:0/1611542709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda840051c0 0x7fda8400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:36.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.253+0000 7fda9ce0c640 1 -- 172.21.15.104:0/1611542709 reap_dead start 2024-05-08T04:21:36.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.254+0000 7fda97fff640 1 --2- 172.21.15.104:0/1611542709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda840039b0 0x7fda84003dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda88001750 tx=0x7fda84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd69ad68d44baad5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:36.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.254+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88001370 con 0x7fda840039b0 2024-05-08T04:21:36.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.254+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda880052d0 con 0x7fda840039b0 2024-05-08T04:21:36.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.254+0000 7fda977fe640 1 -- 172.21.15.104:0/1611542709 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8802abc0 con 0x7fda840039b0 2024-05-08T04:21:36.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.254+0000 7fda9e86f640 1 -- 172.21.15.104:0/1611542709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda840039b0 msgr2=0x7fda84003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.254+0000 7fda9e86f640 1 --2- 172.21.15.104:0/1611542709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda840039b0 0x7fda84003dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda88001750 tx=0x7fda84005830 comp rx=0 tx=0).stop 2024-05-08T04:21:36.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.254+0000 7fda9e86f640 1 -- 172.21.15.104:0/1611542709 shutdown_connections 2024-05-08T04:21:36.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.254+0000 7fda9e86f640 1 --2- 172.21.15.104:0/1611542709 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda840039b0 0x7fda84003dd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.254+0000 7fda9e86f640 1 -- 172.21.15.104:0/1611542709 >> 172.21.15.104:0/1611542709 conn(0x7fda980b3450 msgr2=0x7fda980b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:36.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.255+0000 7fda9e86f640 1 -- 172.21.15.104:0/1611542709 shutdown_connections 2024-05-08T04:21:36.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.255+0000 7fda9e86f640 1 -- 172.21.15.104:0/1611542709 wait complete. 2024-05-08T04:21:36.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.256+0000 7fda9e86f640 1 Processor -- start 2024-05-08T04:21:36.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.256+0000 7fda9e86f640 1 -- start start 2024-05-08T04:21:36.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.256+0000 7fda9e86f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda840039b0 0x7fda981440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.256+0000 7fda9e86f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda98151340 0x7fda981517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.256+0000 7fda9e86f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda9806bc70 0x7fda9806c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.256+0000 7fda9e86f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9815c590 con 0x7fda9806bc70 2024-05-08T04:21:36.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.256+0000 7fda9e86f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9815d6c0 con 0x7fda98151340 2024-05-08T04:21:36.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.256+0000 7fda9e86f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9815c710 con 0x7fda840039b0 2024-05-08T04:21:36.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda9ce0c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda9806bc70 0x7fda9806c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda9ce0c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda9806bc70 0x7fda9806c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38434/0 (socket says 172.21.15.104:38434) 2024-05-08T04:21:36.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda9ce0c640 1 -- 172.21.15.104:0/1140145980 learned_addr learned my addr 172.21.15.104:0/1140145980 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda97fff640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda840039b0 0x7fda981440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda8ffff640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda98151340 0x7fda981517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda9ce0c640 1 -- 172.21.15.104:0/1140145980 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda840039b0 msgr2=0x7fda981440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda9ce0c640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda840039b0 0x7fda981440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda9ce0c640 1 -- 172.21.15.104:0/1140145980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda98151340 msgr2=0x7fda981517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda9ce0c640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda98151340 0x7fda981517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda9ce0c640 1 -- 172.21.15.104:0/1140145980 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9806d9d0 con 0x7fda9806bc70 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda97fff640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda840039b0 0x7fda981440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda8ffff640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda98151340 0x7fda981517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda9ce0c640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda9806bc70 0x7fda9806c0d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fda90001560 tx=0x7fda90007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda957fa640 1 -- 172.21.15.104:0/1140145980 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9000eb40 con 0x7fda9806bc70 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda957fa640 1 -- 172.21.15.104:0/1140145980 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda90018070 con 0x7fda9806bc70 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda9e86f640 1 -- 172.21.15.104:0/1140145980 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9806c930 con 0x7fda9806bc70 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda957fa640 1 -- 172.21.15.104:0/1140145980 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90013420 con 0x7fda9806bc70 2024-05-08T04:21:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.257+0000 7fda9e86f640 1 -- 172.21.15.104:0/1140145980 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9806cef0 con 0x7fda9806bc70 2024-05-08T04:21:36.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.258+0000 7fda9e86f640 1 -- 172.21.15.104:0/1140145980 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda98075010 con 0x7fda9806bc70 2024-05-08T04:21:36.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.259+0000 7fda957fa640 1 -- 172.21.15.104:0/1140145980 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fda900135c0 con 0x7fda9806bc70 2024-05-08T04:21:36.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.259+0000 7fda957fa640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fda7806b4d0 0x7fda7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.259+0000 7fda957fa640 1 -- 172.21.15.104:0/1140145980 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda9008a460 con 0x7fda9806bc70 2024-05-08T04:21:36.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.259+0000 7fda97fff640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fda7806b4d0 0x7fda7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.260+0000 7fda97fff640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fda7806b4d0 0x7fda7806d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fda88032000 tx=0x7fda8802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:36.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.263+0000 7fda957fa640 1 -- 172.21.15.104:0/1140145980 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda900592e0 con 0x7fda9806bc70 2024-05-08T04:21:36.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.431+0000 7fda9e86f640 1 -- 172.21.15.104:0/1140145980 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda980b4180 con 0x7fda9806bc70 2024-05-08T04:21:36.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.432+0000 7fda957fa640 1 -- 172.21.15.104:0/1140145980 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda90058be0 con 0x7fda9806bc70 2024-05-08T04:21:36.433 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:36.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.434+0000 7fda9e86f640 1 -- 172.21.15.104:0/1140145980 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fda7806b4d0 msgr2=0x7fda7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.434+0000 7fda9e86f640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fda7806b4d0 0x7fda7806d990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fda88032000 tx=0x7fda8802e000 comp rx=0 tx=0).stop 2024-05-08T04:21:36.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.434+0000 7fda9e86f640 1 -- 172.21.15.104:0/1140145980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda9806bc70 msgr2=0x7fda9806c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.434+0000 7fda9e86f640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda9806bc70 0x7fda9806c0d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fda90001560 tx=0x7fda90007bc0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.434+0000 7fda9e86f640 1 -- 172.21.15.104:0/1140145980 shutdown_connections 2024-05-08T04:21:36.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.434+0000 7fda9e86f640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fda7806b4d0 0x7fda7806d990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.434+0000 7fda9e86f640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda98151340 0x7fda981517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.434+0000 7fda9e86f640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda9806bc70 0x7fda9806c0d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.434+0000 7fda9e86f640 1 --2- 172.21.15.104:0/1140145980 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda840039b0 0x7fda981440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.434+0000 7fda9e86f640 1 -- 172.21.15.104:0/1140145980 >> 172.21.15.104:0/1140145980 conn(0x7fda980b3450 msgr2=0x7fda9815dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:36.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.434+0000 7fda9e86f640 1 -- 172.21.15.104:0/1140145980 shutdown_connections 2024-05-08T04:21:36.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.434+0000 7fda9e86f640 1 -- 172.21.15.104:0/1140145980 wait complete. 2024-05-08T04:21:36.446 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:36.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.545+0000 7f061d0b3640 1 Processor -- start 2024-05-08T04:21:36.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.545+0000 7f061d0b3640 1 -- start start 2024-05-08T04:21:36.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.545+0000 7f061d0b3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061815de20 0x7f06180b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.545+0000 7f061d0b3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f06180b1d50 0x7f06180cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.545+0000 7f061d0b3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06180cd7a0 con 0x7f06180cff80 2024-05-08T04:21:36.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.545+0000 7f061d0b3640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06180caf50 con 0x7f06180b1d50 2024-05-08T04:21:36.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.545+0000 7f061d0b3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06180cda80 con 0x7f061815de20 2024-05-08T04:21:36.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.546+0000 7f061659c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f06180b1d50 0x7f06180cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.546+0000 7f061659c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f06180b1d50 0x7f06180cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38436/0 (socket says 172.21.15.104:38436) 2024-05-08T04:21:36.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.546+0000 7f061659c640 1 -- 172.21.15.104:0/2947083736 learned_addr learned my addr 172.21.15.104:0/2947083736 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:36.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.546+0000 7f0616d9d640 1 --2- 172.21.15.104:0/2947083736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061815de20 0x7f06180b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.546+0000 7f061659c640 1 -- 172.21.15.104:0/2947083736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061815de20 msgr2=0x7f06180b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:36.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.546+0000 7f061659c640 1 --2- 172.21.15.104:0/2947083736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061815de20 0x7f06180b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.546+0000 7f061659c640 1 -- 172.21.15.104:0/2947083736 >> v1:172.21.15.183:6789/0 conn(0x7f06180cff80 legacy=0x7f061806ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.546+0000 7f061659c640 1 -- 172.21.15.104:0/2947083736 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06180cdd60 con 0x7f06180b1d50 2024-05-08T04:21:36.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.547+0000 7f061659c640 1 --2- 172.21.15.104:0/2947083736 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06180b1d50 0x7f06180cfa40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0600009870 tx=0x7f060002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d4ef29a5f0acb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:36.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.547+0000 7f0615d9b640 1 -- 172.21.15.104:0/2947083736 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600037070 con 0x7f06180b1d50 2024-05-08T04:21:36.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.547+0000 7f0615d9b640 1 -- 172.21.15.104:0/2947083736 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0600032440 con 0x7f06180b1d50 2024-05-08T04:21:36.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.547+0000 7f0615d9b640 1 -- 172.21.15.104:0/2947083736 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600032810 con 0x7f06180b1d50 2024-05-08T04:21:36.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.547+0000 7f061d0b3640 1 -- 172.21.15.104:0/2947083736 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06180b1d50 msgr2=0x7f06180cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.547+0000 7f061d0b3640 1 --2- 172.21.15.104:0/2947083736 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06180b1d50 0x7f06180cfa40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0600009870 tx=0x7f060002a270 comp rx=0 tx=0).stop 2024-05-08T04:21:36.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.547+0000 7f061d0b3640 1 -- 172.21.15.104:0/2947083736 shutdown_connections 2024-05-08T04:21:36.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.547+0000 7f061d0b3640 1 --2- 172.21.15.104:0/2947083736 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06180b1d50 0x7f06180cfa40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.547+0000 7f061d0b3640 1 --2- 172.21.15.104:0/2947083736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061815de20 0x7f06180b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.547+0000 7f061d0b3640 1 -- 172.21.15.104:0/2947083736 >> 172.21.15.104:0/2947083736 conn(0x7f06180b2220 msgr2=0x7f06180b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:36.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.547+0000 7f061d0b3640 1 -- 172.21.15.104:0/2947083736 shutdown_connections 2024-05-08T04:21:36.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.547+0000 7f061d0b3640 1 -- 172.21.15.104:0/2947083736 wait complete. 2024-05-08T04:21:36.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.549+0000 7f061d0b3640 1 Processor -- start 2024-05-08T04:21:36.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.549+0000 7f061d0b3640 1 -- start start 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.549+0000 7f061d0b3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06180b1d50 0x7f06180ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.549+0000 7f061d0b3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06180cff80 0x7f06180b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.549+0000 7f061d0b3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061815de20 0x7f061814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.549+0000 7f061d0b3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061815e200 con 0x7f06180cff80 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.549+0000 7f061d0b3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06180cd450 con 0x7f06180b1d50 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.549+0000 7f061d0b3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061815e380 con 0x7f061815de20 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f061659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06180cff80 0x7f06180b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f061659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06180cff80 0x7f06180b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38438/0 (socket says 172.21.15.104:38438) 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f061659c640 1 -- 172.21.15.104:0/3455744176 learned_addr learned my addr 172.21.15.104:0/3455744176 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f0616d9d640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06180b1d50 0x7f06180ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f061759e640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061815de20 0x7f061814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f061659c640 1 -- 172.21.15.104:0/3455744176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061815de20 msgr2=0x7f061814fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f061659c640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061815de20 0x7f061814fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f061659c640 1 -- 172.21.15.104:0/3455744176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06180b1d50 msgr2=0x7f06180ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f061659c640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06180b1d50 0x7f06180ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f061659c640 1 -- 172.21.15.104:0/3455744176 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618150060 con 0x7f06180cff80 2024-05-08T04:21:36.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f061659c640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06180cff80 0x7f06180b5d30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0600000c00 tx=0x7f06000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:36.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f060f7fe640 1 -- 172.21.15.104:0/3455744176 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600037040 con 0x7f06180cff80 2024-05-08T04:21:36.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f060f7fe640 1 -- 172.21.15.104:0/3455744176 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0600042070 con 0x7f06180cff80 2024-05-08T04:21:36.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f061d0b3640 1 -- 172.21.15.104:0/3455744176 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06180adbe0 con 0x7f06180cff80 2024-05-08T04:21:36.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f060f7fe640 1 -- 172.21.15.104:0/3455744176 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600030880 con 0x7f06180cff80 2024-05-08T04:21:36.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.550+0000 7f061d0b3640 1 -- 172.21.15.104:0/3455744176 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06180ae1a0 con 0x7f06180cff80 2024-05-08T04:21:36.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.551+0000 7f061d0b3640 1 -- 172.21.15.104:0/3455744176 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0618075010 con 0x7f06180cff80 2024-05-08T04:21:36.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.552+0000 7f060f7fe640 1 -- 172.21.15.104:0/3455744176 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0600030a20 con 0x7f06180cff80 2024-05-08T04:21:36.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.552+0000 7f060f7fe640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f05f806b500 0x7f05f806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.552+0000 7f060f7fe640 1 -- 172.21.15.104:0/3455744176 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06000aa8a0 con 0x7f06180cff80 2024-05-08T04:21:36.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.552+0000 7f0616d9d640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f05f806b500 0x7f05f806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.552+0000 7f0616d9d640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f05f806b500 0x7f05f806d9c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0608009aa0 tx=0x7f0608009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:36.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.556+0000 7f060f7fe640 1 -- 172.21.15.104:0/3455744176 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0618150060 con 0x7f06180cff80 2024-05-08T04:21:36.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.731+0000 7f061d0b3640 1 -- 172.21.15.104:0/3455744176 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06180b0f00 con 0x7f06180cff80 2024-05-08T04:21:36.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.732+0000 7f060f7fe640 1 -- 172.21.15.104:0/3455744176 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f06000790d0 con 0x7f06180cff80 2024-05-08T04:21:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:36.734 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:36.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.734+0000 7f061d0b3640 1 -- 172.21.15.104:0/3455744176 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f05f806b500 msgr2=0x7f05f806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.734+0000 7f061d0b3640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f05f806b500 0x7f05f806d9c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0608009aa0 tx=0x7f0608009190 comp rx=0 tx=0).stop 2024-05-08T04:21:36.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.734+0000 7f061d0b3640 1 -- 172.21.15.104:0/3455744176 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06180cff80 msgr2=0x7f06180b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.734+0000 7f061d0b3640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06180cff80 0x7f06180b5d30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0600000c00 tx=0x7f06000046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.734+0000 7f061d0b3640 1 -- 172.21.15.104:0/3455744176 shutdown_connections 2024-05-08T04:21:36.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.734+0000 7f061d0b3640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f05f806b500 0x7f05f806d9c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.734+0000 7f061d0b3640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f061815de20 0x7f061814fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.734+0000 7f061d0b3640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06180cff80 0x7f06180b5d30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.734+0000 7f061d0b3640 1 --2- 172.21.15.104:0/3455744176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f06180b1d50 0x7f06180ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.734+0000 7f061d0b3640 1 -- 172.21.15.104:0/3455744176 >> 172.21.15.104:0/3455744176 conn(0x7f06180b2220 msgr2=0x7f06180cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:36.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.734+0000 7f061d0b3640 1 -- 172.21.15.104:0/3455744176 shutdown_connections 2024-05-08T04:21:36.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.734+0000 7f061d0b3640 1 -- 172.21.15.104:0/3455744176 wait complete. 2024-05-08T04:21:36.747 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:36.747 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:36.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.849+0000 7f5f3ff9e640 1 Processor -- start 2024-05-08T04:21:36.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.849+0000 7f5f3ff9e640 1 -- start start 2024-05-08T04:21:36.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.850+0000 7f5f3ff9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f38159ec0 0x7f5f3806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.850+0000 7f5f3ff9e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3815dce0 con 0x7f5f38072160 2024-05-08T04:21:36.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.850+0000 7f5f3ff9e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3806eb60 con 0x7f5f3815a2a0 2024-05-08T04:21:36.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.850+0000 7f5f3ff9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3806ee40 con 0x7f5f38159ec0 2024-05-08T04:21:36.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.850+0000 7f5f3e53b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f5f38072160 0x7f5f380b26f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46906/0 (socket says 172.21.15.104:46906) 2024-05-08T04:21:36.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.850+0000 7f5f3e53b640 1 -- 172.21.15.104:0/30897973 learned_addr learned my addr 172.21.15.104:0/30897973 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:36.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.851+0000 7f5f3dd3a640 1 --2- 172.21.15.104:0/30897973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f38159ec0 0x7f5f3806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.851+0000 7f5f3cd38640 1 -- 172.21.15.104:0/30897973 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125063477 0 0) 0x7f5f3815dce0 con 0x7f5f38072160 2024-05-08T04:21:36.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.851+0000 7f5f3cd38640 1 -- 172.21.15.104:0/30897973 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f20003520 con 0x7f5f38072160 2024-05-08T04:21:36.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.851+0000 7f5f3dd3a640 1 -- 172.21.15.104:0/30897973 >> v1:172.21.15.183:6789/0 conn(0x7f5f3815a2a0 legacy=0x7f5f38071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.851+0000 7f5f3cd38640 1 -- 172.21.15.104:0/30897973 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601426168 0 0) 0x7f5f3806eb60 con 0x7f5f3815a2a0 2024-05-08T04:21:36.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.851+0000 7f5f3dd3a640 1 -- 172.21.15.104:0/30897973 >> v1:172.21.15.104:6789/0 conn(0x7f5f38072160 legacy=0x7f5f380b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.851+0000 7f5f3dd3a640 1 -- 172.21.15.104:0/30897973 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3815df80 con 0x7f5f38159ec0 2024-05-08T04:21:36.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.852+0000 7f5f3dd3a640 1 --2- 172.21.15.104:0/30897973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f38159ec0 0x7f5f3806e4d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009dc0 tx=0x7f5f2802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9502afbef2b7ee9a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:36.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.852+0000 7f5f3cd38640 1 -- 172.21.15.104:0/30897973 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28007740 con 0x7f5f38159ec0 2024-05-08T04:21:36.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.852+0000 7f5f3cd38640 1 -- 172.21.15.104:0/30897973 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f280078e0 con 0x7f5f38159ec0 2024-05-08T04:21:36.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.852+0000 7f5f3cd38640 1 -- 172.21.15.104:0/30897973 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28007cb0 con 0x7f5f38159ec0 2024-05-08T04:21:36.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.852+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/30897973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f38159ec0 msgr2=0x7f5f3806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.852+0000 7f5f3ff9e640 1 --2- 172.21.15.104:0/30897973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f38159ec0 0x7f5f3806e4d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009dc0 tx=0x7f5f2802a6d0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.852+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/30897973 shutdown_connections 2024-05-08T04:21:36.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.852+0000 7f5f3ff9e640 1 --2- 172.21.15.104:0/30897973 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f38159ec0 0x7f5f3806e4d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.852+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/30897973 >> 172.21.15.104:0/30897973 conn(0x7f5f380b13f0 msgr2=0x7f5f380b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:36.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.852+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/30897973 shutdown_connections 2024-05-08T04:21:36.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.852+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/30897973 wait complete. 2024-05-08T04:21:36.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.853+0000 7f5f3ff9e640 1 Processor -- start 2024-05-08T04:21:36.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.854+0000 7f5f3ff9e640 1 -- start start 2024-05-08T04:21:36.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.854+0000 7f5f3ff9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f38072160 0x7f5f38168150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.854+0000 7f5f3ff9e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f38159ec0 0x7f5f380cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.854+0000 7f5f3ff9e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f3815a2a0 0x7f5f380ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.854+0000 7f5f3ff9e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3815b360 con 0x7f5f38159ec0 2024-05-08T04:21:36.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.854+0000 7f5f3ff9e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3815b1e0 con 0x7f5f3815a2a0 2024-05-08T04:21:36.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.854+0000 7f5f3ff9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3815b4e0 con 0x7f5f38072160 2024-05-08T04:21:36.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.854+0000 7f5f3d539640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f38159ec0 0x7f5f380cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.854+0000 7f5f3d539640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f38159ec0 0x7f5f380cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38446/0 (socket says 172.21.15.104:38446) 2024-05-08T04:21:36.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.854+0000 7f5f3d539640 1 -- 172.21.15.104:0/45031133 learned_addr learned my addr 172.21.15.104:0/45031133 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:36.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.854+0000 7f5f3dd3a640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f38072160 0x7f5f38168150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.854+0000 7f5f3e53b640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f3815a2a0 0x7f5f380ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.855+0000 7f5f3d539640 1 -- 172.21.15.104:0/45031133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f38072160 msgr2=0x7f5f38168150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.855+0000 7f5f3d539640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f38072160 0x7f5f38168150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.855+0000 7f5f3d539640 1 -- 172.21.15.104:0/45031133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f3815a2a0 msgr2=0x7f5f380ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.855+0000 7f5f3d539640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f3815a2a0 0x7f5f380ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.855+0000 7f5f3d539640 1 -- 172.21.15.104:0/45031133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f38144b40 con 0x7f5f38159ec0 2024-05-08T04:21:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.855+0000 7f5f3d539640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f38159ec0 0x7f5f380cce60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00c440 tx=0x7f5f2c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.855+0000 7f5f367fc640 1 -- 172.21.15.104:0/45031133 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c017070 con 0x7f5f38159ec0 2024-05-08T04:21:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.855+0000 7f5f367fc640 1 -- 172.21.15.104:0/45031133 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c005480 con 0x7f5f38159ec0 2024-05-08T04:21:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.855+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/45031133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f38144830 con 0x7f5f38159ec0 2024-05-08T04:21:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.855+0000 7f5f367fc640 1 -- 172.21.15.104:0/45031133 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c003830 con 0x7f5f38159ec0 2024-05-08T04:21:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.855+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/45031133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f38144450 con 0x7f5f38159ec0 2024-05-08T04:21:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.856+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/45031133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f38142e40 con 0x7f5f38159ec0 2024-05-08T04:21:36.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.856+0000 7f5f367fc640 1 -- 172.21.15.104:0/45031133 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5f2c01a070 con 0x7f5f38159ec0 2024-05-08T04:21:36.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.857+0000 7f5f367fc640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5f2406b4d0 0x7f5f2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:36.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.857+0000 7f5f3dd3a640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5f2406b4d0 0x7f5f2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:36.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.857+0000 7f5f367fc640 1 -- 172.21.15.104:0/45031133 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f2c089450 con 0x7f5f38159ec0 2024-05-08T04:21:36.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.858+0000 7f5f3dd3a640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5f2406b4d0 0x7f5f2406d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5f28034000 tx=0x7f5f2802f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:36.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:36.861+0000 7f5f367fc640 1 -- 172.21.15.104:0/45031133 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5f2c057c80 con 0x7f5f38159ec0 2024-05-08T04:21:37.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.038+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/45031133 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f380cc4c0 con 0x7f5f38159ec0 2024-05-08T04:21:37.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.038+0000 7f5f367fc640 1 -- 172.21.15.104:0/45031133 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f380cc4c0 con 0x7f5f38159ec0 2024-05-08T04:21:37.040 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.040+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/45031133 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5f2406b4d0 msgr2=0x7f5f2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.040+0000 7f5f3ff9e640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5f2406b4d0 0x7f5f2406d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5f28034000 tx=0x7f5f2802f000 comp rx=0 tx=0).stop 2024-05-08T04:21:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.040+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/45031133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f38159ec0 msgr2=0x7f5f380cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.040+0000 7f5f3ff9e640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f38159ec0 0x7f5f380cce60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00c440 tx=0x7f5f2c00c900 comp rx=0 tx=0).stop 2024-05-08T04:21:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.040+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/45031133 shutdown_connections 2024-05-08T04:21:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.040+0000 7f5f3ff9e640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5f2406b4d0 0x7f5f2406d990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.040+0000 7f5f3ff9e640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f3815a2a0 0x7f5f380ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.040+0000 7f5f3ff9e640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f38159ec0 0x7f5f380cce60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.040+0000 7f5f3ff9e640 1 --2- 172.21.15.104:0/45031133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f38072160 0x7f5f38168150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.040+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/45031133 >> 172.21.15.104:0/45031133 conn(0x7f5f380b13f0 msgr2=0x7f5f380cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:37.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.040+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/45031133 shutdown_connections 2024-05-08T04:21:37.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.040+0000 7f5f3ff9e640 1 -- 172.21.15.104:0/45031133 wait complete. 2024-05-08T04:21:37.052 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:37.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.153+0000 7f187833b640 1 Processor -- start 2024-05-08T04:21:37.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.153+0000 7f187833b640 1 -- start start 2024-05-08T04:21:37.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f187833b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1870070c70 0x7f1870071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f187833b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f187015edf0 0x7f18700b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f187833b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1870071590 con 0x7f1870157ac0 2024-05-08T04:21:37.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f187833b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187006bc70 con 0x7f1870070c70 2024-05-08T04:21:37.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f187833b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18700d15c0 con 0x7f187015edf0 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f18760d7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1870070c70 0x7f1870071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f18768d8640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f1870157ac0 0x7f1870157f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46918/0 (socket says 172.21.15.104:46918) 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f18768d8640 1 -- 172.21.15.104:0/358760407 learned_addr learned my addr 172.21.15.104:0/358760407 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f18758d6640 1 --2- 172.21.15.104:0/358760407 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f187015edf0 0x7f18700b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f18760d7640 1 -- 172.21.15.104:0/358760407 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f187015edf0 msgr2=0x7f18700b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f18760d7640 1 --2- 172.21.15.104:0/358760407 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f187015edf0 0x7f18700b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f18760d7640 1 -- 172.21.15.104:0/358760407 >> v1:172.21.15.104:6789/0 conn(0x7f1870157ac0 legacy=0x7f1870157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f18760d7640 1 -- 172.21.15.104:0/358760407 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187015f550 con 0x7f1870070c70 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f18750d5640 1 -- 172.21.15.104:0/358760407 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127855257 0 0) 0x7f1870071590 con 0x7f1870157ac0 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.154+0000 7f18758d6640 1 --2- 172.21.15.104:0/358760407 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f187015edf0 0x7f18700b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.155+0000 7f18760d7640 1 --2- 172.21.15.104:0/358760407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1870070c70 0x7f1870071050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f186c009d90 tx=0x7f186c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4abb0c66d16b5c61 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.155+0000 7f18750d5640 1 -- 172.21.15.104:0/358760407 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c007740 con 0x7f1870070c70 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.155+0000 7f18750d5640 1 -- 172.21.15.104:0/358760407 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c0078e0 con 0x7f1870070c70 2024-05-08T04:21:37.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.155+0000 7f18750d5640 1 -- 172.21.15.104:0/358760407 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c007cb0 con 0x7f1870070c70 2024-05-08T04:21:37.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.156+0000 7f187833b640 1 -- 172.21.15.104:0/358760407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1870070c70 msgr2=0x7f1870071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.156+0000 7f187833b640 1 --2- 172.21.15.104:0/358760407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1870070c70 0x7f1870071050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f186c009d90 tx=0x7f186c02a660 comp rx=0 tx=0).stop 2024-05-08T04:21:37.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.156+0000 7f187833b640 1 -- 172.21.15.104:0/358760407 shutdown_connections 2024-05-08T04:21:37.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.156+0000 7f187833b640 1 --2- 172.21.15.104:0/358760407 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f187015edf0 0x7f18700b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.156+0000 7f187833b640 1 --2- 172.21.15.104:0/358760407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1870070c70 0x7f1870071050 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.156+0000 7f187833b640 1 -- 172.21.15.104:0/358760407 >> 172.21.15.104:0/358760407 conn(0x7f18700b3450 msgr2=0x7f18700b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.156+0000 7f187833b640 1 -- 172.21.15.104:0/358760407 shutdown_connections 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.156+0000 7f187833b640 1 -- 172.21.15.104:0/358760407 wait complete. 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.157+0000 7f187833b640 1 Processor -- start 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.157+0000 7f187833b640 1 -- start start 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f187833b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1870070c70 0x7f1870156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f187833b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1870157ac0 0x7f1870158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f187833b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f187015edf0 0x7f18700caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f187833b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18700b5b80 con 0x7f1870157ac0 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f187833b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187015fb10 con 0x7f1870070c70 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f187833b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18700b57e0 con 0x7f187015edf0 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f18758d6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1870157ac0 0x7f1870158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f18758d6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1870157ac0 0x7f1870158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38458/0 (socket says 172.21.15.104:38458) 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f18758d6640 1 -- 172.21.15.104:0/1012568902 learned_addr learned my addr 172.21.15.104:0/1012568902 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:37.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f18768d8640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f187015edf0 0x7f18700caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f18758d6640 1 -- 172.21.15.104:0/1012568902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f187015edf0 msgr2=0x7f18700caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f18760d7640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1870070c70 0x7f1870156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f18758d6640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f187015edf0 0x7f18700caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f18758d6640 1 -- 172.21.15.104:0/1012568902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1870070c70 msgr2=0x7f1870156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f18758d6640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1870070c70 0x7f1870156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f18758d6640 1 -- 172.21.15.104:0/1012568902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870159950 con 0x7f1870157ac0 2024-05-08T04:21:37.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.158+0000 7f18758d6640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1870157ac0 0x7f1870158f00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f186000c7c0 tx=0x7f186000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:37.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.159+0000 7f1866ffd640 1 -- 172.21.15.104:0/1012568902 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860015070 con 0x7f1870157ac0 2024-05-08T04:21:37.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.159+0000 7f1866ffd640 1 -- 172.21.15.104:0/1012568902 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860007820 con 0x7f1870157ac0 2024-05-08T04:21:37.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.159+0000 7f187833b640 1 -- 172.21.15.104:0/1012568902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1870159c30 con 0x7f1870157ac0 2024-05-08T04:21:37.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.159+0000 7f1866ffd640 1 -- 172.21.15.104:0/1012568902 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860007bf0 con 0x7f1870157ac0 2024-05-08T04:21:37.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.159+0000 7f187833b640 1 -- 172.21.15.104:0/1012568902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187015a1f0 con 0x7f1870157ac0 2024-05-08T04:21:37.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.160+0000 7f187833b640 1 -- 172.21.15.104:0/1012568902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1870075010 con 0x7f1870157ac0 2024-05-08T04:21:37.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.160+0000 7f1866ffd640 1 -- 172.21.15.104:0/1012568902 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1860018070 con 0x7f1870157ac0 2024-05-08T04:21:37.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.161+0000 7f1866ffd640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f185406b4d0 0x7f185406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.161+0000 7f18760d7640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f185406b4d0 0x7f185406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.161+0000 7f1866ffd640 1 -- 172.21.15.104:0/1012568902 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f186008a090 con 0x7f1870157ac0 2024-05-08T04:21:37.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.161+0000 7f18760d7640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f185406b4d0 0x7f185406d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f186c034000 tx=0x7f186c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:37.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.165+0000 7f1866ffd640 1 -- 172.21.15.104:0/1012568902 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1860058f10 con 0x7f1870157ac0 2024-05-08T04:21:37.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.338+0000 7f187833b640 1 -- 172.21.15.104:0/1012568902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18700b0cb0 con 0x7f1870157ac0 2024-05-08T04:21:37.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.338+0000 7f1866ffd640 1 -- 172.21.15.104:0/1012568902 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1860058810 con 0x7f1870157ac0 2024-05-08T04:21:37.340 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.340+0000 7f187833b640 1 -- 172.21.15.104:0/1012568902 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f185406b4d0 msgr2=0x7f185406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.340+0000 7f187833b640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f185406b4d0 0x7f185406d990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f186c034000 tx=0x7f186c02f000 comp rx=0 tx=0).stop 2024-05-08T04:21:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.340+0000 7f187833b640 1 -- 172.21.15.104:0/1012568902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1870157ac0 msgr2=0x7f1870158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.340+0000 7f187833b640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1870157ac0 0x7f1870158f00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f186000c7c0 tx=0x7f186000cc80 comp rx=0 tx=0).stop 2024-05-08T04:21:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.340+0000 7f187833b640 1 -- 172.21.15.104:0/1012568902 shutdown_connections 2024-05-08T04:21:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.340+0000 7f187833b640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f185406b4d0 0x7f185406d990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.340+0000 7f187833b640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f187015edf0 0x7f18700caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.340+0000 7f187833b640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1870157ac0 0x7f1870158f00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.340+0000 7f187833b640 1 --2- 172.21.15.104:0/1012568902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1870070c70 0x7f1870156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.340+0000 7f187833b640 1 -- 172.21.15.104:0/1012568902 >> 172.21.15.104:0/1012568902 conn(0x7f18700b3450 msgr2=0x7f18700b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.340+0000 7f187833b640 1 -- 172.21.15.104:0/1012568902 shutdown_connections 2024-05-08T04:21:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.341+0000 7f187833b640 1 -- 172.21.15.104:0/1012568902 wait complete. 2024-05-08T04:21:37.353 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:37.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.454+0000 7f9a6386b640 1 Processor -- start 2024-05-08T04:21:37.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.454+0000 7f9a6386b640 1 -- start start 2024-05-08T04:21:37.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a6386b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9a5c0b2b80 0x7f9a5c09a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a6386b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a5c099ea0 0x7f9a5c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a6386b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c0cd940 con 0x7f9a5c099a40 2024-05-08T04:21:37.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a6386b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5c0cc8a0 con 0x7f9a5c0b2b80 2024-05-08T04:21:37.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a6386b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0ccb80 con 0x7f9a5c099ea0 2024-05-08T04:21:37.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a60e06640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9a5c099a40 0x7f9a5c15d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43128/0 (socket says 172.21.15.104:43128) 2024-05-08T04:21:37.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a60e06640 1 -- 172.21.15.104:0/3618339935 learned_addr learned my addr 172.21.15.104:0/3618339935 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:37.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a61e08640 1 --2- 172.21.15.104:0/3618339935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a5c099ea0 0x7f9a5c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a61607640 1 --2- 172.21.15.104:0/3618339935 >> v2:172.21.15.183:3300/0 conn(0x7f9a5c0b2b80 0x7f9a5c09a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944000569 0 0) 0x7f9a5c0cd940 con 0x7f9a5c099a40 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a48003520 con 0x7f9a5c099a40 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1240912050 0 0) 0x7f9a48003520 con 0x7f9a5c099a40 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a5c099ea0 msgr2=0x7f9a5c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.455+0000 7f9a53fff640 1 --2- 172.21.15.104:0/3618339935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a5c099ea0 0x7f9a5c15dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 >> v2:172.21.15.183:3300/0 conn(0x7f9a5c0b2b80 msgr2=0x7f9a5c09a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a53fff640 1 --2- 172.21.15.104:0/3618339935 >> v2:172.21.15.183:3300/0 conn(0x7f9a5c0b2b80 0x7f9a5c09a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c0cce60 con 0x7f9a5c099a40 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f9a4c001670 con 0x7f9a5c099a40 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 >> v1:172.21.15.104:6789/0 conn(0x7f9a5c099a40 legacy=0x7f9a5c15d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a53fff640 1 --2- 172.21.15.104:0/3618339935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a5c099ea0 0x7f9a480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a53fff640 1 --2- 172.21.15.104:0/3618339935 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a48003f30 0x7f9a48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a53fff640 1 --2- 172.21.15.104:0/3618339935 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a48004d40 0x7f9a480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0cc8a0 con 0x7f9a48003f30 2024-05-08T04:21:37.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0ccb80 con 0x7f9a48004d40 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4800b9f0 con 0x7f9a5c099ea0 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a60e06640 1 --2- 172.21.15.104:0/3618339935 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a48003f30 0x7f9a48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a61607640 1 --2- 172.21.15.104:0/3618339935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a5c099ea0 0x7f9a480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a61e08640 1 --2- 172.21.15.104:0/3618339935 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a48004d40 0x7f9a480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a60e06640 1 -- 172.21.15.104:0/3618339935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a5c099ea0 msgr2=0x7f9a480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a60e06640 1 --2- 172.21.15.104:0/3618339935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a5c099ea0 0x7f9a480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a60e06640 1 -- 172.21.15.104:0/3618339935 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a48004d40 msgr2=0x7f9a480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a60e06640 1 --2- 172.21.15.104:0/3618339935 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a48004d40 0x7f9a480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.456+0000 7f9a60e06640 1 -- 172.21.15.104:0/3618339935 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a48003520 con 0x7f9a48003f30 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.457+0000 7f9a60e06640 1 --2- 172.21.15.104:0/3618339935 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a48003f30 0x7f9a48004800 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c001050 tx=0x7f9a48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b928672f34070d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.457+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c02e070 con 0x7f9a48003f30 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.457+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c005af0 con 0x7f9a48003f30 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.457+0000 7f9a53fff640 1 -- 172.21.15.104:0/3618339935 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c007d70 con 0x7f9a48003f30 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.457+0000 7f9a6386b640 1 -- 172.21.15.104:0/3618339935 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a48003f30 msgr2=0x7f9a48004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.457+0000 7f9a6386b640 1 --2- 172.21.15.104:0/3618339935 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a48003f30 0x7f9a48004800 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c001050 tx=0x7f9a48005830 comp rx=0 tx=0).stop 2024-05-08T04:21:37.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.457+0000 7f9a61e08640 1 -- 172.21.15.104:0/3618339935 reap_dead start 2024-05-08T04:21:37.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.457+0000 7f9a6386b640 1 -- 172.21.15.104:0/3618339935 shutdown_connections 2024-05-08T04:21:37.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.457+0000 7f9a6386b640 1 -- 172.21.15.104:0/3618339935 >> 172.21.15.104:0/3618339935 conn(0x7f9a5c0b3310 msgr2=0x7f9a5c0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:37.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.457+0000 7f9a6386b640 1 -- 172.21.15.104:0/3618339935 shutdown_connections 2024-05-08T04:21:37.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.457+0000 7f9a6386b640 1 -- 172.21.15.104:0/3618339935 wait complete. 2024-05-08T04:21:37.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.459+0000 7f9a6386b640 1 Processor -- start 2024-05-08T04:21:37.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.459+0000 7f9a6386b640 1 -- start start 2024-05-08T04:21:37.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.459+0000 7f9a6386b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a48003f30 0x7f9a5c0b7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.459+0000 7f9a6386b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a5c0b4280 0x7f9a5c1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.459+0000 7f9a6386b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a5c160a10 0x7f9a5c160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.459+0000 7f9a6386b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c09aef0 con 0x7f9a5c0b4280 2024-05-08T04:21:37.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.459+0000 7f9a6386b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c09a330 con 0x7f9a5c160a10 2024-05-08T04:21:37.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.459+0000 7f9a6386b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0cf830 con 0x7f9a48003f30 2024-05-08T04:21:37.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.459+0000 7f9a60e06640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a5c0b4280 0x7f9a5c1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.459+0000 7f9a60e06640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a5c0b4280 0x7f9a5c1596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53974/0 (socket says 172.21.15.104:53974) 2024-05-08T04:21:37.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.459+0000 7f9a60e06640 1 -- 172.21.15.104:0/122425892 learned_addr learned my addr 172.21.15.104:0/122425892 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:37.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.460+0000 7f9a61607640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a48003f30 0x7f9a5c0b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.460+0000 7f9a61e08640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a5c160a10 0x7f9a5c160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.460+0000 7f9a60e06640 1 -- 172.21.15.104:0/122425892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a48003f30 msgr2=0x7f9a5c0b7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.460+0000 7f9a60e06640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a48003f30 0x7f9a5c0b7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.460+0000 7f9a60e06640 1 -- 172.21.15.104:0/122425892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a5c160a10 msgr2=0x7f9a5c160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.460+0000 7f9a60e06640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a5c160a10 0x7f9a5c160ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.460+0000 7f9a60e06640 1 -- 172.21.15.104:0/122425892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c1f3710 con 0x7f9a5c0b4280 2024-05-08T04:21:37.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.460+0000 7f9a60e06640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a5c0b4280 0x7f9a5c1596c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c034040 tx=0x7f9a4c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:37.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.460+0000 7f9a51ffb640 1 -- 172.21.15.104:0/122425892 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c042070 con 0x7f9a5c0b4280 2024-05-08T04:21:37.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.460+0000 7f9a51ffb640 1 -- 172.21.15.104:0/122425892 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c007480 con 0x7f9a5c0b4280 2024-05-08T04:21:37.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.460+0000 7f9a51ffb640 1 -- 172.21.15.104:0/122425892 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c007d50 con 0x7f9a5c0b4280 2024-05-08T04:21:37.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.460+0000 7f9a6386b640 1 -- 172.21.15.104:0/122425892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c159c00 con 0x7f9a5c0b4280 2024-05-08T04:21:37.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.460+0000 7f9a6386b640 1 -- 172.21.15.104:0/122425892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c1f3c60 con 0x7f9a5c0b4280 2024-05-08T04:21:37.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.461+0000 7f9a6386b640 1 -- 172.21.15.104:0/122425892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c075010 con 0x7f9a5c0b4280 2024-05-08T04:21:37.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.462+0000 7f9a51ffb640 1 -- 172.21.15.104:0/122425892 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9a4c045070 con 0x7f9a5c0b4280 2024-05-08T04:21:37.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.462+0000 7f9a51ffb640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9a4006b500 0x7f9a4006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.462+0000 7f9a51ffb640 1 -- 172.21.15.104:0/122425892 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a4c0aac70 con 0x7f9a5c0b4280 2024-05-08T04:21:37.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.462+0000 7f9a61607640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9a4006b500 0x7f9a4006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.463+0000 7f9a61607640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9a4006b500 0x7f9a4006d9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0c5d20 tx=0x7f9a58009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:37.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.466+0000 7f9a51ffb640 1 -- 172.21.15.104:0/122425892 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9a4c005ac0 con 0x7f9a5c0b4280 2024-05-08T04:21:37.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.636+0000 7f9a6386b640 1 -- 172.21.15.104:0/122425892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a5c0cf420 con 0x7f9a5c0b4280 2024-05-08T04:21:37.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.636+0000 7f9a51ffb640 1 -- 172.21.15.104:0/122425892 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a4c079650 con 0x7f9a5c0b4280 2024-05-08T04:21:37.637 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:37.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.638+0000 7f9a6386b640 1 -- 172.21.15.104:0/122425892 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9a4006b500 msgr2=0x7f9a4006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.638+0000 7f9a6386b640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9a4006b500 0x7f9a4006d9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0c5d20 tx=0x7f9a58009190 comp rx=0 tx=0).stop 2024-05-08T04:21:37.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.638+0000 7f9a6386b640 1 -- 172.21.15.104:0/122425892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a5c0b4280 msgr2=0x7f9a5c1596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.638+0000 7f9a6386b640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a5c0b4280 0x7f9a5c1596c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c034040 tx=0x7f9a4c000fe0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.638+0000 7f9a6386b640 1 -- 172.21.15.104:0/122425892 shutdown_connections 2024-05-08T04:21:37.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.638+0000 7f9a6386b640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9a4006b500 0x7f9a4006d9c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.638+0000 7f9a6386b640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a5c160a10 0x7f9a5c160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.638+0000 7f9a6386b640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a5c0b4280 0x7f9a5c1596c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.638+0000 7f9a6386b640 1 --2- 172.21.15.104:0/122425892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a48003f30 0x7f9a5c0b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.638+0000 7f9a6386b640 1 -- 172.21.15.104:0/122425892 >> 172.21.15.104:0/122425892 conn(0x7f9a5c0b3310 msgr2=0x7f9a5c162170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:37.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.638+0000 7f9a6386b640 1 -- 172.21.15.104:0/122425892 shutdown_connections 2024-05-08T04:21:37.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.638+0000 7f9a6386b640 1 -- 172.21.15.104:0/122425892 wait complete. 2024-05-08T04:21:37.650 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:37.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.752+0000 7f02fabc4640 1 Processor -- start 2024-05-08T04:21:37.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.752+0000 7f02fabc4640 1 -- start start 2024-05-08T04:21:37.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02fabc4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02f40d35c0 0x7f02f40b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02fabc4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f40b9920 con 0x7f02f40b59c0 2024-05-08T04:21:37.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02fabc4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f40d2520 con 0x7f02f415dad0 2024-05-08T04:21:37.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02fabc4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40b5e10 con 0x7f02f40d35c0 2024-05-08T04:21:37.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02f9161640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f02f40b59c0 0x7f02f40b6b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43138/0 (socket says 172.21.15.104:43138) 2024-05-08T04:21:37.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02f9161640 1 -- 172.21.15.104:0/2983666295 learned_addr learned my addr 172.21.15.104:0/2983666295 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:37.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617946254 0 0) 0x7f02f40b9920 con 0x7f02f40b59c0 2024-05-08T04:21:37.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02dc003520 con 0x7f02f40b59c0 2024-05-08T04:21:37.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02ebfff640 1 --2- 172.21.15.104:0/2983666295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02f40d35c0 0x7f02f40b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4049951559 0 0) 0x7f02dc003520 con 0x7f02f40b59c0 2024-05-08T04:21:37.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02f40d35c0 msgr2=0x7f02f40b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:37.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02eb7fe640 1 --2- 172.21.15.104:0/2983666295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02f40d35c0 0x7f02f40b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 >> v1:172.21.15.183:6789/0 conn(0x7f02f415dad0 legacy=0x7f02f40d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f40d2800 con 0x7f02f40b59c0 2024-05-08T04:21:37.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f02ec0019f0 con 0x7f02f40b59c0 2024-05-08T04:21:37.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 >> v1:172.21.15.104:6789/0 conn(0x7f02f40b59c0 legacy=0x7f02f40b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.753+0000 7f02eb7fe640 1 --2- 172.21.15.104:0/2983666295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02dc0039e0 0x7f02dc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.754+0000 7f02eb7fe640 1 --2- 172.21.15.104:0/2983666295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02f40d35c0 0x7f02dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.754+0000 7f02eb7fe640 1 --2- 172.21.15.104:0/2983666295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc004d40 0x7f02dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.754+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40b5e10 con 0x7f02dc0039e0 2024-05-08T04:21:37.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.754+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc00bb20 con 0x7f02dc004d40 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.754+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc00bd20 con 0x7f02f40d35c0 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.754+0000 7f02f8960640 1 --2- 172.21.15.104:0/2983666295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02dc0039e0 0x7f02dc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.754+0000 7f02f9161640 1 --2- 172.21.15.104:0/2983666295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc004d40 0x7f02dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.754+0000 7f02ebfff640 1 --2- 172.21.15.104:0/2983666295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02f40d35c0 0x7f02dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.754+0000 7f02f8960640 1 -- 172.21.15.104:0/2983666295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02f40d35c0 msgr2=0x7f02dc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.754+0000 7f02f8960640 1 --2- 172.21.15.104:0/2983666295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02f40d35c0 0x7f02dc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.754+0000 7f02f8960640 1 -- 172.21.15.104:0/2983666295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc004d40 msgr2=0x7f02dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.754+0000 7f02f8960640 1 --2- 172.21.15.104:0/2983666295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02dc004d40 0x7f02dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.754+0000 7f02f8960640 1 -- 172.21.15.104:0/2983666295 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc003520 con 0x7f02dc0039e0 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.755+0000 7f02f8960640 1 --2- 172.21.15.104:0/2983666295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02dc0039e0 0x7f02dc003e00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f02f0001750 tx=0x7f02dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd5ef5a3952f054 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.755+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0001370 con 0x7f02dc0039e0 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.755+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f00052d0 con 0x7f02dc0039e0 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.755+0000 7f02eb7fe640 1 -- 172.21.15.104:0/2983666295 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f002ab20 con 0x7f02dc0039e0 2024-05-08T04:21:37.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.755+0000 7f02fabc4640 1 -- 172.21.15.104:0/2983666295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02dc0039e0 msgr2=0x7f02dc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.755+0000 7f02fabc4640 1 --2- 172.21.15.104:0/2983666295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02dc0039e0 0x7f02dc003e00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f02f0001750 tx=0x7f02dc005830 comp rx=0 tx=0).stop 2024-05-08T04:21:37.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.755+0000 7f02f9161640 1 -- 172.21.15.104:0/2983666295 reap_dead start 2024-05-08T04:21:37.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.755+0000 7f02fabc4640 1 -- 172.21.15.104:0/2983666295 shutdown_connections 2024-05-08T04:21:37.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.755+0000 7f02fabc4640 1 -- 172.21.15.104:0/2983666295 >> 172.21.15.104:0/2983666295 conn(0x7f02f406c650 msgr2=0x7f02f40d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:37.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.755+0000 7f02fabc4640 1 -- 172.21.15.104:0/2983666295 shutdown_connections 2024-05-08T04:21:37.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.755+0000 7f02fabc4640 1 -- 172.21.15.104:0/2983666295 wait complete. 2024-05-08T04:21:37.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.756+0000 7f02fabc4640 1 Processor -- start 2024-05-08T04:21:37.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.757+0000 7f02fabc4640 1 -- start start 2024-05-08T04:21:37.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.757+0000 7f02fabc4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02dc0039e0 0x7f02f40cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.757+0000 7f02fabc4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02f4156ef0 0x7f02f4157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.757+0000 7f02fabc4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02f414ad80 0x7f02f414b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.757+0000 7f02fabc4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40d30a0 con 0x7f02dc0039e0 2024-05-08T04:21:37.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.757+0000 7f02fabc4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40d2e00 con 0x7f02f414ad80 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.757+0000 7f02fabc4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40d2170 con 0x7f02f4156ef0 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.757+0000 7f02f8960640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02dc0039e0 0x7f02f40cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.757+0000 7f02f8960640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02dc0039e0 0x7f02f40cc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53994/0 (socket says 172.21.15.104:53994) 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.757+0000 7f02f8960640 1 -- 172.21.15.104:0/3912406454 learned_addr learned my addr 172.21.15.104:0/3912406454 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.758+0000 7f02ebfff640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02f4156ef0 0x7f02f4157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.758+0000 7f02f9161640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02f414ad80 0x7f02f414b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.758+0000 7f02f8960640 1 -- 172.21.15.104:0/3912406454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02f4156ef0 msgr2=0x7f02f4157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.758+0000 7f02f8960640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02f4156ef0 0x7f02f4157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.758+0000 7f02f8960640 1 -- 172.21.15.104:0/3912406454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02f414ad80 msgr2=0x7f02f414b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.758+0000 7f02f8960640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02f414ad80 0x7f02f414b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.758+0000 7f02f8960640 1 -- 172.21.15.104:0/3912406454 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f415ebf0 con 0x7f02dc0039e0 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.758+0000 7f02f8960640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02dc0039e0 0x7f02f40cc030 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f02f0008fd0 tx=0x7f02f0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.758+0000 7f02e97fa640 1 -- 172.21.15.104:0/3912406454 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0037040 con 0x7f02dc0039e0 2024-05-08T04:21:37.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.758+0000 7f02e97fa640 1 -- 172.21.15.104:0/3912406454 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f0005480 con 0x7f02dc0039e0 2024-05-08T04:21:37.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.758+0000 7f02fabc4640 1 -- 172.21.15.104:0/3912406454 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f415eed0 con 0x7f02dc0039e0 2024-05-08T04:21:37.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.758+0000 7f02e97fa640 1 -- 172.21.15.104:0/3912406454 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0007470 con 0x7f02dc0039e0 2024-05-08T04:21:37.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.758+0000 7f02fabc4640 1 -- 172.21.15.104:0/3912406454 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f415f490 con 0x7f02dc0039e0 2024-05-08T04:21:37.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.759+0000 7f02fabc4640 1 -- 172.21.15.104:0/3912406454 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f4075010 con 0x7f02dc0039e0 2024-05-08T04:21:37.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.760+0000 7f02e97fa640 1 -- 172.21.15.104:0/3912406454 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f02f0044020 con 0x7f02dc0039e0 2024-05-08T04:21:37.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.760+0000 7f02e97fa640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f02e006b500 0x7f02e006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:37.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.760+0000 7f02e97fa640 1 -- 172.21.15.104:0/3912406454 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02f00a9c40 con 0x7f02dc0039e0 2024-05-08T04:21:37.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.760+0000 7f02ebfff640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f02e006b500 0x7f02e006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:37.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.761+0000 7f02ebfff640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f02e006b500 0x7f02e006d9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f02f40ccd00 tx=0x7f02e4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:37.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.764+0000 7f02e97fa640 1 -- 172.21.15.104:0/3912406454 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f02f004b020 con 0x7f02dc0039e0 2024-05-08T04:21:37.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.937+0000 7f02fabc4640 1 -- 172.21.15.104:0/3912406454 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02f4159d70 con 0x7f02dc0039e0 2024-05-08T04:21:37.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.938+0000 7f02e97fa640 1 -- 172.21.15.104:0/3912406454 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f02f0078ac0 con 0x7f02dc0039e0 2024-05-08T04:21:37.939 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:37.939 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:37.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.940+0000 7f02fabc4640 1 -- 172.21.15.104:0/3912406454 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f02e006b500 msgr2=0x7f02e006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.940+0000 7f02fabc4640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f02e006b500 0x7f02e006d9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f02f40ccd00 tx=0x7f02e4008040 comp rx=0 tx=0).stop 2024-05-08T04:21:37.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.940+0000 7f02fabc4640 1 -- 172.21.15.104:0/3912406454 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02dc0039e0 msgr2=0x7f02f40cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:37.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.940+0000 7f02fabc4640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02dc0039e0 0x7f02f40cc030 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f02f0008fd0 tx=0x7f02f0001120 comp rx=0 tx=0).stop 2024-05-08T04:21:37.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.940+0000 7f02fabc4640 1 -- 172.21.15.104:0/3912406454 shutdown_connections 2024-05-08T04:21:37.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.940+0000 7f02fabc4640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f02e006b500 0x7f02e006d9c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.940+0000 7f02fabc4640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02f414ad80 0x7f02f414b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.940+0000 7f02fabc4640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02f4156ef0 0x7f02f4157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.940+0000 7f02fabc4640 1 --2- 172.21.15.104:0/3912406454 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02dc0039e0 0x7f02f40cc030 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:37.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.940+0000 7f02fabc4640 1 -- 172.21.15.104:0/3912406454 >> 172.21.15.104:0/3912406454 conn(0x7f02f406c650 msgr2=0x7f02f415b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:37.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.940+0000 7f02fabc4640 1 -- 172.21.15.104:0/3912406454 shutdown_connections 2024-05-08T04:21:37.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:37.940+0000 7f02fabc4640 1 -- 172.21.15.104:0/3912406454 wait complete. 2024-05-08T04:21:37.952 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:37.953 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:38.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.055+0000 7fabbdcf5640 1 Processor -- start 2024-05-08T04:21:38.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.055+0000 7fabbdcf5640 1 -- start start 2024-05-08T04:21:38.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.055+0000 7fabbdcf5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fabb815ba10 0x7fabb8099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.055+0000 7fabbdcf5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabb815ee90 0x7fabb80cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.055+0000 7fabbdcf5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb80cc5d0 con 0x7fabb80d0320 2024-05-08T04:21:38.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.055+0000 7fabbdcf5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb80d0790 con 0x7fabb815ba10 2024-05-08T04:21:38.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.055+0000 7fabbdcf5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb809a340 con 0x7fabb815ee90 2024-05-08T04:21:38.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.056+0000 7fabb6ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabb815ee90 0x7fabb80cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.056+0000 7fabb77fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fabb815ba10 0x7fabb8099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.056+0000 7fabb6ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabb815ee90 0x7fabb80cfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:52200/0 (socket says 172.21.15.104:52200) 2024-05-08T04:21:38.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.056+0000 7fabb6ffd640 1 -- 172.21.15.104:0/4291471721 learned_addr learned my addr 172.21.15.104:0/4291471721 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:38.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.056+0000 7fabb77fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fabb815ba10 0x7fabb8099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:48034/0 (socket says 172.21.15.104:48034) 2024-05-08T04:21:38.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.056+0000 7fabb7fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fabb80d0320 0x7fabb80b24c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:59164/0 (socket says 172.21.15.104:59164) 2024-05-08T04:21:38.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.056+0000 7fabb6ffd640 1 -- 172.21.15.104:0/4291471721 >> v2:172.21.15.183:3300/0 conn(0x7fabb815ba10 msgr2=0x7fabb8099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:38.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.056+0000 7fabb6ffd640 1 --2- 172.21.15.104:0/4291471721 >> v2:172.21.15.183:3300/0 conn(0x7fabb815ba10 0x7fabb8099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.056+0000 7fabb6ffd640 1 -- 172.21.15.104:0/4291471721 >> v1:172.21.15.183:6789/0 conn(0x7fabb80d0320 legacy=0x7fabb80b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.056+0000 7fabb6ffd640 1 -- 172.21.15.104:0/4291471721 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb809a620 con 0x7fabb815ee90 2024-05-08T04:21:38.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.057+0000 7fabb6ffd640 1 --2- 172.21.15.104:0/4291471721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabb815ee90 0x7fabb80cfde0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fabac009870 tx=0x7fabac02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a91808542d3e468 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:38.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.057+0000 7fabb67fc640 1 -- 172.21.15.104:0/4291471721 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac037070 con 0x7fabb815ee90 2024-05-08T04:21:38.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.057+0000 7fabb67fc640 1 -- 172.21.15.104:0/4291471721 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac032440 con 0x7fabb815ee90 2024-05-08T04:21:38.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.057+0000 7fabb67fc640 1 -- 172.21.15.104:0/4291471721 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac032810 con 0x7fabb815ee90 2024-05-08T04:21:38.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.058+0000 7fabbdcf5640 1 -- 172.21.15.104:0/4291471721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabb815ee90 msgr2=0x7fabb80cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.058+0000 7fabbdcf5640 1 --2- 172.21.15.104:0/4291471721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabb815ee90 0x7fabb80cfde0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fabac009870 tx=0x7fabac02a270 comp rx=0 tx=0).stop 2024-05-08T04:21:38.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.058+0000 7fabbdcf5640 1 -- 172.21.15.104:0/4291471721 shutdown_connections 2024-05-08T04:21:38.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.058+0000 7fabbdcf5640 1 --2- 172.21.15.104:0/4291471721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabb815ee90 0x7fabb80cfde0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.058+0000 7fabbdcf5640 1 --2- 172.21.15.104:0/4291471721 >> v2:172.21.15.183:3300/0 conn(0x7fabb815ba10 0x7fabb8099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.058+0000 7fabbdcf5640 1 -- 172.21.15.104:0/4291471721 >> 172.21.15.104:0/4291471721 conn(0x7fabb80b3280 msgr2=0x7fabb80b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:38.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.058+0000 7fabbdcf5640 1 -- 172.21.15.104:0/4291471721 shutdown_connections 2024-05-08T04:21:38.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.058+0000 7fabbdcf5640 1 -- 172.21.15.104:0/4291471721 wait complete. 2024-05-08T04:21:38.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.059+0000 7fabbdcf5640 1 Processor -- start 2024-05-08T04:21:38.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.059+0000 7fabbdcf5640 1 -- start start 2024-05-08T04:21:38.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabbdcf5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabb80d0320 0x7fabb8148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabbdcf5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabb815ba10 0x7fabb80c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabbdcf5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabb815ee90 0x7fabb815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabbdcf5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb8099f80 con 0x7fabb815ba10 2024-05-08T04:21:38.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabbdcf5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb80cc870 con 0x7fabb80d0320 2024-05-08T04:21:38.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabbdcf5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb809a100 con 0x7fabb815ee90 2024-05-08T04:21:38.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabb6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabb815ba10 0x7fabb80c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabb6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabb815ba10 0x7fabb80c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54008/0 (socket says 172.21.15.104:54008) 2024-05-08T04:21:38.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabb6ffd640 1 -- 172.21.15.104:0/2941655049 learned_addr learned my addr 172.21.15.104:0/2941655049 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:38.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabb7fff640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabb815ee90 0x7fabb815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabb77fe640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabb80d0320 0x7fabb8148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabb6ffd640 1 -- 172.21.15.104:0/2941655049 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabb815ee90 msgr2=0x7fabb815ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabb6ffd640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabb815ee90 0x7fabb815ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabb6ffd640 1 -- 172.21.15.104:0/2941655049 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabb80d0320 msgr2=0x7fabb8148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabb6ffd640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabb80d0320 0x7fabb8148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabb6ffd640 1 -- 172.21.15.104:0/2941655049 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb80c8900 con 0x7fabb815ba10 2024-05-08T04:21:38.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabb77fe640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabb80d0320 0x7fabb8148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:38.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.060+0000 7fabb6ffd640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabb815ba10 0x7fabb80c9650 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fabac02a2b0 tx=0x7fabac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:38.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.061+0000 7fab9ffff640 1 -- 172.21.15.104:0/2941655049 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac041030 con 0x7fabb815ba10 2024-05-08T04:21:38.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.061+0000 7fab9ffff640 1 -- 172.21.15.104:0/2941655049 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac030440 con 0x7fabb815ba10 2024-05-08T04:21:38.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.061+0000 7fabbdcf5640 1 -- 172.21.15.104:0/2941655049 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb81490e0 con 0x7fabb815ba10 2024-05-08T04:21:38.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.061+0000 7fab9ffff640 1 -- 172.21.15.104:0/2941655049 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac037040 con 0x7fabb815ba10 2024-05-08T04:21:38.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.061+0000 7fabbdcf5640 1 -- 172.21.15.104:0/2941655049 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb80c8e50 con 0x7fabb815ba10 2024-05-08T04:21:38.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.062+0000 7fabbdcf5640 1 -- 172.21.15.104:0/2941655049 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb8075010 con 0x7fabb815ba10 2024-05-08T04:21:38.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.062+0000 7fab9ffff640 1 -- 172.21.15.104:0/2941655049 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fabac044070 con 0x7fabb815ba10 2024-05-08T04:21:38.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.062+0000 7fab9ffff640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7faba406b4d0 0x7faba406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.063+0000 7fab9ffff640 1 -- 172.21.15.104:0/2941655049 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabac0aa840 con 0x7fabb815ba10 2024-05-08T04:21:38.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.063+0000 7fabb77fe640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7faba406b4d0 0x7faba406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.063+0000 7fabb77fe640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7faba406b4d0 0x7faba406d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faba8009a10 tx=0x7faba8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:38.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.067+0000 7fab9ffff640 1 -- 172.21.15.104:0/2941655049 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fabb81490e0 con 0x7fabb815ba10 2024-05-08T04:21:38.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.235+0000 7fabbdcf5640 1 -- 172.21.15.104:0/2941655049 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabb80cfbc0 con 0x7fabb815ba10 2024-05-08T04:21:38.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.235+0000 7fab9ffff640 1 -- 172.21.15.104:0/2941655049 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabac0796c0 con 0x7fabb815ba10 2024-05-08T04:21:38.236 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:38.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.237+0000 7fabbdcf5640 1 -- 172.21.15.104:0/2941655049 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7faba406b4d0 msgr2=0x7faba406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.237+0000 7fabbdcf5640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7faba406b4d0 0x7faba406d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faba8009a10 tx=0x7faba8008040 comp rx=0 tx=0).stop 2024-05-08T04:21:38.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.237+0000 7fabbdcf5640 1 -- 172.21.15.104:0/2941655049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabb815ba10 msgr2=0x7fabb80c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.237+0000 7fabbdcf5640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabb815ba10 0x7fabb80c9650 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fabac02a2b0 tx=0x7fabac0046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.237+0000 7fabbdcf5640 1 -- 172.21.15.104:0/2941655049 shutdown_connections 2024-05-08T04:21:38.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.237+0000 7fabbdcf5640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7faba406b4d0 0x7faba406d990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.237+0000 7fabbdcf5640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabb815ee90 0x7fabb815ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.237+0000 7fabbdcf5640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabb815ba10 0x7fabb80c9650 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.237+0000 7fabbdcf5640 1 --2- 172.21.15.104:0/2941655049 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabb80d0320 0x7fabb8148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.237+0000 7fabbdcf5640 1 -- 172.21.15.104:0/2941655049 >> 172.21.15.104:0/2941655049 conn(0x7fabb80b3280 msgr2=0x7fabb815e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:38.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.237+0000 7fabbdcf5640 1 -- 172.21.15.104:0/2941655049 shutdown_connections 2024-05-08T04:21:38.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.237+0000 7fabbdcf5640 1 -- 172.21.15.104:0/2941655049 wait complete. 2024-05-08T04:21:38.249 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:38.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.354+0000 7fcd342a3640 1 Processor -- start 2024-05-08T04:21:38.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.354+0000 7fcd342a3640 1 -- start start 2024-05-08T04:21:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.355+0000 7fcd342a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd2c15dbe0 0x7fcd2c0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.355+0000 7fcd342a3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcd2c06b270 0x7fcd2c0b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.355+0000 7fcd342a3640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c0b4cf0 con 0x7fcd2c070940 2024-05-08T04:21:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.355+0000 7fcd342a3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c06fb80 con 0x7fcd2c06b270 2024-05-08T04:21:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.355+0000 7fcd342a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c06fe60 con 0x7fcd2c15dbe0 2024-05-08T04:21:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3183e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fcd2c070940 0x7fcd2c06ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43148/0 (socket says 172.21.15.104:43148) 2024-05-08T04:21:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3183e640 1 -- 172.21.15.104:0/56853927 learned_addr learned my addr 172.21.15.104:0/56853927 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3203f640 1 --2- 172.21.15.104:0/56853927 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd2c15dbe0 0x7fcd2c0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd32840640 1 --2- 172.21.15.104:0/56853927 >> v2:172.21.15.183:3300/0 conn(0x7fcd2c06b270 0x7fcd2c0b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163258195 0 0) 0x7fcd2c0b4cf0 con 0x7fcd2c070940 2024-05-08T04:21:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd18003520 con 0x7fcd2c070940 2024-05-08T04:21:38.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 398151003 0 0) 0x7fcd18003520 con 0x7fcd2c070940 2024-05-08T04:21:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd2c15dbe0 msgr2=0x7fcd2c0b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 --2- 172.21.15.104:0/56853927 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd2c15dbe0 0x7fcd2c0b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 >> v2:172.21.15.183:3300/0 conn(0x7fcd2c06b270 msgr2=0x7fcd2c0b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 --2- 172.21.15.104:0/56853927 >> v2:172.21.15.183:3300/0 conn(0x7fcd2c06b270 0x7fcd2c0b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c070140 con 0x7fcd2c070940 2024-05-08T04:21:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fcd1c001670 con 0x7fcd2c070940 2024-05-08T04:21:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 >> v1:172.21.15.104:6789/0 conn(0x7fcd2c070940 legacy=0x7fcd2c06ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 --2- 172.21.15.104:0/56853927 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd2c15dbe0 0x7fcd180039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 --2- 172.21.15.104:0/56853927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd18003f30 0x7fcd18004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 --2- 172.21.15.104:0/56853927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd18004d40 0x7fcd180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c06fb80 con 0x7fcd18003f30 2024-05-08T04:21:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c06fe60 con 0x7fcd18004d40 2024-05-08T04:21:38.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1800b9c0 con 0x7fcd2c15dbe0 2024-05-08T04:21:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3183e640 1 --2- 172.21.15.104:0/56853927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd18003f30 0x7fcd18004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd3203f640 1 --2- 172.21.15.104:0/56853927 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd2c15dbe0 0x7fcd180039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.356+0000 7fcd32840640 1 --2- 172.21.15.104:0/56853927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd18004d40 0x7fcd180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.357+0000 7fcd3183e640 1 -- 172.21.15.104:0/56853927 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd2c15dbe0 msgr2=0x7fcd180039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.357+0000 7fcd3183e640 1 --2- 172.21.15.104:0/56853927 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd2c15dbe0 0x7fcd180039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.357+0000 7fcd3183e640 1 -- 172.21.15.104:0/56853927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd18004d40 msgr2=0x7fcd180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.357+0000 7fcd3183e640 1 --2- 172.21.15.104:0/56853927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd18004d40 0x7fcd180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.357+0000 7fcd3183e640 1 -- 172.21.15.104:0/56853927 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18003520 con 0x7fcd18003f30 2024-05-08T04:21:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.357+0000 7fcd32840640 1 --2- 172.21.15.104:0/56853927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd18004d40 0x7fcd180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.357+0000 7fcd3183e640 1 --2- 172.21.15.104:0/56853927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd18003f30 0x7fcd18004800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00c290 tx=0x7fcd18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18514bdea153660f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.357+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c007d50 con 0x7fcd18003f30 2024-05-08T04:21:38.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.357+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c02e070 con 0x7fcd18003f30 2024-05-08T04:21:38.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.357+0000 7fcd3103d640 1 -- 172.21.15.104:0/56853927 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c005d70 con 0x7fcd18003f30 2024-05-08T04:21:38.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.358+0000 7fcd342a3640 1 -- 172.21.15.104:0/56853927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd18003f30 msgr2=0x7fcd18004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.358+0000 7fcd342a3640 1 --2- 172.21.15.104:0/56853927 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd18003f30 0x7fcd18004800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00c290 tx=0x7fcd18005830 comp rx=0 tx=0).stop 2024-05-08T04:21:38.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.358+0000 7fcd32840640 1 -- 172.21.15.104:0/56853927 reap_dead start 2024-05-08T04:21:38.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.358+0000 7fcd342a3640 1 -- 172.21.15.104:0/56853927 shutdown_connections 2024-05-08T04:21:38.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.358+0000 7fcd342a3640 1 -- 172.21.15.104:0/56853927 >> 172.21.15.104:0/56853927 conn(0x7fcd2c0b2370 msgr2=0x7fcd2c0b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:38.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.358+0000 7fcd342a3640 1 -- 172.21.15.104:0/56853927 shutdown_connections 2024-05-08T04:21:38.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.358+0000 7fcd342a3640 1 -- 172.21.15.104:0/56853927 wait complete. 2024-05-08T04:21:38.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.359+0000 7fcd342a3640 1 Processor -- start 2024-05-08T04:21:38.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.359+0000 7fcd342a3640 1 -- start start 2024-05-08T04:21:38.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd342a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd18003f30 0x7fcd2c156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd342a3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd2c156370 0x7fcd2c13fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd342a3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd2c140250 0x7fcd2c143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd342a3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0b4180 con 0x7fcd2c140250 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd342a3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0afe80 con 0x7fcd2c156370 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd342a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0b4300 con 0x7fcd18003f30 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd32840640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd2c140250 0x7fcd2c143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd32840640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd2c140250 0x7fcd2c143de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54026/0 (socket says 172.21.15.104:54026) 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd32840640 1 -- 172.21.15.104:0/634057367 learned_addr learned my addr 172.21.15.104:0/634057367 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd3203f640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd18003f30 0x7fcd2c156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd3183e640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd2c156370 0x7fcd2c13fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd32840640 1 -- 172.21.15.104:0/634057367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd18003f30 msgr2=0x7fcd2c156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd32840640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd18003f30 0x7fcd2c156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd32840640 1 -- 172.21.15.104:0/634057367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd2c156370 msgr2=0x7fcd2c13fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd32840640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd2c156370 0x7fcd2c13fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.360+0000 7fcd32840640 1 -- 172.21.15.104:0/634057367 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c1555b0 con 0x7fcd2c140250 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.361+0000 7fcd32840640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd2c140250 0x7fcd2c143de0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0b4ec0 tx=0x7fcd24011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:38.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.361+0000 7fcd22ffd640 1 -- 172.21.15.104:0/634057367 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24003610 con 0x7fcd2c140250 2024-05-08T04:21:38.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.361+0000 7fcd22ffd640 1 -- 172.21.15.104:0/634057367 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2401b070 con 0x7fcd2c140250 2024-05-08T04:21:38.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.361+0000 7fcd22ffd640 1 -- 172.21.15.104:0/634057367 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24003a10 con 0x7fcd2c140250 2024-05-08T04:21:38.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.361+0000 7fcd342a3640 1 -- 172.21.15.104:0/634057367 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c155890 con 0x7fcd2c140250 2024-05-08T04:21:38.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.361+0000 7fcd342a3640 1 -- 172.21.15.104:0/634057367 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c155e50 con 0x7fcd2c140250 2024-05-08T04:21:38.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.362+0000 7fcd342a3640 1 -- 172.21.15.104:0/634057367 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c075010 con 0x7fcd2c140250 2024-05-08T04:21:38.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.362+0000 7fcd22ffd640 1 -- 172.21.15.104:0/634057367 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd24003bb0 con 0x7fcd2c140250 2024-05-08T04:21:38.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.363+0000 7fcd22ffd640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd1006b500 0x7fcd1006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.363+0000 7fcd22ffd640 1 -- 172.21.15.104:0/634057367 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd2408a300 con 0x7fcd2c140250 2024-05-08T04:21:38.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.363+0000 7fcd3203f640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd1006b500 0x7fcd1006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.363+0000 7fcd3203f640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd1006b500 0x7fcd1006d9c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcd280133c0 tx=0x7fcd2800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:38.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.367+0000 7fcd22ffd640 1 -- 172.21.15.104:0/634057367 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd24025020 con 0x7fcd2c140250 2024-05-08T04:21:38.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.535+0000 7fcd342a3640 1 -- 172.21.15.104:0/634057367 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd2c1592a0 con 0x7fcd2c140250 2024-05-08T04:21:38.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.536+0000 7fcd22ffd640 1 -- 172.21.15.104:0/634057367 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd24059180 con 0x7fcd2c140250 2024-05-08T04:21:38.537 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:38.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.537+0000 7fcd342a3640 1 -- 172.21.15.104:0/634057367 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd1006b500 msgr2=0x7fcd1006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.537+0000 7fcd342a3640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd1006b500 0x7fcd1006d9c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcd280133c0 tx=0x7fcd2800b040 comp rx=0 tx=0).stop 2024-05-08T04:21:38.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.538+0000 7fcd342a3640 1 -- 172.21.15.104:0/634057367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd2c140250 msgr2=0x7fcd2c143de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.538+0000 7fcd342a3640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd2c140250 0x7fcd2c143de0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0b4ec0 tx=0x7fcd24011920 comp rx=0 tx=0).stop 2024-05-08T04:21:38.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.538+0000 7fcd342a3640 1 -- 172.21.15.104:0/634057367 shutdown_connections 2024-05-08T04:21:38.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.538+0000 7fcd342a3640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd1006b500 0x7fcd1006d9c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.538+0000 7fcd342a3640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd2c156370 0x7fcd2c13fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.538+0000 7fcd342a3640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd2c140250 0x7fcd2c143de0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.538+0000 7fcd342a3640 1 --2- 172.21.15.104:0/634057367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd18003f30 0x7fcd2c156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.538+0000 7fcd342a3640 1 -- 172.21.15.104:0/634057367 >> 172.21.15.104:0/634057367 conn(0x7fcd2c0b2370 msgr2=0x7fcd2c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:38.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.538+0000 7fcd342a3640 1 -- 172.21.15.104:0/634057367 shutdown_connections 2024-05-08T04:21:38.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.538+0000 7fcd342a3640 1 -- 172.21.15.104:0/634057367 wait complete. 2024-05-08T04:21:38.550 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:38.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.651+0000 7f4cfc36a640 1 Processor -- start 2024-05-08T04:21:38.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.651+0000 7f4cfc36a640 1 -- start start 2024-05-08T04:21:38.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cfc36a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4cf4099a40 0x7f4cf4099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cfc36a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4cf415d490 0x7f4cf415d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cfc36a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf40cd940 con 0x7f4cf40b2b80 2024-05-08T04:21:38.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cfc36a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf409a3e0 con 0x7f4cf415d490 2024-05-08T04:21:38.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cfc36a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf40cc8a0 con 0x7f4cf4099a40 2024-05-08T04:21:38.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cfa106640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f4cf40b2b80 0x7f4cf409a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43160/0 (socket says 172.21.15.104:43160) 2024-05-08T04:21:38.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cfa907640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4cf415d490 0x7f4cf415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cfa106640 1 -- 172.21.15.104:0/983673390 learned_addr learned my addr 172.21.15.104:0/983673390 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:38.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cf9905640 1 --2- 172.21.15.104:0/983673390 >> v2:172.21.15.183:3300/0 conn(0x7f4cf4099a40 0x7f4cf4099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cfa907640 1 -- 172.21.15.104:0/983673390 >> v2:172.21.15.183:3300/0 conn(0x7f4cf4099a40 msgr2=0x7f4cf4099ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:38.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cfa907640 1 --2- 172.21.15.104:0/983673390 >> v2:172.21.15.183:3300/0 conn(0x7f4cf4099a40 0x7f4cf4099ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cfa907640 1 -- 172.21.15.104:0/983673390 >> v1:172.21.15.104:6789/0 conn(0x7f4cf40b2b80 legacy=0x7f4cf409a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cfa907640 1 -- 172.21.15.104:0/983673390 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf40ccb80 con 0x7f4cf415d490 2024-05-08T04:21:38.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cf9104640 1 -- 172.21.15.104:0/983673390 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043909059 0 0) 0x7f4cf40cd940 con 0x7f4cf40b2b80 2024-05-08T04:21:38.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.652+0000 7f4cf9905640 1 --2- 172.21.15.104:0/983673390 >> v2:172.21.15.183:3300/0 conn(0x7f4cf4099a40 0x7f4cf4099ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:38.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.653+0000 7f4cfa907640 1 --2- 172.21.15.104:0/983673390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4cf415d490 0x7f4cf415d900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4cf41617d0 tx=0x7f4cec02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a127097b8f41966 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:38.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.653+0000 7f4cf9104640 1 -- 172.21.15.104:0/983673390 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec037070 con 0x7f4cf415d490 2024-05-08T04:21:38.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.653+0000 7f4cf9104640 1 -- 172.21.15.104:0/983673390 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec032440 con 0x7f4cf415d490 2024-05-08T04:21:38.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.653+0000 7f4cf9104640 1 -- 172.21.15.104:0/983673390 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec032810 con 0x7f4cf415d490 2024-05-08T04:21:38.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.654+0000 7f4cfc36a640 1 -- 172.21.15.104:0/983673390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4cf415d490 msgr2=0x7f4cf415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.654+0000 7f4cfc36a640 1 --2- 172.21.15.104:0/983673390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4cf415d490 0x7f4cf415d900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4cf41617d0 tx=0x7f4cec02a230 comp rx=0 tx=0).stop 2024-05-08T04:21:38.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.654+0000 7f4cfc36a640 1 -- 172.21.15.104:0/983673390 shutdown_connections 2024-05-08T04:21:38.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.654+0000 7f4cfc36a640 1 --2- 172.21.15.104:0/983673390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4cf415d490 0x7f4cf415d900 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.654+0000 7f4cfc36a640 1 --2- 172.21.15.104:0/983673390 >> v2:172.21.15.183:3300/0 conn(0x7f4cf4099a40 0x7f4cf4099ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.654+0000 7f4cfc36a640 1 -- 172.21.15.104:0/983673390 >> 172.21.15.104:0/983673390 conn(0x7f4cf40b3310 msgr2=0x7f4cf40b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:38.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.654+0000 7f4cfc36a640 1 -- 172.21.15.104:0/983673390 shutdown_connections 2024-05-08T04:21:38.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.654+0000 7f4cfc36a640 1 -- 172.21.15.104:0/983673390 wait complete. 2024-05-08T04:21:38.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.655+0000 7f4cfc36a640 1 Processor -- start 2024-05-08T04:21:38.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.655+0000 7f4cfc36a640 1 -- start start 2024-05-08T04:21:38.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cfc36a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf4099a40 0x7f4cf40b6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cfc36a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4cf40b2b80 0x7f4cf40b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cfc36a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4cf415d490 0x7f4cf41f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cfc36a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40cf830 con 0x7f4cf40b2b80 2024-05-08T04:21:38.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cfc36a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40cd140 con 0x7f4cf415d490 2024-05-08T04:21:38.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cfc36a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40cc550 con 0x7f4cf4099a40 2024-05-08T04:21:38.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cf9905640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4cf40b2b80 0x7f4cf40b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cf9905640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4cf40b2b80 0x7f4cf40b6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54040/0 (socket says 172.21.15.104:54040) 2024-05-08T04:21:38.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cf9905640 1 -- 172.21.15.104:0/3224172951 learned_addr learned my addr 172.21.15.104:0/3224172951 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:38.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cfa106640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf4099a40 0x7f4cf40b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cfa907640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4cf415d490 0x7f4cf41f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cf9905640 1 -- 172.21.15.104:0/3224172951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf4099a40 msgr2=0x7f4cf40b6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cf9905640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf4099a40 0x7f4cf40b6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cf9905640 1 -- 172.21.15.104:0/3224172951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4cf415d490 msgr2=0x7f4cf41f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cf9905640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4cf415d490 0x7f4cf41f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cf9905640 1 -- 172.21.15.104:0/3224172951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf40b13c0 con 0x7f4cf40b2b80 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cf9905640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4cf40b2b80 0x7f4cf40b6c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c7f0 tx=0x7f4ce400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4ceaffd640 1 -- 172.21.15.104:0/3224172951 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4015070 con 0x7f4cf40b2b80 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4ceaffd640 1 -- 172.21.15.104:0/3224172951 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce4007a30 con 0x7f4cf40b2b80 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4cfc36a640 1 -- 172.21.15.104:0/3224172951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf40b16a0 con 0x7f4cf40b2b80 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.656+0000 7f4ceaffd640 1 -- 172.21.15.104:0/3224172951 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4007e00 con 0x7f4cf40b2b80 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.657+0000 7f4cfc36a640 1 -- 172.21.15.104:0/3224172951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf40ae640 con 0x7f4cf40b2b80 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.657+0000 7f4cfc36a640 1 -- 172.21.15.104:0/3224172951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf4075010 con 0x7f4cf40b2b80 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.658+0000 7f4ceaffd640 1 -- 172.21.15.104:0/3224172951 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ce4018070 con 0x7f4cf40b2b80 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.658+0000 7f4ceaffd640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4cd806b4d0 0x7f4cd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.658+0000 7f4cfa106640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4cd806b4d0 0x7f4cd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:38.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.658+0000 7f4ceaffd640 1 -- 172.21.15.104:0/3224172951 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ce408a1b0 con 0x7f4cf40b2b80 2024-05-08T04:21:38.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.659+0000 7f4cfa106640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4cd806b4d0 0x7f4cd806d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00012e0 tx=0x7f4cf0007ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:38.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.662+0000 7f4ceaffd640 1 -- 172.21.15.104:0/3224172951 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4ce4059030 con 0x7f4cf40b2b80 2024-05-08T04:21:38.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.831+0000 7f4cfc36a640 1 -- 172.21.15.104:0/3224172951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4cf40b3890 con 0x7f4cf40b2b80 2024-05-08T04:21:38.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.832+0000 7f4ceaffd640 1 -- 172.21.15.104:0/3224172951 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ce4058930 con 0x7f4cf40b2b80 2024-05-08T04:21:38.833 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.834+0000 7f4cfc36a640 1 -- 172.21.15.104:0/3224172951 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4cd806b4d0 msgr2=0x7f4cd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.834+0000 7f4cfc36a640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4cd806b4d0 0x7f4cd806d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00012e0 tx=0x7f4cf0007ed0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.834+0000 7f4cfc36a640 1 -- 172.21.15.104:0/3224172951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4cf40b2b80 msgr2=0x7f4cf40b6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.834+0000 7f4cfc36a640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4cf40b2b80 0x7f4cf40b6c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c7f0 tx=0x7f4ce400cbf0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.834+0000 7f4cfc36a640 1 -- 172.21.15.104:0/3224172951 shutdown_connections 2024-05-08T04:21:38.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.834+0000 7f4cfc36a640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4cd806b4d0 0x7f4cd806d990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.834+0000 7f4cfc36a640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4cf415d490 0x7f4cf41f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.834+0000 7f4cfc36a640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4cf40b2b80 0x7f4cf40b6c60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.834+0000 7f4cfc36a640 1 --2- 172.21.15.104:0/3224172951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf4099a40 0x7f4cf40b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:38.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.834+0000 7f4cfc36a640 1 -- 172.21.15.104:0/3224172951 >> 172.21.15.104:0/3224172951 conn(0x7f4cf40b3310 msgr2=0x7f4cf40705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:38.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.834+0000 7f4cfc36a640 1 -- 172.21.15.104:0/3224172951 shutdown_connections 2024-05-08T04:21:38.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:38.834+0000 7f4cfc36a640 1 -- 172.21.15.104:0/3224172951 wait complete. 2024-05-08T04:21:38.908 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate binary .meta file on legacy subvol root doesn't break the system 2024-05-08T04:21:38.908 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-05-08T04:21:38.909 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:39.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.008+0000 7f7ae8838640 1 Processor -- start 2024-05-08T04:21:39.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.008+0000 7f7ae8838640 1 -- start start 2024-05-08T04:21:39.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae8838640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7ae415db30 0x7f7ae406bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae8838640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7ae40b93b0 0x7f7ae40b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae8838640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ae40b5970 0x7f7ae4161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae8838640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae40b5de0 con 0x7f7ae415db30 2024-05-08T04:21:39.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae8838640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae40b6b50 con 0x7f7ae40b93b0 2024-05-08T04:21:39.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae8838640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae406c800 con 0x7f7ae40b5970 2024-05-08T04:21:39.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae259c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7ae415db30 0x7f7ae406bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae259c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7ae415db30 0x7f7ae406bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54050/0 (socket says 172.21.15.104:54050) 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae259c640 1 -- 172.21.15.104:0/399783086 learned_addr learned my addr 172.21.15.104:0/399783086 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae2d9d640 1 --2- 172.21.15.104:0/399783086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ae40b5970 0x7f7ae4161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae259c640 1 -- 172.21.15.104:0/399783086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ae40b5970 msgr2=0x7f7ae4161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae1d9b640 1 --2- 172.21.15.104:0/399783086 >> v2:172.21.15.183:3300/0 conn(0x7f7ae40b93b0 0x7f7ae40b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae259c640 1 --2- 172.21.15.104:0/399783086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ae40b5970 0x7f7ae4161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae259c640 1 -- 172.21.15.104:0/399783086 >> v2:172.21.15.183:3300/0 conn(0x7f7ae40b93b0 msgr2=0x7f7ae40b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae259c640 1 --2- 172.21.15.104:0/399783086 >> v2:172.21.15.183:3300/0 conn(0x7f7ae40b93b0 0x7f7ae40b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae259c640 1 -- 172.21.15.104:0/399783086 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae406cae0 con 0x7f7ae415db30 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae2d9d640 1 --2- 172.21.15.104:0/399783086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ae40b5970 0x7f7ae4161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.009+0000 7f7ae1d9b640 1 --2- 172.21.15.104:0/399783086 >> v2:172.21.15.183:3300/0 conn(0x7f7ae40b93b0 0x7f7ae40b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.010+0000 7f7ae259c640 1 --2- 172.21.15.104:0/399783086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae415db30 0x7f7ae406bfb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4161660 tx=0x7f7ad402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d152e599f018fd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.010+0000 7f7ae159a640 1 -- 172.21.15.104:0/399783086 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4037070 con 0x7f7ae415db30 2024-05-08T04:21:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.010+0000 7f7ae159a640 1 -- 172.21.15.104:0/399783086 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad4032440 con 0x7f7ae415db30 2024-05-08T04:21:39.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.010+0000 7f7ae159a640 1 -- 172.21.15.104:0/399783086 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4032810 con 0x7f7ae415db30 2024-05-08T04:21:39.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.010+0000 7f7ae8838640 1 -- 172.21.15.104:0/399783086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae415db30 msgr2=0x7f7ae406bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.010+0000 7f7ae8838640 1 --2- 172.21.15.104:0/399783086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae415db30 0x7f7ae406bfb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4161660 tx=0x7f7ad402a1e0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.011+0000 7f7ae8838640 1 -- 172.21.15.104:0/399783086 shutdown_connections 2024-05-08T04:21:39.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.011+0000 7f7ae8838640 1 --2- 172.21.15.104:0/399783086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ae40b5970 0x7f7ae4161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.011+0000 7f7ae8838640 1 --2- 172.21.15.104:0/399783086 >> v2:172.21.15.183:3300/0 conn(0x7f7ae40b93b0 0x7f7ae40b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.011+0000 7f7ae8838640 1 --2- 172.21.15.104:0/399783086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae415db30 0x7f7ae406bfb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.011+0000 7f7ae8838640 1 -- 172.21.15.104:0/399783086 >> 172.21.15.104:0/399783086 conn(0x7f7ae40d0430 msgr2=0x7f7ae40d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.011+0000 7f7ae8838640 1 -- 172.21.15.104:0/399783086 shutdown_connections 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.011+0000 7f7ae8838640 1 -- 172.21.15.104:0/399783086 wait complete. 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.012+0000 7f7ae8838640 1 Processor -- start 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.012+0000 7f7ae8838640 1 -- start start 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae8838640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ae40b5970 0x7f7ae4161e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae8838640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae40b93b0 0x7f7ae415e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae8838640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ae415db30 0x7f7ae415a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae8838640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae406c4f0 con 0x7f7ae40b93b0 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae8838640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae40d1f90 con 0x7f7ae40b5970 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae8838640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae415df10 con 0x7f7ae415db30 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae40b93b0 0x7f7ae415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae40b93b0 0x7f7ae415e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54058/0 (socket says 172.21.15.104:54058) 2024-05-08T04:21:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae1d9b640 1 -- 172.21.15.104:0/3612680585 learned_addr learned my addr 172.21.15.104:0/3612680585 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae1d9b640 1 -- 172.21.15.104:0/3612680585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ae415db30 msgr2=0x7f7ae415a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae1d9b640 1 --2- 172.21.15.104:0/3612680585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ae415db30 0x7f7ae415a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae1d9b640 1 -- 172.21.15.104:0/3612680585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ae40b5970 msgr2=0x7f7ae4161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae1d9b640 1 --2- 172.21.15.104:0/3612680585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ae40b5970 0x7f7ae4161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae1d9b640 1 -- 172.21.15.104:0/3612680585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae415e760 con 0x7f7ae40b93b0 2024-05-08T04:21:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae1d9b640 1 --2- 172.21.15.104:0/3612680585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae40b93b0 0x7f7ae415e220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800c7f0 tx=0x7f7ad800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ad2ffd640 1 -- 172.21.15.104:0/3612680585 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8015070 con 0x7f7ae40b93b0 2024-05-08T04:21:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ad2ffd640 1 -- 172.21.15.104:0/3612680585 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad8007a30 con 0x7f7ae40b93b0 2024-05-08T04:21:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae8838640 1 -- 172.21.15.104:0/3612680585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae415e9e0 con 0x7f7ae40b93b0 2024-05-08T04:21:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ad2ffd640 1 -- 172.21.15.104:0/3612680585 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8007e00 con 0x7f7ae40b93b0 2024-05-08T04:21:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.013+0000 7f7ae8838640 1 -- 172.21.15.104:0/3612680585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae415efa0 con 0x7f7ae40b93b0 2024-05-08T04:21:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.014+0000 7f7ae8838640 1 -- 172.21.15.104:0/3612680585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae4075010 con 0x7f7ae40b93b0 2024-05-08T04:21:39.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.015+0000 7f7ad2ffd640 1 -- 172.21.15.104:0/3612680585 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7ad8018070 con 0x7f7ae40b93b0 2024-05-08T04:21:39.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.015+0000 7f7ad2ffd640 1 --2- 172.21.15.104:0/3612680585 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ac406b500 0x7f7ac406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.015+0000 7f7ad2ffd640 1 -- 172.21.15.104:0/3612680585 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ad808a120 con 0x7f7ae40b93b0 2024-05-08T04:21:39.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.015+0000 7f7ae259c640 1 --2- 172.21.15.104:0/3612680585 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ac406b500 0x7f7ac406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.016+0000 7f7ae259c640 1 --2- 172.21.15.104:0/3612680585 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ac406b500 0x7f7ac406d9c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4034000 tx=0x7f7ad402c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:39.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.019+0000 7f7ad2ffd640 1 -- 172.21.15.104:0/3612680585 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7ae415e760 con 0x7f7ae40b93b0 2024-05-08T04:21:39.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.190+0000 7f7ae8838640 1 -- 172.21.15.104:0/3612680585 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ae40d0af0 con 0x7f7ae40b93b0 2024-05-08T04:21:39.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.191+0000 7f7ad2ffd640 1 -- 172.21.15.104:0/3612680585 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f7ad8059030 con 0x7f7ae40b93b0 2024-05-08T04:21:39.193 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:39.193 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:39.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.193+0000 7f7ae8838640 1 -- 172.21.15.104:0/3612680585 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ac406b500 msgr2=0x7f7ac406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.193+0000 7f7ae8838640 1 --2- 172.21.15.104:0/3612680585 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ac406b500 0x7f7ac406d9c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4034000 tx=0x7f7ad402c000 comp rx=0 tx=0).stop 2024-05-08T04:21:39.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.193+0000 7f7ae8838640 1 -- 172.21.15.104:0/3612680585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae40b93b0 msgr2=0x7f7ae415e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.193+0000 7f7ae8838640 1 --2- 172.21.15.104:0/3612680585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae40b93b0 0x7f7ae415e220 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800c7f0 tx=0x7f7ad800ccb0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.193+0000 7f7ae8838640 1 -- 172.21.15.104:0/3612680585 shutdown_connections 2024-05-08T04:21:39.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.193+0000 7f7ae8838640 1 --2- 172.21.15.104:0/3612680585 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ac406b500 0x7f7ac406d9c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.193+0000 7f7ae8838640 1 --2- 172.21.15.104:0/3612680585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ae415db30 0x7f7ae415a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.193+0000 7f7ae8838640 1 --2- 172.21.15.104:0/3612680585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ae40b93b0 0x7f7ae415e220 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.193+0000 7f7ae8838640 1 --2- 172.21.15.104:0/3612680585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ae40b5970 0x7f7ae4161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.193+0000 7f7ae8838640 1 -- 172.21.15.104:0/3612680585 >> 172.21.15.104:0/3612680585 conn(0x7f7ae40d0430 msgr2=0x7f7ae40d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:39.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.193+0000 7f7ae8838640 1 -- 172.21.15.104:0/3612680585 shutdown_connections 2024-05-08T04:21:39.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.193+0000 7f7ae8838640 1 -- 172.21.15.104:0/3612680585 wait complete. 2024-05-08T04:21:39.205 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:39.206 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:39.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.307+0000 7f6a18f42640 1 Processor -- start 2024-05-08T04:21:39.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.307+0000 7f6a18f42640 1 -- start start 2024-05-08T04:21:39.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a18f42640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6a140cd370 0x7f6a140cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a18f42640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6a140cf600 0x7f6a14099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a18f42640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a140cfb70 con 0x7f6a140b2320 2024-05-08T04:21:39.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a18f42640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a140d0860 con 0x7f6a140cf600 2024-05-08T04:21:39.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a18f42640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a140cff30 con 0x7f6a140cd370 2024-05-08T04:21:39.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a0bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6a140cf600 0x7f6a14099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a12d9d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6a140b2320 0x7f6a140b14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43172/0 (socket says 172.21.15.104:43172) 2024-05-08T04:21:39.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a12d9d640 1 -- 172.21.15.104:0/2070691172 learned_addr learned my addr 172.21.15.104:0/2070691172 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:39.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a1259c640 1 --2- 172.21.15.104:0/2070691172 >> v2:172.21.15.183:3300/0 conn(0x7f6a140cd370 0x7f6a140cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a0bfff640 1 -- 172.21.15.104:0/2070691172 >> v2:172.21.15.183:3300/0 conn(0x7f6a140cd370 msgr2=0x7f6a140cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:39.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a0bfff640 1 --2- 172.21.15.104:0/2070691172 >> v2:172.21.15.183:3300/0 conn(0x7f6a140cd370 0x7f6a140cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a0bfff640 1 -- 172.21.15.104:0/2070691172 >> v1:172.21.15.104:6789/0 conn(0x7f6a140b2320 legacy=0x7f6a140b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a0bfff640 1 -- 172.21.15.104:0/2070691172 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140d0210 con 0x7f6a140cf600 2024-05-08T04:21:39.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.308+0000 7f6a11d9b640 1 -- 172.21.15.104:0/2070691172 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254642543 0 0) 0x7f6a140cfb70 con 0x7f6a140b2320 2024-05-08T04:21:39.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.309+0000 7f6a0bfff640 1 --2- 172.21.15.104:0/2070691172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a140cf600 0x7f6a14099a40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6a14072160 tx=0x7f69fc02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a15cb18513aab67 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:39.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.309+0000 7f6a11d9b640 1 -- 172.21.15.104:0/2070691172 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc037070 con 0x7f6a140cf600 2024-05-08T04:21:39.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.309+0000 7f6a11d9b640 1 -- 172.21.15.104:0/2070691172 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc02add0 con 0x7f6a140cf600 2024-05-08T04:21:39.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.309+0000 7f6a11d9b640 1 -- 172.21.15.104:0/2070691172 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc032660 con 0x7f6a140cf600 2024-05-08T04:21:39.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.310+0000 7f6a18f42640 1 -- 172.21.15.104:0/2070691172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a140cf600 msgr2=0x7f6a14099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.310+0000 7f6a18f42640 1 --2- 172.21.15.104:0/2070691172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a140cf600 0x7f6a14099a40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6a14072160 tx=0x7f69fc02a080 comp rx=0 tx=0).stop 2024-05-08T04:21:39.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.310+0000 7f6a18f42640 1 -- 172.21.15.104:0/2070691172 shutdown_connections 2024-05-08T04:21:39.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.310+0000 7f6a18f42640 1 --2- 172.21.15.104:0/2070691172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a140cf600 0x7f6a14099a40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.310+0000 7f6a18f42640 1 --2- 172.21.15.104:0/2070691172 >> v2:172.21.15.183:3300/0 conn(0x7f6a140cd370 0x7f6a140cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.310+0000 7f6a18f42640 1 -- 172.21.15.104:0/2070691172 >> 172.21.15.104:0/2070691172 conn(0x7f6a140b3310 msgr2=0x7f6a140b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:39.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.310+0000 7f6a18f42640 1 -- 172.21.15.104:0/2070691172 shutdown_connections 2024-05-08T04:21:39.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.310+0000 7f6a18f42640 1 -- 172.21.15.104:0/2070691172 wait complete. 2024-05-08T04:21:39.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.311+0000 7f6a18f42640 1 Processor -- start 2024-05-08T04:21:39.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.311+0000 7f6a18f42640 1 -- start start 2024-05-08T04:21:39.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a18f42640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a140b2320 0x7f6a140ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a18f42640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a140cd370 0x7f6a141f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a18f42640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a140cf600 0x7f6a140c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a18f42640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140b2a30 con 0x7f6a140cf600 2024-05-08T04:21:39.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a18f42640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140cd750 con 0x7f6a140b2320 2024-05-08T04:21:39.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a18f42640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140b2bb0 con 0x7f6a140cd370 2024-05-08T04:21:39.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a12d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a140cf600 0x7f6a140c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a12d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a140cf600 0x7f6a140c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54072/0 (socket says 172.21.15.104:54072) 2024-05-08T04:21:39.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a12d9d640 1 -- 172.21.15.104:0/2681559343 learned_addr learned my addr 172.21.15.104:0/2681559343 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:39.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a12d9d640 1 -- 172.21.15.104:0/2681559343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a140cd370 msgr2=0x7f6a141f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a0bfff640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a140cd370 0x7f6a141f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a1259c640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a140b2320 0x7f6a140ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a12d9d640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a140cd370 0x7f6a141f1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a12d9d640 1 -- 172.21.15.104:0/2681559343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a140b2320 msgr2=0x7f6a140ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a12d9d640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a140b2320 0x7f6a140ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a12d9d640 1 -- 172.21.15.104:0/2681559343 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140cac20 con 0x7f6a140cf600 2024-05-08T04:21:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a1259c640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a140b2320 0x7f6a140ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a12d9d640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a140cf600 0x7f6a140c7520 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00c7a0 tx=0x7f6a0c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a0affd640 1 -- 172.21.15.104:0/2681559343 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c018070 con 0x7f6a140cf600 2024-05-08T04:21:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a0affd640 1 -- 172.21.15.104:0/2681559343 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c00a640 con 0x7f6a140cf600 2024-05-08T04:21:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a0affd640 1 -- 172.21.15.104:0/2681559343 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c00aab0 con 0x7f6a140cf600 2024-05-08T04:21:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a18f42640 1 -- 172.21.15.104:0/2681559343 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a141f4f60 con 0x7f6a140cf600 2024-05-08T04:21:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.312+0000 7f6a18f42640 1 -- 172.21.15.104:0/2681559343 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a141f5520 con 0x7f6a140cf600 2024-05-08T04:21:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.313+0000 7f6a18f42640 1 -- 172.21.15.104:0/2681559343 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a14075010 con 0x7f6a140cf600 2024-05-08T04:21:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.314+0000 7f6a0affd640 1 -- 172.21.15.104:0/2681559343 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6a0c01b070 con 0x7f6a140cf600 2024-05-08T04:21:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.314+0000 7f6a0affd640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f69f406b4d0 0x7f69f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.314+0000 7f6a0affd640 1 -- 172.21.15.104:0/2681559343 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a0c089820 con 0x7f6a140cf600 2024-05-08T04:21:39.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.314+0000 7f6a1259c640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f69f406b4d0 0x7f69f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.315+0000 7f6a1259c640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f69f406b4d0 0x7f69f406d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6a04008890 tx=0x7f6a04008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:39.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.319+0000 7f6a0affd640 1 -- 172.21.15.104:0/2681559343 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a0c0586a0 con 0x7f6a140cf600 2024-05-08T04:21:39.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.490+0000 7f6a18f42640 1 -- 172.21.15.104:0/2681559343 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a140ce080 con 0x7f6a140cf600 2024-05-08T04:21:39.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.490+0000 7f6a0affd640 1 -- 172.21.15.104:0/2681559343 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a0c057fa0 con 0x7f6a140cf600 2024-05-08T04:21:39.492 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:39.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.493+0000 7f6a18f42640 1 -- 172.21.15.104:0/2681559343 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f69f406b4d0 msgr2=0x7f69f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.493+0000 7f6a18f42640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f69f406b4d0 0x7f69f406d990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6a04008890 tx=0x7f6a04008040 comp rx=0 tx=0).stop 2024-05-08T04:21:39.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.493+0000 7f6a18f42640 1 -- 172.21.15.104:0/2681559343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a140cf600 msgr2=0x7f6a140c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.493+0000 7f6a18f42640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a140cf600 0x7f6a140c7520 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00c7a0 tx=0x7f6a0c00cc60 comp rx=0 tx=0).stop 2024-05-08T04:21:39.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.493+0000 7f6a18f42640 1 -- 172.21.15.104:0/2681559343 shutdown_connections 2024-05-08T04:21:39.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.493+0000 7f6a18f42640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f69f406b4d0 0x7f69f406d990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.493+0000 7f6a18f42640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a140cf600 0x7f6a140c7520 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.493+0000 7f6a18f42640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a140cd370 0x7f6a141f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.493+0000 7f6a18f42640 1 --2- 172.21.15.104:0/2681559343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a140b2320 0x7f6a140ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.493+0000 7f6a18f42640 1 -- 172.21.15.104:0/2681559343 >> 172.21.15.104:0/2681559343 conn(0x7f6a140b3310 msgr2=0x7f6a14099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:39.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.493+0000 7f6a18f42640 1 -- 172.21.15.104:0/2681559343 shutdown_connections 2024-05-08T04:21:39.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.493+0000 7f6a18f42640 1 -- 172.21.15.104:0/2681559343 wait complete. 2024-05-08T04:21:39.505 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:39.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.606+0000 7f20013f4640 1 Processor -- start 2024-05-08T04:21:39.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.606+0000 7f20013f4640 1 -- start start 2024-05-08T04:21:39.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f20013f4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1ffc15de10 0x7f1ffc161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f20013f4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1ffc0d07c0 0x7f1ffc0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f20013f4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ffc15e1f0 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f20013f4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc0d0f50 con 0x7f1ffc15de10 2024-05-08T04:21:39.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f20013f4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc161e60 con 0x7f1ffc0d07c0 2024-05-08T04:21:39.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f1ffaffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1ffc15de10 0x7f1ffc161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f1ffaffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1ffc15de10 0x7f1ffc161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54076/0 (socket says 172.21.15.104:54076) 2024-05-08T04:21:39.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f1ffaffd640 1 -- 172.21.15.104:0/1936668639 learned_addr learned my addr 172.21.15.104:0/1936668639 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:39.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f1ffb7fe640 1 --2- 172.21.15.104:0/1936668639 >> v2:172.21.15.183:3300/0 conn(0x7f1ffc0d07c0 0x7f1ffc0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f1ffaffd640 1 -- 172.21.15.104:0/1936668639 >> v2:172.21.15.183:3300/0 conn(0x7f1ffc0d07c0 msgr2=0x7f1ffc0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:39.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f1ffaffd640 1 --2- 172.21.15.104:0/1936668639 >> v2:172.21.15.183:3300/0 conn(0x7f1ffc0d07c0 0x7f1ffc0d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f1ffaffd640 1 -- 172.21.15.104:0/1936668639 >> v1:172.21.15.183:6789/0 conn(0x7f1ffc0ce5a0 legacy=0x7f1ffc0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:39.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f1ffaffd640 1 -- 172.21.15.104:0/1936668639 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc162090 con 0x7f1ffc15de10 2024-05-08T04:21:39.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.607+0000 7f1ffb7fe640 1 --2- 172.21.15.104:0/1936668639 >> v2:172.21.15.183:3300/0 conn(0x7f1ffc0d07c0 0x7f1ffc0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:39.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.608+0000 7f1ffaffd640 1 --2- 172.21.15.104:0/1936668639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ffc15de10 0x7f1ffc161920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0b3420 tx=0x7f1fec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb408fadaa336628 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:39.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.608+0000 7f1ff9ffb640 1 -- 172.21.15.104:0/1936668639 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec037070 con 0x7f1ffc15de10 2024-05-08T04:21:39.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.608+0000 7f1ff9ffb640 1 -- 172.21.15.104:0/1936668639 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec032440 con 0x7f1ffc15de10 2024-05-08T04:21:39.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.608+0000 7f1ff9ffb640 1 -- 172.21.15.104:0/1936668639 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec032810 con 0x7f1ffc15de10 2024-05-08T04:21:39.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.609+0000 7f20013f4640 1 -- 172.21.15.104:0/1936668639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ffc15de10 msgr2=0x7f1ffc161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.609+0000 7f20013f4640 1 --2- 172.21.15.104:0/1936668639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ffc15de10 0x7f1ffc161920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0b3420 tx=0x7f1fec02a1e0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.609+0000 7f20013f4640 1 -- 172.21.15.104:0/1936668639 shutdown_connections 2024-05-08T04:21:39.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.609+0000 7f20013f4640 1 --2- 172.21.15.104:0/1936668639 >> v2:172.21.15.183:3300/0 conn(0x7f1ffc0d07c0 0x7f1ffc0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.609+0000 7f20013f4640 1 --2- 172.21.15.104:0/1936668639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ffc15de10 0x7f1ffc161920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.609+0000 7f20013f4640 1 -- 172.21.15.104:0/1936668639 >> 172.21.15.104:0/1936668639 conn(0x7f1ffc072290 msgr2=0x7f1ffc072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:39.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.609+0000 7f20013f4640 1 -- 172.21.15.104:0/1936668639 shutdown_connections 2024-05-08T04:21:39.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.609+0000 7f20013f4640 1 -- 172.21.15.104:0/1936668639 wait complete. 2024-05-08T04:21:39.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.610+0000 7f20013f4640 1 Processor -- start 2024-05-08T04:21:39.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.610+0000 7f20013f4640 1 -- start start 2024-05-08T04:21:39.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.611+0000 7f20013f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ffc0ce5a0 0x7f1ffc0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.611+0000 7f20013f4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ffc0d07c0 0x7f1ffc0c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.611+0000 7f20013f4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ffc15de10 0x7f1ffc1e8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.611+0000 7f20013f4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc162650 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.611+0000 7f20013f4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0d1a90 con 0x7f1ffc15de10 2024-05-08T04:21:39.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.611+0000 7f20013f4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0d1ce0 con 0x7f1ffc0d07c0 2024-05-08T04:21:39.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.611+0000 7f1ffaffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ffc0ce5a0 0x7f1ffc0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.611+0000 7f1ffaffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ffc0ce5a0 0x7f1ffc0ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54082/0 (socket says 172.21.15.104:54082) 2024-05-08T04:21:39.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.611+0000 7f1ffaffd640 1 -- 172.21.15.104:0/1336876573 learned_addr learned my addr 172.21.15.104:0/1336876573 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:39.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.611+0000 7f1ffa7fc640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ffc0d07c0 0x7f1ffc0c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.611+0000 7f1ffb7fe640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ffc15de10 0x7f1ffc1e8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.612+0000 7f1ffaffd640 1 -- 172.21.15.104:0/1336876573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ffc0d07c0 msgr2=0x7f1ffc0c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.612+0000 7f1ffaffd640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ffc0d07c0 0x7f1ffc0c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.612+0000 7f1ffaffd640 1 -- 172.21.15.104:0/1336876573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ffc15de10 msgr2=0x7f1ffc1e8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.612+0000 7f1ffaffd640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ffc15de10 0x7f1ffc1e8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.612+0000 7f1ffaffd640 1 -- 172.21.15.104:0/1336876573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc154aa0 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.612+0000 7f1ffaffd640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ffc0ce5a0 0x7f1ffc0ca2d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1fec02a220 tx=0x7f1fec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.612+0000 7f1fe37fe640 1 -- 172.21.15.104:0/1336876573 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec041020 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.612+0000 7f1fe37fe640 1 -- 172.21.15.104:0/1336876573 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec0306c0 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.612+0000 7f20013f4640 1 -- 172.21.15.104:0/1336876573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ffc154d80 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.612+0000 7f1fe37fe640 1 -- 172.21.15.104:0/1336876573 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec037040 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.612+0000 7f20013f4640 1 -- 172.21.15.104:0/1336876573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ffc140b40 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.613+0000 7f20013f4640 1 -- 172.21.15.104:0/1336876573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ffc075010 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.613+0000 7f1fe37fe640 1 -- 172.21.15.104:0/1336876573 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1fec044020 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.614+0000 7f1fe37fe640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1fe806b4d0 0x7f1fe806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.614+0000 7f1ffa7fc640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1fe806b4d0 0x7f1fe806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.614+0000 7f1fe37fe640 1 -- 172.21.15.104:0/1336876573 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fec0aa8e0 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.614+0000 7f1ffa7fc640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1fe806b4d0 0x7f1fe806d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc074070 tx=0x7f1ff0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:39.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.618+0000 7f1fe37fe640 1 -- 172.21.15.104:0/1336876573 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1fec04b030 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.788+0000 7f20013f4640 1 -- 172.21.15.104:0/1336876573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ffc0d1870 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.789+0000 7f1fe37fe640 1 -- 172.21.15.104:0/1336876573 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1fec079110 con 0x7f1ffc0ce5a0 2024-05-08T04:21:39.790 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:39.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.791+0000 7f20013f4640 1 -- 172.21.15.104:0/1336876573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1fe806b4d0 msgr2=0x7f1fe806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.791+0000 7f20013f4640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1fe806b4d0 0x7f1fe806d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc074070 tx=0x7f1ff0009040 comp rx=0 tx=0).stop 2024-05-08T04:21:39.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.791+0000 7f20013f4640 1 -- 172.21.15.104:0/1336876573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ffc0ce5a0 msgr2=0x7f1ffc0ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.791+0000 7f20013f4640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ffc0ce5a0 0x7f1ffc0ca2d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1fec02a220 tx=0x7f1fec0046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.791+0000 7f20013f4640 1 -- 172.21.15.104:0/1336876573 shutdown_connections 2024-05-08T04:21:39.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.791+0000 7f20013f4640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1fe806b4d0 0x7f1fe806d990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.791+0000 7f20013f4640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ffc15de10 0x7f1ffc1e8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.791+0000 7f20013f4640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ffc0d07c0 0x7f1ffc0c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.791+0000 7f20013f4640 1 --2- 172.21.15.104:0/1336876573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1ffc0ce5a0 0x7f1ffc0ca2d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.791+0000 7f20013f4640 1 -- 172.21.15.104:0/1336876573 >> 172.21.15.104:0/1336876573 conn(0x7f1ffc072290 msgr2=0x7f1ffc0cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:39.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.791+0000 7f20013f4640 1 -- 172.21.15.104:0/1336876573 shutdown_connections 2024-05-08T04:21:39.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.791+0000 7f20013f4640 1 -- 172.21.15.104:0/1336876573 wait complete. 2024-05-08T04:21:39.803 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:39.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.905+0000 7f2307bb6640 1 Processor -- start 2024-05-08T04:21:39.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.905+0000 7f2307bb6640 1 -- start start 2024-05-08T04:21:39.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.906+0000 7f2307bb6640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f230009a150 0x7f23000cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.906+0000 7f2307bb6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f23000cf600 0x7f23000b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.906+0000 7f2307bb6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23000cfb70 con 0x7f23000cd370 2024-05-08T04:21:39.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.906+0000 7f2307bb6640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23000d0860 con 0x7f230009a150 2024-05-08T04:21:39.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.906+0000 7f2307bb6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23000cff30 con 0x7f23000cf600 2024-05-08T04:21:39.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.906+0000 7f2305151640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f230009a150 0x7f23000cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.906+0000 7f2305151640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f230009a150 0x7f23000cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54094/0 (socket says 172.21.15.104:54094) 2024-05-08T04:21:39.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.906+0000 7f2305151640 1 -- 172.21.15.104:0/1861640982 learned_addr learned my addr 172.21.15.104:0/1861640982 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:39.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.906+0000 7f2305151640 1 -- 172.21.15.104:0/1861640982 >> v2:172.21.15.183:3300/0 conn(0x7f23000cf600 msgr2=0x7f23000b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:39.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.906+0000 7f2305151640 1 --2- 172.21.15.104:0/1861640982 >> v2:172.21.15.183:3300/0 conn(0x7f23000cf600 0x7f23000b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.906+0000 7f2305151640 1 -- 172.21.15.104:0/1861640982 >> v1:172.21.15.183:6789/0 conn(0x7f23000cd370 legacy=0x7f2300099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:39.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.906+0000 7f2305151640 1 -- 172.21.15.104:0/1861640982 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23000d0210 con 0x7f230009a150 2024-05-08T04:21:39.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.907+0000 7f2305151640 1 --2- 172.21.15.104:0/1861640982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f230009a150 0x7f23000cc4a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f23000cf2b0 tx=0x7f22f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fa99bc991f3e7a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:39.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.907+0000 7f2304950640 1 -- 172.21.15.104:0/1861640982 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0037070 con 0x7f230009a150 2024-05-08T04:21:39.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.907+0000 7f2304950640 1 -- 172.21.15.104:0/1861640982 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f0032440 con 0x7f230009a150 2024-05-08T04:21:39.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.907+0000 7f2304950640 1 -- 172.21.15.104:0/1861640982 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0032810 con 0x7f230009a150 2024-05-08T04:21:39.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.907+0000 7f2307bb6640 1 -- 172.21.15.104:0/1861640982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f230009a150 msgr2=0x7f23000cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.907+0000 7f2307bb6640 1 --2- 172.21.15.104:0/1861640982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f230009a150 0x7f23000cc4a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f23000cf2b0 tx=0x7f22f002a1a0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.907+0000 7f2307bb6640 1 -- 172.21.15.104:0/1861640982 shutdown_connections 2024-05-08T04:21:39.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.907+0000 7f2307bb6640 1 --2- 172.21.15.104:0/1861640982 >> v2:172.21.15.183:3300/0 conn(0x7f23000cf600 0x7f23000b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.907+0000 7f2307bb6640 1 --2- 172.21.15.104:0/1861640982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f230009a150 0x7f23000cc4a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.907+0000 7f2307bb6640 1 -- 172.21.15.104:0/1861640982 >> 172.21.15.104:0/1861640982 conn(0x7f23000b3310 msgr2=0x7f23000b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:39.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.908+0000 7f2307bb6640 1 -- 172.21.15.104:0/1861640982 shutdown_connections 2024-05-08T04:21:39.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.908+0000 7f2307bb6640 1 -- 172.21.15.104:0/1861640982 wait complete. 2024-05-08T04:21:39.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.909+0000 7f2307bb6640 1 Processor -- start 2024-05-08T04:21:39.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.909+0000 7f2307bb6640 1 -- start start 2024-05-08T04:21:39.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.909+0000 7f2307bb6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f230009a150 0x7f230009a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.909+0000 7f2307bb6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23000cd370 0x7f2300150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.909+0000 7f2307bb6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23000cf600 0x7f2300150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.909+0000 7f2307bb6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000b2a30 con 0x7f23000cd370 2024-05-08T04:21:39.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.909+0000 7f2307bb6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000cd750 con 0x7f23000cf600 2024-05-08T04:21:39.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.909+0000 7f2307bb6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23000b2bb0 con 0x7f230009a150 2024-05-08T04:21:39.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.909+0000 7f2305151640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23000cd370 0x7f2300150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f2305151640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23000cd370 0x7f2300150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54102/0 (socket says 172.21.15.104:54102) 2024-05-08T04:21:39.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f2305151640 1 -- 172.21.15.104:0/3182476547 learned_addr learned my addr 172.21.15.104:0/3182476547 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:39.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f2306153640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23000cf600 0x7f2300150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f2305952640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f230009a150 0x7f230009a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f2305151640 1 -- 172.21.15.104:0/3182476547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f230009a150 msgr2=0x7f230009a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f2305151640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f230009a150 0x7f230009a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f2305151640 1 -- 172.21.15.104:0/3182476547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23000cf600 msgr2=0x7f2300150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:39.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f2305151640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23000cf600 0x7f2300150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:39.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f2305151640 1 -- 172.21.15.104:0/3182476547 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23000c8eb0 con 0x7f23000cd370 2024-05-08T04:21:39.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f2305952640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f230009a150 0x7f230009a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:39.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f2305151640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23000cd370 0x7f2300150910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f22f0000c00 tx=0x7f22f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:39.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f22f67fc640 1 -- 172.21.15.104:0/3182476547 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0041070 con 0x7f23000cd370 2024-05-08T04:21:39.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f22f67fc640 1 -- 172.21.15.104:0/3182476547 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f003c870 con 0x7f23000cd370 2024-05-08T04:21:39.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f2307bb6640 1 -- 172.21.15.104:0/3182476547 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23000b4540 con 0x7f23000cd370 2024-05-08T04:21:39.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f22f67fc640 1 -- 172.21.15.104:0/3182476547 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0037040 con 0x7f23000cd370 2024-05-08T04:21:39.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.910+0000 7f2307bb6640 1 -- 172.21.15.104:0/3182476547 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23000b4b00 con 0x7f23000cd370 2024-05-08T04:21:39.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.911+0000 7f2307bb6640 1 -- 172.21.15.104:0/3182476547 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2300075010 con 0x7f23000cd370 2024-05-08T04:21:39.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.912+0000 7f22f67fc640 1 -- 172.21.15.104:0/3182476547 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f22f0044070 con 0x7f23000cd370 2024-05-08T04:21:39.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.912+0000 7f22f67fc640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f22e406b4d0 0x7f22e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:39.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.912+0000 7f2305952640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f22e406b4d0 0x7f22e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:39.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.912+0000 7f22f67fc640 1 -- 172.21.15.104:0/3182476547 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22f00aad50 con 0x7f23000cd370 2024-05-08T04:21:39.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.913+0000 7f2305952640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f22e406b4d0 0x7f22e406d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f22fc006fd0 tx=0x7f22fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:39.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:39.916+0000 7f22f67fc640 1 -- 172.21.15.104:0/3182476547 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f22f00ae030 con 0x7f23000cd370 2024-05-08T04:21:40.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.087+0000 7f2307bb6640 1 -- 172.21.15.104:0/3182476547 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2300074610 con 0x7f23000cd370 2024-05-08T04:21:40.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.087+0000 7f22f67fc640 1 -- 172.21.15.104:0/3182476547 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f23000c8eb0 con 0x7f23000cd370 2024-05-08T04:21:40.088 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:40.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.089+0000 7f2307bb6640 1 -- 172.21.15.104:0/3182476547 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f22e406b4d0 msgr2=0x7f22e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:40.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.089+0000 7f2307bb6640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f22e406b4d0 0x7f22e406d990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f22fc006fd0 tx=0x7f22fc008040 comp rx=0 tx=0).stop 2024-05-08T04:21:40.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.089+0000 7f2307bb6640 1 -- 172.21.15.104:0/3182476547 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23000cd370 msgr2=0x7f2300150910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:40.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.089+0000 7f2307bb6640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23000cd370 0x7f2300150910 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f22f0000c00 tx=0x7f22f00046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.089+0000 7f2307bb6640 1 -- 172.21.15.104:0/3182476547 shutdown_connections 2024-05-08T04:21:40.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.089+0000 7f2307bb6640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f22e406b4d0 0x7f22e406d990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.089+0000 7f2307bb6640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23000cf600 0x7f2300150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.089+0000 7f2307bb6640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23000cd370 0x7f2300150910 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.089+0000 7f2307bb6640 1 --2- 172.21.15.104:0/3182476547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f230009a150 0x7f230009a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.089+0000 7f2307bb6640 1 -- 172.21.15.104:0/3182476547 >> 172.21.15.104:0/3182476547 conn(0x7f23000b3310 msgr2=0x7f2300070640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:40.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.089+0000 7f2307bb6640 1 -- 172.21.15.104:0/3182476547 shutdown_connections 2024-05-08T04:21:40.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.089+0000 7f2307bb6640 1 -- 172.21.15.104:0/3182476547 wait complete. 2024-05-08T04:21:40.101 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-05-08T04:21:40.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.199+0000 7efce689a640 1 Processor -- start 2024-05-08T04:21:40.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.199+0000 7efce689a640 1 -- start start 2024-05-08T04:21:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.200+0000 7efce689a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efce015b7d0 0x7efce015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.200+0000 7efce689a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce015ed40 con 0x7efce00b3d50 2024-05-08T04:21:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.200+0000 7efce689a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce006d6d0 con 0x7efce015e6a0 2024-05-08T04:21:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.200+0000 7efce689a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce006d9b0 con 0x7efce015b7d0 2024-05-08T04:21:40.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.200+0000 7efce4e37640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7efce00b3d50 0x7efce006e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43186/0 (socket says 172.21.15.104:43186) 2024-05-08T04:21:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.200+0000 7efce4e37640 1 -- 172.21.15.104:0/2748634405 learned_addr learned my addr 172.21.15.104:0/2748634405 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdffff640 1 --2- 172.21.15.104:0/2748634405 >> v2:172.21.15.183:3300/0 conn(0x7efce015b7d0 0x7efce015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805887303 0 0) 0x7efce015ed40 con 0x7efce00b3d50 2024-05-08T04:21:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efccc003520 con 0x7efce00b3d50 2024-05-08T04:21:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3352667018 0 0) 0x7efccc003520 con 0x7efce00b3d50 2024-05-08T04:21:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 >> v2:172.21.15.183:3300/0 conn(0x7efce015b7d0 msgr2=0x7efce015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 --2- 172.21.15.104:0/2748634405 >> v2:172.21.15.183:3300/0 conn(0x7efce015b7d0 0x7efce015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 >> v1:172.21.15.183:6789/0 conn(0x7efce015e6a0 legacy=0x7efce00b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce006dc90 con 0x7efce00b3d50 2024-05-08T04:21:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7efcd80019f0 con 0x7efce00b3d50 2024-05-08T04:21:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 >> v1:172.21.15.104:6789/0 conn(0x7efce00b3d50 legacy=0x7efce006e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 --2- 172.21.15.104:0/2748634405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efccc0039b0 0x7efccc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:40.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 --2- 172.21.15.104:0/2748634405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efccc004800 0x7efccc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 --2- 172.21.15.104:0/2748634405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efccc0051c0 0x7efccc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce006d9b0 con 0x7efccc0039b0 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc00c060 con 0x7efccc0051c0 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc00c260 con 0x7efccc004800 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdffff640 1 --2- 172.21.15.104:0/2748634405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efccc0039b0 0x7efccc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efce4e37640 1 --2- 172.21.15.104:0/2748634405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efccc0051c0 0x7efccc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcd7fff640 1 --2- 172.21.15.104:0/2748634405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efccc004800 0x7efccc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdffff640 1 -- 172.21.15.104:0/2748634405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efccc004800 msgr2=0x7efccc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdffff640 1 --2- 172.21.15.104:0/2748634405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efccc004800 0x7efccc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdffff640 1 -- 172.21.15.104:0/2748634405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efccc0051c0 msgr2=0x7efccc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdffff640 1 --2- 172.21.15.104:0/2748634405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efccc0051c0 0x7efccc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efce4e37640 1 -- 172.21.15.104:0/2748634405 reap_dead start 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcdffff640 1 -- 172.21.15.104:0/2748634405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc003520 con 0x7efccc0039b0 2024-05-08T04:21:40.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.201+0000 7efcd7fff640 1 --2- 172.21.15.104:0/2748634405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efccc004800 0x7efccc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:40.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.202+0000 7efcdffff640 1 --2- 172.21.15.104:0/2748634405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efccc0039b0 0x7efccc003dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009ac0 tx=0x7efccc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597dd8d4c4570ef7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:40.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.202+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0036070 con 0x7efccc0039b0 2024-05-08T04:21:40.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.202+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd0031400 con 0x7efccc0039b0 2024-05-08T04:21:40.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.202+0000 7efcdf7fe640 1 -- 172.21.15.104:0/2748634405 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0009690 con 0x7efccc0039b0 2024-05-08T04:21:40.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.203+0000 7efce689a640 1 -- 172.21.15.104:0/2748634405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efccc0039b0 msgr2=0x7efccc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:40.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.203+0000 7efce689a640 1 --2- 172.21.15.104:0/2748634405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efccc0039b0 0x7efccc003dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efcd0009ac0 tx=0x7efccc005830 comp rx=0 tx=0).stop 2024-05-08T04:21:40.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.203+0000 7efce689a640 1 -- 172.21.15.104:0/2748634405 shutdown_connections 2024-05-08T04:21:40.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.203+0000 7efce689a640 1 --2- 172.21.15.104:0/2748634405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efccc0039b0 0x7efccc003dd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.203+0000 7efce689a640 1 -- 172.21.15.104:0/2748634405 >> 172.21.15.104:0/2748634405 conn(0x7efce00cfa60 msgr2=0x7efce00cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:40.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.203+0000 7efce689a640 1 -- 172.21.15.104:0/2748634405 shutdown_connections 2024-05-08T04:21:40.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.203+0000 7efce689a640 1 -- 172.21.15.104:0/2748634405 wait complete. 2024-05-08T04:21:40.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.204+0000 7efce689a640 1 Processor -- start 2024-05-08T04:21:40.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.204+0000 7efce689a640 1 -- start start 2024-05-08T04:21:40.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce689a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efccc0039b0 0x7efce0150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:40.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce689a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce01531d0 0x7efce0151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:40.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce689a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efce0155700 0x7efce0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:40.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce689a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce015e160 con 0x7efce0155700 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce689a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce015f020 con 0x7efccc0039b0 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce689a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce015e2e0 con 0x7efce01531d0 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce4e37640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efce0155700 0x7efce0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce4e37640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efce0155700 0x7efce0155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54120/0 (socket says 172.21.15.104:54120) 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce4e37640 1 -- 172.21.15.104:0/1974745395 learned_addr learned my addr 172.21.15.104:0/1974745395 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efcd7fff640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce01531d0 0x7efce0151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efcdffff640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efccc0039b0 0x7efce0150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce4e37640 1 -- 172.21.15.104:0/1974745395 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce01531d0 msgr2=0x7efce0151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce4e37640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce01531d0 0x7efce0151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce4e37640 1 -- 172.21.15.104:0/1974745395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efccc0039b0 msgr2=0x7efce0150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce4e37640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efccc0039b0 0x7efce0150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce4e37640 1 -- 172.21.15.104:0/1974745395 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce0154da0 con 0x7efce0155700 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efcdffff640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efccc0039b0 0x7efce0150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce4e37640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efce0155700 0x7efce0155b80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efce00b4f40 tx=0x7efcd8007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:40.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efcdd7fa640 1 -- 172.21.15.104:0/1974745395 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd800aba0 con 0x7efce0155700 2024-05-08T04:21:40.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efcdd7fa640 1 -- 172.21.15.104:0/1974745395 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd8018070 con 0x7efce0155700 2024-05-08T04:21:40.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce689a640 1 -- 172.21.15.104:0/1974745395 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce0155080 con 0x7efce0155700 2024-05-08T04:21:40.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efcdd7fa640 1 -- 172.21.15.104:0/1974745395 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd80133f0 con 0x7efce0155700 2024-05-08T04:21:40.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.205+0000 7efce689a640 1 -- 172.21.15.104:0/1974745395 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce0153930 con 0x7efce0155700 2024-05-08T04:21:40.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.206+0000 7efce689a640 1 -- 172.21.15.104:0/1974745395 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce0075010 con 0x7efce0155700 2024-05-08T04:21:40.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.207+0000 7efcdd7fa640 1 -- 172.21.15.104:0/1974745395 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efcd8013590 con 0x7efce0155700 2024-05-08T04:21:40.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.207+0000 7efcdd7fa640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efcc006b500 0x7efcc006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:40.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.207+0000 7efcdd7fa640 1 -- 172.21.15.104:0/1974745395 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcd808a800 con 0x7efce0155700 2024-05-08T04:21:40.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.207+0000 7efcdffff640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efcc006b500 0x7efcc006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:40.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.208+0000 7efcdffff640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efcc006b500 0x7efcc006d9c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efcd0033000 tx=0x7efcd0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:40.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.211+0000 7efcdd7fa640 1 -- 172.21.15.104:0/1974745395 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efcd8059680 con 0x7efce0155700 2024-05-08T04:21:40.421 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:21:40.424 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:21:40.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.448+0000 7efce689a640 1 -- 172.21.15.104:0/1974745395 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7efce00af4e0 con 0x7efce0155700 2024-05-08T04:21:40.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.921+0000 7efcdd7fa640 1 -- 172.21.15.104:0/1974745395 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7efcd8058f80 con 0x7efce0155700 2024-05-08T04:21:40.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.924+0000 7efce689a640 1 -- 172.21.15.104:0/1974745395 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efcc006b500 msgr2=0x7efcc006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:40.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.924+0000 7efce689a640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efcc006b500 0x7efcc006d9c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efcd0033000 tx=0x7efcd0008030 comp rx=0 tx=0).stop 2024-05-08T04:21:40.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.924+0000 7efce689a640 1 -- 172.21.15.104:0/1974745395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efce0155700 msgr2=0x7efce0155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:40.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.924+0000 7efce689a640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efce0155700 0x7efce0155b80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efce00b4f40 tx=0x7efcd8007bd0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.924+0000 7efce689a640 1 -- 172.21.15.104:0/1974745395 shutdown_connections 2024-05-08T04:21:40.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.924+0000 7efce689a640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efcc006b500 0x7efcc006d9c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.924+0000 7efce689a640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efce0155700 0x7efce0155b80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.924+0000 7efce689a640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce01531d0 0x7efce0151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.924+0000 7efce689a640 1 --2- 172.21.15.104:0/1974745395 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efccc0039b0 0x7efce0150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:40.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.924+0000 7efce689a640 1 -- 172.21.15.104:0/1974745395 >> 172.21.15.104:0/1974745395 conn(0x7efce00cfa60 msgr2=0x7efce015c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:40.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.924+0000 7efce689a640 1 -- 172.21.15.104:0/1974745395 shutdown_connections 2024-05-08T04:21:40.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:40.924+0000 7efce689a640 1 -- 172.21.15.104:0/1974745395 wait complete. 2024-05-08T04:21:40.939 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-08T04:21:41.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.040+0000 7f870c66b640 1 Processor -- start 2024-05-08T04:21:41.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.040+0000 7f870c66b640 1 -- start start 2024-05-08T04:21:41.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.041+0000 7f870c66b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870406ea40 0x7f87040b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.041+0000 7f870c66b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f87040b3ff0 0x7f87040b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.041+0000 7f870c66b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87040b49e0 con 0x7f87040ceee0 2024-05-08T04:21:41.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.041+0000 7f870c66b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870415f390 con 0x7f87040b3ff0 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.041+0000 7f870c66b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870415e780 con 0x7f870406ea40 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f870a407640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f87040ceee0 0x7f870406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43202/0 (socket says 172.21.15.104:43202) 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f870a407640 1 -- 172.21.15.104:0/2517028042 learned_addr learned my addr 172.21.15.104:0/2517028042 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709c06640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870406ea40 0x7f87040b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189109007 0 0) 0x7f87040b49e0 con 0x7f87040ceee0 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f870ac08640 1 --2- 172.21.15.104:0/2517028042 >> v2:172.21.15.183:3300/0 conn(0x7f87040b3ff0 0x7f87040b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86f0005730 con 0x7f87040ceee0 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1403134682 0 0) 0x7f86f0005730 con 0x7f87040ceee0 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870406ea40 msgr2=0x7f87040b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870406ea40 0x7f87040b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 >> v2:172.21.15.183:3300/0 conn(0x7f87040b3ff0 msgr2=0x7f87040b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 --2- 172.21.15.104:0/2517028042 >> v2:172.21.15.183:3300/0 conn(0x7f87040b3ff0 0x7f87040b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870415ea60 con 0x7f87040ceee0 2024-05-08T04:21:41.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f86fc0019f0 con 0x7f87040ceee0 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 >> v1:172.21.15.104:6789/0 conn(0x7f87040ceee0 legacy=0x7f870406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86f0005bc0 0x7f86f0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870406ea40 0x7f86f0006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0006f50 0x7f86f00073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870415f390 con 0x7f86f0005bc0 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870415e780 con 0x7f86f0006f50 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f000dbd0 con 0x7f870406ea40 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f870a407640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86f0005bc0 0x7f86f0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f8709c06640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870406ea40 0x7f86f0006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.042+0000 7f870ac08640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0006f50 0x7f86f00073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.043+0000 7f870a407640 1 -- 172.21.15.104:0/2517028042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870406ea40 msgr2=0x7f86f0006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.043+0000 7f870a407640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870406ea40 0x7f86f0006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.043+0000 7f870a407640 1 -- 172.21.15.104:0/2517028042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0006f50 msgr2=0x7f86f00073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:41.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.043+0000 7f870a407640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0006f50 0x7f86f00073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.043+0000 7f870a407640 1 -- 172.21.15.104:0/2517028042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f0005730 con 0x7f86f0005bc0 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.043+0000 7f8709c06640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870406ea40 0x7f86f0006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.043+0000 7f870ac08640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0006f50 0x7f86f00073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.043+0000 7f870a407640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86f0005bc0 0x7f86f0005fe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00a890 tx=0x7f86f0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724f39c21576b593 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.043+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc00a480 con 0x7f86f0005bc0 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.043+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc02f070 con 0x7f86f0005bc0 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.043+0000 7f8709405640 1 -- 172.21.15.104:0/2517028042 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc02bce0 con 0x7f86f0005bc0 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.044+0000 7f870c66b640 1 -- 172.21.15.104:0/2517028042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86f0005bc0 msgr2=0x7f86f0005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.044+0000 7f870c66b640 1 --2- 172.21.15.104:0/2517028042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f86f0005bc0 0x7f86f0005fe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00a890 tx=0x7f86f0007a40 comp rx=0 tx=0).stop 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.044+0000 7f870ac08640 1 -- 172.21.15.104:0/2517028042 reap_dead start 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.044+0000 7f870c66b640 1 -- 172.21.15.104:0/2517028042 shutdown_connections 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.044+0000 7f870c66b640 1 -- 172.21.15.104:0/2517028042 >> 172.21.15.104:0/2517028042 conn(0x7f87040b13f0 msgr2=0x7f87040b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.044+0000 7f870c66b640 1 -- 172.21.15.104:0/2517028042 shutdown_connections 2024-05-08T04:21:41.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.044+0000 7f870c66b640 1 -- 172.21.15.104:0/2517028042 wait complete. 2024-05-08T04:21:41.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.045+0000 7f870c66b640 1 Processor -- start 2024-05-08T04:21:41.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.045+0000 7f870c66b640 1 -- start start 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870c66b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0005bc0 0x7f87041f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870c66b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870414d1b0 0x7f87040cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870c66b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87040711c0 0x7f8704071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870c66b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87040cf2c0 con 0x7f87040711c0 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870c66b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870415f020 con 0x7f86f0005bc0 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870c66b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87040cf440 con 0x7f870414d1b0 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870ac08640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87040711c0 0x7f8704071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870ac08640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87040711c0 0x7f8704071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54124/0 (socket says 172.21.15.104:54124) 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870ac08640 1 -- 172.21.15.104:0/2968955542 learned_addr learned my addr 172.21.15.104:0/2968955542 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870a407640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0005bc0 0x7f87041f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f8709c06640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870414d1b0 0x7f87040cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870ac08640 1 -- 172.21.15.104:0/2968955542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870414d1b0 msgr2=0x7f87040cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870ac08640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870414d1b0 0x7f87040cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870ac08640 1 -- 172.21.15.104:0/2968955542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0005bc0 msgr2=0x7f87041f6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870ac08640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0005bc0 0x7f87041f6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870ac08640 1 -- 172.21.15.104:0/2968955542 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870414d630 con 0x7f87040711c0 2024-05-08T04:21:41.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.046+0000 7f870a407640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0005bc0 0x7f87041f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:41.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.047+0000 7f870ac08640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87040711c0 0x7f8704071640 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f870406d080 tx=0x7f8700011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:41.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.047+0000 7f86faffd640 1 -- 172.21.15.104:0/2968955542 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700004440 con 0x7f87040711c0 2024-05-08T04:21:41.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.047+0000 7f86faffd640 1 -- 172.21.15.104:0/2968955542 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870001b070 con 0x7f87040711c0 2024-05-08T04:21:41.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.047+0000 7f86faffd640 1 -- 172.21.15.104:0/2968955542 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700003850 con 0x7f87040711c0 2024-05-08T04:21:41.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.047+0000 7f870c66b640 1 -- 172.21.15.104:0/2968955542 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87041f7270 con 0x7f87040711c0 2024-05-08T04:21:41.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.047+0000 7f870c66b640 1 -- 172.21.15.104:0/2968955542 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87041f7830 con 0x7f87040711c0 2024-05-08T04:21:41.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.048+0000 7f870c66b640 1 -- 172.21.15.104:0/2968955542 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8704075010 con 0x7f87040711c0 2024-05-08T04:21:41.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.048+0000 7f86faffd640 1 -- 172.21.15.104:0/2968955542 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f87000039f0 con 0x7f87040711c0 2024-05-08T04:21:41.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.049+0000 7f86faffd640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f86e806b4d0 0x7f86e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.049+0000 7f86faffd640 1 -- 172.21.15.104:0/2968955542 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8700089d70 con 0x7f87040711c0 2024-05-08T04:21:41.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.049+0000 7f870a407640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f86e806b4d0 0x7f86e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.049+0000 7f870a407640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f86e806b4d0 0x7f86e806d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f86fc033000 tx=0x7f86fc009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:41.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.053+0000 7f86faffd640 1 -- 172.21.15.104:0/2968955542 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8700024020 con 0x7f87040711c0 2024-05-08T04:21:41.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.225+0000 7f870c66b640 1 -- 172.21.15.104:0/2968955542 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f870406f3f0 con 0x7f87040711c0 2024-05-08T04:21:41.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.228+0000 7f86faffd640 1 -- 172.21.15.104:0/2968955542 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f87000122d0 con 0x7f87040711c0 2024-05-08T04:21:41.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.230+0000 7f870c66b640 1 -- 172.21.15.104:0/2968955542 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f86e806b4d0 msgr2=0x7f86e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.230+0000 7f870c66b640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f86e806b4d0 0x7f86e806d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f86fc033000 tx=0x7f86fc009030 comp rx=0 tx=0).stop 2024-05-08T04:21:41.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.230+0000 7f870c66b640 1 -- 172.21.15.104:0/2968955542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87040711c0 msgr2=0x7f8704071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.230+0000 7f870c66b640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87040711c0 0x7f8704071640 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f870406d080 tx=0x7f8700011920 comp rx=0 tx=0).stop 2024-05-08T04:21:41.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.230+0000 7f870c66b640 1 -- 172.21.15.104:0/2968955542 shutdown_connections 2024-05-08T04:21:41.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.230+0000 7f870c66b640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f86e806b4d0 0x7f86e806d990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.230+0000 7f870c66b640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87040711c0 0x7f8704071640 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.230+0000 7f870c66b640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f870414d1b0 0x7f87040cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.230+0000 7f870c66b640 1 --2- 172.21.15.104:0/2968955542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f0005bc0 0x7f87041f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.230+0000 7f870c66b640 1 -- 172.21.15.104:0/2968955542 >> 172.21.15.104:0/2968955542 conn(0x7f87040b13f0 msgr2=0x7f87040b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:41.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.230+0000 7f870c66b640 1 -- 172.21.15.104:0/2968955542 shutdown_connections 2024-05-08T04:21:41.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.230+0000 7f870c66b640 1 -- 172.21.15.104:0/2968955542 wait complete. 2024-05-08T04:21:41.244 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-08T04:21:41.244 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T04:21:41.282 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T04:21:41.441 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-08T04:21:41.441 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:21:41.441 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:21:41.458 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:21:41.458 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:21:41.514 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:41.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.651+0000 7ff5fe44d640 1 Processor -- start 2024-05-08T04:21:41.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.651+0000 7ff5fe44d640 1 -- start start 2024-05-08T04:21:41.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.652+0000 7ff5fe44d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8099a40 0x7ff5f8099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.652+0000 7ff5fe44d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff5f815d490 0x7ff5f815d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.652+0000 7ff5fe44d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f80cd940 con 0x7ff5f80b2b80 2024-05-08T04:21:41.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.652+0000 7ff5fe44d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f809a3e0 con 0x7ff5f815d490 2024-05-08T04:21:41.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.652+0000 7ff5fe44d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80cc8a0 con 0x7ff5f8099a40 2024-05-08T04:21:41.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.652+0000 7ff5f77fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8099a40 0x7ff5f8099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.652+0000 7ff5fc9ea640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff5f815d490 0x7ff5f815d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.652+0000 7ff5f7fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7ff5f80b2b80 0x7ff5f809a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:59212/0 (socket says 172.21.15.104:59212) 2024-05-08T04:21:41.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.652+0000 7ff5f7fff640 1 -- 172.21.15.104:0/3378837629 learned_addr learned my addr 172.21.15.104:0/3378837629 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:41.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.652+0000 7ff5f77fe640 1 -- 172.21.15.104:0/3378837629 >> v2:172.21.15.183:3300/0 conn(0x7ff5f815d490 msgr2=0x7ff5f815d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:41.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.652+0000 7ff5f77fe640 1 --2- 172.21.15.104:0/3378837629 >> v2:172.21.15.183:3300/0 conn(0x7ff5f815d490 0x7ff5f815d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.652+0000 7ff5f77fe640 1 -- 172.21.15.104:0/3378837629 >> v1:172.21.15.183:6789/0 conn(0x7ff5f80b2b80 legacy=0x7ff5f809a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.653+0000 7ff5f77fe640 1 -- 172.21.15.104:0/3378837629 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f80ccb80 con 0x7ff5f8099a40 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.653+0000 7ff5fc9ea640 1 --2- 172.21.15.104:0/3378837629 >> v2:172.21.15.183:3300/0 conn(0x7ff5f815d490 0x7ff5f815d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.653+0000 7ff5f77fe640 1 --2- 172.21.15.104:0/3378837629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8099a40 0x7ff5f8099ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0097a0 tx=0x7ff5ec02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c046dfbd58fdb959 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.653+0000 7ff5f6ffd640 1 -- 172.21.15.104:0/3378837629 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec037070 con 0x7ff5f8099a40 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.653+0000 7ff5f6ffd640 1 -- 172.21.15.104:0/3378837629 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec032440 con 0x7ff5f8099a40 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.653+0000 7ff5f6ffd640 1 -- 172.21.15.104:0/3378837629 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec032810 con 0x7ff5f8099a40 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.654+0000 7ff5fe44d640 1 -- 172.21.15.104:0/3378837629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8099a40 msgr2=0x7ff5f8099ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.654+0000 7ff5fe44d640 1 --2- 172.21.15.104:0/3378837629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8099a40 0x7ff5f8099ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0097a0 tx=0x7ff5ec02a210 comp rx=0 tx=0).stop 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.654+0000 7ff5fe44d640 1 -- 172.21.15.104:0/3378837629 shutdown_connections 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.654+0000 7ff5fe44d640 1 --2- 172.21.15.104:0/3378837629 >> v2:172.21.15.183:3300/0 conn(0x7ff5f815d490 0x7ff5f815d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.654+0000 7ff5fe44d640 1 --2- 172.21.15.104:0/3378837629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8099a40 0x7ff5f8099ea0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.654+0000 7ff5fe44d640 1 -- 172.21.15.104:0/3378837629 >> 172.21.15.104:0/3378837629 conn(0x7ff5f80b3310 msgr2=0x7ff5f80b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.654+0000 7ff5fe44d640 1 -- 172.21.15.104:0/3378837629 shutdown_connections 2024-05-08T04:21:41.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.654+0000 7ff5fe44d640 1 -- 172.21.15.104:0/3378837629 wait complete. 2024-05-08T04:21:41.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.655+0000 7ff5fe44d640 1 Processor -- start 2024-05-08T04:21:41.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.655+0000 7ff5fe44d640 1 -- start start 2024-05-08T04:21:41.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5fe44d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5f8099a40 0x7ff5f81f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5fe44d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f80b2b80 0x7ff5f80c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5fe44d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f815d490 0x7ff5f8070180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5fe44d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80cf830 con 0x7ff5f8099a40 2024-05-08T04:21:41.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5fe44d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80cd140 con 0x7ff5f815d490 2024-05-08T04:21:41.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5fe44d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80cc550 con 0x7ff5f80b2b80 2024-05-08T04:21:41.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5f7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5f8099a40 0x7ff5f81f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5f7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5f8099a40 0x7ff5f81f41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54140/0 (socket says 172.21.15.104:54140) 2024-05-08T04:21:41.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5f7fff640 1 -- 172.21.15.104:0/4233049576 learned_addr learned my addr 172.21.15.104:0/4233049576 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:41.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5f7fff640 1 -- 172.21.15.104:0/4233049576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f80b2b80 msgr2=0x7ff5f80c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5f7fff640 1 --2- 172.21.15.104:0/4233049576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f80b2b80 0x7ff5f80c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5f7fff640 1 -- 172.21.15.104:0/4233049576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f815d490 msgr2=0x7ff5f8070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5fc9ea640 1 --2- 172.21.15.104:0/4233049576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f815d490 0x7ff5f8070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5f7fff640 1 --2- 172.21.15.104:0/4233049576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f815d490 0x7ff5f8070180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.656+0000 7ff5f7fff640 1 -- 172.21.15.104:0/4233049576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f81f3710 con 0x7ff5f8099a40 2024-05-08T04:21:41.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.657+0000 7ff5f7fff640 1 --2- 172.21.15.104:0/4233049576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5f8099a40 0x7ff5f81f41b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c400 tx=0x7ff5e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:41.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.657+0000 7ff5f4ff9640 1 -- 172.21.15.104:0/4233049576 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8017070 con 0x7ff5f8099a40 2024-05-08T04:21:41.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.657+0000 7ff5f4ff9640 1 -- 172.21.15.104:0/4233049576 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e8005ce0 con 0x7ff5f8099a40 2024-05-08T04:21:41.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.657+0000 7ff5fe44d640 1 -- 172.21.15.104:0/4233049576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f80c5c10 con 0x7ff5f8099a40 2024-05-08T04:21:41.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.657+0000 7ff5f4ff9640 1 -- 172.21.15.104:0/4233049576 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80072f0 con 0x7ff5f8099a40 2024-05-08T04:21:41.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.657+0000 7ff5fe44d640 1 -- 172.21.15.104:0/4233049576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f81f3c90 con 0x7ff5f8099a40 2024-05-08T04:21:41.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.658+0000 7ff5fe44d640 1 -- 172.21.15.104:0/4233049576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f8075010 con 0x7ff5f8099a40 2024-05-08T04:21:41.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.658+0000 7ff5f4ff9640 1 -- 172.21.15.104:0/4233049576 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff5e801a070 con 0x7ff5f8099a40 2024-05-08T04:21:41.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.659+0000 7ff5f4ff9640 1 --2- 172.21.15.104:0/4233049576 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff5e406b4d0 0x7ff5e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.659+0000 7ff5f4ff9640 1 -- 172.21.15.104:0/4233049576 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5e80895a0 con 0x7ff5f8099a40 2024-05-08T04:21:41.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.659+0000 7ff5f77fe640 1 --2- 172.21.15.104:0/4233049576 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff5e406b4d0 0x7ff5e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.659+0000 7ff5f77fe640 1 --2- 172.21.15.104:0/4233049576 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff5e406b4d0 0x7ff5e406d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec034000 tx=0x7ff5ec02c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:41.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.663+0000 7ff5f4ff9640 1 -- 172.21.15.104:0/4233049576 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff5e80584b0 con 0x7ff5f8099a40 2024-05-08T04:21:41.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.839+0000 7ff5fe44d640 1 -- 172.21.15.104:0/4233049576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5f81f3ed0 con 0x7ff5f8099a40 2024-05-08T04:21:41.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.840+0000 7ff5f4ff9640 1 -- 172.21.15.104:0/4233049576 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7ff5e805ce20 con 0x7ff5f8099a40 2024-05-08T04:21:41.843 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:41.843 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:41.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.842+0000 7ff5fe44d640 1 -- 172.21.15.104:0/4233049576 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff5e406b4d0 msgr2=0x7ff5e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.842+0000 7ff5fe44d640 1 --2- 172.21.15.104:0/4233049576 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff5e406b4d0 0x7ff5e406d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec034000 tx=0x7ff5ec02c000 comp rx=0 tx=0).stop 2024-05-08T04:21:41.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.842+0000 7ff5fe44d640 1 -- 172.21.15.104:0/4233049576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5f8099a40 msgr2=0x7ff5f81f41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.842+0000 7ff5fe44d640 1 --2- 172.21.15.104:0/4233049576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5f8099a40 0x7ff5f81f41b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c400 tx=0x7ff5e800c8c0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.842+0000 7ff5fe44d640 1 -- 172.21.15.104:0/4233049576 shutdown_connections 2024-05-08T04:21:41.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.842+0000 7ff5fe44d640 1 --2- 172.21.15.104:0/4233049576 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff5e406b4d0 0x7ff5e406d990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.842+0000 7ff5fe44d640 1 --2- 172.21.15.104:0/4233049576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f815d490 0x7ff5f8070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.842+0000 7ff5fe44d640 1 --2- 172.21.15.104:0/4233049576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f80b2b80 0x7ff5f80c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.842+0000 7ff5fe44d640 1 --2- 172.21.15.104:0/4233049576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5f8099a40 0x7ff5f81f41b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.842+0000 7ff5fe44d640 1 -- 172.21.15.104:0/4233049576 >> 172.21.15.104:0/4233049576 conn(0x7ff5f80b3310 msgr2=0x7ff5f80b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:41.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.842+0000 7ff5fe44d640 1 -- 172.21.15.104:0/4233049576 shutdown_connections 2024-05-08T04:21:41.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.842+0000 7ff5fe44d640 1 -- 172.21.15.104:0/4233049576 wait complete. 2024-05-08T04:21:41.859 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:41.859 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:41.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.959+0000 7f6e9f25a640 1 Processor -- start 2024-05-08T04:21:41.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.960+0000 7f6e9f25a640 1 -- start start 2024-05-08T04:21:41.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.960+0000 7f6e9f25a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e9815edf0 0x7f6e980b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.960+0000 7f6e9f25a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6e98157ac0 0x7f6e98157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.960+0000 7f6e9f25a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980d15c0 con 0x7f6e98070c70 2024-05-08T04:21:41.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.960+0000 7f6e9f25a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9806bc70 con 0x7f6e98157ac0 2024-05-08T04:21:41.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.960+0000 7f6e9f25a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9815f550 con 0x7f6e9815edf0 2024-05-08T04:21:41.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.960+0000 7f6e9cff6640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6e98070c70 0x7f6e98071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43216/0 (socket says 172.21.15.104:43216) 2024-05-08T04:21:41.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.960+0000 7f6e9cff6640 1 -- 172.21.15.104:0/2704028502 learned_addr learned my addr 172.21.15.104:0/2704028502 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:41.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e97fff640 1 --2- 172.21.15.104:0/2704028502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e9815edf0 0x7f6e980b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e9d7f7640 1 --2- 172.21.15.104:0/2704028502 >> v2:172.21.15.183:3300/0 conn(0x7f6e98157ac0 0x7f6e98157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831294641 0 0) 0x7f6e980d15c0 con 0x7f6e98070c70 2024-05-08T04:21:41.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e80003520 con 0x7f6e98070c70 2024-05-08T04:21:41.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 66912391 0 0) 0x7f6e80003520 con 0x7f6e98070c70 2024-05-08T04:21:41.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e9815edf0 msgr2=0x7f6e980b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:41.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 --2- 172.21.15.104:0/2704028502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e9815edf0 0x7f6e980b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 >> v2:172.21.15.183:3300/0 conn(0x7f6e98157ac0 msgr2=0x7f6e98157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 --2- 172.21.15.104:0/2704028502 >> v2:172.21.15.183:3300/0 conn(0x7f6e98157ac0 0x7f6e98157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9815f830 con 0x7f6e98070c70 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f6e88001670 con 0x7f6e98070c70 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 >> v1:172.21.15.104:6789/0 conn(0x7f6e98070c70 legacy=0x7f6e98071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 --2- 172.21.15.104:0/2704028502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e800039b0 0x7f6e80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 --2- 172.21.15.104:0/2704028502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e80004800 0x7f6e80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 --2- 172.21.15.104:0/2704028502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e9815edf0 0x7f6e800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9815f550 con 0x7f6e800039b0 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8000b9c0 con 0x7f6e80004800 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8000bb40 con 0x7f6e9815edf0 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e9cff6640 1 --2- 172.21.15.104:0/2704028502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e800039b0 0x7f6e80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e97fff640 1 --2- 172.21.15.104:0/2704028502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e80004800 0x7f6e80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e9d7f7640 1 --2- 172.21.15.104:0/2704028502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e9815edf0 0x7f6e800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e9cff6640 1 -- 172.21.15.104:0/2704028502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e9815edf0 msgr2=0x7f6e800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e9cff6640 1 --2- 172.21.15.104:0/2704028502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e9815edf0 0x7f6e800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e9cff6640 1 -- 172.21.15.104:0/2704028502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e80004800 msgr2=0x7f6e80004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e9cff6640 1 --2- 172.21.15.104:0/2704028502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e80004800 0x7f6e80004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e9cff6640 1 -- 172.21.15.104:0/2704028502 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e80003520 con 0x7f6e800039b0 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.961+0000 7f6e9d7f7640 1 --2- 172.21.15.104:0/2704028502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e9815edf0 0x7f6e800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.962+0000 7f6e9cff6640 1 --2- 172.21.15.104:0/2704028502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e800039b0 0x7f6e80003dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e88001050 tx=0x7f6e80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322e4080ac611d6a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.962+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8802e070 con 0x7f6e800039b0 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.962+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e88005af0 con 0x7f6e800039b0 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.962+0000 7f6e977fe640 1 -- 172.21.15.104:0/2704028502 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88007d70 con 0x7f6e800039b0 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.963+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2704028502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e800039b0 msgr2=0x7f6e80003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.963+0000 7f6e9f25a640 1 --2- 172.21.15.104:0/2704028502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e800039b0 0x7f6e80003dd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6e88001050 tx=0x7f6e80005830 comp rx=0 tx=0).stop 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.963+0000 7f6e9d7f7640 1 -- 172.21.15.104:0/2704028502 reap_dead start 2024-05-08T04:21:41.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.963+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2704028502 shutdown_connections 2024-05-08T04:21:41.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.963+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2704028502 >> 172.21.15.104:0/2704028502 conn(0x7f6e980b3450 msgr2=0x7f6e980b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:41.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.963+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2704028502 shutdown_connections 2024-05-08T04:21:41.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.963+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2704028502 wait complete. 2024-05-08T04:21:41.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.964+0000 7f6e9f25a640 1 Processor -- start 2024-05-08T04:21:41.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.964+0000 7f6e9f25a640 1 -- start start 2024-05-08T04:21:41.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9f25a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e800039b0 0x7f6e9814f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9f25a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e981587a0 0x7f6e98158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9f25a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e98151340 0x7f6e981517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9f25a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98158490 con 0x7f6e800039b0 2024-05-08T04:21:41.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9f25a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980b5b80 con 0x7f6e98151340 2024-05-08T04:21:41.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9f25a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98159160 con 0x7f6e981587a0 2024-05-08T04:21:41.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9cff6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e800039b0 0x7f6e9814f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9cff6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e800039b0 0x7f6e9814f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54162/0 (socket says 172.21.15.104:54162) 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9cff6640 1 -- 172.21.15.104:0/2553413450 learned_addr learned my addr 172.21.15.104:0/2553413450 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9cff6640 1 -- 172.21.15.104:0/2553413450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e981587a0 msgr2=0x7f6e98158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9cff6640 1 --2- 172.21.15.104:0/2553413450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e981587a0 0x7f6e98158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9cff6640 1 -- 172.21.15.104:0/2553413450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e98151340 msgr2=0x7f6e981517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9cff6640 1 --2- 172.21.15.104:0/2553413450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e98151340 0x7f6e981517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9cff6640 1 -- 172.21.15.104:0/2553413450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e98151020 con 0x7f6e800039b0 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.965+0000 7f6e9cff6640 1 --2- 172.21.15.104:0/2553413450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e800039b0 0x7f6e9814f3e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6e88034040 tx=0x7f6e88000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.966+0000 7f6e957fa640 1 -- 172.21.15.104:0/2553413450 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88042070 con 0x7f6e800039b0 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.966+0000 7f6e957fa640 1 -- 172.21.15.104:0/2553413450 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e88007d50 con 0x7f6e800039b0 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.966+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2553413450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e98159380 con 0x7f6e800039b0 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.966+0000 7f6e957fa640 1 -- 172.21.15.104:0/2553413450 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88001cc0 con 0x7f6e800039b0 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.966+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2553413450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e98159940 con 0x7f6e800039b0 2024-05-08T04:21:41.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.967+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2553413450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e98075010 con 0x7f6e800039b0 2024-05-08T04:21:41.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.967+0000 7f6e957fa640 1 -- 172.21.15.104:0/2553413450 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6e88045070 con 0x7f6e800039b0 2024-05-08T04:21:41.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.967+0000 7f6e957fa640 1 --2- 172.21.15.104:0/2553413450 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6e8406b500 0x7f6e8406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:41.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.967+0000 7f6e957fa640 1 -- 172.21.15.104:0/2553413450 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e880aadb0 con 0x7f6e800039b0 2024-05-08T04:21:41.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.967+0000 7f6e97fff640 1 --2- 172.21.15.104:0/2553413450 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6e8406b500 0x7f6e8406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:41.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.968+0000 7f6e97fff640 1 --2- 172.21.15.104:0/2553413450 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6e8406b500 0x7f6e8406d9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6e9815d6f0 tx=0x7f6e8c009320 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:41.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:41.972+0000 7f6e957fa640 1 -- 172.21.15.104:0/2553413450 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6e8804c030 con 0x7f6e800039b0 2024-05-08T04:21:42.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.140+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2553413450 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e980b10a0 con 0x7f6e800039b0 2024-05-08T04:21:42.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.140+0000 7f6e957fa640 1 -- 172.21.15.104:0/2553413450 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e98151020 con 0x7f6e800039b0 2024-05-08T04:21:42.142 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:42.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.142+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2553413450 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6e8406b500 msgr2=0x7f6e8406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.142+0000 7f6e9f25a640 1 --2- 172.21.15.104:0/2553413450 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6e8406b500 0x7f6e8406d9c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6e9815d6f0 tx=0x7f6e8c009320 comp rx=0 tx=0).stop 2024-05-08T04:21:42.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.142+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2553413450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e800039b0 msgr2=0x7f6e9814f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.142+0000 7f6e9f25a640 1 --2- 172.21.15.104:0/2553413450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e800039b0 0x7f6e9814f3e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6e88034040 tx=0x7f6e88000fe0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.142+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2553413450 shutdown_connections 2024-05-08T04:21:42.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.142+0000 7f6e9f25a640 1 --2- 172.21.15.104:0/2553413450 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6e8406b500 0x7f6e8406d9c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.142+0000 7f6e9f25a640 1 --2- 172.21.15.104:0/2553413450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e98151340 0x7f6e981517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.142+0000 7f6e9f25a640 1 --2- 172.21.15.104:0/2553413450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e981587a0 0x7f6e98158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.142+0000 7f6e9f25a640 1 --2- 172.21.15.104:0/2553413450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e800039b0 0x7f6e9814f3e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.142+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2553413450 >> 172.21.15.104:0/2553413450 conn(0x7f6e980b3450 msgr2=0x7f6e980b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:42.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.142+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2553413450 shutdown_connections 2024-05-08T04:21:42.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.142+0000 7f6e9f25a640 1 -- 172.21.15.104:0/2553413450 wait complete. 2024-05-08T04:21:42.155 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:42.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.255+0000 7fa2e950a640 1 Processor -- start 2024-05-08T04:21:42.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.256+0000 7fa2e950a640 1 -- start start 2024-05-08T04:21:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.256+0000 7fa2e950a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa2e40cdbf0 0x7fa2e41668d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.256+0000 7fa2e950a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e40cc700 con 0x7fa2e40cf360 2024-05-08T04:21:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.256+0000 7fa2e950a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e40d0020 con 0x7fa2e4099a40 2024-05-08T04:21:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.256+0000 7fa2e950a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e415ced0 con 0x7fa2e40cdbf0 2024-05-08T04:21:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e27fc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fa2e40cf360 0x7fa2e40cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43218/0 (socket says 172.21.15.104:43218) 2024-05-08T04:21:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e27fc640 1 -- 172.21.15.104:0/1570385055 learned_addr learned my addr 172.21.15.104:0/1570385055 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e37fe640 1 --2- 172.21.15.104:0/1570385055 >> v2:172.21.15.183:3300/0 conn(0x7fa2e40cdbf0 0x7fa2e41668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697625503 0 0) 0x7fa2e40cc700 con 0x7fa2e40cf360 2024-05-08T04:21:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2cc003520 con 0x7fa2e40cf360 2024-05-08T04:21:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1648239335 0 0) 0x7fa2cc003520 con 0x7fa2e40cf360 2024-05-08T04:21:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 >> v2:172.21.15.183:3300/0 conn(0x7fa2e40cdbf0 msgr2=0x7fa2e41668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 --2- 172.21.15.104:0/1570385055 >> v2:172.21.15.183:3300/0 conn(0x7fa2e40cdbf0 0x7fa2e41668d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 >> v1:172.21.15.183:6789/0 conn(0x7fa2e4099a40 legacy=0x7fa2e4099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e40d0300 con 0x7fa2e40cf360 2024-05-08T04:21:42.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fa2d8001690 con 0x7fa2e40cf360 2024-05-08T04:21:42.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 >> v1:172.21.15.104:6789/0 conn(0x7fa2e40cf360 legacy=0x7fa2e40cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 --2- 172.21.15.104:0/1570385055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2cc0039b0 0x7fa2cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 --2- 172.21.15.104:0/1570385055 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2cc004800 0x7fa2cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 --2- 172.21.15.104:0/1570385055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2cc0051c0 0x7fa2cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e415ced0 con 0x7fa2cc004800 2024-05-08T04:21:42.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc00c160 con 0x7fa2cc0039b0 2024-05-08T04:21:42.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc00c360 con 0x7fa2cc0051c0 2024-05-08T04:21:42.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e27fc640 1 --2- 172.21.15.104:0/1570385055 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2cc004800 0x7fa2cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e2ffd640 1 --2- 172.21.15.104:0/1570385055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2cc0039b0 0x7fa2cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e37fe640 1 --2- 172.21.15.104:0/1570385055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2cc0051c0 0x7fa2cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e27fc640 1 -- 172.21.15.104:0/1570385055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2cc0051c0 msgr2=0x7fa2cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e27fc640 1 --2- 172.21.15.104:0/1570385055 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2cc0051c0 0x7fa2cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e27fc640 1 -- 172.21.15.104:0/1570385055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2cc0039b0 msgr2=0x7fa2cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e27fc640 1 --2- 172.21.15.104:0/1570385055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2cc0039b0 0x7fa2cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.257+0000 7fa2e27fc640 1 -- 172.21.15.104:0/1570385055 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc003520 con 0x7fa2cc004800 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.258+0000 7fa2e37fe640 1 -- 172.21.15.104:0/1570385055 reap_dead start 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.258+0000 7fa2e27fc640 1 --2- 172.21.15.104:0/1570385055 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2cc004800 0x7fa2cc004c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800c210 tx=0x7fa2cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4f88fc761835d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.258+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8007d60 con 0x7fa2cc004800 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.258+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d8005af0 con 0x7fa2cc004800 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.258+0000 7fa2e1ffb640 1 -- 172.21.15.104:0/1570385055 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8007070 con 0x7fa2cc004800 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.259+0000 7fa2e950a640 1 -- 172.21.15.104:0/1570385055 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2cc004800 msgr2=0x7fa2cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.259+0000 7fa2e950a640 1 --2- 172.21.15.104:0/1570385055 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2cc004800 0x7fa2cc004c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800c210 tx=0x7fa2cc005830 comp rx=0 tx=0).stop 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.259+0000 7fa2e950a640 1 -- 172.21.15.104:0/1570385055 shutdown_connections 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.259+0000 7fa2e950a640 1 --2- 172.21.15.104:0/1570385055 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2cc004800 0x7fa2cc004c80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.259+0000 7fa2e950a640 1 -- 172.21.15.104:0/1570385055 >> 172.21.15.104:0/1570385055 conn(0x7fa2e40b3280 msgr2=0x7fa2e40b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:42.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.259+0000 7fa2e950a640 1 -- 172.21.15.104:0/1570385055 shutdown_connections 2024-05-08T04:21:42.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.259+0000 7fa2e950a640 1 -- 172.21.15.104:0/1570385055 wait complete. 2024-05-08T04:21:42.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.260+0000 7fa2e950a640 1 Processor -- start 2024-05-08T04:21:42.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.260+0000 7fa2e950a640 1 -- start start 2024-05-08T04:21:42.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e950a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2cc004800 0x7fa2e415d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e950a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2e40ca830 0x7fa2e415f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e950a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2e415fed0 0x7fa2e4158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e950a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40d08c0 con 0x7fa2cc004800 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e950a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e4159860 con 0x7fa2e40ca830 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e950a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e40d0a40 con 0x7fa2e415fed0 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2cc004800 0x7fa2e415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2cc004800 0x7fa2e415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54182/0 (socket says 172.21.15.104:54182) 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e2ffd640 1 -- 172.21.15.104:0/1402504555 learned_addr learned my addr 172.21.15.104:0/1402504555 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e37fe640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2e415fed0 0x7fa2e4158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e27fc640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2e40ca830 0x7fa2e415f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e2ffd640 1 -- 172.21.15.104:0/1402504555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2e415fed0 msgr2=0x7fa2e4158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e2ffd640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2e415fed0 0x7fa2e4158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e2ffd640 1 -- 172.21.15.104:0/1402504555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2e40ca830 msgr2=0x7fa2e415f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e2ffd640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2e40ca830 0x7fa2e415f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.261+0000 7fa2e2ffd640 1 -- 172.21.15.104:0/1402504555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e40cacc0 con 0x7fa2cc004800 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.262+0000 7fa2e2ffd640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2cc004800 0x7fa2e415d950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400f940 tx=0x7fa2d400fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:42.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.262+0000 7fa2cb7fe640 1 -- 172.21.15.104:0/1402504555 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d401a070 con 0x7fa2cc004800 2024-05-08T04:21:42.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.262+0000 7fa2cb7fe640 1 -- 172.21.15.104:0/1402504555 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4006db0 con 0x7fa2cc004800 2024-05-08T04:21:42.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.262+0000 7fa2cb7fe640 1 -- 172.21.15.104:0/1402504555 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4003be0 con 0x7fa2cc004800 2024-05-08T04:21:42.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.262+0000 7fa2e950a640 1 -- 172.21.15.104:0/1402504555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e40cafa0 con 0x7fa2cc004800 2024-05-08T04:21:42.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.262+0000 7fa2e950a640 1 -- 172.21.15.104:0/1402504555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e40b5470 con 0x7fa2cc004800 2024-05-08T04:21:42.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.263+0000 7fa2e950a640 1 -- 172.21.15.104:0/1402504555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e4075010 con 0x7fa2cc004800 2024-05-08T04:21:42.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.263+0000 7fa2cb7fe640 1 -- 172.21.15.104:0/1402504555 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa2d401d070 con 0x7fa2cc004800 2024-05-08T04:21:42.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.263+0000 7fa2cb7fe640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa2d006b4d0 0x7fa2d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.264+0000 7fa2e27fc640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa2d006b4d0 0x7fa2d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.264+0000 7fa2cb7fe640 1 -- 172.21.15.104:0/1402504555 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2d4089d30 con 0x7fa2cc004800 2024-05-08T04:21:42.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.264+0000 7fa2e27fc640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa2d006b4d0 0x7fa2d006d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40cc8d0 tx=0x7fa2d802d000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:42.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.268+0000 7fa2cb7fe640 1 -- 172.21.15.104:0/1402504555 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa2d4058c40 con 0x7fa2cc004800 2024-05-08T04:21:42.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.437+0000 7fa2e950a640 1 -- 172.21.15.104:0/1402504555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2e40b7710 con 0x7fa2cc004800 2024-05-08T04:21:42.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.437+0000 7fa2cb7fe640 1 -- 172.21.15.104:0/1402504555 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa2d4058540 con 0x7fa2cc004800 2024-05-08T04:21:42.439 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:42.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.439+0000 7fa2e950a640 1 -- 172.21.15.104:0/1402504555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa2d006b4d0 msgr2=0x7fa2d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.439+0000 7fa2e950a640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa2d006b4d0 0x7fa2d006d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40cc8d0 tx=0x7fa2d802d000 comp rx=0 tx=0).stop 2024-05-08T04:21:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.439+0000 7fa2e950a640 1 -- 172.21.15.104:0/1402504555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2cc004800 msgr2=0x7fa2e415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.439+0000 7fa2e950a640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2cc004800 0x7fa2e415d950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400f940 tx=0x7fa2d400fe00 comp rx=0 tx=0).stop 2024-05-08T04:21:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.439+0000 7fa2e950a640 1 -- 172.21.15.104:0/1402504555 shutdown_connections 2024-05-08T04:21:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.439+0000 7fa2e950a640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa2d006b4d0 0x7fa2d006d990 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40cc8d0 tx=0x7fa2d802d000 comp rx=0 tx=0).stop 2024-05-08T04:21:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.439+0000 7fa2e950a640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2e40ca830 0x7fa2e415f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.439+0000 7fa2e950a640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2e415fed0 0x7fa2e4158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.439+0000 7fa2e950a640 1 --2- 172.21.15.104:0/1402504555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2cc004800 0x7fa2e415d950 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.439+0000 7fa2e950a640 1 -- 172.21.15.104:0/1402504555 >> 172.21.15.104:0/1402504555 conn(0x7fa2e40b3280 msgr2=0x7fa2e40ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.439+0000 7fa2e950a640 1 -- 172.21.15.104:0/1402504555 shutdown_connections 2024-05-08T04:21:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.439+0000 7fa2e950a640 1 -- 172.21.15.104:0/1402504555 wait complete. 2024-05-08T04:21:42.452 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:42.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.552+0000 7f8098d63640 1 Processor -- start 2024-05-08T04:21:42.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.552+0000 7f8098d63640 1 -- start start 2024-05-08T04:21:42.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.553+0000 7f8098d63640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f80940711c0 0x7f809406d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.553+0000 7f8098d63640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8094071fb0 con 0x7f80940cc930 2024-05-08T04:21:42.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.553+0000 7f8098d63640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8094071710 con 0x7f8094144c80 2024-05-08T04:21:42.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.553+0000 7f8098d63640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80940719f0 con 0x7f80940711c0 2024-05-08T04:21:42.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.553+0000 7f8091d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f80940711c0 0x7f809406d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.553+0000 7f809259c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f80940cc930 0x7f80940ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43232/0 (socket says 172.21.15.104:43232) 2024-05-08T04:21:42.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.553+0000 7f809259c640 1 -- 172.21.15.104:0/769588267 learned_addr learned my addr 172.21.15.104:0/769588267 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:42.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.554+0000 7f8091d9b640 1 -- 172.21.15.104:0/769588267 >> v1:172.21.15.183:6789/0 conn(0x7f8094144c80 legacy=0x7f809406dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:42.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.554+0000 7f8091d9b640 1 -- 172.21.15.104:0/769588267 >> v1:172.21.15.104:6789/0 conn(0x7f80940cc930 legacy=0x7f80940ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.554+0000 7f8091d9b640 1 -- 172.21.15.104:0/769588267 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8094071cd0 con 0x7f80940711c0 2024-05-08T04:21:42.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.554+0000 7f8091d9b640 1 --2- 172.21.15.104:0/769588267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940711c0 0x7f809406d850 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f807c0097a0 tx=0x7f807c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafedbec78396b75 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:42.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.554+0000 7f809159a640 1 -- 172.21.15.104:0/769588267 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c037070 con 0x7f80940711c0 2024-05-08T04:21:42.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.554+0000 7f809159a640 1 -- 172.21.15.104:0/769588267 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807c02ae50 con 0x7f80940711c0 2024-05-08T04:21:42.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.554+0000 7f809159a640 1 -- 172.21.15.104:0/769588267 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c032660 con 0x7f80940711c0 2024-05-08T04:21:42.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.555+0000 7f8098d63640 1 -- 172.21.15.104:0/769588267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940711c0 msgr2=0x7f809406d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.555+0000 7f8098d63640 1 --2- 172.21.15.104:0/769588267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940711c0 0x7f809406d850 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f807c0097a0 tx=0x7f807c02a140 comp rx=0 tx=0).stop 2024-05-08T04:21:42.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.555+0000 7f8098d63640 1 -- 172.21.15.104:0/769588267 shutdown_connections 2024-05-08T04:21:42.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.555+0000 7f8098d63640 1 --2- 172.21.15.104:0/769588267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940711c0 0x7f809406d850 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.555+0000 7f8098d63640 1 -- 172.21.15.104:0/769588267 >> 172.21.15.104:0/769588267 conn(0x7f80940b13f0 msgr2=0x7f80940b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:42.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.555+0000 7f8098d63640 1 -- 172.21.15.104:0/769588267 shutdown_connections 2024-05-08T04:21:42.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.555+0000 7f8098d63640 1 -- 172.21.15.104:0/769588267 wait complete. 2024-05-08T04:21:42.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.556+0000 7f8098d63640 1 Processor -- start 2024-05-08T04:21:42.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.556+0000 7f8098d63640 1 -- start start 2024-05-08T04:21:42.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f8098d63640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940711c0 0x7f809413b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f8098d63640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80940cc930 0x7f80940aa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f8098d63640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8094144c80 0x7f80940adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f8098d63640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80941453f0 con 0x7f80940711c0 2024-05-08T04:21:42.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f8098d63640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80940cf3b0 con 0x7f8094144c80 2024-05-08T04:21:42.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f8098d63640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809406e4a0 con 0x7f80940cc930 2024-05-08T04:21:42.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f809259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940711c0 0x7f809413b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f809259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940711c0 0x7f809413b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54206/0 (socket says 172.21.15.104:54206) 2024-05-08T04:21:42.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f809259c640 1 -- 172.21.15.104:0/4102596409 learned_addr learned my addr 172.21.15.104:0/4102596409 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:42.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f8091d9b640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80940cc930 0x7f80940aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f8092d9d640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8094144c80 0x7f80940adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f809259c640 1 -- 172.21.15.104:0/4102596409 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80940cc930 msgr2=0x7f80940aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f809259c640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80940cc930 0x7f80940aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f809259c640 1 -- 172.21.15.104:0/4102596409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8094144c80 msgr2=0x7f80940adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f809259c640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8094144c80 0x7f80940adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.557+0000 7f809259c640 1 -- 172.21.15.104:0/4102596409 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80940ab0c0 con 0x7f80940711c0 2024-05-08T04:21:42.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.558+0000 7f809259c640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940711c0 0x7f809413b220 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f808400cb10 tx=0x7f808400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:42.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.558+0000 7f808affd640 1 -- 172.21.15.104:0/4102596409 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084017070 con 0x7f80940711c0 2024-05-08T04:21:42.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.558+0000 7f808affd640 1 -- 172.21.15.104:0/4102596409 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808400ac70 con 0x7f80940711c0 2024-05-08T04:21:42.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.558+0000 7f8098d63640 1 -- 172.21.15.104:0/4102596409 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80940aab00 con 0x7f80940711c0 2024-05-08T04:21:42.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.558+0000 7f808affd640 1 -- 172.21.15.104:0/4102596409 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808400ae60 con 0x7f80940711c0 2024-05-08T04:21:42.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.558+0000 7f8098d63640 1 -- 172.21.15.104:0/4102596409 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809413b900 con 0x7f80940711c0 2024-05-08T04:21:42.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.559+0000 7f8098d63640 1 -- 172.21.15.104:0/4102596409 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8094075010 con 0x7f80940711c0 2024-05-08T04:21:42.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.559+0000 7f808affd640 1 -- 172.21.15.104:0/4102596409 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f808401a070 con 0x7f80940711c0 2024-05-08T04:21:42.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.560+0000 7f808affd640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f807406b4d0 0x7f807406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.560+0000 7f808affd640 1 -- 172.21.15.104:0/4102596409 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8084089f20 con 0x7f80940711c0 2024-05-08T04:21:42.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.560+0000 7f8091d9b640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f807406b4d0 0x7f807406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.560+0000 7f8091d9b640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f807406b4d0 0x7f807406d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f807c034000 tx=0x7f807c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:42.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.564+0000 7f808affd640 1 -- 172.21.15.104:0/4102596409 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f80940ab0c0 con 0x7f80940711c0 2024-05-08T04:21:42.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.735+0000 7f8098d63640 1 -- 172.21.15.104:0/4102596409 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80940af040 con 0x7f80940711c0 2024-05-08T04:21:42.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.735+0000 7f808affd640 1 -- 172.21.15.104:0/4102596409 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8084058e30 con 0x7f80940711c0 2024-05-08T04:21:42.738 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:42.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.737+0000 7f8098d63640 1 -- 172.21.15.104:0/4102596409 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f807406b4d0 msgr2=0x7f807406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.737+0000 7f8098d63640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f807406b4d0 0x7f807406d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f807c034000 tx=0x7f807c02e000 comp rx=0 tx=0).stop 2024-05-08T04:21:42.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.737+0000 7f8098d63640 1 -- 172.21.15.104:0/4102596409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940711c0 msgr2=0x7f809413b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.737+0000 7f8098d63640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940711c0 0x7f809413b220 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f808400cb10 tx=0x7f808400a060 comp rx=0 tx=0).stop 2024-05-08T04:21:42.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.737+0000 7f8098d63640 1 -- 172.21.15.104:0/4102596409 shutdown_connections 2024-05-08T04:21:42.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.737+0000 7f8098d63640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f807406b4d0 0x7f807406d990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.737+0000 7f8098d63640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8094144c80 0x7f80940adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.737+0000 7f8098d63640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80940cc930 0x7f80940aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.737+0000 7f8098d63640 1 --2- 172.21.15.104:0/4102596409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80940711c0 0x7f809413b220 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.737+0000 7f8098d63640 1 -- 172.21.15.104:0/4102596409 >> 172.21.15.104:0/4102596409 conn(0x7f80940b13f0 msgr2=0x7f80940a95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:42.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.737+0000 7f8098d63640 1 -- 172.21.15.104:0/4102596409 shutdown_connections 2024-05-08T04:21:42.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.737+0000 7f8098d63640 1 -- 172.21.15.104:0/4102596409 wait complete. 2024-05-08T04:21:42.751 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:21:42.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.853+0000 7efe2b25d640 1 Processor -- start 2024-05-08T04:21:42.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.853+0000 7efe2b25d640 1 -- start start 2024-05-08T04:21:42.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.853+0000 7efe2b25d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe240ceee0 0x7efe240b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.854+0000 7efe2b25d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efe240b4700 0x7efe2406e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.854+0000 7efe2b25d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2415e780 con 0x7efe2406e330 2024-05-08T04:21:42.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.854+0000 7efe2b25d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2415f390 con 0x7efe240b4700 2024-05-08T04:21:42.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.854+0000 7efe2b25d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2415ea60 con 0x7efe240ceee0 2024-05-08T04:21:42.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.854+0000 7efe297fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efe240b4700 0x7efe2406e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.854+0000 7efe297fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efe240b4700 0x7efe2406e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:48290/0 (socket says 172.21.15.104:48290) 2024-05-08T04:21:42.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.854+0000 7efe23fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7efe2406e330 0x7efe240b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:59236/0 (socket says 172.21.15.104:59236) 2024-05-08T04:21:42.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.854+0000 7efe297fa640 1 -- 172.21.15.104:0/832382280 learned_addr learned my addr 172.21.15.104:0/832382280 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:42.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.854+0000 7efe297fa640 1 -- 172.21.15.104:0/832382280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe240ceee0 msgr2=0x7efe240b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:42.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.854+0000 7efe297fa640 1 --2- 172.21.15.104:0/832382280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe240ceee0 0x7efe240b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.854+0000 7efe297fa640 1 -- 172.21.15.104:0/832382280 >> v1:172.21.15.183:6789/0 conn(0x7efe2406e330 legacy=0x7efe240b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.854+0000 7efe297fa640 1 -- 172.21.15.104:0/832382280 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2415ed40 con 0x7efe240b4700 2024-05-08T04:21:42.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.854+0000 7efe237fe640 1 -- 172.21.15.104:0/832382280 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361629740 0 0) 0x7efe2415e780 con 0x7efe2406e330 2024-05-08T04:21:42.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.855+0000 7efe297fa640 1 --2- 172.21.15.104:0/832382280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe240b4700 0x7efe2406e7b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009870 tx=0x7efe1c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=856d49897e3af2a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:42.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.855+0000 7efe237fe640 1 -- 172.21.15.104:0/832382280 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c037070 con 0x7efe240b4700 2024-05-08T04:21:42.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.855+0000 7efe237fe640 1 -- 172.21.15.104:0/832382280 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c032440 con 0x7efe240b4700 2024-05-08T04:21:42.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.855+0000 7efe237fe640 1 -- 172.21.15.104:0/832382280 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c032810 con 0x7efe240b4700 2024-05-08T04:21:42.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.856+0000 7efe2b25d640 1 -- 172.21.15.104:0/832382280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe240b4700 msgr2=0x7efe2406e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.856+0000 7efe2b25d640 1 --2- 172.21.15.104:0/832382280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe240b4700 0x7efe2406e7b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009870 tx=0x7efe1c02a270 comp rx=0 tx=0).stop 2024-05-08T04:21:42.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.856+0000 7efe2b25d640 1 -- 172.21.15.104:0/832382280 shutdown_connections 2024-05-08T04:21:42.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.856+0000 7efe2b25d640 1 --2- 172.21.15.104:0/832382280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe240b4700 0x7efe2406e7b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.856+0000 7efe2b25d640 1 --2- 172.21.15.104:0/832382280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe240ceee0 0x7efe240b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.856+0000 7efe2b25d640 1 -- 172.21.15.104:0/832382280 >> 172.21.15.104:0/832382280 conn(0x7efe240b13f0 msgr2=0x7efe240b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:42.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.856+0000 7efe2b25d640 1 -- 172.21.15.104:0/832382280 shutdown_connections 2024-05-08T04:21:42.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.856+0000 7efe2b25d640 1 -- 172.21.15.104:0/832382280 wait complete. 2024-05-08T04:21:42.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.857+0000 7efe2b25d640 1 Processor -- start 2024-05-08T04:21:42.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.857+0000 7efe2b25d640 1 -- start start 2024-05-08T04:21:42.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe2b25d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe2406e330 0x7efe240cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe2b25d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe240b4700 0x7efe240ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe2b25d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe240ceee0 0x7efe241517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe2b25d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe240cf440 con 0x7efe240b4700 2024-05-08T04:21:42.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe2b25d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe240cf2c0 con 0x7efe2406e330 2024-05-08T04:21:42.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe2b25d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2415b210 con 0x7efe240ceee0 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe23fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe240b4700 0x7efe240ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe23fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe240b4700 0x7efe240ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54208/0 (socket says 172.21.15.104:54208) 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe23fff640 1 -- 172.21.15.104:0/623547334 learned_addr learned my addr 172.21.15.104:0/623547334 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe297fa640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe240ceee0 0x7efe241517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe28ff9640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe2406e330 0x7efe240cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe23fff640 1 -- 172.21.15.104:0/623547334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe240ceee0 msgr2=0x7efe241517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe23fff640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe240ceee0 0x7efe241517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe23fff640 1 -- 172.21.15.104:0/623547334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe2406e330 msgr2=0x7efe240cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.858+0000 7efe23fff640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe2406e330 0x7efe240cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.859+0000 7efe23fff640 1 -- 172.21.15.104:0/623547334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2415e160 con 0x7efe240b4700 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.859+0000 7efe23fff640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe240b4700 0x7efe240ce4b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00c500 tx=0x7efe0c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.859+0000 7efe217fa640 1 -- 172.21.15.104:0/623547334 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c018070 con 0x7efe240b4700 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.859+0000 7efe217fa640 1 -- 172.21.15.104:0/623547334 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c007580 con 0x7efe240b4700 2024-05-08T04:21:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.859+0000 7efe2b25d640 1 -- 172.21.15.104:0/623547334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2415e440 con 0x7efe240b4700 2024-05-08T04:21:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.859+0000 7efe217fa640 1 -- 172.21.15.104:0/623547334 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c004a20 con 0x7efe240b4700 2024-05-08T04:21:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.859+0000 7efe2b25d640 1 -- 172.21.15.104:0/623547334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2415b910 con 0x7efe240b4700 2024-05-08T04:21:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.860+0000 7efe2b25d640 1 -- 172.21.15.104:0/623547334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe24075010 con 0x7efe240b4700 2024-05-08T04:21:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.860+0000 7efe217fa640 1 -- 172.21.15.104:0/623547334 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe0c01b070 con 0x7efe240b4700 2024-05-08T04:21:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.861+0000 7efe217fa640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efe0406b4d0 0x7efe0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.861+0000 7efe217fa640 1 -- 172.21.15.104:0/623547334 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe0c0894f0 con 0x7efe240b4700 2024-05-08T04:21:42.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.861+0000 7efe28ff9640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efe0406b4d0 0x7efe0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:42.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.862+0000 7efe28ff9640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efe0406b4d0 0x7efe0406d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efe14009f20 tx=0x7efe140094f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:42.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:42.865+0000 7efe217fa640 1 -- 172.21.15.104:0/623547334 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe0c058400 con 0x7efe240b4700 2024-05-08T04:21:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.051+0000 7efe2b25d640 1 -- 172.21.15.104:0/623547334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efe2406f3f0 con 0x7efe240b4700 2024-05-08T04:21:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.052+0000 7efe217fa640 1 -- 172.21.15.104:0/623547334 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7efe0c057d00 con 0x7efe240b4700 2024-05-08T04:21:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:21:43.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.054+0000 7efe2b25d640 1 -- 172.21.15.104:0/623547334 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efe0406b4d0 msgr2=0x7efe0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.054+0000 7efe2b25d640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efe0406b4d0 0x7efe0406d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efe14009f20 tx=0x7efe140094f0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.054+0000 7efe2b25d640 1 -- 172.21.15.104:0/623547334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe240b4700 msgr2=0x7efe240ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.054+0000 7efe2b25d640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe240b4700 0x7efe240ce4b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00c500 tx=0x7efe0c00c9c0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.054+0000 7efe2b25d640 1 -- 172.21.15.104:0/623547334 shutdown_connections 2024-05-08T04:21:43.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.054+0000 7efe2b25d640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efe0406b4d0 0x7efe0406d990 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.054+0000 7efe2b25d640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe240ceee0 0x7efe241517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.054+0000 7efe2b25d640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe240b4700 0x7efe240ce4b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.054+0000 7efe2b25d640 1 --2- 172.21.15.104:0/623547334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe2406e330 0x7efe240cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.054+0000 7efe2b25d640 1 -- 172.21.15.104:0/623547334 >> 172.21.15.104:0/623547334 conn(0x7efe240b13f0 msgr2=0x7efe240b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:43.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.054+0000 7efe2b25d640 1 -- 172.21.15.104:0/623547334 shutdown_connections 2024-05-08T04:21:43.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.054+0000 7efe2b25d640 1 -- 172.21.15.104:0/623547334 wait complete. 2024-05-08T04:21:43.067 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:21:43.067 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:21:43.083 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:43.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.222+0000 7f4dededb640 1 Processor -- start 2024-05-08T04:21:43.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.222+0000 7f4dededb640 1 -- start start 2024-05-08T04:21:43.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4dededb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4de806ab60 0x7f4de8070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4dededb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4de815de30 0x7f4de815e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4dededb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de80d0450 con 0x7f4de80cff50 2024-05-08T04:21:43.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4dededb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de8161630 con 0x7f4de806ab60 2024-05-08T04:21:43.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4dededb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de8072ab0 con 0x7f4de815de30 2024-05-08T04:21:43.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4de77fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4de806ab60 0x7f4de8070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4de77fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4de806ab60 0x7f4de8070820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54214/0 (socket says 172.21.15.104:54214) 2024-05-08T04:21:43.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4de77fe640 1 -- 172.21.15.104:0/2278191172 learned_addr learned my addr 172.21.15.104:0/2278191172 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:43.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4de77fe640 1 -- 172.21.15.104:0/2278191172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4de815de30 msgr2=0x7f4de815e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:43.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4de7fff640 1 --2- 172.21.15.104:0/2278191172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4de815de30 0x7f4de815e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4de77fe640 1 --2- 172.21.15.104:0/2278191172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4de815de30 0x7f4de815e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4de77fe640 1 -- 172.21.15.104:0/2278191172 >> v1:172.21.15.183:6789/0 conn(0x7f4de80cff50 legacy=0x7f4de806af40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T04:21:43.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4de77fe640 1 -- 172.21.15.104:0/2278191172 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de8072d90 con 0x7f4de806ab60 2024-05-08T04:21:43.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.224+0000 7f4de7fff640 1 --2- 172.21.15.104:0/2278191172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4de815de30 0x7f4de815e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:43.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.225+0000 7f4de77fe640 1 --2- 172.21.15.104:0/2278191172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4de806ab60 0x7f4de8070820 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009870 tx=0x7f4dd002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5f165965ed049f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:43.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.225+0000 7f4de67fc640 1 -- 172.21.15.104:0/2278191172 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0037070 con 0x7f4de806ab60 2024-05-08T04:21:43.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.225+0000 7f4de67fc640 1 -- 172.21.15.104:0/2278191172 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd0032440 con 0x7f4de806ab60 2024-05-08T04:21:43.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.225+0000 7f4de67fc640 1 -- 172.21.15.104:0/2278191172 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0032810 con 0x7f4de806ab60 2024-05-08T04:21:43.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.225+0000 7f4dededb640 1 -- 172.21.15.104:0/2278191172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4de806ab60 msgr2=0x7f4de8070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.225+0000 7f4dededb640 1 --2- 172.21.15.104:0/2278191172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4de806ab60 0x7f4de8070820 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009870 tx=0x7f4dd002a180 comp rx=0 tx=0).stop 2024-05-08T04:21:43.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.226+0000 7f4dededb640 1 -- 172.21.15.104:0/2278191172 shutdown_connections 2024-05-08T04:21:43.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.226+0000 7f4dededb640 1 --2- 172.21.15.104:0/2278191172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4de815de30 0x7f4de815e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.226+0000 7f4dededb640 1 --2- 172.21.15.104:0/2278191172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4de806ab60 0x7f4de8070820 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.226+0000 7f4dededb640 1 -- 172.21.15.104:0/2278191172 >> 172.21.15.104:0/2278191172 conn(0x7f4de80b23e0 msgr2=0x7f4de80b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:43.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.226+0000 7f4dededb640 1 -- 172.21.15.104:0/2278191172 shutdown_connections 2024-05-08T04:21:43.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.226+0000 7f4dededb640 1 -- 172.21.15.104:0/2278191172 wait complete. 2024-05-08T04:21:43.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.227+0000 7f4dededb640 1 Processor -- start 2024-05-08T04:21:43.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.227+0000 7f4dededb640 1 -- start start 2024-05-08T04:21:43.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4dededb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4de806ab60 0x7f4de8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4dededb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4de80cff50 0x7f4de81f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4dededb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4de815de30 0x7f4de81f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4dededb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de8161ac0 con 0x7f4de80cff50 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4dededb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de8070370 con 0x7f4de815de30 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4dededb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de8161c40 con 0x7f4de806ab60 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4de6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4de80cff50 0x7f4de81f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4de6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4de80cff50 0x7f4de81f7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54230/0 (socket says 172.21.15.104:54230) 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4de6ffd640 1 -- 172.21.15.104:0/2454128074 learned_addr learned my addr 172.21.15.104:0/2454128074 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4de6ffd640 1 -- 172.21.15.104:0/2454128074 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4de806ab60 msgr2=0x7f4de8150fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4de6ffd640 1 --2- 172.21.15.104:0/2454128074 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4de806ab60 0x7f4de8150fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4de6ffd640 1 -- 172.21.15.104:0/2454128074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4de815de30 msgr2=0x7f4de81f8010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4de6ffd640 1 --2- 172.21.15.104:0/2454128074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4de815de30 0x7f4de81f8010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4de6ffd640 1 -- 172.21.15.104:0/2454128074 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de80b5280 con 0x7f4de80cff50 2024-05-08T04:21:43.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4de6ffd640 1 --2- 172.21.15.104:0/2454128074 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4de80cff50 0x7f4de81f7ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800b450 tx=0x7f4dd800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:43.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4ddffff640 1 -- 172.21.15.104:0/2454128074 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8015020 con 0x7f4de80cff50 2024-05-08T04:21:43.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4ddffff640 1 -- 172.21.15.104:0/2454128074 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd80118b0 con 0x7f4de80cff50 2024-05-08T04:21:43.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4dededb640 1 -- 172.21.15.104:0/2454128074 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de80b5560 con 0x7f4de80cff50 2024-05-08T04:21:43.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4ddffff640 1 -- 172.21.15.104:0/2454128074 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8011ca0 con 0x7f4de80cff50 2024-05-08T04:21:43.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.228+0000 7f4dededb640 1 -- 172.21.15.104:0/2454128074 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de81f8550 con 0x7f4de80cff50 2024-05-08T04:21:43.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.229+0000 7f4dededb640 1 -- 172.21.15.104:0/2454128074 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de8075010 con 0x7f4de80cff50 2024-05-08T04:21:43.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.230+0000 7f4ddffff640 1 -- 172.21.15.104:0/2454128074 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4dd8018020 con 0x7f4de80cff50 2024-05-08T04:21:43.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.230+0000 7f4ddffff640 1 --2- 172.21.15.104:0/2454128074 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4dc806b4d0 0x7f4dc806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.230+0000 7f4ddffff640 1 -- 172.21.15.104:0/2454128074 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4dd808a430 con 0x7f4de80cff50 2024-05-08T04:21:43.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.230+0000 7f4de77fe640 1 --2- 172.21.15.104:0/2454128074 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4dc806b4d0 0x7f4dc806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.231+0000 7f4de77fe640 1 --2- 172.21.15.104:0/2454128074 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4dc806b4d0 0x7f4dc806d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0034000 tx=0x7f4dd002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:43.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.235+0000 7f4ddffff640 1 -- 172.21.15.104:0/2454128074 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4dd801f020 con 0x7f4de80cff50 2024-05-08T04:21:43.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.416+0000 7f4dededb640 1 -- 172.21.15.104:0/2454128074 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4de806fa90 con 0x7f4de80cff50 2024-05-08T04:21:43.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.417+0000 7f4ddffff640 1 -- 172.21.15.104:0/2454128074 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f4dd800d040 con 0x7f4de80cff50 2024-05-08T04:21:43.419 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:43.420 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:43.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.419+0000 7f4dededb640 1 -- 172.21.15.104:0/2454128074 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4dc806b4d0 msgr2=0x7f4dc806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.419+0000 7f4dededb640 1 --2- 172.21.15.104:0/2454128074 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4dc806b4d0 0x7f4dc806d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0034000 tx=0x7f4dd002e000 comp rx=0 tx=0).stop 2024-05-08T04:21:43.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.419+0000 7f4dededb640 1 -- 172.21.15.104:0/2454128074 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4de80cff50 msgr2=0x7f4de81f7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.419+0000 7f4dededb640 1 --2- 172.21.15.104:0/2454128074 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4de80cff50 0x7f4de81f7ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800b450 tx=0x7f4dd800b910 comp rx=0 tx=0).stop 2024-05-08T04:21:43.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.420+0000 7f4dededb640 1 -- 172.21.15.104:0/2454128074 shutdown_connections 2024-05-08T04:21:43.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.420+0000 7f4dededb640 1 --2- 172.21.15.104:0/2454128074 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4dc806b4d0 0x7f4dc806d990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.420+0000 7f4dededb640 1 --2- 172.21.15.104:0/2454128074 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4de815de30 0x7f4de81f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.420+0000 7f4dededb640 1 --2- 172.21.15.104:0/2454128074 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4de80cff50 0x7f4de81f7ad0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.420+0000 7f4dededb640 1 --2- 172.21.15.104:0/2454128074 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4de806ab60 0x7f4de8150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.420+0000 7f4dededb640 1 -- 172.21.15.104:0/2454128074 >> 172.21.15.104:0/2454128074 conn(0x7f4de80b23e0 msgr2=0x7f4de80ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:43.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.420+0000 7f4dededb640 1 -- 172.21.15.104:0/2454128074 shutdown_connections 2024-05-08T04:21:43.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.420+0000 7f4dededb640 1 -- 172.21.15.104:0/2454128074 wait complete. 2024-05-08T04:21:43.433 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:43.434 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:43.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.535+0000 7f044397e640 1 Processor -- start 2024-05-08T04:21:43.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.536+0000 7f044397e640 1 -- start start 2024-05-08T04:21:43.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.536+0000 7f044397e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f043c099a40 0x7f043c099e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.536+0000 7f044397e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f043c0cf360 0x7f043c0cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.536+0000 7f044397e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c0cc700 con 0x7f043c15f540 2024-05-08T04:21:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.536+0000 7f044397e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c15ced0 con 0x7f043c099a40 2024-05-08T04:21:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.536+0000 7f044397e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c09a360 con 0x7f043c0cf360 2024-05-08T04:21:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.537+0000 7f0440f19640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f043c0cf360 0x7f043c0cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.537+0000 7f044171a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f043c099a40 0x7f043c099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.537+0000 7f044171a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f043c099a40 0x7f043c099e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:48318/0 (socket says 172.21.15.104:48318) 2024-05-08T04:21:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.537+0000 7f0440f19640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f043c0cf360 0x7f043c0cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:52428/0 (socket says 172.21.15.104:52428) 2024-05-08T04:21:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.537+0000 7f0441f1b640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f043c15f540 0x7f043c15f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:59262/0 (socket says 172.21.15.104:59262) 2024-05-08T04:21:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.537+0000 7f044171a640 1 -- 172.21.15.104:0/3452690589 learned_addr learned my addr 172.21.15.104:0/3452690589 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.537+0000 7f044171a640 1 -- 172.21.15.104:0/3452690589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f043c0cf360 msgr2=0x7f043c0cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.537+0000 7f044171a640 1 --2- 172.21.15.104:0/3452690589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f043c0cf360 0x7f043c0cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.537+0000 7f044171a640 1 -- 172.21.15.104:0/3452690589 >> v1:172.21.15.183:6789/0 conn(0x7f043c15f540 legacy=0x7f043c15f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.537+0000 7f044171a640 1 -- 172.21.15.104:0/3452690589 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c0d0020 con 0x7f043c099a40 2024-05-08T04:21:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.537+0000 7f0440f19640 1 --2- 172.21.15.104:0/3452690589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f043c0cf360 0x7f043c0cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.538+0000 7f044171a640 1 --2- 172.21.15.104:0/3452690589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f043c099a40 0x7f043c099e20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0438009850 tx=0x7f043802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=701f9a96153f2c9d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.538+0000 7f0433fff640 1 -- 172.21.15.104:0/3452690589 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438004030 con 0x7f043c099a40 2024-05-08T04:21:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.538+0000 7f0433fff640 1 -- 172.21.15.104:0/3452690589 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04380041d0 con 0x7f043c099a40 2024-05-08T04:21:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.538+0000 7f0433fff640 1 -- 172.21.15.104:0/3452690589 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438003610 con 0x7f043c099a40 2024-05-08T04:21:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.539+0000 7f044397e640 1 -- 172.21.15.104:0/3452690589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f043c099a40 msgr2=0x7f043c099e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.539+0000 7f044397e640 1 --2- 172.21.15.104:0/3452690589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f043c099a40 0x7f043c099e20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0438009850 tx=0x7f043802a250 comp rx=0 tx=0).stop 2024-05-08T04:21:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.539+0000 7f044397e640 1 -- 172.21.15.104:0/3452690589 shutdown_connections 2024-05-08T04:21:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.539+0000 7f044397e640 1 --2- 172.21.15.104:0/3452690589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f043c0cf360 0x7f043c0cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.539+0000 7f044397e640 1 --2- 172.21.15.104:0/3452690589 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f043c099a40 0x7f043c099e20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.539+0000 7f044397e640 1 -- 172.21.15.104:0/3452690589 >> 172.21.15.104:0/3452690589 conn(0x7f043c0b3280 msgr2=0x7f043c0b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.539+0000 7f044397e640 1 -- 172.21.15.104:0/3452690589 shutdown_connections 2024-05-08T04:21:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.539+0000 7f044397e640 1 -- 172.21.15.104:0/3452690589 wait complete. 2024-05-08T04:21:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.540+0000 7f044397e640 1 Processor -- start 2024-05-08T04:21:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.540+0000 7f044397e640 1 -- start start 2024-05-08T04:21:43.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f044397e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f043c099a40 0x7f043c1569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f044397e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f043c0cf360 0x7f043c0cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f044397e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f043c15f540 0x7f043c0ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f044397e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c159860 con 0x7f043c0cf360 2024-05-08T04:21:43.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f044397e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0d05e0 con 0x7f043c099a40 2024-05-08T04:21:43.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f044397e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0cfd00 con 0x7f043c15f540 2024-05-08T04:21:43.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f0440f19640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f043c0cf360 0x7f043c0cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f0440f19640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f043c0cf360 0x7f043c0cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54234/0 (socket says 172.21.15.104:54234) 2024-05-08T04:21:43.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f0440f19640 1 -- 172.21.15.104:0/4072190497 learned_addr learned my addr 172.21.15.104:0/4072190497 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:43.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f044171a640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f043c099a40 0x7f043c1569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f0441f1b640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f043c15f540 0x7f043c0ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f0440f19640 1 -- 172.21.15.104:0/4072190497 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f043c15f540 msgr2=0x7f043c0ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f0440f19640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f043c15f540 0x7f043c0ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f0440f19640 1 -- 172.21.15.104:0/4072190497 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f043c099a40 msgr2=0x7f043c1569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f0440f19640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f043c099a40 0x7f043c1569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f0440f19640 1 -- 172.21.15.104:0/4072190497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c0c9410 con 0x7f043c0cf360 2024-05-08T04:21:43.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.541+0000 7f0440f19640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f043c0cf360 0x7f043c0cb050 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f042c00e990 tx=0x7f042c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:43.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.542+0000 7f0431ffb640 1 -- 172.21.15.104:0/4072190497 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c017070 con 0x7f043c0cf360 2024-05-08T04:21:43.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.542+0000 7f0431ffb640 1 -- 172.21.15.104:0/4072190497 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c00c9e0 con 0x7f043c0cf360 2024-05-08T04:21:43.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.542+0000 7f044397e640 1 -- 172.21.15.104:0/4072190497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c0c96b0 con 0x7f043c0cf360 2024-05-08T04:21:43.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.542+0000 7f0431ffb640 1 -- 172.21.15.104:0/4072190497 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c00cdb0 con 0x7f043c0cf360 2024-05-08T04:21:43.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.542+0000 7f044397e640 1 -- 172.21.15.104:0/4072190497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c0c9c70 con 0x7f043c0cf360 2024-05-08T04:21:43.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.543+0000 7f044397e640 1 -- 172.21.15.104:0/4072190497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c075010 con 0x7f043c0cf360 2024-05-08T04:21:43.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.544+0000 7f0431ffb640 1 -- 172.21.15.104:0/4072190497 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f042c01a070 con 0x7f043c0cf360 2024-05-08T04:21:43.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.544+0000 7f0431ffb640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f042006b4d0 0x7f042006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.544+0000 7f0431ffb640 1 -- 172.21.15.104:0/4072190497 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f042c08a0e0 con 0x7f043c0cf360 2024-05-08T04:21:43.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.544+0000 7f044171a640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f042006b4d0 0x7f042006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.545+0000 7f044171a640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f042006b4d0 0x7f042006d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0438033000 tx=0x7f043802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:43.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.548+0000 7f0431ffb640 1 -- 172.21.15.104:0/4072190497 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f042c058f60 con 0x7f043c0cf360 2024-05-08T04:21:43.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.723+0000 7f044397e640 1 -- 172.21.15.104:0/4072190497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f043c071b90 con 0x7f043c0cf360 2024-05-08T04:21:43.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.723+0000 7f0431ffb640 1 -- 172.21.15.104:0/4072190497 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f042c058860 con 0x7f043c0cf360 2024-05-08T04:21:43.726 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:43.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.725+0000 7f044397e640 1 -- 172.21.15.104:0/4072190497 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f042006b4d0 msgr2=0x7f042006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.725+0000 7f044397e640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f042006b4d0 0x7f042006d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0438033000 tx=0x7f043802e000 comp rx=0 tx=0).stop 2024-05-08T04:21:43.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.725+0000 7f044397e640 1 -- 172.21.15.104:0/4072190497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f043c0cf360 msgr2=0x7f043c0cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.725+0000 7f044397e640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f043c0cf360 0x7f043c0cb050 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f042c00e990 tx=0x7f042c00ee50 comp rx=0 tx=0).stop 2024-05-08T04:21:43.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.725+0000 7f044397e640 1 -- 172.21.15.104:0/4072190497 shutdown_connections 2024-05-08T04:21:43.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.725+0000 7f044397e640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f042006b4d0 0x7f042006d990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.725+0000 7f044397e640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f043c15f540 0x7f043c0ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.725+0000 7f044397e640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f043c0cf360 0x7f043c0cb050 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.725+0000 7f044397e640 1 --2- 172.21.15.104:0/4072190497 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f043c099a40 0x7f043c1569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.725+0000 7f044397e640 1 -- 172.21.15.104:0/4072190497 >> 172.21.15.104:0/4072190497 conn(0x7f043c0b3280 msgr2=0x7f043c158c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:43.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.725+0000 7f044397e640 1 -- 172.21.15.104:0/4072190497 shutdown_connections 2024-05-08T04:21:43.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.725+0000 7f044397e640 1 -- 172.21.15.104:0/4072190497 wait complete. 2024-05-08T04:21:43.739 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:43.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.840+0000 7f3968688640 1 Processor -- start 2024-05-08T04:21:43.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.840+0000 7f3968688640 1 -- start start 2024-05-08T04:21:43.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.841+0000 7f3968688640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f39600cdbf0 0x7f39601668d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.841+0000 7f3968688640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39600cc700 con 0x7f39600cf360 2024-05-08T04:21:43.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.841+0000 7f3968688640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39600d0020 con 0x7f3960099a40 2024-05-08T04:21:43.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.841+0000 7f3968688640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396015ced0 con 0x7f39600cdbf0 2024-05-08T04:21:43.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.841+0000 7f3966c25640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f39600cdbf0 0x7f39601668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.841+0000 7f3965c23640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f39600cf360 0x7f39600cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43238/0 (socket says 172.21.15.104:43238) 2024-05-08T04:21:43.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.841+0000 7f3965c23640 1 -- 172.21.15.104:0/3663593942 learned_addr learned my addr 172.21.15.104:0/3663593942 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:43.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.841+0000 7f3966c25640 1 -- 172.21.15.104:0/3663593942 >> v1:172.21.15.183:6789/0 conn(0x7f3960099a40 legacy=0x7f3960099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:43.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.841+0000 7f3966c25640 1 -- 172.21.15.104:0/3663593942 >> v1:172.21.15.104:6789/0 conn(0x7f39600cf360 legacy=0x7f39600cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.841+0000 7f3966c25640 1 -- 172.21.15.104:0/3663593942 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600d0300 con 0x7f39600cdbf0 2024-05-08T04:21:43.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.841+0000 7f3965422640 1 -- 172.21.15.104:0/3663593942 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761638665 0 0) 0x7f39600cc700 con 0x7f39600cf360 2024-05-08T04:21:43.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.842+0000 7f3966c25640 1 --2- 172.21.15.104:0/3663593942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39600cdbf0 0x7f39601668d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3958009d90 tx=0x7f395802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3abb158cb6c45b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:43.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.842+0000 7f3965422640 1 -- 172.21.15.104:0/3663593942 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958031600 con 0x7f39600cdbf0 2024-05-08T04:21:43.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.842+0000 7f3965422640 1 -- 172.21.15.104:0/3663593942 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39580317a0 con 0x7f39600cdbf0 2024-05-08T04:21:43.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.842+0000 7f3965422640 1 -- 172.21.15.104:0/3663593942 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958031b70 con 0x7f39600cdbf0 2024-05-08T04:21:43.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.843+0000 7f3968688640 1 -- 172.21.15.104:0/3663593942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39600cdbf0 msgr2=0x7f39601668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.843+0000 7f3968688640 1 --2- 172.21.15.104:0/3663593942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39600cdbf0 0x7f39601668d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3958009d90 tx=0x7f395802a610 comp rx=0 tx=0).stop 2024-05-08T04:21:43.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.843+0000 7f3968688640 1 -- 172.21.15.104:0/3663593942 shutdown_connections 2024-05-08T04:21:43.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.843+0000 7f3968688640 1 --2- 172.21.15.104:0/3663593942 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39600cdbf0 0x7f39601668d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.843+0000 7f3968688640 1 -- 172.21.15.104:0/3663593942 >> 172.21.15.104:0/3663593942 conn(0x7f39600b3280 msgr2=0x7f39600b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:43.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.843+0000 7f3968688640 1 -- 172.21.15.104:0/3663593942 shutdown_connections 2024-05-08T04:21:43.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.843+0000 7f3968688640 1 -- 172.21.15.104:0/3663593942 wait complete. 2024-05-08T04:21:43.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.844+0000 7f3968688640 1 Processor -- start 2024-05-08T04:21:43.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.844+0000 7f3968688640 1 -- start start 2024-05-08T04:21:43.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3968688640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3960099a40 0x7f39601f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3968688640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39600cdbf0 0x7f3960156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3968688640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39600cf360 0x7f39600c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3968688640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600d08c0 con 0x7f39600cdbf0 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3968688640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960159860 con 0x7f39600cf360 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3968688640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39600d0a40 con 0x7f3960099a40 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3965c23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39600cdbf0 0x7f3960156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3965c23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39600cdbf0 0x7f3960156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54248/0 (socket says 172.21.15.104:54248) 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3965c23640 1 -- 172.21.15.104:0/2964877463 learned_addr learned my addr 172.21.15.104:0/2964877463 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3966424640 1 --2- 172.21.15.104:0/2964877463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3960099a40 0x7f39601f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3965c23640 1 -- 172.21.15.104:0/2964877463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3960099a40 msgr2=0x7f39601f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3965c23640 1 --2- 172.21.15.104:0/2964877463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3960099a40 0x7f39601f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3965c23640 1 -- 172.21.15.104:0/2964877463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39600cf360 msgr2=0x7f39600c9980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3965c23640 1 --2- 172.21.15.104:0/2964877463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39600cf360 0x7f39600c9980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.845+0000 7f3965c23640 1 -- 172.21.15.104:0/2964877463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600b43b0 con 0x7f39600cdbf0 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.846+0000 7f3965c23640 1 --2- 172.21.15.104:0/2964877463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39600cdbf0 0x7f3960156350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f395000c400 tx=0x7f395000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.846+0000 7f3956ffd640 1 -- 172.21.15.104:0/2964877463 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950017070 con 0x7f39600cdbf0 2024-05-08T04:21:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.846+0000 7f3956ffd640 1 -- 172.21.15.104:0/2964877463 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3950005ce0 con 0x7f39600cdbf0 2024-05-08T04:21:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.846+0000 7f3956ffd640 1 -- 172.21.15.104:0/2964877463 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950007310 con 0x7f39600cdbf0 2024-05-08T04:21:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.846+0000 7f3968688640 1 -- 172.21.15.104:0/2964877463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39601f5e20 con 0x7f39600cdbf0 2024-05-08T04:21:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.846+0000 7f3968688640 1 -- 172.21.15.104:0/2964877463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39600b4910 con 0x7f39600cdbf0 2024-05-08T04:21:43.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.847+0000 7f3968688640 1 -- 172.21.15.104:0/2964877463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3960075010 con 0x7f39600cdbf0 2024-05-08T04:21:43.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.848+0000 7f3956ffd640 1 -- 172.21.15.104:0/2964877463 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f395001a070 con 0x7f39600cdbf0 2024-05-08T04:21:43.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.848+0000 7f3956ffd640 1 --2- 172.21.15.104:0/2964877463 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f394406b500 0x7f394406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:43.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.848+0000 7f3956ffd640 1 -- 172.21.15.104:0/2964877463 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3950089620 con 0x7f39600cdbf0 2024-05-08T04:21:43.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.848+0000 7f3966424640 1 --2- 172.21.15.104:0/2964877463 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f394406b500 0x7f394406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:43.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.849+0000 7f3966424640 1 --2- 172.21.15.104:0/2964877463 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f394406b500 0x7f394406d9c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f39600af490 tx=0x7f395c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:43.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:43.853+0000 7f3956ffd640 1 -- 172.21.15.104:0/2964877463 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f39601f5e20 con 0x7f39600cdbf0 2024-05-08T04:21:44.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.028+0000 7f3968688640 1 -- 172.21.15.104:0/2964877463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39600b73f0 con 0x7f39600cdbf0 2024-05-08T04:21:44.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.028+0000 7f3956ffd640 1 -- 172.21.15.104:0/2964877463 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39600b43b0 con 0x7f39600cdbf0 2024-05-08T04:21:44.030 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.030+0000 7f3968688640 1 -- 172.21.15.104:0/2964877463 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f394406b500 msgr2=0x7f394406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.030+0000 7f3968688640 1 --2- 172.21.15.104:0/2964877463 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f394406b500 0x7f394406d9c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f39600af490 tx=0x7f395c009040 comp rx=0 tx=0).stop 2024-05-08T04:21:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.030+0000 7f3968688640 1 -- 172.21.15.104:0/2964877463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39600cdbf0 msgr2=0x7f3960156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.030+0000 7f3968688640 1 --2- 172.21.15.104:0/2964877463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39600cdbf0 0x7f3960156350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f395000c400 tx=0x7f395000c8c0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.030+0000 7f3968688640 1 -- 172.21.15.104:0/2964877463 shutdown_connections 2024-05-08T04:21:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.030+0000 7f3968688640 1 --2- 172.21.15.104:0/2964877463 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f394406b500 0x7f394406d9c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.030+0000 7f3968688640 1 --2- 172.21.15.104:0/2964877463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39600cf360 0x7f39600c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.030+0000 7f3968688640 1 --2- 172.21.15.104:0/2964877463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39600cdbf0 0x7f3960156350 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.030+0000 7f3968688640 1 --2- 172.21.15.104:0/2964877463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3960099a40 0x7f39601f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.030+0000 7f3968688640 1 -- 172.21.15.104:0/2964877463 >> 172.21.15.104:0/2964877463 conn(0x7f39600b3280 msgr2=0x7f39600b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:44.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.030+0000 7f3968688640 1 -- 172.21.15.104:0/2964877463 shutdown_connections 2024-05-08T04:21:44.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.030+0000 7f3968688640 1 -- 172.21.15.104:0/2964877463 wait complete. 2024-05-08T04:21:44.043 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:44.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.145+0000 7fa78e4bd640 1 Processor -- start 2024-05-08T04:21:44.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.145+0000 7fa78e4bd640 1 -- start start 2024-05-08T04:21:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.146+0000 7fa78e4bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7880701a0 0x7fa788070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.146+0000 7fa78e4bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa7880cd120 0x7fa7880cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.146+0000 7fa78e4bd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa788073030 con 0x7fa788158540 2024-05-08T04:21:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.146+0000 7fa78e4bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7880cbf50 con 0x7fa7880cd120 2024-05-08T04:21:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.146+0000 7fa78e4bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa788072210 con 0x7fa7880701a0 2024-05-08T04:21:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.146+0000 7fa7877fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7880701a0 0x7fa788070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.146+0000 7fa78ca5a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa7880cd120 0x7fa7880cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.146+0000 7fa78ca5a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa7880cd120 0x7fa7880cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:48338/0 (socket says 172.21.15.104:48338) 2024-05-08T04:21:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.146+0000 7fa787fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fa788158540 0x7fa78815e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:59270/0 (socket says 172.21.15.104:59270) 2024-05-08T04:21:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.146+0000 7fa7877fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7880701a0 0x7fa788070600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:52456/0 (socket says 172.21.15.104:52456) 2024-05-08T04:21:44.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.146+0000 7fa787fff640 1 -- 172.21.15.104:0/781136780 learned_addr learned my addr 172.21.15.104:0/781136780 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:44.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.147+0000 7fa7877fe640 1 -- 172.21.15.104:0/781136780 >> v2:172.21.15.183:3300/0 conn(0x7fa7880cd120 msgr2=0x7fa7880cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:44.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.147+0000 7fa7877fe640 1 --2- 172.21.15.104:0/781136780 >> v2:172.21.15.183:3300/0 conn(0x7fa7880cd120 0x7fa7880cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.147+0000 7fa7877fe640 1 -- 172.21.15.104:0/781136780 >> v1:172.21.15.183:6789/0 conn(0x7fa788158540 legacy=0x7fa78815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.147+0000 7fa7877fe640 1 -- 172.21.15.104:0/781136780 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7880724b0 con 0x7fa7880701a0 2024-05-08T04:21:44.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.147+0000 7fa78ca5a640 1 --2- 172.21.15.104:0/781136780 >> v2:172.21.15.183:3300/0 conn(0x7fa7880cd120 0x7fa7880cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:44.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.148+0000 7fa7877fe640 1 --2- 172.21.15.104:0/781136780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7880701a0 0x7fa788070600 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0097a0 tx=0x7fa77c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90761976b12d5f7a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:44.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.148+0000 7fa786ffd640 1 -- 172.21.15.104:0/781136780 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c037070 con 0x7fa7880701a0 2024-05-08T04:21:44.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.148+0000 7fa786ffd640 1 -- 172.21.15.104:0/781136780 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c032440 con 0x7fa7880701a0 2024-05-08T04:21:44.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.148+0000 7fa786ffd640 1 -- 172.21.15.104:0/781136780 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c032810 con 0x7fa7880701a0 2024-05-08T04:21:44.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.148+0000 7fa78e4bd640 1 -- 172.21.15.104:0/781136780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7880701a0 msgr2=0x7fa788070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.148+0000 7fa78e4bd640 1 --2- 172.21.15.104:0/781136780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7880701a0 0x7fa788070600 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0097a0 tx=0x7fa77c02a180 comp rx=0 tx=0).stop 2024-05-08T04:21:44.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.148+0000 7fa78e4bd640 1 -- 172.21.15.104:0/781136780 shutdown_connections 2024-05-08T04:21:44.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.148+0000 7fa78e4bd640 1 --2- 172.21.15.104:0/781136780 >> v2:172.21.15.183:3300/0 conn(0x7fa7880cd120 0x7fa7880cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.148+0000 7fa78e4bd640 1 --2- 172.21.15.104:0/781136780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7880701a0 0x7fa788070600 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.148+0000 7fa78e4bd640 1 -- 172.21.15.104:0/781136780 >> 172.21.15.104:0/781136780 conn(0x7fa7880b23e0 msgr2=0x7fa7880b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:44.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.148+0000 7fa78e4bd640 1 -- 172.21.15.104:0/781136780 shutdown_connections 2024-05-08T04:21:44.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.148+0000 7fa78e4bd640 1 -- 172.21.15.104:0/781136780 wait complete. 2024-05-08T04:21:44.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.150+0000 7fa78e4bd640 1 Processor -- start 2024-05-08T04:21:44.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.150+0000 7fa78e4bd640 1 -- start start 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.150+0000 7fa78e4bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7880701a0 0x7fa7880b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.150+0000 7fa78e4bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7880cd120 0x7fa7881e6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.150+0000 7fa78e4bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa788158540 0x7fa7881e6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.150+0000 7fa78e4bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa788072d50 con 0x7fa788158540 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.150+0000 7fa78e4bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa788072a70 con 0x7fa7880701a0 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.150+0000 7fa78e4bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7880cc380 con 0x7fa7880cd120 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa78ca5a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa788158540 0x7fa7881e6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa78ca5a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa788158540 0x7fa7881e6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54258/0 (socket says 172.21.15.104:54258) 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa78ca5a640 1 -- 172.21.15.104:0/3841569423 learned_addr learned my addr 172.21.15.104:0/3841569423 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa787fff640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7880701a0 0x7fa7880b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa7877fe640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7880cd120 0x7fa7881e6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa78ca5a640 1 -- 172.21.15.104:0/3841569423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7880cd120 msgr2=0x7fa7881e6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa78ca5a640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7880cd120 0x7fa7881e6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa78ca5a640 1 -- 172.21.15.104:0/3841569423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7880701a0 msgr2=0x7fa7880b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa78ca5a640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7880701a0 0x7fa7880b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa78ca5a640 1 -- 172.21.15.104:0/3841569423 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7881559e0 con 0x7fa788158540 2024-05-08T04:21:44.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa78ca5a640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa788158540 0x7fa7881e6850 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa78000efc0 tx=0x7fa780009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:44.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa784ff9640 1 -- 172.21.15.104:0/3841569423 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780018030 con 0x7fa788158540 2024-05-08T04:21:44.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa784ff9640 1 -- 172.21.15.104:0/3841569423 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78000cde0 con 0x7fa788158540 2024-05-08T04:21:44.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa784ff9640 1 -- 172.21.15.104:0/3841569423 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780003bb0 con 0x7fa788158540 2024-05-08T04:21:44.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa78e4bd640 1 -- 172.21.15.104:0/3841569423 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa788155cc0 con 0x7fa788158540 2024-05-08T04:21:44.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.151+0000 7fa78e4bd640 1 -- 172.21.15.104:0/3841569423 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa788156280 con 0x7fa788158540 2024-05-08T04:21:44.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.152+0000 7fa78e4bd640 1 -- 172.21.15.104:0/3841569423 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa788075010 con 0x7fa788158540 2024-05-08T04:21:44.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.153+0000 7fa784ff9640 1 -- 172.21.15.104:0/3841569423 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa78001b070 con 0x7fa788158540 2024-05-08T04:21:44.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.153+0000 7fa784ff9640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa77406b4d0 0x7fa77406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.153+0000 7fa787fff640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa77406b4d0 0x7fa77406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.153+0000 7fa784ff9640 1 -- 172.21.15.104:0/3841569423 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa78008ac00 con 0x7fa788158540 2024-05-08T04:21:44.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.154+0000 7fa787fff640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa77406b4d0 0x7fa77406d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa7880b64d0 tx=0x7fa778009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:44.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.158+0000 7fa784ff9640 1 -- 172.21.15.104:0/3841569423 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa780091080 con 0x7fa788158540 2024-05-08T04:21:44.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.332+0000 7fa78e4bd640 1 -- 172.21.15.104:0/3841569423 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7880743b0 con 0x7fa788158540 2024-05-08T04:21:44.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.332+0000 7fa784ff9640 1 -- 172.21.15.104:0/3841569423 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa780010040 con 0x7fa788158540 2024-05-08T04:21:44.334 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:44.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.334+0000 7fa78e4bd640 1 -- 172.21.15.104:0/3841569423 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa77406b4d0 msgr2=0x7fa77406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.334+0000 7fa78e4bd640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa77406b4d0 0x7fa77406d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa7880b64d0 tx=0x7fa778009040 comp rx=0 tx=0).stop 2024-05-08T04:21:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.334+0000 7fa78e4bd640 1 -- 172.21.15.104:0/3841569423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa788158540 msgr2=0x7fa7881e6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.334+0000 7fa78e4bd640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa788158540 0x7fa7881e6850 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa78000efc0 tx=0x7fa780009f90 comp rx=0 tx=0).stop 2024-05-08T04:21:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.334+0000 7fa78e4bd640 1 -- 172.21.15.104:0/3841569423 shutdown_connections 2024-05-08T04:21:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.334+0000 7fa78e4bd640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa77406b4d0 0x7fa77406d990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.334+0000 7fa78e4bd640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa788158540 0x7fa7881e6850 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.334+0000 7fa78e4bd640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7880cd120 0x7fa7881e6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.334+0000 7fa78e4bd640 1 --2- 172.21.15.104:0/3841569423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7880701a0 0x7fa7880b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.334+0000 7fa78e4bd640 1 -- 172.21.15.104:0/3841569423 >> 172.21.15.104:0/3841569423 conn(0x7fa7880b23e0 msgr2=0x7fa7880cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.334+0000 7fa78e4bd640 1 -- 172.21.15.104:0/3841569423 shutdown_connections 2024-05-08T04:21:44.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.334+0000 7fa78e4bd640 1 -- 172.21.15.104:0/3841569423 wait complete. 2024-05-08T04:21:44.347 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:21:44.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.445+0000 7f3fd6d16640 1 Processor -- start 2024-05-08T04:21:44.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.445+0000 7f3fd6d16640 1 -- start start 2024-05-08T04:21:44.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.445+0000 7f3fd6d16640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3fd0099a40 0x7f3fd0099e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.445+0000 7f3fd6d16640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd00cf360 0x7f3fd00cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.445+0000 7f3fd6d16640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3fd015f540 0x7f3fd015f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.445+0000 7f3fd6d16640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd015ced0 con 0x7f3fd015f540 2024-05-08T04:21:44.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.445+0000 7f3fd6d16640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd00cc700 con 0x7f3fd0099a40 2024-05-08T04:21:44.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.445+0000 7f3fd6d16640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd009a360 con 0x7f3fd00cf360 2024-05-08T04:21:44.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.446+0000 7f3fd52b3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3fd015f540 0x7f3fd015f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.446+0000 7f3fd52b3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3fd015f540 0x7f3fd015f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54270/0 (socket says 172.21.15.104:54270) 2024-05-08T04:21:44.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.446+0000 7f3fd52b3640 1 -- 172.21.15.104:0/3887497561 learned_addr learned my addr 172.21.15.104:0/3887497561 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:44.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.446+0000 7f3fd4ab2640 1 --2- 172.21.15.104:0/3887497561 >> v2:172.21.15.183:3300/0 conn(0x7f3fd0099a40 0x7f3fd0099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.446+0000 7f3fcffff640 1 --2- 172.21.15.104:0/3887497561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd00cf360 0x7f3fd00cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.446+0000 7f3fd52b3640 1 -- 172.21.15.104:0/3887497561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd00cf360 msgr2=0x7f3fd00cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.446+0000 7f3fd52b3640 1 --2- 172.21.15.104:0/3887497561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd00cf360 0x7f3fd00cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.446+0000 7f3fd52b3640 1 -- 172.21.15.104:0/3887497561 >> v2:172.21.15.183:3300/0 conn(0x7f3fd0099a40 msgr2=0x7f3fd0099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.446+0000 7f3fd52b3640 1 --2- 172.21.15.104:0/3887497561 >> v2:172.21.15.183:3300/0 conn(0x7f3fd0099a40 0x7f3fd0099e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.446+0000 7f3fd52b3640 1 -- 172.21.15.104:0/3887497561 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd00d0020 con 0x7f3fd015f540 2024-05-08T04:21:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.446+0000 7f3fd4ab2640 1 --2- 172.21.15.104:0/3887497561 >> v2:172.21.15.183:3300/0 conn(0x7f3fd0099a40 0x7f3fd0099e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.446+0000 7f3fd52b3640 1 --2- 172.21.15.104:0/3887497561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd015f540 0x7f3fd015f990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0072ec0 tx=0x7f3fc802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956773f1203e3b75 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.447+0000 7f3fcf7fe640 1 -- 172.21.15.104:0/3887497561 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8036070 con 0x7f3fd015f540 2024-05-08T04:21:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.447+0000 7f3fcf7fe640 1 -- 172.21.15.104:0/3887497561 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc8031600 con 0x7f3fd015f540 2024-05-08T04:21:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.447+0000 7f3fcf7fe640 1 -- 172.21.15.104:0/3887497561 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc80319d0 con 0x7f3fd015f540 2024-05-08T04:21:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.447+0000 7f3fd6d16640 1 -- 172.21.15.104:0/3887497561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd015f540 msgr2=0x7f3fd015f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.447+0000 7f3fd6d16640 1 --2- 172.21.15.104:0/3887497561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd015f540 0x7f3fd015f990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0072ec0 tx=0x7f3fc802a6a0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.447+0000 7f3fd6d16640 1 -- 172.21.15.104:0/3887497561 shutdown_connections 2024-05-08T04:21:44.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.447+0000 7f3fd6d16640 1 --2- 172.21.15.104:0/3887497561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd015f540 0x7f3fd015f990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.447+0000 7f3fd6d16640 1 --2- 172.21.15.104:0/3887497561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd00cf360 0x7f3fd00cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.447+0000 7f3fd6d16640 1 --2- 172.21.15.104:0/3887497561 >> v2:172.21.15.183:3300/0 conn(0x7f3fd0099a40 0x7f3fd0099e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.447+0000 7f3fd6d16640 1 -- 172.21.15.104:0/3887497561 >> 172.21.15.104:0/3887497561 conn(0x7f3fd00b3280 msgr2=0x7f3fd00b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:44.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.447+0000 7f3fd6d16640 1 -- 172.21.15.104:0/3887497561 shutdown_connections 2024-05-08T04:21:44.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.447+0000 7f3fd6d16640 1 -- 172.21.15.104:0/3887497561 wait complete. 2024-05-08T04:21:44.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.448+0000 7f3fd6d16640 1 Processor -- start 2024-05-08T04:21:44.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.448+0000 7f3fd6d16640 1 -- start start 2024-05-08T04:21:44.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.449+0000 7f3fd6d16640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd0099a40 0x7f3fd0156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.449+0000 7f3fd6d16640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd00cf360 0x7f3fd00aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.449+0000 7f3fd6d16640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fd015f540 0x7f3fd015dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.449+0000 7f3fd6d16640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd0159860 con 0x7f3fd00cf360 2024-05-08T04:21:44.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.449+0000 7f3fd6d16640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00d05e0 con 0x7f3fd015f540 2024-05-08T04:21:44.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.449+0000 7f3fd6d16640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00cfd00 con 0x7f3fd0099a40 2024-05-08T04:21:44.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.449+0000 7f3fcffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd00cf360 0x7f3fd00aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fcffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd00cf360 0x7f3fd00aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54278/0 (socket says 172.21.15.104:54278) 2024-05-08T04:21:44.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fcffff640 1 -- 172.21.15.104:0/143813247 learned_addr learned my addr 172.21.15.104:0/143813247 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:44.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fd4ab2640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd0099a40 0x7f3fd0156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fd52b3640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fd015f540 0x7f3fd015dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fcffff640 1 -- 172.21.15.104:0/143813247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd0099a40 msgr2=0x7f3fd0156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fcffff640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd0099a40 0x7f3fd0156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fcffff640 1 -- 172.21.15.104:0/143813247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fd015f540 msgr2=0x7f3fd015dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fcffff640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fd015f540 0x7f3fd015dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fcffff640 1 -- 172.21.15.104:0/143813247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd00b6bb0 con 0x7f3fd00cf360 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fcffff640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd00cf360 0x7f3fd00aef00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00c7f0 tx=0x7f3fbc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fcd7fa640 1 -- 172.21.15.104:0/143813247 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc015070 con 0x7f3fd00cf360 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fcd7fa640 1 -- 172.21.15.104:0/143813247 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc004240 con 0x7f3fd00cf360 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fd6d16640 1 -- 172.21.15.104:0/143813247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd015eda0 con 0x7f3fd00cf360 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fcd7fa640 1 -- 172.21.15.104:0/143813247 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc007620 con 0x7f3fd00cf360 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.450+0000 7f3fd6d16640 1 -- 172.21.15.104:0/143813247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd015d4d0 con 0x7f3fd00cf360 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.451+0000 7f3fd6d16640 1 -- 172.21.15.104:0/143813247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd0075010 con 0x7f3fd00cf360 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.452+0000 7f3fcd7fa640 1 -- 172.21.15.104:0/143813247 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3fbc0077c0 con 0x7f3fd00cf360 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.452+0000 7f3fcd7fa640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3fb406b500 0x7f3fb406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.452+0000 7f3fd4ab2640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3fb406b500 0x7f3fb406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.452+0000 7f3fcd7fa640 1 -- 172.21.15.104:0/143813247 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fbc089fe0 con 0x7f3fd00cf360 2024-05-08T04:21:44.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.453+0000 7f3fd4ab2640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3fb406b500 0x7f3fb406d9c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4006ab0 tx=0x7f3fc4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:44.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.456+0000 7f3fcd7fa640 1 -- 172.21.15.104:0/143813247 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3fbc058810 con 0x7f3fd00cf360 2024-05-08T04:21:44.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.640+0000 7f3fd6d16640 1 -- 172.21.15.104:0/143813247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3fd0071b90 con 0x7f3fd00cf360 2024-05-08T04:21:44.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.641+0000 7f3fcd7fa640 1 -- 172.21.15.104:0/143813247 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3fbc05c8b0 con 0x7f3fd00cf360 2024-05-08T04:21:44.643 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:21:44.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.643+0000 7f3fd6d16640 1 -- 172.21.15.104:0/143813247 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3fb406b500 msgr2=0x7f3fb406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.643+0000 7f3fd6d16640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3fb406b500 0x7f3fb406d9c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4006ab0 tx=0x7f3fc4008040 comp rx=0 tx=0).stop 2024-05-08T04:21:44.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.643+0000 7f3fd6d16640 1 -- 172.21.15.104:0/143813247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd00cf360 msgr2=0x7f3fd00aef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.643+0000 7f3fd6d16640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd00cf360 0x7f3fd00aef00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00c7f0 tx=0x7f3fbc00ccb0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.643+0000 7f3fd6d16640 1 -- 172.21.15.104:0/143813247 shutdown_connections 2024-05-08T04:21:44.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.643+0000 7f3fd6d16640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3fb406b500 0x7f3fb406d9c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.643+0000 7f3fd6d16640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fd015f540 0x7f3fd015dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.643+0000 7f3fd6d16640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd00cf360 0x7f3fd00aef00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.643+0000 7f3fd6d16640 1 --2- 172.21.15.104:0/143813247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd0099a40 0x7f3fd0156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.643+0000 7f3fd6d16640 1 -- 172.21.15.104:0/143813247 >> 172.21.15.104:0/143813247 conn(0x7f3fd00b3280 msgr2=0x7f3fd00b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:44.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.643+0000 7f3fd6d16640 1 -- 172.21.15.104:0/143813247 shutdown_connections 2024-05-08T04:21:44.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.643+0000 7f3fd6d16640 1 -- 172.21.15.104:0/143813247 wait complete. 2024-05-08T04:21:44.656 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi104.front.sepia.ceph.com... 2024-05-08T04:21:44.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:44.656 DEBUG:teuthology.orchestra.run.smithi104:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-08T04:21:44.681 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:21:44.681 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:21:44.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:44.682 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T04:21:44.745 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:21:44.745 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:21:44.765 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:21:44.765 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:21:44.825 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:44.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.922+0000 7f6ff799d640 1 Processor -- start 2024-05-08T04:21:44.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.922+0000 7f6ff799d640 1 -- start start 2024-05-08T04:21:44.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.923+0000 7f6ff799d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6ff0070c70 0x7f6ff00d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.923+0000 7f6ff799d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6ff0071050 0x7f6ff015c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.923+0000 7f6ff799d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff015d420 con 0x7f6ff015cad0 2024-05-08T04:21:44.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.923+0000 7f6ff799d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff00d16a0 con 0x7f6ff0070c70 2024-05-08T04:21:44.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.923+0000 7f6ff799d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff00d0eb0 con 0x7f6ff0071050 2024-05-08T04:21:44.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.923+0000 7f6ff5739640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6ff0070c70 0x7f6ff00d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.923+0000 7f6ff5739640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6ff0070c70 0x7f6ff00d0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54288/0 (socket says 172.21.15.104:54288) 2024-05-08T04:21:44.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.923+0000 7f6ff5739640 1 -- 172.21.15.104:0/3032963220 learned_addr learned my addr 172.21.15.104:0/3032963220 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:44.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.923+0000 7f6ff4f38640 1 --2- 172.21.15.104:0/3032963220 >> v2:172.21.15.183:3300/0 conn(0x7f6ff0071050 0x7f6ff015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.923+0000 7f6ff5739640 1 -- 172.21.15.104:0/3032963220 >> v2:172.21.15.183:3300/0 conn(0x7f6ff0071050 msgr2=0x7f6ff015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:44.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.924+0000 7f6ff5739640 1 --2- 172.21.15.104:0/3032963220 >> v2:172.21.15.183:3300/0 conn(0x7f6ff0071050 0x7f6ff015c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.924+0000 7f6ff5739640 1 -- 172.21.15.104:0/3032963220 >> v1:172.21.15.183:6789/0 conn(0x7f6ff015cad0 legacy=0x7f6ff015f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:44.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.924+0000 7f6ff5739640 1 -- 172.21.15.104:0/3032963220 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff00d10e0 con 0x7f6ff0070c70 2024-05-08T04:21:44.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.924+0000 7f6ff4f38640 1 --2- 172.21.15.104:0/3032963220 >> v2:172.21.15.183:3300/0 conn(0x7f6ff0071050 0x7f6ff015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:44.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.924+0000 7f6ff5739640 1 --2- 172.21.15.104:0/3032963220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ff0070c70 0x7f6ff00d0970 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6ff004fe80 tx=0x7f6fe002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35daecad1865ab8c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.924+0000 7f6feffff640 1 -- 172.21.15.104:0/3032963220 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0036070 con 0x7f6ff0070c70 2024-05-08T04:21:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.924+0000 7f6feffff640 1 -- 172.21.15.104:0/3032963220 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe0031600 con 0x7f6ff0070c70 2024-05-08T04:21:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.924+0000 7f6feffff640 1 -- 172.21.15.104:0/3032963220 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe00319d0 con 0x7f6ff0070c70 2024-05-08T04:21:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.925+0000 7f6ff799d640 1 -- 172.21.15.104:0/3032963220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ff0070c70 msgr2=0x7f6ff00d0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.925+0000 7f6ff799d640 1 --2- 172.21.15.104:0/3032963220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ff0070c70 0x7f6ff00d0970 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6ff004fe80 tx=0x7f6fe002a6c0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.925+0000 7f6ff799d640 1 -- 172.21.15.104:0/3032963220 shutdown_connections 2024-05-08T04:21:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.925+0000 7f6ff799d640 1 --2- 172.21.15.104:0/3032963220 >> v2:172.21.15.183:3300/0 conn(0x7f6ff0071050 0x7f6ff015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.925+0000 7f6ff799d640 1 --2- 172.21.15.104:0/3032963220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ff0070c70 0x7f6ff00d0970 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.925+0000 7f6ff799d640 1 -- 172.21.15.104:0/3032963220 >> 172.21.15.104:0/3032963220 conn(0x7f6ff00b3450 msgr2=0x7f6ff00b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.925+0000 7f6ff799d640 1 -- 172.21.15.104:0/3032963220 shutdown_connections 2024-05-08T04:21:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.925+0000 7f6ff799d640 1 -- 172.21.15.104:0/3032963220 wait complete. 2024-05-08T04:21:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.926+0000 7f6ff799d640 1 Processor -- start 2024-05-08T04:21:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.926+0000 7f6ff799d640 1 -- start start 2024-05-08T04:21:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff799d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ff0070c70 0x7f6ff01f1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff799d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ff0071050 0x7f6ff0144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff799d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ff015cad0 0x7f6ff01598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff799d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff0071500 con 0x7f6ff0071050 2024-05-08T04:21:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff799d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff015d6c0 con 0x7f6ff015cad0 2024-05-08T04:21:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff799d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff015ebf0 con 0x7f6ff0070c70 2024-05-08T04:21:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff4f38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ff0071050 0x7f6ff0144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff4f38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ff0071050 0x7f6ff0144850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54296/0 (socket says 172.21.15.104:54296) 2024-05-08T04:21:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff4f38640 1 -- 172.21.15.104:0/3168206108 learned_addr learned my addr 172.21.15.104:0/3168206108 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff4f38640 1 -- 172.21.15.104:0/3168206108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ff0070c70 msgr2=0x7f6ff01f1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff4f38640 1 --2- 172.21.15.104:0/3168206108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ff0070c70 0x7f6ff01f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff4f38640 1 -- 172.21.15.104:0/3168206108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ff015cad0 msgr2=0x7f6ff01598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff4f38640 1 --2- 172.21.15.104:0/3168206108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ff015cad0 0x7f6ff01598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff4f38640 1 -- 172.21.15.104:0/3168206108 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff0144d90 con 0x7f6ff0071050 2024-05-08T04:21:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.927+0000 7f6ff4f38640 1 --2- 172.21.15.104:0/3168206108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ff0071050 0x7f6ff0144850 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400c7f0 tx=0x7f6fe400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.928+0000 7f6fedffb640 1 -- 172.21.15.104:0/3168206108 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4015070 con 0x7f6ff0071050 2024-05-08T04:21:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.928+0000 7f6fedffb640 1 -- 172.21.15.104:0/3168206108 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe4007a30 con 0x7f6ff0071050 2024-05-08T04:21:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.928+0000 7f6ff799d640 1 -- 172.21.15.104:0/3168206108 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff01420e0 con 0x7f6ff0071050 2024-05-08T04:21:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.928+0000 7f6fedffb640 1 -- 172.21.15.104:0/3168206108 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4007e00 con 0x7f6ff0071050 2024-05-08T04:21:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.928+0000 7f6ff799d640 1 -- 172.21.15.104:0/3168206108 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff01426a0 con 0x7f6ff0071050 2024-05-08T04:21:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.929+0000 7f6ff799d640 1 -- 172.21.15.104:0/3168206108 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff0075010 con 0x7f6ff0071050 2024-05-08T04:21:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.929+0000 7f6fedffb640 1 -- 172.21.15.104:0/3168206108 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6fe4018070 con 0x7f6ff0071050 2024-05-08T04:21:44.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.930+0000 7f6fedffb640 1 --2- 172.21.15.104:0/3168206108 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6fdc06b4d0 0x7f6fdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:44.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.930+0000 7f6fedffb640 1 -- 172.21.15.104:0/3168206108 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fe408a170 con 0x7f6ff0071050 2024-05-08T04:21:44.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.930+0000 7f6ff5739640 1 --2- 172.21.15.104:0/3168206108 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6fdc06b4d0 0x7f6fdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:44.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.930+0000 7f6ff5739640 1 --2- 172.21.15.104:0/3168206108 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6fdc06b4d0 0x7f6fdc06d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0033000 tx=0x7f6fe002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:44.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:44.936+0000 7f6fedffb640 1 -- 172.21.15.104:0/3168206108 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6ff0144d90 con 0x7f6ff0071050 2024-05-08T04:21:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.107+0000 7f6ff799d640 1 -- 172.21.15.104:0/3168206108 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ff006ebe0 con 0x7f6ff0071050 2024-05-08T04:21:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.109+0000 7f6fedffb640 1 -- 172.21.15.104:0/3168206108 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f6fe4058ff0 con 0x7f6ff0071050 2024-05-08T04:21:45.111 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:45.111 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:45.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.111+0000 7f6ff799d640 1 -- 172.21.15.104:0/3168206108 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6fdc06b4d0 msgr2=0x7f6fdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.111+0000 7f6ff799d640 1 --2- 172.21.15.104:0/3168206108 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6fdc06b4d0 0x7f6fdc06d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0033000 tx=0x7f6fe002e000 comp rx=0 tx=0).stop 2024-05-08T04:21:45.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.111+0000 7f6ff799d640 1 -- 172.21.15.104:0/3168206108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ff0071050 msgr2=0x7f6ff0144850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.111+0000 7f6ff799d640 1 --2- 172.21.15.104:0/3168206108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ff0071050 0x7f6ff0144850 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400c7f0 tx=0x7f6fe400cbf0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.111+0000 7f6ff799d640 1 -- 172.21.15.104:0/3168206108 shutdown_connections 2024-05-08T04:21:45.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.111+0000 7f6ff799d640 1 --2- 172.21.15.104:0/3168206108 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6fdc06b4d0 0x7f6fdc06d990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.111+0000 7f6ff799d640 1 --2- 172.21.15.104:0/3168206108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ff015cad0 0x7f6ff01598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.111+0000 7f6ff799d640 1 --2- 172.21.15.104:0/3168206108 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ff0071050 0x7f6ff0144850 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.111+0000 7f6ff799d640 1 --2- 172.21.15.104:0/3168206108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ff0070c70 0x7f6ff01f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.111+0000 7f6ff799d640 1 -- 172.21.15.104:0/3168206108 >> 172.21.15.104:0/3168206108 conn(0x7f6ff00b3450 msgr2=0x7f6ff0152370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:45.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.111+0000 7f6ff799d640 1 -- 172.21.15.104:0/3168206108 shutdown_connections 2024-05-08T04:21:45.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.111+0000 7f6ff799d640 1 -- 172.21.15.104:0/3168206108 wait complete. 2024-05-08T04:21:45.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:45.124 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:45.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.225+0000 7f86a0bce640 1 Processor -- start 2024-05-08T04:21:45.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.225+0000 7f86a0bce640 1 -- start start 2024-05-08T04:21:45.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.226+0000 7f86a0bce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f869c072160 0x7f869c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.226+0000 7f86a0bce640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f869c15a2a0 0x7f869c15b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.226+0000 7f86a0bce640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869c15dce0 con 0x7f869c159ec0 2024-05-08T04:21:45.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.226+0000 7f86a0bce640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869c06eb60 con 0x7f869c15a2a0 2024-05-08T04:21:45.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.226+0000 7f86a0bce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869c06ee40 con 0x7f869c072160 2024-05-08T04:21:45.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.226+0000 7f869ad9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f869c15a2a0 0x7f869c15b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.226+0000 7f869ad9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f869c15a2a0 0x7f869c15b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54300/0 (socket says 172.21.15.104:54300) 2024-05-08T04:21:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.226+0000 7f869ad9d640 1 -- 172.21.15.104:0/3897617274 learned_addr learned my addr 172.21.15.104:0/3897617274 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.226+0000 7f8691d9b640 1 --2- 172.21.15.104:0/3897617274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f869c072160 0x7f869c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.226+0000 7f869ad9d640 1 -- 172.21.15.104:0/3897617274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f869c072160 msgr2=0x7f869c06e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.226+0000 7f869ad9d640 1 --2- 172.21.15.104:0/3897617274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f869c072160 0x7f869c06e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.226+0000 7f869ad9d640 1 -- 172.21.15.104:0/3897617274 >> v1:172.21.15.183:6789/0 conn(0x7f869c159ec0 legacy=0x7f869c071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.226+0000 7f869ad9d640 1 -- 172.21.15.104:0/3897617274 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c15df80 con 0x7f869c15a2a0 2024-05-08T04:21:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.227+0000 7f869ad9d640 1 --2- 172.21.15.104:0/3897617274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f869c15a2a0 0x7f869c15b1e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8694009e50 tx=0x7f869402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8c41f2064d58ab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.227+0000 7f8699d9b640 1 -- 172.21.15.104:0/3897617274 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694036070 con 0x7f869c15a2a0 2024-05-08T04:21:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.227+0000 7f8699d9b640 1 -- 172.21.15.104:0/3897617274 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8694031600 con 0x7f869c15a2a0 2024-05-08T04:21:45.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.227+0000 7f8699d9b640 1 -- 172.21.15.104:0/3897617274 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940319d0 con 0x7f869c15a2a0 2024-05-08T04:21:45.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.228+0000 7f86a0bce640 1 -- 172.21.15.104:0/3897617274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f869c15a2a0 msgr2=0x7f869c15b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.228+0000 7f86a0bce640 1 --2- 172.21.15.104:0/3897617274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f869c15a2a0 0x7f869c15b1e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8694009e50 tx=0x7f869402a6c0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.228+0000 7f86a0bce640 1 -- 172.21.15.104:0/3897617274 shutdown_connections 2024-05-08T04:21:45.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.228+0000 7f86a0bce640 1 --2- 172.21.15.104:0/3897617274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f869c15a2a0 0x7f869c15b1e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.228+0000 7f86a0bce640 1 --2- 172.21.15.104:0/3897617274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f869c072160 0x7f869c06e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.228+0000 7f86a0bce640 1 -- 172.21.15.104:0/3897617274 >> 172.21.15.104:0/3897617274 conn(0x7f869c0b13f0 msgr2=0x7f869c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:45.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.228+0000 7f86a0bce640 1 -- 172.21.15.104:0/3897617274 shutdown_connections 2024-05-08T04:21:45.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.228+0000 7f86a0bce640 1 -- 172.21.15.104:0/3897617274 wait complete. 2024-05-08T04:21:45.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.229+0000 7f86a0bce640 1 Processor -- start 2024-05-08T04:21:45.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.229+0000 7f86a0bce640 1 -- start start 2024-05-08T04:21:45.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f86a0bce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f869c072160 0x7f869c147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f86a0bce640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f869c159ec0 0x7f869c1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f86a0bce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f869c15a2a0 0x7f869c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f86a0bce640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c15e900 con 0x7f869c15a2a0 2024-05-08T04:21:45.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f86a0bce640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c15e780 con 0x7f869c159ec0 2024-05-08T04:21:45.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f86a0bce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869c15ea80 con 0x7f869c072160 2024-05-08T04:21:45.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f869ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f869c15a2a0 0x7f869c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f869ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f869c15a2a0 0x7f869c0b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54304/0 (socket says 172.21.15.104:54304) 2024-05-08T04:21:45.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f869ad9d640 1 -- 172.21.15.104:0/2199048920 learned_addr learned my addr 172.21.15.104:0/2199048920 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:45.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f8691d9b640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f869c159ec0 0x7f869c1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f869a59c640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f869c072160 0x7f869c147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f869ad9d640 1 -- 172.21.15.104:0/2199048920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f869c072160 msgr2=0x7f869c147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f869ad9d640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f869c072160 0x7f869c147fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f869ad9d640 1 -- 172.21.15.104:0/2199048920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f869c159ec0 msgr2=0x7f869c1509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f869ad9d640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f869c159ec0 0x7f869c1509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f869ad9d640 1 -- 172.21.15.104:0/2199048920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c153a20 con 0x7f869c15a2a0 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.230+0000 7f869ad9d640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f869c15a2a0 0x7f869c0b36f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8694009e50 tx=0x7f8694004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.231+0000 7f86937fe640 1 -- 172.21.15.104:0/2199048920 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694036050 con 0x7f869c15a2a0 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.231+0000 7f86937fe640 1 -- 172.21.15.104:0/2199048920 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8694042070 con 0x7f869c15a2a0 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.231+0000 7f86a0bce640 1 -- 172.21.15.104:0/2199048920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869c0cd1d0 con 0x7f869c15a2a0 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.231+0000 7f86937fe640 1 -- 172.21.15.104:0/2199048920 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694009510 con 0x7f869c15a2a0 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.231+0000 7f86a0bce640 1 -- 172.21.15.104:0/2199048920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869c153740 con 0x7f869c15a2a0 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.232+0000 7f86a0bce640 1 -- 172.21.15.104:0/2199048920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f869c075010 con 0x7f869c15a2a0 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.232+0000 7f86937fe640 1 -- 172.21.15.104:0/2199048920 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8694007bd0 con 0x7f869c15a2a0 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.233+0000 7f86937fe640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f867c06b4d0 0x7f867c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.233+0000 7f86937fe640 1 -- 172.21.15.104:0/2199048920 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86940aaeb0 con 0x7f869c15a2a0 2024-05-08T04:21:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.233+0000 7f869a59c640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f867c06b4d0 0x7f867c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.233+0000 7f869a59c640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f867c06b4d0 0x7f867c06d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f868c004f60 tx=0x7f868c007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:45.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.237+0000 7f86937fe640 1 -- 172.21.15.104:0/2199048920 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8694079770 con 0x7f869c15a2a0 2024-05-08T04:21:45.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.405+0000 7f86a0bce640 1 -- 172.21.15.104:0/2199048920 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f869c0b2cb0 con 0x7f869c15a2a0 2024-05-08T04:21:45.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.405+0000 7f86937fe640 1 -- 172.21.15.104:0/2199048920 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f869407d810 con 0x7f869c15a2a0 2024-05-08T04:21:45.408 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.407+0000 7f86a0bce640 1 -- 172.21.15.104:0/2199048920 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f867c06b4d0 msgr2=0x7f867c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.407+0000 7f86a0bce640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f867c06b4d0 0x7f867c06d990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f868c004f60 tx=0x7f868c007e30 comp rx=0 tx=0).stop 2024-05-08T04:21:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.407+0000 7f86a0bce640 1 -- 172.21.15.104:0/2199048920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f869c15a2a0 msgr2=0x7f869c0b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.407+0000 7f86a0bce640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f869c15a2a0 0x7f869c0b36f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8694009e50 tx=0x7f8694004a40 comp rx=0 tx=0).stop 2024-05-08T04:21:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.407+0000 7f86a0bce640 1 -- 172.21.15.104:0/2199048920 shutdown_connections 2024-05-08T04:21:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.407+0000 7f86a0bce640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f867c06b4d0 0x7f867c06d990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.407+0000 7f86a0bce640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f869c159ec0 0x7f869c1509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.407+0000 7f86a0bce640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f869c15a2a0 0x7f869c0b36f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.407+0000 7f86a0bce640 1 --2- 172.21.15.104:0/2199048920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f869c072160 0x7f869c147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.407+0000 7f86a0bce640 1 -- 172.21.15.104:0/2199048920 >> 172.21.15.104:0/2199048920 conn(0x7f869c0b13f0 msgr2=0x7f869c14f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.407+0000 7f86a0bce640 1 -- 172.21.15.104:0/2199048920 shutdown_connections 2024-05-08T04:21:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.407+0000 7f86a0bce640 1 -- 172.21.15.104:0/2199048920 wait complete. 2024-05-08T04:21:45.421 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:45.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.521+0000 7fafe259e640 1 Processor -- start 2024-05-08T04:21:45.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.521+0000 7fafe259e640 1 -- start start 2024-05-08T04:21:45.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.522+0000 7fafe259e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc0d3320 0x7fafdc0d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.522+0000 7fafe259e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fafdc0ce5f0 0x7fafdc0cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.522+0000 7fafe259e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafdc0d2280 con 0x7fafdc15de40 2024-05-08T04:21:45.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.522+0000 7fafe259e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafdc0cefa0 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.522+0000 7fafe259e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc0b7960 con 0x7fafdc0d3320 2024-05-08T04:21:45.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.522+0000 7fafe0d9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc0d3320 0x7fafdc0d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.523+0000 7fafe1d9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fafdc0ce5f0 0x7fafdc0cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.523+0000 7fafe0d9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc0d3320 0x7fafdc0d1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:52518/0 (socket says 172.21.15.104:52518) 2024-05-08T04:21:45.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.523+0000 7fafe0d9b640 1 -- 172.21.15.104:0/178814792 learned_addr learned my addr 172.21.15.104:0/178814792 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:45.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.523+0000 7fafe0d9b640 1 -- 172.21.15.104:0/178814792 >> v2:172.21.15.183:3300/0 conn(0x7fafdc0ce5f0 msgr2=0x7fafdc0cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:45.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.523+0000 7fafe0d9b640 1 --2- 172.21.15.104:0/178814792 >> v2:172.21.15.183:3300/0 conn(0x7fafdc0ce5f0 0x7fafdc0cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.523+0000 7fafe0d9b640 1 -- 172.21.15.104:0/178814792 >> v1:172.21.15.183:6789/0 conn(0x7fafdc15de40 legacy=0x7fafdc0b9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.523+0000 7fafe0d9b640 1 -- 172.21.15.104:0/178814792 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc0d2560 con 0x7fafdc0d3320 2024-05-08T04:21:45.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.524+0000 7fafe0d9b640 1 --2- 172.21.15.104:0/178814792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc0d3320 0x7fafdc0d1bf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009870 tx=0x7fafcc02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfa451681b2b258a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:45.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.524+0000 7fafd3fff640 1 -- 172.21.15.104:0/178814792 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc037070 con 0x7fafdc0d3320 2024-05-08T04:21:45.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.524+0000 7fafd3fff640 1 -- 172.21.15.104:0/178814792 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc032440 con 0x7fafdc0d3320 2024-05-08T04:21:45.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.524+0000 7fafd3fff640 1 -- 172.21.15.104:0/178814792 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc032810 con 0x7fafdc0d3320 2024-05-08T04:21:45.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.524+0000 7fafe259e640 1 -- 172.21.15.104:0/178814792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc0d3320 msgr2=0x7fafdc0d1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.524+0000 7fafe259e640 1 --2- 172.21.15.104:0/178814792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc0d3320 0x7fafdc0d1bf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009870 tx=0x7fafcc02a1c0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.524+0000 7fafe259e640 1 -- 172.21.15.104:0/178814792 shutdown_connections 2024-05-08T04:21:45.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.524+0000 7fafe259e640 1 --2- 172.21.15.104:0/178814792 >> v2:172.21.15.183:3300/0 conn(0x7fafdc0ce5f0 0x7fafdc0cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.524+0000 7fafe259e640 1 --2- 172.21.15.104:0/178814792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc0d3320 0x7fafdc0d1bf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.524+0000 7fafe259e640 1 -- 172.21.15.104:0/178814792 >> 172.21.15.104:0/178814792 conn(0x7fafdc0726b0 msgr2=0x7fafdc072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:45.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.524+0000 7fafe259e640 1 -- 172.21.15.104:0/178814792 shutdown_connections 2024-05-08T04:21:45.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.524+0000 7fafe259e640 1 -- 172.21.15.104:0/178814792 wait complete. 2024-05-08T04:21:45.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.526+0000 7fafe259e640 1 Processor -- start 2024-05-08T04:21:45.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.526+0000 7fafe259e640 1 -- start start 2024-05-08T04:21:45.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.526+0000 7fafe259e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafdc0ce5f0 0x7fafdc1f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe259e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafdc0d3320 0x7fafdc0cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe259e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc15de40 0x7fafdc0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe259e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc0b6950 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe259e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc0d2b20 con 0x7fafdc0d3320 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe259e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc0b6ad0 con 0x7fafdc15de40 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe159c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafdc0ce5f0 0x7fafdc1f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe159c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafdc0ce5f0 0x7fafdc1f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54310/0 (socket says 172.21.15.104:54310) 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe159c640 1 -- 172.21.15.104:0/4174543590 learned_addr learned my addr 172.21.15.104:0/4174543590 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe1d9d640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc15de40 0x7fafdc0cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe0d9b640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafdc0d3320 0x7fafdc0cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe159c640 1 -- 172.21.15.104:0/4174543590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc15de40 msgr2=0x7fafdc0cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe159c640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc15de40 0x7fafdc0cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe159c640 1 -- 172.21.15.104:0/4174543590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafdc0d3320 msgr2=0x7fafdc0cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe159c640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafdc0d3320 0x7fafdc0cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe159c640 1 -- 172.21.15.104:0/4174543590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc15e350 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe159c640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafdc0ce5f0 0x7fafdc1f4840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fafd800c3c0 tx=0x7fafd800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:45.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafd1ffb640 1 -- 172.21.15.104:0/4174543590 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd80052d0 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafd1ffb640 1 -- 172.21.15.104:0/4174543590 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd8005490 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafd1ffb640 1 -- 172.21.15.104:0/4174543590 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8007260 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.527+0000 7fafe259e640 1 -- 172.21.15.104:0/4174543590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafdc15e630 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.528+0000 7fafe259e640 1 -- 172.21.15.104:0/4174543590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafdc15ebf0 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.528+0000 7fafe259e640 1 -- 172.21.15.104:0/4174543590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafdc074fa0 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.529+0000 7fafd1ffb640 1 -- 172.21.15.104:0/4174543590 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fafd8007400 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.529+0000 7fafd1ffb640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fafc006b4d0 0x7fafc006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.529+0000 7fafe0d9b640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fafc006b4d0 0x7fafc006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.529+0000 7fafd1ffb640 1 -- 172.21.15.104:0/4174543590 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafd8089610 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.530+0000 7fafe0d9b640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fafc006b4d0 0x7fafc006d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fafcc034000 tx=0x7fafcc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:45.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.534+0000 7fafd1ffb640 1 -- 172.21.15.104:0/4174543590 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fafd8058520 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.702+0000 7fafe259e640 1 -- 172.21.15.104:0/4174543590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafdc06ae80 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.703+0000 7fafd1ffb640 1 -- 172.21.15.104:0/4174543590 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafd8057e20 con 0x7fafdc0ce5f0 2024-05-08T04:21:45.705 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:45.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.705+0000 7fafe259e640 1 -- 172.21.15.104:0/4174543590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fafc006b4d0 msgr2=0x7fafc006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.705+0000 7fafe259e640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fafc006b4d0 0x7fafc006d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fafcc034000 tx=0x7fafcc02e000 comp rx=0 tx=0).stop 2024-05-08T04:21:45.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.705+0000 7fafe259e640 1 -- 172.21.15.104:0/4174543590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafdc0ce5f0 msgr2=0x7fafdc1f4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.705+0000 7fafe259e640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafdc0ce5f0 0x7fafdc1f4840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fafd800c3c0 tx=0x7fafd800c880 comp rx=0 tx=0).stop 2024-05-08T04:21:45.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.705+0000 7fafe259e640 1 -- 172.21.15.104:0/4174543590 shutdown_connections 2024-05-08T04:21:45.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.705+0000 7fafe259e640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fafc006b4d0 0x7fafc006d990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.705+0000 7fafe259e640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafdc0d3320 0x7fafdc0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.705+0000 7fafe259e640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc15de40 0x7fafdc0cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.705+0000 7fafe259e640 1 --2- 172.21.15.104:0/4174543590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fafdc0ce5f0 0x7fafdc1f4840 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.705+0000 7fafe259e640 1 -- 172.21.15.104:0/4174543590 >> 172.21.15.104:0/4174543590 conn(0x7fafdc0726b0 msgr2=0x7fafdc0b7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:45.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.705+0000 7fafe259e640 1 -- 172.21.15.104:0/4174543590 shutdown_connections 2024-05-08T04:21:45.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.705+0000 7fafe259e640 1 -- 172.21.15.104:0/4174543590 wait complete. 2024-05-08T04:21:45.718 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:45.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.818+0000 7f7a28f9e640 1 Processor -- start 2024-05-08T04:21:45.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.818+0000 7f7a28f9e640 1 -- start start 2024-05-08T04:21:45.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.818+0000 7f7a28f9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a2415de20 0x7f7a240b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.818+0000 7f7a28f9e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7a240d0150 0x7f7a240cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.818+0000 7f7a28f9e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a240cd7a0 con 0x7f7a240b1d50 2024-05-08T04:21:45.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.818+0000 7f7a28f9e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a240caf50 con 0x7f7a240d0150 2024-05-08T04:21:45.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.818+0000 7f7a28f9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240cda80 con 0x7f7a2415de20 2024-05-08T04:21:45.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.819+0000 7f7a22d9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7a240d0150 0x7f7a240cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.819+0000 7f7a2259c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a2415de20 0x7f7a240b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.819+0000 7f7a22d9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7a240d0150 0x7f7a240cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:48412/0 (socket says 172.21.15.104:48412) 2024-05-08T04:21:45.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.819+0000 7f7a22d9d640 1 -- 172.21.15.104:0/363680170 learned_addr learned my addr 172.21.15.104:0/363680170 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:45.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.819+0000 7f7a22d9d640 1 -- 172.21.15.104:0/363680170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a2415de20 msgr2=0x7f7a240b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:45.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.819+0000 7f7a22d9d640 1 --2- 172.21.15.104:0/363680170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a2415de20 0x7f7a240b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.819+0000 7f7a22d9d640 1 -- 172.21.15.104:0/363680170 >> v1:172.21.15.183:6789/0 conn(0x7f7a240b1d50 legacy=0x7f7a240cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.819+0000 7f7a22d9d640 1 -- 172.21.15.104:0/363680170 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a240cdd60 con 0x7f7a240d0150 2024-05-08T04:21:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.820+0000 7f7a22d9d640 1 --2- 172.21.15.104:0/363680170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a240d0150 0x7f7a240cb3e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009e50 tx=0x7f7a1c02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f457eafe1eadb431 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.820+0000 7f7a21d9b640 1 -- 172.21.15.104:0/363680170 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c036070 con 0x7f7a240d0150 2024-05-08T04:21:45.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.820+0000 7f7a21d9b640 1 -- 172.21.15.104:0/363680170 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c031600 con 0x7f7a240d0150 2024-05-08T04:21:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.820+0000 7f7a21d9b640 1 -- 172.21.15.104:0/363680170 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0319d0 con 0x7f7a240d0150 2024-05-08T04:21:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.821+0000 7f7a28f9e640 1 -- 172.21.15.104:0/363680170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a240d0150 msgr2=0x7f7a240cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.821+0000 7f7a28f9e640 1 --2- 172.21.15.104:0/363680170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a240d0150 0x7f7a240cb3e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009e50 tx=0x7f7a1c02a680 comp rx=0 tx=0).stop 2024-05-08T04:21:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.821+0000 7f7a28f9e640 1 -- 172.21.15.104:0/363680170 shutdown_connections 2024-05-08T04:21:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.821+0000 7f7a28f9e640 1 --2- 172.21.15.104:0/363680170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a240d0150 0x7f7a240cb3e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.821+0000 7f7a28f9e640 1 --2- 172.21.15.104:0/363680170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a2415de20 0x7f7a240b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.821+0000 7f7a28f9e640 1 -- 172.21.15.104:0/363680170 >> 172.21.15.104:0/363680170 conn(0x7f7a240b2220 msgr2=0x7f7a240b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.821+0000 7f7a28f9e640 1 -- 172.21.15.104:0/363680170 shutdown_connections 2024-05-08T04:21:45.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.821+0000 7f7a28f9e640 1 -- 172.21.15.104:0/363680170 wait complete. 2024-05-08T04:21:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.822+0000 7f7a28f9e640 1 Processor -- start 2024-05-08T04:21:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.822+0000 7f7a28f9e640 1 -- start start 2024-05-08T04:21:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a28f9e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a240b1d50 0x7f7a240c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a28f9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a240d0150 0x7f7a241f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a28f9e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a2415de20 0x7f7a241f07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a28f9e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2415e380 con 0x7f7a2415de20 2024-05-08T04:21:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a28f9e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2415e200 con 0x7f7a240b1d50 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a28f9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240cb920 con 0x7f7a240d0150 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a22d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a2415de20 0x7f7a241f07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a22d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a2415de20 0x7f7a241f07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54312/0 (socket says 172.21.15.104:54312) 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a22d9d640 1 -- 172.21.15.104:0/3114538371 learned_addr learned my addr 172.21.15.104:0/3114538371 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a2259c640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a240b1d50 0x7f7a240c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a19d9b640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a240d0150 0x7f7a241f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a22d9d640 1 -- 172.21.15.104:0/3114538371 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a240d0150 msgr2=0x7f7a241f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a22d9d640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a240d0150 0x7f7a241f3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a22d9d640 1 -- 172.21.15.104:0/3114538371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a240b1d50 msgr2=0x7f7a240c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a22d9d640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a240b1d50 0x7f7a240c79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.823+0000 7f7a22d9d640 1 -- 172.21.15.104:0/3114538371 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a241f4580 con 0x7f7a2415de20 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.824+0000 7f7a22d9d640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a2415de20 0x7f7a241f07b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c034040 tx=0x7f7a1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.824+0000 7f7a1b7fe640 1 -- 172.21.15.104:0/3114538371 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c036050 con 0x7f7a2415de20 2024-05-08T04:21:45.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.824+0000 7f7a1b7fe640 1 -- 172.21.15.104:0/3114538371 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c042070 con 0x7f7a2415de20 2024-05-08T04:21:45.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.824+0000 7f7a1b7fe640 1 -- 172.21.15.104:0/3114538371 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c009510 con 0x7f7a2415de20 2024-05-08T04:21:45.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.824+0000 7f7a28f9e640 1 -- 172.21.15.104:0/3114538371 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a241f4860 con 0x7f7a2415de20 2024-05-08T04:21:45.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.824+0000 7f7a28f9e640 1 -- 172.21.15.104:0/3114538371 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a240c5740 con 0x7f7a2415de20 2024-05-08T04:21:45.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.825+0000 7f7a28f9e640 1 -- 172.21.15.104:0/3114538371 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a24075010 con 0x7f7a2415de20 2024-05-08T04:21:45.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.825+0000 7f7a1b7fe640 1 -- 172.21.15.104:0/3114538371 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7a1c007c70 con 0x7f7a2415de20 2024-05-08T04:21:45.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.826+0000 7f7a1b7fe640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7a0406b4d0 0x7f7a0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:45.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.826+0000 7f7a1b7fe640 1 -- 172.21.15.104:0/3114538371 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a1c0aafc0 con 0x7f7a2415de20 2024-05-08T04:21:45.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.826+0000 7f7a2259c640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7a0406b4d0 0x7f7a0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:45.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.826+0000 7f7a2259c640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7a0406b4d0 0x7f7a0406d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009970 tx=0x7f7a14008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:45.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:45.830+0000 7f7a1b7fe640 1 -- 172.21.15.104:0/3114538371 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a1c045360 con 0x7f7a2415de20 2024-05-08T04:21:46.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.001+0000 7f7a28f9e640 1 -- 172.21.15.104:0/3114538371 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a2406f2d0 con 0x7f7a2415de20 2024-05-08T04:21:46.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.002+0000 7f7a1b7fe640 1 -- 172.21.15.104:0/3114538371 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a1c079ed0 con 0x7f7a2415de20 2024-05-08T04:21:46.004 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:46.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.004+0000 7f7a28f9e640 1 -- 172.21.15.104:0/3114538371 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7a0406b4d0 msgr2=0x7f7a0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.004+0000 7f7a28f9e640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7a0406b4d0 0x7f7a0406d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009970 tx=0x7f7a14008040 comp rx=0 tx=0).stop 2024-05-08T04:21:46.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.004+0000 7f7a28f9e640 1 -- 172.21.15.104:0/3114538371 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a2415de20 msgr2=0x7f7a241f07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.004+0000 7f7a28f9e640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a2415de20 0x7f7a241f07b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c034040 tx=0x7f7a1c004a40 comp rx=0 tx=0).stop 2024-05-08T04:21:46.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.004+0000 7f7a28f9e640 1 -- 172.21.15.104:0/3114538371 shutdown_connections 2024-05-08T04:21:46.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.004+0000 7f7a28f9e640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7a0406b4d0 0x7f7a0406d990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.004+0000 7f7a28f9e640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a2415de20 0x7f7a241f07b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.004+0000 7f7a28f9e640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7a240d0150 0x7f7a241f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.004+0000 7f7a28f9e640 1 --2- 172.21.15.104:0/3114538371 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7a240b1d50 0x7f7a240c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.004+0000 7f7a28f9e640 1 -- 172.21.15.104:0/3114538371 >> 172.21.15.104:0/3114538371 conn(0x7f7a240b2220 msgr2=0x7f7a240ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:46.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.004+0000 7f7a28f9e640 1 -- 172.21.15.104:0/3114538371 shutdown_connections 2024-05-08T04:21:46.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.004+0000 7f7a28f9e640 1 -- 172.21.15.104:0/3114538371 wait complete. 2024-05-08T04:21:46.017 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:21:46.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.114+0000 7f85fcbdb640 1 Processor -- start 2024-05-08T04:21:46.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.114+0000 7f85fcbdb640 1 -- start start 2024-05-08T04:21:46.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.115+0000 7f85fcbdb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85f80b4700 0x7f85f80b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.115+0000 7f85fcbdb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f815e780 con 0x7f85f806ea40 2024-05-08T04:21:46.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.115+0000 7f85fcbdb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f815ea60 con 0x7f85f80ceee0 2024-05-08T04:21:46.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.115+0000 7f85fcbdb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f815f390 con 0x7f85f80b4700 2024-05-08T04:21:46.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.115+0000 7f85f5d9b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f85f806ea40 0x7f85f80b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43242/0 (socket says 172.21.15.104:43242) 2024-05-08T04:21:46.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.115+0000 7f85f5d9b640 1 -- 172.21.15.104:0/3323019723 learned_addr learned my addr 172.21.15.104:0/3323019723 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:46.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f6d9d640 1 --2- 172.21.15.104:0/3323019723 >> v2:172.21.15.183:3300/0 conn(0x7f85f80b4700 0x7f85f80b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931731301 0 0) 0x7f85f815e780 con 0x7f85f806ea40 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e4003520 con 0x7f85f806ea40 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2332815277 0 0) 0x7f85e4003520 con 0x7f85f806ea40 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 >> v2:172.21.15.183:3300/0 conn(0x7f85f80b4700 msgr2=0x7f85f80b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 --2- 172.21.15.104:0/3323019723 >> v2:172.21.15.183:3300/0 conn(0x7f85f80b4700 0x7f85f80b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 >> v1:172.21.15.183:6789/0 conn(0x7f85f80ceee0 legacy=0x7f85f806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f815ed40 con 0x7f85f806ea40 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f85e0001670 con 0x7f85f806ea40 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 >> v1:172.21.15.104:6789/0 conn(0x7f85f806ea40 legacy=0x7f85f80b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 --2- 172.21.15.104:0/3323019723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e40039b0 0x7f85e4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 --2- 172.21.15.104:0/3323019723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e4004800 0x7f85e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 --2- 172.21.15.104:0/3323019723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85e40051c0 0x7f85e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f815f390 con 0x7f85e40051c0 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e400c090 con 0x7f85e40039b0 2024-05-08T04:21:46.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e400c290 con 0x7f85e4004800 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f6d9d640 1 --2- 172.21.15.104:0/3323019723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85e40051c0 0x7f85e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f659c640 1 --2- 172.21.15.104:0/3323019723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e40039b0 0x7f85e4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f5d9b640 1 --2- 172.21.15.104:0/3323019723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e4004800 0x7f85e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f6d9d640 1 -- 172.21.15.104:0/3323019723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e4004800 msgr2=0x7f85e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f6d9d640 1 --2- 172.21.15.104:0/3323019723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e4004800 0x7f85e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f6d9d640 1 -- 172.21.15.104:0/3323019723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e40039b0 msgr2=0x7f85e4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f6d9d640 1 --2- 172.21.15.104:0/3323019723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e40039b0 0x7f85e4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.116+0000 7f85f6d9d640 1 -- 172.21.15.104:0/3323019723 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e4003520 con 0x7f85e40051c0 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.117+0000 7f85f6d9d640 1 -- 172.21.15.104:0/3323019723 reap_dead start 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.117+0000 7f85f6d9d640 1 --2- 172.21.15.104:0/3323019723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85e40051c0 0x7f85e400b9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009ac0 tx=0x7f85e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa565a4d8d2f95d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.117+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0009690 con 0x7f85e40051c0 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.117+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f0004030 con 0x7f85e40051c0 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.117+0000 7f85f559a640 1 -- 172.21.15.104:0/3323019723 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0004420 con 0x7f85e40051c0 2024-05-08T04:21:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.118+0000 7f85fcbdb640 1 -- 172.21.15.104:0/3323019723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85e40051c0 msgr2=0x7f85e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.118+0000 7f85fcbdb640 1 --2- 172.21.15.104:0/3323019723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85e40051c0 0x7f85e400b9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009ac0 tx=0x7f85e4005830 comp rx=0 tx=0).stop 2024-05-08T04:21:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.118+0000 7f85fcbdb640 1 -- 172.21.15.104:0/3323019723 shutdown_connections 2024-05-08T04:21:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.118+0000 7f85fcbdb640 1 --2- 172.21.15.104:0/3323019723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85e40051c0 0x7f85e400b9c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.118+0000 7f85fcbdb640 1 -- 172.21.15.104:0/3323019723 >> 172.21.15.104:0/3323019723 conn(0x7f85f80b13f0 msgr2=0x7f85f80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.118+0000 7f85fcbdb640 1 -- 172.21.15.104:0/3323019723 shutdown_connections 2024-05-08T04:21:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.118+0000 7f85fcbdb640 1 -- 172.21.15.104:0/3323019723 wait complete. 2024-05-08T04:21:46.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.119+0000 7f85fcbdb640 1 Processor -- start 2024-05-08T04:21:46.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.119+0000 7f85fcbdb640 1 -- start start 2024-05-08T04:21:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85fcbdb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e40051c0 0x7f85f81f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85fcbdb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85f806de80 0x7f85f8151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85fcbdb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f814fc90 0x7f85f8150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85fcbdb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80cf440 con 0x7f85f806de80 2024-05-08T04:21:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85fcbdb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80cf2c0 con 0x7f85f814fc90 2024-05-08T04:21:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85fcbdb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80b26f0 con 0x7f85e40051c0 2024-05-08T04:21:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85f5d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85f806de80 0x7f85f8151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85f5d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85f806de80 0x7f85f8151a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54340/0 (socket says 172.21.15.104:54340) 2024-05-08T04:21:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85f5d9b640 1 -- 172.21.15.104:0/2938143989 learned_addr learned my addr 172.21.15.104:0/2938143989 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85f5d9b640 1 -- 172.21.15.104:0/2938143989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e40051c0 msgr2=0x7f85f81f0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85f5d9b640 1 --2- 172.21.15.104:0/2938143989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e40051c0 0x7f85f81f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85f5d9b640 1 -- 172.21.15.104:0/2938143989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f814fc90 msgr2=0x7f85f8150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85f5d9b640 1 --2- 172.21.15.104:0/2938143989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f814fc90 0x7f85f8150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85f5d9b640 1 -- 172.21.15.104:0/2938143989 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f8151f50 con 0x7f85f806de80 2024-05-08T04:21:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.120+0000 7f85f5d9b640 1 --2- 172.21.15.104:0/2938143989 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85f806de80 0x7f85f8151a10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f85e00072c0 tx=0x7f85e0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.121+0000 7f85eeffd640 1 -- 172.21.15.104:0/2938143989 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e001a070 con 0x7f85f806de80 2024-05-08T04:21:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.121+0000 7f85eeffd640 1 -- 172.21.15.104:0/2938143989 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e000f960 con 0x7f85f806de80 2024-05-08T04:21:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.121+0000 7f85fcbdb640 1 -- 172.21.15.104:0/2938143989 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f8152ae0 con 0x7f85f806de80 2024-05-08T04:21:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.121+0000 7f85eeffd640 1 -- 172.21.15.104:0/2938143989 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e000fd30 con 0x7f85f806de80 2024-05-08T04:21:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.121+0000 7f85fcbdb640 1 -- 172.21.15.104:0/2938143989 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f81530a0 con 0x7f85f806de80 2024-05-08T04:21:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.122+0000 7f85fcbdb640 1 -- 172.21.15.104:0/2938143989 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f8075010 con 0x7f85f806de80 2024-05-08T04:21:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.122+0000 7f85eeffd640 1 -- 172.21.15.104:0/2938143989 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f85e001d070 con 0x7f85f806de80 2024-05-08T04:21:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.123+0000 7f85eeffd640 1 --2- 172.21.15.104:0/2938143989 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f85d806b4d0 0x7f85d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.123+0000 7f85eeffd640 1 -- 172.21.15.104:0/2938143989 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85e0089a10 con 0x7f85f806de80 2024-05-08T04:21:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.123+0000 7f85f659c640 1 --2- 172.21.15.104:0/2938143989 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f85d806b4d0 0x7f85d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.123+0000 7f85f659c640 1 --2- 172.21.15.104:0/2938143989 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f85d806b4d0 0x7f85d806d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85e8000f80 tx=0x7f85e8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:46.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.127+0000 7f85eeffd640 1 -- 172.21.15.104:0/2938143989 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f85f8151f50 con 0x7f85f806de80 2024-05-08T04:21:46.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.308+0000 7f85fcbdb640 1 -- 172.21.15.104:0/2938143989 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f85f806f3f0 con 0x7f85f806de80 2024-05-08T04:21:46.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.309+0000 7f85eeffd640 1 -- 172.21.15.104:0/2938143989 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f85e0058890 con 0x7f85f806de80 2024-05-08T04:21:46.311 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:21:46.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.311+0000 7f85fcbdb640 1 -- 172.21.15.104:0/2938143989 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f85d806b4d0 msgr2=0x7f85d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.311+0000 7f85fcbdb640 1 --2- 172.21.15.104:0/2938143989 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f85d806b4d0 0x7f85d806d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85e8000f80 tx=0x7f85e8009040 comp rx=0 tx=0).stop 2024-05-08T04:21:46.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.311+0000 7f85fcbdb640 1 -- 172.21.15.104:0/2938143989 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85f806de80 msgr2=0x7f85f8151a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.311+0000 7f85fcbdb640 1 --2- 172.21.15.104:0/2938143989 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85f806de80 0x7f85f8151a10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f85e00072c0 tx=0x7f85e0007780 comp rx=0 tx=0).stop 2024-05-08T04:21:46.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.311+0000 7f85fcbdb640 1 -- 172.21.15.104:0/2938143989 shutdown_connections 2024-05-08T04:21:46.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.311+0000 7f85fcbdb640 1 --2- 172.21.15.104:0/2938143989 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f85d806b4d0 0x7f85d806d990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.311+0000 7f85fcbdb640 1 --2- 172.21.15.104:0/2938143989 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f814fc90 0x7f85f8150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.311+0000 7f85fcbdb640 1 --2- 172.21.15.104:0/2938143989 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85f806de80 0x7f85f8151a10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.311+0000 7f85fcbdb640 1 --2- 172.21.15.104:0/2938143989 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e40051c0 0x7f85f81f0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.311+0000 7f85fcbdb640 1 -- 172.21.15.104:0/2938143989 >> 172.21.15.104:0/2938143989 conn(0x7f85f80b13f0 msgr2=0x7f85f80afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:46.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.311+0000 7f85fcbdb640 1 -- 172.21.15.104:0/2938143989 shutdown_connections 2024-05-08T04:21:46.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.311+0000 7f85fcbdb640 1 -- 172.21.15.104:0/2938143989 wait complete. 2024-05-08T04:21:46.324 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:21:46.324 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:21:46.344 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:46.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.440+0000 7eff42389640 1 Processor -- start 2024-05-08T04:21:46.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.440+0000 7eff42389640 1 -- start start 2024-05-08T04:21:46.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.441+0000 7eff42389640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7eff3c0cc930 0x7eff3c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.441+0000 7eff42389640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7eff3c06e860 0x7eff3c15fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.441+0000 7eff42389640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c071fb0 con 0x7eff3c0711c0 2024-05-08T04:21:46.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.441+0000 7eff42389640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0cd250 con 0x7eff3c06e860 2024-05-08T04:21:46.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.441+0000 7eff42389640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c071710 con 0x7eff3c0cc930 2024-05-08T04:21:46.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.441+0000 7eff40926640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7eff3c06e860 0x7eff3c15fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.441+0000 7eff40926640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7eff3c06e860 0x7eff3c15fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54342/0 (socket says 172.21.15.104:54342) 2024-05-08T04:21:46.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.441+0000 7eff40926640 1 -- 172.21.15.104:0/2730035319 learned_addr learned my addr 172.21.15.104:0/2730035319 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:46.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.442+0000 7eff40926640 1 -- 172.21.15.104:0/2730035319 >> v2:172.21.15.183:3300/0 conn(0x7eff3c0cc930 msgr2=0x7eff3c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:46.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.442+0000 7eff40926640 1 --2- 172.21.15.104:0/2730035319 >> v2:172.21.15.183:3300/0 conn(0x7eff3c0cc930 0x7eff3c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.442+0000 7eff40926640 1 -- 172.21.15.104:0/2730035319 >> v1:172.21.15.183:6789/0 conn(0x7eff3c0711c0 legacy=0x7eff3c15f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:46.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.442+0000 7eff40926640 1 -- 172.21.15.104:0/2730035319 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0719f0 con 0x7eff3c06e860 2024-05-08T04:21:46.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.442+0000 7eff40926640 1 --2- 172.21.15.104:0/2730035319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c06e860 0x7eff3c15fcb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0685c0 tx=0x7eff3402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84763dbbcbc71e1d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:46.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.442+0000 7eff3b7fe640 1 -- 172.21.15.104:0/2730035319 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34036070 con 0x7eff3c06e860 2024-05-08T04:21:46.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.442+0000 7eff3b7fe640 1 -- 172.21.15.104:0/2730035319 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff34031600 con 0x7eff3c06e860 2024-05-08T04:21:46.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.442+0000 7eff3b7fe640 1 -- 172.21.15.104:0/2730035319 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff340319d0 con 0x7eff3c06e860 2024-05-08T04:21:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.443+0000 7eff42389640 1 -- 172.21.15.104:0/2730035319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c06e860 msgr2=0x7eff3c15fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.443+0000 7eff42389640 1 --2- 172.21.15.104:0/2730035319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c06e860 0x7eff3c15fcb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0685c0 tx=0x7eff3402a660 comp rx=0 tx=0).stop 2024-05-08T04:21:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.443+0000 7eff42389640 1 -- 172.21.15.104:0/2730035319 shutdown_connections 2024-05-08T04:21:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.443+0000 7eff42389640 1 --2- 172.21.15.104:0/2730035319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c06e860 0x7eff3c15fcb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.443+0000 7eff42389640 1 --2- 172.21.15.104:0/2730035319 >> v2:172.21.15.183:3300/0 conn(0x7eff3c0cc930 0x7eff3c0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.443+0000 7eff42389640 1 -- 172.21.15.104:0/2730035319 >> 172.21.15.104:0/2730035319 conn(0x7eff3c0b13f0 msgr2=0x7eff3c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.443+0000 7eff42389640 1 -- 172.21.15.104:0/2730035319 shutdown_connections 2024-05-08T04:21:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.443+0000 7eff42389640 1 -- 172.21.15.104:0/2730035319 wait complete. 2024-05-08T04:21:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.444+0000 7eff42389640 1 Processor -- start 2024-05-08T04:21:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.444+0000 7eff42389640 1 -- start start 2024-05-08T04:21:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff42389640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff3c06e860 0x7eff3c139990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff42389640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0711c0 0x7eff3c1432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff42389640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff3c0cc930 0x7eff3c143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff42389640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0cf3b0 con 0x7eff3c0711c0 2024-05-08T04:21:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff42389640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c06d330 con 0x7eff3c0cc930 2024-05-08T04:21:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff42389640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c1453f0 con 0x7eff3c06e860 2024-05-08T04:21:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff33fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0711c0 0x7eff3c1432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff33fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0711c0 0x7eff3c1432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54358/0 (socket says 172.21.15.104:54358) 2024-05-08T04:21:46.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff33fff640 1 -- 172.21.15.104:0/2755615335 learned_addr learned my addr 172.21.15.104:0/2755615335 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:46.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff33fff640 1 -- 172.21.15.104:0/2755615335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff3c06e860 msgr2=0x7eff3c139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff33fff640 1 --2- 172.21.15.104:0/2755615335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff3c06e860 0x7eff3c139990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff33fff640 1 -- 172.21.15.104:0/2755615335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff3c0cc930 msgr2=0x7eff3c143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff33fff640 1 --2- 172.21.15.104:0/2755615335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff3c0cc930 0x7eff3c143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff33fff640 1 -- 172.21.15.104:0/2755615335 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c139ed0 con 0x7eff3c0711c0 2024-05-08T04:21:46.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.445+0000 7eff33fff640 1 --2- 172.21.15.104:0/2755615335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0711c0 0x7eff3c1432f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7eff2400c410 tx=0x7eff2400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:46.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.446+0000 7eff397fa640 1 -- 172.21.15.104:0/2755615335 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24017070 con 0x7eff3c0711c0 2024-05-08T04:21:46.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.446+0000 7eff397fa640 1 -- 172.21.15.104:0/2755615335 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff240035f0 con 0x7eff3c0711c0 2024-05-08T04:21:46.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.446+0000 7eff42389640 1 -- 172.21.15.104:0/2755615335 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c0accd0 con 0x7eff3c0711c0 2024-05-08T04:21:46.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.446+0000 7eff397fa640 1 -- 172.21.15.104:0/2755615335 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24003a20 con 0x7eff3c0711c0 2024-05-08T04:21:46.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.446+0000 7eff42389640 1 -- 172.21.15.104:0/2755615335 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c0ad290 con 0x7eff3c0711c0 2024-05-08T04:21:46.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.447+0000 7eff42389640 1 -- 172.21.15.104:0/2755615335 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c075010 con 0x7eff3c0711c0 2024-05-08T04:21:46.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.447+0000 7eff397fa640 1 -- 172.21.15.104:0/2755615335 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7eff2401a070 con 0x7eff3c0711c0 2024-05-08T04:21:46.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.447+0000 7eff397fa640 1 --2- 172.21.15.104:0/2755615335 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff1c06b4d0 0x7eff1c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.448+0000 7eff397fa640 1 -- 172.21.15.104:0/2755615335 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff24089660 con 0x7eff3c0711c0 2024-05-08T04:21:46.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.448+0000 7eff3bfff640 1 --2- 172.21.15.104:0/2755615335 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff1c06b4d0 0x7eff1c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.448+0000 7eff3bfff640 1 --2- 172.21.15.104:0/2755615335 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff1c06b4d0 0x7eff1c06d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009710 tx=0x7eff2c006c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:46.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.452+0000 7eff397fa640 1 -- 172.21.15.104:0/2755615335 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7eff24058570 con 0x7eff3c0711c0 2024-05-08T04:21:46.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.621+0000 7eff42389640 1 -- 172.21.15.104:0/2755615335 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff3c0af040 con 0x7eff3c0711c0 2024-05-08T04:21:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.622+0000 7eff397fa640 1 -- 172.21.15.104:0/2755615335 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7eff24057e70 con 0x7eff3c0711c0 2024-05-08T04:21:46.624 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:46.625 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:46.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.624+0000 7eff42389640 1 -- 172.21.15.104:0/2755615335 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff1c06b4d0 msgr2=0x7eff1c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.624+0000 7eff42389640 1 --2- 172.21.15.104:0/2755615335 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff1c06b4d0 0x7eff1c06d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009710 tx=0x7eff2c006c90 comp rx=0 tx=0).stop 2024-05-08T04:21:46.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.624+0000 7eff42389640 1 -- 172.21.15.104:0/2755615335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0711c0 msgr2=0x7eff3c1432f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.624+0000 7eff42389640 1 --2- 172.21.15.104:0/2755615335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0711c0 0x7eff3c1432f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7eff2400c410 tx=0x7eff2400c8d0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.624+0000 7eff42389640 1 -- 172.21.15.104:0/2755615335 shutdown_connections 2024-05-08T04:21:46.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.624+0000 7eff42389640 1 --2- 172.21.15.104:0/2755615335 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff1c06b4d0 0x7eff1c06d990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.624+0000 7eff42389640 1 --2- 172.21.15.104:0/2755615335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff3c0cc930 0x7eff3c143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.624+0000 7eff42389640 1 --2- 172.21.15.104:0/2755615335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0711c0 0x7eff3c1432f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.624+0000 7eff42389640 1 --2- 172.21.15.104:0/2755615335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff3c06e860 0x7eff3c139990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.624+0000 7eff42389640 1 -- 172.21.15.104:0/2755615335 >> 172.21.15.104:0/2755615335 conn(0x7eff3c0b13f0 msgr2=0x7eff3c0a8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:46.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.624+0000 7eff42389640 1 -- 172.21.15.104:0/2755615335 shutdown_connections 2024-05-08T04:21:46.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.624+0000 7eff42389640 1 -- 172.21.15.104:0/2755615335 wait complete. 2024-05-08T04:21:46.637 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:46.638 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:46.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.739+0000 7f180b33b640 1 Processor -- start 2024-05-08T04:21:46.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.739+0000 7f180b33b640 1 -- start start 2024-05-08T04:21:46.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.740+0000 7f180b33b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f180415dad0 0x7f18040d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.740+0000 7f180b33b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f18040d35c0 0x7f18040b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.740+0000 7f180b33b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f18040d1fa0 0x7f18040b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.740+0000 7f180b33b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18040b9920 con 0x7f18040d1fa0 2024-05-08T04:21:46.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.740+0000 7f180b33b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18040d2520 con 0x7f18040d35c0 2024-05-08T04:21:46.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.740+0000 7f180b33b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18040d2800 con 0x7f180415dad0 2024-05-08T04:21:46.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.740+0000 7f18098d8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f18040d1fa0 0x7f18040b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.740+0000 7f18098d8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f18040d1fa0 0x7f18040b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54372/0 (socket says 172.21.15.104:54372) 2024-05-08T04:21:46.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.740+0000 7f18098d8640 1 -- 172.21.15.104:0/3742098092 learned_addr learned my addr 172.21.15.104:0/3742098092 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:46.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.741+0000 7f18088d6640 1 --2- 172.21.15.104:0/3742098092 >> v2:172.21.15.183:3300/0 conn(0x7f18040d35c0 0x7f18040b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.741+0000 7f18090d7640 1 --2- 172.21.15.104:0/3742098092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f180415dad0 0x7f18040d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.741+0000 7f18098d8640 1 -- 172.21.15.104:0/3742098092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f180415dad0 msgr2=0x7f18040d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:46.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.741+0000 7f18098d8640 1 --2- 172.21.15.104:0/3742098092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f180415dad0 0x7f18040d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.741+0000 7f18098d8640 1 -- 172.21.15.104:0/3742098092 >> v2:172.21.15.183:3300/0 conn(0x7f18040d35c0 msgr2=0x7f18040b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:46.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.741+0000 7f18098d8640 1 --2- 172.21.15.104:0/3742098092 >> v2:172.21.15.183:3300/0 conn(0x7f18040d35c0 0x7f18040b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.741+0000 7f18098d8640 1 -- 172.21.15.104:0/3742098092 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18040d2ae0 con 0x7f18040d1fa0 2024-05-08T04:21:46.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.741+0000 7f18098d8640 1 --2- 172.21.15.104:0/3742098092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18040d1fa0 0x7f18040b59c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f18040d4ac0 tx=0x7f17fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65969b2ceef29275 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.742+0000 7f17fbfff640 1 -- 172.21.15.104:0/3742098092 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc037070 con 0x7f18040d1fa0 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.742+0000 7f17fbfff640 1 -- 172.21.15.104:0/3742098092 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc032440 con 0x7f18040d1fa0 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.742+0000 7f17fbfff640 1 -- 172.21.15.104:0/3742098092 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc032810 con 0x7f18040d1fa0 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.742+0000 7f180b33b640 1 -- 172.21.15.104:0/3742098092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18040d1fa0 msgr2=0x7f18040b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.742+0000 7f180b33b640 1 --2- 172.21.15.104:0/3742098092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18040d1fa0 0x7f18040b59c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f18040d4ac0 tx=0x7f17fc02a1e0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.742+0000 7f180b33b640 1 -- 172.21.15.104:0/3742098092 shutdown_connections 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.742+0000 7f180b33b640 1 --2- 172.21.15.104:0/3742098092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18040d1fa0 0x7f18040b59c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.742+0000 7f180b33b640 1 --2- 172.21.15.104:0/3742098092 >> v2:172.21.15.183:3300/0 conn(0x7f18040d35c0 0x7f18040b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.742+0000 7f180b33b640 1 --2- 172.21.15.104:0/3742098092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f180415dad0 0x7f18040d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.742+0000 7f180b33b640 1 -- 172.21.15.104:0/3742098092 >> 172.21.15.104:0/3742098092 conn(0x7f180406c650 msgr2=0x7f18040d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.742+0000 7f180b33b640 1 -- 172.21.15.104:0/3742098092 shutdown_connections 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.742+0000 7f180b33b640 1 -- 172.21.15.104:0/3742098092 wait complete. 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.743+0000 7f180b33b640 1 Processor -- start 2024-05-08T04:21:46.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.743+0000 7f180b33b640 1 -- start start 2024-05-08T04:21:46.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f180b33b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18040d1fa0 0x7f180414beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f180b33b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18040d35c0 0x7f180414c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f180b33b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f180415dad0 0x7f180415ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f180b33b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180415deb0 con 0x7f18040d1fa0 2024-05-08T04:21:46.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f180b33b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18040d30a0 con 0x7f180415dad0 2024-05-08T04:21:46.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f180b33b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180415e030 con 0x7f18040d35c0 2024-05-08T04:21:46.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f18090d7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18040d1fa0 0x7f180414beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f18090d7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18040d1fa0 0x7f180414beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54382/0 (socket says 172.21.15.104:54382) 2024-05-08T04:21:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f18090d7640 1 -- 172.21.15.104:0/2484636994 learned_addr learned my addr 172.21.15.104:0/2484636994 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f18088d6640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18040d35c0 0x7f180414c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f18098d8640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f180415dad0 0x7f180415ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f18090d7640 1 -- 172.21.15.104:0/2484636994 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18040d35c0 msgr2=0x7f180414c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f18090d7640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18040d35c0 0x7f180414c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f18090d7640 1 -- 172.21.15.104:0/2484636994 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f180415dad0 msgr2=0x7f180415ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f18090d7640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f180415dad0 0x7f180415ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f18090d7640 1 -- 172.21.15.104:0/2484636994 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18040cae90 con 0x7f18040d1fa0 2024-05-08T04:21:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.744+0000 7f18088d6640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18040d35c0 0x7f180414c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.745+0000 7f18098d8640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f180415dad0 0x7f180415ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.745+0000 7f18090d7640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18040d1fa0 0x7f180414beb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f180000efc0 tx=0x7f180000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:46.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.745+0000 7f17f9ffb640 1 -- 172.21.15.104:0/2484636994 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800018020 con 0x7f18040d1fa0 2024-05-08T04:21:46.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.745+0000 7f17f9ffb640 1 -- 172.21.15.104:0/2484636994 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1800014480 con 0x7f18040d1fa0 2024-05-08T04:21:46.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.745+0000 7f180b33b640 1 -- 172.21.15.104:0/2484636994 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18040cb170 con 0x7f18040d1fa0 2024-05-08T04:21:46.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.745+0000 7f17f9ffb640 1 -- 172.21.15.104:0/2484636994 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800014850 con 0x7f18040d1fa0 2024-05-08T04:21:46.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.745+0000 7f180b33b640 1 -- 172.21.15.104:0/2484636994 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18040cb730 con 0x7f18040d1fa0 2024-05-08T04:21:46.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.746+0000 7f180b33b640 1 -- 172.21.15.104:0/2484636994 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1804075010 con 0x7f18040d1fa0 2024-05-08T04:21:46.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.747+0000 7f17f9ffb640 1 -- 172.21.15.104:0/2484636994 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1800005d10 con 0x7f18040d1fa0 2024-05-08T04:21:46.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.747+0000 7f17f9ffb640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f17e806b4d0 0x7f17e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:46.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.747+0000 7f17f9ffb640 1 -- 172.21.15.104:0/2484636994 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f180008ac60 con 0x7f18040d1fa0 2024-05-08T04:21:46.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.747+0000 7f18088d6640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f17e806b4d0 0x7f17e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:46.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.748+0000 7f18088d6640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f17e806b4d0 0x7f17e806d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18040ce430 tx=0x7f17f4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:46.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.751+0000 7f17f9ffb640 1 -- 172.21.15.104:0/2484636994 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1800022070 con 0x7f18040d1fa0 2024-05-08T04:21:46.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.920+0000 7f180b33b640 1 -- 172.21.15.104:0/2484636994 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18040b87d0 con 0x7f18040d1fa0 2024-05-08T04:21:46.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.921+0000 7f17f9ffb640 1 -- 172.21.15.104:0/2484636994 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1800010040 con 0x7f18040d1fa0 2024-05-08T04:21:46.923 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:46.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.923+0000 7f180b33b640 1 -- 172.21.15.104:0/2484636994 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f17e806b4d0 msgr2=0x7f17e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.923+0000 7f180b33b640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f17e806b4d0 0x7f17e806d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18040ce430 tx=0x7f17f4008040 comp rx=0 tx=0).stop 2024-05-08T04:21:46.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.923+0000 7f180b33b640 1 -- 172.21.15.104:0/2484636994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18040d1fa0 msgr2=0x7f180414beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:46.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.923+0000 7f180b33b640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18040d1fa0 0x7f180414beb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f180000efc0 tx=0x7f180000c490 comp rx=0 tx=0).stop 2024-05-08T04:21:46.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.923+0000 7f180b33b640 1 -- 172.21.15.104:0/2484636994 shutdown_connections 2024-05-08T04:21:46.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.923+0000 7f180b33b640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f17e806b4d0 0x7f17e806d990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.923+0000 7f180b33b640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f180415dad0 0x7f180415ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.923+0000 7f180b33b640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18040d35c0 0x7f180414c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.923+0000 7f180b33b640 1 --2- 172.21.15.104:0/2484636994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18040d1fa0 0x7f180414beb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:46.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.923+0000 7f180b33b640 1 -- 172.21.15.104:0/2484636994 >> 172.21.15.104:0/2484636994 conn(0x7f180406c650 msgr2=0x7f18040d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:46.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.923+0000 7f180b33b640 1 -- 172.21.15.104:0/2484636994 shutdown_connections 2024-05-08T04:21:46.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:46.923+0000 7f180b33b640 1 -- 172.21.15.104:0/2484636994 wait complete. 2024-05-08T04:21:46.936 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:47.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.037+0000 7f975ce6f640 1 Processor -- start 2024-05-08T04:21:47.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.037+0000 7f975ce6f640 1 -- start start 2024-05-08T04:21:47.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.037+0000 7f975ce6f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f975815e870 0x7f97580b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.037+0000 7f975ce6f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97580b3b80 0x7f975806e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.037+0000 7f975ce6f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975815ed40 con 0x7f975815b7d0 2024-05-08T04:21:47.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f975ce6f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975806d6d0 con 0x7f975815e870 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f975ce6f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975806d9b0 con 0x7f97580b3b80 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f975659c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f975815b7d0 0x7f975815e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43254/0 (socket says 172.21.15.104:43254) 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f975659c640 1 -- 172.21.15.104:0/862018523 learned_addr learned my addr 172.21.15.104:0/862018523 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178144298 0 0) 0x7f975815ed40 con 0x7f975815b7d0 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9756d9d640 1 --2- 172.21.15.104:0/862018523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97580b3b80 0x7f975806e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9744003520 con 0x7f975815b7d0 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f974ffff640 1 --2- 172.21.15.104:0/862018523 >> v2:172.21.15.183:3300/0 conn(0x7f975815e870 0x7f97580b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1897316124 0 0) 0x7f9744003520 con 0x7f975815b7d0 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97580b3b80 msgr2=0x7f975806e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 --2- 172.21.15.104:0/862018523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97580b3b80 0x7f975806e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 >> v2:172.21.15.183:3300/0 conn(0x7f975815e870 msgr2=0x7f97580b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 --2- 172.21.15.104:0/862018523 >> v2:172.21.15.183:3300/0 conn(0x7f975815e870 0x7f97580b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975806dc90 con 0x7f975815b7d0 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f9748001670 con 0x7f975815b7d0 2024-05-08T04:21:47.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 >> v1:172.21.15.104:6789/0 conn(0x7f975815b7d0 legacy=0x7f975815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 --2- 172.21.15.104:0/862018523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97440039b0 0x7f9744003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 --2- 172.21.15.104:0/862018523 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9744004800 0x7f9744004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 --2- 172.21.15.104:0/862018523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97580b3b80 0x7f97440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975806d6d0 con 0x7f9744004800 2024-05-08T04:21:47.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975806d9b0 con 0x7f97440039b0 2024-05-08T04:21:47.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974400b9c0 con 0x7f97580b3b80 2024-05-08T04:21:47.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f974ffff640 1 --2- 172.21.15.104:0/862018523 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9744004800 0x7f9744004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f975659c640 1 --2- 172.21.15.104:0/862018523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97440039b0 0x7f9744003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.038+0000 7f9756d9d640 1 --2- 172.21.15.104:0/862018523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97580b3b80 0x7f97440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.039+0000 7f974ffff640 1 -- 172.21.15.104:0/862018523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97580b3b80 msgr2=0x7f97440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:47.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.039+0000 7f974ffff640 1 --2- 172.21.15.104:0/862018523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97580b3b80 0x7f97440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.039+0000 7f974ffff640 1 -- 172.21.15.104:0/862018523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97440039b0 msgr2=0x7f9744003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:47.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.039+0000 7f974ffff640 1 --2- 172.21.15.104:0/862018523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97440039b0 0x7f9744003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.039+0000 7f974ffff640 1 -- 172.21.15.104:0/862018523 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744003520 con 0x7f9744004800 2024-05-08T04:21:47.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.039+0000 7f974ffff640 1 --2- 172.21.15.104:0/862018523 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9744004800 0x7f9744004c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9740009ac0 tx=0x7f9744005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc900e4038f2f559 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:47.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.039+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740036070 con 0x7f9744004800 2024-05-08T04:21:47.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.039+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740031400 con 0x7f9744004800 2024-05-08T04:21:47.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.039+0000 7f9755d9b640 1 -- 172.21.15.104:0/862018523 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740009690 con 0x7f9744004800 2024-05-08T04:21:47.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.040+0000 7f975ce6f640 1 -- 172.21.15.104:0/862018523 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9744004800 msgr2=0x7f9744004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.040+0000 7f975ce6f640 1 --2- 172.21.15.104:0/862018523 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9744004800 0x7f9744004c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9740009ac0 tx=0x7f9744005830 comp rx=0 tx=0).stop 2024-05-08T04:21:47.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.040+0000 7f9756d9d640 1 -- 172.21.15.104:0/862018523 reap_dead start 2024-05-08T04:21:47.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.040+0000 7f975ce6f640 1 -- 172.21.15.104:0/862018523 shutdown_connections 2024-05-08T04:21:47.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.040+0000 7f975ce6f640 1 -- 172.21.15.104:0/862018523 >> 172.21.15.104:0/862018523 conn(0x7f97580cfa60 msgr2=0x7f97580cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:47.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.040+0000 7f975ce6f640 1 -- 172.21.15.104:0/862018523 shutdown_connections 2024-05-08T04:21:47.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.040+0000 7f975ce6f640 1 -- 172.21.15.104:0/862018523 wait complete. 2024-05-08T04:21:47.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.041+0000 7f975ce6f640 1 Processor -- start 2024-05-08T04:21:47.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.041+0000 7f975ce6f640 1 -- start start 2024-05-08T04:21:47.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f975ce6f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9744004800 0x7f975814b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f975ce6f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f975806e5f0 0x7f975806ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f975ce6f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f975814bbd0 0x7f975814c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f975ce6f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975815f020 con 0x7f975806e5f0 2024-05-08T04:21:47.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f975ce6f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97580b3fb0 con 0x7f9744004800 2024-05-08T04:21:47.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f975ce6f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975806e1b0 con 0x7f975814bbd0 2024-05-08T04:21:47.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f974ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f975806e5f0 0x7f975806ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f974ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f975806e5f0 0x7f975806ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54408/0 (socket says 172.21.15.104:54408) 2024-05-08T04:21:47.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f974ffff640 1 -- 172.21.15.104:0/2739909390 learned_addr learned my addr 172.21.15.104:0/2739909390 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:47.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f9756d9d640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f975814bbd0 0x7f975814c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f975659c640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9744004800 0x7f975814b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f974ffff640 1 -- 172.21.15.104:0/2739909390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f975814bbd0 msgr2=0x7f975814c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f974ffff640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f975814bbd0 0x7f975814c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.042+0000 7f974ffff640 1 -- 172.21.15.104:0/2739909390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9744004800 msgr2=0x7f975814b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.043+0000 7f974ffff640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9744004800 0x7f975814b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.043+0000 7f974ffff640 1 -- 172.21.15.104:0/2739909390 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9758151f10 con 0x7f975806e5f0 2024-05-08T04:21:47.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.043+0000 7f974ffff640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f975806e5f0 0x7f975806ea70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9740009be0 tx=0x7f9740004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:47.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.043+0000 7f974effd640 1 -- 172.21.15.104:0/2739909390 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740040020 con 0x7f975806e5f0 2024-05-08T04:21:47.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.043+0000 7f974effd640 1 -- 172.21.15.104:0/2739909390 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740003950 con 0x7f975806e5f0 2024-05-08T04:21:47.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.043+0000 7f975ce6f640 1 -- 172.21.15.104:0/2739909390 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975814b8c0 con 0x7f975806e5f0 2024-05-08T04:21:47.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.043+0000 7f974effd640 1 -- 172.21.15.104:0/2739909390 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740036040 con 0x7f975806e5f0 2024-05-08T04:21:47.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.043+0000 7f975ce6f640 1 -- 172.21.15.104:0/2739909390 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975814ca90 con 0x7f975806e5f0 2024-05-08T04:21:47.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.044+0000 7f975ce6f640 1 -- 172.21.15.104:0/2739909390 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9758075010 con 0x7f975806e5f0 2024-05-08T04:21:47.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.044+0000 7f974effd640 1 -- 172.21.15.104:0/2739909390 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9740043020 con 0x7f975806e5f0 2024-05-08T04:21:47.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.045+0000 7f974effd640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f973806b500 0x7f973806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.045+0000 7f974effd640 1 -- 172.21.15.104:0/2739909390 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97400aa390 con 0x7f975806e5f0 2024-05-08T04:21:47.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.045+0000 7f975659c640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f973806b500 0x7f973806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.045+0000 7f975659c640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f973806b500 0x7f973806d9c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f97480015d0 tx=0x7f9748009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:47.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.049+0000 7f974effd640 1 -- 172.21.15.104:0/2739909390 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f974004a070 con 0x7f975806e5f0 2024-05-08T04:21:47.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.219+0000 7f975ce6f640 1 -- 172.21.15.104:0/2739909390 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97580af4e0 con 0x7f975806e5f0 2024-05-08T04:21:47.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.219+0000 7f974effd640 1 -- 172.21.15.104:0/2739909390 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9740079210 con 0x7f975806e5f0 2024-05-08T04:21:47.222 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:47.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.221+0000 7f975ce6f640 1 -- 172.21.15.104:0/2739909390 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f973806b500 msgr2=0x7f973806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.221+0000 7f975ce6f640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f973806b500 0x7f973806d9c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f97480015d0 tx=0x7f9748009040 comp rx=0 tx=0).stop 2024-05-08T04:21:47.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.221+0000 7f975ce6f640 1 -- 172.21.15.104:0/2739909390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f975806e5f0 msgr2=0x7f975806ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.221+0000 7f975ce6f640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f975806e5f0 0x7f975806ea70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9740009be0 tx=0x7f9740004730 comp rx=0 tx=0).stop 2024-05-08T04:21:47.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.221+0000 7f975ce6f640 1 -- 172.21.15.104:0/2739909390 shutdown_connections 2024-05-08T04:21:47.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.221+0000 7f975ce6f640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f973806b500 0x7f973806d9c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.221+0000 7f975ce6f640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f975814bbd0 0x7f975814c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.221+0000 7f975ce6f640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f975806e5f0 0x7f975806ea70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.221+0000 7f975ce6f640 1 --2- 172.21.15.104:0/2739909390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9744004800 0x7f975814b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.221+0000 7f975ce6f640 1 -- 172.21.15.104:0/2739909390 >> 172.21.15.104:0/2739909390 conn(0x7f97580cfa60 msgr2=0x7f975815c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:47.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.221+0000 7f975ce6f640 1 -- 172.21.15.104:0/2739909390 shutdown_connections 2024-05-08T04:21:47.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.221+0000 7f975ce6f640 1 -- 172.21.15.104:0/2739909390 wait complete. 2024-05-08T04:21:47.235 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:47.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.334+0000 7fb3fb2f5640 1 Processor -- start 2024-05-08T04:21:47.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.334+0000 7fb3fb2f5640 1 -- start start 2024-05-08T04:21:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.335+0000 7fb3fb2f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3f4099a40 0x7fb3f4099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.335+0000 7fb3fb2f5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb3f415d490 0x7fb3f415d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.335+0000 7fb3fb2f5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f40cd940 con 0x7fb3f40b2b80 2024-05-08T04:21:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.335+0000 7fb3fb2f5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f409a3e0 con 0x7fb3f415d490 2024-05-08T04:21:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.335+0000 7fb3fb2f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40cc8a0 con 0x7fb3f4099a40 2024-05-08T04:21:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.335+0000 7fb3f9892640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb3f415d490 0x7fb3f415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.335+0000 7fb3f9091640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb3f40b2b80 0x7fb3f409a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43270/0 (socket says 172.21.15.104:43270) 2024-05-08T04:21:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.335+0000 7fb3f9091640 1 -- 172.21.15.104:0/729714326 learned_addr learned my addr 172.21.15.104:0/729714326 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.335+0000 7fb3f9892640 1 -- 172.21.15.104:0/729714326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3f4099a40 msgr2=0x7fb3f4099ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.335+0000 7fb3f9892640 1 --2- 172.21.15.104:0/729714326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3f4099a40 0x7fb3f4099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.335+0000 7fb3f9892640 1 -- 172.21.15.104:0/729714326 >> v1:172.21.15.104:6789/0 conn(0x7fb3f40b2b80 legacy=0x7fb3f409a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.335+0000 7fb3ebfff640 1 -- 172.21.15.104:0/729714326 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816352001 0 0) 0x7fb3f40cd940 con 0x7fb3f40b2b80 2024-05-08T04:21:47.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.335+0000 7fb3f9892640 1 -- 172.21.15.104:0/729714326 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f40ccb80 con 0x7fb3f415d490 2024-05-08T04:21:47.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.336+0000 7fb3f9892640 1 --2- 172.21.15.104:0/729714326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f415d490 0x7fb3f415d920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec009d90 tx=0x7fb3ec02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1fac9002785dbb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:47.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.336+0000 7fb3ebfff640 1 -- 172.21.15.104:0/729714326 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec007740 con 0x7fb3f415d490 2024-05-08T04:21:47.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.336+0000 7fb3ebfff640 1 -- 172.21.15.104:0/729714326 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec0078e0 con 0x7fb3f415d490 2024-05-08T04:21:47.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.336+0000 7fb3ebfff640 1 -- 172.21.15.104:0/729714326 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec007cb0 con 0x7fb3f415d490 2024-05-08T04:21:47.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.337+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/729714326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f415d490 msgr2=0x7fb3f415d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.337+0000 7fb3fb2f5640 1 --2- 172.21.15.104:0/729714326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f415d490 0x7fb3f415d920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec009d90 tx=0x7fb3ec02a6f0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.337+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/729714326 shutdown_connections 2024-05-08T04:21:47.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.337+0000 7fb3fb2f5640 1 --2- 172.21.15.104:0/729714326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f415d490 0x7fb3f415d920 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.337+0000 7fb3fb2f5640 1 --2- 172.21.15.104:0/729714326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3f4099a40 0x7fb3f4099ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.337+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/729714326 >> 172.21.15.104:0/729714326 conn(0x7fb3f40b3310 msgr2=0x7fb3f40b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:47.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.337+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/729714326 shutdown_connections 2024-05-08T04:21:47.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.337+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/729714326 wait complete. 2024-05-08T04:21:47.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.338+0000 7fb3fb2f5640 1 Processor -- start 2024-05-08T04:21:47.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.338+0000 7fb3fb2f5640 1 -- start start 2024-05-08T04:21:47.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3fb2f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3f4099a40 0x7fb3f41526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3fb2f5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3f40b2b80 0x7fb3f40b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3fb2f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f415d490 0x7fb3f40703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3fb2f5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40cf830 con 0x7fb3f415d490 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3fb2f5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40cd140 con 0x7fb3f40b2b80 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3fb2f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40cc550 con 0x7fb3f4099a40 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3f9892640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f415d490 0x7fb3f40703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3f9892640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f415d490 0x7fb3f40703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54416/0 (socket says 172.21.15.104:54416) 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3f9892640 1 -- 172.21.15.104:0/3451250216 learned_addr learned my addr 172.21.15.104:0/3451250216 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3f9091640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3f4099a40 0x7fb3f41526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3f8890640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3f40b2b80 0x7fb3f40b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3f9892640 1 -- 172.21.15.104:0/3451250216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3f4099a40 msgr2=0x7fb3f41526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3f9892640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3f4099a40 0x7fb3f41526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3f9892640 1 -- 172.21.15.104:0/3451250216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3f40b2b80 msgr2=0x7fb3f40b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3f9892640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3f40b2b80 0x7fb3f40b4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3f9892640 1 -- 172.21.15.104:0/3451250216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f40b4d00 con 0x7fb3f415d490 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3f9892640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f415d490 0x7fb3f40703a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec02ace0 tx=0x7fb3ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:47.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.339+0000 7fb3e9ffb640 1 -- 172.21.15.104:0/3451250216 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec040070 con 0x7fb3f415d490 2024-05-08T04:21:47.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.340+0000 7fb3e9ffb640 1 -- 172.21.15.104:0/3451250216 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec031c90 con 0x7fb3f415d490 2024-05-08T04:21:47.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.340+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/3451250216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f40b4fe0 con 0x7fb3f415d490 2024-05-08T04:21:47.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.340+0000 7fb3e9ffb640 1 -- 172.21.15.104:0/3451250216 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec045680 con 0x7fb3f415d490 2024-05-08T04:21:47.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.340+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/3451250216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f40c5740 con 0x7fb3f415d490 2024-05-08T04:21:47.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.341+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/3451250216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f40c5940 con 0x7fb3f415d490 2024-05-08T04:21:47.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.341+0000 7fb3e9ffb640 1 -- 172.21.15.104:0/3451250216 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb3ec039040 con 0x7fb3f415d490 2024-05-08T04:21:47.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.342+0000 7fb3e9ffb640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3d806b4d0 0x7fb3d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.342+0000 7fb3f9091640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3d806b4d0 0x7fb3d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.342+0000 7fb3e9ffb640 1 -- 172.21.15.104:0/3451250216 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3ec0abb10 con 0x7fb3f415d490 2024-05-08T04:21:47.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.342+0000 7fb3f9091640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3d806b4d0 0x7fb3d806d990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0007fd0 tx=0x7fb3f0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:47.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.346+0000 7fb3e9ffb640 1 -- 172.21.15.104:0/3451250216 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb3f40c5940 con 0x7fb3f415d490 2024-05-08T04:21:47.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.515+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/3451250216 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3f40b62e0 con 0x7fb3f415d490 2024-05-08T04:21:47.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.515+0000 7fb3e9ffb640 1 -- 172.21.15.104:0/3451250216 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3ec07aae0 con 0x7fb3f415d490 2024-05-08T04:21:47.518 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:47.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.517+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/3451250216 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3d806b4d0 msgr2=0x7fb3d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.517+0000 7fb3fb2f5640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3d806b4d0 0x7fb3d806d990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0007fd0 tx=0x7fb3f0009040 comp rx=0 tx=0).stop 2024-05-08T04:21:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.517+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/3451250216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f415d490 msgr2=0x7fb3f40703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.517+0000 7fb3fb2f5640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f415d490 0x7fb3f40703a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec02ace0 tx=0x7fb3ec004a40 comp rx=0 tx=0).stop 2024-05-08T04:21:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.517+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/3451250216 shutdown_connections 2024-05-08T04:21:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.517+0000 7fb3fb2f5640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3d806b4d0 0x7fb3d806d990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.517+0000 7fb3fb2f5640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3f40b2b80 0x7fb3f40b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.517+0000 7fb3fb2f5640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f415d490 0x7fb3f40703a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.517+0000 7fb3fb2f5640 1 --2- 172.21.15.104:0/3451250216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3f4099a40 0x7fb3f41526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.517+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/3451250216 >> 172.21.15.104:0/3451250216 conn(0x7fb3f40b3310 msgr2=0x7fb3f406cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:47.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.517+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/3451250216 shutdown_connections 2024-05-08T04:21:47.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.517+0000 7fb3fb2f5640 1 -- 172.21.15.104:0/3451250216 wait complete. 2024-05-08T04:21:47.530 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:21:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.629+0000 7feae29c1640 1 Processor -- start 2024-05-08T04:21:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.629+0000 7feae29c1640 1 -- start start 2024-05-08T04:21:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.630+0000 7feae29c1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feadc0ceee0 0x7feadc0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.630+0000 7feae29c1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7feadc06e330 0x7feadc06e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.630+0000 7feae29c1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc15e780 con 0x7feadc0b3ff0 2024-05-08T04:21:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.630+0000 7feae29c1640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc15f390 con 0x7feadc06e330 2024-05-08T04:21:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.630+0000 7feae29c1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc15ea60 con 0x7feadc0ceee0 2024-05-08T04:21:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.630+0000 7feadb7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7feadc06e330 0x7feadc06e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.630+0000 7feadb7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7feadc06e330 0x7feadc06e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51880/0 (socket says 172.21.15.104:51880) 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.630+0000 7feadb7fe640 1 -- 172.21.15.104:0/3325085542 learned_addr learned my addr 172.21.15.104:0/3325085542 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.630+0000 7feadb7fe640 1 -- 172.21.15.104:0/3325085542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feadc0ceee0 msgr2=0x7feadc0b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.630+0000 7feadbfff640 1 --2- 172.21.15.104:0/3325085542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feadc0ceee0 0x7feadc0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.630+0000 7feadb7fe640 1 --2- 172.21.15.104:0/3325085542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feadc0ceee0 0x7feadc0b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.630+0000 7feadb7fe640 1 -- 172.21.15.104:0/3325085542 >> v1:172.21.15.183:6789/0 conn(0x7feadc0b3ff0 legacy=0x7feadc0b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.630+0000 7feadb7fe640 1 -- 172.21.15.104:0/3325085542 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc15ed40 con 0x7feadc06e330 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.631+0000 7feadb7fe640 1 --2- 172.21.15.104:0/3325085542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feadc06e330 0x7feadc06e7b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fead0009870 tx=0x7fead002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b93ff9df4967e15 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.631+0000 7feadaffd640 1 -- 172.21.15.104:0/3325085542 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0037070 con 0x7feadc06e330 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.631+0000 7feadaffd640 1 -- 172.21.15.104:0/3325085542 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead0032440 con 0x7feadc06e330 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.631+0000 7feadaffd640 1 -- 172.21.15.104:0/3325085542 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0032810 con 0x7feadc06e330 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.631+0000 7feae29c1640 1 -- 172.21.15.104:0/3325085542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feadc06e330 msgr2=0x7feadc06e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.631+0000 7feae29c1640 1 --2- 172.21.15.104:0/3325085542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feadc06e330 0x7feadc06e7b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fead0009870 tx=0x7fead002a210 comp rx=0 tx=0).stop 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.631+0000 7feae29c1640 1 -- 172.21.15.104:0/3325085542 shutdown_connections 2024-05-08T04:21:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.631+0000 7feae29c1640 1 --2- 172.21.15.104:0/3325085542 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feadc06e330 0x7feadc06e7b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.632+0000 7feae29c1640 1 --2- 172.21.15.104:0/3325085542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feadc0ceee0 0x7feadc0b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.632+0000 7feae29c1640 1 -- 172.21.15.104:0/3325085542 >> 172.21.15.104:0/3325085542 conn(0x7feadc0b13f0 msgr2=0x7feadc0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:47.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.632+0000 7feae29c1640 1 -- 172.21.15.104:0/3325085542 shutdown_connections 2024-05-08T04:21:47.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.632+0000 7feae29c1640 1 -- 172.21.15.104:0/3325085542 wait complete. 2024-05-08T04:21:47.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.633+0000 7feae29c1640 1 Processor -- start 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.633+0000 7feae29c1640 1 -- start start 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.633+0000 7feae29c1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feadc06e330 0x7feadc15b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae29c1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feadc0b3ff0 0x7feadc15a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae29c1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feadc0ceee0 0x7feadc1511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae29c1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc0cf440 con 0x7feadc0ceee0 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae29c1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc0cf2c0 con 0x7feadc06e330 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae29c1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc15b210 con 0x7feadc0b3ff0 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae0f5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feadc0ceee0 0x7feadc1511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae0f5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feadc0ceee0 0x7feadc1511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51890/0 (socket says 172.21.15.104:51890) 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae0f5e640 1 -- 172.21.15.104:0/813846513 learned_addr learned my addr 172.21.15.104:0/813846513 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feadb7fe640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feadc0b3ff0 0x7feadc15a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feadbfff640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feadc06e330 0x7feadc15b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae0f5e640 1 -- 172.21.15.104:0/813846513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feadc0b3ff0 msgr2=0x7feadc15a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae0f5e640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feadc0b3ff0 0x7feadc15a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae0f5e640 1 -- 172.21.15.104:0/813846513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feadc06e330 msgr2=0x7feadc15b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae0f5e640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feadc06e330 0x7feadc15b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae0f5e640 1 -- 172.21.15.104:0/813846513 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc15bcd0 con 0x7feadc0ceee0 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feadb7fe640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feadc0b3ff0 0x7feadc15a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feadbfff640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feadc06e330 0x7feadc15b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae0f5e640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feadc0ceee0 0x7feadc1511f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fead400c7b0 tx=0x7fead400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7fead8ff9640 1 -- 172.21.15.104:0/813846513 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4004b60 con 0x7feadc0ceee0 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7fead8ff9640 1 -- 172.21.15.104:0/813846513 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead4004d00 con 0x7feadc0ceee0 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7fead8ff9640 1 -- 172.21.15.104:0/813846513 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead400aa30 con 0x7feadc0ceee0 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae29c1640 1 -- 172.21.15.104:0/813846513 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc15ddf0 con 0x7feadc0ceee0 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.634+0000 7feae29c1640 1 -- 172.21.15.104:0/813846513 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc15e3b0 con 0x7feadc0ceee0 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.635+0000 7feae29c1640 1 -- 172.21.15.104:0/813846513 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc075010 con 0x7feadc0ceee0 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.636+0000 7fead8ff9640 1 -- 172.21.15.104:0/813846513 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fead400abd0 con 0x7feadc0ceee0 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.636+0000 7fead8ff9640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7feac806b4d0 0x7feac806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.636+0000 7feadbfff640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7feac806b4d0 0x7feac806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:47.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.636+0000 7fead8ff9640 1 -- 172.21.15.104:0/813846513 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fead408a3a0 con 0x7feadc0ceee0 2024-05-08T04:21:47.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.637+0000 7feadbfff640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7feac806b4d0 0x7feac806d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feacc00b820 tx=0x7feacc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:47.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.640+0000 7fead8ff9640 1 -- 172.21.15.104:0/813846513 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fead4020070 con 0x7feadc0ceee0 2024-05-08T04:21:47.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.824+0000 7feae29c1640 1 -- 172.21.15.104:0/813846513 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feadc06f3f0 con 0x7feadc0ceee0 2024-05-08T04:21:47.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.825+0000 7fead8ff9640 1 -- 172.21.15.104:0/813846513 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fead40592b0 con 0x7feadc0ceee0 2024-05-08T04:21:47.827 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:21:47.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.827+0000 7feae29c1640 1 -- 172.21.15.104:0/813846513 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7feac806b4d0 msgr2=0x7feac806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.827+0000 7feae29c1640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7feac806b4d0 0x7feac806d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feacc00b820 tx=0x7feacc008040 comp rx=0 tx=0).stop 2024-05-08T04:21:47.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.827+0000 7feae29c1640 1 -- 172.21.15.104:0/813846513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feadc0ceee0 msgr2=0x7feadc1511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:47.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.827+0000 7feae29c1640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feadc0ceee0 0x7feadc1511f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fead400c7b0 tx=0x7fead400cc70 comp rx=0 tx=0).stop 2024-05-08T04:21:47.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.827+0000 7feae29c1640 1 -- 172.21.15.104:0/813846513 shutdown_connections 2024-05-08T04:21:47.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.827+0000 7feae29c1640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7feac806b4d0 0x7feac806d990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.827+0000 7feae29c1640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feadc0ceee0 0x7feadc1511f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.827+0000 7feae29c1640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feadc0b3ff0 0x7feadc15a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.827+0000 7feae29c1640 1 --2- 172.21.15.104:0/813846513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feadc06e330 0x7feadc15b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:47.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.827+0000 7feae29c1640 1 -- 172.21.15.104:0/813846513 >> 172.21.15.104:0/813846513 conn(0x7feadc0b13f0 msgr2=0x7feadc06d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:47.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.827+0000 7feae29c1640 1 -- 172.21.15.104:0/813846513 shutdown_connections 2024-05-08T04:21:47.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:47.827+0000 7feae29c1640 1 -- 172.21.15.104:0/813846513 wait complete. 2024-05-08T04:21:47.840 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi183.front.sepia.ceph.com... 2024-05-08T04:21:47.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:47.840 DEBUG:teuthology.orchestra.run.smithi183:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-08T04:21:47.871 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:21:47.871 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:21:47.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:47.872 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-08T04:21:47.939 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:21:47.939 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:21:47.956 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:21:47.956 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:21:48.012 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:48.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.149+0000 7f21cba4c640 1 Processor -- start 2024-05-08T04:21:48.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.149+0000 7f21cba4c640 1 -- start start 2024-05-08T04:21:48.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21cba4c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f21c40715d0 0x7f21c40719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21cba4c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c415cd20 0x7f21c406d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21cba4c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c4071ef0 con 0x7f21c40725b0 2024-05-08T04:21:48.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21cba4c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c40cf680 con 0x7f21c40715d0 2024-05-08T04:21:48.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21cba4c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c415c240 con 0x7f21c415cd20 2024-05-08T04:21:48.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21c97e8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f21c40715d0 0x7f21c40719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21c8fe7640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f21c40725b0 0x7f21c40cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59570/0 (socket says 172.21.15.104:59570) 2024-05-08T04:21:48.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21c8fe7640 1 -- 172.21.15.104:0/4169763052 learned_addr learned my addr 172.21.15.104:0/4169763052 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:48.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21c9fe9640 1 --2- 172.21.15.104:0/4169763052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c415cd20 0x7f21c406d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21c97e8640 1 -- 172.21.15.104:0/4169763052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c415cd20 msgr2=0x7f21c406d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:48.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21c97e8640 1 --2- 172.21.15.104:0/4169763052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c415cd20 0x7f21c406d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21c97e8640 1 -- 172.21.15.104:0/4169763052 >> v1:172.21.15.104:6789/0 conn(0x7f21c40725b0 legacy=0x7f21c40cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21bbfff640 1 -- 172.21.15.104:0/4169763052 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584394313 0 0) 0x7f21c4071ef0 con 0x7f21c40725b0 2024-05-08T04:21:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.150+0000 7f21c97e8640 1 -- 172.21.15.104:0/4169763052 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c415c520 con 0x7f21c40715d0 2024-05-08T04:21:48.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.151+0000 7f21c97e8640 1 --2- 172.21.15.104:0/4169763052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21c40715d0 0x7f21c40719b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009d90 tx=0x7f21c002a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435474542df1e7f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:48.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.151+0000 7f21bbfff640 1 -- 172.21.15.104:0/4169763052 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0007740 con 0x7f21c40715d0 2024-05-08T04:21:48.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.151+0000 7f21bbfff640 1 -- 172.21.15.104:0/4169763052 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c00078e0 con 0x7f21c40715d0 2024-05-08T04:21:48.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.151+0000 7f21bbfff640 1 -- 172.21.15.104:0/4169763052 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0007cb0 con 0x7f21c40715d0 2024-05-08T04:21:48.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.152+0000 7f21cba4c640 1 -- 172.21.15.104:0/4169763052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21c40715d0 msgr2=0x7f21c40719b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.152+0000 7f21cba4c640 1 --2- 172.21.15.104:0/4169763052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21c40715d0 0x7f21c40719b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009d90 tx=0x7f21c002a530 comp rx=0 tx=0).stop 2024-05-08T04:21:48.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.152+0000 7f21cba4c640 1 -- 172.21.15.104:0/4169763052 shutdown_connections 2024-05-08T04:21:48.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.152+0000 7f21cba4c640 1 --2- 172.21.15.104:0/4169763052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c415cd20 0x7f21c406d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.152+0000 7f21cba4c640 1 --2- 172.21.15.104:0/4169763052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21c40715d0 0x7f21c40719b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.152+0000 7f21cba4c640 1 -- 172.21.15.104:0/4169763052 >> 172.21.15.104:0/4169763052 conn(0x7f21c40cfa60 msgr2=0x7f21c40cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:48.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.152+0000 7f21cba4c640 1 -- 172.21.15.104:0/4169763052 shutdown_connections 2024-05-08T04:21:48.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.152+0000 7f21cba4c640 1 -- 172.21.15.104:0/4169763052 wait complete. 2024-05-08T04:21:48.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.153+0000 7f21cba4c640 1 Processor -- start 2024-05-08T04:21:48.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.153+0000 7f21cba4c640 1 -- start start 2024-05-08T04:21:48.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21cba4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21c40715d0 0x7f21c4139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21cba4c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c40725b0 0x7f21c413d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21cba4c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21c415cd20 0x7f21c413b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21cba4c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c406db70 con 0x7f21c40715d0 2024-05-08T04:21:48.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21cba4c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c40cf360 con 0x7f21c415cd20 2024-05-08T04:21:48.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21cba4c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c406dcf0 con 0x7f21c40725b0 2024-05-08T04:21:48.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21c97e8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21c40715d0 0x7f21c4139880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21c97e8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21c40715d0 0x7f21c4139880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51900/0 (socket says 172.21.15.104:51900) 2024-05-08T04:21:48.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21c97e8640 1 -- 172.21.15.104:0/2778242405 learned_addr learned my addr 172.21.15.104:0/2778242405 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:48.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21c8fe7640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c40725b0 0x7f21c413d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21c9fe9640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21c415cd20 0x7f21c413b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21c97e8640 1 -- 172.21.15.104:0/2778242405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c40725b0 msgr2=0x7f21c413d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21c97e8640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c40725b0 0x7f21c413d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21c97e8640 1 -- 172.21.15.104:0/2778242405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21c415cd20 msgr2=0x7f21c413b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21c97e8640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21c415cd20 0x7f21c413b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21c97e8640 1 -- 172.21.15.104:0/2778242405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c413be60 con 0x7f21c40715d0 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21c9fe9640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21c415cd20 0x7f21c413b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.154+0000 7f21c97e8640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21c40715d0 0x7f21c4139880 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009eb0 tx=0x7f21c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.155+0000 7f21b9ffb640 1 -- 172.21.15.104:0/2778242405 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0040070 con 0x7f21c40715d0 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.155+0000 7f21b9ffb640 1 -- 172.21.15.104:0/2778242405 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c0031c40 con 0x7f21c40715d0 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.155+0000 7f21cba4c640 1 -- 172.21.15.104:0/2778242405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c413c100 con 0x7f21c40715d0 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.155+0000 7f21b9ffb640 1 -- 172.21.15.104:0/2778242405 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0045460 con 0x7f21c40715d0 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.155+0000 7f21cba4c640 1 -- 172.21.15.104:0/2778242405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c413c6c0 con 0x7f21c40715d0 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.156+0000 7f21cba4c640 1 -- 172.21.15.104:0/2778242405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c4075010 con 0x7f21c40715d0 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.156+0000 7f21b9ffb640 1 -- 172.21.15.104:0/2778242405 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f21c0039040 con 0x7f21c40715d0 2024-05-08T04:21:48.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.157+0000 7f21b9ffb640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f21a806b4d0 0x7f21a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.157+0000 7f21b9ffb640 1 -- 172.21.15.104:0/2778242405 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21c00abad0 con 0x7f21c40715d0 2024-05-08T04:21:48.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.157+0000 7f21c8fe7640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f21a806b4d0 0x7f21a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.157+0000 7f21c8fe7640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f21a806b4d0 0x7f21a806d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21b40011e0 tx=0x7f21b4001130 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:48.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.161+0000 7f21b9ffb640 1 -- 172.21.15.104:0/2778242405 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f21c007aa70 con 0x7f21c40715d0 2024-05-08T04:21:48.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.332+0000 7f21cba4c640 1 -- 172.21.15.104:0/2778242405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21c40d0970 con 0x7f21c40715d0 2024-05-08T04:21:48.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.333+0000 7f21b9ffb640 1 -- 172.21.15.104:0/2778242405 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f21c007a370 con 0x7f21c40715d0 2024-05-08T04:21:48.336 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:48.336 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:48.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.335+0000 7f21cba4c640 1 -- 172.21.15.104:0/2778242405 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f21a806b4d0 msgr2=0x7f21a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.335+0000 7f21cba4c640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f21a806b4d0 0x7f21a806d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21b40011e0 tx=0x7f21b4001130 comp rx=0 tx=0).stop 2024-05-08T04:21:48.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.335+0000 7f21cba4c640 1 -- 172.21.15.104:0/2778242405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21c40715d0 msgr2=0x7f21c4139880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.335+0000 7f21cba4c640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21c40715d0 0x7f21c4139880 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009eb0 tx=0x7f21c0004a40 comp rx=0 tx=0).stop 2024-05-08T04:21:48.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.336+0000 7f21cba4c640 1 -- 172.21.15.104:0/2778242405 shutdown_connections 2024-05-08T04:21:48.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.336+0000 7f21cba4c640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f21a806b4d0 0x7f21a806d990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.336+0000 7f21cba4c640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21c415cd20 0x7f21c413b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.336+0000 7f21cba4c640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21c40725b0 0x7f21c413d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.336+0000 7f21cba4c640 1 --2- 172.21.15.104:0/2778242405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f21c40715d0 0x7f21c4139880 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.336+0000 7f21cba4c640 1 -- 172.21.15.104:0/2778242405 >> 172.21.15.104:0/2778242405 conn(0x7f21c40cfa60 msgr2=0x7f21c4141300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:48.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.336+0000 7f21cba4c640 1 -- 172.21.15.104:0/2778242405 shutdown_connections 2024-05-08T04:21:48.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.336+0000 7f21cba4c640 1 -- 172.21.15.104:0/2778242405 wait complete. 2024-05-08T04:21:48.349 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:48.349 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:48.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.450+0000 7f5f07bce640 1 Processor -- start 2024-05-08T04:21:48.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.450+0000 7f5f07bce640 1 -- start start 2024-05-08T04:21:48.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.451+0000 7f5f07bce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0015ee90 0x7f5f000cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.451+0000 7f5f07bce640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5f000d0320 0x7f5f000b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.451+0000 7f5f07bce640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f000cc5d0 con 0x7f5f0015ba10 2024-05-08T04:21:48.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.451+0000 7f5f07bce640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f000d0790 con 0x7f5f000d0320 2024-05-08T04:21:48.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.451+0000 7f5f07bce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0009a340 con 0x7f5f0015ee90 2024-05-08T04:21:48.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.451+0000 7f5f0616b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5f000d0320 0x7f5f000b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.451+0000 7f5f0616b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5f000d0320 0x7f5f000b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51916/0 (socket says 172.21.15.104:51916) 2024-05-08T04:21:48.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.451+0000 7f5f0616b640 1 -- 172.21.15.104:0/3231803512 learned_addr learned my addr 172.21.15.104:0/3231803512 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:48.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.451+0000 7f5f05169640 1 --2- 172.21.15.104:0/3231803512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0015ee90 0x7f5f000cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.451+0000 7f5f0616b640 1 -- 172.21.15.104:0/3231803512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0015ee90 msgr2=0x7f5f000cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:48.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.451+0000 7f5f0616b640 1 --2- 172.21.15.104:0/3231803512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0015ee90 0x7f5f000cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.451+0000 7f5f0616b640 1 -- 172.21.15.104:0/3231803512 >> v1:172.21.15.183:6789/0 conn(0x7f5f0015ba10 legacy=0x7f5f00099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.451+0000 7f5f0616b640 1 -- 172.21.15.104:0/3231803512 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0009a620 con 0x7f5f000d0320 2024-05-08T04:21:48.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.452+0000 7f5f0616b640 1 --2- 172.21.15.104:0/3231803512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f000d0320 0x7f5f000b24c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009e50 tx=0x7f5ef802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8861656a430ee613 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:48.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.452+0000 7f5f04968640 1 -- 172.21.15.104:0/3231803512 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8036070 con 0x7f5f000d0320 2024-05-08T04:21:48.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.452+0000 7f5f04968640 1 -- 172.21.15.104:0/3231803512 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef8031600 con 0x7f5f000d0320 2024-05-08T04:21:48.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.452+0000 7f5f04968640 1 -- 172.21.15.104:0/3231803512 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef80319d0 con 0x7f5f000d0320 2024-05-08T04:21:48.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.453+0000 7f5f07bce640 1 -- 172.21.15.104:0/3231803512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f000d0320 msgr2=0x7f5f000b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.453+0000 7f5f07bce640 1 --2- 172.21.15.104:0/3231803512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f000d0320 0x7f5f000b24c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009e50 tx=0x7f5ef802a710 comp rx=0 tx=0).stop 2024-05-08T04:21:48.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.453+0000 7f5f07bce640 1 -- 172.21.15.104:0/3231803512 shutdown_connections 2024-05-08T04:21:48.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.453+0000 7f5f07bce640 1 --2- 172.21.15.104:0/3231803512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f000d0320 0x7f5f000b24c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.453+0000 7f5f07bce640 1 --2- 172.21.15.104:0/3231803512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0015ee90 0x7f5f000cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.453+0000 7f5f07bce640 1 -- 172.21.15.104:0/3231803512 >> 172.21.15.104:0/3231803512 conn(0x7f5f000b3280 msgr2=0x7f5f000b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:48.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.453+0000 7f5f07bce640 1 -- 172.21.15.104:0/3231803512 shutdown_connections 2024-05-08T04:21:48.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.453+0000 7f5f07bce640 1 -- 172.21.15.104:0/3231803512 wait complete. 2024-05-08T04:21:48.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.454+0000 7f5f07bce640 1 Processor -- start 2024-05-08T04:21:48.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.454+0000 7f5f07bce640 1 -- start start 2024-05-08T04:21:48.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f07bce640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f000d0320 0x7f5f000ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f07bce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0015ba10 0x7f5f000ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f07bce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f0015ee90 0x7f5f001566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f07bce640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0006bc70 con 0x7f5f0015ee90 2024-05-08T04:21:48.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f07bce640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000cc870 con 0x7f5f000d0320 2024-05-08T04:21:48.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f07bce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0006bdf0 con 0x7f5f0015ba10 2024-05-08T04:21:48.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f0616b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f0015ee90 0x7f5f001566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f0616b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f0015ee90 0x7f5f001566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51928/0 (socket says 172.21.15.104:51928) 2024-05-08T04:21:48.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f0616b640 1 -- 172.21.15.104:0/3530766755 learned_addr learned my addr 172.21.15.104:0/3530766755 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:48.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f0596a640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f000d0320 0x7f5f000ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f05169640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0015ba10 0x7f5f000ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f0616b640 1 -- 172.21.15.104:0/3530766755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0015ba10 msgr2=0x7f5f000ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f0616b640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0015ba10 0x7f5f000ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f0616b640 1 -- 172.21.15.104:0/3530766755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f000d0320 msgr2=0x7f5f000ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f0616b640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f000d0320 0x7f5f000ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f0616b640 1 -- 172.21.15.104:0/3530766755 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000b4dc0 con 0x7f5f0015ee90 2024-05-08T04:21:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f0596a640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f000d0320 0x7f5f000ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f0616b640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f0015ee90 0x7f5f001566e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8034040 tx=0x7f5ef8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5ef67fc640 1 -- 172.21.15.104:0/3530766755 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8036050 con 0x7f5f0015ee90 2024-05-08T04:21:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5ef67fc640 1 -- 172.21.15.104:0/3530766755 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef8042070 con 0x7f5f0015ee90 2024-05-08T04:21:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f07bce640 1 -- 172.21.15.104:0/3530766755 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f000b5060 con 0x7f5f0015ee90 2024-05-08T04:21:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5ef67fc640 1 -- 172.21.15.104:0/3530766755 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8009510 con 0x7f5f0015ee90 2024-05-08T04:21:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.455+0000 7f5f07bce640 1 -- 172.21.15.104:0/3530766755 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f000b5620 con 0x7f5f0015ee90 2024-05-08T04:21:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.456+0000 7f5f07bce640 1 -- 172.21.15.104:0/3530766755 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f000b5df0 con 0x7f5f0015ee90 2024-05-08T04:21:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.457+0000 7f5ef67fc640 1 -- 172.21.15.104:0/3530766755 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5ef8007c70 con 0x7f5f0015ee90 2024-05-08T04:21:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.457+0000 7f5ef67fc640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5ee406b4d0 0x7f5ee406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.458+0000 7f5f0596a640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5ee406b4d0 0x7f5ee406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.458+0000 7f5ef67fc640 1 -- 172.21.15.104:0/3530766755 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ef80aafc0 con 0x7f5f0015ee90 2024-05-08T04:21:48.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.458+0000 7f5f0596a640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5ee406b4d0 0x7f5ee406d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5efc001610 tx=0x7f5efc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:48.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.462+0000 7f5ef67fc640 1 -- 172.21.15.104:0/3530766755 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5ef8045360 con 0x7f5f0015ee90 2024-05-08T04:21:48.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.631+0000 7f5f07bce640 1 -- 172.21.15.104:0/3530766755 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f00075010 con 0x7f5f0015ee90 2024-05-08T04:21:48.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.632+0000 7f5ef67fc640 1 -- 172.21.15.104:0/3530766755 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ef8079ed0 con 0x7f5f0015ee90 2024-05-08T04:21:48.634 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:48.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.634+0000 7f5f07bce640 1 -- 172.21.15.104:0/3530766755 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5ee406b4d0 msgr2=0x7f5ee406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.634+0000 7f5f07bce640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5ee406b4d0 0x7f5ee406d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5efc001610 tx=0x7f5efc009040 comp rx=0 tx=0).stop 2024-05-08T04:21:48.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.634+0000 7f5f07bce640 1 -- 172.21.15.104:0/3530766755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f0015ee90 msgr2=0x7f5f001566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.634+0000 7f5f07bce640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f0015ee90 0x7f5f001566e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8034040 tx=0x7f5ef8004a40 comp rx=0 tx=0).stop 2024-05-08T04:21:48.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.634+0000 7f5f07bce640 1 -- 172.21.15.104:0/3530766755 shutdown_connections 2024-05-08T04:21:48.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.634+0000 7f5f07bce640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5ee406b4d0 0x7f5ee406d990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.634+0000 7f5f07bce640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f0015ee90 0x7f5f001566e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.634+0000 7f5f07bce640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0015ba10 0x7f5f000ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.634+0000 7f5f07bce640 1 --2- 172.21.15.104:0/3530766755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f000d0320 0x7f5f000ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.634+0000 7f5f07bce640 1 -- 172.21.15.104:0/3530766755 >> 172.21.15.104:0/3530766755 conn(0x7f5f000b3280 msgr2=0x7f5f00159af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:48.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.634+0000 7f5f07bce640 1 -- 172.21.15.104:0/3530766755 shutdown_connections 2024-05-08T04:21:48.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.634+0000 7f5f07bce640 1 -- 172.21.15.104:0/3530766755 wait complete. 2024-05-08T04:21:48.647 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:48.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.748+0000 7fdc0c676640 1 Processor -- start 2024-05-08T04:21:48.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.748+0000 7fdc0c676640 1 -- start start 2024-05-08T04:21:48.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.749+0000 7fdc0c676640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdc0415de10 0x7fdc04161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.749+0000 7fdc0c676640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc040ce5a0 0x7fdc040d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.749+0000 7fdc0c676640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdc040d05f0 0x7fdc040b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.749+0000 7fdc0c676640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc040d0f50 con 0x7fdc0415de10 2024-05-08T04:21:48.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.749+0000 7fdc0c676640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc04161e60 con 0x7fdc040d05f0 2024-05-08T04:21:48.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.749+0000 7fdc0c676640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040d1a90 con 0x7fdc040ce5a0 2024-05-08T04:21:48.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.749+0000 7fdc0a412640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdc0415de10 0x7fdc04161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.749+0000 7fdc0a412640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdc0415de10 0x7fdc04161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51936/0 (socket says 172.21.15.104:51936) 2024-05-08T04:21:48.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.749+0000 7fdc0a412640 1 -- 172.21.15.104:0/3930138657 learned_addr learned my addr 172.21.15.104:0/3930138657 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:48.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.750+0000 7fdc09c11640 1 --2- 172.21.15.104:0/3930138657 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc040ce5a0 0x7fdc040d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.750+0000 7fdc0ac13640 1 --2- 172.21.15.104:0/3930138657 >> v2:172.21.15.183:3300/0 conn(0x7fdc040d05f0 0x7fdc040b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.750+0000 7fdc0a412640 1 -- 172.21.15.104:0/3930138657 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc040ce5a0 msgr2=0x7fdc040d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:48.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.750+0000 7fdc0a412640 1 --2- 172.21.15.104:0/3930138657 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc040ce5a0 0x7fdc040d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.750+0000 7fdc0a412640 1 -- 172.21.15.104:0/3930138657 >> v2:172.21.15.183:3300/0 conn(0x7fdc040d05f0 msgr2=0x7fdc040b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:48.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.750+0000 7fdc0a412640 1 --2- 172.21.15.104:0/3930138657 >> v2:172.21.15.183:3300/0 conn(0x7fdc040d05f0 0x7fdc040b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.750+0000 7fdc0a412640 1 -- 172.21.15.104:0/3930138657 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0415e1f0 con 0x7fdc0415de10 2024-05-08T04:21:48.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.750+0000 7fdc0a412640 1 --2- 172.21.15.104:0/3930138657 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0415de10 0x7fdc04161920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdc0408cd90 tx=0x7fdbf402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dee513e3a776bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:48.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.751+0000 7fdc09410640 1 -- 172.21.15.104:0/3930138657 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4036070 con 0x7fdc0415de10 2024-05-08T04:21:48.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.751+0000 7fdc09410640 1 -- 172.21.15.104:0/3930138657 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf4031600 con 0x7fdc0415de10 2024-05-08T04:21:48.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.751+0000 7fdc09410640 1 -- 172.21.15.104:0/3930138657 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40319d0 con 0x7fdc0415de10 2024-05-08T04:21:48.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.751+0000 7fdc0c676640 1 -- 172.21.15.104:0/3930138657 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0415de10 msgr2=0x7fdc04161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.751+0000 7fdc0c676640 1 --2- 172.21.15.104:0/3930138657 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0415de10 0x7fdc04161920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdc0408cd90 tx=0x7fdbf402a610 comp rx=0 tx=0).stop 2024-05-08T04:21:48.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.751+0000 7fdc0c676640 1 -- 172.21.15.104:0/3930138657 shutdown_connections 2024-05-08T04:21:48.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.751+0000 7fdc0c676640 1 --2- 172.21.15.104:0/3930138657 >> v2:172.21.15.183:3300/0 conn(0x7fdc040d05f0 0x7fdc040b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.751+0000 7fdc0c676640 1 --2- 172.21.15.104:0/3930138657 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc040ce5a0 0x7fdc040d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.751+0000 7fdc0c676640 1 --2- 172.21.15.104:0/3930138657 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc0415de10 0x7fdc04161920 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.751+0000 7fdc0c676640 1 -- 172.21.15.104:0/3930138657 >> 172.21.15.104:0/3930138657 conn(0x7fdc04072290 msgr2=0x7fdc04072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:48.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.751+0000 7fdc0c676640 1 -- 172.21.15.104:0/3930138657 shutdown_connections 2024-05-08T04:21:48.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.751+0000 7fdc0c676640 1 -- 172.21.15.104:0/3930138657 wait complete. 2024-05-08T04:21:48.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.752+0000 7fdc0c676640 1 Processor -- start 2024-05-08T04:21:48.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.752+0000 7fdc0c676640 1 -- start start 2024-05-08T04:21:48.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.753+0000 7fdc0c676640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc040ce5a0 0x7fdc04160260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.753+0000 7fdc0c676640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc040d05f0 0x7fdc0415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.753+0000 7fdc0c676640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc0415de10 0x7fdc0415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.753+0000 7fdc0c676640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc04162370 con 0x7fdc040d05f0 2024-05-08T04:21:48.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.753+0000 7fdc0c676640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc04162090 con 0x7fdc0415de10 2024-05-08T04:21:48.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.753+0000 7fdc0c676640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc04162650 con 0x7fdc040ce5a0 2024-05-08T04:21:48.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.753+0000 7fdc09c11640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc040d05f0 0x7fdc0415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.753+0000 7fdc09c11640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc040d05f0 0x7fdc0415c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51950/0 (socket says 172.21.15.104:51950) 2024-05-08T04:21:48.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.753+0000 7fdc09c11640 1 -- 172.21.15.104:0/1990339847 learned_addr learned my addr 172.21.15.104:0/1990339847 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:48.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.753+0000 7fdc09c11640 1 -- 172.21.15.104:0/1990339847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc040ce5a0 msgr2=0x7fdc04160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.753+0000 7fdc09c11640 1 --2- 172.21.15.104:0/1990339847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc040ce5a0 0x7fdc04160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.753+0000 7fdc09c11640 1 -- 172.21.15.104:0/1990339847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc0415de10 msgr2=0x7fdc0415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.753+0000 7fdc09c11640 1 --2- 172.21.15.104:0/1990339847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc0415de10 0x7fdc0415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.754+0000 7fdc09c11640 1 -- 172.21.15.104:0/1990339847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0415cd30 con 0x7fdc040d05f0 2024-05-08T04:21:48.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.754+0000 7fdc09c11640 1 --2- 172.21.15.104:0/1990339847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc040d05f0 0x7fdc0415c3e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800d800 tx=0x7fdbf800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:48.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.754+0000 7fdc02ffd640 1 -- 172.21.15.104:0/1990339847 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8018020 con 0x7fdc040d05f0 2024-05-08T04:21:48.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.754+0000 7fdc02ffd640 1 -- 172.21.15.104:0/1990339847 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf80096a0 con 0x7fdc040d05f0 2024-05-08T04:21:48.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.754+0000 7fdc0c676640 1 -- 172.21.15.104:0/1990339847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0415d010 con 0x7fdc040d05f0 2024-05-08T04:21:48.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.754+0000 7fdc02ffd640 1 -- 172.21.15.104:0/1990339847 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8009a70 con 0x7fdc040d05f0 2024-05-08T04:21:48.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.754+0000 7fdc0c676640 1 -- 172.21.15.104:0/1990339847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc041607a0 con 0x7fdc040d05f0 2024-05-08T04:21:48.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.755+0000 7fdc0c676640 1 -- 172.21.15.104:0/1990339847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc04075010 con 0x7fdc040d05f0 2024-05-08T04:21:48.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.755+0000 7fdc02ffd640 1 -- 172.21.15.104:0/1990339847 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdbf801b020 con 0x7fdc040d05f0 2024-05-08T04:21:48.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.756+0000 7fdc02ffd640 1 --2- 172.21.15.104:0/1990339847 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdbf006b500 0x7fdbf006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:48.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.756+0000 7fdc0a412640 1 --2- 172.21.15.104:0/1990339847 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdbf006b500 0x7fdbf006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:48.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.756+0000 7fdc02ffd640 1 -- 172.21.15.104:0/1990339847 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbf808a450 con 0x7fdc040d05f0 2024-05-08T04:21:48.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.757+0000 7fdc0a412640 1 --2- 172.21.15.104:0/1990339847 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdbf006b500 0x7fdbf006d9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4033000 tx=0x7fdbf402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:48.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.760+0000 7fdc02ffd640 1 -- 172.21.15.104:0/1990339847 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdbf8022030 con 0x7fdc040d05f0 2024-05-08T04:21:48.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.929+0000 7fdc0c676640 1 -- 172.21.15.104:0/1990339847 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc0415a040 con 0x7fdc040d05f0 2024-05-08T04:21:48.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.929+0000 7fdc02ffd640 1 -- 172.21.15.104:0/1990339847 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdbf80592d0 con 0x7fdc040d05f0 2024-05-08T04:21:48.931 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:48.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.931+0000 7fdc0c676640 1 -- 172.21.15.104:0/1990339847 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdbf006b500 msgr2=0x7fdbf006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.931+0000 7fdc0c676640 1 --2- 172.21.15.104:0/1990339847 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdbf006b500 0x7fdbf006d9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4033000 tx=0x7fdbf402e000 comp rx=0 tx=0).stop 2024-05-08T04:21:48.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.931+0000 7fdc0c676640 1 -- 172.21.15.104:0/1990339847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc040d05f0 msgr2=0x7fdc0415c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:48.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.931+0000 7fdc0c676640 1 --2- 172.21.15.104:0/1990339847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc040d05f0 0x7fdc0415c3e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800d800 tx=0x7fdbf800dcc0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.931+0000 7fdc0c676640 1 -- 172.21.15.104:0/1990339847 shutdown_connections 2024-05-08T04:21:48.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.931+0000 7fdc0c676640 1 --2- 172.21.15.104:0/1990339847 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdbf006b500 0x7fdbf006d9c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.931+0000 7fdc0c676640 1 --2- 172.21.15.104:0/1990339847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc0415de10 0x7fdc0415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.931+0000 7fdc0c676640 1 --2- 172.21.15.104:0/1990339847 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc040d05f0 0x7fdc0415c3e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.931+0000 7fdc0c676640 1 --2- 172.21.15.104:0/1990339847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc040ce5a0 0x7fdc04160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:48.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.931+0000 7fdc0c676640 1 -- 172.21.15.104:0/1990339847 >> 172.21.15.104:0/1990339847 conn(0x7fdc04072290 msgr2=0x7fdc04073fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:48.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.931+0000 7fdc0c676640 1 -- 172.21.15.104:0/1990339847 shutdown_connections 2024-05-08T04:21:48.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:48.931+0000 7fdc0c676640 1 -- 172.21.15.104:0/1990339847 wait complete. 2024-05-08T04:21:48.944 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:49.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.044+0000 7f87cfefc640 1 Processor -- start 2024-05-08T04:21:49.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.044+0000 7f87cfefc640 1 -- start start 2024-05-08T04:21:49.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.045+0000 7f87cfefc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f87c8072160 0x7f87c806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.045+0000 7f87cfefc640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c815dce0 con 0x7f87c815a2a0 2024-05-08T04:21:49.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.045+0000 7f87cfefc640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c806eb60 con 0x7f87c8159ec0 2024-05-08T04:21:49.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.045+0000 7f87cfefc640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c806ee40 con 0x7f87c8072160 2024-05-08T04:21:49.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.045+0000 7f87cd497640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f87c8072160 0x7f87c806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.045+0000 7f87ce499640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f87c815a2a0 0x7f87c80b26f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59582/0 (socket says 172.21.15.104:59582) 2024-05-08T04:21:49.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.045+0000 7f87ce499640 1 -- 172.21.15.104:0/2746377228 learned_addr learned my addr 172.21.15.104:0/2746377228 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:49.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.046+0000 7f87cd497640 1 -- 172.21.15.104:0/2746377228 >> v1:172.21.15.183:6789/0 conn(0x7f87c8159ec0 legacy=0x7f87c8071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:49.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.046+0000 7f87cd497640 1 -- 172.21.15.104:0/2746377228 >> v1:172.21.15.104:6789/0 conn(0x7f87c815a2a0 legacy=0x7f87c80b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.046+0000 7f87cd497640 1 -- 172.21.15.104:0/2746377228 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c815df80 con 0x7f87c8072160 2024-05-08T04:21:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.046+0000 7f87cd497640 1 --2- 172.21.15.104:0/2746377228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87c8072160 0x7f87c806e4d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0097a0 tx=0x7f87bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911be22936ccbb3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.046+0000 7f87ccc96640 1 -- 172.21.15.104:0/2746377228 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc037070 con 0x7f87c8072160 2024-05-08T04:21:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.047+0000 7f87ccc96640 1 -- 172.21.15.104:0/2746377228 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc032440 con 0x7f87c8072160 2024-05-08T04:21:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.047+0000 7f87ccc96640 1 -- 172.21.15.104:0/2746377228 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc032810 con 0x7f87c8072160 2024-05-08T04:21:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.047+0000 7f87cfefc640 1 -- 172.21.15.104:0/2746377228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87c8072160 msgr2=0x7f87c806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.047+0000 7f87cfefc640 1 --2- 172.21.15.104:0/2746377228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87c8072160 0x7f87c806e4d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0097a0 tx=0x7f87bc02a1e0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.047+0000 7f87cfefc640 1 -- 172.21.15.104:0/2746377228 shutdown_connections 2024-05-08T04:21:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.047+0000 7f87cfefc640 1 --2- 172.21.15.104:0/2746377228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87c8072160 0x7f87c806e4d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.047+0000 7f87cfefc640 1 -- 172.21.15.104:0/2746377228 >> 172.21.15.104:0/2746377228 conn(0x7f87c80b13f0 msgr2=0x7f87c80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:49.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.047+0000 7f87cfefc640 1 -- 172.21.15.104:0/2746377228 shutdown_connections 2024-05-08T04:21:49.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.047+0000 7f87cfefc640 1 -- 172.21.15.104:0/2746377228 wait complete. 2024-05-08T04:21:49.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.048+0000 7f87cfefc640 1 Processor -- start 2024-05-08T04:21:49.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.048+0000 7f87cfefc640 1 -- start start 2024-05-08T04:21:49.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87cfefc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87c8072160 0x7f87c813fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87cfefc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87c8159ec0 0x7f87c80b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87cfefc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87c815a2a0 0x7f87c8153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87cfefc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c815b360 con 0x7f87c815a2a0 2024-05-08T04:21:49.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87cfefc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c815b1e0 con 0x7f87c8072160 2024-05-08T04:21:49.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87cfefc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c815b4e0 con 0x7f87c8159ec0 2024-05-08T04:21:49.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87ce499640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87c815a2a0 0x7f87c8153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87ce499640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87c815a2a0 0x7f87c8153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51964/0 (socket says 172.21.15.104:51964) 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87ce499640 1 -- 172.21.15.104:0/3551009647 learned_addr learned my addr 172.21.15.104:0/3551009647 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87cdc98640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87c8072160 0x7f87c813fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87cd497640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87c8159ec0 0x7f87c80b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87ce499640 1 -- 172.21.15.104:0/3551009647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87c8159ec0 msgr2=0x7f87c80b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87ce499640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87c8159ec0 0x7f87c80b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87ce499640 1 -- 172.21.15.104:0/3551009647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87c8072160 msgr2=0x7f87c813fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87ce499640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87c8072160 0x7f87c813fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87ce499640 1 -- 172.21.15.104:0/3551009647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c81401a0 con 0x7f87c815a2a0 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.049+0000 7f87cdc98640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87c8072160 0x7f87c813fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.050+0000 7f87ce499640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87c815a2a0 0x7f87c8153f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f87c000e6e0 tx=0x7f87c000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.050+0000 7f87c67fc640 1 -- 172.21.15.104:0/3551009647 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0015070 con 0x7f87c815a2a0 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.050+0000 7f87c67fc640 1 -- 172.21.15.104:0/3551009647 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c0005ab0 con 0x7f87c815a2a0 2024-05-08T04:21:49.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.050+0000 7f87cfefc640 1 -- 172.21.15.104:0/3551009647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c8140480 con 0x7f87c815a2a0 2024-05-08T04:21:49.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.050+0000 7f87c67fc640 1 -- 172.21.15.104:0/3551009647 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0001700 con 0x7f87c815a2a0 2024-05-08T04:21:49.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.050+0000 7f87cfefc640 1 -- 172.21.15.104:0/3551009647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c8140a40 con 0x7f87c815a2a0 2024-05-08T04:21:49.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.051+0000 7f87cfefc640 1 -- 172.21.15.104:0/3551009647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c8075010 con 0x7f87c815a2a0 2024-05-08T04:21:49.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.051+0000 7f87c67fc640 1 -- 172.21.15.104:0/3551009647 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f87c0018070 con 0x7f87c815a2a0 2024-05-08T04:21:49.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.051+0000 7f87c67fc640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f87b406b500 0x7f87b406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.052+0000 7f87cdc98640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f87b406b500 0x7f87b406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.052+0000 7f87c67fc640 1 -- 172.21.15.104:0/3551009647 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87c008c3d0 con 0x7f87c815a2a0 2024-05-08T04:21:49.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.052+0000 7f87cdc98640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f87b406b500 0x7f87b406d9c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87b80045b0 tx=0x7f87b8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:49.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.056+0000 7f87c67fc640 1 -- 172.21.15.104:0/3551009647 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f87c005b250 con 0x7f87c815a2a0 2024-05-08T04:21:49.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.228+0000 7f87cfefc640 1 -- 172.21.15.104:0/3551009647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87c80af7e0 con 0x7f87c815a2a0 2024-05-08T04:21:49.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.228+0000 7f87c67fc640 1 -- 172.21.15.104:0/3551009647 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87c005ab50 con 0x7f87c815a2a0 2024-05-08T04:21:49.231 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:49.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.230+0000 7f87cfefc640 1 -- 172.21.15.104:0/3551009647 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f87b406b500 msgr2=0x7f87b406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.230+0000 7f87cfefc640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f87b406b500 0x7f87b406d9c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87b80045b0 tx=0x7f87b8009040 comp rx=0 tx=0).stop 2024-05-08T04:21:49.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.230+0000 7f87cfefc640 1 -- 172.21.15.104:0/3551009647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87c815a2a0 msgr2=0x7f87c8153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.230+0000 7f87cfefc640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87c815a2a0 0x7f87c8153f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f87c000e6e0 tx=0x7f87c000eba0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.230+0000 7f87cfefc640 1 -- 172.21.15.104:0/3551009647 shutdown_connections 2024-05-08T04:21:49.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.230+0000 7f87cfefc640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f87b406b500 0x7f87b406d9c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.230+0000 7f87cfefc640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87c815a2a0 0x7f87c8153f30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.230+0000 7f87cfefc640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87c8159ec0 0x7f87c80b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.230+0000 7f87cfefc640 1 --2- 172.21.15.104:0/3551009647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87c8072160 0x7f87c813fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.230+0000 7f87cfefc640 1 -- 172.21.15.104:0/3551009647 >> 172.21.15.104:0/3551009647 conn(0x7f87c80b13f0 msgr2=0x7f87c80b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:49.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.230+0000 7f87cfefc640 1 -- 172.21.15.104:0/3551009647 shutdown_connections 2024-05-08T04:21:49.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.230+0000 7f87cfefc640 1 -- 172.21.15.104:0/3551009647 wait complete. 2024-05-08T04:21:49.243 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:21:49.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.342+0000 7f45bb163640 1 Processor -- start 2024-05-08T04:21:49.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.342+0000 7f45bb163640 1 -- start start 2024-05-08T04:21:49.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.342+0000 7f45bb163640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f45b4158540 0x7f45b415e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.342+0000 7f45bb163640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b4073030 con 0x7f45b40cd830 2024-05-08T04:21:49.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.342+0000 7f45bb163640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b4072210 con 0x7f45b40701a0 2024-05-08T04:21:49.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.342+0000 7f45bb163640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b40cbf50 con 0x7f45b4158540 2024-05-08T04:21:49.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b9700640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f45b40cd830 0x7f45b40cc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59596/0 (socket says 172.21.15.104:59596) 2024-05-08T04:21:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b9700640 1 -- 172.21.15.104:0/1196944462 learned_addr learned my addr 172.21.15.104:0/1196944462 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b8eff640 1 --2- 172.21.15.104:0/1196944462 >> v2:172.21.15.183:3300/0 conn(0x7f45b4158540 0x7f45b415e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994635919 0 0) 0x7f45b4073030 con 0x7f45b40cd830 2024-05-08T04:21:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a0003520 con 0x7f45b40cd830 2024-05-08T04:21:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3088322563 0 0) 0x7f45a0003520 con 0x7f45b40cd830 2024-05-08T04:21:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 >> v2:172.21.15.183:3300/0 conn(0x7f45b4158540 msgr2=0x7f45b415e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 --2- 172.21.15.104:0/1196944462 >> v2:172.21.15.183:3300/0 conn(0x7f45b4158540 0x7f45b415e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 >> v1:172.21.15.183:6789/0 conn(0x7f45b40701a0 legacy=0x7f45b40cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b415e900 con 0x7f45b40cd830 2024-05-08T04:21:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f459c001670 con 0x7f45b40cd830 2024-05-08T04:21:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 >> v1:172.21.15.104:6789/0 conn(0x7f45b40cd830 legacy=0x7f45b40cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 --2- 172.21.15.104:0/1196944462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45a00039b0 0x7f45a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 --2- 172.21.15.104:0/1196944462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45a0004800 0x7f45a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 --2- 172.21.15.104:0/1196944462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45a00051c0 0x7f45a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a000c030 con 0x7f45a00051c0 2024-05-08T04:21:49.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a000c1e0 con 0x7f45a0004800 2024-05-08T04:21:49.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a000c3e0 con 0x7f45a00039b0 2024-05-08T04:21:49.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b9700640 1 --2- 172.21.15.104:0/1196944462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45a00051c0 0x7f45a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b8eff640 1 --2- 172.21.15.104:0/1196944462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45a00039b0 0x7f45a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b3fff640 1 --2- 172.21.15.104:0/1196944462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45a0004800 0x7f45a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b9700640 1 -- 172.21.15.104:0/1196944462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45a00039b0 msgr2=0x7f45a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:49.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b9700640 1 --2- 172.21.15.104:0/1196944462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45a00039b0 0x7f45a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b9700640 1 -- 172.21.15.104:0/1196944462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45a0004800 msgr2=0x7f45a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:49.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.343+0000 7f45b9700640 1 --2- 172.21.15.104:0/1196944462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45a0004800 0x7f45a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.344+0000 7f45b9700640 1 -- 172.21.15.104:0/1196944462 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0003520 con 0x7f45a00051c0 2024-05-08T04:21:49.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.344+0000 7f45b8eff640 1 --2- 172.21.15.104:0/1196944462 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45a00039b0 0x7f45a0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.344+0000 7f45b3fff640 1 --2- 172.21.15.104:0/1196944462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45a0004800 0x7f45a0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.344+0000 7f45b9700640 1 -- 172.21.15.104:0/1196944462 reap_dead start 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.344+0000 7f45b9700640 1 --2- 172.21.15.104:0/1196944462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45a00051c0 0x7f45a000b9c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f459c00c210 tx=0x7f45a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f2e93df995f664 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.344+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c007d10 con 0x7f45a00051c0 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.344+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c0058d0 con 0x7f45a00051c0 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.344+0000 7f45b37fe640 1 -- 172.21.15.104:0/1196944462 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c005cc0 con 0x7f45a00051c0 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.345+0000 7f45bb163640 1 -- 172.21.15.104:0/1196944462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45a00051c0 msgr2=0x7f45a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.345+0000 7f45bb163640 1 --2- 172.21.15.104:0/1196944462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45a00051c0 0x7f45a000b9c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f459c00c210 tx=0x7f45a0005830 comp rx=0 tx=0).stop 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.345+0000 7f45bb163640 1 -- 172.21.15.104:0/1196944462 shutdown_connections 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.345+0000 7f45bb163640 1 --2- 172.21.15.104:0/1196944462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45a00051c0 0x7f45a000b9c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.345+0000 7f45bb163640 1 -- 172.21.15.104:0/1196944462 >> 172.21.15.104:0/1196944462 conn(0x7f45b40b23e0 msgr2=0x7f45b40b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.345+0000 7f45bb163640 1 -- 172.21.15.104:0/1196944462 shutdown_connections 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.345+0000 7f45bb163640 1 -- 172.21.15.104:0/1196944462 wait complete. 2024-05-08T04:21:49.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.346+0000 7f45bb163640 1 Processor -- start 2024-05-08T04:21:49.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.346+0000 7f45bb163640 1 -- start start 2024-05-08T04:21:49.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45bb163640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45a00051c0 0x7f45b4152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45bb163640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45b4154b20 0x7f45b4154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45bb163640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45b406ab60 0x7f45b406afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45bb163640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4072a70 con 0x7f45a00051c0 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45bb163640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4072790 con 0x7f45b4154b20 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45bb163640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4072d50 con 0x7f45b406ab60 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45b8eff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45a00051c0 0x7f45b4152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45b8eff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45a00051c0 0x7f45b4152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51988/0 (socket says 172.21.15.104:51988) 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45b8eff640 1 -- 172.21.15.104:0/3371191665 learned_addr learned my addr 172.21.15.104:0/3371191665 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45b3fff640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45b4154b20 0x7f45b4154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45b9700640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45b406ab60 0x7f45b406afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45b8eff640 1 -- 172.21.15.104:0/3371191665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45b406ab60 msgr2=0x7f45b406afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45b8eff640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45b406ab60 0x7f45b406afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45b8eff640 1 -- 172.21.15.104:0/3371191665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45b4154b20 msgr2=0x7f45b4154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45b8eff640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45b4154b20 0x7f45b4154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45b8eff640 1 -- 172.21.15.104:0/3371191665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b40c6830 con 0x7f45a00051c0 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.347+0000 7f45b8eff640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45a00051c0 0x7f45b4152ff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f45ac011570 tx=0x7f45ac011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.348+0000 7f45b17fa640 1 -- 172.21.15.104:0/3371191665 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac015870 con 0x7f45a00051c0 2024-05-08T04:21:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.348+0000 7f45b17fa640 1 -- 172.21.15.104:0/3371191665 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac015a10 con 0x7f45a00051c0 2024-05-08T04:21:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.348+0000 7f45bb163640 1 -- 172.21.15.104:0/3371191665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b4155620 con 0x7f45a00051c0 2024-05-08T04:21:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.348+0000 7f45b17fa640 1 -- 172.21.15.104:0/3371191665 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac015dc0 con 0x7f45a00051c0 2024-05-08T04:21:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.348+0000 7f45bb163640 1 -- 172.21.15.104:0/3371191665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b4155be0 con 0x7f45a00051c0 2024-05-08T04:21:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.349+0000 7f45bb163640 1 -- 172.21.15.104:0/3371191665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b4075010 con 0x7f45a00051c0 2024-05-08T04:21:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.349+0000 7f45b17fa640 1 -- 172.21.15.104:0/3371191665 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f45ac00f460 con 0x7f45a00051c0 2024-05-08T04:21:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.350+0000 7f45b17fa640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f459406b500 0x7f459406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.350+0000 7f45b3fff640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f459406b500 0x7f459406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.350+0000 7f45b17fa640 1 -- 172.21.15.104:0/3371191665 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45ac08a9c0 con 0x7f45a00051c0 2024-05-08T04:21:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.350+0000 7f45b3fff640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f459406b500 0x7f459406d9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f45a4007fd0 tx=0x7f45a4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.354+0000 7f45b17fa640 1 -- 172.21.15.104:0/3371191665 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f45ac08ce20 con 0x7f45a00051c0 2024-05-08T04:21:49.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.538+0000 7f45bb163640 1 -- 172.21.15.104:0/3371191665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f45b415f130 con 0x7f45a00051c0 2024-05-08T04:21:49.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.539+0000 7f45b17fa640 1 -- 172.21.15.104:0/3371191665 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f45ac019030 con 0x7f45a00051c0 2024-05-08T04:21:49.541 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:21:49.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.541+0000 7f45bb163640 1 -- 172.21.15.104:0/3371191665 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f459406b500 msgr2=0x7f459406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.541+0000 7f45bb163640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f459406b500 0x7f459406d9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f45a4007fd0 tx=0x7f45a4009040 comp rx=0 tx=0).stop 2024-05-08T04:21:49.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.541+0000 7f45bb163640 1 -- 172.21.15.104:0/3371191665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45a00051c0 msgr2=0x7f45b4152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.541+0000 7f45bb163640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45a00051c0 0x7f45b4152ff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f45ac011570 tx=0x7f45ac011a30 comp rx=0 tx=0).stop 2024-05-08T04:21:49.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.541+0000 7f45bb163640 1 -- 172.21.15.104:0/3371191665 shutdown_connections 2024-05-08T04:21:49.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.541+0000 7f45bb163640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f459406b500 0x7f459406d9c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.541+0000 7f45bb163640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45b4154b20 0x7f45b4154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.541+0000 7f45bb163640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45b406ab60 0x7f45b406afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.541+0000 7f45bb163640 1 --2- 172.21.15.104:0/3371191665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f45a00051c0 0x7f45b4152ff0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.541+0000 7f45bb163640 1 -- 172.21.15.104:0/3371191665 >> 172.21.15.104:0/3371191665 conn(0x7f45b40b23e0 msgr2=0x7f45b40b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:49.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.541+0000 7f45bb163640 1 -- 172.21.15.104:0/3371191665 shutdown_connections 2024-05-08T04:21:49.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.541+0000 7f45bb163640 1 -- 172.21.15.104:0/3371191665 wait complete. 2024-05-08T04:21:49.554 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:21:49.554 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:21:49.571 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:49.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.708+0000 7f161bf22640 1 Processor -- start 2024-05-08T04:21:49.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.708+0000 7f161bf22640 1 -- start start 2024-05-08T04:21:49.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.709+0000 7f161bf22640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f161406ea40 0x7f16140b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.709+0000 7f161bf22640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161415e780 con 0x7f16140b3ff0 2024-05-08T04:21:49.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.709+0000 7f161bf22640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161415ea60 con 0x7f16140ceee0 2024-05-08T04:21:49.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.709+0000 7f161bf22640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161415f390 con 0x7f161406ea40 2024-05-08T04:21:49.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.709+0000 7f161a4bf640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f16140b3ff0 0x7f16140b4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59602/0 (socket says 172.21.15.104:59602) 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.709+0000 7f161a4bf640 1 -- 172.21.15.104:0/2445407545 learned_addr learned my addr 172.21.15.104:0/2445407545 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.709+0000 7f16194bd640 1 --2- 172.21.15.104:0/2445407545 >> v2:172.21.15.183:3300/0 conn(0x7f161406ea40 0x7f16140b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.709+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226953743 0 0) 0x7f161415e780 con 0x7f16140b3ff0 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.709+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15fc003520 con 0x7f16140b3ff0 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2726999056 0 0) 0x7f15fc003520 con 0x7f16140b3ff0 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 >> v2:172.21.15.183:3300/0 conn(0x7f161406ea40 msgr2=0x7f16140b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1618cbc640 1 --2- 172.21.15.104:0/2445407545 >> v2:172.21.15.183:3300/0 conn(0x7f161406ea40 0x7f16140b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 >> v1:172.21.15.183:6789/0 conn(0x7f16140ceee0 legacy=0x7f161406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161415ed40 con 0x7f16140b3ff0 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f160c001670 con 0x7f16140b3ff0 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 >> v1:172.21.15.104:6789/0 conn(0x7f16140b3ff0 legacy=0x7f16140b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1618cbc640 1 --2- 172.21.15.104:0/2445407545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15fc0039b0 0x7f15fc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1618cbc640 1 --2- 172.21.15.104:0/2445407545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15fc004800 0x7f15fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1618cbc640 1 --2- 172.21.15.104:0/2445407545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15fc0051c0 0x7f15fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161415f390 con 0x7f15fc0051c0 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc00c090 con 0x7f15fc0039b0 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc00c290 con 0x7f15fc004800 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f161a4bf640 1 --2- 172.21.15.104:0/2445407545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15fc0051c0 0x7f15fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f1619cbe640 1 --2- 172.21.15.104:0/2445407545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15fc0039b0 0x7f15fc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f16194bd640 1 --2- 172.21.15.104:0/2445407545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15fc004800 0x7f15fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f161a4bf640 1 -- 172.21.15.104:0/2445407545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15fc004800 msgr2=0x7f15fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f161a4bf640 1 --2- 172.21.15.104:0/2445407545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15fc004800 0x7f15fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f161a4bf640 1 -- 172.21.15.104:0/2445407545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15fc0039b0 msgr2=0x7f15fc003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f161a4bf640 1 --2- 172.21.15.104:0/2445407545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15fc0039b0 0x7f15fc003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f161a4bf640 1 -- 172.21.15.104:0/2445407545 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc003520 con 0x7f15fc0051c0 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.710+0000 7f16194bd640 1 --2- 172.21.15.104:0/2445407545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15fc004800 0x7f15fc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.711+0000 7f161a4bf640 1 -- 172.21.15.104:0/2445407545 reap_dead start 2024-05-08T04:21:49.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.711+0000 7f161a4bf640 1 --2- 172.21.15.104:0/2445407545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15fc0051c0 0x7f15fc00b9c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f160c00c240 tx=0x7f15fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf33f27a1a52db8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:49.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.711+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c007d10 con 0x7f15fc0051c0 2024-05-08T04:21:49.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.711+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c005ad0 con 0x7f15fc0051c0 2024-05-08T04:21:49.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.711+0000 7f1618cbc640 1 -- 172.21.15.104:0/2445407545 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c007070 con 0x7f15fc0051c0 2024-05-08T04:21:49.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.711+0000 7f161bf22640 1 -- 172.21.15.104:0/2445407545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15fc0051c0 msgr2=0x7f15fc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.711+0000 7f161bf22640 1 --2- 172.21.15.104:0/2445407545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15fc0051c0 0x7f15fc00b9c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f160c00c240 tx=0x7f15fc005830 comp rx=0 tx=0).stop 2024-05-08T04:21:49.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.711+0000 7f161bf22640 1 -- 172.21.15.104:0/2445407545 shutdown_connections 2024-05-08T04:21:49.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.711+0000 7f161bf22640 1 --2- 172.21.15.104:0/2445407545 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15fc0051c0 0x7f15fc00b9c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.711+0000 7f161bf22640 1 -- 172.21.15.104:0/2445407545 >> 172.21.15.104:0/2445407545 conn(0x7f16140b13f0 msgr2=0x7f16140b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:49.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.712+0000 7f161bf22640 1 -- 172.21.15.104:0/2445407545 shutdown_connections 2024-05-08T04:21:49.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.712+0000 7f161bf22640 1 -- 172.21.15.104:0/2445407545 wait complete. 2024-05-08T04:21:49.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.713+0000 7f161bf22640 1 Processor -- start 2024-05-08T04:21:49.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.713+0000 7f161bf22640 1 -- start start 2024-05-08T04:21:49.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.713+0000 7f161bf22640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15fc0051c0 0x7f16140c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.713+0000 7f161bf22640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16140c5ce0 0x7f161415a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.713+0000 7f161bf22640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16141553d0 0x7f1614148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.713+0000 7f161bf22640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16140cf440 con 0x7f16140c5ce0 2024-05-08T04:21:49.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.713+0000 7f161bf22640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16140cf2c0 con 0x7f15fc0051c0 2024-05-08T04:21:49.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.713+0000 7f161bf22640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16140b26f0 con 0x7f16141553d0 2024-05-08T04:21:49.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f16194bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16140c5ce0 0x7f161415a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f16194bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16140c5ce0 0x7f161415a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52004/0 (socket says 172.21.15.104:52004) 2024-05-08T04:21:49.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f16194bd640 1 -- 172.21.15.104:0/916287403 learned_addr learned my addr 172.21.15.104:0/916287403 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:49.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f161a4bf640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16141553d0 0x7f1614148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f1619cbe640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15fc0051c0 0x7f16140c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f16194bd640 1 -- 172.21.15.104:0/916287403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16141553d0 msgr2=0x7f1614148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f16194bd640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16141553d0 0x7f1614148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f16194bd640 1 -- 172.21.15.104:0/916287403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15fc0051c0 msgr2=0x7f16140c4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f16194bd640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15fc0051c0 0x7f16140c4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f16194bd640 1 -- 172.21.15.104:0/916287403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16140c4c40 con 0x7f16140c5ce0 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f1619cbe640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15fc0051c0 0x7f16140c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f161a4bf640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16141553d0 0x7f1614148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f16194bd640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16140c5ce0 0x7f161415a080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1608011540 tx=0x7f1608011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f16127fc640 1 -- 172.21.15.104:0/916287403 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608015870 con 0x7f16140c5ce0 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f16127fc640 1 -- 172.21.15.104:0/916287403 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1608015a10 con 0x7f16140c5ce0 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f16127fc640 1 -- 172.21.15.104:0/916287403 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608015dc0 con 0x7f16140c5ce0 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f161bf22640 1 -- 172.21.15.104:0/916287403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16140c4f20 con 0x7f16140c5ce0 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.714+0000 7f161bf22640 1 -- 172.21.15.104:0/916287403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16140c54e0 con 0x7f16140c5ce0 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.715+0000 7f161bf22640 1 -- 172.21.15.104:0/916287403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1614075010 con 0x7f16140c5ce0 2024-05-08T04:21:49.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.716+0000 7f16127fc640 1 -- 172.21.15.104:0/916287403 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f160800f460 con 0x7f16140c5ce0 2024-05-08T04:21:49.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.716+0000 7f16127fc640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f160006b500 0x7f160006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:49.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.716+0000 7f16127fc640 1 -- 172.21.15.104:0/916287403 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f160808ab20 con 0x7f16140c5ce0 2024-05-08T04:21:49.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.716+0000 7f1619cbe640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f160006b500 0x7f160006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:49.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.717+0000 7f1619cbe640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f160006b500 0x7f160006d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1604000f80 tx=0x7f1604009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:49.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.720+0000 7f16127fc640 1 -- 172.21.15.104:0/916287403 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1608019030 con 0x7f16140c5ce0 2024-05-08T04:21:49.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.894+0000 7f161bf22640 1 -- 172.21.15.104:0/916287403 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f161406f3f0 con 0x7f16140c5ce0 2024-05-08T04:21:49.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.895+0000 7f16127fc640 1 -- 172.21.15.104:0/916287403 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f1608059910 con 0x7f16140c5ce0 2024-05-08T04:21:49.897 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:49.897 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:11.793502+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:49.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.897+0000 7f161bf22640 1 -- 172.21.15.104:0/916287403 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f160006b500 msgr2=0x7f160006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.897+0000 7f161bf22640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f160006b500 0x7f160006d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1604000f80 tx=0x7f1604009040 comp rx=0 tx=0).stop 2024-05-08T04:21:49.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.897+0000 7f161bf22640 1 -- 172.21.15.104:0/916287403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16140c5ce0 msgr2=0x7f161415a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:49.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.897+0000 7f161bf22640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16140c5ce0 0x7f161415a080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1608011540 tx=0x7f1608011a00 comp rx=0 tx=0).stop 2024-05-08T04:21:49.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.897+0000 7f161bf22640 1 -- 172.21.15.104:0/916287403 shutdown_connections 2024-05-08T04:21:49.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.897+0000 7f161bf22640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f160006b500 0x7f160006d9c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.897+0000 7f161bf22640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16141553d0 0x7f1614148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.897+0000 7f161bf22640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16140c5ce0 0x7f161415a080 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.897+0000 7f161bf22640 1 --2- 172.21.15.104:0/916287403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15fc0051c0 0x7f16140c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:49.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.897+0000 7f161bf22640 1 -- 172.21.15.104:0/916287403 >> 172.21.15.104:0/916287403 conn(0x7f16140b13f0 msgr2=0x7f161406d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:49.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.897+0000 7f161bf22640 1 -- 172.21.15.104:0/916287403 shutdown_connections 2024-05-08T04:21:49.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:49.897+0000 7f161bf22640 1 -- 172.21.15.104:0/916287403 wait complete. 2024-05-08T04:21:49.910 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:49.911 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:50.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.012+0000 7fefb1ca3640 1 Processor -- start 2024-05-08T04:21:50.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.012+0000 7fefb1ca3640 1 -- start start 2024-05-08T04:21:50.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.013+0000 7fefb1ca3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fefac0cc470 0x7fefac0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.013+0000 7fefb1ca3640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac0cfc00 con 0x7fefac15ab50 2024-05-08T04:21:50.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.013+0000 7fefb1ca3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac0ca5d0 con 0x7fefac0ce0e0 2024-05-08T04:21:50.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.013+0000 7fefb1ca3640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefac0ce850 con 0x7fefac0cc470 2024-05-08T04:21:50.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.013+0000 7fefaaffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fefac0cc470 0x7fefac0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.013+0000 7fefab7fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fefac15ab50 0x7fefac0cd9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59604/0 (socket says 172.21.15.104:59604) 2024-05-08T04:21:50.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.013+0000 7fefab7fe640 1 -- 172.21.15.104:0/798977302 learned_addr learned my addr 172.21.15.104:0/798977302 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:50.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.013+0000 7fefaaffd640 1 -- 172.21.15.104:0/798977302 >> v1:172.21.15.183:6789/0 conn(0x7fefac0ce0e0 legacy=0x7fefac0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.013+0000 7fefaaffd640 1 -- 172.21.15.104:0/798977302 >> v1:172.21.15.104:6789/0 conn(0x7fefac15ab50 legacy=0x7fefac0cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.013+0000 7fefaaffd640 1 -- 172.21.15.104:0/798977302 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac06bda0 con 0x7fefac0cc470 2024-05-08T04:21:50.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.013+0000 7fefaa7fc640 1 -- 172.21.15.104:0/798977302 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902296093 0 0) 0x7fefac0cfc00 con 0x7fefac15ab50 2024-05-08T04:21:50.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.014+0000 7fefaaffd640 1 --2- 172.21.15.104:0/798977302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefac0cc470 0x7fefac0cefb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fefa00097a0 tx=0x7fefa002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6285abd46192d495 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:50.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.014+0000 7fefaa7fc640 1 -- 172.21.15.104:0/798977302 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0037070 con 0x7fefac0cc470 2024-05-08T04:21:50.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.014+0000 7fefaa7fc640 1 -- 172.21.15.104:0/798977302 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa0032440 con 0x7fefac0cc470 2024-05-08T04:21:50.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.014+0000 7fefaa7fc640 1 -- 172.21.15.104:0/798977302 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa002ae60 con 0x7fefac0cc470 2024-05-08T04:21:50.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.015+0000 7fefb1ca3640 1 -- 172.21.15.104:0/798977302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefac0cc470 msgr2=0x7fefac0cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.015+0000 7fefb1ca3640 1 --2- 172.21.15.104:0/798977302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefac0cc470 0x7fefac0cefb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fefa00097a0 tx=0x7fefa002a110 comp rx=0 tx=0).stop 2024-05-08T04:21:50.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.015+0000 7fefb1ca3640 1 -- 172.21.15.104:0/798977302 shutdown_connections 2024-05-08T04:21:50.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.015+0000 7fefb1ca3640 1 --2- 172.21.15.104:0/798977302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefac0cc470 0x7fefac0cefb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.015+0000 7fefb1ca3640 1 -- 172.21.15.104:0/798977302 >> 172.21.15.104:0/798977302 conn(0x7fefac0cc880 msgr2=0x7fefac0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:50.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.015+0000 7fefb1ca3640 1 -- 172.21.15.104:0/798977302 shutdown_connections 2024-05-08T04:21:50.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.015+0000 7fefb1ca3640 1 -- 172.21.15.104:0/798977302 wait complete. 2024-05-08T04:21:50.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.016+0000 7fefb1ca3640 1 Processor -- start 2024-05-08T04:21:50.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.016+0000 7fefb1ca3640 1 -- start start 2024-05-08T04:21:50.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefb1ca3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefac0cc470 0x7fefac15d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefb1ca3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefac0ce0e0 0x7fefac148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefb1ca3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefac15ab50 0x7fefac150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefb1ca3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac0cbf50 con 0x7fefac15ab50 2024-05-08T04:21:50.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefb1ca3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac0ca8b0 con 0x7fefac0cc470 2024-05-08T04:21:50.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefb1ca3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac0acd80 con 0x7fefac0ce0e0 2024-05-08T04:21:50.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefabfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefac15ab50 0x7fefac150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefabfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefac15ab50 0x7fefac150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52030/0 (socket says 172.21.15.104:52030) 2024-05-08T04:21:50.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefabfff640 1 -- 172.21.15.104:0/2417538004 learned_addr learned my addr 172.21.15.104:0/2417538004 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:50.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefab7fe640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefac0cc470 0x7fefac15d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefabfff640 1 -- 172.21.15.104:0/2417538004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefac0ce0e0 msgr2=0x7fefac148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefabfff640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefac0ce0e0 0x7fefac148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefabfff640 1 -- 172.21.15.104:0/2417538004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefac0cc470 msgr2=0x7fefac15d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefabfff640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefac0cc470 0x7fefac15d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefabfff640 1 -- 172.21.15.104:0/2417538004 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac15c9c0 con 0x7fefac15ab50 2024-05-08T04:21:50.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefab7fe640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefac0cc470 0x7fefac15d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:50.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.017+0000 7fefabfff640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefac15ab50 0x7fefac150e00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fefa400c7d0 tx=0x7fefa400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:50.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.018+0000 7fef93fff640 1 -- 172.21.15.104:0/2417538004 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4003b70 con 0x7fefac15ab50 2024-05-08T04:21:50.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.018+0000 7fef93fff640 1 -- 172.21.15.104:0/2417538004 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa4003d30 con 0x7fefac15ab50 2024-05-08T04:21:50.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.018+0000 7fef93fff640 1 -- 172.21.15.104:0/2417538004 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa400aa90 con 0x7fefac15ab50 2024-05-08T04:21:50.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.018+0000 7fefb1ca3640 1 -- 172.21.15.104:0/2417538004 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefac15cc30 con 0x7fefac15ab50 2024-05-08T04:21:50.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.018+0000 7fefb1ca3640 1 -- 172.21.15.104:0/2417538004 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac15d1f0 con 0x7fefac15ab50 2024-05-08T04:21:50.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.019+0000 7fefb1ca3640 1 -- 172.21.15.104:0/2417538004 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefac075010 con 0x7fefac15ab50 2024-05-08T04:21:50.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.019+0000 7fef93fff640 1 -- 172.21.15.104:0/2417538004 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fefa400ac30 con 0x7fefac15ab50 2024-05-08T04:21:50.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.020+0000 7fef93fff640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fef9806b4d0 0x7fef9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.020+0000 7fef93fff640 1 -- 172.21.15.104:0/2417538004 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefa408a230 con 0x7fefac15ab50 2024-05-08T04:21:50.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.020+0000 7fefab7fe640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fef9806b4d0 0x7fef9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.020+0000 7fefab7fe640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fef9806b4d0 0x7fef9806d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fef9c000f60 tx=0x7fef9c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:50.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.024+0000 7fef93fff640 1 -- 172.21.15.104:0/2417538004 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fefa4059020 con 0x7fefac15ab50 2024-05-08T04:21:50.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.192+0000 7fefb1ca3640 1 -- 172.21.15.104:0/2417538004 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fefac074320 con 0x7fefac15ab50 2024-05-08T04:21:50.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.192+0000 7fef93fff640 1 -- 172.21.15.104:0/2417538004 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fefa4058920 con 0x7fefac15ab50 2024-05-08T04:21:50.194 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:50.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.194+0000 7fefb1ca3640 1 -- 172.21.15.104:0/2417538004 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fef9806b4d0 msgr2=0x7fef9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.194+0000 7fefb1ca3640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fef9806b4d0 0x7fef9806d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fef9c000f60 tx=0x7fef9c009040 comp rx=0 tx=0).stop 2024-05-08T04:21:50.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.194+0000 7fefb1ca3640 1 -- 172.21.15.104:0/2417538004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefac15ab50 msgr2=0x7fefac150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.194+0000 7fefb1ca3640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefac15ab50 0x7fefac150e00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fefa400c7d0 tx=0x7fefa400cc90 comp rx=0 tx=0).stop 2024-05-08T04:21:50.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.194+0000 7fefb1ca3640 1 -- 172.21.15.104:0/2417538004 shutdown_connections 2024-05-08T04:21:50.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.194+0000 7fefb1ca3640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fef9806b4d0 0x7fef9806d990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.194+0000 7fefb1ca3640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefac15ab50 0x7fefac150e00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.194+0000 7fefb1ca3640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefac0ce0e0 0x7fefac148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.194+0000 7fefb1ca3640 1 --2- 172.21.15.104:0/2417538004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefac0cc470 0x7fefac15d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.194+0000 7fefb1ca3640 1 -- 172.21.15.104:0/2417538004 >> 172.21.15.104:0/2417538004 conn(0x7fefac0cc880 msgr2=0x7fefac1531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:50.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.194+0000 7fefb1ca3640 1 -- 172.21.15.104:0/2417538004 shutdown_connections 2024-05-08T04:21:50.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.194+0000 7fefb1ca3640 1 -- 172.21.15.104:0/2417538004 wait complete. 2024-05-08T04:21:50.208 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:50.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.308+0000 7f4588748640 1 Processor -- start 2024-05-08T04:21:50.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.308+0000 7f4588748640 1 -- start start 2024-05-08T04:21:50.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.309+0000 7f4588748640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4580070c70 0x7f45800d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.309+0000 7f4588748640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458015d420 con 0x7f458015dbe0 2024-05-08T04:21:50.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.309+0000 7f4588748640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45800d10e0 con 0x7f4580071050 2024-05-08T04:21:50.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.309+0000 7f4588748640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45800d16a0 con 0x7f4580070c70 2024-05-08T04:21:50.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.309+0000 7f45864e4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4580070c70 0x7f45800d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.309+0000 7f4586ce5640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f458015dbe0 0x7f458015dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59614/0 (socket says 172.21.15.104:59614) 2024-05-08T04:21:50.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.309+0000 7f45864e4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4580070c70 0x7f45800d0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52036/0 (socket says 172.21.15.104:52036) 2024-05-08T04:21:50.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.309+0000 7f4586ce5640 1 -- 172.21.15.104:0/3177954894 learned_addr learned my addr 172.21.15.104:0/3177954894 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:50.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.310+0000 7f45864e4640 1 -- 172.21.15.104:0/3177954894 >> v1:172.21.15.183:6789/0 conn(0x7f4580071050 legacy=0x7f458015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.310+0000 7f45864e4640 1 -- 172.21.15.104:0/3177954894 >> v1:172.21.15.104:6789/0 conn(0x7f458015dbe0 legacy=0x7f458015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.310+0000 7f45864e4640 1 -- 172.21.15.104:0/3177954894 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800d13c0 con 0x7f4580070c70 2024-05-08T04:21:50.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.310+0000 7f45854e2640 1 -- 172.21.15.104:0/3177954894 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941299501 0 0) 0x7f458015d420 con 0x7f458015dbe0 2024-05-08T04:21:50.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.310+0000 7f45864e4640 1 --2- 172.21.15.104:0/3177954894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4580070c70 0x7f45800d0970 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f457c009d90 tx=0x7f457c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d72aa633080163 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:50.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.310+0000 7f45854e2640 1 -- 172.21.15.104:0/3177954894 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c007740 con 0x7f4580070c70 2024-05-08T04:21:50.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.310+0000 7f45854e2640 1 -- 172.21.15.104:0/3177954894 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c0078e0 con 0x7f4580070c70 2024-05-08T04:21:50.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.310+0000 7f45854e2640 1 -- 172.21.15.104:0/3177954894 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c007cb0 con 0x7f4580070c70 2024-05-08T04:21:50.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.311+0000 7f4588748640 1 -- 172.21.15.104:0/3177954894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4580070c70 msgr2=0x7f45800d0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.311+0000 7f4588748640 1 --2- 172.21.15.104:0/3177954894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4580070c70 0x7f45800d0970 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f457c009d90 tx=0x7f457c02a6f0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.311+0000 7f4588748640 1 -- 172.21.15.104:0/3177954894 shutdown_connections 2024-05-08T04:21:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.311+0000 7f4588748640 1 --2- 172.21.15.104:0/3177954894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4580070c70 0x7f45800d0970 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.311+0000 7f4588748640 1 -- 172.21.15.104:0/3177954894 >> 172.21.15.104:0/3177954894 conn(0x7f45800b3450 msgr2=0x7f45800b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.311+0000 7f4588748640 1 -- 172.21.15.104:0/3177954894 shutdown_connections 2024-05-08T04:21:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.311+0000 7f4588748640 1 -- 172.21.15.104:0/3177954894 wait complete. 2024-05-08T04:21:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.312+0000 7f4588748640 1 Processor -- start 2024-05-08T04:21:50.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.312+0000 7f4588748640 1 -- start start 2024-05-08T04:21:50.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4588748640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4580070c70 0x7f45801472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4588748640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4580071050 0x7f458015a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4588748640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f458015dbe0 0x7f458015ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4588748640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4580071500 con 0x7f458015dbe0 2024-05-08T04:21:50.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4588748640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458015cca0 con 0x7f4580070c70 2024-05-08T04:21:50.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4588748640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458015ce20 con 0x7f4580071050 2024-05-08T04:21:50.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4586ce5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f458015dbe0 0x7f458015ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4586ce5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f458015dbe0 0x7f458015ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52038/0 (socket says 172.21.15.104:52038) 2024-05-08T04:21:50.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4586ce5640 1 -- 172.21.15.104:0/926271106 learned_addr learned my addr 172.21.15.104:0/926271106 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:50.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f45864e4640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4580070c70 0x7f45801472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4585ce3640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4580071050 0x7f458015a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4586ce5640 1 -- 172.21.15.104:0/926271106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4580071050 msgr2=0x7f458015a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4586ce5640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4580071050 0x7f458015a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4586ce5640 1 -- 172.21.15.104:0/926271106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4580070c70 msgr2=0x7f45801472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4586ce5640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4580070c70 0x7f45801472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f4586ce5640 1 -- 172.21.15.104:0/926271106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45801477e0 con 0x7f458015dbe0 2024-05-08T04:21:50.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.313+0000 7f45864e4640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4580070c70 0x7f45801472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:50.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.314+0000 7f4586ce5640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f458015dbe0 0x7f458015ae30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f457800c3e0 tx=0x7f457800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:50.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.314+0000 7f4576ffd640 1 -- 172.21.15.104:0/926271106 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578017070 con 0x7f458015dbe0 2024-05-08T04:21:50.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.314+0000 7f4576ffd640 1 -- 172.21.15.104:0/926271106 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4578005ce0 con 0x7f458015dbe0 2024-05-08T04:21:50.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.314+0000 7f4588748640 1 -- 172.21.15.104:0/926271106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45801e6fb0 con 0x7f458015dbe0 2024-05-08T04:21:50.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.314+0000 7f4576ffd640 1 -- 172.21.15.104:0/926271106 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45780072f0 con 0x7f458015dbe0 2024-05-08T04:21:50.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.314+0000 7f4588748640 1 -- 172.21.15.104:0/926271106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45801f41d0 con 0x7f458015dbe0 2024-05-08T04:21:50.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.315+0000 7f4588748640 1 -- 172.21.15.104:0/926271106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4580075010 con 0x7f458015dbe0 2024-05-08T04:21:50.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.315+0000 7f4576ffd640 1 -- 172.21.15.104:0/926271106 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f457801a070 con 0x7f458015dbe0 2024-05-08T04:21:50.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.316+0000 7f4576ffd640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f456406b4d0 0x7f456406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.316+0000 7f4576ffd640 1 -- 172.21.15.104:0/926271106 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45780895b0 con 0x7f458015dbe0 2024-05-08T04:21:50.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.316+0000 7f45864e4640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f456406b4d0 0x7f456406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.316+0000 7f45864e4640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f456406b4d0 0x7f456406d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f457c034000 tx=0x7f457c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:50.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.320+0000 7f4576ffd640 1 -- 172.21.15.104:0/926271106 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f45801477e0 con 0x7f458015dbe0 2024-05-08T04:21:50.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.488+0000 7f4588748640 1 -- 172.21.15.104:0/926271106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45800b4180 con 0x7f458015dbe0 2024-05-08T04:21:50.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.488+0000 7f4576ffd640 1 -- 172.21.15.104:0/926271106 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4578058430 con 0x7f458015dbe0 2024-05-08T04:21:50.491 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:50.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.490+0000 7f4588748640 1 -- 172.21.15.104:0/926271106 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f456406b4d0 msgr2=0x7f456406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.490+0000 7f4588748640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f456406b4d0 0x7f456406d990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f457c034000 tx=0x7f457c02f000 comp rx=0 tx=0).stop 2024-05-08T04:21:50.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.490+0000 7f4588748640 1 -- 172.21.15.104:0/926271106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f458015dbe0 msgr2=0x7f458015ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.490+0000 7f4588748640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f458015dbe0 0x7f458015ae30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f457800c3e0 tx=0x7f457800c8a0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.490+0000 7f4588748640 1 -- 172.21.15.104:0/926271106 shutdown_connections 2024-05-08T04:21:50.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.490+0000 7f4588748640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f456406b4d0 0x7f456406d990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.490+0000 7f4588748640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f458015dbe0 0x7f458015ae30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.490+0000 7f4588748640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4580071050 0x7f458015a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.490+0000 7f4588748640 1 --2- 172.21.15.104:0/926271106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4580070c70 0x7f45801472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.490+0000 7f4588748640 1 -- 172.21.15.104:0/926271106 >> 172.21.15.104:0/926271106 conn(0x7f45800b3450 msgr2=0x7f458015f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:50.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.490+0000 7f4588748640 1 -- 172.21.15.104:0/926271106 shutdown_connections 2024-05-08T04:21:50.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.490+0000 7f4588748640 1 -- 172.21.15.104:0/926271106 wait complete. 2024-05-08T04:21:50.504 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:50.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.604+0000 7f8544fab640 1 Processor -- start 2024-05-08T04:21:50.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.604+0000 7f8544fab640 1 -- start start 2024-05-08T04:21:50.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f8544fab640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85400cc930 0x7f85400ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f8544fab640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f854006e860 0x7f854015fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f8544fab640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8540071fb0 con 0x7f85400711c0 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f8544fab640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85400cd250 con 0x7f85400cc930 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f8544fab640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8540071710 con 0x7f854006e860 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f853dd9b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f85400711c0 0x7f854015f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59630/0 (socket says 172.21.15.104:59630) 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f853dd9b640 1 -- 172.21.15.104:0/3999922128 learned_addr learned my addr 172.21.15.104:0/3999922128 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f853e59c640 1 --2- 172.21.15.104:0/3999922128 >> v2:172.21.15.183:3300/0 conn(0x7f85400cc930 0x7f85400ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f853ed9d640 1 --2- 172.21.15.104:0/3999922128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f854006e860 0x7f854015fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171876411 0 0) 0x7f8540071fb0 con 0x7f85400711c0 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8528003520 con 0x7f85400711c0 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2470507784 0 0) 0x7f8528003520 con 0x7f85400711c0 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f854006e860 msgr2=0x7f854015fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f853d59a640 1 --2- 172.21.15.104:0/3999922128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f854006e860 0x7f854015fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 >> v2:172.21.15.183:3300/0 conn(0x7f85400cc930 msgr2=0x7f85400ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f853d59a640 1 --2- 172.21.15.104:0/3999922128 >> v2:172.21.15.183:3300/0 conn(0x7f85400cc930 0x7f85400ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85400719f0 con 0x7f85400711c0 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.605+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f8534001670 con 0x7f85400711c0 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 >> v1:172.21.15.104:6789/0 conn(0x7f85400711c0 legacy=0x7f854015f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853d59a640 1 --2- 172.21.15.104:0/3999922128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85280039b0 0x7f8528003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853d59a640 1 --2- 172.21.15.104:0/3999922128 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8528004800 0x7f8528004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853d59a640 1 --2- 172.21.15.104:0/3999922128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f854006e860 0x7f85280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85400cd250 con 0x7f8528004800 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8540071710 con 0x7f85280039b0 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852800b9c0 con 0x7f854006e860 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853dd9b640 1 --2- 172.21.15.104:0/3999922128 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8528004800 0x7f8528004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853e59c640 1 --2- 172.21.15.104:0/3999922128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85280039b0 0x7f8528003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853ed9d640 1 --2- 172.21.15.104:0/3999922128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f854006e860 0x7f85280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853dd9b640 1 -- 172.21.15.104:0/3999922128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f854006e860 msgr2=0x7f85280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853dd9b640 1 --2- 172.21.15.104:0/3999922128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f854006e860 0x7f85280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853dd9b640 1 -- 172.21.15.104:0/3999922128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85280039b0 msgr2=0x7f8528003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853dd9b640 1 --2- 172.21.15.104:0/3999922128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85280039b0 0x7f8528003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853dd9b640 1 -- 172.21.15.104:0/3999922128 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8528003520 con 0x7f8528004800 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.606+0000 7f853e59c640 1 --2- 172.21.15.104:0/3999922128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85280039b0 0x7f8528003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.607+0000 7f853dd9b640 1 --2- 172.21.15.104:0/3999922128 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8528004800 0x7f8528004c80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f853400c210 tx=0x7f8528005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6f1d18ca029205 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.607+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534007d70 con 0x7f8528004800 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.607+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8534005af0 con 0x7f8528004800 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.607+0000 7f853d59a640 1 -- 172.21.15.104:0/3999922128 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534007070 con 0x7f8528004800 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.607+0000 7f8544fab640 1 -- 172.21.15.104:0/3999922128 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8528004800 msgr2=0x7f8528004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.607+0000 7f8544fab640 1 --2- 172.21.15.104:0/3999922128 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8528004800 0x7f8528004c80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f853400c210 tx=0x7f8528005830 comp rx=0 tx=0).stop 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.607+0000 7f853ed9d640 1 -- 172.21.15.104:0/3999922128 reap_dead start 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.607+0000 7f8544fab640 1 -- 172.21.15.104:0/3999922128 shutdown_connections 2024-05-08T04:21:50.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.607+0000 7f8544fab640 1 -- 172.21.15.104:0/3999922128 >> 172.21.15.104:0/3999922128 conn(0x7f85400b13f0 msgr2=0x7f85400b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:50.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.607+0000 7f8544fab640 1 -- 172.21.15.104:0/3999922128 shutdown_connections 2024-05-08T04:21:50.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.607+0000 7f8544fab640 1 -- 172.21.15.104:0/3999922128 wait complete. 2024-05-08T04:21:50.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.609+0000 7f8544fab640 1 Processor -- start 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.609+0000 7f8544fab640 1 -- start start 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.609+0000 7f8544fab640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8528004800 0x7f8540140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.609+0000 7f8544fab640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85400ac5c0 0x7f85400aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.609+0000 7f8544fab640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85401f1d20 0x7f85401f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.609+0000 7f8544fab640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85400cf3b0 con 0x7f8528004800 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.609+0000 7f8544fab640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854006d330 con 0x7f85401f1d20 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.609+0000 7f8544fab640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85401453f0 con 0x7f85400ac5c0 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f853e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8528004800 0x7f8540140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f853e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8528004800 0x7f8540140170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52056/0 (socket says 172.21.15.104:52056) 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f853e59c640 1 -- 172.21.15.104:0/2561513734 learned_addr learned my addr 172.21.15.104:0/2561513734 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f853dd9b640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85400ac5c0 0x7f85400aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f853ed9d640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85401f1d20 0x7f85401f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f853e59c640 1 -- 172.21.15.104:0/2561513734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85400ac5c0 msgr2=0x7f85400aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f853e59c640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85400ac5c0 0x7f85400aca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f853e59c640 1 -- 172.21.15.104:0/2561513734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85401f1d20 msgr2=0x7f85401f21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f853e59c640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85401f1d20 0x7f85401f21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f853e59c640 1 -- 172.21.15.104:0/2561513734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85400ad350 con 0x7f8528004800 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f853ed9d640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85401f1d20 0x7f85401f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f853e59c640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8528004800 0x7f8540140170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8530011630 tx=0x7f8530011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f852effd640 1 -- 172.21.15.104:0/2561513734 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853000f920 con 0x7f8528004800 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f852effd640 1 -- 172.21.15.104:0/2561513734 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853000fac0 con 0x7f8528004800 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f852effd640 1 -- 172.21.15.104:0/2561513734 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853000fe90 con 0x7f8528004800 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f8544fab640 1 -- 172.21.15.104:0/2561513734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85400ad630 con 0x7f8528004800 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.610+0000 7f8544fab640 1 -- 172.21.15.104:0/2561513734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85400adbf0 con 0x7f8528004800 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.611+0000 7f8544fab640 1 -- 172.21.15.104:0/2561513734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8540075010 con 0x7f8528004800 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.612+0000 7f852effd640 1 -- 172.21.15.104:0/2561513734 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8530015460 con 0x7f8528004800 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.612+0000 7f852effd640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f852006b670 0x7f852006db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.612+0000 7f852effd640 1 -- 172.21.15.104:0/2561513734 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f853008ab10 con 0x7f8528004800 2024-05-08T04:21:50.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.612+0000 7f853dd9b640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f852006b670 0x7f852006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.613+0000 7f853dd9b640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f852006b670 0x7f852006db30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8534033000 tx=0x7f8534009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:50.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.616+0000 7f852effd640 1 -- 172.21.15.104:0/2561513734 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8530019030 con 0x7f8528004800 2024-05-08T04:21:50.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.794+0000 7f8544fab640 1 -- 172.21.15.104:0/2561513734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f85400cc100 con 0x7f8528004800 2024-05-08T04:21:50.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.794+0000 7f852effd640 1 -- 172.21.15.104:0/2561513734 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8530059990 con 0x7f8528004800 2024-05-08T04:21:50.797 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:50.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.796+0000 7f8544fab640 1 -- 172.21.15.104:0/2561513734 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f852006b670 msgr2=0x7f852006db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.796+0000 7f8544fab640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f852006b670 0x7f852006db30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8534033000 tx=0x7f8534009030 comp rx=0 tx=0).stop 2024-05-08T04:21:50.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.796+0000 7f8544fab640 1 -- 172.21.15.104:0/2561513734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8528004800 msgr2=0x7f8540140170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.796+0000 7f8544fab640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8528004800 0x7f8540140170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8530011630 tx=0x7f8530011af0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.796+0000 7f8544fab640 1 -- 172.21.15.104:0/2561513734 shutdown_connections 2024-05-08T04:21:50.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.796+0000 7f8544fab640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f852006b670 0x7f852006db30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.796+0000 7f8544fab640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85401f1d20 0x7f85401f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.796+0000 7f8544fab640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85400ac5c0 0x7f85400aca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.796+0000 7f8544fab640 1 --2- 172.21.15.104:0/2561513734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8528004800 0x7f8540140170 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.796+0000 7f8544fab640 1 -- 172.21.15.104:0/2561513734 >> 172.21.15.104:0/2561513734 conn(0x7f85400b13f0 msgr2=0x7f8540144c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:50.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.796+0000 7f8544fab640 1 -- 172.21.15.104:0/2561513734 shutdown_connections 2024-05-08T04:21:50.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.796+0000 7f8544fab640 1 -- 172.21.15.104:0/2561513734 wait complete. 2024-05-08T04:21:50.810 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:21:50.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.908+0000 7fd68259e640 1 Processor -- start 2024-05-08T04:21:50.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.908+0000 7fd68259e640 1 -- start start 2024-05-08T04:21:50.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.909+0000 7fd68259e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd67c0ceee0 0x7fd67c0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.909+0000 7fd68259e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c15e780 con 0x7fd67c0b4700 2024-05-08T04:21:50.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.909+0000 7fd68259e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd67c15ea60 con 0x7fd67c06e330 2024-05-08T04:21:50.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.909+0000 7fd68259e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c15f390 con 0x7fd67c0ceee0 2024-05-08T04:21:50.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.909+0000 7fd67bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd67c0ceee0 0x7fd67c0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.909+0000 7fd680b3b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd67c0b4700 0x7fd67c15b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59644/0 (socket says 172.21.15.104:59644) 2024-05-08T04:21:50.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.909+0000 7fd680b3b640 1 -- 172.21.15.104:0/3104719218 learned_addr learned my addr 172.21.15.104:0/3104719218 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:50.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.910+0000 7fd67bfff640 1 -- 172.21.15.104:0/3104719218 >> v1:172.21.15.183:6789/0 conn(0x7fd67c06e330 legacy=0x7fd67c0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:50.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.910+0000 7fd67bfff640 1 -- 172.21.15.104:0/3104719218 >> v1:172.21.15.104:6789/0 conn(0x7fd67c0b4700 legacy=0x7fd67c15b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.910+0000 7fd67bfff640 1 -- 172.21.15.104:0/3104719218 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c15ed40 con 0x7fd67c0ceee0 2024-05-08T04:21:50.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.910+0000 7fd67affd640 1 -- 172.21.15.104:0/3104719218 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517956067 0 0) 0x7fd67c15e780 con 0x7fd67c0b4700 2024-05-08T04:21:50.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.910+0000 7fd67bfff640 1 --2- 172.21.15.104:0/3104719218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd67c0ceee0 0x7fd67c0b26f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0097a0 tx=0x7fd66c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120b96dfa58e4f44 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:50.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.910+0000 7fd67affd640 1 -- 172.21.15.104:0/3104719218 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c037070 con 0x7fd67c0ceee0 2024-05-08T04:21:50.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.911+0000 7fd67affd640 1 -- 172.21.15.104:0/3104719218 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c032440 con 0x7fd67c0ceee0 2024-05-08T04:21:50.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.911+0000 7fd67affd640 1 -- 172.21.15.104:0/3104719218 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c032810 con 0x7fd67c0ceee0 2024-05-08T04:21:50.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.911+0000 7fd68259e640 1 -- 172.21.15.104:0/3104719218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd67c0ceee0 msgr2=0x7fd67c0b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.911+0000 7fd68259e640 1 --2- 172.21.15.104:0/3104719218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd67c0ceee0 0x7fd67c0b26f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0097a0 tx=0x7fd66c02a1e0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.911+0000 7fd68259e640 1 -- 172.21.15.104:0/3104719218 shutdown_connections 2024-05-08T04:21:50.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.911+0000 7fd68259e640 1 --2- 172.21.15.104:0/3104719218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd67c0ceee0 0x7fd67c0b26f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.911+0000 7fd68259e640 1 -- 172.21.15.104:0/3104719218 >> 172.21.15.104:0/3104719218 conn(0x7fd67c0b13f0 msgr2=0x7fd67c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:50.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.911+0000 7fd68259e640 1 -- 172.21.15.104:0/3104719218 shutdown_connections 2024-05-08T04:21:50.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.911+0000 7fd68259e640 1 -- 172.21.15.104:0/3104719218 wait complete. 2024-05-08T04:21:50.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.912+0000 7fd68259e640 1 Processor -- start 2024-05-08T04:21:50.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.912+0000 7fd68259e640 1 -- start start 2024-05-08T04:21:50.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.913+0000 7fd68259e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd67c06e330 0x7fd67c152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.913+0000 7fd68259e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd67c0b4700 0x7fd67c144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.913+0000 7fd68259e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd67c0ceee0 0x7fd67c150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.913+0000 7fd68259e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0cf440 con 0x7fd67c0b4700 2024-05-08T04:21:50.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.913+0000 7fd68259e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0cf2c0 con 0x7fd67c06e330 2024-05-08T04:21:50.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.913+0000 7fd68259e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c06e7e0 con 0x7fd67c0ceee0 2024-05-08T04:21:50.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.913+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd67c0b4700 0x7fd67c144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.913+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd67c0b4700 0x7fd67c144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52078/0 (socket says 172.21.15.104:52078) 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.913+0000 7fd67b7fe640 1 -- 172.21.15.104:0/2093233363 learned_addr learned my addr 172.21.15.104:0/2093233363 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.913+0000 7fd680b3b640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd67c0ceee0 0x7fd67c150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.913+0000 7fd67b7fe640 1 -- 172.21.15.104:0/2093233363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd67c0ceee0 msgr2=0x7fd67c150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.913+0000 7fd67bfff640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd67c06e330 0x7fd67c152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.913+0000 7fd67b7fe640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd67c0ceee0 0x7fd67c150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.914+0000 7fd67b7fe640 1 -- 172.21.15.104:0/2093233363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd67c06e330 msgr2=0x7fd67c152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.914+0000 7fd67b7fe640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd67c06e330 0x7fd67c152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.914+0000 7fd67b7fe640 1 -- 172.21.15.104:0/2093233363 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c1517a0 con 0x7fd67c0b4700 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.914+0000 7fd67b7fe640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd67c0b4700 0x7fd67c144ef0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c410 tx=0x7fd67000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.914+0000 7fd678ff9640 1 -- 172.21.15.104:0/2093233363 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670017070 con 0x7fd67c0b4700 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.914+0000 7fd678ff9640 1 -- 172.21.15.104:0/2093233363 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6700035f0 con 0x7fd67c0b4700 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.914+0000 7fd68259e640 1 -- 172.21.15.104:0/2093233363 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67c151a80 con 0x7fd67c0b4700 2024-05-08T04:21:50.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.914+0000 7fd678ff9640 1 -- 172.21.15.104:0/2093233363 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670003a20 con 0x7fd67c0b4700 2024-05-08T04:21:50.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.914+0000 7fd68259e640 1 -- 172.21.15.104:0/2093233363 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c152040 con 0x7fd67c0b4700 2024-05-08T04:21:50.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.915+0000 7fd68259e640 1 -- 172.21.15.104:0/2093233363 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67c075010 con 0x7fd67c0b4700 2024-05-08T04:21:50.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.915+0000 7fd678ff9640 1 -- 172.21.15.104:0/2093233363 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd67001a070 con 0x7fd67c0b4700 2024-05-08T04:21:50.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.916+0000 7fd678ff9640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd66806b4d0 0x7fd66806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:50.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.916+0000 7fd678ff9640 1 -- 172.21.15.104:0/2093233363 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd670089650 con 0x7fd67c0b4700 2024-05-08T04:21:50.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.916+0000 7fd67bfff640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd66806b4d0 0x7fd66806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:50.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.916+0000 7fd67bfff640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd66806b4d0 0x7fd66806d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd66c034000 tx=0x7fd66c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:50.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:50.920+0000 7fd678ff9640 1 -- 172.21.15.104:0/2093233363 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd6700584d0 con 0x7fd67c0b4700 2024-05-08T04:21:51.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.104+0000 7fd68259e640 1 -- 172.21.15.104:0/2093233363 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd67c071c70 con 0x7fd67c0b4700 2024-05-08T04:21:51.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.104+0000 7fd678ff9640 1 -- 172.21.15.104:0/2093233363 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd670057dd0 con 0x7fd67c0b4700 2024-05-08T04:21:51.107 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:21:51.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.106+0000 7fd68259e640 1 -- 172.21.15.104:0/2093233363 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd66806b4d0 msgr2=0x7fd66806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.106+0000 7fd68259e640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd66806b4d0 0x7fd66806d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd66c034000 tx=0x7fd66c02e000 comp rx=0 tx=0).stop 2024-05-08T04:21:51.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.106+0000 7fd68259e640 1 -- 172.21.15.104:0/2093233363 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd67c0b4700 msgr2=0x7fd67c144ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.106+0000 7fd68259e640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd67c0b4700 0x7fd67c144ef0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c410 tx=0x7fd67000c8d0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.106+0000 7fd68259e640 1 -- 172.21.15.104:0/2093233363 shutdown_connections 2024-05-08T04:21:51.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.106+0000 7fd68259e640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd66806b4d0 0x7fd66806d990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.106+0000 7fd68259e640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd67c0ceee0 0x7fd67c150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.106+0000 7fd68259e640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd67c0b4700 0x7fd67c144ef0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.106+0000 7fd68259e640 1 --2- 172.21.15.104:0/2093233363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd67c06e330 0x7fd67c152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.106+0000 7fd68259e640 1 -- 172.21.15.104:0/2093233363 >> 172.21.15.104:0/2093233363 conn(0x7fd67c0b13f0 msgr2=0x7fd67c0cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:51.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.106+0000 7fd68259e640 1 -- 172.21.15.104:0/2093233363 shutdown_connections 2024-05-08T04:21:51.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.106+0000 7fd68259e640 1 -- 172.21.15.104:0/2093233363 wait complete. 2024-05-08T04:21:51.119 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi104.front.sepia.ceph.com... 2024-05-08T04:21:51.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:51.120 DEBUG:teuthology.orchestra.run.smithi104:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-05-08T04:21:51.145 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:21:51.145 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:21:51.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:51.145 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-08T04:21:51.200 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:21:51.200 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:21:51.220 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:21:51.220 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:21:51.280 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:51.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.377+0000 7f57a5f6a640 1 Processor -- start 2024-05-08T04:21:51.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.377+0000 7f57a5f6a640 1 -- start start 2024-05-08T04:21:51.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.378+0000 7f57a5f6a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f57a015de10 0x7f57a0161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.378+0000 7f57a5f6a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f57a00ce5a0 0x7f57a00d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.378+0000 7f57a5f6a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a00d3210 con 0x7f57a00d05f0 2024-05-08T04:21:51.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.378+0000 7f57a5f6a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a00d0f50 con 0x7f57a00ce5a0 2024-05-08T04:21:51.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.378+0000 7f57a5f6a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a0161e60 con 0x7f57a015de10 2024-05-08T04:21:51.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.378+0000 7f579effd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f57a00ce5a0 0x7f57a00d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.378+0000 7f579ffff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f57a00d05f0 0x7f57a00b54a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59654/0 (socket says 172.21.15.104:59654) 2024-05-08T04:21:51.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.378+0000 7f579ffff640 1 -- 172.21.15.104:0/2252978103 learned_addr learned my addr 172.21.15.104:0/2252978103 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:51.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.379+0000 7f579f7fe640 1 --2- 172.21.15.104:0/2252978103 >> v2:172.21.15.183:3300/0 conn(0x7f57a015de10 0x7f57a0161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.379+0000 7f579effd640 1 -- 172.21.15.104:0/2252978103 >> v2:172.21.15.183:3300/0 conn(0x7f57a015de10 msgr2=0x7f57a0161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:51.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.379+0000 7f579effd640 1 --2- 172.21.15.104:0/2252978103 >> v2:172.21.15.183:3300/0 conn(0x7f57a015de10 0x7f57a0161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.379+0000 7f579effd640 1 -- 172.21.15.104:0/2252978103 >> v1:172.21.15.104:6789/0 conn(0x7f57a00d05f0 legacy=0x7f57a00b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.379+0000 7f579e7fc640 1 -- 172.21.15.104:0/2252978103 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391114598 0 0) 0x7f57a00d3210 con 0x7f57a00d05f0 2024-05-08T04:21:51.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.379+0000 7f579effd640 1 -- 172.21.15.104:0/2252978103 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a015e1f0 con 0x7f57a00ce5a0 2024-05-08T04:21:51.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.379+0000 7f579effd640 1 --2- 172.21.15.104:0/2252978103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a00ce5a0 0x7f57a00d00b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f57a00d15a0 tx=0x7f579402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b44ba74ed4918a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:51.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.380+0000 7f579e7fc640 1 -- 172.21.15.104:0/2252978103 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794037070 con 0x7f57a00ce5a0 2024-05-08T04:21:51.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.380+0000 7f579e7fc640 1 -- 172.21.15.104:0/2252978103 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5794032440 con 0x7f57a00ce5a0 2024-05-08T04:21:51.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.380+0000 7f579e7fc640 1 -- 172.21.15.104:0/2252978103 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579402ae60 con 0x7f57a00ce5a0 2024-05-08T04:21:51.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.380+0000 7f57a5f6a640 1 -- 172.21.15.104:0/2252978103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a00ce5a0 msgr2=0x7f57a00d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.380+0000 7f57a5f6a640 1 --2- 172.21.15.104:0/2252978103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a00ce5a0 0x7f57a00d00b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f57a00d15a0 tx=0x7f579402a110 comp rx=0 tx=0).stop 2024-05-08T04:21:51.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.380+0000 7f57a5f6a640 1 -- 172.21.15.104:0/2252978103 shutdown_connections 2024-05-08T04:21:51.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.380+0000 7f57a5f6a640 1 --2- 172.21.15.104:0/2252978103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a00ce5a0 0x7f57a00d00b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.380+0000 7f57a5f6a640 1 --2- 172.21.15.104:0/2252978103 >> v2:172.21.15.183:3300/0 conn(0x7f57a015de10 0x7f57a0161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.380+0000 7f57a5f6a640 1 -- 172.21.15.104:0/2252978103 >> 172.21.15.104:0/2252978103 conn(0x7f57a0072290 msgr2=0x7f57a0072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:51.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.380+0000 7f57a5f6a640 1 -- 172.21.15.104:0/2252978103 shutdown_connections 2024-05-08T04:21:51.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.380+0000 7f57a5f6a640 1 -- 172.21.15.104:0/2252978103 wait complete. 2024-05-08T04:21:51.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.381+0000 7f57a5f6a640 1 Processor -- start 2024-05-08T04:21:51.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.381+0000 7f57a5f6a640 1 -- start start 2024-05-08T04:21:51.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.382+0000 7f57a5f6a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57a00ce5a0 0x7f57a01f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.382+0000 7f57a5f6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57a00d05f0 0x7f57a01604e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.382+0000 7f57a5f6a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a015de10 0x7f57a0160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.382+0000 7f57a5f6a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0162090 con 0x7f57a015de10 2024-05-08T04:21:51.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.382+0000 7f57a5f6a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00d1a90 con 0x7f57a00ce5a0 2024-05-08T04:21:51.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.382+0000 7f57a5f6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0162370 con 0x7f57a00d05f0 2024-05-08T04:21:51.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.382+0000 7f579ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a015de10 0x7f57a0160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.382+0000 7f579ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a015de10 0x7f57a0160a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52094/0 (socket says 172.21.15.104:52094) 2024-05-08T04:21:51.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.382+0000 7f579ffff640 1 -- 172.21.15.104:0/271511738 learned_addr learned my addr 172.21.15.104:0/271511738 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:51.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.382+0000 7f579f7fe640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57a00ce5a0 0x7f57a01f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.382+0000 7f579effd640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57a00d05f0 0x7f57a01604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.383+0000 7f579ffff640 1 -- 172.21.15.104:0/271511738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57a00d05f0 msgr2=0x7f57a01604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.383+0000 7f579ffff640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57a00d05f0 0x7f57a01604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.383+0000 7f579ffff640 1 -- 172.21.15.104:0/271511738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57a00ce5a0 msgr2=0x7f57a01f2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.383+0000 7f579ffff640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57a00ce5a0 0x7f57a01f2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.383+0000 7f579ffff640 1 -- 172.21.15.104:0/271511738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a01f32f0 con 0x7f57a015de10 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.383+0000 7f579f7fe640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57a00ce5a0 0x7f57a01f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.383+0000 7f579ffff640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a015de10 0x7f57a0160a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f579800c480 tx=0x7f579800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.383+0000 7f5787fff640 1 -- 172.21.15.104:0/271511738 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798018070 con 0x7f57a015de10 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.383+0000 7f5787fff640 1 -- 172.21.15.104:0/271511738 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5798007500 con 0x7f57a015de10 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.383+0000 7f57a5f6a640 1 -- 172.21.15.104:0/271511738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a015f070 con 0x7f57a015de10 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.383+0000 7f5787fff640 1 -- 172.21.15.104:0/271511738 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798004a20 con 0x7f57a015de10 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.383+0000 7f57a5f6a640 1 -- 172.21.15.104:0/271511738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a015f630 con 0x7f57a015de10 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.384+0000 7f57a5f6a640 1 -- 172.21.15.104:0/271511738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a0075010 con 0x7f57a015de10 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.384+0000 7f5787fff640 1 -- 172.21.15.104:0/271511738 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f579801b070 con 0x7f57a015de10 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.385+0000 7f5787fff640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f578c06b500 0x7f578c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.385+0000 7f5787fff640 1 -- 172.21.15.104:0/271511738 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5798089450 con 0x7f57a015de10 2024-05-08T04:21:51.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.385+0000 7f579f7fe640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f578c06b500 0x7f578c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.385+0000 7f579f7fe640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f578c06b500 0x7f578c06d9c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5790009a80 tx=0x7f57900039d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:51.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.389+0000 7f5787fff640 1 -- 172.21.15.104:0/271511738 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5798058400 con 0x7f57a015de10 2024-05-08T04:21:51.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.567+0000 7f57a5f6a640 1 -- 172.21.15.104:0/271511738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57a00d1870 con 0x7f57a015de10 2024-05-08T04:21:51.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.569+0000 7f5787fff640 1 -- 172.21.15.104:0/271511738 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16718 (secure 0 0 0) 0x7f5798057d00 con 0x7f57a015de10 2024-05-08T04:21:51.571 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:51.571 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":21,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:50.956824+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:51.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.571+0000 7f57a5f6a640 1 -- 172.21.15.104:0/271511738 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f578c06b500 msgr2=0x7f578c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.571+0000 7f57a5f6a640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f578c06b500 0x7f578c06d9c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5790009a80 tx=0x7f57900039d0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.571+0000 7f57a5f6a640 1 -- 172.21.15.104:0/271511738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a015de10 msgr2=0x7f57a0160a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.571+0000 7f57a5f6a640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a015de10 0x7f57a0160a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f579800c480 tx=0x7f579800c940 comp rx=0 tx=0).stop 2024-05-08T04:21:51.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.571+0000 7f57a5f6a640 1 -- 172.21.15.104:0/271511738 shutdown_connections 2024-05-08T04:21:51.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.571+0000 7f57a5f6a640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f578c06b500 0x7f578c06d9c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.571+0000 7f57a5f6a640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57a015de10 0x7f57a0160a20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.571+0000 7f57a5f6a640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57a00d05f0 0x7f57a01604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.571+0000 7f57a5f6a640 1 --2- 172.21.15.104:0/271511738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57a00ce5a0 0x7f57a01f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.571+0000 7f57a5f6a640 1 -- 172.21.15.104:0/271511738 >> 172.21.15.104:0/271511738 conn(0x7f57a0072290 msgr2=0x7f57a015a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:51.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.571+0000 7f57a5f6a640 1 -- 172.21.15.104:0/271511738 shutdown_connections 2024-05-08T04:21:51.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.571+0000 7f57a5f6a640 1 -- 172.21.15.104:0/271511738 wait complete. 2024-05-08T04:21:51.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:51.584 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:51.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.685+0000 7fc7cad7e640 1 Processor -- start 2024-05-08T04:21:51.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.685+0000 7fc7cad7e640 1 -- start start 2024-05-08T04:21:51.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7cad7e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7c40d0970 0x7fc7c415c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7cad7e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc7c415cad0 0x7fc7c415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7cad7e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c415d420 con 0x7fc7c4070c70 2024-05-08T04:21:51.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7cad7e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c40d16a0 con 0x7fc7c415cad0 2024-05-08T04:21:51.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7cad7e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40d10e0 con 0x7fc7c40d0970 2024-05-08T04:21:51.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7c931b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc7c415cad0 0x7fc7c415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7c8b1a640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc7c4070c70 0x7fc7c4071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59670/0 (socket says 172.21.15.104:59670) 2024-05-08T04:21:51.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7c8b1a640 1 -- 172.21.15.104:0/2520560954 learned_addr learned my addr 172.21.15.104:0/2520560954 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:51.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7bbfff640 1 --2- 172.21.15.104:0/2520560954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7c40d0970 0x7fc7c415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7c931b640 1 -- 172.21.15.104:0/2520560954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7c40d0970 msgr2=0x7fc7c415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:51.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7c931b640 1 --2- 172.21.15.104:0/2520560954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7c40d0970 0x7fc7c415c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7bb7fe640 1 -- 172.21.15.104:0/2520560954 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151935372 0 0) 0x7fc7c415d420 con 0x7fc7c4070c70 2024-05-08T04:21:51.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7c931b640 1 -- 172.21.15.104:0/2520560954 >> v1:172.21.15.104:6789/0 conn(0x7fc7c4070c70 legacy=0x7fc7c4071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.686+0000 7fc7c931b640 1 -- 172.21.15.104:0/2520560954 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c40d13c0 con 0x7fc7c415cad0 2024-05-08T04:21:51.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.687+0000 7fc7c931b640 1 --2- 172.21.15.104:0/2520560954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c415cad0 0x7fc7c415dbe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009d90 tx=0x7fc7bc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b4dabcfa37543f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:51.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.687+0000 7fc7bb7fe640 1 -- 172.21.15.104:0/2520560954 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc007740 con 0x7fc7c415cad0 2024-05-08T04:21:51.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.687+0000 7fc7bb7fe640 1 -- 172.21.15.104:0/2520560954 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc0078e0 con 0x7fc7c415cad0 2024-05-08T04:21:51.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.687+0000 7fc7bb7fe640 1 -- 172.21.15.104:0/2520560954 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc007cb0 con 0x7fc7c415cad0 2024-05-08T04:21:51.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.688+0000 7fc7cad7e640 1 -- 172.21.15.104:0/2520560954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c415cad0 msgr2=0x7fc7c415dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.688+0000 7fc7cad7e640 1 --2- 172.21.15.104:0/2520560954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c415cad0 0x7fc7c415dbe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009d90 tx=0x7fc7bc02a660 comp rx=0 tx=0).stop 2024-05-08T04:21:51.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.688+0000 7fc7cad7e640 1 -- 172.21.15.104:0/2520560954 shutdown_connections 2024-05-08T04:21:51.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.688+0000 7fc7cad7e640 1 --2- 172.21.15.104:0/2520560954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c415cad0 0x7fc7c415dbe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.688+0000 7fc7cad7e640 1 --2- 172.21.15.104:0/2520560954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7c40d0970 0x7fc7c415c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.688+0000 7fc7cad7e640 1 -- 172.21.15.104:0/2520560954 >> 172.21.15.104:0/2520560954 conn(0x7fc7c40b3450 msgr2=0x7fc7c40b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:51.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.688+0000 7fc7cad7e640 1 -- 172.21.15.104:0/2520560954 shutdown_connections 2024-05-08T04:21:51.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.688+0000 7fc7cad7e640 1 -- 172.21.15.104:0/2520560954 wait complete. 2024-05-08T04:21:51.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.689+0000 7fc7cad7e640 1 Processor -- start 2024-05-08T04:21:51.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.689+0000 7fc7cad7e640 1 -- start start 2024-05-08T04:21:51.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7cad7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c4070c70 0x7fc7c413b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7cad7e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7c40d0970 0x7fc7c40b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7cad7e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7c415cad0 0x7fc7c40b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7cad7e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c415e120 con 0x7fc7c4070c70 2024-05-08T04:21:51.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7cad7e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40d0df0 con 0x7fc7c40d0970 2024-05-08T04:21:51.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7cad7e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c415e2a0 con 0x7fc7c415cad0 2024-05-08T04:21:51.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7c8b1a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c4070c70 0x7fc7c413b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7c8b1a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c4070c70 0x7fc7c413b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52106/0 (socket says 172.21.15.104:52106) 2024-05-08T04:21:51.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7c8b1a640 1 -- 172.21.15.104:0/388513767 learned_addr learned my addr 172.21.15.104:0/388513767 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7bbfff640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7c40d0970 0x7fc7c40b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7c8b1a640 1 -- 172.21.15.104:0/388513767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7c415cad0 msgr2=0x7fc7c40b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7c931b640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7c415cad0 0x7fc7c40b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7c8b1a640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7c415cad0 0x7fc7c40b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7c8b1a640 1 -- 172.21.15.104:0/388513767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7c40d0970 msgr2=0x7fc7c40b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7c8b1a640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7c40d0970 0x7fc7c40b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7c8b1a640 1 -- 172.21.15.104:0/388513767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c40c7540 con 0x7fc7c4070c70 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7bbfff640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7c40d0970 0x7fc7c40b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7c8b1a640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c4070c70 0x7fc7c413b500 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000c4d0 tx=0x7fc7c000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7b97fa640 1 -- 172.21.15.104:0/388513767 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0018070 con 0x7fc7c4070c70 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7b97fa640 1 -- 172.21.15.104:0/388513767 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c0007500 con 0x7fc7c4070c70 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7b97fa640 1 -- 172.21.15.104:0/388513767 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0004a20 con 0x7fc7c4070c70 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.690+0000 7fc7cad7e640 1 -- 172.21.15.104:0/388513767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c40c7820 con 0x7fc7c4070c70 2024-05-08T04:21:51.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.691+0000 7fc7cad7e640 1 -- 172.21.15.104:0/388513767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c40c7de0 con 0x7fc7c4070c70 2024-05-08T04:21:51.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.692+0000 7fc7cad7e640 1 -- 172.21.15.104:0/388513767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c4075010 con 0x7fc7c4070c70 2024-05-08T04:21:51.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.692+0000 7fc7b97fa640 1 -- 172.21.15.104:0/388513767 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc7c001b070 con 0x7fc7c4070c70 2024-05-08T04:21:51.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.692+0000 7fc7b97fa640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc7b006b4d0 0x7fc7b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.692+0000 7fc7b97fa640 1 -- 172.21.15.104:0/388513767 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc7c0089560 con 0x7fc7c4070c70 2024-05-08T04:21:51.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.692+0000 7fc7bbfff640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc7b006b4d0 0x7fc7b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.693+0000 7fc7bbfff640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc7b006b4d0 0x7fc7b006d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc7c414e3f0 tx=0x7fc7b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:51.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.696+0000 7fc7b97fa640 1 -- 172.21.15.104:0/388513767 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc7c00583c0 con 0x7fc7c4070c70 2024-05-08T04:21:51.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.866+0000 7fc7cad7e640 1 -- 172.21.15.104:0/388513767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7c40b4180 con 0x7fc7c4070c70 2024-05-08T04:21:51.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.867+0000 7fc7b97fa640 1 -- 172.21.15.104:0/388513767 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7c0057cc0 con 0x7fc7c4070c70 2024-05-08T04:21:51.869 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:51.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.868+0000 7fc7cad7e640 1 -- 172.21.15.104:0/388513767 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc7b006b4d0 msgr2=0x7fc7b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.868+0000 7fc7cad7e640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc7b006b4d0 0x7fc7b006d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc7c414e3f0 tx=0x7fc7b4008040 comp rx=0 tx=0).stop 2024-05-08T04:21:51.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.868+0000 7fc7cad7e640 1 -- 172.21.15.104:0/388513767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c4070c70 msgr2=0x7fc7c413b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.868+0000 7fc7cad7e640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c4070c70 0x7fc7c413b500 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc7c000c4d0 tx=0x7fc7c000c990 comp rx=0 tx=0).stop 2024-05-08T04:21:51.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.869+0000 7fc7cad7e640 1 -- 172.21.15.104:0/388513767 shutdown_connections 2024-05-08T04:21:51.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.869+0000 7fc7cad7e640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc7b006b4d0 0x7fc7b006d990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.869+0000 7fc7cad7e640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7c40d0970 0x7fc7c40b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.869+0000 7fc7cad7e640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7c415cad0 0x7fc7c40b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.869+0000 7fc7cad7e640 1 --2- 172.21.15.104:0/388513767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c4070c70 0x7fc7c413b500 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.869+0000 7fc7cad7e640 1 -- 172.21.15.104:0/388513767 >> 172.21.15.104:0/388513767 conn(0x7fc7c40b3450 msgr2=0x7fc7c40b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:51.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.869+0000 7fc7cad7e640 1 -- 172.21.15.104:0/388513767 shutdown_connections 2024-05-08T04:21:51.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.869+0000 7fc7cad7e640 1 -- 172.21.15.104:0/388513767 wait complete. 2024-05-08T04:21:51.882 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:51.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.983+0000 7fa0a288f640 1 Processor -- start 2024-05-08T04:21:51.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.983+0000 7fa0a288f640 1 -- start start 2024-05-08T04:21:51.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa0a288f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c0b9620 0x7fa09c0ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa0a288f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09c0d25a0 con 0x7fa09c161090 2024-05-08T04:21:51.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa0a288f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09c0d2880 con 0x7fa09c0cecc0 2024-05-08T04:21:51.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa0a288f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0d2b60 con 0x7fa09c0b9620 2024-05-08T04:21:51.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09bfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fa09c161090 0x7fa09c0d1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59676/0 (socket says 172.21.15.104:59676) 2024-05-08T04:21:51.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09bfff640 1 -- 172.21.15.104:0/255893527 learned_addr learned my addr 172.21.15.104:0/255893527 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:51.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa093fff640 1 --2- 172.21.15.104:0/255893527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c0b9620 0x7fa09c0ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96758205 0 0) 0x7fa09c0d25a0 con 0x7fa09c161090 2024-05-08T04:21:51.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa088003520 con 0x7fa09c161090 2024-05-08T04:21:51.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3699289464 0 0) 0x7fa088003520 con 0x7fa09c161090 2024-05-08T04:21:51.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c0b9620 msgr2=0x7fa09c0ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:51.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 --2- 172.21.15.104:0/255893527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c0b9620 0x7fa09c0ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 >> v1:172.21.15.183:6789/0 conn(0x7fa09c0cecc0 legacy=0x7fa09c0b6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c0d2e40 con 0x7fa09c161090 2024-05-08T04:21:51.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fa08c001670 con 0x7fa09c161090 2024-05-08T04:21:51.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 >> v1:172.21.15.104:6789/0 conn(0x7fa09c161090 legacy=0x7fa09c0d1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 --2- 172.21.15.104:0/255893527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0880039e0 0x7fa088003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 --2- 172.21.15.104:0/255893527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c0b9620 0x7fa088004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 --2- 172.21.15.104:0/255893527 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa088004d40 0x7fa0880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0d2b60 con 0x7fa088004d40 2024-05-08T04:21:51.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08800bad0 con 0x7fa0880039e0 2024-05-08T04:21:51.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.984+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08800bcd0 con 0x7fa09c0b9620 2024-05-08T04:21:51.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.985+0000 7fa0a0e2c640 1 --2- 172.21.15.104:0/255893527 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa088004d40 0x7fa0880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.985+0000 7fa09bfff640 1 --2- 172.21.15.104:0/255893527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0880039e0 0x7fa088003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.985+0000 7fa093fff640 1 --2- 172.21.15.104:0/255893527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c0b9620 0x7fa088004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.985+0000 7fa0a0e2c640 1 -- 172.21.15.104:0/255893527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c0b9620 msgr2=0x7fa088004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:51.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.985+0000 7fa0a0e2c640 1 --2- 172.21.15.104:0/255893527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa09c0b9620 0x7fa088004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.985+0000 7fa0a0e2c640 1 -- 172.21.15.104:0/255893527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0880039e0 msgr2=0x7fa088003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:51.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.985+0000 7fa0a0e2c640 1 --2- 172.21.15.104:0/255893527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0880039e0 0x7fa088003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.985+0000 7fa0a0e2c640 1 -- 172.21.15.104:0/255893527 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa088003520 con 0x7fa088004d40 2024-05-08T04:21:51.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.985+0000 7fa0a0e2c640 1 --2- 172.21.15.104:0/255893527 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa088004d40 0x7fa0880051c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa094001f60 tx=0x7fa088005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b22973beb64bf03 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:51.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.986+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094001b30 con 0x7fa088004d40 2024-05-08T04:21:51.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.986+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa094031620 con 0x7fa088004d40 2024-05-08T04:21:51.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.986+0000 7fa09b7fe640 1 -- 172.21.15.104:0/255893527 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094031a10 con 0x7fa088004d40 2024-05-08T04:21:51.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.986+0000 7fa0a288f640 1 -- 172.21.15.104:0/255893527 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa088004d40 msgr2=0x7fa0880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.986+0000 7fa0a288f640 1 --2- 172.21.15.104:0/255893527 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa088004d40 0x7fa0880051c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa094001f60 tx=0x7fa088005830 comp rx=0 tx=0).stop 2024-05-08T04:21:51.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.986+0000 7fa0a0e2c640 1 -- 172.21.15.104:0/255893527 reap_dead start 2024-05-08T04:21:51.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.986+0000 7fa0a288f640 1 -- 172.21.15.104:0/255893527 shutdown_connections 2024-05-08T04:21:51.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.986+0000 7fa0a288f640 1 -- 172.21.15.104:0/255893527 >> 172.21.15.104:0/255893527 conn(0x7fa09c06c400 msgr2=0x7fa09c06c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:51.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.986+0000 7fa0a288f640 1 -- 172.21.15.104:0/255893527 shutdown_connections 2024-05-08T04:21:51.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.986+0000 7fa0a288f640 1 -- 172.21.15.104:0/255893527 wait complete. 2024-05-08T04:21:51.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.987+0000 7fa0a288f640 1 Processor -- start 2024-05-08T04:21:51.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.987+0000 7fa0a288f640 1 -- start start 2024-05-08T04:21:51.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.988+0000 7fa0a288f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa088004d40 0x7fa09c0c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.988+0000 7fa0a288f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa09c148a70 0x7fa09c14b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.988+0000 7fa0a288f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa09c1467c0 0x7fa09c146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.988+0000 7fa0a288f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0ce780 con 0x7fa09c148a70 2024-05-08T04:21:51.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.988+0000 7fa0a288f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c161470 con 0x7fa09c1467c0 2024-05-08T04:21:51.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.988+0000 7fa0a288f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0ce900 con 0x7fa088004d40 2024-05-08T04:21:51.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.988+0000 7fa093fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa09c148a70 0x7fa09c14b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.988+0000 7fa093fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa09c148a70 0x7fa09c14b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52132/0 (socket says 172.21.15.104:52132) 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.988+0000 7fa093fff640 1 -- 172.21.15.104:0/773964306 learned_addr learned my addr 172.21.15.104:0/773964306 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.988+0000 7fa09bfff640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa088004d40 0x7fa09c0c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.988+0000 7fa0a0e2c640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa09c1467c0 0x7fa09c146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.989+0000 7fa093fff640 1 -- 172.21.15.104:0/773964306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa088004d40 msgr2=0x7fa09c0c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.989+0000 7fa093fff640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa088004d40 0x7fa09c0c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.989+0000 7fa093fff640 1 -- 172.21.15.104:0/773964306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa09c1467c0 msgr2=0x7fa09c146c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.989+0000 7fa093fff640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa09c1467c0 0x7fa09c146c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.989+0000 7fa093fff640 1 -- 172.21.15.104:0/773964306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c145720 con 0x7fa09c148a70 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.989+0000 7fa09bfff640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa088004d40 0x7fa09c0c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.989+0000 7fa093fff640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa09c148a70 0x7fa09c14b2d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa0840119a0 tx=0x7fa084011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.989+0000 7fa0997fa640 1 -- 172.21.15.104:0/773964306 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400faf0 con 0x7fa09c148a70 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.989+0000 7fa0997fa640 1 -- 172.21.15.104:0/773964306 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08400fc90 con 0x7fa09c148a70 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.989+0000 7fa0a288f640 1 -- 172.21.15.104:0/773964306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09c145a00 con 0x7fa09c148a70 2024-05-08T04:21:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.989+0000 7fa0997fa640 1 -- 172.21.15.104:0/773964306 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa084014440 con 0x7fa09c148a70 2024-05-08T04:21:51.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.989+0000 7fa0a288f640 1 -- 172.21.15.104:0/773964306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09c145fc0 con 0x7fa09c148a70 2024-05-08T04:21:51.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.990+0000 7fa0a288f640 1 -- 172.21.15.104:0/773964306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09c075010 con 0x7fa09c148a70 2024-05-08T04:21:51.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.990+0000 7fa0997fa640 1 -- 172.21.15.104:0/773964306 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa084012040 con 0x7fa09c148a70 2024-05-08T04:21:51.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.991+0000 7fa0997fa640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa07c06b4d0 0x7fa07c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:51.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.991+0000 7fa09bfff640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa07c06b4d0 0x7fa07c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:51.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.991+0000 7fa0997fa640 1 -- 172.21.15.104:0/773964306 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa08408a870 con 0x7fa09c148a70 2024-05-08T04:21:51.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.991+0000 7fa09bfff640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa07c06b4d0 0x7fa07c06d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa08c007cb0 tx=0x7fa08c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:51.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:51.995+0000 7fa0997fa640 1 -- 172.21.15.104:0/773964306 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa084019030 con 0x7fa09c148a70 2024-05-08T04:21:52.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.163+0000 7fa0a288f640 1 -- 172.21.15.104:0/773964306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa09c148ef0 con 0x7fa09c148a70 2024-05-08T04:21:52.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.163+0000 7fa0997fa640 1 -- 172.21.15.104:0/773964306 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa084059110 con 0x7fa09c148a70 2024-05-08T04:21:52.166 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:52.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.165+0000 7fa0a288f640 1 -- 172.21.15.104:0/773964306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa07c06b4d0 msgr2=0x7fa07c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.165+0000 7fa0a288f640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa07c06b4d0 0x7fa07c06d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa08c007cb0 tx=0x7fa08c009040 comp rx=0 tx=0).stop 2024-05-08T04:21:52.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.165+0000 7fa0a288f640 1 -- 172.21.15.104:0/773964306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa09c148a70 msgr2=0x7fa09c14b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.165+0000 7fa0a288f640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa09c148a70 0x7fa09c14b2d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa0840119a0 tx=0x7fa084011e60 comp rx=0 tx=0).stop 2024-05-08T04:21:52.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.165+0000 7fa0a288f640 1 -- 172.21.15.104:0/773964306 shutdown_connections 2024-05-08T04:21:52.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.165+0000 7fa0a288f640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa07c06b4d0 0x7fa07c06d990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.165+0000 7fa0a288f640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa09c1467c0 0x7fa09c146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.165+0000 7fa0a288f640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa09c148a70 0x7fa09c14b2d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.165+0000 7fa0a288f640 1 --2- 172.21.15.104:0/773964306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa088004d40 0x7fa09c0c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.165+0000 7fa0a288f640 1 -- 172.21.15.104:0/773964306 >> 172.21.15.104:0/773964306 conn(0x7fa09c06c400 msgr2=0x7fa09c0cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:52.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.165+0000 7fa0a288f640 1 -- 172.21.15.104:0/773964306 shutdown_connections 2024-05-08T04:21:52.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.165+0000 7fa0a288f640 1 -- 172.21.15.104:0/773964306 wait complete. 2024-05-08T04:21:52.179 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:52.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.278+0000 7f640e0cb640 1 Processor -- start 2024-05-08T04:21:52.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.279+0000 7f640e0cb640 1 -- start start 2024-05-08T04:21:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.279+0000 7f640e0cb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f64080ce5a0 0x7f6408161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.279+0000 7f640e0cb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640815e1f0 con 0x7f64080d07c0 2024-05-08T04:21:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.279+0000 7f640e0cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6408162090 con 0x7f640815de10 2024-05-08T04:21:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.279+0000 7f640e0cb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64080d0f50 con 0x7f64080ce5a0 2024-05-08T04:21:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.280+0000 7f63feffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f64080ce5a0 0x7f6408161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.280+0000 7f6407fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f64080d07c0 0x7f64080d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59690/0 (socket says 172.21.15.104:59690) 2024-05-08T04:21:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.280+0000 7f6407fff640 1 -- 172.21.15.104:0/1956653622 learned_addr learned my addr 172.21.15.104:0/1956653622 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:52.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.280+0000 7f63feffd640 1 -- 172.21.15.104:0/1956653622 >> v1:172.21.15.183:6789/0 conn(0x7f640815de10 legacy=0x7f64080d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.280+0000 7f63feffd640 1 -- 172.21.15.104:0/1956653622 >> v1:172.21.15.104:6789/0 conn(0x7f64080d07c0 legacy=0x7f64080d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.280+0000 7f63feffd640 1 -- 172.21.15.104:0/1956653622 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408162370 con 0x7f64080ce5a0 2024-05-08T04:21:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.281+0000 7f63feffd640 1 --2- 172.21.15.104:0/1956653622 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64080ce5a0 0x7f6408161920 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f63f00097a0 tx=0x7f63f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d749332db05cc29e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.281+0000 7f6406ffd640 1 -- 172.21.15.104:0/1956653622 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f0037070 con 0x7f64080ce5a0 2024-05-08T04:21:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.281+0000 7f6406ffd640 1 -- 172.21.15.104:0/1956653622 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f0032440 con 0x7f64080ce5a0 2024-05-08T04:21:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.281+0000 7f6406ffd640 1 -- 172.21.15.104:0/1956653622 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f0032810 con 0x7f64080ce5a0 2024-05-08T04:21:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.281+0000 7f640e0cb640 1 -- 172.21.15.104:0/1956653622 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64080ce5a0 msgr2=0x7f6408161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.281+0000 7f640e0cb640 1 --2- 172.21.15.104:0/1956653622 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64080ce5a0 0x7f6408161920 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f63f00097a0 tx=0x7f63f002a1a0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.281+0000 7f640e0cb640 1 -- 172.21.15.104:0/1956653622 shutdown_connections 2024-05-08T04:21:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.281+0000 7f640e0cb640 1 --2- 172.21.15.104:0/1956653622 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64080ce5a0 0x7f6408161920 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.281+0000 7f640e0cb640 1 -- 172.21.15.104:0/1956653622 >> 172.21.15.104:0/1956653622 conn(0x7f6408072290 msgr2=0x7f6408072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.281+0000 7f640e0cb640 1 -- 172.21.15.104:0/1956653622 shutdown_connections 2024-05-08T04:21:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.281+0000 7f640e0cb640 1 -- 172.21.15.104:0/1956653622 wait complete. 2024-05-08T04:21:52.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.282+0000 7f640e0cb640 1 Processor -- start 2024-05-08T04:21:52.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.283+0000 7f640e0cb640 1 -- start start 2024-05-08T04:21:52.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.283+0000 7f640e0cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64080ce5a0 0x7f64080c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.283+0000 7f640e0cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64080d07c0 0x7f64081603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.283+0000 7f640e0cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f640815de10 0x7f64080b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.283+0000 7f640e0cb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64080d1a90 con 0x7f640815de10 2024-05-08T04:21:52.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.283+0000 7f640e0cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64080d1ce0 con 0x7f64080ce5a0 2024-05-08T04:21:52.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.283+0000 7f640e0cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64080b6dc0 con 0x7f64080d07c0 2024-05-08T04:21:52.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.283+0000 7f6407fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f640815de10 0x7f64080b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.283+0000 7f6407fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f640815de10 0x7f64080b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52148/0 (socket says 172.21.15.104:52148) 2024-05-08T04:21:52.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.283+0000 7f6407fff640 1 -- 172.21.15.104:0/4121741677 learned_addr learned my addr 172.21.15.104:0/4121741677 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:52.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f64077fe640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64080ce5a0 0x7f64080c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f6407fff640 1 -- 172.21.15.104:0/4121741677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64080d07c0 msgr2=0x7f64081603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f63feffd640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64080d07c0 0x7f64081603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f6407fff640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64080d07c0 0x7f64081603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f6407fff640 1 -- 172.21.15.104:0/4121741677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64080ce5a0 msgr2=0x7f64080c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f6407fff640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64080ce5a0 0x7f64080c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f6407fff640 1 -- 172.21.15.104:0/4121741677 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64080b49d0 con 0x7f640815de10 2024-05-08T04:21:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f64077fe640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64080ce5a0 0x7f64080c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f63feffd640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64080d07c0 0x7f64081603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f6407fff640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f640815de10 0x7f64080b3e60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f640000cbc0 tx=0x7f640000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f6404ff9640 1 -- 172.21.15.104:0/4121741677 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400017070 con 0x7f640815de10 2024-05-08T04:21:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f6404ff9640 1 -- 172.21.15.104:0/4121741677 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640000ad40 con 0x7f640815de10 2024-05-08T04:21:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f640e0cb640 1 -- 172.21.15.104:0/4121741677 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640815f5f0 con 0x7f640815de10 2024-05-08T04:21:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f6404ff9640 1 -- 172.21.15.104:0/4121741677 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400012600 con 0x7f640815de10 2024-05-08T04:21:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.284+0000 7f640e0cb640 1 -- 172.21.15.104:0/4121741677 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640815fbb0 con 0x7f640815de10 2024-05-08T04:21:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.285+0000 7f640e0cb640 1 -- 172.21.15.104:0/4121741677 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6408075010 con 0x7f640815de10 2024-05-08T04:21:52.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.285+0000 7f6404ff9640 1 -- 172.21.15.104:0/4121741677 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f640001a070 con 0x7f640815de10 2024-05-08T04:21:52.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.286+0000 7f6404ff9640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f63e806b500 0x7f63e806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.286+0000 7f64077fe640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f63e806b500 0x7f63e806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.286+0000 7f6404ff9640 1 -- 172.21.15.104:0/4121741677 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6400089e90 con 0x7f640815de10 2024-05-08T04:21:52.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.286+0000 7f64077fe640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f63e806b500 0x7f63e806d9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63f80015e0 tx=0x7f63f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:52.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.290+0000 7f6404ff9640 1 -- 172.21.15.104:0/4121741677 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f64000586a0 con 0x7f640815de10 2024-05-08T04:21:52.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.460+0000 7f640e0cb640 1 -- 172.21.15.104:0/4121741677 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f64080d1870 con 0x7f640815de10 2024-05-08T04:21:52.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.460+0000 7f6404ff9640 1 -- 172.21.15.104:0/4121741677 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f640005c740 con 0x7f640815de10 2024-05-08T04:21:52.463 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.462+0000 7f640e0cb640 1 -- 172.21.15.104:0/4121741677 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f63e806b500 msgr2=0x7f63e806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.462+0000 7f640e0cb640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f63e806b500 0x7f63e806d9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63f80015e0 tx=0x7f63f8009040 comp rx=0 tx=0).stop 2024-05-08T04:21:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.462+0000 7f640e0cb640 1 -- 172.21.15.104:0/4121741677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f640815de10 msgr2=0x7f64080b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.462+0000 7f640e0cb640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f640815de10 0x7f64080b3e60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f640000cbc0 tx=0x7f640000a430 comp rx=0 tx=0).stop 2024-05-08T04:21:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.462+0000 7f640e0cb640 1 -- 172.21.15.104:0/4121741677 shutdown_connections 2024-05-08T04:21:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.462+0000 7f640e0cb640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f63e806b500 0x7f63e806d9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.462+0000 7f640e0cb640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f640815de10 0x7f64080b3e60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.462+0000 7f640e0cb640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64080d07c0 0x7f64081603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.462+0000 7f640e0cb640 1 --2- 172.21.15.104:0/4121741677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64080ce5a0 0x7f64080c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.462+0000 7f640e0cb640 1 -- 172.21.15.104:0/4121741677 >> 172.21.15.104:0/4121741677 conn(0x7f6408072290 msgr2=0x7f6408159db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.462+0000 7f640e0cb640 1 -- 172.21.15.104:0/4121741677 shutdown_connections 2024-05-08T04:21:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.462+0000 7f640e0cb640 1 -- 172.21.15.104:0/4121741677 wait complete. 2024-05-08T04:21:52.475 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:21:52.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.573+0000 7facd7b61640 1 Processor -- start 2024-05-08T04:21:52.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.574+0000 7facd7b61640 1 -- start start 2024-05-08T04:21:52.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.574+0000 7facd7b61640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7facd006ea40 0x7facd00b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.574+0000 7facd7b61640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7facd00b3ff0 0x7facd00b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.574+0000 7facd7b61640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd015e780 con 0x7facd00ceee0 2024-05-08T04:21:52.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.574+0000 7facd7b61640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd015f390 con 0x7facd00b3ff0 2024-05-08T04:21:52.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.575+0000 7facd7b61640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd015ea60 con 0x7facd006ea40 2024-05-08T04:21:52.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.575+0000 7facd60fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7facd00b3ff0 0x7facd00b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.575+0000 7facd60fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7facd00b3ff0 0x7facd00b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52150/0 (socket says 172.21.15.104:52150) 2024-05-08T04:21:52.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.575+0000 7facd60fe640 1 -- 172.21.15.104:0/520476848 learned_addr learned my addr 172.21.15.104:0/520476848 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:52.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.575+0000 7facd50fc640 1 --2- 172.21.15.104:0/520476848 >> v2:172.21.15.183:3300/0 conn(0x7facd006ea40 0x7facd00b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.575+0000 7facd60fe640 1 -- 172.21.15.104:0/520476848 >> v2:172.21.15.183:3300/0 conn(0x7facd006ea40 msgr2=0x7facd00b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:52.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.575+0000 7facd60fe640 1 --2- 172.21.15.104:0/520476848 >> v2:172.21.15.183:3300/0 conn(0x7facd006ea40 0x7facd00b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.575+0000 7facd60fe640 1 -- 172.21.15.104:0/520476848 >> v1:172.21.15.183:6789/0 conn(0x7facd00ceee0 legacy=0x7facd006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:52.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.575+0000 7facd60fe640 1 -- 172.21.15.104:0/520476848 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd015ed40 con 0x7facd00b3ff0 2024-05-08T04:21:52.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.576+0000 7facd60fe640 1 --2- 172.21.15.104:0/520476848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facd00b3ff0 0x7facd00b4460 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7facd0072a90 tx=0x7facc802c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fd711600244ffd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:52.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.576+0000 7facd48fb640 1 -- 172.21.15.104:0/520476848 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8009600 con 0x7facd00b3ff0 2024-05-08T04:21:52.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.576+0000 7facd48fb640 1 -- 172.21.15.104:0/520476848 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc80097a0 con 0x7facd00b3ff0 2024-05-08T04:21:52.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.576+0000 7facd48fb640 1 -- 172.21.15.104:0/520476848 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8009b70 con 0x7facd00b3ff0 2024-05-08T04:21:52.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.576+0000 7facd7b61640 1 -- 172.21.15.104:0/520476848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facd00b3ff0 msgr2=0x7facd00b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.576+0000 7facd7b61640 1 --2- 172.21.15.104:0/520476848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facd00b3ff0 0x7facd00b4460 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7facd0072a90 tx=0x7facc802c900 comp rx=0 tx=0).stop 2024-05-08T04:21:52.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.576+0000 7facd7b61640 1 -- 172.21.15.104:0/520476848 shutdown_connections 2024-05-08T04:21:52.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.576+0000 7facd7b61640 1 --2- 172.21.15.104:0/520476848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facd00b3ff0 0x7facd00b4460 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.576+0000 7facd7b61640 1 --2- 172.21.15.104:0/520476848 >> v2:172.21.15.183:3300/0 conn(0x7facd006ea40 0x7facd00b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.576+0000 7facd7b61640 1 -- 172.21.15.104:0/520476848 >> 172.21.15.104:0/520476848 conn(0x7facd00b13f0 msgr2=0x7facd00b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:52.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.576+0000 7facd7b61640 1 -- 172.21.15.104:0/520476848 shutdown_connections 2024-05-08T04:21:52.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.576+0000 7facd7b61640 1 -- 172.21.15.104:0/520476848 wait complete. 2024-05-08T04:21:52.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.578+0000 7facd7b61640 1 Processor -- start 2024-05-08T04:21:52.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.578+0000 7facd7b61640 1 -- start start 2024-05-08T04:21:52.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.578+0000 7facd7b61640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facd006ea40 0x7facd00ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.578+0000 7facd7b61640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd00b3ff0 0x7facd00a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.578+0000 7facd7b61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd00ceee0 0x7facd0148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.578+0000 7facd7b61640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd00cf2c0 con 0x7facd006ea40 2024-05-08T04:21:52.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.578+0000 7facd7b61640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd00b49a0 con 0x7facd00b3ff0 2024-05-08T04:21:52.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.578+0000 7facd7b61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd00cf440 con 0x7facd00ceee0 2024-05-08T04:21:52.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.578+0000 7facd58fd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facd006ea40 0x7facd00ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.578+0000 7facd58fd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facd006ea40 0x7facd00ae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52164/0 (socket says 172.21.15.104:52164) 2024-05-08T04:21:52.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.578+0000 7facd58fd640 1 -- 172.21.15.104:0/4116478534 learned_addr learned my addr 172.21.15.104:0/4116478534 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:52.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.579+0000 7facd58fd640 1 -- 172.21.15.104:0/4116478534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd00ceee0 msgr2=0x7facd0148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.579+0000 7facd58fd640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd00ceee0 0x7facd0148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.579+0000 7facd50fc640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd00b3ff0 0x7facd00a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.579+0000 7facd58fd640 1 -- 172.21.15.104:0/4116478534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd00b3ff0 msgr2=0x7facd00a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.579+0000 7facd58fd640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd00b3ff0 0x7facd00a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.579+0000 7facd58fd640 1 -- 172.21.15.104:0/4116478534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd00a9500 con 0x7facd006ea40 2024-05-08T04:21:52.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.579+0000 7facd50fc640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd00b3ff0 0x7facd00a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:52.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.579+0000 7facd58fd640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facd006ea40 0x7facd00ae690 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7facc400b3f0 tx=0x7facc400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:52.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.579+0000 7facc27fc640 1 -- 172.21.15.104:0/4116478534 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc4015020 con 0x7facd006ea40 2024-05-08T04:21:52.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.579+0000 7facc27fc640 1 -- 172.21.15.104:0/4116478534 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc4011830 con 0x7facd006ea40 2024-05-08T04:21:52.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.579+0000 7facd7b61640 1 -- 172.21.15.104:0/4116478534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd00a9220 con 0x7facd006ea40 2024-05-08T04:21:52.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.579+0000 7facc27fc640 1 -- 172.21.15.104:0/4116478534 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc4011c20 con 0x7facd006ea40 2024-05-08T04:21:52.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.579+0000 7facd7b61640 1 -- 172.21.15.104:0/4116478534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd01f10b0 con 0x7facd006ea40 2024-05-08T04:21:52.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.580+0000 7facd7b61640 1 -- 172.21.15.104:0/4116478534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd01f12b0 con 0x7facd006ea40 2024-05-08T04:21:52.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.580+0000 7facc27fc640 1 -- 172.21.15.104:0/4116478534 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7facc4018020 con 0x7facd006ea40 2024-05-08T04:21:52.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.581+0000 7facc27fc640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7facb406b4d0 0x7facb406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.581+0000 7facc27fc640 1 -- 172.21.15.104:0/4116478534 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5738+0+0 (secure 0 0 0) 0x7facc4089db0 con 0x7facd006ea40 2024-05-08T04:21:52.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.581+0000 7facd50fc640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7facb406b4d0 0x7facb406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.581+0000 7facd50fc640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7facb406b4d0 0x7facb406d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7facd00afe00 tx=0x7faccc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:52.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.585+0000 7facc27fc640 1 -- 172.21.15.104:0/4116478534 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7facd01f12b0 con 0x7facd006ea40 2024-05-08T04:21:52.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.768+0000 7facd7b61640 1 -- 172.21.15.104:0/4116478534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7facd0075010 con 0x7facd006ea40 2024-05-08T04:21:52.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.769+0000 7facc27fc640 1 -- 172.21.15.104:0/4116478534 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7facc401f030 con 0x7facd006ea40 2024-05-08T04:21:52.771 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:21:52.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.770+0000 7facd7b61640 1 -- 172.21.15.104:0/4116478534 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7facb406b4d0 msgr2=0x7facb406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.770+0000 7facd7b61640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7facb406b4d0 0x7facb406d990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7facd00afe00 tx=0x7faccc008040 comp rx=0 tx=0).stop 2024-05-08T04:21:52.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.770+0000 7facd7b61640 1 -- 172.21.15.104:0/4116478534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facd006ea40 msgr2=0x7facd00ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.770+0000 7facd7b61640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facd006ea40 0x7facd00ae690 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7facc400b3f0 tx=0x7facc400b8b0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.770+0000 7facd7b61640 1 -- 172.21.15.104:0/4116478534 shutdown_connections 2024-05-08T04:21:52.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.771+0000 7facd7b61640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7facb406b4d0 0x7facb406d990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.771+0000 7facd7b61640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd00b3ff0 0x7facd00a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.771+0000 7facd7b61640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd00ceee0 0x7facd0148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.771+0000 7facd7b61640 1 --2- 172.21.15.104:0/4116478534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7facd006ea40 0x7facd00ae690 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.771+0000 7facd7b61640 1 -- 172.21.15.104:0/4116478534 >> 172.21.15.104:0/4116478534 conn(0x7facd00b13f0 msgr2=0x7facd00cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:52.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.771+0000 7facd7b61640 1 -- 172.21.15.104:0/4116478534 shutdown_connections 2024-05-08T04:21:52.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.771+0000 7facd7b61640 1 -- 172.21.15.104:0/4116478534 wait complete. 2024-05-08T04:21:52.783 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:21:52.784 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:21:52.803 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:52.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.901+0000 7f7666d89640 1 Processor -- start 2024-05-08T04:21:52.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.901+0000 7f7666d89640 1 -- start start 2024-05-08T04:21:52.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.902+0000 7f7666d89640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f76600ceee0 0x7f76600b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.902+0000 7f7666d89640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766015e780 con 0x7f766006e330 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.902+0000 7f7666d89640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766015ea60 con 0x7f76600b4700 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.902+0000 7f7666d89640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766015f390 con 0x7f76600ceee0 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.902+0000 7f7657fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f766006e330 0x7f76600b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59696/0 (socket says 172.21.15.104:59696) 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.902+0000 7f7657fff640 1 -- 172.21.15.104:0/2747007335 learned_addr learned my addr 172.21.15.104:0/2747007335 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.902+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404214651 0 0) 0x7f766015e780 con 0x7f766006e330 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.902+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7648003520 con 0x7f766006e330 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.902+0000 7f7664b25640 1 --2- 172.21.15.104:0/2747007335 >> v2:172.21.15.183:3300/0 conn(0x7f76600ceee0 0x7f76600b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.902+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1332434950 0 0) 0x7f7648003520 con 0x7f766006e330 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.902+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 >> v2:172.21.15.183:3300/0 conn(0x7f76600ceee0 msgr2=0x7f76600b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.902+0000 7f76577fe640 1 --2- 172.21.15.104:0/2747007335 >> v2:172.21.15.183:3300/0 conn(0x7f76600ceee0 0x7f76600b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 >> v1:172.21.15.183:6789/0 conn(0x7f76600b4700 legacy=0x7f766015b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766015ed40 con 0x7f766006e330 2024-05-08T04:21:52.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f7650001670 con 0x7f766006e330 2024-05-08T04:21:52.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 >> v1:172.21.15.104:6789/0 conn(0x7f766006e330 legacy=0x7f76600b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f76577fe640 1 --2- 172.21.15.104:0/2747007335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76480039b0 0x7f7648003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f76577fe640 1 --2- 172.21.15.104:0/2747007335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7648004800 0x7f7648004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f76577fe640 1 --2- 172.21.15.104:0/2747007335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76480051c0 0x7f764800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766015f390 con 0x7f76480051c0 2024-05-08T04:21:52.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764800c060 con 0x7f7648004800 2024-05-08T04:21:52.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764800c260 con 0x7f76480039b0 2024-05-08T04:21:52.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f7665326640 1 --2- 172.21.15.104:0/2747007335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76480051c0 0x7f764800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f7657fff640 1 --2- 172.21.15.104:0/2747007335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7648004800 0x7f7648004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f7664b25640 1 --2- 172.21.15.104:0/2747007335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76480039b0 0x7f7648003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f7665326640 1 -- 172.21.15.104:0/2747007335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76480039b0 msgr2=0x7f7648003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:52.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f7665326640 1 --2- 172.21.15.104:0/2747007335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76480039b0 0x7f7648003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f7665326640 1 -- 172.21.15.104:0/2747007335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7648004800 msgr2=0x7f7648004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f7665326640 1 --2- 172.21.15.104:0/2747007335 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7648004800 0x7f7648004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.903+0000 7f7665326640 1 -- 172.21.15.104:0/2747007335 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7648003520 con 0x7f76480051c0 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.904+0000 7f7665326640 1 -- 172.21.15.104:0/2747007335 reap_dead start 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.904+0000 7f7665326640 1 --2- 172.21.15.104:0/2747007335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76480051c0 0x7f764800b9c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7658001e50 tx=0x7f7648005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58026de92ef3a2df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.904+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658001a70 con 0x7f76480051c0 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.904+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7658003970 con 0x7f76480051c0 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.904+0000 7f76577fe640 1 -- 172.21.15.104:0/2747007335 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658003d60 con 0x7f76480051c0 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.904+0000 7f7666d89640 1 -- 172.21.15.104:0/2747007335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76480051c0 msgr2=0x7f764800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.904+0000 7f7666d89640 1 --2- 172.21.15.104:0/2747007335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76480051c0 0x7f764800b9c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7658001e50 tx=0x7f7648005830 comp rx=0 tx=0).stop 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.904+0000 7f7666d89640 1 -- 172.21.15.104:0/2747007335 shutdown_connections 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.904+0000 7f7666d89640 1 --2- 172.21.15.104:0/2747007335 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76480051c0 0x7f764800b9c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.904+0000 7f7666d89640 1 -- 172.21.15.104:0/2747007335 >> 172.21.15.104:0/2747007335 conn(0x7f76600b13f0 msgr2=0x7f76600b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.904+0000 7f7666d89640 1 -- 172.21.15.104:0/2747007335 shutdown_connections 2024-05-08T04:21:52.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.904+0000 7f7666d89640 1 -- 172.21.15.104:0/2747007335 wait complete. 2024-05-08T04:21:52.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.906+0000 7f7666d89640 1 Processor -- start 2024-05-08T04:21:52.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.906+0000 7f7666d89640 1 -- start start 2024-05-08T04:21:52.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7666d89640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76480051c0 0x7f7660144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7666d89640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76601f0ad0 0x7f76601f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7666d89640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f766015d320 0x7f766015d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7666d89640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600cf440 con 0x7f76601f0ad0 2024-05-08T04:21:52.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7666d89640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600cf2c0 con 0x7f76480051c0 2024-05-08T04:21:52.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7666d89640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600b26f0 con 0x7f766015d320 2024-05-08T04:21:52.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7657fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76601f0ad0 0x7f76601f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7657fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76601f0ad0 0x7f76601f0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52188/0 (socket says 172.21.15.104:52188) 2024-05-08T04:21:52.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7657fff640 1 -- 172.21.15.104:0/2984899193 learned_addr learned my addr 172.21.15.104:0/2984899193 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:52.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7664b25640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76480051c0 0x7f7660144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7665326640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f766015d320 0x7f766015d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7657fff640 1 -- 172.21.15.104:0/2984899193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f766015d320 msgr2=0x7f766015d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7657fff640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f766015d320 0x7f766015d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7657fff640 1 -- 172.21.15.104:0/2984899193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76480051c0 msgr2=0x7f7660144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:52.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7657fff640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76480051c0 0x7f7660144f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:52.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7657fff640 1 -- 172.21.15.104:0/2984899193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600ace30 con 0x7f76601f0ad0 2024-05-08T04:21:52.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7657fff640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76601f0ad0 0x7f76601f0f50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7650007290 tx=0x7f7650007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:52.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f76557fa640 1 -- 172.21.15.104:0/2984899193 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000f960 con 0x7f76601f0ad0 2024-05-08T04:21:52.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f76557fa640 1 -- 172.21.15.104:0/2984899193 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7650018070 con 0x7f76601f0ad0 2024-05-08T04:21:52.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7666d89640 1 -- 172.21.15.104:0/2984899193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76600ad110 con 0x7f76601f0ad0 2024-05-08T04:21:52.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f76557fa640 1 -- 172.21.15.104:0/2984899193 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765000fd00 con 0x7f76601f0ad0 2024-05-08T04:21:52.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.907+0000 7f7666d89640 1 -- 172.21.15.104:0/2984899193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76600acae0 con 0x7f76601f0ad0 2024-05-08T04:21:52.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.908+0000 7f7666d89640 1 -- 172.21.15.104:0/2984899193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7660075010 con 0x7f76601f0ad0 2024-05-08T04:21:52.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.909+0000 7f76557fa640 1 -- 172.21.15.104:0/2984899193 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f765001d460 con 0x7f76601f0ad0 2024-05-08T04:21:52.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.909+0000 7f76557fa640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f764c06b500 0x7f764c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:52.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.909+0000 7f7664b25640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f764c06b500 0x7f764c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:52.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.909+0000 7f76557fa640 1 -- 172.21.15.104:0/2984899193 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7650089ff0 con 0x7f76601f0ad0 2024-05-08T04:21:52.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.910+0000 7f7664b25640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f764c06b500 0x7f764c06d9c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f765c009a40 tx=0x7f765c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:52.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:52.914+0000 7f76557fa640 1 -- 172.21.15.104:0/2984899193 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7650058890 con 0x7f76601f0ad0 2024-05-08T04:21:53.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.090+0000 7f7666d89640 1 -- 172.21.15.104:0/2984899193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f766006f3f0 con 0x7f76601f0ad0 2024-05-08T04:21:53.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.091+0000 7f76557fa640 1 -- 172.21.15.104:0/2984899193 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16718 (secure 0 0 0) 0x7f765005c930 con 0x7f76601f0ad0 2024-05-08T04:21:53.093 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:53.093 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":21,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:50.956824+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:53.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.093+0000 7f7666d89640 1 -- 172.21.15.104:0/2984899193 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f764c06b500 msgr2=0x7f764c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.093+0000 7f7666d89640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f764c06b500 0x7f764c06d9c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f765c009a40 tx=0x7f765c008040 comp rx=0 tx=0).stop 2024-05-08T04:21:53.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.093+0000 7f7666d89640 1 -- 172.21.15.104:0/2984899193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76601f0ad0 msgr2=0x7f76601f0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.093+0000 7f7666d89640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76601f0ad0 0x7f76601f0f50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7650007290 tx=0x7f7650007750 comp rx=0 tx=0).stop 2024-05-08T04:21:53.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.093+0000 7f7666d89640 1 -- 172.21.15.104:0/2984899193 shutdown_connections 2024-05-08T04:21:53.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.093+0000 7f7666d89640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f764c06b500 0x7f764c06d9c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.093+0000 7f7666d89640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f766015d320 0x7f766015d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.093+0000 7f7666d89640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76601f0ad0 0x7f76601f0f50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.093+0000 7f7666d89640 1 --2- 172.21.15.104:0/2984899193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76480051c0 0x7f7660144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.093+0000 7f7666d89640 1 -- 172.21.15.104:0/2984899193 >> 172.21.15.104:0/2984899193 conn(0x7f76600b13f0 msgr2=0x7f76600afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:53.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.093+0000 7f7666d89640 1 -- 172.21.15.104:0/2984899193 shutdown_connections 2024-05-08T04:21:53.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.093+0000 7f7666d89640 1 -- 172.21.15.104:0/2984899193 wait complete. 2024-05-08T04:21:53.106 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:53.107 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:53.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.207+0000 7efe3da15640 1 Processor -- start 2024-05-08T04:21:53.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.207+0000 7efe3da15640 1 -- start start 2024-05-08T04:21:53.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe3da15640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe3815de10 0x7efe38161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe3da15640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efe380ce5a0 0x7efe380d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe3da15640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe380d3210 con 0x7efe380d05f0 2024-05-08T04:21:53.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe3da15640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe380d0f50 con 0x7efe380ce5a0 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe3da15640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe38161e60 con 0x7efe3815de10 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe2ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efe380ce5a0 0x7efe380d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe2ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efe380ce5a0 0x7efe380d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52196/0 (socket says 172.21.15.104:52196) 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe2ffff640 1 -- 172.21.15.104:0/889752329 learned_addr learned my addr 172.21.15.104:0/889752329 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe36ffd640 1 --2- 172.21.15.104:0/889752329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe3815de10 0x7efe38161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe2ffff640 1 -- 172.21.15.104:0/889752329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe3815de10 msgr2=0x7efe38161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe2ffff640 1 --2- 172.21.15.104:0/889752329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe3815de10 0x7efe38161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe2ffff640 1 -- 172.21.15.104:0/889752329 >> v1:172.21.15.183:6789/0 conn(0x7efe380d05f0 legacy=0x7efe380b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe2ffff640 1 -- 172.21.15.104:0/889752329 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3815e1f0 con 0x7efe380ce5a0 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.208+0000 7efe36ffd640 1 --2- 172.21.15.104:0/889752329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe3815de10 0x7efe38161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.209+0000 7efe2ffff640 1 --2- 172.21.15.104:0/889752329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe380ce5a0 0x7efe380d00b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efe20009870 tx=0x7efe2002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07b410255e87890 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.209+0000 7efe367fc640 1 -- 172.21.15.104:0/889752329 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20037070 con 0x7efe380ce5a0 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.209+0000 7efe367fc640 1 -- 172.21.15.104:0/889752329 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe20032440 con 0x7efe380ce5a0 2024-05-08T04:21:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.209+0000 7efe367fc640 1 -- 172.21.15.104:0/889752329 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20032810 con 0x7efe380ce5a0 2024-05-08T04:21:53.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.210+0000 7efe3da15640 1 -- 172.21.15.104:0/889752329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe380ce5a0 msgr2=0x7efe380d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.210+0000 7efe3da15640 1 --2- 172.21.15.104:0/889752329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe380ce5a0 0x7efe380d00b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efe20009870 tx=0x7efe2002a180 comp rx=0 tx=0).stop 2024-05-08T04:21:53.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.210+0000 7efe3da15640 1 -- 172.21.15.104:0/889752329 shutdown_connections 2024-05-08T04:21:53.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.210+0000 7efe3da15640 1 --2- 172.21.15.104:0/889752329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe380ce5a0 0x7efe380d00b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.210+0000 7efe3da15640 1 --2- 172.21.15.104:0/889752329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe3815de10 0x7efe38161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.210+0000 7efe3da15640 1 -- 172.21.15.104:0/889752329 >> 172.21.15.104:0/889752329 conn(0x7efe38072290 msgr2=0x7efe38072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:53.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.210+0000 7efe3da15640 1 -- 172.21.15.104:0/889752329 shutdown_connections 2024-05-08T04:21:53.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.210+0000 7efe3da15640 1 -- 172.21.15.104:0/889752329 wait complete. 2024-05-08T04:21:53.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.211+0000 7efe3da15640 1 Processor -- start 2024-05-08T04:21:53.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.211+0000 7efe3da15640 1 -- start start 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe3da15640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe380ce5a0 0x7efe380c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe3da15640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe380d05f0 0x7efe3815ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe3da15640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe3815de10 0x7efe381f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe3da15640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe38162090 con 0x7efe3815de10 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe3da15640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe380d1a90 con 0x7efe380d05f0 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe3da15640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe38162370 con 0x7efe380ce5a0 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe377fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe3815de10 0x7efe381f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe377fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe3815de10 0x7efe381f6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52204/0 (socket says 172.21.15.104:52204) 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe377fe640 1 -- 172.21.15.104:0/1394472162 learned_addr learned my addr 172.21.15.104:0/1394472162 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe36ffd640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe380ce5a0 0x7efe380c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe2ffff640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe380d05f0 0x7efe3815ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe377fe640 1 -- 172.21.15.104:0/1394472162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe380ce5a0 msgr2=0x7efe380c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe377fe640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe380ce5a0 0x7efe380c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe377fe640 1 -- 172.21.15.104:0/1394472162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe380d05f0 msgr2=0x7efe3815ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe377fe640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe380d05f0 0x7efe3815ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe377fe640 1 -- 172.21.15.104:0/1394472162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe381f7990 con 0x7efe3815de10 2024-05-08T04:21:53.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe377fe640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe3815de10 0x7efe381f6f40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c7b0 tx=0x7efe3000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:53.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe34ff9640 1 -- 172.21.15.104:0/1394472162 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30004b60 con 0x7efe3815de10 2024-05-08T04:21:53.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe34ff9640 1 -- 172.21.15.104:0/1394472162 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe30004d00 con 0x7efe3815de10 2024-05-08T04:21:53.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe34ff9640 1 -- 172.21.15.104:0/1394472162 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3000aa90 con 0x7efe3815de10 2024-05-08T04:21:53.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe3da15640 1 -- 172.21.15.104:0/1394472162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe381f7c70 con 0x7efe3815de10 2024-05-08T04:21:53.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.212+0000 7efe3da15640 1 -- 172.21.15.104:0/1394472162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3815e910 con 0x7efe3815de10 2024-05-08T04:21:53.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.213+0000 7efe3da15640 1 -- 172.21.15.104:0/1394472162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3815e420 con 0x7efe3815de10 2024-05-08T04:21:53.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.214+0000 7efe34ff9640 1 -- 172.21.15.104:0/1394472162 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe3000ac30 con 0x7efe3815de10 2024-05-08T04:21:53.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.214+0000 7efe34ff9640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efe1806b4d0 0x7efe1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.214+0000 7efe34ff9640 1 -- 172.21.15.104:0/1394472162 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5738+0+0 (secure 0 0 0) 0x7efe3008a350 con 0x7efe3815de10 2024-05-08T04:21:53.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.214+0000 7efe36ffd640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efe1806b4d0 0x7efe1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.215+0000 7efe36ffd640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efe1806b4d0 0x7efe1806d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe2800aac0 tx=0x7efe28008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:53.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.218+0000 7efe34ff9640 1 -- 172.21.15.104:0/1394472162 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe30020070 con 0x7efe3815de10 2024-05-08T04:21:53.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.386+0000 7efe3da15640 1 -- 172.21.15.104:0/1394472162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe38075010 con 0x7efe3815de10 2024-05-08T04:21:53.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.387+0000 7efe34ff9640 1 -- 172.21.15.104:0/1394472162 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe30058bf0 con 0x7efe3815de10 2024-05-08T04:21:53.389 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:53.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.389+0000 7efe3da15640 1 -- 172.21.15.104:0/1394472162 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efe1806b4d0 msgr2=0x7efe1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.389+0000 7efe3da15640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efe1806b4d0 0x7efe1806d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe2800aac0 tx=0x7efe28008040 comp rx=0 tx=0).stop 2024-05-08T04:21:53.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.389+0000 7efe3da15640 1 -- 172.21.15.104:0/1394472162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe3815de10 msgr2=0x7efe381f6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.389+0000 7efe3da15640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe3815de10 0x7efe381f6f40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c7b0 tx=0x7efe3000cc70 comp rx=0 tx=0).stop 2024-05-08T04:21:53.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.389+0000 7efe3da15640 1 -- 172.21.15.104:0/1394472162 shutdown_connections 2024-05-08T04:21:53.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.389+0000 7efe3da15640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efe1806b4d0 0x7efe1806d990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.389+0000 7efe3da15640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe380d05f0 0x7efe3815ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.389+0000 7efe3da15640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efe3815de10 0x7efe381f6f40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.389+0000 7efe3da15640 1 --2- 172.21.15.104:0/1394472162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe380ce5a0 0x7efe380c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.389+0000 7efe3da15640 1 -- 172.21.15.104:0/1394472162 >> 172.21.15.104:0/1394472162 conn(0x7efe38072290 msgr2=0x7efe380cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:53.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.389+0000 7efe3da15640 1 -- 172.21.15.104:0/1394472162 shutdown_connections 2024-05-08T04:21:53.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.389+0000 7efe3da15640 1 -- 172.21.15.104:0/1394472162 wait complete. 2024-05-08T04:21:53.402 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:53.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.502+0000 7f3e60bd5640 1 Processor -- start 2024-05-08T04:21:53.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.502+0000 7f3e60bd5640 1 -- start start 2024-05-08T04:21:53.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e60bd5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3e5c0711c0 0x7f3e5c06d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e60bd5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e5c144c80 0x7f3e5c06dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e60bd5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c071fb0 con 0x7f3e5c0cc930 2024-05-08T04:21:53.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e60bd5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5c071710 con 0x7f3e5c0711c0 2024-05-08T04:21:53.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e60bd5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0719f0 con 0x7f3e5c144c80 2024-05-08T04:21:53.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e5ad9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e5c144c80 0x7f3e5c06dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e5ad9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e5c144c80 0x7f3e5c06dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:46800/0 (socket says 172.21.15.104:46800) 2024-05-08T04:21:53.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e51d9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3e5c0711c0 0x7f3e5c06d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e5ad9d640 1 -- 172.21.15.104:0/4233809111 learned_addr learned my addr 172.21.15.104:0/4233809111 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:53.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e5ad9d640 1 -- 172.21.15.104:0/4233809111 >> v2:172.21.15.183:3300/0 conn(0x7f3e5c0711c0 msgr2=0x7f3e5c06d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:53.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e5ad9d640 1 --2- 172.21.15.104:0/4233809111 >> v2:172.21.15.183:3300/0 conn(0x7f3e5c0711c0 0x7f3e5c06d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e5ad9d640 1 -- 172.21.15.104:0/4233809111 >> v1:172.21.15.183:6789/0 conn(0x7f3e5c0cc930 legacy=0x7f3e5c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e5ad9d640 1 -- 172.21.15.104:0/4233809111 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c071cd0 con 0x7f3e5c144c80 2024-05-08T04:21:53.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.503+0000 7f3e51d9b640 1 --2- 172.21.15.104:0/4233809111 >> v2:172.21.15.183:3300/0 conn(0x7f3e5c0711c0 0x7f3e5c06d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:53.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.504+0000 7f3e5ad9d640 1 --2- 172.21.15.104:0/4233809111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e5c144c80 0x7f3e5c06dd90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009e50 tx=0x7f3e5402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ffcd65660c4fd70 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:53.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.504+0000 7f3e59d9b640 1 -- 172.21.15.104:0/4233809111 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e54036070 con 0x7f3e5c144c80 2024-05-08T04:21:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.504+0000 7f3e59d9b640 1 -- 172.21.15.104:0/4233809111 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e54031600 con 0x7f3e5c144c80 2024-05-08T04:21:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.504+0000 7f3e59d9b640 1 -- 172.21.15.104:0/4233809111 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e540319d0 con 0x7f3e5c144c80 2024-05-08T04:21:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.505+0000 7f3e60bd5640 1 -- 172.21.15.104:0/4233809111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e5c144c80 msgr2=0x7f3e5c06dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.505+0000 7f3e60bd5640 1 --2- 172.21.15.104:0/4233809111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e5c144c80 0x7f3e5c06dd90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009e50 tx=0x7f3e5402a680 comp rx=0 tx=0).stop 2024-05-08T04:21:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.505+0000 7f3e60bd5640 1 -- 172.21.15.104:0/4233809111 shutdown_connections 2024-05-08T04:21:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.505+0000 7f3e60bd5640 1 --2- 172.21.15.104:0/4233809111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e5c144c80 0x7f3e5c06dd90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.505+0000 7f3e60bd5640 1 --2- 172.21.15.104:0/4233809111 >> v2:172.21.15.183:3300/0 conn(0x7f3e5c0711c0 0x7f3e5c06d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.505+0000 7f3e60bd5640 1 -- 172.21.15.104:0/4233809111 >> 172.21.15.104:0/4233809111 conn(0x7f3e5c0b13f0 msgr2=0x7f3e5c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.505+0000 7f3e60bd5640 1 -- 172.21.15.104:0/4233809111 shutdown_connections 2024-05-08T04:21:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.505+0000 7f3e60bd5640 1 -- 172.21.15.104:0/4233809111 wait complete. 2024-05-08T04:21:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.506+0000 7f3e60bd5640 1 Processor -- start 2024-05-08T04:21:53.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.506+0000 7f3e60bd5640 1 -- start start 2024-05-08T04:21:53.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e60bd5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e5c0711c0 0x7f3e5c1594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e60bd5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e5c0cc930 0x7f3e5c15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e60bd5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e5c144c80 0x7f3e5c132800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e60bd5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c1453f0 con 0x7f3e5c0cc930 2024-05-08T04:21:53.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e60bd5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0cf3b0 con 0x7f3e5c0711c0 2024-05-08T04:21:53.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e60bd5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c06e2d0 con 0x7f3e5c144c80 2024-05-08T04:21:53.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e51d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e5c0cc930 0x7f3e5c15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e51d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e5c0cc930 0x7f3e5c15c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52218/0 (socket says 172.21.15.104:52218) 2024-05-08T04:21:53.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e51d9b640 1 -- 172.21.15.104:0/874027808 learned_addr learned my addr 172.21.15.104:0/874027808 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:53.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e5ad9d640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e5c144c80 0x7f3e5c132800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e5a59c640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e5c0711c0 0x7f3e5c1594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e51d9b640 1 -- 172.21.15.104:0/874027808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e5c144c80 msgr2=0x7f3e5c132800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e51d9b640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e5c144c80 0x7f3e5c132800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e51d9b640 1 -- 172.21.15.104:0/874027808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e5c0711c0 msgr2=0x7f3e5c1594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e51d9b640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e5c0711c0 0x7f3e5c1594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e51d9b640 1 -- 172.21.15.104:0/874027808 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c15b960 con 0x7f3e5c0cc930 2024-05-08T04:21:53.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.507+0000 7f3e5ad9d640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e5c144c80 0x7f3e5c132800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.508+0000 7f3e51d9b640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e5c0cc930 0x7f3e5c15c9c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400ebe0 tx=0x7f3e4400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.508+0000 7f3e537fe640 1 -- 172.21.15.104:0/874027808 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44017070 con 0x7f3e5c0cc930 2024-05-08T04:21:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.508+0000 7f3e537fe640 1 -- 172.21.15.104:0/874027808 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4400cc30 con 0x7f3e5c0cc930 2024-05-08T04:21:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.508+0000 7f3e60bd5640 1 -- 172.21.15.104:0/874027808 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5c1599f0 con 0x7f3e5c0cc930 2024-05-08T04:21:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.508+0000 7f3e537fe640 1 -- 172.21.15.104:0/874027808 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44013470 con 0x7f3e5c0cc930 2024-05-08T04:21:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.508+0000 7f3e60bd5640 1 -- 172.21.15.104:0/874027808 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c15bee0 con 0x7f3e5c0cc930 2024-05-08T04:21:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.509+0000 7f3e60bd5640 1 -- 172.21.15.104:0/874027808 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c075010 con 0x7f3e5c0cc930 2024-05-08T04:21:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.509+0000 7f3e537fe640 1 -- 172.21.15.104:0/874027808 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3e4401a070 con 0x7f3e5c0cc930 2024-05-08T04:21:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.510+0000 7f3e537fe640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e3c06b4d0 0x7f3e3c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.510+0000 7f3e537fe640 1 -- 172.21.15.104:0/874027808 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3e4408a0f0 con 0x7f3e5c0cc930 2024-05-08T04:21:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.510+0000 7f3e5a59c640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e3c06b4d0 0x7f3e3c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.510+0000 7f3e5a59c640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e3c06b4d0 0x7f3e3c06d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c001640 tx=0x7f3e4c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:53.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.514+0000 7f3e537fe640 1 -- 172.21.15.104:0/874027808 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e44058fe0 con 0x7f3e5c0cc930 2024-05-08T04:21:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.683+0000 7f3e60bd5640 1 -- 172.21.15.104:0/874027808 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e5c0aedf0 con 0x7f3e5c0cc930 2024-05-08T04:21:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.684+0000 7f3e537fe640 1 -- 172.21.15.104:0/874027808 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e440588e0 con 0x7f3e5c0cc930 2024-05-08T04:21:53.686 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:53.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.686+0000 7f3e60bd5640 1 -- 172.21.15.104:0/874027808 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e3c06b4d0 msgr2=0x7f3e3c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.686+0000 7f3e60bd5640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e3c06b4d0 0x7f3e3c06d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c001640 tx=0x7f3e4c009040 comp rx=0 tx=0).stop 2024-05-08T04:21:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.686+0000 7f3e60bd5640 1 -- 172.21.15.104:0/874027808 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e5c0cc930 msgr2=0x7f3e5c15c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.686+0000 7f3e60bd5640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e5c0cc930 0x7f3e5c15c9c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400ebe0 tx=0x7f3e4400c520 comp rx=0 tx=0).stop 2024-05-08T04:21:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.686+0000 7f3e60bd5640 1 -- 172.21.15.104:0/874027808 shutdown_connections 2024-05-08T04:21:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.686+0000 7f3e60bd5640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e3c06b4d0 0x7f3e3c06d990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.686+0000 7f3e60bd5640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e5c144c80 0x7f3e5c132800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.686+0000 7f3e60bd5640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e5c0cc930 0x7f3e5c15c9c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.686+0000 7f3e60bd5640 1 --2- 172.21.15.104:0/874027808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e5c0711c0 0x7f3e5c1594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.686+0000 7f3e60bd5640 1 -- 172.21.15.104:0/874027808 >> 172.21.15.104:0/874027808 conn(0x7f3e5c0b13f0 msgr2=0x7f3e5c0a84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.686+0000 7f3e60bd5640 1 -- 172.21.15.104:0/874027808 shutdown_connections 2024-05-08T04:21:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.686+0000 7f3e60bd5640 1 -- 172.21.15.104:0/874027808 wait complete. 2024-05-08T04:21:53.700 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:53.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.802+0000 7f66174ee640 1 Processor -- start 2024-05-08T04:21:53.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.802+0000 7f66174ee640 1 -- start start 2024-05-08T04:21:53.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.803+0000 7f66174ee640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f66100ceee0 0x7f66100b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.803+0000 7f66174ee640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661015e780 con 0x7f661006e330 2024-05-08T04:21:53.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.803+0000 7f66174ee640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661015ea60 con 0x7f66100b4700 2024-05-08T04:21:53.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.803+0000 7f66174ee640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661015f390 con 0x7f66100ceee0 2024-05-08T04:21:53.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.803+0000 7f6614a89640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f661006e330 0x7f66100b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59700/0 (socket says 172.21.15.104:59700) 2024-05-08T04:21:53.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.803+0000 7f6614a89640 1 -- 172.21.15.104:0/2540444369 learned_addr learned my addr 172.21.15.104:0/2540444369 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:53.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.803+0000 7f661528a640 1 --2- 172.21.15.104:0/2540444369 >> v2:172.21.15.183:3300/0 conn(0x7f66100ceee0 0x7f66100b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.803+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708942297 0 0) 0x7f661015e780 con 0x7f661006e330 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f8003520 con 0x7f661006e330 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 25455531 0 0) 0x7f65f8003520 con 0x7f661006e330 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 >> v2:172.21.15.183:3300/0 conn(0x7f66100ceee0 msgr2=0x7f66100b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 --2- 172.21.15.104:0/2540444369 >> v2:172.21.15.183:3300/0 conn(0x7f66100ceee0 0x7f66100b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 >> v1:172.21.15.183:6789/0 conn(0x7f66100b4700 legacy=0x7f661015b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661015ed40 con 0x7f661006e330 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f6604001670 con 0x7f661006e330 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 >> v1:172.21.15.104:6789/0 conn(0x7f661006e330 legacy=0x7f66100b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 --2- 172.21.15.104:0/2540444369 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65f80039b0 0x7f65f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 --2- 172.21.15.104:0/2540444369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65f80043b0 0x7f65f8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 --2- 172.21.15.104:0/2540444369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65f8005080 0x7f65f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661015f390 con 0x7f65f80039b0 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f800bfe0 con 0x7f65f80043b0 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f800c1e0 con 0x7f65f8005080 2024-05-08T04:21:53.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f661528a640 1 --2- 172.21.15.104:0/2540444369 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65f80039b0 0x7f65f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f6614a89640 1 --2- 172.21.15.104:0/2540444369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65f80043b0 0x7f65f8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f6615a8b640 1 --2- 172.21.15.104:0/2540444369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65f8005080 0x7f65f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f661528a640 1 -- 172.21.15.104:0/2540444369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65f8005080 msgr2=0x7f65f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f661528a640 1 --2- 172.21.15.104:0/2540444369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65f8005080 0x7f65f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f661528a640 1 -- 172.21.15.104:0/2540444369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65f80043b0 msgr2=0x7f65f8004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f661528a640 1 --2- 172.21.15.104:0/2540444369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65f80043b0 0x7f65f8004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f661528a640 1 -- 172.21.15.104:0/2540444369 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f8003520 con 0x7f65f80039b0 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f6615a8b640 1 --2- 172.21.15.104:0/2540444369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65f8005080 0x7f65f800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.804+0000 7f6615a8b640 1 -- 172.21.15.104:0/2540444369 reap_dead start 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.805+0000 7f661528a640 1 --2- 172.21.15.104:0/2540444369 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65f80039b0 0x7f65f8003d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6600009fc0 tx=0x7f65f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fd4835372c013d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.805+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600009c10 con 0x7f65f80039b0 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.805+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6600036070 con 0x7f65f80039b0 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.805+0000 7f660ffff640 1 -- 172.21.15.104:0/2540444369 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600031880 con 0x7f65f80039b0 2024-05-08T04:21:53.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.806+0000 7f66174ee640 1 -- 172.21.15.104:0/2540444369 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65f80039b0 msgr2=0x7f65f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.806+0000 7f66174ee640 1 --2- 172.21.15.104:0/2540444369 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65f80039b0 0x7f65f8003d90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6600009fc0 tx=0x7f65f8005830 comp rx=0 tx=0).stop 2024-05-08T04:21:53.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.806+0000 7f66174ee640 1 -- 172.21.15.104:0/2540444369 shutdown_connections 2024-05-08T04:21:53.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.806+0000 7f66174ee640 1 --2- 172.21.15.104:0/2540444369 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65f80039b0 0x7f65f8003d90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.806+0000 7f66174ee640 1 -- 172.21.15.104:0/2540444369 >> 172.21.15.104:0/2540444369 conn(0x7f66100b13f0 msgr2=0x7f66100b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:53.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.806+0000 7f66174ee640 1 -- 172.21.15.104:0/2540444369 shutdown_connections 2024-05-08T04:21:53.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.806+0000 7f66174ee640 1 -- 172.21.15.104:0/2540444369 wait complete. 2024-05-08T04:21:53.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.807+0000 7f66174ee640 1 Processor -- start 2024-05-08T04:21:53.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.807+0000 7f66174ee640 1 -- start start 2024-05-08T04:21:53.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f66174ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65f80039b0 0x7f66100aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f66174ee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6610152160 0x7f661015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f66174ee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f661015d450 0x7f6610155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f66174ee640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100cf440 con 0x7f65f80039b0 2024-05-08T04:21:53.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f66174ee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100cf2c0 con 0x7f6610152160 2024-05-08T04:21:53.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f66174ee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66100b26f0 con 0x7f661015d450 2024-05-08T04:21:53.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f661528a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65f80039b0 0x7f66100aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f661528a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65f80039b0 0x7f66100aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52248/0 (socket says 172.21.15.104:52248) 2024-05-08T04:21:53.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f661528a640 1 -- 172.21.15.104:0/1385436918 learned_addr learned my addr 172.21.15.104:0/1385436918 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:53.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f6615a8b640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f661015d450 0x7f6610155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f6614a89640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6610152160 0x7f661015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f661528a640 1 -- 172.21.15.104:0/1385436918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f661015d450 msgr2=0x7f6610155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f661528a640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f661015d450 0x7f6610155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f661528a640 1 -- 172.21.15.104:0/1385436918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6610152160 msgr2=0x7f661015cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f661528a640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6610152160 0x7f661015cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f661528a640 1 -- 172.21.15.104:0/1385436918 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6610150e20 con 0x7f65f80039b0 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f6615a8b640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f661015d450 0x7f6610155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f6614a89640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6610152160 0x7f661015cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f661528a640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65f80039b0 0x7f66100aea30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f660000e230 tx=0x7f6600009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f660dffb640 1 -- 172.21.15.104:0/1385436918 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600009c10 con 0x7f65f80039b0 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f660dffb640 1 -- 172.21.15.104:0/1385436918 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6600003990 con 0x7f65f80039b0 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f66174ee640 1 -- 172.21.15.104:0/1385436918 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66101510c0 con 0x7f65f80039b0 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.808+0000 7f660dffb640 1 -- 172.21.15.104:0/1385436918 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600003d80 con 0x7f65f80039b0 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.809+0000 7f66174ee640 1 -- 172.21.15.104:0/1385436918 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6610151680 con 0x7f65f80039b0 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.809+0000 7f66174ee640 1 -- 172.21.15.104:0/1385436918 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6610075010 con 0x7f65f80039b0 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.810+0000 7f660dffb640 1 -- 172.21.15.104:0/1385436918 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6600005d10 con 0x7f65f80039b0 2024-05-08T04:21:53.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.810+0000 7f660dffb640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f65fc06b4d0 0x7f65fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:53.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.810+0000 7f660dffb640 1 -- 172.21.15.104:0/1385436918 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f66000ab420 con 0x7f65f80039b0 2024-05-08T04:21:53.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.810+0000 7f6614a89640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f65fc06b4d0 0x7f65fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:53.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.811+0000 7f6614a89640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f65fc06b4d0 0x7f65fc06d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6604000c00 tx=0x7f6604009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:53.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.814+0000 7f660dffb640 1 -- 172.21.15.104:0/1385436918 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f660007a310 con 0x7f65f80039b0 2024-05-08T04:21:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.990+0000 7f66174ee640 1 -- 172.21.15.104:0/1385436918 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f661006f3f0 con 0x7f65f80039b0 2024-05-08T04:21:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.990+0000 7f660dffb640 1 -- 172.21.15.104:0/1385436918 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6600079c10 con 0x7f65f80039b0 2024-05-08T04:21:53.993 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.992+0000 7f66174ee640 1 -- 172.21.15.104:0/1385436918 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f65fc06b4d0 msgr2=0x7f65fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.992+0000 7f66174ee640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f65fc06b4d0 0x7f65fc06d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6604000c00 tx=0x7f6604009040 comp rx=0 tx=0).stop 2024-05-08T04:21:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.992+0000 7f66174ee640 1 -- 172.21.15.104:0/1385436918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65f80039b0 msgr2=0x7f66100aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.992+0000 7f66174ee640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65f80039b0 0x7f66100aea30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f660000e230 tx=0x7f6600009750 comp rx=0 tx=0).stop 2024-05-08T04:21:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.992+0000 7f66174ee640 1 -- 172.21.15.104:0/1385436918 shutdown_connections 2024-05-08T04:21:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.992+0000 7f66174ee640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f65fc06b4d0 0x7f65fc06d990 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.992+0000 7f66174ee640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6610152160 0x7f661015cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.992+0000 7f66174ee640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f661015d450 0x7f6610155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.992+0000 7f66174ee640 1 --2- 172.21.15.104:0/1385436918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65f80039b0 0x7f66100aea30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.992+0000 7f66174ee640 1 -- 172.21.15.104:0/1385436918 >> 172.21.15.104:0/1385436918 conn(0x7f66100b13f0 msgr2=0x7f66101571e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.992+0000 7f66174ee640 1 -- 172.21.15.104:0/1385436918 shutdown_connections 2024-05-08T04:21:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:53.992+0000 7f66174ee640 1 -- 172.21.15.104:0/1385436918 wait complete. 2024-05-08T04:21:54.006 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:21:54.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.107+0000 7f4798238640 1 Processor -- start 2024-05-08T04:21:54.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.108+0000 7f4798238640 1 -- start start 2024-05-08T04:21:54.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.108+0000 7f4798238640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4790099a40 0x7f4790099e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.108+0000 7f4798238640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47900cf360 0x7f47900cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.108+0000 7f4798238640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f479015f540 0x7f479015f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.108+0000 7f4798238640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479015ced0 con 0x7f4790099a40 2024-05-08T04:21:54.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.108+0000 7f4798238640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47900cc700 con 0x7f479015f540 2024-05-08T04:21:54.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.108+0000 7f4798238640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479009a360 con 0x7f47900cf360 2024-05-08T04:21:54.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.108+0000 7f4795fd4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4790099a40 0x7f4790099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.109+0000 7f4795fd4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4790099a40 0x7f4790099e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52254/0 (socket says 172.21.15.104:52254) 2024-05-08T04:21:54.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.109+0000 7f4795fd4640 1 -- 172.21.15.104:0/245896985 learned_addr learned my addr 172.21.15.104:0/245896985 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:54.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.109+0000 7f47957d3640 1 --2- 172.21.15.104:0/245896985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47900cf360 0x7f47900cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.109+0000 7f47967d5640 1 --2- 172.21.15.104:0/245896985 >> v2:172.21.15.183:3300/0 conn(0x7f479015f540 0x7f479015f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.109+0000 7f4795fd4640 1 -- 172.21.15.104:0/245896985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47900cf360 msgr2=0x7f47900cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.109+0000 7f4795fd4640 1 --2- 172.21.15.104:0/245896985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47900cf360 0x7f47900cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.109+0000 7f4795fd4640 1 -- 172.21.15.104:0/245896985 >> v2:172.21.15.183:3300/0 conn(0x7f479015f540 msgr2=0x7f479015f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.109+0000 7f4795fd4640 1 --2- 172.21.15.104:0/245896985 >> v2:172.21.15.183:3300/0 conn(0x7f479015f540 0x7f479015f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.109+0000 7f4795fd4640 1 -- 172.21.15.104:0/245896985 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47900d0020 con 0x7f4790099a40 2024-05-08T04:21:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.109+0000 7f47957d3640 1 --2- 172.21.15.104:0/245896985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47900cf360 0x7f47900cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.109+0000 7f47967d5640 1 --2- 172.21.15.104:0/245896985 >> v2:172.21.15.183:3300/0 conn(0x7f479015f540 0x7f479015f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.109+0000 7f4795fd4640 1 --2- 172.21.15.104:0/245896985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4790099a40 0x7f4790099e20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47900b3230 tx=0x7f478002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7740a7b00e814b71 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.110+0000 7f4794fd2640 1 -- 172.21.15.104:0/245896985 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780004030 con 0x7f4790099a40 2024-05-08T04:21:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.110+0000 7f4794fd2640 1 -- 172.21.15.104:0/245896985 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47800041d0 con 0x7f4790099a40 2024-05-08T04:21:54.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.110+0000 7f4794fd2640 1 -- 172.21.15.104:0/245896985 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780003610 con 0x7f4790099a40 2024-05-08T04:21:54.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.110+0000 7f4798238640 1 -- 172.21.15.104:0/245896985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4790099a40 msgr2=0x7f4790099e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.110+0000 7f4798238640 1 --2- 172.21.15.104:0/245896985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4790099a40 0x7f4790099e20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47900b3230 tx=0x7f478002a1c0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.110+0000 7f4798238640 1 -- 172.21.15.104:0/245896985 shutdown_connections 2024-05-08T04:21:54.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.110+0000 7f4798238640 1 --2- 172.21.15.104:0/245896985 >> v2:172.21.15.183:3300/0 conn(0x7f479015f540 0x7f479015f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.110+0000 7f4798238640 1 --2- 172.21.15.104:0/245896985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47900cf360 0x7f47900cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.110+0000 7f4798238640 1 --2- 172.21.15.104:0/245896985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4790099a40 0x7f4790099e20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.110+0000 7f4798238640 1 -- 172.21.15.104:0/245896985 >> 172.21.15.104:0/245896985 conn(0x7f47900b3280 msgr2=0x7f47900b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:54.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.110+0000 7f4798238640 1 -- 172.21.15.104:0/245896985 shutdown_connections 2024-05-08T04:21:54.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.110+0000 7f4798238640 1 -- 172.21.15.104:0/245896985 wait complete. 2024-05-08T04:21:54.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.111+0000 7f4798238640 1 Processor -- start 2024-05-08T04:21:54.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.111+0000 7f4798238640 1 -- start start 2024-05-08T04:21:54.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.112+0000 7f4798238640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4790099a40 0x7f4790158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.112+0000 7f4798238640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47900cf360 0x7f47900ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.112+0000 7f4798238640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f479015f540 0x7f47900c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.112+0000 7f4798238640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4790159860 con 0x7f479015f540 2024-05-08T04:21:54.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.112+0000 7f4798238640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47900d05e0 con 0x7f47900cf360 2024-05-08T04:21:54.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.112+0000 7f4798238640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47900cfd00 con 0x7f4790099a40 2024-05-08T04:21:54.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.112+0000 7f47967d5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f479015f540 0x7f47900c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.112+0000 7f47967d5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f479015f540 0x7f47900c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52256/0 (socket says 172.21.15.104:52256) 2024-05-08T04:21:54.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.112+0000 7f47967d5640 1 -- 172.21.15.104:0/1717311849 learned_addr learned my addr 172.21.15.104:0/1717311849 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:54.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.112+0000 7f4795fd4640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4790099a40 0x7f4790158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.112+0000 7f47957d3640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47900cf360 0x7f47900ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.113+0000 7f47967d5640 1 -- 172.21.15.104:0/1717311849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4790099a40 msgr2=0x7f4790158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.113+0000 7f47967d5640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4790099a40 0x7f4790158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.113+0000 7f47967d5640 1 -- 172.21.15.104:0/1717311849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47900cf360 msgr2=0x7f47900ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.113+0000 7f47967d5640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47900cf360 0x7f47900ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.113+0000 7f47967d5640 1 -- 172.21.15.104:0/1717311849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47900b6a00 con 0x7f479015f540 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.113+0000 7f4795fd4640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4790099a40 0x7f4790158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.113+0000 7f47957d3640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47900cf360 0x7f47900ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.113+0000 7f47967d5640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f479015f540 0x7f47900c7b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f478800cef0 tx=0x7f478800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.113+0000 7f478e7fc640 1 -- 172.21.15.104:0/1717311849 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478801a070 con 0x7f479015f540 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.113+0000 7f478e7fc640 1 -- 172.21.15.104:0/1717311849 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478800d860 con 0x7f479015f540 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.113+0000 7f4798238640 1 -- 172.21.15.104:0/1717311849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47900b6ce0 con 0x7f479015f540 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.113+0000 7f478e7fc640 1 -- 172.21.15.104:0/1717311849 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478800dc50 con 0x7f479015f540 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.113+0000 7f4798238640 1 -- 172.21.15.104:0/1717311849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47900b72a0 con 0x7f479015f540 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.114+0000 7f4798238640 1 -- 172.21.15.104:0/1717311849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47900b74a0 con 0x7f479015f540 2024-05-08T04:21:54.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.114+0000 7f478e7fc640 1 -- 172.21.15.104:0/1717311849 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f478801d070 con 0x7f479015f540 2024-05-08T04:21:54.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.115+0000 7f478e7fc640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f477c06b4d0 0x7f477c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.115+0000 7f478e7fc640 1 -- 172.21.15.104:0/1717311849 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f478808aa60 con 0x7f479015f540 2024-05-08T04:21:54.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.115+0000 7f4795fd4640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f477c06b4d0 0x7f477c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.115+0000 7f4795fd4640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f477c06b4d0 0x7f477c06d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4780033000 tx=0x7f478002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:54.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.119+0000 7f478e7fc640 1 -- 172.21.15.104:0/1717311849 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f47900b74a0 con 0x7f479015f540 2024-05-08T04:21:54.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.300+0000 7f4798238640 1 -- 172.21.15.104:0/1717311849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4790075010 con 0x7f479015f540 2024-05-08T04:21:54.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.300+0000 7f478e7fc640 1 -- 172.21.15.104:0/1717311849 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4788059a10 con 0x7f479015f540 2024-05-08T04:21:54.303 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:21:54.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.302+0000 7f4798238640 1 -- 172.21.15.104:0/1717311849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f477c06b4d0 msgr2=0x7f477c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.302+0000 7f4798238640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f477c06b4d0 0x7f477c06d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4780033000 tx=0x7f478002e000 comp rx=0 tx=0).stop 2024-05-08T04:21:54.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.302+0000 7f4798238640 1 -- 172.21.15.104:0/1717311849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f479015f540 msgr2=0x7f47900c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.302+0000 7f4798238640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f479015f540 0x7f47900c7b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f478800cef0 tx=0x7f478800a710 comp rx=0 tx=0).stop 2024-05-08T04:21:54.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.303+0000 7f4798238640 1 -- 172.21.15.104:0/1717311849 shutdown_connections 2024-05-08T04:21:54.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.303+0000 7f4798238640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f477c06b4d0 0x7f477c06d990 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.303+0000 7f4798238640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47900cf360 0x7f47900ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.303+0000 7f4798238640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f479015f540 0x7f47900c7b90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.303+0000 7f4798238640 1 --2- 172.21.15.104:0/1717311849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4790099a40 0x7f4790158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.303+0000 7f4798238640 1 -- 172.21.15.104:0/1717311849 >> 172.21.15.104:0/1717311849 conn(0x7f47900b3280 msgr2=0x7f47900afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:54.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.303+0000 7f4798238640 1 -- 172.21.15.104:0/1717311849 shutdown_connections 2024-05-08T04:21:54.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.303+0000 7f4798238640 1 -- 172.21.15.104:0/1717311849 wait complete. 2024-05-08T04:21:54.316 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi183.front.sepia.ceph.com... 2024-05-08T04:21:54.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:54.316 DEBUG:teuthology.orchestra.run.smithi183:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-05-08T04:21:54.347 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:21:54.347 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:21:54.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:21:54.348 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-08T04:21:54.407 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-08T04:21:54.407 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:21:54.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.505+0000 7f40d8563640 1 Processor -- start 2024-05-08T04:21:54.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.505+0000 7f40d8563640 1 -- start start 2024-05-08T04:21:54.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.506+0000 7f40d8563640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40d0070c70 0x7f40d0071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.506+0000 7f40d8563640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f40d0157ac0 0x7f40d0157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.506+0000 7f40d8563640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d0071590 con 0x7f40d015edf0 2024-05-08T04:21:54.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.506+0000 7f40d8563640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d006bc70 con 0x7f40d0157ac0 2024-05-08T04:21:54.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.506+0000 7f40d8563640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00d15c0 con 0x7f40d0070c70 2024-05-08T04:21:54.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.506+0000 7f40d5afe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f40d015edf0 0x7f40d00b52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59702/0 (socket says 172.21.15.104:59702) 2024-05-08T04:21:54.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.506+0000 7f40d5afe640 1 -- 172.21.15.104:0/3871031867 learned_addr learned my addr 172.21.15.104:0/3871031867 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:54.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.506+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702150867 0 0) 0x7f40d0071590 con 0x7f40d015edf0 2024-05-08T04:21:54.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.506+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b8003520 con 0x7f40d015edf0 2024-05-08T04:21:54.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.506+0000 7f40d6b00640 1 --2- 172.21.15.104:0/3871031867 >> v2:172.21.15.183:3300/0 conn(0x7f40d0157ac0 0x7f40d0157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.506+0000 7f40d62ff640 1 --2- 172.21.15.104:0/3871031867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40d0070c70 0x7f40d0071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.506+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3247749637 0 0) 0x7f40b8003520 con 0x7f40d015edf0 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40d0070c70 msgr2=0x7f40d0071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d52fd640 1 --2- 172.21.15.104:0/3871031867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40d0070c70 0x7f40d0071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 >> v2:172.21.15.183:3300/0 conn(0x7f40d0157ac0 msgr2=0x7f40d0157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d52fd640 1 --2- 172.21.15.104:0/3871031867 >> v2:172.21.15.183:3300/0 conn(0x7f40d0157ac0 0x7f40d0157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d015f550 con 0x7f40d015edf0 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f40c4001670 con 0x7f40d015edf0 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 >> v1:172.21.15.104:6789/0 conn(0x7f40d015edf0 legacy=0x7f40d00b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d52fd640 1 --2- 172.21.15.104:0/3871031867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40d0070c70 0x7f40b80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d52fd640 1 --2- 172.21.15.104:0/3871031867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b8003fe0 0x7f40b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d52fd640 1 --2- 172.21.15.104:0/3871031867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b8004d40 0x7f40b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00d15c0 con 0x7f40b8003fe0 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b800ba70 con 0x7f40b8004d40 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b800bc40 con 0x7f40d0070c70 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d5afe640 1 --2- 172.21.15.104:0/3871031867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b8003fe0 0x7f40b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d62ff640 1 --2- 172.21.15.104:0/3871031867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40d0070c70 0x7f40b80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d6b00640 1 --2- 172.21.15.104:0/3871031867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b8004d40 0x7f40b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d5afe640 1 -- 172.21.15.104:0/3871031867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40d0070c70 msgr2=0x7f40b80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d5afe640 1 --2- 172.21.15.104:0/3871031867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40d0070c70 0x7f40b80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d5afe640 1 -- 172.21.15.104:0/3871031867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b8004d40 msgr2=0x7f40b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d5afe640 1 --2- 172.21.15.104:0/3871031867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b8004d40 0x7f40b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d5afe640 1 -- 172.21.15.104:0/3871031867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b8003520 con 0x7f40b8003fe0 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.507+0000 7f40d6b00640 1 --2- 172.21.15.104:0/3871031867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b8004d40 0x7f40b80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.508+0000 7f40d5afe640 1 --2- 172.21.15.104:0/3871031867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b8003fe0 0x7f40b8004800 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f40c4001050 tx=0x7f40b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7a310e986f56c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.508+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4007d70 con 0x7f40b8003fe0 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.508+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4005af0 con 0x7f40b8003fe0 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.508+0000 7f40d52fd640 1 -- 172.21.15.104:0/3871031867 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4007070 con 0x7f40b8003fe0 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.508+0000 7f40d8563640 1 -- 172.21.15.104:0/3871031867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b8003fe0 msgr2=0x7f40b8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.508+0000 7f40d8563640 1 --2- 172.21.15.104:0/3871031867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b8003fe0 0x7f40b8004800 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f40c4001050 tx=0x7f40b8005830 comp rx=0 tx=0).stop 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.508+0000 7f40d6b00640 1 -- 172.21.15.104:0/3871031867 reap_dead start 2024-05-08T04:21:54.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.508+0000 7f40d8563640 1 -- 172.21.15.104:0/3871031867 shutdown_connections 2024-05-08T04:21:54.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.508+0000 7f40d8563640 1 -- 172.21.15.104:0/3871031867 >> 172.21.15.104:0/3871031867 conn(0x7f40d00b3450 msgr2=0x7f40d00b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:54.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.508+0000 7f40d8563640 1 -- 172.21.15.104:0/3871031867 shutdown_connections 2024-05-08T04:21:54.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.508+0000 7f40d8563640 1 -- 172.21.15.104:0/3871031867 wait complete. 2024-05-08T04:21:54.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.510+0000 7f40d8563640 1 Processor -- start 2024-05-08T04:21:54.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.510+0000 7f40d8563640 1 -- start start 2024-05-08T04:21:54.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.510+0000 7f40d8563640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b8003fe0 0x7f40d014a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.510+0000 7f40d8563640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40d015ada0 0x7f40d00cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.510+0000 7f40d8563640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40d015b220 0x7f40d014aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.510+0000 7f40d8563640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00b5b80 con 0x7f40d015b220 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.510+0000 7f40d8563640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d015fb10 con 0x7f40b8003fe0 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.510+0000 7f40d8563640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d0158490 con 0x7f40d015ada0 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40d6b00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40d015b220 0x7f40d014aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40d6b00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40d015b220 0x7f40d014aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52268/0 (socket says 172.21.15.104:52268) 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40d6b00640 1 -- 172.21.15.104:0/3822773162 learned_addr learned my addr 172.21.15.104:0/3822773162 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40d5afe640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40d015ada0 0x7f40d00cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40d62ff640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b8003fe0 0x7f40d014a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40d6b00640 1 -- 172.21.15.104:0/3822773162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40d015ada0 msgr2=0x7f40d00cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40d6b00640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40d015ada0 0x7f40d00cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40d6b00640 1 -- 172.21.15.104:0/3822773162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b8003fe0 msgr2=0x7f40d014a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40d6b00640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b8003fe0 0x7f40d014a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40d6b00640 1 -- 172.21.15.104:0/3822773162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d014a810 con 0x7f40d015b220 2024-05-08T04:21:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40d6b00640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40d015b220 0x7f40d014aaf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f40d0073360 tx=0x7f40c8004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:54.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40ceffd640 1 -- 172.21.15.104:0/3822773162 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8007d00 con 0x7f40d015b220 2024-05-08T04:21:54.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40ceffd640 1 -- 172.21.15.104:0/3822773162 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c8019070 con 0x7f40d015b220 2024-05-08T04:21:54.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40d8563640 1 -- 172.21.15.104:0/3822773162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d0159d00 con 0x7f40d015b220 2024-05-08T04:21:54.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40ceffd640 1 -- 172.21.15.104:0/3822773162 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8014650 con 0x7f40d015b220 2024-05-08T04:21:54.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.511+0000 7f40d8563640 1 -- 172.21.15.104:0/3822773162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d015a2c0 con 0x7f40d015b220 2024-05-08T04:21:54.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.512+0000 7f40d8563640 1 -- 172.21.15.104:0/3822773162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d0075010 con 0x7f40d015b220 2024-05-08T04:21:54.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.513+0000 7f40ceffd640 1 -- 172.21.15.104:0/3822773162 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f40c80147f0 con 0x7f40d015b220 2024-05-08T04:21:54.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.513+0000 7f40ceffd640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f40bc06b4d0 0x7f40bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.514+0000 7f40d62ff640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f40bc06b4d0 0x7f40bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.514+0000 7f40ceffd640 1 -- 172.21.15.104:0/3822773162 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f40c808a780 con 0x7f40d015b220 2024-05-08T04:21:54.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.514+0000 7f40d62ff640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f40bc06b4d0 0x7f40bc06d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f40c0006fd0 tx=0x7f40c0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:54.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.518+0000 7f40ceffd640 1 -- 172.21.15.104:0/3822773162 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f40d014a810 con 0x7f40d015b220 2024-05-08T04:21:54.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.725+0000 7f40d8563640 1 -- 172.21.15.104:0/3822773162 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40d00b10a0 con 0x7f40d015b220 2024-05-08T04:21:54.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.725+0000 7f40ceffd640 1 -- 172.21.15.104:0/3822773162 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f40c80595e0 con 0x7f40d015b220 2024-05-08T04:21:54.728 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:54.728 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/446112297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":446112297},{"type":"v1","addr":"172.21.15.183:6834","nonce":446112297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/702726775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":702726775},{"type":"v1","addr":"172.21.15.183:6835","nonce":702726775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/1820805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1820805788},{"type":"v1","addr":"172.21.15.104:6836","nonce":1820805788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:21:10.133307+0000","modified":"2024-05-08T04:21:12.575912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/610189872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":610189872},{"type":"v1","addr":"172.21.15.104:6837","nonce":610189872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T04:21:54.728 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-05-08T04:21:54.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.727+0000 7f40d8563640 1 -- 172.21.15.104:0/3822773162 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f40bc06b4d0 msgr2=0x7f40bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.727+0000 7f40d8563640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f40bc06b4d0 0x7f40bc06d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f40c0006fd0 tx=0x7f40c0008040 comp rx=0 tx=0).stop 2024-05-08T04:21:54.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.727+0000 7f40d8563640 1 -- 172.21.15.104:0/3822773162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40d015b220 msgr2=0x7f40d014aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.727+0000 7f40d8563640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40d015b220 0x7f40d014aaf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f40d0073360 tx=0x7f40c8004840 comp rx=0 tx=0).stop 2024-05-08T04:21:54.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.727+0000 7f40d8563640 1 -- 172.21.15.104:0/3822773162 shutdown_connections 2024-05-08T04:21:54.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.727+0000 7f40d8563640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f40bc06b4d0 0x7f40bc06d990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.727+0000 7f40d8563640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40d015b220 0x7f40d014aaf0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.727+0000 7f40d8563640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40d015ada0 0x7f40d00cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.727+0000 7f40d8563640 1 --2- 172.21.15.104:0/3822773162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f40b8003fe0 0x7f40d014a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.727+0000 7f40d8563640 1 -- 172.21.15.104:0/3822773162 >> 172.21.15.104:0/3822773162 conn(0x7f40d00b3450 msgr2=0x7f40d00d0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:54.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.727+0000 7f40d8563640 1 -- 172.21.15.104:0/3822773162 shutdown_connections 2024-05-08T04:21:54.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.727+0000 7f40d8563640 1 -- 172.21.15.104:0/3822773162 wait complete. 2024-05-08T04:21:54.741 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:54.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.838+0000 7f7c9bdc1640 1 Processor -- start 2024-05-08T04:21:54.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.838+0000 7f7c9bdc1640 1 -- start start 2024-05-08T04:21:54.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.839+0000 7f7c9bdc1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7c94070c70 0x7f7c94071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.839+0000 7f7c9bdc1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c94157ac0 0x7f7c94157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.839+0000 7f7c9bdc1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c94071590 con 0x7f7c9415edf0 2024-05-08T04:21:54.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.839+0000 7f7c9bdc1640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9406bc70 con 0x7f7c94070c70 2024-05-08T04:21:54.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.839+0000 7f7c9bdc1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940d15c0 con 0x7f7c94157ac0 2024-05-08T04:21:54.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.839+0000 7f7c99b5d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7c94070c70 0x7f7c94071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.839+0000 7f7c99b5d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7c94070c70 0x7f7c94071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52276/0 (socket says 172.21.15.104:52276) 2024-05-08T04:21:54.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.839+0000 7f7c99b5d640 1 -- 172.21.15.104:0/1462454107 learned_addr learned my addr 172.21.15.104:0/1462454107 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:54.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.839+0000 7f7c9a35e640 1 --2- 172.21.15.104:0/1462454107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c94157ac0 0x7f7c94157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.839+0000 7f7c99b5d640 1 -- 172.21.15.104:0/1462454107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c94157ac0 msgr2=0x7f7c94157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:54.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.839+0000 7f7c99b5d640 1 --2- 172.21.15.104:0/1462454107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c94157ac0 0x7f7c94157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.839+0000 7f7c99b5d640 1 -- 172.21.15.104:0/1462454107 >> v1:172.21.15.183:6789/0 conn(0x7f7c9415edf0 legacy=0x7f7c940b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.840+0000 7f7c99b5d640 1 -- 172.21.15.104:0/1462454107 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9415f550 con 0x7f7c94070c70 2024-05-08T04:21:54.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.840+0000 7f7c99b5d640 1 --2- 172.21.15.104:0/1462454107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c94070c70 0x7f7c94071050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009e50 tx=0x7f7c8402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69febe7c7f1e7a75 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:54.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.840+0000 7f7c98b5b640 1 -- 172.21.15.104:0/1462454107 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84036070 con 0x7f7c94070c70 2024-05-08T04:21:54.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.840+0000 7f7c98b5b640 1 -- 172.21.15.104:0/1462454107 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c84031600 con 0x7f7c94070c70 2024-05-08T04:21:54.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.840+0000 7f7c98b5b640 1 -- 172.21.15.104:0/1462454107 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c840319d0 con 0x7f7c94070c70 2024-05-08T04:21:54.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.841+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/1462454107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c94070c70 msgr2=0x7f7c94071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.841+0000 7f7c9bdc1640 1 --2- 172.21.15.104:0/1462454107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c94070c70 0x7f7c94071050 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009e50 tx=0x7f7c8402a710 comp rx=0 tx=0).stop 2024-05-08T04:21:54.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.841+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/1462454107 shutdown_connections 2024-05-08T04:21:54.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.841+0000 7f7c9bdc1640 1 --2- 172.21.15.104:0/1462454107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c94157ac0 0x7f7c94157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.841+0000 7f7c9bdc1640 1 --2- 172.21.15.104:0/1462454107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c94070c70 0x7f7c94071050 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.841+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/1462454107 >> 172.21.15.104:0/1462454107 conn(0x7f7c940b3450 msgr2=0x7f7c940b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:54.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.841+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/1462454107 shutdown_connections 2024-05-08T04:21:54.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.841+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/1462454107 wait complete. 2024-05-08T04:21:54.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.842+0000 7f7c9bdc1640 1 Processor -- start 2024-05-08T04:21:54.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.842+0000 7f7c9bdc1640 1 -- start start 2024-05-08T04:21:54.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9bdc1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c94070c70 0x7f7c9414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9bdc1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c94157ac0 0x7f7c940cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9bdc1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9415edf0 0x7f7c940cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9bdc1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940b5b80 con 0x7f7c94157ac0 2024-05-08T04:21:54.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9bdc1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9415fb10 con 0x7f7c9415edf0 2024-05-08T04:21:54.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9bdc1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94158490 con 0x7f7c94070c70 2024-05-08T04:21:54.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9935c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c94157ac0 0x7f7c940cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9935c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c94157ac0 0x7f7c940cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52280/0 (socket says 172.21.15.104:52280) 2024-05-08T04:21:54.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9935c640 1 -- 172.21.15.104:0/3014049252 learned_addr learned my addr 172.21.15.104:0/3014049252 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:54.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c99b5d640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c94070c70 0x7f7c9414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9a35e640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9415edf0 0x7f7c940cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9935c640 1 -- 172.21.15.104:0/3014049252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c94070c70 msgr2=0x7f7c9414f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9935c640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c94070c70 0x7f7c9414f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9935c640 1 -- 172.21.15.104:0/3014049252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9415edf0 msgr2=0x7f7c940cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:54.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9935c640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9415edf0 0x7f7c940cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:54.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9935c640 1 -- 172.21.15.104:0/3014049252 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940b1510 con 0x7f7c94157ac0 2024-05-08T04:21:54.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c99b5d640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c94070c70 0x7f7c9414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:54.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.843+0000 7f7c9935c640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c94157ac0 0x7f7c940cf8a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800c440 tx=0x7f7c8800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:54.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.844+0000 7f7c927fc640 1 -- 172.21.15.104:0/3014049252 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c880052d0 con 0x7f7c94157ac0 2024-05-08T04:21:54.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.844+0000 7f7c927fc640 1 -- 172.21.15.104:0/3014049252 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88005470 con 0x7f7c94157ac0 2024-05-08T04:21:54.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.844+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/3014049252 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c940b17f0 con 0x7f7c94157ac0 2024-05-08T04:21:54.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.844+0000 7f7c927fc640 1 -- 172.21.15.104:0/3014049252 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88007260 con 0x7f7c94157ac0 2024-05-08T04:21:54.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.844+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/3014049252 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c940b1db0 con 0x7f7c94157ac0 2024-05-08T04:21:54.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.845+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/3014049252 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9406c510 con 0x7f7c94157ac0 2024-05-08T04:21:54.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.845+0000 7f7c927fc640 1 -- 172.21.15.104:0/3014049252 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c880074c0 con 0x7f7c94157ac0 2024-05-08T04:21:54.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.846+0000 7f7c927fc640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c8006b4d0 0x7f7c8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:54.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.846+0000 7f7c927fc640 1 -- 172.21.15.104:0/3014049252 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7c880896a0 con 0x7f7c94157ac0 2024-05-08T04:21:54.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.846+0000 7f7c99b5d640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c8006b4d0 0x7f7c8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:54.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.846+0000 7f7c99b5d640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c8006b4d0 0x7f7c8006d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7c84033000 tx=0x7f7c84009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:54.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:54.850+0000 7f7c927fc640 1 -- 172.21.15.104:0/3014049252 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c9406c510 con 0x7f7c94157ac0 2024-05-08T04:21:55.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.025+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/3014049252 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c94075010 con 0x7f7c94157ac0 2024-05-08T04:21:55.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.026+0000 7f7c927fc640 1 -- 172.21.15.104:0/3014049252 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16718 (secure 0 0 0) 0x7f7c88058500 con 0x7f7c94157ac0 2024-05-08T04:21:55.029 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:55.029 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:53.967875+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:55.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.028+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/3014049252 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c8006b4d0 msgr2=0x7f7c8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.028+0000 7f7c9bdc1640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c8006b4d0 0x7f7c8006d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7c84033000 tx=0x7f7c84009000 comp rx=0 tx=0).stop 2024-05-08T04:21:55.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.028+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/3014049252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c94157ac0 msgr2=0x7f7c940cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.028+0000 7f7c9bdc1640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c94157ac0 0x7f7c940cf8a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800c440 tx=0x7f7c8800c900 comp rx=0 tx=0).stop 2024-05-08T04:21:55.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.029+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/3014049252 shutdown_connections 2024-05-08T04:21:55.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.029+0000 7f7c9bdc1640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c8006b4d0 0x7f7c8006d990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.029+0000 7f7c9bdc1640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9415edf0 0x7f7c940cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.029+0000 7f7c9bdc1640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c94157ac0 0x7f7c940cf8a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.029+0000 7f7c9bdc1640 1 --2- 172.21.15.104:0/3014049252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c94070c70 0x7f7c9414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.029+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/3014049252 >> 172.21.15.104:0/3014049252 conn(0x7f7c940b3450 msgr2=0x7f7c9406be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:55.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.029+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/3014049252 shutdown_connections 2024-05-08T04:21:55.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.029+0000 7f7c9bdc1640 1 -- 172.21.15.104:0/3014049252 wait complete. 2024-05-08T04:21:55.042 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:21:08.633944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:21:09.101547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:21:55.043 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:21:55.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.143+0000 7fcd9e589640 1 Processor -- start 2024-05-08T04:21:55.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.143+0000 7fcd9e589640 1 -- start start 2024-05-08T04:21:55.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.144+0000 7fcd9e589640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcd9815de20 0x7fcd980b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.144+0000 7fcd9e589640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd980cd7a0 con 0x7fcd980d0150 2024-05-08T04:21:55.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.144+0000 7fcd9e589640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd980cda80 con 0x7fcd980b1d50 2024-05-08T04:21:55.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.144+0000 7fcd9e589640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd980caf50 con 0x7fcd9815de20 2024-05-08T04:21:55.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.144+0000 7fcd97fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcd9815de20 0x7fcd980b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.144+0000 7fcd9cb26640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fcd980d0150 0x7fcd980cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59708/0 (socket says 172.21.15.104:59708) 2024-05-08T04:21:55.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.144+0000 7fcd9cb26640 1 -- 172.21.15.104:0/3399428979 learned_addr learned my addr 172.21.15.104:0/3399428979 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:55.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.144+0000 7fcd97fff640 1 -- 172.21.15.104:0/3399428979 >> v1:172.21.15.183:6789/0 conn(0x7fcd980b1d50 legacy=0x7fcd980cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:55.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.144+0000 7fcd97fff640 1 -- 172.21.15.104:0/3399428979 >> v1:172.21.15.104:6789/0 conn(0x7fcd980d0150 legacy=0x7fcd980cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.144+0000 7fcd97fff640 1 -- 172.21.15.104:0/3399428979 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd980cdd60 con 0x7fcd9815de20 2024-05-08T04:21:55.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.144+0000 7fcd96ffd640 1 -- 172.21.15.104:0/3399428979 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959620456 0 0) 0x7fcd980cd7a0 con 0x7fcd980d0150 2024-05-08T04:21:55.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.145+0000 7fcd97fff640 1 --2- 172.21.15.104:0/3399428979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9815de20 0x7fcd980b1810 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcd880097a0 tx=0x7fcd8802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81053c6c79710b1a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:55.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.145+0000 7fcd96ffd640 1 -- 172.21.15.104:0/3399428979 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88037070 con 0x7fcd9815de20 2024-05-08T04:21:55.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.145+0000 7fcd96ffd640 1 -- 172.21.15.104:0/3399428979 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd88032440 con 0x7fcd9815de20 2024-05-08T04:21:55.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.145+0000 7fcd96ffd640 1 -- 172.21.15.104:0/3399428979 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88032810 con 0x7fcd9815de20 2024-05-08T04:21:55.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.146+0000 7fcd9e589640 1 -- 172.21.15.104:0/3399428979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9815de20 msgr2=0x7fcd980b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.146+0000 7fcd9e589640 1 --2- 172.21.15.104:0/3399428979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9815de20 0x7fcd980b1810 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcd880097a0 tx=0x7fcd8802a1e0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.146+0000 7fcd9e589640 1 -- 172.21.15.104:0/3399428979 shutdown_connections 2024-05-08T04:21:55.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.146+0000 7fcd9e589640 1 --2- 172.21.15.104:0/3399428979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd9815de20 0x7fcd980b1810 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.146+0000 7fcd9e589640 1 -- 172.21.15.104:0/3399428979 >> 172.21.15.104:0/3399428979 conn(0x7fcd980b2220 msgr2=0x7fcd980b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:55.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.146+0000 7fcd9e589640 1 -- 172.21.15.104:0/3399428979 shutdown_connections 2024-05-08T04:21:55.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.146+0000 7fcd9e589640 1 -- 172.21.15.104:0/3399428979 wait complete. 2024-05-08T04:21:55.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.147+0000 7fcd9e589640 1 Processor -- start 2024-05-08T04:21:55.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.147+0000 7fcd9e589640 1 -- start start 2024-05-08T04:21:55.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd9e589640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd980b1d50 0x7fcd980ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd9e589640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd980d0150 0x7fcd980c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd9e589640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd9815de20 0x7fcd980d0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd9e589640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9815e380 con 0x7fcd980b1d50 2024-05-08T04:21:55.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd9e589640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9815e200 con 0x7fcd980d0150 2024-05-08T04:21:55.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd9e589640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd980cbaf0 con 0x7fcd9815de20 2024-05-08T04:21:55.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd97fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd980b1d50 0x7fcd980ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd97fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd980b1d50 0x7fcd980ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52306/0 (socket says 172.21.15.104:52306) 2024-05-08T04:21:55.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd97fff640 1 -- 172.21.15.104:0/1384631534 learned_addr learned my addr 172.21.15.104:0/1384631534 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:55.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd977fe640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd980d0150 0x7fcd980c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd9cb26640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd9815de20 0x7fcd980d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd97fff640 1 -- 172.21.15.104:0/1384631534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd9815de20 msgr2=0x7fcd980d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd97fff640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd9815de20 0x7fcd980d0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd97fff640 1 -- 172.21.15.104:0/1384631534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd980d0150 msgr2=0x7fcd980c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd97fff640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd980d0150 0x7fcd980c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd97fff640 1 -- 172.21.15.104:0/1384631534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9814e6a0 con 0x7fcd980b1d50 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.148+0000 7fcd97fff640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd980b1d50 0x7fcd980ca1c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcd880097a0 tx=0x7fcd880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.149+0000 7fcd94ff9640 1 -- 172.21.15.104:0/1384631534 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88041070 con 0x7fcd980b1d50 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.149+0000 7fcd94ff9640 1 -- 172.21.15.104:0/1384631534 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8803c870 con 0x7fcd980b1d50 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.149+0000 7fcd9e589640 1 -- 172.21.15.104:0/1384631534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9814e120 con 0x7fcd980b1d50 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.149+0000 7fcd94ff9640 1 -- 172.21.15.104:0/1384631534 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88037040 con 0x7fcd980b1d50 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.149+0000 7fcd9e589640 1 -- 172.21.15.104:0/1384631534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd980c7410 con 0x7fcd980b1d50 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.150+0000 7fcd9e589640 1 -- 172.21.15.104:0/1384631534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9814e420 con 0x7fcd980b1d50 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.150+0000 7fcd94ff9640 1 -- 172.21.15.104:0/1384631534 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd88044070 con 0x7fcd980b1d50 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.151+0000 7fcd94ff9640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd8406b4d0 0x7fcd8406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.151+0000 7fcd977fe640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd8406b4d0 0x7fcd8406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.151+0000 7fcd94ff9640 1 -- 172.21.15.104:0/1384631534 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcd880aae10 con 0x7fcd980b1d50 2024-05-08T04:21:55.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.151+0000 7fcd977fe640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd8406b4d0 0x7fcd8406d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcd980b00a0 tx=0x7fcd8c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:55.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.155+0000 7fcd94ff9640 1 -- 172.21.15.104:0/1384631534 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd9814e420 con 0x7fcd980b1d50 2024-05-08T04:21:55.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.324+0000 7fcd9e589640 1 -- 172.21.15.104:0/1384631534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd980cd830 con 0x7fcd980b1d50 2024-05-08T04:21:55.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.325+0000 7fcd94ff9640 1 -- 172.21.15.104:0/1384631534 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd88079e20 con 0x7fcd980b1d50 2024-05-08T04:21:55.327 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:21:55.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.327+0000 7fcd9e589640 1 -- 172.21.15.104:0/1384631534 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd8406b4d0 msgr2=0x7fcd8406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.327+0000 7fcd9e589640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd8406b4d0 0x7fcd8406d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcd980b00a0 tx=0x7fcd8c009040 comp rx=0 tx=0).stop 2024-05-08T04:21:55.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.327+0000 7fcd9e589640 1 -- 172.21.15.104:0/1384631534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd980b1d50 msgr2=0x7fcd980ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.327+0000 7fcd9e589640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd980b1d50 0x7fcd980ca1c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcd880097a0 tx=0x7fcd880046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.327+0000 7fcd9e589640 1 -- 172.21.15.104:0/1384631534 shutdown_connections 2024-05-08T04:21:55.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.327+0000 7fcd9e589640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd8406b4d0 0x7fcd8406d990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.327+0000 7fcd9e589640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd980d0150 0x7fcd980c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.327+0000 7fcd9e589640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd9815de20 0x7fcd980d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.327+0000 7fcd9e589640 1 --2- 172.21.15.104:0/1384631534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd980b1d50 0x7fcd980ca1c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.327+0000 7fcd9e589640 1 -- 172.21.15.104:0/1384631534 >> 172.21.15.104:0/1384631534 conn(0x7fcd980b2220 msgr2=0x7fcd980b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:55.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.327+0000 7fcd9e589640 1 -- 172.21.15.104:0/1384631534 shutdown_connections 2024-05-08T04:21:55.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.327+0000 7fcd9e589640 1 -- 172.21.15.104:0/1384631534 wait complete. 2024-05-08T04:21:55.340 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:21:55.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.441+0000 7fa566534640 1 Processor -- start 2024-05-08T04:21:55.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.441+0000 7fa566534640 1 -- start start 2024-05-08T04:21:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa566534640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa5600cfa40 0x7fa5600cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa566534640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5600cd7a0 con 0x7fa56015de20 2024-05-08T04:21:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa566534640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5600cda80 con 0x7fa5600cb3e0 2024-05-08T04:21:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa566534640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5600caf50 con 0x7fa5600cfa40 2024-05-08T04:21:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa55ffff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fa56015de20 0x7fa5600b1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59720/0 (socket says 172.21.15.104:59720) 2024-05-08T04:21:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa55ffff640 1 -- 172.21.15.104:0/2423398715 learned_addr learned my addr 172.21.15.104:0/2423398715 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500721801 0 0) 0x7fa5600cd7a0 con 0x7fa56015de20 2024-05-08T04:21:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa548003520 con 0x7fa56015de20 2024-05-08T04:21:55.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa55f7fe640 1 --2- 172.21.15.104:0/2423398715 >> v2:172.21.15.183:3300/0 conn(0x7fa5600cfa40 0x7fa5600cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3073481521 0 0) 0x7fa548003520 con 0x7fa56015de20 2024-05-08T04:21:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 >> v2:172.21.15.183:3300/0 conn(0x7fa5600cfa40 msgr2=0x7fa5600cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa55effd640 1 --2- 172.21.15.104:0/2423398715 >> v2:172.21.15.183:3300/0 conn(0x7fa5600cfa40 0x7fa5600cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 >> v1:172.21.15.183:6789/0 conn(0x7fa5600cb3e0 legacy=0x7fa5600cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5600cdd60 con 0x7fa56015de20 2024-05-08T04:21:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fa550001670 con 0x7fa56015de20 2024-05-08T04:21:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.442+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 >> v1:172.21.15.104:6789/0 conn(0x7fa56015de20 legacy=0x7fa5600b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa55effd640 1 --2- 172.21.15.104:0/2423398715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5480039b0 0x7fa548003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa55effd640 1 --2- 172.21.15.104:0/2423398715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa548004800 0x7fa548004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa55effd640 1 --2- 172.21.15.104:0/2423398715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5480051c0 0x7fa54800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600caf50 con 0x7fa5480051c0 2024-05-08T04:21:55.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54800c060 con 0x7fa548004800 2024-05-08T04:21:55.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54800c260 con 0x7fa5480039b0 2024-05-08T04:21:55.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa564ad1640 1 --2- 172.21.15.104:0/2423398715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5480051c0 0x7fa54800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa55f7fe640 1 --2- 172.21.15.104:0/2423398715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa548004800 0x7fa548004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa55ffff640 1 --2- 172.21.15.104:0/2423398715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5480039b0 0x7fa548003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa564ad1640 1 -- 172.21.15.104:0/2423398715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5480039b0 msgr2=0x7fa548003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:55.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa564ad1640 1 --2- 172.21.15.104:0/2423398715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5480039b0 0x7fa548003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa564ad1640 1 -- 172.21.15.104:0/2423398715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa548004800 msgr2=0x7fa548004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:55.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa564ad1640 1 --2- 172.21.15.104:0/2423398715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa548004800 0x7fa548004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.443+0000 7fa564ad1640 1 -- 172.21.15.104:0/2423398715 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa548003520 con 0x7fa5480051c0 2024-05-08T04:21:55.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.444+0000 7fa564ad1640 1 -- 172.21.15.104:0/2423398715 reap_dead start 2024-05-08T04:21:55.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.444+0000 7fa564ad1640 1 --2- 172.21.15.104:0/2423398715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5480051c0 0x7fa54800b9c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa558001e50 tx=0x7fa548005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a6ce8cebea90f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:55.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.444+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558001a70 con 0x7fa5480051c0 2024-05-08T04:21:55.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.444+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa558003970 con 0x7fa5480051c0 2024-05-08T04:21:55.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.444+0000 7fa55effd640 1 -- 172.21.15.104:0/2423398715 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558003d60 con 0x7fa5480051c0 2024-05-08T04:21:55.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.444+0000 7fa566534640 1 -- 172.21.15.104:0/2423398715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5480051c0 msgr2=0x7fa54800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.444+0000 7fa566534640 1 --2- 172.21.15.104:0/2423398715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5480051c0 0x7fa54800b9c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa558001e50 tx=0x7fa548005830 comp rx=0 tx=0).stop 2024-05-08T04:21:55.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.444+0000 7fa566534640 1 -- 172.21.15.104:0/2423398715 shutdown_connections 2024-05-08T04:21:55.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.444+0000 7fa566534640 1 --2- 172.21.15.104:0/2423398715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5480051c0 0x7fa54800b9c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.444+0000 7fa566534640 1 -- 172.21.15.104:0/2423398715 >> 172.21.15.104:0/2423398715 conn(0x7fa5600b2220 msgr2=0x7fa5600b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:55.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.444+0000 7fa566534640 1 -- 172.21.15.104:0/2423398715 shutdown_connections 2024-05-08T04:21:55.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.444+0000 7fa566534640 1 -- 172.21.15.104:0/2423398715 wait complete. 2024-05-08T04:21:55.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.445+0000 7fa566534640 1 Processor -- start 2024-05-08T04:21:55.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.446+0000 7fa566534640 1 -- start start 2024-05-08T04:21:55.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.446+0000 7fa566534640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5480051c0 0x7fa5600c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.446+0000 7fa566534640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5600b3350 0x7fa5601f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.446+0000 7fa566534640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5600b5e80 0x7fa5601f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.446+0000 7fa566534640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56015e380 con 0x7fa5600b5e80 2024-05-08T04:21:55.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.446+0000 7fa566534640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56015e200 con 0x7fa5600b3350 2024-05-08T04:21:55.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.446+0000 7fa566534640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600cfed0 con 0x7fa5480051c0 2024-05-08T04:21:55.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.446+0000 7fa564ad1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5600b5e80 0x7fa5601f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa564ad1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5600b5e80 0x7fa5601f40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52318/0 (socket says 172.21.15.104:52318) 2024-05-08T04:21:55.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa564ad1640 1 -- 172.21.15.104:0/1165967576 learned_addr learned my addr 172.21.15.104:0/1165967576 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:55.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa55f7fe640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5600b3350 0x7fa5601f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa55ffff640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5480051c0 0x7fa5600c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa564ad1640 1 -- 172.21.15.104:0/1165967576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5480051c0 msgr2=0x7fa5600c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa564ad1640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5480051c0 0x7fa5600c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa564ad1640 1 -- 172.21.15.104:0/1165967576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5600b3350 msgr2=0x7fa5601f3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa564ad1640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5600b3350 0x7fa5601f3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa564ad1640 1 -- 172.21.15.104:0/1165967576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5600c8850 con 0x7fa5600b5e80 2024-05-08T04:21:55.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa564ad1640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5600b5e80 0x7fa5601f40b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa558001f40 tx=0x7fa5580014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:55.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa55cff9640 1 -- 172.21.15.104:0/1165967576 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558007db0 con 0x7fa5600b5e80 2024-05-08T04:21:55.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa55cff9640 1 -- 172.21.15.104:0/1165967576 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55802ac70 con 0x7fa5600b5e80 2024-05-08T04:21:55.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa566534640 1 -- 172.21.15.104:0/1165967576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5600c6f30 con 0x7fa5600b5e80 2024-05-08T04:21:55.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa55cff9640 1 -- 172.21.15.104:0/1165967576 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558001a70 con 0x7fa5600b5e80 2024-05-08T04:21:55.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.447+0000 7fa566534640 1 -- 172.21.15.104:0/1165967576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5600c8da0 con 0x7fa5600b5e80 2024-05-08T04:21:55.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.448+0000 7fa566534640 1 -- 172.21.15.104:0/1165967576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5600c8fa0 con 0x7fa5600b5e80 2024-05-08T04:21:55.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.449+0000 7fa55cff9640 1 -- 172.21.15.104:0/1165967576 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa558007030 con 0x7fa5600b5e80 2024-05-08T04:21:55.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.449+0000 7fa55cff9640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa54c06b500 0x7fa54c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.449+0000 7fa55ffff640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa54c06b500 0x7fa54c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.449+0000 7fa55cff9640 1 -- 172.21.15.104:0/1165967576 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa5580a9440 con 0x7fa5600b5e80 2024-05-08T04:21:55.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.450+0000 7fa55ffff640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa54c06b500 0x7fa54c06d9c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa560067e10 tx=0x7fa550001150 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:55.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.453+0000 7fa55cff9640 1 -- 172.21.15.104:0/1165967576 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5600c8fa0 con 0x7fa5600b5e80 2024-05-08T04:21:55.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.621+0000 7fa566534640 1 -- 172.21.15.104:0/1165967576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa560075010 con 0x7fa5600b5e80 2024-05-08T04:21:55.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.622+0000 7fa55cff9640 1 -- 172.21.15.104:0/1165967576 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa558043060 con 0x7fa5600b5e80 2024-05-08T04:21:55.626 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:21:55.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.624+0000 7fa566534640 1 -- 172.21.15.104:0/1165967576 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa54c06b500 msgr2=0x7fa54c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.624+0000 7fa566534640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa54c06b500 0x7fa54c06d9c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa560067e10 tx=0x7fa550001150 comp rx=0 tx=0).stop 2024-05-08T04:21:55.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.624+0000 7fa566534640 1 -- 172.21.15.104:0/1165967576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5600b5e80 msgr2=0x7fa5601f40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.624+0000 7fa566534640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5600b5e80 0x7fa5601f40b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa558001f40 tx=0x7fa5580014a0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.624+0000 7fa566534640 1 -- 172.21.15.104:0/1165967576 shutdown_connections 2024-05-08T04:21:55.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.624+0000 7fa566534640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa54c06b500 0x7fa54c06d9c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.624+0000 7fa566534640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5600b3350 0x7fa5601f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.624+0000 7fa566534640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa5600b5e80 0x7fa5601f40b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.624+0000 7fa566534640 1 --2- 172.21.15.104:0/1165967576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5480051c0 0x7fa5600c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.624+0000 7fa566534640 1 -- 172.21.15.104:0/1165967576 >> 172.21.15.104:0/1165967576 conn(0x7fa5600b2220 msgr2=0x7fa56006f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:55.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.624+0000 7fa566534640 1 -- 172.21.15.104:0/1165967576 shutdown_connections 2024-05-08T04:21:55.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.624+0000 7fa566534640 1 -- 172.21.15.104:0/1165967576 wait complete. 2024-05-08T04:21:55.637 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:21:55.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.738+0000 7f9181c4d640 1 Processor -- start 2024-05-08T04:21:55.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.738+0000 7f9181c4d640 1 -- start start 2024-05-08T04:21:55.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.739+0000 7f9181c4d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f917c0b2b80 0x7f917c09a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.739+0000 7f9181c4d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917c099a40 0x7f917c099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.739+0000 7f9181c4d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c0cd940 con 0x7f917c15d490 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.739+0000 7f9181c4d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c09a3e0 con 0x7f917c0b2b80 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.739+0000 7f9181c4d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0cc8a0 con 0x7f917c099a40 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.739+0000 7f917b7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f917c0b2b80 0x7f917c09a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.739+0000 7f917b7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f917c0b2b80 0x7f917c09a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52332/0 (socket says 172.21.15.104:52332) 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.739+0000 7f917b7fe640 1 -- 172.21.15.104:0/3893642775 learned_addr learned my addr 172.21.15.104:0/3893642775 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.740+0000 7f9173fff640 1 --2- 172.21.15.104:0/3893642775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917c099a40 0x7f917c099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.740+0000 7f917b7fe640 1 -- 172.21.15.104:0/3893642775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917c099a40 msgr2=0x7f917c099ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.740+0000 7f917b7fe640 1 --2- 172.21.15.104:0/3893642775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917c099a40 0x7f917c099ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.740+0000 7f917b7fe640 1 -- 172.21.15.104:0/3893642775 >> v1:172.21.15.183:6789/0 conn(0x7f917c15d490 legacy=0x7f917c15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.740+0000 7f917b7fe640 1 -- 172.21.15.104:0/3893642775 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c0ccb80 con 0x7f917c0b2b80 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.740+0000 7f917b7fe640 1 --2- 172.21.15.104:0/3893642775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917c0b2b80 0x7f917c09a9b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f916c009870 tx=0x7f916c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedc6b7676b88b50 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.741+0000 7f917affd640 1 -- 172.21.15.104:0/3893642775 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c037070 con 0x7f917c0b2b80 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.741+0000 7f917affd640 1 -- 172.21.15.104:0/3893642775 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c02ae50 con 0x7f917c0b2b80 2024-05-08T04:21:55.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.741+0000 7f917affd640 1 -- 172.21.15.104:0/3893642775 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c032860 con 0x7f917c0b2b80 2024-05-08T04:21:55.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.741+0000 7f9181c4d640 1 -- 172.21.15.104:0/3893642775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917c0b2b80 msgr2=0x7f917c09a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.741+0000 7f9181c4d640 1 --2- 172.21.15.104:0/3893642775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917c0b2b80 0x7f917c09a9b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f916c009870 tx=0x7f916c02a300 comp rx=0 tx=0).stop 2024-05-08T04:21:55.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.741+0000 7f9181c4d640 1 -- 172.21.15.104:0/3893642775 shutdown_connections 2024-05-08T04:21:55.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.741+0000 7f9181c4d640 1 --2- 172.21.15.104:0/3893642775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917c099a40 0x7f917c099ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.741+0000 7f9181c4d640 1 --2- 172.21.15.104:0/3893642775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917c0b2b80 0x7f917c09a9b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.741+0000 7f9181c4d640 1 -- 172.21.15.104:0/3893642775 >> 172.21.15.104:0/3893642775 conn(0x7f917c0b3310 msgr2=0x7f917c0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:55.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.741+0000 7f9181c4d640 1 -- 172.21.15.104:0/3893642775 shutdown_connections 2024-05-08T04:21:55.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.741+0000 7f9181c4d640 1 -- 172.21.15.104:0/3893642775 wait complete. 2024-05-08T04:21:55.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.742+0000 7f9181c4d640 1 Processor -- start 2024-05-08T04:21:55.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.742+0000 7f9181c4d640 1 -- start start 2024-05-08T04:21:55.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.743+0000 7f9181c4d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917c099a40 0x7f917c1590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.743+0000 7f9181c4d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917c0b2b80 0x7f917c0c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.743+0000 7f9181c4d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f917c15d490 0x7f917c06cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.743+0000 7f9181c4d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c09aef0 con 0x7f917c0b2b80 2024-05-08T04:21:55.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.743+0000 7f9181c4d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0cd140 con 0x7f917c15d490 2024-05-08T04:21:55.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.743+0000 7f9181c4d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0cf830 con 0x7f917c099a40 2024-05-08T04:21:55.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.743+0000 7f9173fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917c0b2b80 0x7f917c0c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.743+0000 7f9173fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917c0b2b80 0x7f917c0c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52342/0 (socket says 172.21.15.104:52342) 2024-05-08T04:21:55.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.743+0000 7f9173fff640 1 -- 172.21.15.104:0/1060463897 learned_addr learned my addr 172.21.15.104:0/1060463897 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:55.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.743+0000 7f917bfff640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f917c15d490 0x7f917c06cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.743+0000 7f917b7fe640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917c099a40 0x7f917c1590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.744+0000 7f9173fff640 1 -- 172.21.15.104:0/1060463897 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917c099a40 msgr2=0x7f917c1590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.744+0000 7f9173fff640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917c099a40 0x7f917c1590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.744+0000 7f9173fff640 1 -- 172.21.15.104:0/1060463897 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f917c15d490 msgr2=0x7f917c06cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.744+0000 7f9173fff640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f917c15d490 0x7f917c06cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.744+0000 7f9173fff640 1 -- 172.21.15.104:0/1060463897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c0c7f30 con 0x7f917c0b2b80 2024-05-08T04:21:55.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.744+0000 7f917bfff640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f917c15d490 0x7f917c06cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:21:55.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.744+0000 7f9173fff640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917c0b2b80 0x7f917c0c7630 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f916400d830 tx=0x7f916400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:55.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.744+0000 7f9178ff9640 1 -- 172.21.15.104:0/1060463897 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916400b6c0 con 0x7f917c0b2b80 2024-05-08T04:21:55.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.744+0000 7f9178ff9640 1 -- 172.21.15.104:0/1060463897 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9164019070 con 0x7f917c0b2b80 2024-05-08T04:21:55.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.744+0000 7f9181c4d640 1 -- 172.21.15.104:0/1060463897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c0b5180 con 0x7f917c0b2b80 2024-05-08T04:21:55.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.744+0000 7f9178ff9640 1 -- 172.21.15.104:0/1060463897 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916400ba80 con 0x7f917c0b2b80 2024-05-08T04:21:55.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.744+0000 7f9181c4d640 1 -- 172.21.15.104:0/1060463897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c0b5740 con 0x7f917c0b2b80 2024-05-08T04:21:55.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.745+0000 7f9181c4d640 1 -- 172.21.15.104:0/1060463897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c075010 con 0x7f917c0b2b80 2024-05-08T04:21:55.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.745+0000 7f9178ff9640 1 -- 172.21.15.104:0/1060463897 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f916401e460 con 0x7f917c0b2b80 2024-05-08T04:21:55.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.746+0000 7f9178ff9640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f915c06b4d0 0x7f915c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:55.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.746+0000 7f917b7fe640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f915c06b4d0 0x7f915c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:55.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.746+0000 7f9178ff9640 1 -- 172.21.15.104:0/1060463897 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f916408a7b0 con 0x7f917c0b2b80 2024-05-08T04:21:55.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.747+0000 7f917b7fe640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f915c06b4d0 0x7f915c06d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f916c034000 tx=0x7f916c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:55.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.750+0000 7f9178ff9640 1 -- 172.21.15.104:0/1060463897 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f91640596a0 con 0x7f917c0b2b80 2024-05-08T04:21:55.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.920+0000 7f9181c4d640 1 -- 172.21.15.104:0/1060463897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f917c09a070 con 0x7f917c0b2b80 2024-05-08T04:21:55.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.920+0000 7f9178ff9640 1 -- 172.21.15.104:0/1060463897 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9164058fa0 con 0x7f917c0b2b80 2024-05-08T04:21:55.923 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:21:55.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.922+0000 7f9181c4d640 1 -- 172.21.15.104:0/1060463897 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f915c06b4d0 msgr2=0x7f915c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.922+0000 7f9181c4d640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f915c06b4d0 0x7f915c06d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f916c034000 tx=0x7f916c02e000 comp rx=0 tx=0).stop 2024-05-08T04:21:55.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.922+0000 7f9181c4d640 1 -- 172.21.15.104:0/1060463897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917c0b2b80 msgr2=0x7f917c0c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:55.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.922+0000 7f9181c4d640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917c0b2b80 0x7f917c0c7630 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f916400d830 tx=0x7f916400dcf0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.922+0000 7f9181c4d640 1 -- 172.21.15.104:0/1060463897 shutdown_connections 2024-05-08T04:21:55.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.922+0000 7f9181c4d640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f915c06b4d0 0x7f915c06d990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.922+0000 7f9181c4d640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f917c15d490 0x7f917c06cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.922+0000 7f9181c4d640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f917c0b2b80 0x7f917c0c7630 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.922+0000 7f9181c4d640 1 --2- 172.21.15.104:0/1060463897 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917c099a40 0x7f917c1590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:55.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.922+0000 7f9181c4d640 1 -- 172.21.15.104:0/1060463897 >> 172.21.15.104:0/1060463897 conn(0x7f917c0b3310 msgr2=0x7f917c0b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:55.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.922+0000 7f9181c4d640 1 -- 172.21.15.104:0/1060463897 shutdown_connections 2024-05-08T04:21:55.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:55.922+0000 7f9181c4d640 1 -- 172.21.15.104:0/1060463897 wait complete. 2024-05-08T04:21:55.935 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:21:56.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.033+0000 7f4964dc8640 1 Processor -- start 2024-05-08T04:21:56.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.033+0000 7f4964dc8640 1 -- start start 2024-05-08T04:21:56.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.034+0000 7f4964dc8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4960099a40 0x7f4960099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.034+0000 7f4964dc8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f496015d490 0x7f496015d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.034+0000 7f4964dc8640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49600cd940 con 0x7f49600b2b80 2024-05-08T04:21:56.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.034+0000 7f4964dc8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496009a3e0 con 0x7f4960099a40 2024-05-08T04:21:56.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.034+0000 7f4964dc8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49600cc8a0 con 0x7f496015d490 2024-05-08T04:21:56.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.034+0000 7f4957fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4960099a40 0x7f4960099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.034+0000 7f4957fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4960099a40 0x7f4960099ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52354/0 (socket says 172.21.15.104:52354) 2024-05-08T04:21:56.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.034+0000 7f4957fff640 1 -- 172.21.15.104:0/868623387 learned_addr learned my addr 172.21.15.104:0/868623387 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:56.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.034+0000 7f4957fff640 1 -- 172.21.15.104:0/868623387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f496015d490 msgr2=0x7f496015d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:56.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.034+0000 7f495ed9d640 1 --2- 172.21.15.104:0/868623387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f496015d490 0x7f496015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.034+0000 7f4957fff640 1 --2- 172.21.15.104:0/868623387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f496015d490 0x7f496015d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.034+0000 7f4957fff640 1 -- 172.21.15.104:0/868623387 >> v1:172.21.15.183:6789/0 conn(0x7f49600b2b80 legacy=0x7f496009a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:56.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.034+0000 7f4957fff640 1 -- 172.21.15.104:0/868623387 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49600ccb80 con 0x7f4960099a40 2024-05-08T04:21:56.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.035+0000 7f4957fff640 1 --2- 172.21.15.104:0/868623387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4960099a40 0x7f4960099ea0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4948009870 tx=0x7f494802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a48ec0389dbb8c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:56.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.035+0000 7f495dd9b640 1 -- 172.21.15.104:0/868623387 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948037070 con 0x7f4960099a40 2024-05-08T04:21:56.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.035+0000 7f495dd9b640 1 -- 172.21.15.104:0/868623387 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4948032440 con 0x7f4960099a40 2024-05-08T04:21:56.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.035+0000 7f495dd9b640 1 -- 172.21.15.104:0/868623387 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948032810 con 0x7f4960099a40 2024-05-08T04:21:56.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.035+0000 7f4964dc8640 1 -- 172.21.15.104:0/868623387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4960099a40 msgr2=0x7f4960099ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.035+0000 7f4964dc8640 1 --2- 172.21.15.104:0/868623387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4960099a40 0x7f4960099ea0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4948009870 tx=0x7f494802a2a0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.036+0000 7f4964dc8640 1 -- 172.21.15.104:0/868623387 shutdown_connections 2024-05-08T04:21:56.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.036+0000 7f4964dc8640 1 --2- 172.21.15.104:0/868623387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f496015d490 0x7f496015d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.036+0000 7f4964dc8640 1 --2- 172.21.15.104:0/868623387 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4960099a40 0x7f4960099ea0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.036+0000 7f4964dc8640 1 -- 172.21.15.104:0/868623387 >> 172.21.15.104:0/868623387 conn(0x7f49600b3310 msgr2=0x7f49600b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:56.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.036+0000 7f4964dc8640 1 -- 172.21.15.104:0/868623387 shutdown_connections 2024-05-08T04:21:56.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.036+0000 7f4964dc8640 1 -- 172.21.15.104:0/868623387 wait complete. 2024-05-08T04:21:56.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.037+0000 7f4964dc8640 1 Processor -- start 2024-05-08T04:21:56.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.037+0000 7f4964dc8640 1 -- start start 2024-05-08T04:21:56.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4964dc8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4960099a40 0x7f4960151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4964dc8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49600b2b80 0x7f496014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4964dc8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f496015d490 0x7f49600c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4964dc8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49600cf830 con 0x7f49600b2b80 2024-05-08T04:21:56.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4964dc8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49600cd140 con 0x7f4960099a40 2024-05-08T04:21:56.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4964dc8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49600cc550 con 0x7f496015d490 2024-05-08T04:21:56.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4957fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49600b2b80 0x7f496014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4957fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49600b2b80 0x7f496014ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52370/0 (socket says 172.21.15.104:52370) 2024-05-08T04:21:56.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4957fff640 1 -- 172.21.15.104:0/1335308610 learned_addr learned my addr 172.21.15.104:0/1335308610 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:56.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f495ed9d640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f496015d490 0x7f49600c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f495e59c640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4960099a40 0x7f4960151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4957fff640 1 -- 172.21.15.104:0/1335308610 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f496015d490 msgr2=0x7f49600c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4957fff640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f496015d490 0x7f49600c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4957fff640 1 -- 172.21.15.104:0/1335308610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4960099a40 msgr2=0x7f4960151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4957fff640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4960099a40 0x7f4960151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4957fff640 1 -- 172.21.15.104:0/1335308610 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496009e1b0 con 0x7f49600b2b80 2024-05-08T04:21:56.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f495e59c640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4960099a40 0x7f4960151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:56.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4957fff640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49600b2b80 0x7f496014ec00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4948000c00 tx=0x7f49480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:56.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4956ffd640 1 -- 172.21.15.104:0/1335308610 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948037040 con 0x7f49600b2b80 2024-05-08T04:21:56.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4956ffd640 1 -- 172.21.15.104:0/1335308610 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4948042070 con 0x7f49600b2b80 2024-05-08T04:21:56.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4964dc8640 1 -- 172.21.15.104:0/1335308610 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496009e490 con 0x7f49600b2b80 2024-05-08T04:21:56.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4956ffd640 1 -- 172.21.15.104:0/1335308610 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948030bd0 con 0x7f49600b2b80 2024-05-08T04:21:56.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.038+0000 7f4964dc8640 1 -- 172.21.15.104:0/1335308610 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496009ea50 con 0x7f49600b2b80 2024-05-08T04:21:56.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.039+0000 7f4964dc8640 1 -- 172.21.15.104:0/1335308610 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4960075010 con 0x7f49600b2b80 2024-05-08T04:21:56.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.040+0000 7f4956ffd640 1 -- 172.21.15.104:0/1335308610 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4948047460 con 0x7f49600b2b80 2024-05-08T04:21:56.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.040+0000 7f4956ffd640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f494006b4d0 0x7f494006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.040+0000 7f4956ffd640 1 -- 172.21.15.104:0/1335308610 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f49480aae70 con 0x7f49600b2b80 2024-05-08T04:21:56.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.040+0000 7f495e59c640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f494006b4d0 0x7f494006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.041+0000 7f495e59c640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f494006b4d0 0x7f494006d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4950003eb0 tx=0x7f4950009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:56.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.045+0000 7f4956ffd640 1 -- 172.21.15.104:0/1335308610 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4948045360 con 0x7f49600b2b80 2024-05-08T04:21:56.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.250+0000 7f4964dc8640 1 -- 172.21.15.104:0/1335308610 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49600d1160 con 0x7f49600b2b80 2024-05-08T04:21:56.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.251+0000 7f4956ffd640 1 -- 172.21.15.104:0/1335308610 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f4948079cd0 con 0x7f49600b2b80 2024-05-08T04:21:56.253 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:56.254 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/446112297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":446112297},{"type":"v1","addr":"172.21.15.183:6834","nonce":446112297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/702726775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":702726775},{"type":"v1","addr":"172.21.15.183:6835","nonce":702726775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/1820805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1820805788},{"type":"v1","addr":"172.21.15.104:6836","nonce":1820805788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:21:10.133307+0000","modified":"2024-05-08T04:21:12.575912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/610189872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":610189872},{"type":"v1","addr":"172.21.15.104:6837","nonce":610189872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T04:21:56.254 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-05-08T04:21:56.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.253+0000 7f4964dc8640 1 -- 172.21.15.104:0/1335308610 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f494006b4d0 msgr2=0x7f494006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.253+0000 7f4964dc8640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f494006b4d0 0x7f494006d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4950003eb0 tx=0x7f4950009040 comp rx=0 tx=0).stop 2024-05-08T04:21:56.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.253+0000 7f4964dc8640 1 -- 172.21.15.104:0/1335308610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49600b2b80 msgr2=0x7f496014ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.253+0000 7f4964dc8640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49600b2b80 0x7f496014ec00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4948000c00 tx=0x7f49480046c0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.253+0000 7f4964dc8640 1 -- 172.21.15.104:0/1335308610 shutdown_connections 2024-05-08T04:21:56.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.253+0000 7f4964dc8640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f494006b4d0 0x7f494006d990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.253+0000 7f4964dc8640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f496015d490 0x7f49600c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.253+0000 7f4964dc8640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49600b2b80 0x7f496014ec00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.253+0000 7f4964dc8640 1 --2- 172.21.15.104:0/1335308610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4960099a40 0x7f4960151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.253+0000 7f4964dc8640 1 -- 172.21.15.104:0/1335308610 >> 172.21.15.104:0/1335308610 conn(0x7f49600b3310 msgr2=0x7f496009a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:56.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.253+0000 7f4964dc8640 1 -- 172.21.15.104:0/1335308610 shutdown_connections 2024-05-08T04:21:56.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.253+0000 7f4964dc8640 1 -- 172.21.15.104:0/1335308610 wait complete. 2024-05-08T04:21:56.267 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:56.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.364+0000 7f676db4c640 1 Processor -- start 2024-05-08T04:21:56.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.364+0000 7f676db4c640 1 -- start start 2024-05-08T04:21:56.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f676db4c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6768161190 0x7f6768072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f676db4c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6768072a70 0x7f67680acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f676db4c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676806de30 con 0x7f67680ad330 2024-05-08T04:21:56.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f676db4c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67680b4db0 con 0x7f6768072a70 2024-05-08T04:21:56.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f676db4c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676806e110 con 0x7f6768161190 2024-05-08T04:21:56.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f6766ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6768072a70 0x7f67680acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f6767fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f67680ad330 0x7f676806bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59726/0 (socket says 172.21.15.104:59726) 2024-05-08T04:21:56.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f6767fff640 1 -- 172.21.15.104:0/1612112584 learned_addr learned my addr 172.21.15.104:0/1612112584 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f67677fe640 1 --2- 172.21.15.104:0/1612112584 >> v2:172.21.15.183:3300/0 conn(0x7f6768161190 0x7f6768072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f6766ffd640 1 -- 172.21.15.104:0/1612112584 >> v2:172.21.15.183:3300/0 conn(0x7f6768161190 msgr2=0x7f6768072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f6766ffd640 1 --2- 172.21.15.104:0/1612112584 >> v2:172.21.15.183:3300/0 conn(0x7f6768161190 0x7f6768072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f6766ffd640 1 -- 172.21.15.104:0/1612112584 >> v1:172.21.15.104:6789/0 conn(0x7f67680ad330 legacy=0x7f676806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f6766ffd640 1 -- 172.21.15.104:0/1612112584 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676806e3f0 con 0x7f6768072a70 2024-05-08T04:21:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.365+0000 7f67667fc640 1 -- 172.21.15.104:0/1612112584 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652794234 0 0) 0x7f676806de30 con 0x7f67680ad330 2024-05-08T04:21:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.366+0000 7f6766ffd640 1 --2- 172.21.15.104:0/1612112584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6768072a70 0x7f67680acdf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f676806faa0 tx=0x7f675c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195a7ca521f11400 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.366+0000 7f67667fc640 1 -- 172.21.15.104:0/1612112584 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c037070 con 0x7f6768072a70 2024-05-08T04:21:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.366+0000 7f67667fc640 1 -- 172.21.15.104:0/1612112584 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c032440 con 0x7f6768072a70 2024-05-08T04:21:56.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.366+0000 7f67667fc640 1 -- 172.21.15.104:0/1612112584 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c032810 con 0x7f6768072a70 2024-05-08T04:21:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.366+0000 7f676db4c640 1 -- 172.21.15.104:0/1612112584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6768072a70 msgr2=0x7f67680acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.366+0000 7f676db4c640 1 --2- 172.21.15.104:0/1612112584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6768072a70 0x7f67680acdf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f676806faa0 tx=0x7f675c02a1a0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.367+0000 7f676db4c640 1 -- 172.21.15.104:0/1612112584 shutdown_connections 2024-05-08T04:21:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.367+0000 7f676db4c640 1 --2- 172.21.15.104:0/1612112584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6768072a70 0x7f67680acdf0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.367+0000 7f676db4c640 1 --2- 172.21.15.104:0/1612112584 >> v2:172.21.15.183:3300/0 conn(0x7f6768161190 0x7f6768072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.367+0000 7f676db4c640 1 -- 172.21.15.104:0/1612112584 >> 172.21.15.104:0/1612112584 conn(0x7f6768071a10 msgr2=0x7f6768071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.367+0000 7f676db4c640 1 -- 172.21.15.104:0/1612112584 shutdown_connections 2024-05-08T04:21:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.367+0000 7f676db4c640 1 -- 172.21.15.104:0/1612112584 wait complete. 2024-05-08T04:21:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.368+0000 7f676db4c640 1 Processor -- start 2024-05-08T04:21:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.368+0000 7f676db4c640 1 -- start start 2024-05-08T04:21:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f676db4c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67680ad330 0x7f676806b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f676db4c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6768161190 0x7f676815f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f676db4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67681f41d0 0x7f676815fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f676db4c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676806da70 con 0x7f67681f41d0 2024-05-08T04:21:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f676db4c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676806e9b0 con 0x7f67680ad330 2024-05-08T04:21:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f676db4c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676806dbf0 con 0x7f6768161190 2024-05-08T04:21:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f6767fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67681f41d0 0x7f676815fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f6767fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67681f41d0 0x7f676815fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52376/0 (socket says 172.21.15.104:52376) 2024-05-08T04:21:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f6767fff640 1 -- 172.21.15.104:0/389063057 learned_addr learned my addr 172.21.15.104:0/389063057 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f67677fe640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67680ad330 0x7f676806b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f6766ffd640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6768161190 0x7f676815f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f6767fff640 1 -- 172.21.15.104:0/389063057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6768161190 msgr2=0x7f676815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f6767fff640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6768161190 0x7f676815f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f6767fff640 1 -- 172.21.15.104:0/389063057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67680ad330 msgr2=0x7f676806b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f6767fff640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67680ad330 0x7f676806b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f6767fff640 1 -- 172.21.15.104:0/389063057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67681f3470 con 0x7f67681f41d0 2024-05-08T04:21:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f6767fff640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67681f41d0 0x7f676815fd10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f676000c7a0 tx=0x7f676000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f674ffff640 1 -- 172.21.15.104:0/389063057 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760018070 con 0x7f67681f41d0 2024-05-08T04:21:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f674ffff640 1 -- 172.21.15.104:0/389063057 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676000a640 con 0x7f67681f41d0 2024-05-08T04:21:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f676db4c640 1 -- 172.21.15.104:0/389063057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676806bbf0 con 0x7f67681f41d0 2024-05-08T04:21:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f674ffff640 1 -- 172.21.15.104:0/389063057 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676000aab0 con 0x7f67681f41d0 2024-05-08T04:21:56.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.369+0000 7f676db4c640 1 -- 172.21.15.104:0/389063057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67681f39d0 con 0x7f67681f41d0 2024-05-08T04:21:56.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.370+0000 7f676db4c640 1 -- 172.21.15.104:0/389063057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6768075010 con 0x7f67681f41d0 2024-05-08T04:21:56.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.371+0000 7f674ffff640 1 -- 172.21.15.104:0/389063057 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f676001b070 con 0x7f67681f41d0 2024-05-08T04:21:56.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.371+0000 7f674ffff640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f675406b4d0 0x7f675406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.371+0000 7f674ffff640 1 -- 172.21.15.104:0/389063057 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6760089790 con 0x7f67681f41d0 2024-05-08T04:21:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.371+0000 7f67677fe640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f675406b4d0 0x7f675406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.372+0000 7f67677fe640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f675406b4d0 0x7f675406d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f676814d760 tx=0x7f6758008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.376+0000 7f674ffff640 1 -- 172.21.15.104:0/389063057 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f67681f3470 con 0x7f67681f41d0 2024-05-08T04:21:56.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.546+0000 7f676db4c640 1 -- 172.21.15.104:0/389063057 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6768153730 con 0x7f67681f41d0 2024-05-08T04:21:56.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.547+0000 7f674ffff640 1 -- 172.21.15.104:0/389063057 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16718 (secure 0 0 0) 0x7f6760057fa0 con 0x7f67681f41d0 2024-05-08T04:21:56.550 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:56.550 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:53.967875+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:56.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.549+0000 7f676db4c640 1 -- 172.21.15.104:0/389063057 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f675406b4d0 msgr2=0x7f675406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.549+0000 7f676db4c640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f675406b4d0 0x7f675406d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f676814d760 tx=0x7f6758008040 comp rx=0 tx=0).stop 2024-05-08T04:21:56.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.549+0000 7f676db4c640 1 -- 172.21.15.104:0/389063057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67681f41d0 msgr2=0x7f676815fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.549+0000 7f676db4c640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67681f41d0 0x7f676815fd10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f676000c7a0 tx=0x7f676000cc60 comp rx=0 tx=0).stop 2024-05-08T04:21:56.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.549+0000 7f676db4c640 1 -- 172.21.15.104:0/389063057 shutdown_connections 2024-05-08T04:21:56.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.549+0000 7f676db4c640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f675406b4d0 0x7f675406d990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.549+0000 7f676db4c640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67681f41d0 0x7f676815fd10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.549+0000 7f676db4c640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6768161190 0x7f676815f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.549+0000 7f676db4c640 1 --2- 172.21.15.104:0/389063057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67680ad330 0x7f676806b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.549+0000 7f676db4c640 1 -- 172.21.15.104:0/389063057 >> 172.21.15.104:0/389063057 conn(0x7f6768071a10 msgr2=0x7f67680afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:56.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.550+0000 7f676db4c640 1 -- 172.21.15.104:0/389063057 shutdown_connections 2024-05-08T04:21:56.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.550+0000 7f676db4c640 1 -- 172.21.15.104:0/389063057 wait complete. 2024-05-08T04:21:56.563 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T04:21:56.563 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:21:56.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.661+0000 7f22d3e88640 1 Processor -- start 2024-05-08T04:21:56.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.662+0000 7f22d3e88640 1 -- start start 2024-05-08T04:21:56.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.662+0000 7f22d3e88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc0d07c0 0x7f22cc161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.662+0000 7f22d3e88640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc15e1f0 con 0x7f22cc0ce5a0 2024-05-08T04:21:56.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.662+0000 7f22d3e88640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc162090 con 0x7f22cc15de10 2024-05-08T04:21:56.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.662+0000 7f22d3e88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0d0f50 con 0x7f22cc0d07c0 2024-05-08T04:21:56.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.662+0000 7f22d1423640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f22cc0ce5a0 0x7f22cc0d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59728/0 (socket says 172.21.15.104:59728) 2024-05-08T04:21:56.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.662+0000 7f22d1423640 1 -- 172.21.15.104:0/1018128268 learned_addr learned my addr 172.21.15.104:0/1018128268 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:56.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d2425640 1 --2- 172.21.15.104:0/1018128268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc0d07c0 0x7f22cc161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282043453 0 0) 0x7f22cc15e1f0 con 0x7f22cc0ce5a0 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b4003520 con 0x7f22cc0ce5a0 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 883133634 0 0) 0x7f22b4003520 con 0x7f22cc0ce5a0 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc0d07c0 msgr2=0x7f22cc161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 --2- 172.21.15.104:0/1018128268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc0d07c0 0x7f22cc161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 >> v1:172.21.15.183:6789/0 conn(0x7f22cc15de10 legacy=0x7f22cc0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc162370 con 0x7f22cc0ce5a0 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f22c0001670 con 0x7f22cc0ce5a0 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 >> v1:172.21.15.104:6789/0 conn(0x7f22cc0ce5a0 legacy=0x7f22cc0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 --2- 172.21.15.104:0/1018128268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b40039e0 0x7f22b4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 --2- 172.21.15.104:0/1018128268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc0d07c0 0x7f22b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 --2- 172.21.15.104:0/1018128268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22b4004d40 0x7f22b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0d0f50 con 0x7f22b4004d40 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b400bb20 con 0x7f22b40039e0 2024-05-08T04:21:56.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b400bd20 con 0x7f22cc0d07c0 2024-05-08T04:21:56.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d2425640 1 --2- 172.21.15.104:0/1018128268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22b4004d40 0x7f22b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d1c24640 1 --2- 172.21.15.104:0/1018128268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b40039e0 0x7f22b4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d1423640 1 --2- 172.21.15.104:0/1018128268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc0d07c0 0x7f22b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.663+0000 7f22d2425640 1 -- 172.21.15.104:0/1018128268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc0d07c0 msgr2=0x7f22b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:56.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.664+0000 7f22d2425640 1 --2- 172.21.15.104:0/1018128268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc0d07c0 0x7f22b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.664+0000 7f22d2425640 1 -- 172.21.15.104:0/1018128268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b40039e0 msgr2=0x7f22b4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:56.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.664+0000 7f22d2425640 1 --2- 172.21.15.104:0/1018128268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b40039e0 0x7f22b4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.664+0000 7f22d2425640 1 -- 172.21.15.104:0/1018128268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b4003520 con 0x7f22b4004d40 2024-05-08T04:21:56.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.664+0000 7f22d2425640 1 --2- 172.21.15.104:0/1018128268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22b4004d40 0x7f22b40051c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009ac0 tx=0x7f22b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e3cb3178d36af7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:56.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.664+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc036070 con 0x7f22b4004d40 2024-05-08T04:21:56.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.664+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc031400 con 0x7f22b4004d40 2024-05-08T04:21:56.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.664+0000 7f22d0c22640 1 -- 172.21.15.104:0/1018128268 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc009690 con 0x7f22b4004d40 2024-05-08T04:21:56.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.665+0000 7f22d3e88640 1 -- 172.21.15.104:0/1018128268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22b4004d40 msgr2=0x7f22b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.665+0000 7f22d3e88640 1 --2- 172.21.15.104:0/1018128268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22b4004d40 0x7f22b40051c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009ac0 tx=0x7f22b4005830 comp rx=0 tx=0).stop 2024-05-08T04:21:56.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.665+0000 7f22d2425640 1 -- 172.21.15.104:0/1018128268 reap_dead start 2024-05-08T04:21:56.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.665+0000 7f22d3e88640 1 -- 172.21.15.104:0/1018128268 shutdown_connections 2024-05-08T04:21:56.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.665+0000 7f22d3e88640 1 -- 172.21.15.104:0/1018128268 >> 172.21.15.104:0/1018128268 conn(0x7f22cc072290 msgr2=0x7f22cc072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:56.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.665+0000 7f22d3e88640 1 -- 172.21.15.104:0/1018128268 shutdown_connections 2024-05-08T04:21:56.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.665+0000 7f22d3e88640 1 -- 172.21.15.104:0/1018128268 wait complete. 2024-05-08T04:21:56.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.666+0000 7f22d3e88640 1 Processor -- start 2024-05-08T04:21:56.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.666+0000 7f22d3e88640 1 -- start start 2024-05-08T04:21:56.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d3e88640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b4004d40 0x7f22cc150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d3e88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc14f6b0 0x7f22cc14ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d3e88640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22cc0b5c60 0x7f22cc151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d3e88640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0d1ce0 con 0x7f22cc0b5c60 2024-05-08T04:21:56.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d3e88640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0d1a90 con 0x7f22b4004d40 2024-05-08T04:21:56.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d3e88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0b6dc0 con 0x7f22cc14f6b0 2024-05-08T04:21:56.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d2425640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22cc0b5c60 0x7f22cc151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d2425640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22cc0b5c60 0x7f22cc151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52392/0 (socket says 172.21.15.104:52392) 2024-05-08T04:21:56.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d2425640 1 -- 172.21.15.104:0/2480648449 learned_addr learned my addr 172.21.15.104:0/2480648449 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:56.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d2425640 1 -- 172.21.15.104:0/2480648449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc14f6b0 msgr2=0x7f22cc14ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d2425640 1 --2- 172.21.15.104:0/2480648449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc14f6b0 0x7f22cc14ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d2425640 1 -- 172.21.15.104:0/2480648449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b4004d40 msgr2=0x7f22cc150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d2425640 1 --2- 172.21.15.104:0/2480648449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b4004d40 0x7f22cc150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d2425640 1 -- 172.21.15.104:0/2480648449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc14f4b0 con 0x7f22cc0b5c60 2024-05-08T04:21:56.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.667+0000 7f22d2425640 1 --2- 172.21.15.104:0/2480648449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22cc0b5c60 0x7f22cc151b30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009be0 tx=0x7f22bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:56.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.668+0000 7f22ca7fc640 1 -- 172.21.15.104:0/2480648449 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc036070 con 0x7f22cc0b5c60 2024-05-08T04:21:56.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.668+0000 7f22ca7fc640 1 -- 172.21.15.104:0/2480648449 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc037040 con 0x7f22cc0b5c60 2024-05-08T04:21:56.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.668+0000 7f22d3e88640 1 -- 172.21.15.104:0/2480648449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc14fb90 con 0x7f22cc0b5c60 2024-05-08T04:21:56.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.668+0000 7f22ca7fc640 1 -- 172.21.15.104:0/2480648449 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc009690 con 0x7f22cc0b5c60 2024-05-08T04:21:56.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.668+0000 7f22d3e88640 1 -- 172.21.15.104:0/2480648449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc150150 con 0x7f22cc0b5c60 2024-05-08T04:21:56.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.669+0000 7f22d3e88640 1 -- 172.21.15.104:0/2480648449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc075010 con 0x7f22cc0b5c60 2024-05-08T04:21:56.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.669+0000 7f22ca7fc640 1 -- 172.21.15.104:0/2480648449 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f22bc003610 con 0x7f22cc0b5c60 2024-05-08T04:21:56.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.670+0000 7f22ca7fc640 1 --2- 172.21.15.104:0/2480648449 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f22b806b500 0x7f22b806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:56.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.670+0000 7f22ca7fc640 1 -- 172.21.15.104:0/2480648449 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f22bc0a99c0 con 0x7f22cc0b5c60 2024-05-08T04:21:56.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.670+0000 7f22d1c24640 1 --2- 172.21.15.104:0/2480648449 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f22b806b500 0x7f22b806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:56.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.670+0000 7f22d1c24640 1 --2- 172.21.15.104:0/2480648449 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f22b806b500 0x7f22b806d9c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f22c4001e50 tx=0x7f22c4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:56.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.674+0000 7f22ca7fc640 1 -- 172.21.15.104:0/2480648449 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f22bc0abe20 con 0x7f22cc0b5c60 2024-05-08T04:21:56.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.881+0000 7f22d3e88640 1 -- 172.21.15.104:0/2480648449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22cc0ccb90 con 0x7f22cc0b5c60 2024-05-08T04:21:56.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.882+0000 7f22ca7fc640 1 -- 172.21.15.104:0/2480648449 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f22cc14f4b0 con 0x7f22cc0b5c60 2024-05-08T04:21:56.884 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:56.884 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/446112297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":446112297},{"type":"v1","addr":"172.21.15.183:6834","nonce":446112297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/702726775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":702726775},{"type":"v1","addr":"172.21.15.183:6835","nonce":702726775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/1820805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1820805788},{"type":"v1","addr":"172.21.15.104:6836","nonce":1820805788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:21:10.133307+0000","modified":"2024-05-08T04:21:12.575912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/610189872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":610189872},{"type":"v1","addr":"172.21.15.104:6837","nonce":610189872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T04:21:56.885 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-05-08T04:21:56.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.884+0000 7f22d3e88640 1 -- 172.21.15.104:0/2480648449 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f22b806b500 msgr2=0x7f22b806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.884+0000 7f22d3e88640 1 --2- 172.21.15.104:0/2480648449 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f22b806b500 0x7f22b806d9c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f22c4001e50 tx=0x7f22c4009040 comp rx=0 tx=0).stop 2024-05-08T04:21:56.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.884+0000 7f22d3e88640 1 -- 172.21.15.104:0/2480648449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22cc0b5c60 msgr2=0x7f22cc151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:56.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.884+0000 7f22d3e88640 1 --2- 172.21.15.104:0/2480648449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22cc0b5c60 0x7f22cc151b30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009be0 tx=0x7f22bc004730 comp rx=0 tx=0).stop 2024-05-08T04:21:56.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.884+0000 7f22d3e88640 1 -- 172.21.15.104:0/2480648449 shutdown_connections 2024-05-08T04:21:56.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.884+0000 7f22d3e88640 1 --2- 172.21.15.104:0/2480648449 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f22b806b500 0x7f22b806d9c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.884+0000 7f22d3e88640 1 --2- 172.21.15.104:0/2480648449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22cc0b5c60 0x7f22cc151b30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.884+0000 7f22d3e88640 1 --2- 172.21.15.104:0/2480648449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22cc14f6b0 0x7f22cc14ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.884+0000 7f22d3e88640 1 --2- 172.21.15.104:0/2480648449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22b4004d40 0x7f22cc150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:56.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.884+0000 7f22d3e88640 1 -- 172.21.15.104:0/2480648449 >> 172.21.15.104:0/2480648449 conn(0x7f22cc072290 msgr2=0x7f22cc0cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:56.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.884+0000 7f22d3e88640 1 -- 172.21.15.104:0/2480648449 shutdown_connections 2024-05-08T04:21:56.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.884+0000 7f22d3e88640 1 -- 172.21.15.104:0/2480648449 wait complete. 2024-05-08T04:21:56.897 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:21:56.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.996+0000 7f5dcd838640 1 Processor -- start 2024-05-08T04:21:56.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.996+0000 7f5dcd838640 1 -- start start 2024-05-08T04:21:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.996+0000 7f5dcd838640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5dc80ce5a0 0x7f5dc8161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.996+0000 7f5dcd838640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc815e1f0 con 0x7f5dc815de10 2024-05-08T04:21:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.997+0000 7f5dcd838640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc8162090 con 0x7f5dc80d07c0 2024-05-08T04:21:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.997+0000 7f5dcd838640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc80d0f50 con 0x7f5dc80ce5a0 2024-05-08T04:21:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.997+0000 7f5dbe7fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5dc80ce5a0 0x7f5dc8161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.997+0000 7f5dc6ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f5dc815de10 0x7f5dc80d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:59744/0 (socket says 172.21.15.104:59744) 2024-05-08T04:21:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.997+0000 7f5dc6ffd640 1 -- 172.21.15.104:0/3851503705 learned_addr learned my addr 172.21.15.104:0/3851503705 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.997+0000 7f5dbe7fc640 1 -- 172.21.15.104:0/3851503705 >> v1:172.21.15.183:6789/0 conn(0x7f5dc80d07c0 legacy=0x7f5dc80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.997+0000 7f5dbe7fc640 1 -- 172.21.15.104:0/3851503705 >> v1:172.21.15.104:6789/0 conn(0x7f5dc815de10 legacy=0x7f5dc80d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.997+0000 7f5dbe7fc640 1 -- 172.21.15.104:0/3851503705 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc8162370 con 0x7f5dc80ce5a0 2024-05-08T04:21:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.998+0000 7f5dbe7fc640 1 --2- 172.21.15.104:0/3851503705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc80ce5a0 0x7f5dc8161920 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5db00097a0 tx=0x7f5db002a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc13d43f835aa6f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:57.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.998+0000 7f5dc67fc640 1 -- 172.21.15.104:0/3851503705 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0037070 con 0x7f5dc80ce5a0 2024-05-08T04:21:57.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.998+0000 7f5dc67fc640 1 -- 172.21.15.104:0/3851503705 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db002acd0 con 0x7f5dc80ce5a0 2024-05-08T04:21:57.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.998+0000 7f5dc67fc640 1 -- 172.21.15.104:0/3851503705 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0032660 con 0x7f5dc80ce5a0 2024-05-08T04:21:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.998+0000 7f5dcd838640 1 -- 172.21.15.104:0/3851503705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc80ce5a0 msgr2=0x7f5dc8161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.998+0000 7f5dcd838640 1 --2- 172.21.15.104:0/3851503705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc80ce5a0 0x7f5dc8161920 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5db00097a0 tx=0x7f5db002a040 comp rx=0 tx=0).stop 2024-05-08T04:21:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.998+0000 7f5dcd838640 1 -- 172.21.15.104:0/3851503705 shutdown_connections 2024-05-08T04:21:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.998+0000 7f5dcd838640 1 --2- 172.21.15.104:0/3851503705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc80ce5a0 0x7f5dc8161920 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.998+0000 7f5dcd838640 1 -- 172.21.15.104:0/3851503705 >> 172.21.15.104:0/3851503705 conn(0x7f5dc8072290 msgr2=0x7f5dc8072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.998+0000 7f5dcd838640 1 -- 172.21.15.104:0/3851503705 shutdown_connections 2024-05-08T04:21:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.998+0000 7f5dcd838640 1 -- 172.21.15.104:0/3851503705 wait complete. 2024-05-08T04:21:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:56.999+0000 7f5dcd838640 1 Processor -- start 2024-05-08T04:21:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.000+0000 7f5dcd838640 1 -- start start 2024-05-08T04:21:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.000+0000 7f5dcd838640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc80ce5a0 0x7f5dc8160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.000+0000 7f5dcd838640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc80d07c0 0x7f5dc80cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.000+0000 7f5dcd838640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc815de10 0x7f5dc80cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.000+0000 7f5dcd838640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc80d1a90 con 0x7f5dc815de10 2024-05-08T04:21:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.000+0000 7f5dcd838640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc80d1ce0 con 0x7f5dc80ce5a0 2024-05-08T04:21:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.000+0000 7f5dcd838640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc80b6dc0 con 0x7f5dc80d07c0 2024-05-08T04:21:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.000+0000 7f5dc77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc815de10 0x7f5dc80cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dc77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc815de10 0x7f5dc80cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52408/0 (socket says 172.21.15.104:52408) 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dc77fe640 1 -- 172.21.15.104:0/1326735533 learned_addr learned my addr 172.21.15.104:0/1326735533 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dbe7fc640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc80d07c0 0x7f5dc80cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dc6ffd640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc80ce5a0 0x7f5dc8160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dc77fe640 1 -- 172.21.15.104:0/1326735533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc80d07c0 msgr2=0x7f5dc80cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dc77fe640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc80d07c0 0x7f5dc80cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dc77fe640 1 -- 172.21.15.104:0/1326735533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc80ce5a0 msgr2=0x7f5dc8160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dc77fe640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc80ce5a0 0x7f5dc8160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dc77fe640 1 -- 172.21.15.104:0/1326735533 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc814af10 con 0x7f5dc815de10 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dc6ffd640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc80ce5a0 0x7f5dc8160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dc77fe640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc815de10 0x7f5dc80cc080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000c7b0 tx=0x7f5dc000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dc4ff9640 1 -- 172.21.15.104:0/1326735533 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0017070 con 0x7f5dc815de10 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dc4ff9640 1 -- 172.21.15.104:0/1326735533 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc0003da0 con 0x7f5dc815de10 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dcd838640 1 -- 172.21.15.104:0/1326735533 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc815e940 con 0x7f5dc815de10 2024-05-08T04:21:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dc4ff9640 1 -- 172.21.15.104:0/1326735533 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00052b0 con 0x7f5dc815de10 2024-05-08T04:21:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.001+0000 7f5dcd838640 1 -- 172.21.15.104:0/1326735533 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc80b3b40 con 0x7f5dc815de10 2024-05-08T04:21:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.002+0000 7f5dcd838640 1 -- 172.21.15.104:0/1326735533 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc80d1870 con 0x7f5dc815de10 2024-05-08T04:21:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.002+0000 7f5dc4ff9640 1 -- 172.21.15.104:0/1326735533 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5dc001a070 con 0x7f5dc815de10 2024-05-08T04:21:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.003+0000 7f5dc4ff9640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5da806b4d0 0x7f5da806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.003+0000 7f5dc4ff9640 1 -- 172.21.15.104:0/1326735533 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5dc00898a0 con 0x7f5dc815de10 2024-05-08T04:21:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.003+0000 7f5dc6ffd640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5da806b4d0 0x7f5da806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.003+0000 7f5dc6ffd640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5da806b4d0 0x7f5da806d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5db8000f60 tx=0x7f5db8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:57.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.007+0000 7f5dc4ff9640 1 -- 172.21.15.104:0/1326735533 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5dc0058700 con 0x7f5dc815de10 2024-05-08T04:21:57.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.210+0000 7f5dcd838640 1 -- 172.21.15.104:0/1326735533 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5dc8074ff0 con 0x7f5dc815de10 2024-05-08T04:21:57.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.211+0000 7f5dc4ff9640 1 -- 172.21.15.104:0/1326735533 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4935 (secure 0 0 0) 0x7f5dc0058000 con 0x7f5dc815de10 2024-05-08T04:21:57.213 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:57.213 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/446112297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":446112297},{"type":"v1","addr":"172.21.15.183:6834","nonce":446112297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/702726775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":702726775},{"type":"v1","addr":"172.21.15.183:6835","nonce":702726775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/1820805788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1820805788},{"type":"v1","addr":"172.21.15.104:6836","nonce":1820805788}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:21:10.133307+0000","modified":"2024-05-08T04:21:12.575912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/610189872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":610189872},{"type":"v1","addr":"172.21.15.104:6837","nonce":610189872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T04:21:57.214 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-05-08T04:21:57.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.213+0000 7f5dcd838640 1 -- 172.21.15.104:0/1326735533 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5da806b4d0 msgr2=0x7f5da806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.213+0000 7f5dcd838640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5da806b4d0 0x7f5da806d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5db8000f60 tx=0x7f5db8009040 comp rx=0 tx=0).stop 2024-05-08T04:21:57.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.213+0000 7f5dcd838640 1 -- 172.21.15.104:0/1326735533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc815de10 msgr2=0x7f5dc80cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.213+0000 7f5dcd838640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc815de10 0x7f5dc80cc080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000c7b0 tx=0x7f5dc000cc70 comp rx=0 tx=0).stop 2024-05-08T04:21:57.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.213+0000 7f5dcd838640 1 -- 172.21.15.104:0/1326735533 shutdown_connections 2024-05-08T04:21:57.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.213+0000 7f5dcd838640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5da806b4d0 0x7f5da806d990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.213+0000 7f5dcd838640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc815de10 0x7f5dc80cc080 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.213+0000 7f5dcd838640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc80d07c0 0x7f5dc80cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.213+0000 7f5dcd838640 1 --2- 172.21.15.104:0/1326735533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc80ce5a0 0x7f5dc8160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.213+0000 7f5dcd838640 1 -- 172.21.15.104:0/1326735533 >> 172.21.15.104:0/1326735533 conn(0x7f5dc8072290 msgr2=0x7f5dc815a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:57.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.213+0000 7f5dcd838640 1 -- 172.21.15.104:0/1326735533 shutdown_connections 2024-05-08T04:21:57.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.213+0000 7f5dcd838640 1 -- 172.21.15.104:0/1326735533 wait complete. 2024-05-08T04:21:57.226 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:21:57.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.324+0000 7fa0dfbc8640 1 Processor -- start 2024-05-08T04:21:57.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.324+0000 7fa0dfbc8640 1 -- start start 2024-05-08T04:21:57.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dfbc8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa0d8070c70 0x7fa0d8071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dfbc8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa0d815edf0 0x7fa0d80b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dfbc8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d8157ac0 0x7fa0d8157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dfbc8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d806bc70 con 0x7fa0d8070c70 2024-05-08T04:21:57.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dfbc8640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d8071590 con 0x7fa0d815edf0 2024-05-08T04:21:57.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dfbc8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d80d15c0 con 0x7fa0d8157ac0 2024-05-08T04:21:57.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dd964640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa0d8070c70 0x7fa0d8071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dd964640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa0d8070c70 0x7fa0d8071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52422/0 (socket says 172.21.15.104:52422) 2024-05-08T04:21:57.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dd964640 1 -- 172.21.15.104:0/112426345 learned_addr learned my addr 172.21.15.104:0/112426345 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:57.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dd964640 1 -- 172.21.15.104:0/112426345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d8157ac0 msgr2=0x7fa0d8157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:57.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dd964640 1 --2- 172.21.15.104:0/112426345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d8157ac0 0x7fa0d8157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dd964640 1 -- 172.21.15.104:0/112426345 >> v2:172.21.15.183:3300/0 conn(0x7fa0d815edf0 msgr2=0x7fa0d80b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:57.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dd964640 1 --2- 172.21.15.104:0/112426345 >> v2:172.21.15.183:3300/0 conn(0x7fa0d815edf0 0x7fa0d80b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.325+0000 7fa0dd964640 1 -- 172.21.15.104:0/112426345 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d815f550 con 0x7fa0d8070c70 2024-05-08T04:21:57.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.326+0000 7fa0dd964640 1 --2- 172.21.15.104:0/112426345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0d8070c70 0x7fa0d8071050 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80b4150 tx=0x7fa0d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdac71ad12087aff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:57.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.326+0000 7fa0dc962640 1 -- 172.21.15.104:0/112426345 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4037070 con 0x7fa0d8070c70 2024-05-08T04:21:57.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.326+0000 7fa0dc962640 1 -- 172.21.15.104:0/112426345 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d4032440 con 0x7fa0d8070c70 2024-05-08T04:21:57.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.326+0000 7fa0dc962640 1 -- 172.21.15.104:0/112426345 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4032810 con 0x7fa0d8070c70 2024-05-08T04:21:57.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.327+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/112426345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0d8070c70 msgr2=0x7fa0d8071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.327+0000 7fa0dfbc8640 1 --2- 172.21.15.104:0/112426345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0d8070c70 0x7fa0d8071050 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80b4150 tx=0x7fa0d402a1e0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.327+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/112426345 shutdown_connections 2024-05-08T04:21:57.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.327+0000 7fa0dfbc8640 1 --2- 172.21.15.104:0/112426345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d8157ac0 0x7fa0d8157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.327+0000 7fa0dfbc8640 1 --2- 172.21.15.104:0/112426345 >> v2:172.21.15.183:3300/0 conn(0x7fa0d815edf0 0x7fa0d80b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.327+0000 7fa0dfbc8640 1 --2- 172.21.15.104:0/112426345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0d8070c70 0x7fa0d8071050 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.327+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/112426345 >> 172.21.15.104:0/112426345 conn(0x7fa0d80b3450 msgr2=0x7fa0d80b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:57.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.327+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/112426345 shutdown_connections 2024-05-08T04:21:57.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.327+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/112426345 wait complete. 2024-05-08T04:21:57.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.328+0000 7fa0dfbc8640 1 Processor -- start 2024-05-08T04:21:57.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.328+0000 7fa0dfbc8640 1 -- start start 2024-05-08T04:21:57.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dfbc8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0d8070c70 0x7fa0d80caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dfbc8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0d8157ac0 0x7fa0d8161750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dfbc8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d815edf0 0x7fa0d80cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dfbc8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d80b5b80 con 0x7fa0d8157ac0 2024-05-08T04:21:57.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dfbc8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d815fb10 con 0x7fa0d8070c70 2024-05-08T04:21:57.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dfbc8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d80b57e0 con 0x7fa0d815edf0 2024-05-08T04:21:57.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dd163640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0d8157ac0 0x7fa0d8161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dd163640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0d8157ac0 0x7fa0d8161750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52436/0 (socket says 172.21.15.104:52436) 2024-05-08T04:21:57.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dd163640 1 -- 172.21.15.104:0/1844491642 learned_addr learned my addr 172.21.15.104:0/1844491642 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:57.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dd163640 1 -- 172.21.15.104:0/1844491642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d815edf0 msgr2=0x7fa0d80cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dd163640 1 --2- 172.21.15.104:0/1844491642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d815edf0 0x7fa0d80cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dd163640 1 -- 172.21.15.104:0/1844491642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0d8070c70 msgr2=0x7fa0d80caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dd163640 1 --2- 172.21.15.104:0/1844491642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0d8070c70 0x7fa0d80caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dd163640 1 -- 172.21.15.104:0/1844491642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d81606b0 con 0x7fa0d8157ac0 2024-05-08T04:21:57.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dd163640 1 --2- 172.21.15.104:0/1844491642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0d8157ac0 0x7fa0d8161750 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800b410 tx=0x7fa0c800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:57.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0ce7fc640 1 -- 172.21.15.104:0/1844491642 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8015020 con 0x7fa0d8157ac0 2024-05-08T04:21:57.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0ce7fc640 1 -- 172.21.15.104:0/1844491642 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c8011850 con 0x7fa0d8157ac0 2024-05-08T04:21:57.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/1844491642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d8160990 con 0x7fa0d8157ac0 2024-05-08T04:21:57.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0ce7fc640 1 -- 172.21.15.104:0/1844491642 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8011c40 con 0x7fa0d8157ac0 2024-05-08T04:21:57.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.329+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/1844491642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d8160f50 con 0x7fa0d8157ac0 2024-05-08T04:21:57.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.330+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/1844491642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d8075010 con 0x7fa0d8157ac0 2024-05-08T04:21:57.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.331+0000 7fa0ce7fc640 1 -- 172.21.15.104:0/1844491642 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa0c8018020 con 0x7fa0d8157ac0 2024-05-08T04:21:57.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.331+0000 7fa0ce7fc640 1 --2- 172.21.15.104:0/1844491642 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa0bc06b4d0 0x7fa0bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.331+0000 7fa0ce7fc640 1 -- 172.21.15.104:0/1844491642 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa0c808a0f0 con 0x7fa0d8157ac0 2024-05-08T04:21:57.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.331+0000 7fa0dd964640 1 --2- 172.21.15.104:0/1844491642 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa0bc06b4d0 0x7fa0bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.332+0000 7fa0dd964640 1 --2- 172.21.15.104:0/1844491642 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa0bc06b4d0 0x7fa0bc06d990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4034000 tx=0x7fa0d402c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:57.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.336+0000 7fa0ce7fc640 1 -- 172.21.15.104:0/1844491642 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa0c801f020 con 0x7fa0d8157ac0 2024-05-08T04:21:57.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.505+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/1844491642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0d80b10a0 con 0x7fa0d8157ac0 2024-05-08T04:21:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.506+0000 7fa0ce7fc640 1 -- 172.21.15.104:0/1844491642 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16718 (secure 0 0 0) 0x7fa0c80172c0 con 0x7fa0d8157ac0 2024-05-08T04:21:57.509 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:21:57.509 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:21:53.967875+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:21:08.633944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T04:21:09.101547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:21:57.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.509+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/1844491642 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa0bc06b4d0 msgr2=0x7fa0bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.509+0000 7fa0dfbc8640 1 --2- 172.21.15.104:0/1844491642 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa0bc06b4d0 0x7fa0bc06d990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4034000 tx=0x7fa0d402c000 comp rx=0 tx=0).stop 2024-05-08T04:21:57.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.509+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/1844491642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0d8157ac0 msgr2=0x7fa0d8161750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.509+0000 7fa0dfbc8640 1 --2- 172.21.15.104:0/1844491642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0d8157ac0 0x7fa0d8161750 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800b410 tx=0x7fa0c800b8d0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.509+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/1844491642 shutdown_connections 2024-05-08T04:21:57.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.509+0000 7fa0dfbc8640 1 --2- 172.21.15.104:0/1844491642 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa0bc06b4d0 0x7fa0bc06d990 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.509+0000 7fa0dfbc8640 1 --2- 172.21.15.104:0/1844491642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d815edf0 0x7fa0d80cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.509+0000 7fa0dfbc8640 1 --2- 172.21.15.104:0/1844491642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0d8157ac0 0x7fa0d8161750 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.509+0000 7fa0dfbc8640 1 --2- 172.21.15.104:0/1844491642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0d8070c70 0x7fa0d80caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.509+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/1844491642 >> 172.21.15.104:0/1844491642 conn(0x7fa0d80b3450 msgr2=0x7fa0d8157220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:57.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.509+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/1844491642 shutdown_connections 2024-05-08T04:21:57.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.509+0000 7fa0dfbc8640 1 -- 172.21.15.104:0/1844491642 wait complete. 2024-05-08T04:21:57.522 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T04:21:57.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.620+0000 7f097b81f640 1 Processor -- start 2024-05-08T04:21:57.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.620+0000 7f097b81f640 1 -- start start 2024-05-08T04:21:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.621+0000 7f097b81f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0974161190 0x7f0974072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.621+0000 7f097b81f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f097406bb70 0x7f097406bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.621+0000 7f097b81f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097406de30 con 0x7f0974072a70 2024-05-08T04:21:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.621+0000 7f097b81f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09740b4db0 con 0x7f097406bb70 2024-05-08T04:21:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.621+0000 7f097b81f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097406c500 con 0x7f0974161190 2024-05-08T04:21:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.621+0000 7f09795bb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0974161190 0x7f0974072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.621+0000 7f09795bb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0974161190 0x7f0974072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:52500/0 (socket says 172.21.15.104:52500) 2024-05-08T04:21:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.621+0000 7f09795bb640 1 -- 172.21.15.104:0/2438541686 learned_addr learned my addr 172.21.15.104:0/2438541686 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.621+0000 7f0979dbc640 1 --2- 172.21.15.104:0/2438541686 >> v2:172.21.15.183:3300/0 conn(0x7f097406bb70 0x7f097406bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.622+0000 7f09795bb640 1 -- 172.21.15.104:0/2438541686 >> v2:172.21.15.183:3300/0 conn(0x7f097406bb70 msgr2=0x7f097406bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.622+0000 7f09795bb640 1 --2- 172.21.15.104:0/2438541686 >> v2:172.21.15.183:3300/0 conn(0x7f097406bb70 0x7f097406bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.622+0000 7f09795bb640 1 -- 172.21.15.104:0/2438541686 >> v1:172.21.15.183:6789/0 conn(0x7f0974072a70 legacy=0x7f09740acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.622+0000 7f09795bb640 1 -- 172.21.15.104:0/2438541686 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097406e110 con 0x7f0974161190 2024-05-08T04:21:57.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.622+0000 7f0979dbc640 1 --2- 172.21.15.104:0/2438541686 >> v2:172.21.15.183:3300/0 conn(0x7f097406bb70 0x7f097406bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:21:57.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.622+0000 7f09795bb640 1 --2- 172.21.15.104:0/2438541686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0974161190 0x7f0974072530 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0970009e50 tx=0x7f097002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50bfa7f86a5c10c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:57.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.622+0000 7f096bfff640 1 -- 172.21.15.104:0/2438541686 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970036070 con 0x7f0974161190 2024-05-08T04:21:57.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.623+0000 7f096bfff640 1 -- 172.21.15.104:0/2438541686 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0970031600 con 0x7f0974161190 2024-05-08T04:21:57.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.623+0000 7f096bfff640 1 -- 172.21.15.104:0/2438541686 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09700319d0 con 0x7f0974161190 2024-05-08T04:21:57.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.623+0000 7f097b81f640 1 -- 172.21.15.104:0/2438541686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0974161190 msgr2=0x7f0974072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.623+0000 7f097b81f640 1 --2- 172.21.15.104:0/2438541686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0974161190 0x7f0974072530 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0970009e50 tx=0x7f097002a710 comp rx=0 tx=0).stop 2024-05-08T04:21:57.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.623+0000 7f097b81f640 1 -- 172.21.15.104:0/2438541686 shutdown_connections 2024-05-08T04:21:57.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.623+0000 7f097b81f640 1 --2- 172.21.15.104:0/2438541686 >> v2:172.21.15.183:3300/0 conn(0x7f097406bb70 0x7f097406bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.623+0000 7f097b81f640 1 --2- 172.21.15.104:0/2438541686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0974161190 0x7f0974072530 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.623+0000 7f097b81f640 1 -- 172.21.15.104:0/2438541686 >> 172.21.15.104:0/2438541686 conn(0x7f0974071a10 msgr2=0x7f0974071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:57.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.623+0000 7f097b81f640 1 -- 172.21.15.104:0/2438541686 shutdown_connections 2024-05-08T04:21:57.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.623+0000 7f097b81f640 1 -- 172.21.15.104:0/2438541686 wait complete. 2024-05-08T04:21:57.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.624+0000 7f097b81f640 1 Processor -- start 2024-05-08T04:21:57.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.624+0000 7f097b81f640 1 -- start start 2024-05-08T04:21:57.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.625+0000 7f097b81f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f097406bb70 0x7f0974146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.625+0000 7f097b81f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0974161190 0x7f0974152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.625+0000 7f097b81f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0974150b70 0x7f097415ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.625+0000 7f097b81f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097406e9b0 con 0x7f0974161190 2024-05-08T04:21:57.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.625+0000 7f097b81f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097406e6d0 con 0x7f0974150b70 2024-05-08T04:21:57.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.625+0000 7f097b81f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09740ad500 con 0x7f097406bb70 2024-05-08T04:21:57.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.625+0000 7f0978dba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0974161190 0x7f0974152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.625+0000 7f0978dba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0974161190 0x7f0974152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40756/0 (socket says 172.21.15.104:40756) 2024-05-08T04:21:57.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.625+0000 7f0978dba640 1 -- 172.21.15.104:0/148677987 learned_addr learned my addr 172.21.15.104:0/148677987 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:57.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.625+0000 7f0979dbc640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0974150b70 0x7f097415ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.625+0000 7f09795bb640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f097406bb70 0x7f0974146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.626+0000 7f0978dba640 1 -- 172.21.15.104:0/148677987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f097406bb70 msgr2=0x7f0974146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.626+0000 7f0978dba640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f097406bb70 0x7f0974146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.626+0000 7f0978dba640 1 -- 172.21.15.104:0/148677987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0974150b70 msgr2=0x7f097415ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.626+0000 7f0978dba640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0974150b70 0x7f097415ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.626+0000 7f0978dba640 1 -- 172.21.15.104:0/148677987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09741538a0 con 0x7f0974161190 2024-05-08T04:21:57.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.626+0000 7f0978dba640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0974161190 0x7f0974152f30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f096400c430 tx=0x7f096400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:57.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.626+0000 7f0969ffb640 1 -- 172.21.15.104:0/148677987 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09640052d0 con 0x7f0974161190 2024-05-08T04:21:57.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.626+0000 7f0969ffb640 1 -- 172.21.15.104:0/148677987 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0964005490 con 0x7f0974161190 2024-05-08T04:21:57.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.626+0000 7f0969ffb640 1 -- 172.21.15.104:0/148677987 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964007260 con 0x7f0974161190 2024-05-08T04:21:57.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.626+0000 7f097b81f640 1 -- 172.21.15.104:0/148677987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0974153b80 con 0x7f0974161190 2024-05-08T04:21:57.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.626+0000 7f097b81f640 1 -- 172.21.15.104:0/148677987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09741585f0 con 0x7f0974161190 2024-05-08T04:21:57.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.627+0000 7f097b81f640 1 -- 172.21.15.104:0/148677987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09740b15c0 con 0x7f0974161190 2024-05-08T04:21:57.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.627+0000 7f0969ffb640 1 -- 172.21.15.104:0/148677987 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0964007400 con 0x7f0974161190 2024-05-08T04:21:57.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.628+0000 7f0969ffb640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f095806b4d0 0x7f095806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.628+0000 7f09795bb640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f095806b4d0 0x7f095806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.628+0000 7f0969ffb640 1 -- 172.21.15.104:0/148677987 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0964089520 con 0x7f0974161190 2024-05-08T04:21:57.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.628+0000 7f09795bb640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f095806b4d0 0x7f095806d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0970033000 tx=0x7f0970009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:57.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.632+0000 7f0969ffb640 1 -- 172.21.15.104:0/148677987 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f09740b15c0 con 0x7f0974161190 2024-05-08T04:21:57.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.841+0000 7f097b81f640 1 -- 172.21.15.104:0/148677987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0974075010 con 0x7f0974161190 2024-05-08T04:21:57.844 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-05-08T04:21:57.842+0000 7f0fa0f98640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T04:21:57.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.843+0000 7f0969ffb640 1 -- 172.21.15.104:0/148677987 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0964057dc0 con 0x7f0974161190 2024-05-08T04:21:57.845 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T04:21:57.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.845+0000 7f097b81f640 1 -- 172.21.15.104:0/148677987 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f095806b4d0 msgr2=0x7f095806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.845+0000 7f097b81f640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f095806b4d0 0x7f095806d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0970033000 tx=0x7f0970009000 comp rx=0 tx=0).stop 2024-05-08T04:21:57.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.845+0000 7f097b81f640 1 -- 172.21.15.104:0/148677987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0974161190 msgr2=0x7f0974152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.845+0000 7f097b81f640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0974161190 0x7f0974152f30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f096400c430 tx=0x7f096400c830 comp rx=0 tx=0).stop 2024-05-08T04:21:57.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.845+0000 7f097b81f640 1 -- 172.21.15.104:0/148677987 shutdown_connections 2024-05-08T04:21:57.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.845+0000 7f097b81f640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f095806b4d0 0x7f095806d990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.845+0000 7f097b81f640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0974150b70 0x7f097415ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.845+0000 7f097b81f640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0974161190 0x7f0974152f30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.845+0000 7f097b81f640 1 --2- 172.21.15.104:0/148677987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f097406bb70 0x7f0974146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.845+0000 7f097b81f640 1 -- 172.21.15.104:0/148677987 >> 172.21.15.104:0/148677987 conn(0x7f0974071a10 msgr2=0x7f0974071df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:57.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.845+0000 7f097b81f640 1 -- 172.21.15.104:0/148677987 shutdown_connections 2024-05-08T04:21:57.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.845+0000 7f097b81f640 1 -- 172.21.15.104:0/148677987 wait complete. 2024-05-08T04:21:57.849 INFO:tasks.ceph.mds.a.smithi104.stderr: -2951> 2024-05-08T04:21:15.238+0000 7f239060e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T04:21:57.861 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T04:21:57.880 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-05-08T04:21:57.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.962+0000 7efef1bb7640 1 Processor -- start 2024-05-08T04:21:57.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.962+0000 7efef1bb7640 1 -- start start 2024-05-08T04:21:57.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efef1bb7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeec161190 0x7efeec072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efef1bb7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efeec072a70 0x7efeec0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efef1bb7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efeec0ad330 0x7efeec06bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efef1bb7640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeec0b4db0 con 0x7efeec072a70 2024-05-08T04:21:57.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efef1bb7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeec06de30 con 0x7efeec0ad330 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efef1bb7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec06e110 con 0x7efeec161190 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efeeaffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efeec072a70 0x7efeec0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efeeaffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efeec072a70 0x7efeec0acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40792/0 (socket says 172.21.15.104:40792) 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efeeaffd640 1 -- 172.21.15.104:0/1104614929 learned_addr learned my addr 172.21.15.104:0/1104614929 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efeeaffd640 1 -- 172.21.15.104:0/1104614929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeec161190 msgr2=0x7efeec072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efeeb7fe640 1 --2- 172.21.15.104:0/1104614929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeec161190 0x7efeec072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efeebfff640 1 --2- 172.21.15.104:0/1104614929 >> v2:172.21.15.183:3300/0 conn(0x7efeec0ad330 0x7efeec06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efeeaffd640 1 --2- 172.21.15.104:0/1104614929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeec161190 0x7efeec072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efeeaffd640 1 -- 172.21.15.104:0/1104614929 >> v2:172.21.15.183:3300/0 conn(0x7efeec0ad330 msgr2=0x7efeec06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efeeaffd640 1 --2- 172.21.15.104:0/1104614929 >> v2:172.21.15.183:3300/0 conn(0x7efeec0ad330 0x7efeec06bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.963+0000 7efeeaffd640 1 -- 172.21.15.104:0/1104614929 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec06e3f0 con 0x7efeec072a70 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.964+0000 7efeeaffd640 1 --2- 172.21.15.104:0/1104614929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efeec072a70 0x7efeec0acdf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7efeec071580 tx=0x7efee002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f0f6f5f009ab7b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.964+0000 7efeea7fc640 1 -- 172.21.15.104:0/1104614929 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee0036070 con 0x7efeec072a70 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.964+0000 7efeea7fc640 1 -- 172.21.15.104:0/1104614929 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee0031600 con 0x7efeec072a70 2024-05-08T04:21:57.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.964+0000 7efeea7fc640 1 -- 172.21.15.104:0/1104614929 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee00319d0 con 0x7efeec072a70 2024-05-08T04:21:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.965+0000 7efef1bb7640 1 -- 172.21.15.104:0/1104614929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efeec072a70 msgr2=0x7efeec0acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.965+0000 7efef1bb7640 1 --2- 172.21.15.104:0/1104614929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efeec072a70 0x7efeec0acdf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7efeec071580 tx=0x7efee002a6a0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.965+0000 7efef1bb7640 1 -- 172.21.15.104:0/1104614929 shutdown_connections 2024-05-08T04:21:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.965+0000 7efef1bb7640 1 --2- 172.21.15.104:0/1104614929 >> v2:172.21.15.183:3300/0 conn(0x7efeec0ad330 0x7efeec06bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.965+0000 7efef1bb7640 1 --2- 172.21.15.104:0/1104614929 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efeec072a70 0x7efeec0acdf0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.965+0000 7efef1bb7640 1 --2- 172.21.15.104:0/1104614929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeec161190 0x7efeec072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.965+0000 7efef1bb7640 1 -- 172.21.15.104:0/1104614929 >> 172.21.15.104:0/1104614929 conn(0x7efeec071a10 msgr2=0x7efeec071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.965+0000 7efef1bb7640 1 -- 172.21.15.104:0/1104614929 shutdown_connections 2024-05-08T04:21:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.965+0000 7efef1bb7640 1 -- 172.21.15.104:0/1104614929 wait complete. 2024-05-08T04:21:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.966+0000 7efef1bb7640 1 Processor -- start 2024-05-08T04:21:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.966+0000 7efef1bb7640 1 -- start start 2024-05-08T04:21:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efef1bb7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeec0ad330 0x7efeec146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efef1bb7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeec161190 0x7efeec14bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efef1bb7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efeec14c180 0x7efeec1e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efef1bb7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec06da70 con 0x7efeec14c180 2024-05-08T04:21:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efef1bb7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec06e9b0 con 0x7efeec0ad330 2024-05-08T04:21:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efef1bb7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec06dbf0 con 0x7efeec161190 2024-05-08T04:21:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efeebfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efeec14c180 0x7efeec1e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efeebfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efeec14c180 0x7efeec1e75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40796/0 (socket says 172.21.15.104:40796) 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efeebfff640 1 -- 172.21.15.104:0/1706942032 learned_addr learned my addr 172.21.15.104:0/1706942032 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efeeb7fe640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeec0ad330 0x7efeec146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efeeaffd640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeec161190 0x7efeec14bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efeebfff640 1 -- 172.21.15.104:0/1706942032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeec161190 msgr2=0x7efeec14bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efeebfff640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeec161190 0x7efeec14bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efeebfff640 1 -- 172.21.15.104:0/1706942032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeec0ad330 msgr2=0x7efeec146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efeebfff640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeec0ad330 0x7efeec146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efeebfff640 1 -- 172.21.15.104:0/1706942032 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec1e85e0 con 0x7efeec14c180 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.967+0000 7efeebfff640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efeec14c180 0x7efeec1e75d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efee400c5a0 tx=0x7efee400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.968+0000 7efed3fff640 1 -- 172.21.15.104:0/1706942032 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4015070 con 0x7efeec14c180 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.968+0000 7efed3fff640 1 -- 172.21.15.104:0/1706942032 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee4004220 con 0x7efeec14c180 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.968+0000 7efef1bb7640 1 -- 172.21.15.104:0/1706942032 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec1e8300 con 0x7efeec14c180 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.968+0000 7efed3fff640 1 -- 172.21.15.104:0/1706942032 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4003610 con 0x7efeec14c180 2024-05-08T04:21:57.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.968+0000 7efef1bb7640 1 -- 172.21.15.104:0/1706942032 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec14d550 con 0x7efeec14c180 2024-05-08T04:21:57.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.969+0000 7efef1bb7640 1 -- 172.21.15.104:0/1706942032 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec075010 con 0x7efeec14c180 2024-05-08T04:21:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.969+0000 7efed3fff640 1 -- 172.21.15.104:0/1706942032 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efee40037b0 con 0x7efeec14c180 2024-05-08T04:21:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.969+0000 7efed3fff640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efed806b4d0 0x7efed806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.970+0000 7efed3fff640 1 -- 172.21.15.104:0/1706942032 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5824+0+0 (secure 0 0 0) 0x7efee408a0e0 con 0x7efeec14c180 2024-05-08T04:21:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.970+0000 7efeeb7fe640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efed806b4d0 0x7efed806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.970+0000 7efeeb7fe640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efed806b4d0 0x7efed806d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efedc006fd0 tx=0x7efedc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:57.974+0000 7efed3fff640 1 -- 172.21.15.104:0/1706942032 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efee4058e60 con 0x7efeec14c180 2024-05-08T04:21:58.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.180+0000 7efef1bb7640 1 -- 172.21.15.104:0/1706942032 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efeec066a30 con 0x7efeec14c180 2024-05-08T04:21:58.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.845+0000 7efed3fff640 1 -- 172.21.15.104:0/1706942032 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7efee4058760 con 0x7efeec14c180 2024-05-08T04:21:58.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.847+0000 7efef1bb7640 1 -- 172.21.15.104:0/1706942032 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efed806b4d0 msgr2=0x7efed806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:58.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.847+0000 7efef1bb7640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efed806b4d0 0x7efed806d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efedc006fd0 tx=0x7efedc008040 comp rx=0 tx=0).stop 2024-05-08T04:21:58.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.847+0000 7efef1bb7640 1 -- 172.21.15.104:0/1706942032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efeec14c180 msgr2=0x7efeec1e75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:58.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.847+0000 7efef1bb7640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efeec14c180 0x7efeec1e75d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efee400c5a0 tx=0x7efee400ca60 comp rx=0 tx=0).stop 2024-05-08T04:21:58.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.847+0000 7efef1bb7640 1 -- 172.21.15.104:0/1706942032 shutdown_connections 2024-05-08T04:21:58.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.847+0000 7efef1bb7640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efed806b4d0 0x7efed806d990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:58.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.847+0000 7efef1bb7640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efeec14c180 0x7efeec1e75d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:58.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.847+0000 7efef1bb7640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeec161190 0x7efeec14bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:58.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.847+0000 7efef1bb7640 1 --2- 172.21.15.104:0/1706942032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeec0ad330 0x7efeec146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:58.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.847+0000 7efef1bb7640 1 -- 172.21.15.104:0/1706942032 >> 172.21.15.104:0/1706942032 conn(0x7efeec071a10 msgr2=0x7efeec15b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:58.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.848+0000 7efef1bb7640 1 -- 172.21.15.104:0/1706942032 shutdown_connections 2024-05-08T04:21:58.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:58.848+0000 7efef1bb7640 1 -- 172.21.15.104:0/1706942032 wait complete. 2024-05-08T04:21:58.863 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T04:21:59.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.011+0000 7fc697446640 1 Processor -- start 2024-05-08T04:21:59.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.011+0000 7fc697446640 1 -- start start 2024-05-08T04:21:59.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.012+0000 7fc697446640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc69015dad0 0x7fc6900d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:59.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.012+0000 7fc697446640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc6900b5b90 0x7fc6900b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:59.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.012+0000 7fc697446640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900b9920 con 0x7fc6900d35c0 2024-05-08T04:21:59.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.012+0000 7fc697446640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6900d2520 con 0x7fc6900b5b90 2024-05-08T04:21:59.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.012+0000 7fc697446640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900d2800 con 0x7fc69015dad0 2024-05-08T04:21:59.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.012+0000 7fc6959e3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc6900b5b90 0x7fc6900b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:59.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.012+0000 7fc6949e1640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc6900d35c0 0x7fc6900b5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53444/0 (socket says 172.21.15.104:53444) 2024-05-08T04:21:59.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.012+0000 7fc6949e1640 1 -- 172.21.15.104:0/2928977623 learned_addr learned my addr 172.21.15.104:0/2928977623 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:21:59.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.012+0000 7fc6951e2640 1 --2- 172.21.15.104:0/2928977623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc69015dad0 0x7fc6900d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:59.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.012+0000 7fc6959e3640 1 -- 172.21.15.104:0/2928977623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc69015dad0 msgr2=0x7fc6900d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:21:59.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.012+0000 7fc6959e3640 1 --2- 172.21.15.104:0/2928977623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc69015dad0 0x7fc6900d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:59.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.012+0000 7fc6959e3640 1 -- 172.21.15.104:0/2928977623 >> v1:172.21.15.104:6789/0 conn(0x7fc6900d35c0 legacy=0x7fc6900b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:59.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.013+0000 7fc687fff640 1 -- 172.21.15.104:0/2928977623 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686289637 0 0) 0x7fc6900b9920 con 0x7fc6900d35c0 2024-05-08T04:21:59.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.013+0000 7fc6959e3640 1 -- 172.21.15.104:0/2928977623 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900d2ae0 con 0x7fc6900b5b90 2024-05-08T04:21:59.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.013+0000 7fc6959e3640 1 --2- 172.21.15.104:0/2928977623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6900b5b90 0x7fc6900b6b30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc6880097a0 tx=0x7fc68802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67746e6f7c2cad18 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:59.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.013+0000 7fc687fff640 1 -- 172.21.15.104:0/2928977623 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688037070 con 0x7fc6900b5b90 2024-05-08T04:21:59.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.013+0000 7fc687fff640 1 -- 172.21.15.104:0/2928977623 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68802ae50 con 0x7fc6900b5b90 2024-05-08T04:21:59.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.013+0000 7fc687fff640 1 -- 172.21.15.104:0/2928977623 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688032660 con 0x7fc6900b5b90 2024-05-08T04:21:59.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.014+0000 7fc697446640 1 -- 172.21.15.104:0/2928977623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6900b5b90 msgr2=0x7fc6900b6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:59.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.014+0000 7fc697446640 1 --2- 172.21.15.104:0/2928977623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6900b5b90 0x7fc6900b6b30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc6880097a0 tx=0x7fc68802a100 comp rx=0 tx=0).stop 2024-05-08T04:21:59.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.014+0000 7fc697446640 1 -- 172.21.15.104:0/2928977623 shutdown_connections 2024-05-08T04:21:59.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.014+0000 7fc697446640 1 --2- 172.21.15.104:0/2928977623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6900b5b90 0x7fc6900b6b30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:59.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.014+0000 7fc697446640 1 --2- 172.21.15.104:0/2928977623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc69015dad0 0x7fc6900d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:59.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.014+0000 7fc697446640 1 -- 172.21.15.104:0/2928977623 >> 172.21.15.104:0/2928977623 conn(0x7fc69006c650 msgr2=0x7fc6900d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:21:59.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.014+0000 7fc697446640 1 -- 172.21.15.104:0/2928977623 shutdown_connections 2024-05-08T04:21:59.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.014+0000 7fc697446640 1 -- 172.21.15.104:0/2928977623 wait complete. 2024-05-08T04:21:59.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.015+0000 7fc697446640 1 Processor -- start 2024-05-08T04:21:59.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.015+0000 7fc697446640 1 -- start start 2024-05-08T04:21:59.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc697446640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6900b5b90 0x7fc6900cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:59.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc697446640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6900d35c0 0x7fc6900c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:59.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc697446640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc69015dad0 0x7fc6900cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc697446640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69015deb0 con 0x7fc6900b5b90 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc697446640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900d30a0 con 0x7fc69015dad0 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc697446640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69015e030 con 0x7fc6900d35c0 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc6951e2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6900b5b90 0x7fc6900cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc6951e2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6900b5b90 0x7fc6900cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40812/0 (socket says 172.21.15.104:40812) 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc6951e2640 1 -- 172.21.15.104:0/3090813969 learned_addr learned my addr 172.21.15.104:0/3090813969 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc6951e2640 1 -- 172.21.15.104:0/3090813969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6900d35c0 msgr2=0x7fc6900c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc6951e2640 1 --2- 172.21.15.104:0/3090813969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6900d35c0 0x7fc6900c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc6951e2640 1 -- 172.21.15.104:0/3090813969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc69015dad0 msgr2=0x7fc6900cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc6951e2640 1 --2- 172.21.15.104:0/3090813969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc69015dad0 0x7fc6900cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc6951e2640 1 -- 172.21.15.104:0/3090813969 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900cc390 con 0x7fc6900b5b90 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.016+0000 7fc6951e2640 1 --2- 172.21.15.104:0/3090813969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6900b5b90 0x7fc6900cd430 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc68c007e40 tx=0x7fc68c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.017+0000 7fc685ffb640 1 -- 172.21.15.104:0/3090813969 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c014620 con 0x7fc6900b5b90 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.017+0000 7fc685ffb640 1 -- 172.21.15.104:0/3090813969 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c019070 con 0x7fc6900b5b90 2024-05-08T04:21:59.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.017+0000 7fc685ffb640 1 -- 172.21.15.104:0/3090813969 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c014a00 con 0x7fc6900b5b90 2024-05-08T04:21:59.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.017+0000 7fc697446640 1 -- 172.21.15.104:0/3090813969 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6900cc670 con 0x7fc6900b5b90 2024-05-08T04:21:59.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.017+0000 7fc697446640 1 -- 172.21.15.104:0/3090813969 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6900ccc30 con 0x7fc6900b5b90 2024-05-08T04:21:59.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.018+0000 7fc697446640 1 -- 172.21.15.104:0/3090813969 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6900d2030 con 0x7fc6900b5b90 2024-05-08T04:21:59.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.018+0000 7fc685ffb640 1 -- 172.21.15.104:0/3090813969 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc68c014ba0 con 0x7fc6900b5b90 2024-05-08T04:21:59.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.019+0000 7fc685ffb640 1 --2- 172.21.15.104:0/3090813969 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc67406b4d0 0x7fc67406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:21:59.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.019+0000 7fc6949e1640 1 --2- 172.21.15.104:0/3090813969 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc67406b4d0 0x7fc67406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:21:59.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.019+0000 7fc685ffb640 1 -- 172.21.15.104:0/3090813969 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fc68c08aa50 con 0x7fc6900b5b90 2024-05-08T04:21:59.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.019+0000 7fc6949e1640 1 --2- 172.21.15.104:0/3090813969 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc67406b4d0 0x7fc67406d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc680005880 tx=0x7fc680007950 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:21:59.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.023+0000 7fc685ffb640 1 -- 172.21.15.104:0/3090813969 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc6900d2030 con 0x7fc6900b5b90 2024-05-08T04:21:59.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.191+0000 7fc697446640 1 -- 172.21.15.104:0/3090813969 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc690075010 con 0x7fc6900b5b90 2024-05-08T04:21:59.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:21:59.997+0000 7fc685ffb640 1 -- 172.21.15.104:0/3090813969 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc68c059860 con 0x7fc6900b5b90 2024-05-08T04:22:00.000 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-05-08T04:22:00.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.000+0000 7fc697446640 1 -- 172.21.15.104:0/3090813969 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc67406b4d0 msgr2=0x7fc67406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:00.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.000+0000 7fc697446640 1 --2- 172.21.15.104:0/3090813969 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc67406b4d0 0x7fc67406d990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc680005880 tx=0x7fc680007950 comp rx=0 tx=0).stop 2024-05-08T04:22:00.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.000+0000 7fc697446640 1 -- 172.21.15.104:0/3090813969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6900b5b90 msgr2=0x7fc6900cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:00.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.000+0000 7fc697446640 1 --2- 172.21.15.104:0/3090813969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6900b5b90 0x7fc6900cd430 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc68c007e40 tx=0x7fc68c00e4b0 comp rx=0 tx=0).stop 2024-05-08T04:22:00.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.000+0000 7fc697446640 1 -- 172.21.15.104:0/3090813969 shutdown_connections 2024-05-08T04:22:00.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.000+0000 7fc697446640 1 --2- 172.21.15.104:0/3090813969 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc67406b4d0 0x7fc67406d990 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:00.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.000+0000 7fc697446640 1 --2- 172.21.15.104:0/3090813969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc69015dad0 0x7fc6900cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:00.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.000+0000 7fc697446640 1 --2- 172.21.15.104:0/3090813969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6900d35c0 0x7fc6900c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:00.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.000+0000 7fc697446640 1 --2- 172.21.15.104:0/3090813969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc6900b5b90 0x7fc6900cd430 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:00.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.000+0000 7fc697446640 1 -- 172.21.15.104:0/3090813969 >> 172.21.15.104:0/3090813969 conn(0x7fc69006c650 msgr2=0x7fc6900b6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:00.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.000+0000 7fc697446640 1 -- 172.21.15.104:0/3090813969 shutdown_connections 2024-05-08T04:22:00.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.000+0000 7fc697446640 1 -- 172.21.15.104:0/3090813969 wait complete. 2024-05-08T04:22:00.016 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T04:22:00.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.122+0000 7f901979e640 1 Processor -- start 2024-05-08T04:22:00.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.122+0000 7f901979e640 1 -- start start 2024-05-08T04:22:00.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f901979e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90140ce5a0 0x7f9014161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:00.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f901979e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f90140d07c0 0x7f90140d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:00.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f901979e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901415e1f0 con 0x7f901415de10 2024-05-08T04:22:00.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f901979e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90140d0f50 con 0x7f90140d07c0 2024-05-08T04:22:00.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f901979e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9014161e60 con 0x7f90140ce5a0 2024-05-08T04:22:00.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f90137fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f90140d07c0 0x7f90140d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:00.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f9012ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f901415de10 0x7f90140d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53458/0 (socket says 172.21.15.104:53458) 2024-05-08T04:22:00.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f9012ffd640 1 -- 172.21.15.104:0/2427044920 learned_addr learned my addr 172.21.15.104:0/2427044920 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:00.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f900bfff640 1 --2- 172.21.15.104:0/2427044920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90140ce5a0 0x7f9014161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:00.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f90137fe640 1 -- 172.21.15.104:0/2427044920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90140ce5a0 msgr2=0x7f9014161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:00.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f90137fe640 1 --2- 172.21.15.104:0/2427044920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90140ce5a0 0x7f9014161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:00.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f90137fe640 1 -- 172.21.15.104:0/2427044920 >> v1:172.21.15.104:6789/0 conn(0x7f901415de10 legacy=0x7f90140d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:00.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f90137fe640 1 -- 172.21.15.104:0/2427044920 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9014162090 con 0x7f90140d07c0 2024-05-08T04:22:00.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.123+0000 7f90127fc640 1 -- 172.21.15.104:0/2427044920 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161476416 0 0) 0x7f901415e1f0 con 0x7f901415de10 2024-05-08T04:22:00.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.124+0000 7f90137fe640 1 --2- 172.21.15.104:0/2427044920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90140d07c0 0x7f90140d2200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f900c009d90 tx=0x7f900c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600a5fb191f92891 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:00.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.124+0000 7f90127fc640 1 -- 172.21.15.104:0/2427044920 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c031600 con 0x7f90140d07c0 2024-05-08T04:22:00.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.124+0000 7f90127fc640 1 -- 172.21.15.104:0/2427044920 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c0317a0 con 0x7f90140d07c0 2024-05-08T04:22:00.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.124+0000 7f90127fc640 1 -- 172.21.15.104:0/2427044920 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c031b70 con 0x7f90140d07c0 2024-05-08T04:22:00.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.125+0000 7f901979e640 1 -- 172.21.15.104:0/2427044920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90140d07c0 msgr2=0x7f90140d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:00.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.125+0000 7f901979e640 1 --2- 172.21.15.104:0/2427044920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90140d07c0 0x7f90140d2200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f900c009d90 tx=0x7f900c02a5d0 comp rx=0 tx=0).stop 2024-05-08T04:22:00.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.125+0000 7f901979e640 1 -- 172.21.15.104:0/2427044920 shutdown_connections 2024-05-08T04:22:00.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.125+0000 7f901979e640 1 --2- 172.21.15.104:0/2427044920 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90140d07c0 0x7f90140d2200 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:00.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.125+0000 7f901979e640 1 --2- 172.21.15.104:0/2427044920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90140ce5a0 0x7f9014161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:00.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.125+0000 7f901979e640 1 -- 172.21.15.104:0/2427044920 >> 172.21.15.104:0/2427044920 conn(0x7f9014072290 msgr2=0x7f9014072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:00.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.125+0000 7f901979e640 1 -- 172.21.15.104:0/2427044920 shutdown_connections 2024-05-08T04:22:00.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.125+0000 7f901979e640 1 -- 172.21.15.104:0/2427044920 wait complete. 2024-05-08T04:22:00.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.126+0000 7f901979e640 1 Processor -- start 2024-05-08T04:22:00.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.126+0000 7f901979e640 1 -- start start 2024-05-08T04:22:00.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f901979e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90140ce5a0 0x7f901414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:00.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f901979e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90140d07c0 0x7f901414d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:00.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f901979e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f901415de10 0x7f901415f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:00.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f901979e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9014162650 con 0x7f901415de10 2024-05-08T04:22:00.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f901979e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90140d1a90 con 0x7f90140ce5a0 2024-05-08T04:22:00.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f901979e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90140d1ce0 con 0x7f90140d07c0 2024-05-08T04:22:00.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f90137fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f901415de10 0x7f901415f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:00.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f90137fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f901415de10 0x7f901415f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40836/0 (socket says 172.21.15.104:40836) 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f90137fe640 1 -- 172.21.15.104:0/2582060087 learned_addr learned my addr 172.21.15.104:0/2582060087 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f9012ffd640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90140ce5a0 0x7f901414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f900bfff640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90140d07c0 0x7f901414d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f90137fe640 1 -- 172.21.15.104:0/2582060087 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90140d07c0 msgr2=0x7f901414d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f90137fe640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90140d07c0 0x7f901414d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f90137fe640 1 -- 172.21.15.104:0/2582060087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90140ce5a0 msgr2=0x7f901414ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f90137fe640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90140ce5a0 0x7f901414ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f90137fe640 1 -- 172.21.15.104:0/2582060087 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901415f550 con 0x7f901415de10 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.127+0000 7f90137fe640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f901415de10 0x7f901415f010 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f900c009eb0 tx=0x7f900c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.128+0000 7f900b7fe640 1 -- 172.21.15.104:0/2582060087 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c040070 con 0x7f901415de10 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.128+0000 7f900b7fe640 1 -- 172.21.15.104:0/2582060087 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c030b60 con 0x7f901415de10 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.128+0000 7f901979e640 1 -- 172.21.15.104:0/2582060087 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901415f820 con 0x7f901415de10 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.128+0000 7f900b7fe640 1 -- 172.21.15.104:0/2582060087 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c009450 con 0x7f901415de10 2024-05-08T04:22:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.128+0000 7f901979e640 1 -- 172.21.15.104:0/2582060087 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90140cc140 con 0x7f901415de10 2024-05-08T04:22:00.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.129+0000 7f901979e640 1 -- 172.21.15.104:0/2582060087 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9014075010 con 0x7f901415de10 2024-05-08T04:22:00.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.129+0000 7f900b7fe640 1 -- 172.21.15.104:0/2582060087 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f900c039040 con 0x7f901415de10 2024-05-08T04:22:00.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.129+0000 7f900b7fe640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8ff406b500 0x7f8ff406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:00.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.130+0000 7f900b7fe640 1 -- 172.21.15.104:0/2582060087 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f900c0ab810 con 0x7f901415de10 2024-05-08T04:22:00.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.130+0000 7f9012ffd640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8ff406b500 0x7f8ff406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:00.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.130+0000 7f9012ffd640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8ff406b500 0x7f8ff406d9c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9004000f60 tx=0x7f9004007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:00.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.134+0000 7f900b7fe640 1 -- 172.21.15.104:0/2582060087 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f900c0443c0 con 0x7f901415de10 2024-05-08T04:22:00.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:00.302+0000 7f901979e640 1 -- 172.21.15.104:0/2582060087 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f90140d1870 con 0x7f901415de10 2024-05-08T04:22:01.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.002+0000 7f900b7fe640 1 -- 172.21.15.104:0/2582060087 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f900c07a7d0 con 0x7f901415de10 2024-05-08T04:22:01.005 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-05-08T04:22:01.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.006+0000 7f901979e640 1 -- 172.21.15.104:0/2582060087 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8ff406b500 msgr2=0x7f8ff406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:01.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.006+0000 7f901979e640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8ff406b500 0x7f8ff406d9c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9004000f60 tx=0x7f9004007c00 comp rx=0 tx=0).stop 2024-05-08T04:22:01.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.006+0000 7f901979e640 1 -- 172.21.15.104:0/2582060087 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f901415de10 msgr2=0x7f901415f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:01.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.006+0000 7f901979e640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f901415de10 0x7f901415f010 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f900c009eb0 tx=0x7f900c004a40 comp rx=0 tx=0).stop 2024-05-08T04:22:01.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.006+0000 7f901979e640 1 -- 172.21.15.104:0/2582060087 shutdown_connections 2024-05-08T04:22:01.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.006+0000 7f901979e640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8ff406b500 0x7f8ff406d9c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:01.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.006+0000 7f901979e640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f901415de10 0x7f901415f010 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:01.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.006+0000 7f901979e640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90140d07c0 0x7f901414d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:01.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.006+0000 7f901979e640 1 --2- 172.21.15.104:0/2582060087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90140ce5a0 0x7f901414ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:01.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.006+0000 7f901979e640 1 -- 172.21.15.104:0/2582060087 >> 172.21.15.104:0/2582060087 conn(0x7f9014072290 msgr2=0x7f901415a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:01.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.006+0000 7f901979e640 1 -- 172.21.15.104:0/2582060087 shutdown_connections 2024-05-08T04:22:01.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.006+0000 7f901979e640 1 -- 172.21.15.104:0/2582060087 wait complete. 2024-05-08T04:22:01.020 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T04:22:01.020 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-08T04:22:01.020 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T04:22:01.020 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:22:01.020 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T04:22:01.021 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-08T04:22:01.021 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T04:22:01.021 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:22:01.021 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T04:22:01.021 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-08T04:22:01.021 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T04:22:01.021 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:22:01.021 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T04:22:01.022 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-08T04:22:01.022 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T04:22:01.022 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:22:01.030 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T04:22:01.030 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T04:22:01.031 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T04:22:01.031 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T04:22:01.033 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T04:22:01.033 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T04:22:01.033 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T04:22:01.034 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T04:22:01.072 INFO:tasks.ceph.mds.a:Started 2024-05-08T04:22:01.073 DEBUG:teuthology.parallel:result is None 2024-05-08T04:22:01.074 INFO:tasks.ceph.mds.c:Started 2024-05-08T04:22:01.075 DEBUG:teuthology.parallel:result is None 2024-05-08T04:22:01.077 INFO:tasks.ceph.mds.b:Started 2024-05-08T04:22:01.077 DEBUG:teuthology.parallel:result is None 2024-05-08T04:22:01.078 INFO:tasks.ceph.mds.d:Started 2024-05-08T04:22:01.078 DEBUG:teuthology.parallel:result is None 2024-05-08T04:22:01.078 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-08T04:22:01.148 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-05-08T04:22:01.148 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-05-08T04:22:01.154 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2024-05-08T04:22:01.155 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2024-05-08T04:22:01.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.181+0000 7fe69f7b0640 1 Processor -- start 2024-05-08T04:22:01.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.181+0000 7fe69f7b0640 1 -- start start 2024-05-08T04:22:01.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.182+0000 7fe69f7b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe698143bb0 0x7fe6980af720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:01.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.182+0000 7fe69f7b0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe6980afc60 0x7fe6980722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:01.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.182+0000 7fe69dd4d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe6980afc60 0x7fe6980722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:01.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.182+0000 7fe69f7b0640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69815eb00 con 0x7fe698140a80 2024-05-08T04:22:01.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.182+0000 7fe69d54c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe698140a80 0x7fe69815e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53482/0 (socket says 172.21.15.104:53482) 2024-05-08T04:22:01.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.182+0000 7fe69f7b0640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe698140e60 con 0x7fe6980afc60 2024-05-08T04:22:01.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.182+0000 7fe69d54c640 1 -- 172.21.15.104:0/241653320 learned_addr learned my addr 172.21.15.104:0/241653320 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:01.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.182+0000 7fe69f7b0640 1 -- 172.21.15.104:0/241653320 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69815ede0 con 0x7fe698143bb0 2024-05-08T04:22:01.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.182+0000 7fe69cd4b640 1 --2- 172.21.15.104:0/241653320 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe698143bb0 0x7fe6980af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:01.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.182+0000 7fe69dd4d640 1 -- 172.21.15.104:0/241653320 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe698143bb0 msgr2=0x7fe6980af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:01.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.182+0000 7fe69dd4d640 1 --2- 172.21.15.104:0/241653320 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe698143bb0 0x7fe6980af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:01.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.182+0000 7fe69dd4d640 1 -- 172.21.15.104:0/241653320 >> v1:172.21.15.104:6789/0 conn(0x7fe698140a80 legacy=0x7fe69815e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:01.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.182+0000 7fe69dd4d640 1 -- 172.21.15.104:0/241653320 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6981433b0 con 0x7fe6980afc60 2024-05-08T04:22:01.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.183+0000 7fe69dd4d640 1 --2- 172.21.15.104:0/241653320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6980afc60 0x7fe6980722c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe690009d90 tx=0x7fe69002a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf7f83979b4920e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:01.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.183+0000 7fe68ffff640 1 -- 172.21.15.104:0/241653320 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690007740 con 0x7fe6980afc60 2024-05-08T04:22:01.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.183+0000 7fe68ffff640 1 -- 172.21.15.104:0/241653320 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6900078e0 con 0x7fe6980afc60 2024-05-08T04:22:01.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.183+0000 7fe68ffff640 1 -- 172.21.15.104:0/241653320 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690007cb0 con 0x7fe6980afc60 2024-05-08T04:22:01.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.184+0000 7fe69f7b0640 1 -- 172.21.15.104:0/241653320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6980afc60 msgr2=0x7fe6980722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:01.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.184+0000 7fe69f7b0640 1 --2- 172.21.15.104:0/241653320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6980afc60 0x7fe6980722c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe690009d90 tx=0x7fe69002a530 comp rx=0 tx=0).stop 2024-05-08T04:22:01.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.184+0000 7fe69f7b0640 1 -- 172.21.15.104:0/241653320 shutdown_connections 2024-05-08T04:22:01.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.184+0000 7fe69f7b0640 1 --2- 172.21.15.104:0/241653320 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6980afc60 0x7fe6980722c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:01.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.184+0000 7fe69f7b0640 1 --2- 172.21.15.104:0/241653320 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe698143bb0 0x7fe6980af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:01.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.184+0000 7fe69f7b0640 1 -- 172.21.15.104:0/241653320 >> 172.21.15.104:0/241653320 conn(0x7fe6980b23e0 msgr2=0x7fe6980b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:01.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.184+0000 7fe69f7b0640 1 -- 172.21.15.104:0/241653320 shutdown_connections 2024-05-08T04:22:01.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.184+0000 7fe69f7b0640 1 -- 172.21.15.104:0/241653320 wait complete. 2024-05-08T04:22:01.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.185+0000 7fe69f7b0640 1 Processor -- start 2024-05-08T04:22:01.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.185+0000 7fe69f7b0640 1 -- start start 2024-05-08T04:22:01.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69f7b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6980afc60 0x7fe6981f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:01.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69f7b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe698140a80 0x7fe698139e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:01.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69f7b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe698143bb0 0x7fe6981e8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:01.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69f7b0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69815e770 con 0x7fe698140a80 2024-05-08T04:22:01.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69f7b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe698144030 con 0x7fe6980afc60 2024-05-08T04:22:01.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69f7b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69806ad20 con 0x7fe698143bb0 2024-05-08T04:22:01.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69cd4b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe698140a80 0x7fe698139e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:01.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69cd4b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe698140a80 0x7fe698139e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40892/0 (socket says 172.21.15.104:40892) 2024-05-08T04:22:01.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69cd4b640 1 -- 172.21.15.104:0/4069976034 learned_addr learned my addr 172.21.15.104:0/4069976034 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:01.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69d54c640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6980afc60 0x7fe6981f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:01.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69dd4d640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe698143bb0 0x7fe6981e8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:01.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69cd4b640 1 -- 172.21.15.104:0/4069976034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe698143bb0 msgr2=0x7fe6981e8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:01.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69cd4b640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe698143bb0 0x7fe6981e8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:01.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69cd4b640 1 -- 172.21.15.104:0/4069976034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6980afc60 msgr2=0x7fe6981f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:01.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69cd4b640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6980afc60 0x7fe6981f6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:01.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69cd4b640 1 -- 172.21.15.104:0/4069976034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6981f7460 con 0x7fe698140a80 2024-05-08T04:22:01.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe69cd4b640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe698140a80 0x7fe698139e30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe68800e9e0 tx=0x7fe68800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:01.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe68dffb640 1 -- 172.21.15.104:0/4069976034 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688017070 con 0x7fe698140a80 2024-05-08T04:22:01.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.186+0000 7fe68dffb640 1 -- 172.21.15.104:0/4069976034 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68800c9d0 con 0x7fe698140a80 2024-05-08T04:22:01.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.187+0000 7fe68dffb640 1 -- 172.21.15.104:0/4069976034 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68800cdc0 con 0x7fe698140a80 2024-05-08T04:22:01.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.187+0000 7fe69f7b0640 1 -- 172.21.15.104:0/4069976034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6981f7740 con 0x7fe698140a80 2024-05-08T04:22:01.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.187+0000 7fe69f7b0640 1 -- 172.21.15.104:0/4069976034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6981f7d00 con 0x7fe698140a80 2024-05-08T04:22:01.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.188+0000 7fe69f7b0640 1 -- 172.21.15.104:0/4069976034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe698075010 con 0x7fe698140a80 2024-05-08T04:22:01.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.188+0000 7fe68dffb640 1 -- 172.21.15.104:0/4069976034 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe68801a070 con 0x7fe698140a80 2024-05-08T04:22:01.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.188+0000 7fe68dffb640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe67c06b4d0 0x7fe67c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:01.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.188+0000 7fe68dffb640 1 -- 172.21.15.104:0/4069976034 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe688089f70 con 0x7fe698140a80 2024-05-08T04:22:01.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.188+0000 7fe69d54c640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe67c06b4d0 0x7fe67c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:01.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.189+0000 7fe69d54c640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe67c06b4d0 0x7fe67c06d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe694007fd0 tx=0x7fe694007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:01.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.193+0000 7fe68dffb640 1 -- 172.21.15.104:0/4069976034 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe688058a10 con 0x7fe698140a80 2024-05-08T04:22:01.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:01.380+0000 7fe69f7b0640 1 -- 172.21.15.104:0/4069976034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe698141d10 con 0x7fe698140a80 2024-05-08T04:22:02.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.012+0000 7fe68dffb640 1 -- 172.21.15.104:0/4069976034 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe68805cab0 con 0x7fe698140a80 2024-05-08T04:22:02.014 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-05-08T04:22:02.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.014+0000 7fe69f7b0640 1 -- 172.21.15.104:0/4069976034 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe67c06b4d0 msgr2=0x7fe67c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.014+0000 7fe69f7b0640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe67c06b4d0 0x7fe67c06d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe694007fd0 tx=0x7fe694007e80 comp rx=0 tx=0).stop 2024-05-08T04:22:02.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.014+0000 7fe69f7b0640 1 -- 172.21.15.104:0/4069976034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe698140a80 msgr2=0x7fe698139e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.014+0000 7fe69f7b0640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe698140a80 0x7fe698139e30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe68800e9e0 tx=0x7fe68800eea0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.014+0000 7fe69f7b0640 1 -- 172.21.15.104:0/4069976034 shutdown_connections 2024-05-08T04:22:02.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.014+0000 7fe69f7b0640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe67c06b4d0 0x7fe67c06d990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.014+0000 7fe69f7b0640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe698143bb0 0x7fe6981e8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.014+0000 7fe69f7b0640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe698140a80 0x7fe698139e30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.014+0000 7fe69f7b0640 1 --2- 172.21.15.104:0/4069976034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6980afc60 0x7fe6981f6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.014+0000 7fe69f7b0640 1 -- 172.21.15.104:0/4069976034 >> 172.21.15.104:0/4069976034 conn(0x7fe6980b23e0 msgr2=0x7fe698141ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:02.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.014+0000 7fe69f7b0640 1 -- 172.21.15.104:0/4069976034 shutdown_connections 2024-05-08T04:22:02.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.014+0000 7fe69f7b0640 1 -- 172.21.15.104:0/4069976034 wait complete. 2024-05-08T04:22:02.033 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-08T04:22:02.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.131+0000 7fcd84509640 1 Processor -- start 2024-05-08T04:22:02.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.131+0000 7fcd84509640 1 -- start start 2024-05-08T04:22:02.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd84509640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcd7c161190 0x7fcd7c072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd84509640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcd7c072a70 0x7fcd7c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd84509640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0ad330 0x7fcd7c06bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd84509640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0b4db0 con 0x7fcd7c161190 2024-05-08T04:22:02.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd84509640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c06de30 con 0x7fcd7c072a70 2024-05-08T04:22:02.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd84509640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c06e110 con 0x7fcd7c0ad330 2024-05-08T04:22:02.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd822a5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcd7c161190 0x7fcd7c072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd822a5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcd7c161190 0x7fcd7c072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40902/0 (socket says 172.21.15.104:40902) 2024-05-08T04:22:02.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd822a5640 1 -- 172.21.15.104:0/3830307888 learned_addr learned my addr 172.21.15.104:0/3830307888 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:02.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd82aa6640 1 --2- 172.21.15.104:0/3830307888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0ad330 0x7fcd7c06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd81aa4640 1 --2- 172.21.15.104:0/3830307888 >> v2:172.21.15.183:3300/0 conn(0x7fcd7c072a70 0x7fcd7c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd822a5640 1 -- 172.21.15.104:0/3830307888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0ad330 msgr2=0x7fcd7c06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:02.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd822a5640 1 --2- 172.21.15.104:0/3830307888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0ad330 0x7fcd7c06bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd822a5640 1 -- 172.21.15.104:0/3830307888 >> v2:172.21.15.183:3300/0 conn(0x7fcd7c072a70 msgr2=0x7fcd7c0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:02.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd822a5640 1 --2- 172.21.15.104:0/3830307888 >> v2:172.21.15.183:3300/0 conn(0x7fcd7c072a70 0x7fcd7c0acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.132+0000 7fcd822a5640 1 -- 172.21.15.104:0/3830307888 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c06e3f0 con 0x7fcd7c161190 2024-05-08T04:22:02.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.133+0000 7fcd822a5640 1 --2- 172.21.15.104:0/3830307888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd7c161190 0x7fcd7c072530 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c067930 tx=0x7fcd7802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02cacf3c96d9c6f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:02.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.133+0000 7fcd812a3640 1 -- 172.21.15.104:0/3830307888 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78037070 con 0x7fcd7c161190 2024-05-08T04:22:02.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.133+0000 7fcd812a3640 1 -- 172.21.15.104:0/3830307888 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd78032440 con 0x7fcd7c161190 2024-05-08T04:22:02.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.133+0000 7fcd812a3640 1 -- 172.21.15.104:0/3830307888 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78032810 con 0x7fcd7c161190 2024-05-08T04:22:02.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.134+0000 7fcd84509640 1 -- 172.21.15.104:0/3830307888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd7c161190 msgr2=0x7fcd7c072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.134+0000 7fcd84509640 1 --2- 172.21.15.104:0/3830307888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd7c161190 0x7fcd7c072530 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c067930 tx=0x7fcd7802a140 comp rx=0 tx=0).stop 2024-05-08T04:22:02.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.134+0000 7fcd84509640 1 -- 172.21.15.104:0/3830307888 shutdown_connections 2024-05-08T04:22:02.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.134+0000 7fcd84509640 1 --2- 172.21.15.104:0/3830307888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0ad330 0x7fcd7c06bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.134+0000 7fcd84509640 1 --2- 172.21.15.104:0/3830307888 >> v2:172.21.15.183:3300/0 conn(0x7fcd7c072a70 0x7fcd7c0acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.134+0000 7fcd84509640 1 --2- 172.21.15.104:0/3830307888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd7c161190 0x7fcd7c072530 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.134+0000 7fcd84509640 1 -- 172.21.15.104:0/3830307888 >> 172.21.15.104:0/3830307888 conn(0x7fcd7c071a10 msgr2=0x7fcd7c071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:02.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.134+0000 7fcd84509640 1 -- 172.21.15.104:0/3830307888 shutdown_connections 2024-05-08T04:22:02.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.134+0000 7fcd84509640 1 -- 172.21.15.104:0/3830307888 wait complete. 2024-05-08T04:22:02.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.135+0000 7fcd84509640 1 Processor -- start 2024-05-08T04:22:02.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.135+0000 7fcd84509640 1 -- start start 2024-05-08T04:22:02.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd84509640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0ad330 0x7fcd7c1437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd84509640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd7c161190 0x7fcd7c153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd84509640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c154500 0x7fcd7c144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd84509640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c06da70 con 0x7fcd7c161190 2024-05-08T04:22:02.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd84509640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c06e9b0 con 0x7fcd7c154500 2024-05-08T04:22:02.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd84509640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c06dbf0 con 0x7fcd7c0ad330 2024-05-08T04:22:02.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd81aa4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd7c161190 0x7fcd7c153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd81aa4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd7c161190 0x7fcd7c153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40918/0 (socket says 172.21.15.104:40918) 2024-05-08T04:22:02.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd81aa4640 1 -- 172.21.15.104:0/3187590329 learned_addr learned my addr 172.21.15.104:0/3187590329 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:02.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd822a5640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0ad330 0x7fcd7c1437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd82aa6640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c154500 0x7fcd7c144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd81aa4640 1 -- 172.21.15.104:0/3187590329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0ad330 msgr2=0x7fcd7c1437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd81aa4640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0ad330 0x7fcd7c1437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd81aa4640 1 -- 172.21.15.104:0/3187590329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c154500 msgr2=0x7fcd7c144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd81aa4640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c154500 0x7fcd7c144230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd81aa4640 1 -- 172.21.15.104:0/3187590329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c152670 con 0x7fcd7c161190 2024-05-08T04:22:02.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd81aa4640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd7c161190 0x7fcd7c153fc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00e890 tx=0x7fcd6c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:02.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd72ffd640 1 -- 172.21.15.104:0/3187590329 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c017070 con 0x7fcd7c161190 2024-05-08T04:22:02.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd72ffd640 1 -- 172.21.15.104:0/3187590329 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c00c940 con 0x7fcd7c161190 2024-05-08T04:22:02.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.136+0000 7fcd84509640 1 -- 172.21.15.104:0/3187590329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c152950 con 0x7fcd7c161190 2024-05-08T04:22:02.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.137+0000 7fcd72ffd640 1 -- 172.21.15.104:0/3187590329 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c00cd10 con 0x7fcd7c161190 2024-05-08T04:22:02.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.137+0000 7fcd84509640 1 -- 172.21.15.104:0/3187590329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c152f10 con 0x7fcd7c161190 2024-05-08T04:22:02.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.137+0000 7fcd84509640 1 -- 172.21.15.104:0/3187590329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c075010 con 0x7fcd7c161190 2024-05-08T04:22:02.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.138+0000 7fcd72ffd640 1 -- 172.21.15.104:0/3187590329 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd6c01a070 con 0x7fcd7c161190 2024-05-08T04:22:02.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.138+0000 7fcd72ffd640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd6006b4d0 0x7fcd6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.139+0000 7fcd72ffd640 1 -- 172.21.15.104:0/3187590329 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcd6c08a150 con 0x7fcd7c161190 2024-05-08T04:22:02.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.139+0000 7fcd822a5640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd6006b4d0 0x7fcd6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.139+0000 7fcd822a5640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd6006b4d0 0x7fcd6006d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd78034000 tx=0x7fcd7802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:02.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.143+0000 7fcd72ffd640 1 -- 172.21.15.104:0/3187590329 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd6c058cd0 con 0x7fcd7c161190 2024-05-08T04:22:02.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.381+0000 7fcd84509640 1 -- 172.21.15.104:0/3187590329 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcd7c15d3c0 con 0x7fcd7c161190 2024-05-08T04:22:02.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.381+0000 7fcd72ffd640 1 -- 172.21.15.104:0/3187590329 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fcd6c05cd70 con 0x7fcd7c161190 2024-05-08T04:22:02.384 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:02.384 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:22:02.384 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-05-08T04:22:02.384 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.384 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-05-08T04:22:02.384 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmxdFrMRAAmzLHedytHXAGNpNucGZaCQ==", 2024-05-08T04:22:02.384 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.384 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:02.384 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:22:02.384 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmeApvARAAKgHwMIgcOw0WeJMA6B6Alw==", 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.385 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-05-08T04:22:02.386 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmFB1nOBAAtAvmTbNBjWFX/1fOOdjN5g==", 2024-05-08T04:22:02.386 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.386 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:02.386 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:22:02.386 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:22:02.386 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.386 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.386 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.386 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.386 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-05-08T04:22:02.386 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmvNx2CBAAiekQnEgL4wKKJK0cycdqmA==", 2024-05-08T04:22:02.386 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.387 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:02.387 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:22:02.387 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:22:02.387 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.387 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.387 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.388 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.388 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-05-08T04:22:02.388 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCA/TpmI1TdKxAAmwA8+WnZMSYoYAZ9Jbq3PQ==", 2024-05-08T04:22:02.388 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.388 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:02.388 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:02.388 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.388 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.389 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.389 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.389 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-05-08T04:22:02.389 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCD/TpmnHVwKhAA8eYNmL/xrJeFs5ZMoZEl7w==", 2024-05-08T04:22:02.389 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.389 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:02.389 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:02.389 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.389 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.390 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.390 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.390 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-05-08T04:22:02.390 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCG/Tpmx++nKBAAn79a9YBVJXBBwVb3odRT+Q==", 2024-05-08T04:22:02.390 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.390 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:02.390 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:02.390 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.390 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.390 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.390 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCJ/Tpm2c4qJxAAAvpc8VwahQ3eipDq4B0sLw==", 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCP/TpmTSzlKhAALgVYlmQcoxc95iy2wGzNTw==", 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:02.391 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCS/TpmT8O4KRAAtJalEzRoN4egUhKDGgWG2Q==", 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.392 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCV/Tpmr9wbKBAAjTGgFWKdCTJQeKFh+Qy8rQ==", 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCY/Tpmj8sIJxAAURnOCmVXzgueWr9WWIi5sg==", 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.393 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.394 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.394 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-05-08T04:22:02.394 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmmVCJDBAA7kFxGuTTRTJge+xrcPo3lw==", 2024-05-08T04:22:02.394 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.394 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:02.394 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-05-08T04:22:02.394 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-05-08T04:22:02.394 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-05-08T04:22:02.394 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.394 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.394 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.394 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmnZVEFRAAxxoeoXxT01K0NTE9OIDjEA==", 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/Tpm8YYTEhAAv2yuipPFRLKgsYmLKsVvUw==", 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-05-08T04:22:02.395 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmqiHcGhAAG6+jVhyfQkGUITvUBe7GxQ==", 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmVvyeFBAAHiDJbzlyvYLKJ86reB18sw==", 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-mds", 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCe/TpmdWRuGhAA9dOUjbCiagUONsAiwIpvTA==", 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-mds" 2024-05-08T04:22:02.397 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.398 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-mgr", 2024-05-08T04:22:02.398 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCe/TpmI2xuGhAAVZAeB7By8m2fRcEMSMMinQ==", 2024-05-08T04:22:02.398 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.398 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-08T04:22:02.398 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.398 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.398 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.398 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-osd", 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCe/Tpmo3NuGhAAWEZaBOLp+nFB8/1fCjui4g==", 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-osd" 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-rbd", 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCe/TpmJHpuGhAAqk4H9SWHwJ3L0TZNYE4I9Q==", 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.399 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-08T04:22:02.400 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCe/TpmD4FuGhAAGRP8+47TLETgNRvsazc2yg==", 2024-05-08T04:22:02.400 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.400 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-08T04:22:02.400 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.400 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.400 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.401 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-rgw", 2024-05-08T04:22:02.401 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCe/Tpm/YduGhAACKdlUF0UEwjP/EKHeEn/Qg==", 2024-05-08T04:22:02.401 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.401 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-08T04:22:02.401 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.401 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.401 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.402 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-05-08T04:22:02.402 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmpYwyLhAAaPUMPrzgHp1zZyeBWtqiNA==", 2024-05-08T04:22:02.402 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.402 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-05-08T04:22:02.402 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-05-08T04:22:02.402 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.402 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.402 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:02.402 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:02.402 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-05-08T04:22:02.402 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmC2JMKRAAuayaBslUW+T2xxUcFYJ2iQ==", 2024-05-08T04:22:02.402 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:02.402 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-05-08T04:22:02.403 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-05-08T04:22:02.403 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:02.403 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.403 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:02.403 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-05-08T04:22:02.403 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:22:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.383+0000 7fcd84509640 1 -- 172.21.15.104:0/3187590329 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd6006b4d0 msgr2=0x7fcd6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.383+0000 7fcd84509640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd6006b4d0 0x7fcd6006d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcd78034000 tx=0x7fcd7802e000 comp rx=0 tx=0).stop 2024-05-08T04:22:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.383+0000 7fcd84509640 1 -- 172.21.15.104:0/3187590329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd7c161190 msgr2=0x7fcd7c153fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.383+0000 7fcd84509640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd7c161190 0x7fcd7c153fc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00e890 tx=0x7fcd6c00ed50 comp rx=0 tx=0).stop 2024-05-08T04:22:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.383+0000 7fcd84509640 1 -- 172.21.15.104:0/3187590329 shutdown_connections 2024-05-08T04:22:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.383+0000 7fcd84509640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcd6006b4d0 0x7fcd6006d990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.383+0000 7fcd84509640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c154500 0x7fcd7c144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.383+0000 7fcd84509640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd7c161190 0x7fcd7c153fc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.383+0000 7fcd84509640 1 --2- 172.21.15.104:0/3187590329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0ad330 0x7fcd7c1437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.383+0000 7fcd84509640 1 -- 172.21.15.104:0/3187590329 >> 172.21.15.104:0/3187590329 conn(0x7fcd7c071a10 msgr2=0x7fcd7c0afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:02.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.383+0000 7fcd84509640 1 -- 172.21.15.104:0/3187590329 shutdown_connections 2024-05-08T04:22:02.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.383+0000 7fcd84509640 1 -- 172.21.15.104:0/3187590329 wait complete. 2024-05-08T04:22:02.406 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-08T04:22:02.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.504+0000 7f2254d63640 1 Processor -- start 2024-05-08T04:22:02.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.504+0000 7f2254d63640 1 -- start start 2024-05-08T04:22:02.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.505+0000 7f2254d63640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f225015bac0 0x7f22500b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.505+0000 7f2254d63640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f22500b51b0 0x7f225006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.505+0000 7f2254d63640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22500b1e30 con 0x7f225006ab60 2024-05-08T04:22:02.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.505+0000 7f2254d63640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22500b1c00 con 0x7f22500b51b0 2024-05-08T04:22:02.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.505+0000 7f2254d63640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225006b500 con 0x7f225015bac0 2024-05-08T04:22:02.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.505+0000 7f224ed9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f22500b51b0 0x7f225006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.505+0000 7f224ed9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f22500b51b0 0x7f225006afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40930/0 (socket says 172.21.15.104:40930) 2024-05-08T04:22:02.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.505+0000 7f224ed9d640 1 -- 172.21.15.104:0/3642256872 learned_addr learned my addr 172.21.15.104:0/3642256872 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:02.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.505+0000 7f224e59c640 1 --2- 172.21.15.104:0/3642256872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f225015bac0 0x7f22500b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.506+0000 7f224ed9d640 1 -- 172.21.15.104:0/3642256872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f225015bac0 msgr2=0x7f22500b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:02.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.506+0000 7f224ed9d640 1 --2- 172.21.15.104:0/3642256872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f225015bac0 0x7f22500b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.506+0000 7f224ed9d640 1 -- 172.21.15.104:0/3642256872 >> v1:172.21.15.183:6789/0 conn(0x7f225006ab60 legacy=0x7f22500cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:02.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.506+0000 7f224ed9d640 1 -- 172.21.15.104:0/3642256872 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500b36c0 con 0x7f22500b51b0 2024-05-08T04:22:02.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.506+0000 7f224ed9d640 1 --2- 172.21.15.104:0/3642256872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b51b0 0x7f225006afc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2248009e80 tx=0x7f224802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa4c3f6e3eb6ac0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:02.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.506+0000 7f224d59a640 1 -- 172.21.15.104:0/3642256872 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248036070 con 0x7f22500b51b0 2024-05-08T04:22:02.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.506+0000 7f224d59a640 1 -- 172.21.15.104:0/3642256872 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2248031600 con 0x7f22500b51b0 2024-05-08T04:22:02.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.506+0000 7f224d59a640 1 -- 172.21.15.104:0/3642256872 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22480319d0 con 0x7f22500b51b0 2024-05-08T04:22:02.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.507+0000 7f2254d63640 1 -- 172.21.15.104:0/3642256872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b51b0 msgr2=0x7f225006afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.507+0000 7f2254d63640 1 --2- 172.21.15.104:0/3642256872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b51b0 0x7f225006afc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2248009e80 tx=0x7f224802a660 comp rx=0 tx=0).stop 2024-05-08T04:22:02.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.507+0000 7f2254d63640 1 -- 172.21.15.104:0/3642256872 shutdown_connections 2024-05-08T04:22:02.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.507+0000 7f2254d63640 1 --2- 172.21.15.104:0/3642256872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b51b0 0x7f225006afc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.507+0000 7f2254d63640 1 --2- 172.21.15.104:0/3642256872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f225015bac0 0x7f22500b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.507+0000 7f2254d63640 1 -- 172.21.15.104:0/3642256872 >> 172.21.15.104:0/3642256872 conn(0x7f22500b2220 msgr2=0x7f22500b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:02.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.507+0000 7f2254d63640 1 -- 172.21.15.104:0/3642256872 shutdown_connections 2024-05-08T04:22:02.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.507+0000 7f2254d63640 1 -- 172.21.15.104:0/3642256872 wait complete. 2024-05-08T04:22:02.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.508+0000 7f2254d63640 1 Processor -- start 2024-05-08T04:22:02.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.508+0000 7f2254d63640 1 -- start start 2024-05-08T04:22:02.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.509+0000 7f2254d63640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f225006ab60 0x7f225015d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.509+0000 7f2254d63640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b51b0 0x7f22500c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.509+0000 7f2254d63640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f225015bac0 0x7f225014d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.509+0000 7f2254d63640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22500c3f00 con 0x7f22500b51b0 2024-05-08T04:22:02.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.509+0000 7f2254d63640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22500b3d10 con 0x7f225015bac0 2024-05-08T04:22:02.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.509+0000 7f2254d63640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225015bea0 con 0x7f225006ab60 2024-05-08T04:22:02.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.509+0000 7f224dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b51b0 0x7f22500c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.509+0000 7f224dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b51b0 0x7f22500c4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40938/0 (socket says 172.21.15.104:40938) 2024-05-08T04:22:02.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.509+0000 7f224dd9b640 1 -- 172.21.15.104:0/2089448672 learned_addr learned my addr 172.21.15.104:0/2089448672 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:02.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.509+0000 7f224e59c640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f225006ab60 0x7f225015d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.509+0000 7f224ed9d640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f225015bac0 0x7f225014d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.510+0000 7f224dd9b640 1 -- 172.21.15.104:0/2089448672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f225006ab60 msgr2=0x7f225015d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.510+0000 7f224dd9b640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f225006ab60 0x7f225015d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.510+0000 7f224dd9b640 1 -- 172.21.15.104:0/2089448672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f225015bac0 msgr2=0x7f225014d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.510+0000 7f224dd9b640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f225015bac0 0x7f225014d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.510+0000 7f224dd9b640 1 -- 172.21.15.104:0/2089448672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500c48d0 con 0x7f22500b51b0 2024-05-08T04:22:02.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.510+0000 7f224dd9b640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b51b0 0x7f22500c4080 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f224400c430 tx=0x7f224400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:02.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.510+0000 7f223effd640 1 -- 172.21.15.104:0/2089448672 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244011790 con 0x7f22500b51b0 2024-05-08T04:22:02.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.510+0000 7f223effd640 1 -- 172.21.15.104:0/2089448672 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2244017070 con 0x7f22500b51b0 2024-05-08T04:22:02.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.510+0000 7f2254d63640 1 -- 172.21.15.104:0/2089448672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22500c4bb0 con 0x7f22500b51b0 2024-05-08T04:22:02.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.510+0000 7f223effd640 1 -- 172.21.15.104:0/2089448672 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244011b70 con 0x7f22500b51b0 2024-05-08T04:22:02.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.510+0000 7f2254d63640 1 -- 172.21.15.104:0/2089448672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22500c5170 con 0x7f22500b51b0 2024-05-08T04:22:02.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.511+0000 7f2254d63640 1 -- 172.21.15.104:0/2089448672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2250075010 con 0x7f22500b51b0 2024-05-08T04:22:02.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.511+0000 7f223effd640 1 -- 172.21.15.104:0/2089448672 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2244011d10 con 0x7f22500b51b0 2024-05-08T04:22:02.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.512+0000 7f223effd640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f223006b500 0x7f223006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.512+0000 7f223effd640 1 -- 172.21.15.104:0/2089448672 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2244089b00 con 0x7f22500b51b0 2024-05-08T04:22:02.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.512+0000 7f224e59c640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f223006b500 0x7f223006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.512+0000 7f224e59c640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f223006b500 0x7f223006d9c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f22400079a0 tx=0x7f2240008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:02.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.516+0000 7f223effd640 1 -- 172.21.15.104:0/2089448672 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2244058710 con 0x7f22500b51b0 2024-05-08T04:22:02.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.751+0000 7f2254d63640 1 -- 172.21.15.104:0/2089448672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f22500b2730 con 0x7f22500b51b0 2024-05-08T04:22:02.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.753+0000 7f223effd640 1 -- 172.21.15.104:0/2089448672 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f224405c7b0 con 0x7f22500b51b0 2024-05-08T04:22:02.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.755+0000 7f2254d63640 1 -- 172.21.15.104:0/2089448672 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f223006b500 msgr2=0x7f223006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.755+0000 7f2254d63640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f223006b500 0x7f223006d9c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f22400079a0 tx=0x7f2240008040 comp rx=0 tx=0).stop 2024-05-08T04:22:02.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.755+0000 7f2254d63640 1 -- 172.21.15.104:0/2089448672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b51b0 msgr2=0x7f22500c4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.755+0000 7f2254d63640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b51b0 0x7f22500c4080 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f224400c430 tx=0x7f224400c8f0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.755+0000 7f2254d63640 1 -- 172.21.15.104:0/2089448672 shutdown_connections 2024-05-08T04:22:02.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.755+0000 7f2254d63640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f223006b500 0x7f223006d9c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.755+0000 7f2254d63640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f225015bac0 0x7f225014d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.755+0000 7f2254d63640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f22500b51b0 0x7f22500c4080 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.755+0000 7f2254d63640 1 --2- 172.21.15.104:0/2089448672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f225006ab60 0x7f225015d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.755+0000 7f2254d63640 1 -- 172.21.15.104:0/2089448672 >> 172.21.15.104:0/2089448672 conn(0x7f22500b2220 msgr2=0x7f225006ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:02.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.755+0000 7f2254d63640 1 -- 172.21.15.104:0/2089448672 shutdown_connections 2024-05-08T04:22:02.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.755+0000 7f2254d63640 1 -- 172.21.15.104:0/2089448672 wait complete. 2024-05-08T04:22:02.768 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-08T04:22:02.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.865+0000 7f24b8dc8640 1 Processor -- start 2024-05-08T04:22:02.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.865+0000 7f24b8dc8640 1 -- start start 2024-05-08T04:22:02.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.866+0000 7f24b8dc8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b406ea40 0x7f24b40b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.866+0000 7f24b8dc8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f24b40b3ff0 0x7f24b40b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.866+0000 7f24b8dc8640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b40b49e0 con 0x7f24b40ceee0 2024-05-08T04:22:02.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.866+0000 7f24b8dc8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b415f390 con 0x7f24b40b3ff0 2024-05-08T04:22:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.866+0000 7f24b8dc8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b415e780 con 0x7f24b406ea40 2024-05-08T04:22:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.866+0000 7f24b2d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f24b40b3ff0 0x7f24b40b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.866+0000 7f24b2d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f24b40b3ff0 0x7f24b40b44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40940/0 (socket says 172.21.15.104:40940) 2024-05-08T04:22:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.866+0000 7f24b2d9d640 1 -- 172.21.15.104:0/642494472 learned_addr learned my addr 172.21.15.104:0/642494472 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.867+0000 7f24b1d9b640 1 --2- 172.21.15.104:0/642494472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b406ea40 0x7f24b40b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.867+0000 7f24b2d9d640 1 -- 172.21.15.104:0/642494472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b406ea40 msgr2=0x7f24b40b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.867+0000 7f24b2d9d640 1 --2- 172.21.15.104:0/642494472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b406ea40 0x7f24b40b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.867+0000 7f24b2d9d640 1 -- 172.21.15.104:0/642494472 >> v1:172.21.15.183:6789/0 conn(0x7f24b40ceee0 legacy=0x7f24b406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.867+0000 7f24b2d9d640 1 -- 172.21.15.104:0/642494472 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b415ea60 con 0x7f24b40b3ff0 2024-05-08T04:22:02.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.867+0000 7f24b2d9d640 1 --2- 172.21.15.104:0/642494472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24b40b3ff0 0x7f24b40b44a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00bb40 tx=0x7f24ac02c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec857f6d2ecf6141 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.867+0000 7f24b159a640 1 -- 172.21.15.104:0/642494472 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac036020 con 0x7f24b40b3ff0 2024-05-08T04:22:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.868+0000 7f24b159a640 1 -- 172.21.15.104:0/642494472 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac032820 con 0x7f24b40b3ff0 2024-05-08T04:22:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.868+0000 7f24b159a640 1 -- 172.21.15.104:0/642494472 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac032bf0 con 0x7f24b40b3ff0 2024-05-08T04:22:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.868+0000 7f24b8dc8640 1 -- 172.21.15.104:0/642494472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24b40b3ff0 msgr2=0x7f24b40b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.868+0000 7f24b8dc8640 1 --2- 172.21.15.104:0/642494472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24b40b3ff0 0x7f24b40b44a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00bb40 tx=0x7f24ac02c960 comp rx=0 tx=0).stop 2024-05-08T04:22:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.868+0000 7f24b8dc8640 1 -- 172.21.15.104:0/642494472 shutdown_connections 2024-05-08T04:22:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.868+0000 7f24b8dc8640 1 --2- 172.21.15.104:0/642494472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24b40b3ff0 0x7f24b40b44a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.868+0000 7f24b8dc8640 1 --2- 172.21.15.104:0/642494472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b406ea40 0x7f24b40b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.868+0000 7f24b8dc8640 1 -- 172.21.15.104:0/642494472 >> 172.21.15.104:0/642494472 conn(0x7f24b40b13f0 msgr2=0x7f24b40b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.868+0000 7f24b8dc8640 1 -- 172.21.15.104:0/642494472 shutdown_connections 2024-05-08T04:22:02.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.868+0000 7f24b8dc8640 1 -- 172.21.15.104:0/642494472 wait complete. 2024-05-08T04:22:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.869+0000 7f24b8dc8640 1 Processor -- start 2024-05-08T04:22:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.870+0000 7f24b8dc8640 1 -- start start 2024-05-08T04:22:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.870+0000 7f24b8dc8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24b406ea40 0x7f24b41f7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.870+0000 7f24b8dc8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b40b3ff0 0x7f24b415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.870+0000 7f24b8dc8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24b40ceee0 0x7f24b41f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.870+0000 7f24b8dc8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40cf2c0 con 0x7f24b406ea40 2024-05-08T04:22:02.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.870+0000 7f24b8dc8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b415f020 con 0x7f24b40ceee0 2024-05-08T04:22:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.870+0000 7f24b8dc8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40cf440 con 0x7f24b40b3ff0 2024-05-08T04:22:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.870+0000 7f24b259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24b406ea40 0x7f24b41f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.870+0000 7f24b259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24b406ea40 0x7f24b41f7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40944/0 (socket says 172.21.15.104:40944) 2024-05-08T04:22:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.870+0000 7f24b259c640 1 -- 172.21.15.104:0/4178172636 learned_addr learned my addr 172.21.15.104:0/4178172636 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.870+0000 7f24b2d9d640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24b40ceee0 0x7f24b41f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.871+0000 7f24b1d9b640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b40b3ff0 0x7f24b415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.871+0000 7f24b259c640 1 -- 172.21.15.104:0/4178172636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b40b3ff0 msgr2=0x7f24b415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.871+0000 7f24b259c640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b40b3ff0 0x7f24b415bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.871+0000 7f24b259c640 1 -- 172.21.15.104:0/4178172636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24b40ceee0 msgr2=0x7f24b41f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.871+0000 7f24b259c640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24b40ceee0 0x7f24b41f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.871+0000 7f24b259c640 1 -- 172.21.15.104:0/4178172636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b415c320 con 0x7f24b406ea40 2024-05-08T04:22:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.871+0000 7f24b259c640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24b406ea40 0x7f24b41f7560 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f24a400c760 tx=0x7f24a400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:02.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.871+0000 7f24aaffd640 1 -- 172.21.15.104:0/4178172636 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4016020 con 0x7f24b406ea40 2024-05-08T04:22:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.871+0000 7f24aaffd640 1 -- 172.21.15.104:0/4178172636 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a4006d50 con 0x7f24b406ea40 2024-05-08T04:22:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.871+0000 7f24b8dc8640 1 -- 172.21.15.104:0/4178172636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b415c600 con 0x7f24b406ea40 2024-05-08T04:22:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.871+0000 7f24aaffd640 1 -- 172.21.15.104:0/4178172636 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4003bb0 con 0x7f24b406ea40 2024-05-08T04:22:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.871+0000 7f24b8dc8640 1 -- 172.21.15.104:0/4178172636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b40ad0b0 con 0x7f24b406ea40 2024-05-08T04:22:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.872+0000 7f24b8dc8640 1 -- 172.21.15.104:0/4178172636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b406f3f0 con 0x7f24b406ea40 2024-05-08T04:22:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.872+0000 7f24aaffd640 1 -- 172.21.15.104:0/4178172636 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f24a400a850 con 0x7f24b406ea40 2024-05-08T04:22:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.873+0000 7f24aaffd640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f249406b4d0 0x7f249406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.873+0000 7f24aaffd640 1 -- 172.21.15.104:0/4178172636 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f24a4089b00 con 0x7f24b406ea40 2024-05-08T04:22:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.873+0000 7f24b1d9b640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f249406b4d0 0x7f249406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:02.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.873+0000 7f24b1d9b640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f249406b4d0 0x7f249406d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24b415b5e0 tx=0x7f249c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:02.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:02.877+0000 7f24aaffd640 1 -- 172.21.15.104:0/4178172636 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f24a4020020 con 0x7f24b406ea40 2024-05-08T04:22:03.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.115+0000 7f24b8dc8640 1 -- 172.21.15.104:0/4178172636 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f24b4074ff0 con 0x7f24b406ea40 2024-05-08T04:22:03.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.117+0000 7f24aaffd640 1 -- 172.21.15.104:0/4178172636 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f24a4019310 con 0x7f24b406ea40 2024-05-08T04:22:03.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.119+0000 7f24b8dc8640 1 -- 172.21.15.104:0/4178172636 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f249406b4d0 msgr2=0x7f249406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.119+0000 7f24b8dc8640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f249406b4d0 0x7f249406d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24b415b5e0 tx=0x7f249c008040 comp rx=0 tx=0).stop 2024-05-08T04:22:03.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.119+0000 7f24b8dc8640 1 -- 172.21.15.104:0/4178172636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24b406ea40 msgr2=0x7f24b41f7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.119+0000 7f24b8dc8640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24b406ea40 0x7f24b41f7560 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f24a400c760 tx=0x7f24a400cc20 comp rx=0 tx=0).stop 2024-05-08T04:22:03.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.119+0000 7f24b8dc8640 1 -- 172.21.15.104:0/4178172636 shutdown_connections 2024-05-08T04:22:03.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.119+0000 7f24b8dc8640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f249406b4d0 0x7f249406d990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.119+0000 7f24b8dc8640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24b40ceee0 0x7f24b41f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.119+0000 7f24b8dc8640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b40b3ff0 0x7f24b415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.119+0000 7f24b8dc8640 1 --2- 172.21.15.104:0/4178172636 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24b406ea40 0x7f24b41f7560 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.119+0000 7f24b8dc8640 1 -- 172.21.15.104:0/4178172636 >> 172.21.15.104:0/4178172636 conn(0x7f24b40b13f0 msgr2=0x7f24b41580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:03.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.119+0000 7f24b8dc8640 1 -- 172.21.15.104:0/4178172636 shutdown_connections 2024-05-08T04:22:03.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.119+0000 7f24b8dc8640 1 -- 172.21.15.104:0/4178172636 wait complete. 2024-05-08T04:22:03.132 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-08T04:22:03.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.231+0000 7fbe7444a640 1 Processor -- start 2024-05-08T04:22:03.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.231+0000 7fbe7444a640 1 -- start start 2024-05-08T04:22:03.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.232+0000 7fbe7444a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbe6c0acdf0 0x7fbe6c0ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.232+0000 7fbe7444a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c072c40 con 0x7fbe6c161190 2024-05-08T04:22:03.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.232+0000 7fbe7444a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c06de30 con 0x7fbe6c06bb70 2024-05-08T04:22:03.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.232+0000 7fbe721e6640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fbe6c161190 0x7fbe6c072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53486/0 (socket says 172.21.15.104:53486) 2024-05-08T04:22:03.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.232+0000 7fbe721e6640 1 -- 172.21.15.104:0/82536043 learned_addr learned my addr 172.21.15.104:0/82536043 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:03.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.232+0000 7fbe7444a640 1 -- 172.21.15.104:0/82536043 --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6c0b4db0 con 0x7fbe6c0acdf0 2024-05-08T04:22:03.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.232+0000 7fbe719e5640 1 --2- 172.21.15.104:0/82536043 >> v2:172.21.15.183:3300/0 conn(0x7fbe6c0acdf0 0x7fbe6c0ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.232+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336583864 0 0) 0x7fbe6c072c40 con 0x7fbe6c161190 2024-05-08T04:22:03.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.232+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe58003520 con 0x7fbe6c161190 2024-05-08T04:22:03.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799227025 0 0) 0x7fbe6c06de30 con 0x7fbe6c06bb70 2024-05-08T04:22:03.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe6c072c40 con 0x7fbe6c06bb70 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3283686450 0 0) 0x7fbe58003520 con 0x7fbe6c161190 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 >> v2:172.21.15.183:3300/0 conn(0x7fbe6c0acdf0 msgr2=0x7fbe6c0ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 --2- 172.21.15.104:0/82536043 >> v2:172.21.15.183:3300/0 conn(0x7fbe6c0acdf0 0x7fbe6c0ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 >> v1:172.21.15.183:6789/0 conn(0x7fbe6c06bb70 legacy=0x7fbe6c06eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c06e110 con 0x7fbe6c161190 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fbe680019f0 con 0x7fbe6c161190 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 >> v1:172.21.15.104:6789/0 conn(0x7fbe6c161190 legacy=0x7fbe6c072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 --2- 172.21.15.104:0/82536043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe58003b90 0x7fbe58003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 --2- 172.21.15.104:0/82536043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe58004800 0x7fbe58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 --2- 172.21.15.104:0/82536043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe580051c0 0x7fbe5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5800c090 con 0x7fbe58003b90 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5800c210 con 0x7fbe580051c0 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5800c410 con 0x7fbe58004800 2024-05-08T04:22:03.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe721e6640 1 --2- 172.21.15.104:0/82536043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe58003b90 0x7fbe58003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe719e5640 1 --2- 172.21.15.104:0/82536043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe58004800 0x7fbe58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe729e7640 1 --2- 172.21.15.104:0/82536043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe580051c0 0x7fbe5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe721e6640 1 -- 172.21.15.104:0/82536043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe58004800 msgr2=0x7fbe58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:03.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe721e6640 1 --2- 172.21.15.104:0/82536043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe58004800 0x7fbe58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe721e6640 1 -- 172.21.15.104:0/82536043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe580051c0 msgr2=0x7fbe5800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:03.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe721e6640 1 --2- 172.21.15.104:0/82536043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe580051c0 0x7fbe5800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe729e7640 1 -- 172.21.15.104:0/82536043 reap_dead start 2024-05-08T04:22:03.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.233+0000 7fbe721e6640 1 -- 172.21.15.104:0/82536043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe58003520 con 0x7fbe58003b90 2024-05-08T04:22:03.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.234+0000 7fbe721e6640 1 --2- 172.21.15.104:0/82536043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe58003b90 0x7fbe58003f90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800a750 tx=0x7fbe58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1206e940bf919c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:03.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.234+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6800a370 con 0x7fbe58003b90 2024-05-08T04:22:03.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.234+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6802f070 con 0x7fbe58003b90 2024-05-08T04:22:03.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.234+0000 7fbe711e4640 1 -- 172.21.15.104:0/82536043 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6802bba0 con 0x7fbe58003b90 2024-05-08T04:22:03.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.235+0000 7fbe7444a640 1 -- 172.21.15.104:0/82536043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe58003b90 msgr2=0x7fbe58003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.235+0000 7fbe7444a640 1 --2- 172.21.15.104:0/82536043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe58003b90 0x7fbe58003f90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800a750 tx=0x7fbe58005830 comp rx=0 tx=0).stop 2024-05-08T04:22:03.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.235+0000 7fbe7444a640 1 -- 172.21.15.104:0/82536043 shutdown_connections 2024-05-08T04:22:03.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.235+0000 7fbe7444a640 1 --2- 172.21.15.104:0/82536043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe58003b90 0x7fbe58003f90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.235+0000 7fbe7444a640 1 -- 172.21.15.104:0/82536043 >> 172.21.15.104:0/82536043 conn(0x7fbe6c071a10 msgr2=0x7fbe6c071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:03.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.235+0000 7fbe7444a640 1 -- 172.21.15.104:0/82536043 shutdown_connections 2024-05-08T04:22:03.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.235+0000 7fbe7444a640 1 -- 172.21.15.104:0/82536043 wait complete. 2024-05-08T04:22:03.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.236+0000 7fbe7444a640 1 Processor -- start 2024-05-08T04:22:03.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.236+0000 7fbe7444a640 1 -- start start 2024-05-08T04:22:03.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe7444a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe58003b90 0x7fbe6c148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe7444a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe6c14b670 0x7fbe6c0aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe7444a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe6c0af190 0x7fbe6c1498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe7444a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c06e9b0 con 0x7fbe6c0af190 2024-05-08T04:22:03.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe7444a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c06e6d0 con 0x7fbe58003b90 2024-05-08T04:22:03.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe7444a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c06da70 con 0x7fbe6c14b670 2024-05-08T04:22:03.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe729e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe6c0af190 0x7fbe6c1498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe729e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe6c0af190 0x7fbe6c1498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40956/0 (socket says 172.21.15.104:40956) 2024-05-08T04:22:03.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe729e7640 1 -- 172.21.15.104:0/1161464243 learned_addr learned my addr 172.21.15.104:0/1161464243 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:03.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe721e6640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe58003b90 0x7fbe6c148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe719e5640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe6c14b670 0x7fbe6c0aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe729e7640 1 -- 172.21.15.104:0/1161464243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe6c14b670 msgr2=0x7fbe6c0aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe729e7640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe6c14b670 0x7fbe6c0aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe729e7640 1 -- 172.21.15.104:0/1161464243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe58003b90 msgr2=0x7fbe6c148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe729e7640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe58003b90 0x7fbe6c148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe729e7640 1 -- 172.21.15.104:0/1161464243 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c14a5d0 con 0x7fbe6c0af190 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe729e7640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe6c0af190 0x7fbe6c1498e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0719a0 tx=0x7fbe6400fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe62ffd640 1 -- 172.21.15.104:0/1161464243 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64019070 con 0x7fbe6c0af190 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe62ffd640 1 -- 172.21.15.104:0/1161464243 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe64005030 con 0x7fbe6c0af190 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe62ffd640 1 -- 172.21.15.104:0/1161464243 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64005420 con 0x7fbe6c0af190 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe7444a640 1 -- 172.21.15.104:0/1161464243 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c14a8b0 con 0x7fbe6c0af190 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.237+0000 7fbe7444a640 1 -- 172.21.15.104:0/1161464243 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c14ae70 con 0x7fbe6c0af190 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.239+0000 7fbe7444a640 1 -- 172.21.15.104:0/1161464243 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c075010 con 0x7fbe6c0af190 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.239+0000 7fbe62ffd640 1 -- 172.21.15.104:0/1161464243 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbe6401c070 con 0x7fbe6c0af190 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.240+0000 7fbe62ffd640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbe5006b4d0 0x7fbe5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.240+0000 7fbe62ffd640 1 -- 172.21.15.104:0/1161464243 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbe64088cc0 con 0x7fbe6c0af190 2024-05-08T04:22:03.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.240+0000 7fbe721e6640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbe5006b4d0 0x7fbe5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.240+0000 7fbe721e6640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbe5006b4d0 0x7fbe5006d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbe68033000 tx=0x7fbe68009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:03.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.244+0000 7fbe62ffd640 1 -- 172.21.15.104:0/1161464243 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbe64057840 con 0x7fbe6c0af190 2024-05-08T04:22:03.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.478+0000 7fbe7444a640 1 -- 172.21.15.104:0/1161464243 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fbe6c066a30 con 0x7fbe6c0af190 2024-05-08T04:22:03.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.480+0000 7fbe62ffd640 1 -- 172.21.15.104:0/1161464243 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbe6405b8e0 con 0x7fbe6c0af190 2024-05-08T04:22:03.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.482+0000 7fbe7444a640 1 -- 172.21.15.104:0/1161464243 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbe5006b4d0 msgr2=0x7fbe5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.482+0000 7fbe7444a640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbe5006b4d0 0x7fbe5006d990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbe68033000 tx=0x7fbe68009030 comp rx=0 tx=0).stop 2024-05-08T04:22:03.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.482+0000 7fbe7444a640 1 -- 172.21.15.104:0/1161464243 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe6c0af190 msgr2=0x7fbe6c1498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.482+0000 7fbe7444a640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe6c0af190 0x7fbe6c1498e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0719a0 tx=0x7fbe6400fc00 comp rx=0 tx=0).stop 2024-05-08T04:22:03.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.482+0000 7fbe7444a640 1 -- 172.21.15.104:0/1161464243 shutdown_connections 2024-05-08T04:22:03.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.482+0000 7fbe7444a640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbe5006b4d0 0x7fbe5006d990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.482+0000 7fbe7444a640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe6c0af190 0x7fbe6c1498e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.482+0000 7fbe7444a640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe6c14b670 0x7fbe6c0aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.482+0000 7fbe7444a640 1 --2- 172.21.15.104:0/1161464243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe58003b90 0x7fbe6c148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.482+0000 7fbe7444a640 1 -- 172.21.15.104:0/1161464243 >> 172.21.15.104:0/1161464243 conn(0x7fbe6c071a10 msgr2=0x7fbe6c153eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:03.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.483+0000 7fbe7444a640 1 -- 172.21.15.104:0/1161464243 shutdown_connections 2024-05-08T04:22:03.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.483+0000 7fbe7444a640 1 -- 172.21.15.104:0/1161464243 wait complete. 2024-05-08T04:22:03.496 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-08T04:22:03.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.594+0000 7f3ab2d13640 1 Processor -- start 2024-05-08T04:22:03.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.594+0000 7f3ab2d13640 1 -- start start 2024-05-08T04:22:03.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3ab2d13640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3aac15edf0 0x7f3aac0b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3ab2d13640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3aac157ac0 0x7f3aac157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3ab2d13640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aac0d15c0 con 0x7f3aac070c70 2024-05-08T04:22:03.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3ab2d13640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aac06bc70 con 0x7f3aac157ac0 2024-05-08T04:22:03.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3ab2d13640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aac15f550 con 0x7f3aac15edf0 2024-05-08T04:22:03.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3ab12b0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3aac157ac0 0x7f3aac157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3ab0aaf640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f3aac070c70 0x7f3aac071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53488/0 (socket says 172.21.15.104:53488) 2024-05-08T04:22:03.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3ab0aaf640 1 -- 172.21.15.104:0/164456750 learned_addr learned my addr 172.21.15.104:0/164456750 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:03.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3aa3fff640 1 --2- 172.21.15.104:0/164456750 >> v2:172.21.15.183:3300/0 conn(0x7f3aac15edf0 0x7f3aac0b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3ab12b0640 1 -- 172.21.15.104:0/164456750 >> v2:172.21.15.183:3300/0 conn(0x7f3aac15edf0 msgr2=0x7f3aac0b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:03.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3ab12b0640 1 --2- 172.21.15.104:0/164456750 >> v2:172.21.15.183:3300/0 conn(0x7f3aac15edf0 0x7f3aac0b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3ab12b0640 1 -- 172.21.15.104:0/164456750 >> v1:172.21.15.104:6789/0 conn(0x7f3aac070c70 legacy=0x7f3aac071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3ab12b0640 1 -- 172.21.15.104:0/164456750 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac15f830 con 0x7f3aac157ac0 2024-05-08T04:22:03.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3aa37fe640 1 -- 172.21.15.104:0/164456750 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872298524 0 0) 0x7f3aac0d15c0 con 0x7f3aac070c70 2024-05-08T04:22:03.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.595+0000 7f3aa3fff640 1 --2- 172.21.15.104:0/164456750 >> v2:172.21.15.183:3300/0 conn(0x7f3aac15edf0 0x7f3aac0b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:03.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.596+0000 7f3ab12b0640 1 --2- 172.21.15.104:0/164456750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3aac157ac0 0x7f3aac157f30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0b4150 tx=0x7f3aa402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a8899d372540d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:03.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.596+0000 7f3aa37fe640 1 -- 172.21.15.104:0/164456750 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4037070 con 0x7f3aac157ac0 2024-05-08T04:22:03.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.596+0000 7f3aa37fe640 1 -- 172.21.15.104:0/164456750 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa4032440 con 0x7f3aac157ac0 2024-05-08T04:22:03.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.596+0000 7f3aa37fe640 1 -- 172.21.15.104:0/164456750 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4032810 con 0x7f3aac157ac0 2024-05-08T04:22:03.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.597+0000 7f3ab2d13640 1 -- 172.21.15.104:0/164456750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3aac157ac0 msgr2=0x7f3aac157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.597+0000 7f3ab2d13640 1 --2- 172.21.15.104:0/164456750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3aac157ac0 0x7f3aac157f30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0b4150 tx=0x7f3aa402a1a0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.597+0000 7f3ab2d13640 1 -- 172.21.15.104:0/164456750 shutdown_connections 2024-05-08T04:22:03.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.597+0000 7f3ab2d13640 1 --2- 172.21.15.104:0/164456750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3aac157ac0 0x7f3aac157f30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.597+0000 7f3ab2d13640 1 --2- 172.21.15.104:0/164456750 >> v2:172.21.15.183:3300/0 conn(0x7f3aac15edf0 0x7f3aac0b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.597+0000 7f3ab2d13640 1 -- 172.21.15.104:0/164456750 >> 172.21.15.104:0/164456750 conn(0x7f3aac0b3450 msgr2=0x7f3aac0b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.597+0000 7f3ab2d13640 1 -- 172.21.15.104:0/164456750 shutdown_connections 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.597+0000 7f3ab2d13640 1 -- 172.21.15.104:0/164456750 wait complete. 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.598+0000 7f3ab2d13640 1 Processor -- start 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.598+0000 7f3ab2d13640 1 -- start start 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab2d13640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3aac070c70 0x7f3aac159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab2d13640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3aac157ac0 0x7f3aac14a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab2d13640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3aac15edf0 0x7f3aac160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab2d13640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac0b57e0 con 0x7f3aac15edf0 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab2d13640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac0b5b80 con 0x7f3aac157ac0 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab2d13640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac0b5960 con 0x7f3aac070c70 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab12b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3aac15edf0 0x7f3aac160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab12b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3aac15edf0 0x7f3aac160730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40968/0 (socket says 172.21.15.104:40968) 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab12b0640 1 -- 172.21.15.104:0/1702678418 learned_addr learned my addr 172.21.15.104:0/1702678418 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3aa3fff640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3aac157ac0 0x7f3aac14a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab0aaf640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3aac070c70 0x7f3aac159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab12b0640 1 -- 172.21.15.104:0/1702678418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3aac070c70 msgr2=0x7f3aac159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab12b0640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3aac070c70 0x7f3aac159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab12b0640 1 -- 172.21.15.104:0/1702678418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3aac157ac0 msgr2=0x7f3aac14a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab12b0640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3aac157ac0 0x7f3aac14a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab12b0640 1 -- 172.21.15.104:0/1702678418 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac159980 con 0x7f3aac15edf0 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3aa3fff640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3aac157ac0 0x7f3aac14a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab12b0640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3aac15edf0 0x7f3aac160730 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4035040 tx=0x7f3aa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3aa17fa640 1 -- 172.21.15.104:0/1702678418 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4037040 con 0x7f3aac15edf0 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3aa17fa640 1 -- 172.21.15.104:0/1702678418 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa4042070 con 0x7f3aac15edf0 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3aa17fa640 1 -- 172.21.15.104:0/1702678418 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4030b30 con 0x7f3aac15edf0 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab2d13640 1 -- 172.21.15.104:0/1702678418 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aac159c60 con 0x7f3aac15edf0 2024-05-08T04:22:03.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.599+0000 7f3ab2d13640 1 -- 172.21.15.104:0/1702678418 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aac15a220 con 0x7f3aac15edf0 2024-05-08T04:22:03.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.600+0000 7f3ab2d13640 1 -- 172.21.15.104:0/1702678418 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aac075010 con 0x7f3aac15edf0 2024-05-08T04:22:03.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.601+0000 7f3aa17fa640 1 -- 172.21.15.104:0/1702678418 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3aa4030cd0 con 0x7f3aac15edf0 2024-05-08T04:22:03.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.601+0000 7f3aa17fa640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3a9806b4d0 0x7f3a9806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.601+0000 7f3aa17fa640 1 -- 172.21.15.104:0/1702678418 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3aa40aa9e0 con 0x7f3aac15edf0 2024-05-08T04:22:03.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.601+0000 7f3ab0aaf640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3a9806b4d0 0x7f3a9806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.602+0000 7f3ab0aaf640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3a9806b4d0 0x7f3a9806d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3aa80012e0 tx=0x7f3aa8007ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:03.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.605+0000 7f3aa17fa640 1 -- 172.21.15.104:0/1702678418 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3aa4032e20 con 0x7f3aac15edf0 2024-05-08T04:22:03.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.840+0000 7f3ab2d13640 1 -- 172.21.15.104:0/1702678418 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f3aac071a50 con 0x7f3aac15edf0 2024-05-08T04:22:03.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.842+0000 7f3aa17fa640 1 -- 172.21.15.104:0/1702678418 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3aa4045360 con 0x7f3aac15edf0 2024-05-08T04:22:03.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.844+0000 7f3ab2d13640 1 -- 172.21.15.104:0/1702678418 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3a9806b4d0 msgr2=0x7f3a9806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.844+0000 7f3ab2d13640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3a9806b4d0 0x7f3a9806d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3aa80012e0 tx=0x7f3aa8007ed0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.844+0000 7f3ab2d13640 1 -- 172.21.15.104:0/1702678418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3aac15edf0 msgr2=0x7f3aac160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.844+0000 7f3ab2d13640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3aac15edf0 0x7f3aac160730 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4035040 tx=0x7f3aa40046c0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.844+0000 7f3ab2d13640 1 -- 172.21.15.104:0/1702678418 shutdown_connections 2024-05-08T04:22:03.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.844+0000 7f3ab2d13640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3a9806b4d0 0x7f3a9806d990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.844+0000 7f3ab2d13640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3aac157ac0 0x7f3aac14a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.844+0000 7f3ab2d13640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3aac15edf0 0x7f3aac160730 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.844+0000 7f3ab2d13640 1 --2- 172.21.15.104:0/1702678418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3aac070c70 0x7f3aac159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.844+0000 7f3ab2d13640 1 -- 172.21.15.104:0/1702678418 >> 172.21.15.104:0/1702678418 conn(0x7f3aac0b3450 msgr2=0x7f3aac15d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:03.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.844+0000 7f3ab2d13640 1 -- 172.21.15.104:0/1702678418 shutdown_connections 2024-05-08T04:22:03.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.844+0000 7f3ab2d13640 1 -- 172.21.15.104:0/1702678418 wait complete. 2024-05-08T04:22:03.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-08T04:22:03.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.956+0000 7f33f2dce640 1 Processor -- start 2024-05-08T04:22:03.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.956+0000 7f33f2dce640 1 -- start start 2024-05-08T04:22:03.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33f2dce640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f33ec0cc930 0x7f33ec0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33f2dce640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f33ec0711c0 0x7f33ec15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33f2dce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33ec144c80 0x7f33ec15fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33f2dce640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec071fb0 con 0x7f33ec0711c0 2024-05-08T04:22:03.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33f2dce640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec0cd250 con 0x7f33ec0cc930 2024-05-08T04:22:03.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33f2dce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec071710 con 0x7f33ec144c80 2024-05-08T04:22:03.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33ebfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f33ec0711c0 0x7f33ec15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33ebfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f33ec0711c0 0x7f33ec15f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40976/0 (socket says 172.21.15.104:40976) 2024-05-08T04:22:03.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33ebfff640 1 -- 172.21.15.104:0/2972024760 learned_addr learned my addr 172.21.15.104:0/2972024760 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:03.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33f136b640 1 --2- 172.21.15.104:0/2972024760 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33ec144c80 0x7f33ec15fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33f0b6a640 1 --2- 172.21.15.104:0/2972024760 >> v2:172.21.15.183:3300/0 conn(0x7f33ec0cc930 0x7f33ec0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33ebfff640 1 -- 172.21.15.104:0/2972024760 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33ec144c80 msgr2=0x7f33ec15fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:03.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33ebfff640 1 --2- 172.21.15.104:0/2972024760 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33ec144c80 0x7f33ec15fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33ebfff640 1 -- 172.21.15.104:0/2972024760 >> v2:172.21.15.183:3300/0 conn(0x7f33ec0cc930 msgr2=0x7f33ec0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:03.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33ebfff640 1 --2- 172.21.15.104:0/2972024760 >> v2:172.21.15.183:3300/0 conn(0x7f33ec0cc930 0x7f33ec0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33ebfff640 1 -- 172.21.15.104:0/2972024760 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0719f0 con 0x7f33ec0711c0 2024-05-08T04:22:03.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.957+0000 7f33f0b6a640 1 --2- 172.21.15.104:0/2972024760 >> v2:172.21.15.183:3300/0 conn(0x7f33ec0cc930 0x7f33ec0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:03.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.958+0000 7f33ebfff640 1 --2- 172.21.15.104:0/2972024760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33ec0711c0 0x7f33ec15f5a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0685c0 tx=0x7f33d802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3875cd029ab44d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:03.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.958+0000 7f33eb7fe640 1 -- 172.21.15.104:0/2972024760 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8037070 con 0x7f33ec0711c0 2024-05-08T04:22:03.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.958+0000 7f33eb7fe640 1 -- 172.21.15.104:0/2972024760 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d8032440 con 0x7f33ec0711c0 2024-05-08T04:22:03.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.958+0000 7f33eb7fe640 1 -- 172.21.15.104:0/2972024760 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8032810 con 0x7f33ec0711c0 2024-05-08T04:22:03.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.958+0000 7f33f2dce640 1 -- 172.21.15.104:0/2972024760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33ec0711c0 msgr2=0x7f33ec15f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.958+0000 7f33f2dce640 1 --2- 172.21.15.104:0/2972024760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33ec0711c0 0x7f33ec15f5a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0685c0 tx=0x7f33d802a140 comp rx=0 tx=0).stop 2024-05-08T04:22:03.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.958+0000 7f33f2dce640 1 -- 172.21.15.104:0/2972024760 shutdown_connections 2024-05-08T04:22:03.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.958+0000 7f33f2dce640 1 --2- 172.21.15.104:0/2972024760 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33ec144c80 0x7f33ec15fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.958+0000 7f33f2dce640 1 --2- 172.21.15.104:0/2972024760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33ec0711c0 0x7f33ec15f5a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.958+0000 7f33f2dce640 1 --2- 172.21.15.104:0/2972024760 >> v2:172.21.15.183:3300/0 conn(0x7f33ec0cc930 0x7f33ec0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.958+0000 7f33f2dce640 1 -- 172.21.15.104:0/2972024760 >> 172.21.15.104:0/2972024760 conn(0x7f33ec0b13f0 msgr2=0x7f33ec0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:03.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.959+0000 7f33f2dce640 1 -- 172.21.15.104:0/2972024760 shutdown_connections 2024-05-08T04:22:03.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.959+0000 7f33f2dce640 1 -- 172.21.15.104:0/2972024760 wait complete. 2024-05-08T04:22:03.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.960+0000 7f33f2dce640 1 Processor -- start 2024-05-08T04:22:03.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.960+0000 7f33f2dce640 1 -- start start 2024-05-08T04:22:03.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f2dce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33ec0711c0 0x7f33ec14fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f2dce640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33ec0cc930 0x7f33ec142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f2dce640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33ec144c80 0x7f33ec0c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f2dce640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec0cf3b0 con 0x7f33ec0711c0 2024-05-08T04:22:03.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f2dce640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec06d330 con 0x7f33ec144c80 2024-05-08T04:22:03.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f2dce640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec1453f0 con 0x7f33ec0cc930 2024-05-08T04:22:03.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f0b6a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33ec0711c0 0x7f33ec14fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f0b6a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33ec0711c0 0x7f33ec14fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40986/0 (socket says 172.21.15.104:40986) 2024-05-08T04:22:03.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f0b6a640 1 -- 172.21.15.104:0/1659879860 learned_addr learned my addr 172.21.15.104:0/1659879860 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:03.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33ebfff640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33ec0cc930 0x7f33ec142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f136b640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33ec144c80 0x7f33ec0c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f0b6a640 1 -- 172.21.15.104:0/1659879860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33ec0cc930 msgr2=0x7f33ec142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f0b6a640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33ec0cc930 0x7f33ec142090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f0b6a640 1 -- 172.21.15.104:0/1659879860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33ec144c80 msgr2=0x7f33ec0c4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f0b6a640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33ec144c80 0x7f33ec0c4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f0b6a640 1 -- 172.21.15.104:0/1659879860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec1500f0 con 0x7f33ec0711c0 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f0b6a640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33ec0711c0 0x7f33ec14fbb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f33e000c7f0 tx=0x7f33e000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33e97fa640 1 -- 172.21.15.104:0/1659879860 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0015070 con 0x7f33ec0711c0 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33e97fa640 1 -- 172.21.15.104:0/1659879860 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e0007820 con 0x7f33ec0711c0 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f2dce640 1 -- 172.21.15.104:0/1659879860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec1425d0 con 0x7f33ec0711c0 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33e97fa640 1 -- 172.21.15.104:0/1659879860 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0007c10 con 0x7f33ec0711c0 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.961+0000 7f33f2dce640 1 -- 172.21.15.104:0/1659879860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ec0ace20 con 0x7f33ec0711c0 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.962+0000 7f33f2dce640 1 -- 172.21.15.104:0/1659879860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec075010 con 0x7f33ec0711c0 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.963+0000 7f33e97fa640 1 -- 172.21.15.104:0/1659879860 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f33e0018070 con 0x7f33ec0711c0 2024-05-08T04:22:03.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.963+0000 7f33e97fa640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f33d006b500 0x7f33d006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:03.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.963+0000 7f33e97fa640 1 -- 172.21.15.104:0/1659879860 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f33e0089d10 con 0x7f33ec0711c0 2024-05-08T04:22:03.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.963+0000 7f33ebfff640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f33d006b500 0x7f33d006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:03.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.964+0000 7f33ebfff640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f33d006b500 0x7f33d006d9c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33d8034000 tx=0x7f33d802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:03.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:03.967+0000 7f33e97fa640 1 -- 172.21.15.104:0/1659879860 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f33ec1425d0 con 0x7f33ec0711c0 2024-05-08T04:22:04.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.206+0000 7f33f2dce640 1 -- 172.21.15.104:0/1659879860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f33ec0af040 con 0x7f33ec0711c0 2024-05-08T04:22:04.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.208+0000 7f33e97fa640 1 -- 172.21.15.104:0/1659879860 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f33e0058810 con 0x7f33ec0711c0 2024-05-08T04:22:04.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.210+0000 7f33f2dce640 1 -- 172.21.15.104:0/1659879860 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f33d006b500 msgr2=0x7f33d006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.210+0000 7f33f2dce640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f33d006b500 0x7f33d006d9c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33d8034000 tx=0x7f33d802e000 comp rx=0 tx=0).stop 2024-05-08T04:22:04.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.210+0000 7f33f2dce640 1 -- 172.21.15.104:0/1659879860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33ec0711c0 msgr2=0x7f33ec14fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.210+0000 7f33f2dce640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33ec0711c0 0x7f33ec14fbb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f33e000c7f0 tx=0x7f33e000ccb0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.210+0000 7f33f2dce640 1 -- 172.21.15.104:0/1659879860 shutdown_connections 2024-05-08T04:22:04.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.210+0000 7f33f2dce640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f33d006b500 0x7f33d006d9c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.210+0000 7f33f2dce640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33ec144c80 0x7f33ec0c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.210+0000 7f33f2dce640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33ec0cc930 0x7f33ec142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.210+0000 7f33f2dce640 1 --2- 172.21.15.104:0/1659879860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33ec0711c0 0x7f33ec14fbb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.210+0000 7f33f2dce640 1 -- 172.21.15.104:0/1659879860 >> 172.21.15.104:0/1659879860 conn(0x7f33ec0b13f0 msgr2=0x7f33ec0a8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:04.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.210+0000 7f33f2dce640 1 -- 172.21.15.104:0/1659879860 shutdown_connections 2024-05-08T04:22:04.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.210+0000 7f33f2dce640 1 -- 172.21.15.104:0/1659879860 wait complete. 2024-05-08T04:22:04.223 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-08T04:22:04.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.321+0000 7f94cb1c1640 1 Processor -- start 2024-05-08T04:22:04.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.321+0000 7f94cb1c1640 1 -- start start 2024-05-08T04:22:04.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.322+0000 7f94cb1c1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f94c40ada00 0x7f94c4072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.322+0000 7f94cb1c1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415c080 0x7f94c40acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.322+0000 7f94cb1c1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c406f4f0 con 0x7f94c415bca0 2024-05-08T04:22:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.322+0000 7f94cb1c1640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c415c510 con 0x7f94c40ada00 2024-05-08T04:22:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.322+0000 7f94cb1c1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c406f7b0 con 0x7f94c415c080 2024-05-08T04:22:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.322+0000 7f94c3fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f94c40ada00 0x7f94c4072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.322+0000 7f94c3fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f94c40ada00 0x7f94c4072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40988/0 (socket says 172.21.15.104:40988) 2024-05-08T04:22:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.322+0000 7f94c3fff640 1 -- 172.21.15.104:0/3525635666 learned_addr learned my addr 172.21.15.104:0/3525635666 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.323+0000 7f94c3fff640 1 -- 172.21.15.104:0/3525635666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415c080 msgr2=0x7f94c40acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.323+0000 7f94c975e640 1 --2- 172.21.15.104:0/3525635666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415c080 0x7f94c40acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.323+0000 7f94c3fff640 1 --2- 172.21.15.104:0/3525635666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415c080 0x7f94c40acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.323+0000 7f94c3fff640 1 -- 172.21.15.104:0/3525635666 >> v1:172.21.15.183:6789/0 conn(0x7f94c415bca0 legacy=0x7f94c4160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:04.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.323+0000 7f94c3fff640 1 -- 172.21.15.104:0/3525635666 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c40af570 con 0x7f94c40ada00 2024-05-08T04:22:04.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.323+0000 7f94c3fff640 1 --2- 172.21.15.104:0/3525635666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c40ada00 0x7f94c4072810 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009e50 tx=0x7f94ac02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afcd4878dd91fc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:04.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.323+0000 7f94c37fe640 1 -- 172.21.15.104:0/3525635666 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac036070 con 0x7f94c40ada00 2024-05-08T04:22:04.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.324+0000 7f94c37fe640 1 -- 172.21.15.104:0/3525635666 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac031600 con 0x7f94c40ada00 2024-05-08T04:22:04.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.324+0000 7f94c37fe640 1 -- 172.21.15.104:0/3525635666 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0319d0 con 0x7f94c40ada00 2024-05-08T04:22:04.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.324+0000 7f94cb1c1640 1 -- 172.21.15.104:0/3525635666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c40ada00 msgr2=0x7f94c4072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.324+0000 7f94cb1c1640 1 --2- 172.21.15.104:0/3525635666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c40ada00 0x7f94c4072810 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009e50 tx=0x7f94ac02a630 comp rx=0 tx=0).stop 2024-05-08T04:22:04.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.324+0000 7f94cb1c1640 1 -- 172.21.15.104:0/3525635666 shutdown_connections 2024-05-08T04:22:04.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.324+0000 7f94cb1c1640 1 --2- 172.21.15.104:0/3525635666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c415c080 0x7f94c40acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.324+0000 7f94cb1c1640 1 --2- 172.21.15.104:0/3525635666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c40ada00 0x7f94c4072810 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.324+0000 7f94cb1c1640 1 -- 172.21.15.104:0/3525635666 >> 172.21.15.104:0/3525635666 conn(0x7f94c4071a10 msgr2=0x7f94c4071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:04.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.324+0000 7f94cb1c1640 1 -- 172.21.15.104:0/3525635666 shutdown_connections 2024-05-08T04:22:04.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.324+0000 7f94cb1c1640 1 -- 172.21.15.104:0/3525635666 wait complete. 2024-05-08T04:22:04.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.325+0000 7f94cb1c1640 1 Processor -- start 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.325+0000 7f94cb1c1640 1 -- start start 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.326+0000 7f94cb1c1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c40ada00 0x7f94c4150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.326+0000 7f94cb1c1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c415bca0 0x7f94c4148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.326+0000 7f94cb1c1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c415c080 0x7f94c40cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.326+0000 7f94cb1c1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40ad330 con 0x7f94c415bca0 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.326+0000 7f94cb1c1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40af850 con 0x7f94c415c080 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.326+0000 7f94cb1c1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40ad4b0 con 0x7f94c40ada00 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.326+0000 7f94c3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c415bca0 0x7f94c4148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.326+0000 7f94c3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c415bca0 0x7f94c4148800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40990/0 (socket says 172.21.15.104:40990) 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.326+0000 7f94c3fff640 1 -- 172.21.15.104:0/130982125 learned_addr learned my addr 172.21.15.104:0/130982125 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.327+0000 7f94c975e640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c415c080 0x7f94c40cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.327+0000 7f94c8f5d640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c40ada00 0x7f94c4150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.327+0000 7f94c3fff640 1 -- 172.21.15.104:0/130982125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c40ada00 msgr2=0x7f94c4150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.327+0000 7f94c3fff640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c40ada00 0x7f94c4150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.327+0000 7f94c3fff640 1 -- 172.21.15.104:0/130982125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c415c080 msgr2=0x7f94c40cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.327+0000 7f94c3fff640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c415c080 0x7f94c40cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.327+0000 7f94c3fff640 1 -- 172.21.15.104:0/130982125 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4150a70 con 0x7f94c415bca0 2024-05-08T04:22:04.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.327+0000 7f94c3fff640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c415bca0 0x7f94c4148800 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f94ac034040 tx=0x7f94ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:04.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.327+0000 7f94c17fa640 1 -- 172.21.15.104:0/130982125 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac03f020 con 0x7f94c415bca0 2024-05-08T04:22:04.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.327+0000 7f94c17fa640 1 -- 172.21.15.104:0/130982125 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac037040 con 0x7f94c415bca0 2024-05-08T04:22:04.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.327+0000 7f94cb1c1640 1 -- 172.21.15.104:0/130982125 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c40b3190 con 0x7f94c415bca0 2024-05-08T04:22:04.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.327+0000 7f94c17fa640 1 -- 172.21.15.104:0/130982125 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac036070 con 0x7f94c415bca0 2024-05-08T04:22:04.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.327+0000 7f94cb1c1640 1 -- 172.21.15.104:0/130982125 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c40b3750 con 0x7f94c415bca0 2024-05-08T04:22:04.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.328+0000 7f94cb1c1640 1 -- 172.21.15.104:0/130982125 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c40b3c40 con 0x7f94c415bca0 2024-05-08T04:22:04.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.328+0000 7f94c17fa640 1 -- 172.21.15.104:0/130982125 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f94ac042020 con 0x7f94c415bca0 2024-05-08T04:22:04.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.329+0000 7f94c17fa640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f94a406b4d0 0x7f94a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.329+0000 7f94c17fa640 1 -- 172.21.15.104:0/130982125 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f94ac0aa3b0 con 0x7f94c415bca0 2024-05-08T04:22:04.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.329+0000 7f94c8f5d640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f94a406b4d0 0x7f94a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.329+0000 7f94c8f5d640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f94a406b4d0 0x7f94a406d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f94b4006fd0 tx=0x7f94b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:04.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.333+0000 7f94c17fa640 1 -- 172.21.15.104:0/130982125 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f94ac049030 con 0x7f94c415bca0 2024-05-08T04:22:04.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.570+0000 7f94cb1c1640 1 -- 172.21.15.104:0/130982125 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f94c4075010 con 0x7f94c415bca0 2024-05-08T04:22:04.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.574+0000 7f94c17fa640 1 -- 172.21.15.104:0/130982125 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f94ac079610 con 0x7f94c415bca0 2024-05-08T04:22:04.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.576+0000 7f94cb1c1640 1 -- 172.21.15.104:0/130982125 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f94a406b4d0 msgr2=0x7f94a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.576+0000 7f94cb1c1640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f94a406b4d0 0x7f94a406d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f94b4006fd0 tx=0x7f94b4008040 comp rx=0 tx=0).stop 2024-05-08T04:22:04.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.576+0000 7f94cb1c1640 1 -- 172.21.15.104:0/130982125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c415bca0 msgr2=0x7f94c4148800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.576+0000 7f94cb1c1640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c415bca0 0x7f94c4148800 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f94ac034040 tx=0x7f94ac004a40 comp rx=0 tx=0).stop 2024-05-08T04:22:04.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.576+0000 7f94cb1c1640 1 -- 172.21.15.104:0/130982125 shutdown_connections 2024-05-08T04:22:04.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.576+0000 7f94cb1c1640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f94a406b4d0 0x7f94a406d990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.576+0000 7f94cb1c1640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c415c080 0x7f94c40cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.576+0000 7f94cb1c1640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f94c415bca0 0x7f94c4148800 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.576+0000 7f94cb1c1640 1 --2- 172.21.15.104:0/130982125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c40ada00 0x7f94c4150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.576+0000 7f94cb1c1640 1 -- 172.21.15.104:0/130982125 >> 172.21.15.104:0/130982125 conn(0x7f94c4071a10 msgr2=0x7f94c40b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:04.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.576+0000 7f94cb1c1640 1 -- 172.21.15.104:0/130982125 shutdown_connections 2024-05-08T04:22:04.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.576+0000 7f94cb1c1640 1 -- 172.21.15.104:0/130982125 wait complete. 2024-05-08T04:22:04.589 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:04.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.685+0000 7fca8477e640 1 Processor -- start 2024-05-08T04:22:04.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.685+0000 7fca8477e640 1 -- start start 2024-05-08T04:22:04.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.686+0000 7fca8477e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fca7c159ec0 0x7fca7c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.686+0000 7fca8477e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c15dce0 con 0x7fca7c15a2a0 2024-05-08T04:22:04.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.686+0000 7fca8477e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c06eb60 con 0x7fca7c072160 2024-05-08T04:22:04.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.686+0000 7fca8477e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c06ee40 con 0x7fca7c159ec0 2024-05-08T04:22:04.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.686+0000 7fca8251a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fca7c159ec0 0x7fca7c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.686+0000 7fca81d19640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fca7c15a2a0 0x7fca7c071a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53496/0 (socket says 172.21.15.104:53496) 2024-05-08T04:22:04.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.686+0000 7fca81d19640 1 -- 172.21.15.104:0/2819499107 learned_addr learned my addr 172.21.15.104:0/2819499107 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:04.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.687+0000 7fca8251a640 1 -- 172.21.15.104:0/2819499107 >> v1:172.21.15.183:6789/0 conn(0x7fca7c072160 legacy=0x7fca7c0b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:04.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.687+0000 7fca8251a640 1 -- 172.21.15.104:0/2819499107 >> v1:172.21.15.104:6789/0 conn(0x7fca7c15a2a0 legacy=0x7fca7c071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.687+0000 7fca81518640 1 -- 172.21.15.104:0/2819499107 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094271370 0 0) 0x7fca7c15dce0 con 0x7fca7c15a2a0 2024-05-08T04:22:04.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.687+0000 7fca8251a640 1 -- 172.21.15.104:0/2819499107 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c15df80 con 0x7fca7c159ec0 2024-05-08T04:22:04.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.687+0000 7fca8251a640 1 --2- 172.21.15.104:0/2819499107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca7c159ec0 0x7fca7c06e4d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00a940 tx=0x7fca6c02b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814e4d36722743c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:04.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.687+0000 7fca81518640 1 -- 172.21.15.104:0/2819499107 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c00b040 con 0x7fca7c159ec0 2024-05-08T04:22:04.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.687+0000 7fca81518640 1 -- 172.21.15.104:0/2819499107 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c030710 con 0x7fca7c159ec0 2024-05-08T04:22:04.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.687+0000 7fca81518640 1 -- 172.21.15.104:0/2819499107 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c030ae0 con 0x7fca7c159ec0 2024-05-08T04:22:04.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.688+0000 7fca8477e640 1 -- 172.21.15.104:0/2819499107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca7c159ec0 msgr2=0x7fca7c06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.688+0000 7fca8477e640 1 --2- 172.21.15.104:0/2819499107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca7c159ec0 0x7fca7c06e4d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00a940 tx=0x7fca6c02b5a0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.688+0000 7fca8477e640 1 -- 172.21.15.104:0/2819499107 shutdown_connections 2024-05-08T04:22:04.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.688+0000 7fca8477e640 1 --2- 172.21.15.104:0/2819499107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca7c159ec0 0x7fca7c06e4d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.688+0000 7fca8477e640 1 -- 172.21.15.104:0/2819499107 >> 172.21.15.104:0/2819499107 conn(0x7fca7c0b13f0 msgr2=0x7fca7c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:04.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.688+0000 7fca8477e640 1 -- 172.21.15.104:0/2819499107 shutdown_connections 2024-05-08T04:22:04.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.688+0000 7fca8477e640 1 -- 172.21.15.104:0/2819499107 wait complete. 2024-05-08T04:22:04.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.689+0000 7fca8477e640 1 Processor -- start 2024-05-08T04:22:04.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.689+0000 7fca8477e640 1 -- start start 2024-05-08T04:22:04.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8477e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca7c072160 0x7fca7c14b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8477e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca7c159ec0 0x7fca7c15be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8477e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca7c15a2a0 0x7fca7c15c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8477e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c15b360 con 0x7fca7c072160 2024-05-08T04:22:04.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8477e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c15b1e0 con 0x7fca7c159ec0 2024-05-08T04:22:04.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8477e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c15b4e0 con 0x7fca7c15a2a0 2024-05-08T04:22:04.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8251a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca7c072160 0x7fca7c14b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8251a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca7c072160 0x7fca7c14b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40994/0 (socket says 172.21.15.104:40994) 2024-05-08T04:22:04.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8251a640 1 -- 172.21.15.104:0/3997937924 learned_addr learned my addr 172.21.15.104:0/3997937924 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:04.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8251a640 1 -- 172.21.15.104:0/3997937924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca7c15a2a0 msgr2=0x7fca7c15c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8251a640 1 --2- 172.21.15.104:0/3997937924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca7c15a2a0 0x7fca7c15c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8251a640 1 -- 172.21.15.104:0/3997937924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca7c159ec0 msgr2=0x7fca7c15be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8251a640 1 --2- 172.21.15.104:0/3997937924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca7c159ec0 0x7fca7c15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.690+0000 7fca8251a640 1 -- 172.21.15.104:0/3997937924 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c14a7c0 con 0x7fca7c072160 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.691+0000 7fca8251a640 1 --2- 172.21.15.104:0/3997937924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca7c072160 0x7fca7c14b860 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00a940 tx=0x7fca6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.691+0000 7fca7affd640 1 -- 172.21.15.104:0/3997937924 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c040030 con 0x7fca7c072160 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.691+0000 7fca7affd640 1 -- 172.21.15.104:0/3997937924 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c030510 con 0x7fca7c072160 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.691+0000 7fca7affd640 1 -- 172.21.15.104:0/3997937924 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c006e10 con 0x7fca7c072160 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.691+0000 7fca8477e640 1 -- 172.21.15.104:0/3997937924 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7c14aaa0 con 0x7fca7c072160 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.691+0000 7fca8477e640 1 -- 172.21.15.104:0/3997937924 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c14b060 con 0x7fca7c072160 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.692+0000 7fca8477e640 1 -- 172.21.15.104:0/3997937924 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c075010 con 0x7fca7c072160 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.692+0000 7fca7affd640 1 -- 172.21.15.104:0/3997937924 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fca6c043030 con 0x7fca7c072160 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.693+0000 7fca7affd640 1 --2- 172.21.15.104:0/3997937924 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fca6806b4d0 0x7fca6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.693+0000 7fca7affd640 1 -- 172.21.15.104:0/3997937924 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fca6c0aaa20 con 0x7fca7c072160 2024-05-08T04:22:04.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.693+0000 7fca81d19640 1 --2- 172.21.15.104:0/3997937924 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fca6806b4d0 0x7fca6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.693+0000 7fca81d19640 1 --2- 172.21.15.104:0/3997937924 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fca6806b4d0 0x7fca6806d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca70007fd0 tx=0x7fca70007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:04.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.697+0000 7fca7affd640 1 -- 172.21.15.104:0/3997937924 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca6c079c80 con 0x7fca7c072160 2024-05-08T04:22:04.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.868+0000 7fca8477e640 1 -- 172.21.15.104:0/3997937924 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca7c14f5c0 con 0x7fca7c072160 2024-05-08T04:22:04.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.869+0000 7fca7affd640 1 -- 172.21.15.104:0/3997937924 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12951 (secure 0 0 0) 0x7fca6c0306e0 con 0x7fca7c072160 2024-05-08T04:22:04.871 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:04.872 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":29,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:02.019598+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.871+0000 7fca8477e640 1 -- 172.21.15.104:0/3997937924 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fca6806b4d0 msgr2=0x7fca6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.871+0000 7fca8477e640 1 --2- 172.21.15.104:0/3997937924 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fca6806b4d0 0x7fca6806d990 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca70007fd0 tx=0x7fca70007920 comp rx=0 tx=0).stop 2024-05-08T04:22:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.871+0000 7fca8477e640 1 -- 172.21.15.104:0/3997937924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca7c072160 msgr2=0x7fca7c14b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.871+0000 7fca8477e640 1 --2- 172.21.15.104:0/3997937924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca7c072160 0x7fca7c14b860 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00a940 tx=0x7fca6c004730 comp rx=0 tx=0).stop 2024-05-08T04:22:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.871+0000 7fca8477e640 1 -- 172.21.15.104:0/3997937924 shutdown_connections 2024-05-08T04:22:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.871+0000 7fca8477e640 1 --2- 172.21.15.104:0/3997937924 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fca6806b4d0 0x7fca6806d990 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.871+0000 7fca8477e640 1 --2- 172.21.15.104:0/3997937924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca7c159ec0 0x7fca7c15be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.871+0000 7fca8477e640 1 --2- 172.21.15.104:0/3997937924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca7c15a2a0 0x7fca7c15c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.871+0000 7fca8477e640 1 --2- 172.21.15.104:0/3997937924 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca7c072160 0x7fca7c14b860 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.871+0000 7fca8477e640 1 -- 172.21.15.104:0/3997937924 >> 172.21.15.104:0/3997937924 conn(0x7fca7c0b13f0 msgr2=0x7fca7c14e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.871+0000 7fca8477e640 1 -- 172.21.15.104:0/3997937924 shutdown_connections 2024-05-08T04:22:04.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.871+0000 7fca8477e640 1 -- 172.21.15.104:0/3997937924 wait complete. 2024-05-08T04:22:04.884 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:22:04.885 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:22:04.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.985+0000 7f35675b0640 1 Processor -- start 2024-05-08T04:22:04.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.985+0000 7f35675b0640 1 -- start start 2024-05-08T04:22:04.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f35675b0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f356006ea40 0x7f35600b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f35675b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35600b3ff0 0x7f35600b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f35675b0640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35600b49c0 con 0x7f35600ceee0 2024-05-08T04:22:04.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f35675b0640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356015f390 con 0x7f356006ea40 2024-05-08T04:22:04.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f35675b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356015e780 con 0x7f35600b3ff0 2024-05-08T04:22:04.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f3564b4b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f356006ea40 0x7f35600b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f356534c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f35600ceee0 0x7f356006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53510/0 (socket says 172.21.15.104:53510) 2024-05-08T04:22:04.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f356534c640 1 -- 172.21.15.104:0/1390569825 learned_addr learned my addr 172.21.15.104:0/1390569825 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:04.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f3565b4d640 1 --2- 172.21.15.104:0/1390569825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35600b3ff0 0x7f35600b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f3564b4b640 1 -- 172.21.15.104:0/1390569825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35600b3ff0 msgr2=0x7f35600b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:04.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f3564b4b640 1 --2- 172.21.15.104:0/1390569825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35600b3ff0 0x7f35600b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f3564b4b640 1 -- 172.21.15.104:0/1390569825 >> v1:172.21.15.104:6789/0 conn(0x7f35600ceee0 legacy=0x7f356006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f355ffff640 1 -- 172.21.15.104:0/1390569825 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001244815 0 0) 0x7f35600b49c0 con 0x7f35600ceee0 2024-05-08T04:22:04.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.986+0000 7f3564b4b640 1 -- 172.21.15.104:0/1390569825 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356015ea60 con 0x7f356006ea40 2024-05-08T04:22:04.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.987+0000 7f3564b4b640 1 --2- 172.21.15.104:0/1390569825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f356006ea40 0x7f35600b26f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f35540097a0 tx=0x7f355402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2021b3328871485b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:04.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.987+0000 7f355ffff640 1 -- 172.21.15.104:0/1390569825 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554037070 con 0x7f356006ea40 2024-05-08T04:22:04.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.987+0000 7f355ffff640 1 -- 172.21.15.104:0/1390569825 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3554032440 con 0x7f356006ea40 2024-05-08T04:22:04.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.987+0000 7f355ffff640 1 -- 172.21.15.104:0/1390569825 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554032810 con 0x7f356006ea40 2024-05-08T04:22:04.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.987+0000 7f35675b0640 1 -- 172.21.15.104:0/1390569825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f356006ea40 msgr2=0x7f35600b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.987+0000 7f35675b0640 1 --2- 172.21.15.104:0/1390569825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f356006ea40 0x7f35600b26f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f35540097a0 tx=0x7f355402a180 comp rx=0 tx=0).stop 2024-05-08T04:22:04.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.988+0000 7f35675b0640 1 -- 172.21.15.104:0/1390569825 shutdown_connections 2024-05-08T04:22:04.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.988+0000 7f35675b0640 1 --2- 172.21.15.104:0/1390569825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35600b3ff0 0x7f35600b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.988+0000 7f35675b0640 1 --2- 172.21.15.104:0/1390569825 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f356006ea40 0x7f35600b26f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.988+0000 7f35675b0640 1 -- 172.21.15.104:0/1390569825 >> 172.21.15.104:0/1390569825 conn(0x7f35600b13f0 msgr2=0x7f35600b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:04.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.988+0000 7f35675b0640 1 -- 172.21.15.104:0/1390569825 shutdown_connections 2024-05-08T04:22:04.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.988+0000 7f35675b0640 1 -- 172.21.15.104:0/1390569825 wait complete. 2024-05-08T04:22:04.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.989+0000 7f35675b0640 1 Processor -- start 2024-05-08T04:22:04.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.989+0000 7f35675b0640 1 -- start start 2024-05-08T04:22:04.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.989+0000 7f35675b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f356006ea40 0x7f3560156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.989+0000 7f35675b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35600b3ff0 0x7f35600ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f35675b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35600ceee0 0x7f35600ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f35675b0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600cf2c0 con 0x7f356006ea40 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f35675b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356015f020 con 0x7f35600ceee0 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f35675b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35600cf440 con 0x7f35600b3ff0 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f356534c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f356006ea40 0x7f3560156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f356534c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f356006ea40 0x7f3560156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41012/0 (socket says 172.21.15.104:41012) 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f356534c640 1 -- 172.21.15.104:0/831076185 learned_addr learned my addr 172.21.15.104:0/831076185 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f356534c640 1 -- 172.21.15.104:0/831076185 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35600b3ff0 msgr2=0x7f35600ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f356534c640 1 --2- 172.21.15.104:0/831076185 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35600b3ff0 0x7f35600ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f3565b4d640 1 --2- 172.21.15.104:0/831076185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35600ceee0 0x7f35600ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f356534c640 1 -- 172.21.15.104:0/831076185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35600ceee0 msgr2=0x7f35600ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f356534c640 1 --2- 172.21.15.104:0/831076185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35600ceee0 0x7f35600ad9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f356534c640 1 -- 172.21.15.104:0/831076185 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35601f4e80 con 0x7f356006ea40 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f356534c640 1 --2- 172.21.15.104:0/831076185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f356006ea40 0x7f3560156060 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f355000c7f0 tx=0x7f355000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f355dffb640 1 -- 172.21.15.104:0/831076185 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550018070 con 0x7f356006ea40 2024-05-08T04:22:04.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f355dffb640 1 -- 172.21.15.104:0/831076185 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355000a640 con 0x7f356006ea40 2024-05-08T04:22:04.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f35675b0640 1 -- 172.21.15.104:0/831076185 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35601f5160 con 0x7f356006ea40 2024-05-08T04:22:04.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f355dffb640 1 -- 172.21.15.104:0/831076185 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000aa30 con 0x7f356006ea40 2024-05-08T04:22:04.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.990+0000 7f35675b0640 1 -- 172.21.15.104:0/831076185 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35601f5720 con 0x7f356006ea40 2024-05-08T04:22:04.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.991+0000 7f35675b0640 1 -- 172.21.15.104:0/831076185 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3560075010 con 0x7f356006ea40 2024-05-08T04:22:04.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.992+0000 7f355dffb640 1 -- 172.21.15.104:0/831076185 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f355001b070 con 0x7f356006ea40 2024-05-08T04:22:04.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.992+0000 7f355dffb640 1 --2- 172.21.15.104:0/831076185 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f354c06b4d0 0x7f354c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:04.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.992+0000 7f355dffb640 1 -- 172.21.15.104:0/831076185 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f35500894a0 con 0x7f356006ea40 2024-05-08T04:22:04.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.992+0000 7f3564b4b640 1 --2- 172.21.15.104:0/831076185 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f354c06b4d0 0x7f354c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:04.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.993+0000 7f3564b4b640 1 --2- 172.21.15.104:0/831076185 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f354c06b4d0 0x7f354c06d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3554034000 tx=0x7f355402c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:04.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:04.996+0000 7f355dffb640 1 -- 172.21.15.104:0/831076185 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3550058670 con 0x7f356006ea40 2024-05-08T04:22:05.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.167+0000 7f35675b0640 1 -- 172.21.15.104:0/831076185 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35600b2f30 con 0x7f356006ea40 2024-05-08T04:22:05.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.167+0000 7f355dffb640 1 -- 172.21.15.104:0/831076185 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3550057f70 con 0x7f356006ea40 2024-05-08T04:22:05.170 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:22:05.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.169+0000 7f35675b0640 1 -- 172.21.15.104:0/831076185 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f354c06b4d0 msgr2=0x7f354c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:05.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.169+0000 7f35675b0640 1 --2- 172.21.15.104:0/831076185 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f354c06b4d0 0x7f354c06d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3554034000 tx=0x7f355402c000 comp rx=0 tx=0).stop 2024-05-08T04:22:05.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.169+0000 7f35675b0640 1 -- 172.21.15.104:0/831076185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f356006ea40 msgr2=0x7f3560156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:05.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.169+0000 7f35675b0640 1 --2- 172.21.15.104:0/831076185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f356006ea40 0x7f3560156060 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f355000c7f0 tx=0x7f355000ccb0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.169+0000 7f35675b0640 1 -- 172.21.15.104:0/831076185 shutdown_connections 2024-05-08T04:22:05.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.169+0000 7f35675b0640 1 --2- 172.21.15.104:0/831076185 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f354c06b4d0 0x7f354c06d990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.169+0000 7f35675b0640 1 --2- 172.21.15.104:0/831076185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35600ceee0 0x7f35600ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.169+0000 7f35675b0640 1 --2- 172.21.15.104:0/831076185 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35600b3ff0 0x7f35600ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.169+0000 7f35675b0640 1 --2- 172.21.15.104:0/831076185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f356006ea40 0x7f3560156060 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.169+0000 7f35675b0640 1 -- 172.21.15.104:0/831076185 >> 172.21.15.104:0/831076185 conn(0x7f35600b13f0 msgr2=0x7f35600b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:05.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.169+0000 7f35675b0640 1 -- 172.21.15.104:0/831076185 shutdown_connections 2024-05-08T04:22:05.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.169+0000 7f35675b0640 1 -- 172.21.15.104:0/831076185 wait complete. 2024-05-08T04:22:05.182 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T04:22:05.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.279+0000 7f8b5cae1640 1 Processor -- start 2024-05-08T04:22:05.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.279+0000 7f8b5cae1640 1 -- start start 2024-05-08T04:22:05.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.280+0000 7f8b5cae1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8b580cc930 0x7f8b580ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:05.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.280+0000 7f8b5cae1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8b5806e860 0x7f8b5815fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:05.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.280+0000 7f8b5cae1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b58071fb0 con 0x7f8b580711c0 2024-05-08T04:22:05.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.280+0000 7f8b5cae1640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b580cd250 con 0x7f8b580cc930 2024-05-08T04:22:05.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.280+0000 7f8b5cae1640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b58071710 con 0x7f8b5806e860 2024-05-08T04:22:05.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.280+0000 7f8b5659c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8b580cc930 0x7f8b580ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:05.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.280+0000 7f8b5659c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8b580cc930 0x7f8b580ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41024/0 (socket says 172.21.15.104:41024) 2024-05-08T04:22:05.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.280+0000 7f8b5659c640 1 -- 172.21.15.104:0/1423287493 learned_addr learned my addr 172.21.15.104:0/1423287493 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:05.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.280+0000 7f8b56d9d640 1 --2- 172.21.15.104:0/1423287493 >> v2:172.21.15.183:3300/0 conn(0x7f8b5806e860 0x7f8b5815fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:05.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.280+0000 7f8b5659c640 1 -- 172.21.15.104:0/1423287493 >> v2:172.21.15.183:3300/0 conn(0x7f8b5806e860 msgr2=0x7f8b5815fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:05.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.280+0000 7f8b5659c640 1 --2- 172.21.15.104:0/1423287493 >> v2:172.21.15.183:3300/0 conn(0x7f8b5806e860 0x7f8b5815fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.280+0000 7f8b5659c640 1 -- 172.21.15.104:0/1423287493 >> v1:172.21.15.183:6789/0 conn(0x7f8b580711c0 legacy=0x7f8b5815f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:05.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.280+0000 7f8b5659c640 1 -- 172.21.15.104:0/1423287493 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b580719f0 con 0x7f8b580cc930 2024-05-08T04:22:05.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.281+0000 7f8b5659c640 1 --2- 172.21.15.104:0/1423287493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b580cc930 0x7f8b580ccd10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8b580af2f0 tx=0x7f8b4802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884ae29cb79dee15 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:05.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.281+0000 7f8b55d9b640 1 -- 172.21.15.104:0/1423287493 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48037070 con 0x7f8b580cc930 2024-05-08T04:22:05.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.281+0000 7f8b55d9b640 1 -- 172.21.15.104:0/1423287493 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b48032440 con 0x7f8b580cc930 2024-05-08T04:22:05.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.281+0000 7f8b55d9b640 1 -- 172.21.15.104:0/1423287493 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48032810 con 0x7f8b580cc930 2024-05-08T04:22:05.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.281+0000 7f8b5cae1640 1 -- 172.21.15.104:0/1423287493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b580cc930 msgr2=0x7f8b580ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:05.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.281+0000 7f8b5cae1640 1 --2- 172.21.15.104:0/1423287493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b580cc930 0x7f8b580ccd10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8b580af2f0 tx=0x7f8b4802a1a0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.281+0000 7f8b5cae1640 1 -- 172.21.15.104:0/1423287493 shutdown_connections 2024-05-08T04:22:05.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.281+0000 7f8b5cae1640 1 --2- 172.21.15.104:0/1423287493 >> v2:172.21.15.183:3300/0 conn(0x7f8b5806e860 0x7f8b5815fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.281+0000 7f8b5cae1640 1 --2- 172.21.15.104:0/1423287493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b580cc930 0x7f8b580ccd10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.282+0000 7f8b5cae1640 1 -- 172.21.15.104:0/1423287493 >> 172.21.15.104:0/1423287493 conn(0x7f8b580b13f0 msgr2=0x7f8b580b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:05.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.282+0000 7f8b5cae1640 1 -- 172.21.15.104:0/1423287493 shutdown_connections 2024-05-08T04:22:05.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.282+0000 7f8b5cae1640 1 -- 172.21.15.104:0/1423287493 wait complete. 2024-05-08T04:22:05.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.283+0000 7f8b5cae1640 1 Processor -- start 2024-05-08T04:22:05.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.283+0000 7f8b5cae1640 1 -- start start 2024-05-08T04:22:05.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b5cae1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b5806e860 0x7f8b580aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:05.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b5cae1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b580711c0 0x7f8b5813ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b5cae1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b580cc930 0x7f8b581395c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b5cae1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b580cf3b0 con 0x7f8b580cc930 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b5cae1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5806d330 con 0x7f8b5806e860 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b5cae1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b581453f0 con 0x7f8b580711c0 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b56d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b580cc930 0x7f8b581395c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b56d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b580cc930 0x7f8b581395c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41032/0 (socket says 172.21.15.104:41032) 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b56d9d640 1 -- 172.21.15.104:0/2342046593 learned_addr learned my addr 172.21.15.104:0/2342046593 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b5659c640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b5806e860 0x7f8b580aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b4dd9b640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b580711c0 0x7f8b5813ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b56d9d640 1 -- 172.21.15.104:0/2342046593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b580711c0 msgr2=0x7f8b5813ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b56d9d640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b580711c0 0x7f8b5813ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b56d9d640 1 -- 172.21.15.104:0/2342046593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b5806e860 msgr2=0x7f8b580aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b56d9d640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b5806e860 0x7f8b580aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b56d9d640 1 -- 172.21.15.104:0/2342046593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5813f470 con 0x7f8b580cc930 2024-05-08T04:22:05.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b5659c640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b5806e860 0x7f8b580aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:05.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b56d9d640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b580cc930 0x7f8b581395c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8b50007e60 tx=0x7f8b5000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:05.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b4f7fe640 1 -- 172.21.15.104:0/2342046593 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50014420 con 0x7f8b580cc930 2024-05-08T04:22:05.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b4f7fe640 1 -- 172.21.15.104:0/2342046593 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b50019070 con 0x7f8b580cc930 2024-05-08T04:22:05.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b5cae1640 1 -- 172.21.15.104:0/2342046593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b581407b0 con 0x7f8b580cc930 2024-05-08T04:22:05.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.284+0000 7f8b4f7fe640 1 -- 172.21.15.104:0/2342046593 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50014820 con 0x7f8b580cc930 2024-05-08T04:22:05.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.285+0000 7f8b5cae1640 1 -- 172.21.15.104:0/2342046593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5813f9f0 con 0x7f8b580cc930 2024-05-08T04:22:05.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.286+0000 7f8b5cae1640 1 -- 172.21.15.104:0/2342046593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b58075010 con 0x7f8b580cc930 2024-05-08T04:22:05.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.286+0000 7f8b4f7fe640 1 -- 172.21.15.104:0/2342046593 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8b500149c0 con 0x7f8b580cc930 2024-05-08T04:22:05.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.286+0000 7f8b4f7fe640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8b3806b4d0 0x7f8b3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:05.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.286+0000 7f8b4f7fe640 1 -- 172.21.15.104:0/2342046593 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8b5008a710 con 0x7f8b580cc930 2024-05-08T04:22:05.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.286+0000 7f8b5659c640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8b3806b4d0 0x7f8b3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:05.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.287+0000 7f8b5659c640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8b3806b4d0 0x7f8b3806d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8b48034000 tx=0x7f8b4802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:05.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.290+0000 7f8b4f7fe640 1 -- 172.21.15.104:0/2342046593 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8b500598e0 con 0x7f8b580cc930 2024-05-08T04:22:05.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.463+0000 7f8b5cae1640 1 -- 172.21.15.104:0/2342046593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8b580cbb00 con 0x7f8b580cc930 2024-05-08T04:22:05.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.464+0000 7f8b4f7fe640 1 -- 172.21.15.104:0/2342046593 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8b500591e0 con 0x7f8b580cc930 2024-05-08T04:22:05.466 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:05.466 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-05-08T04:22:05.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:05.467 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-05-08T04:22:05.467 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-05-08T04:22:05.467 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:05.467 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-05-08T04:22:05.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.466+0000 7f8b5cae1640 1 -- 172.21.15.104:0/2342046593 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8b3806b4d0 msgr2=0x7f8b3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:05.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.466+0000 7f8b5cae1640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8b3806b4d0 0x7f8b3806d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8b48034000 tx=0x7f8b4802e000 comp rx=0 tx=0).stop 2024-05-08T04:22:05.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.466+0000 7f8b5cae1640 1 -- 172.21.15.104:0/2342046593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b580cc930 msgr2=0x7f8b581395c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:05.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.466+0000 7f8b5cae1640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b580cc930 0x7f8b581395c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8b50007e60 tx=0x7f8b5000e4b0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.466+0000 7f8b5cae1640 1 -- 172.21.15.104:0/2342046593 shutdown_connections 2024-05-08T04:22:05.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.466+0000 7f8b5cae1640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8b3806b4d0 0x7f8b3806d990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.466+0000 7f8b5cae1640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8b580cc930 0x7f8b581395c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.466+0000 7f8b5cae1640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b580711c0 0x7f8b5813ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.466+0000 7f8b5cae1640 1 --2- 172.21.15.104:0/2342046593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b5806e860 0x7f8b580aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.466+0000 7f8b5cae1640 1 -- 172.21.15.104:0/2342046593 >> 172.21.15.104:0/2342046593 conn(0x7f8b580b13f0 msgr2=0x7f8b580b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:05.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.466+0000 7f8b5cae1640 1 -- 172.21.15.104:0/2342046593 shutdown_connections 2024-05-08T04:22:05.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.466+0000 7f8b5cae1640 1 -- 172.21.15.104:0/2342046593 wait complete. 2024-05-08T04:22:05.479 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T04:22:05.479 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T04:22:05.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.580+0000 7fb3d90f5640 1 Processor -- start 2024-05-08T04:22:05.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.580+0000 7fb3d90f5640 1 -- start start 2024-05-08T04:22:05.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.581+0000 7fb3d90f5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb3d415db30 0x7fb3d406bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:05.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.581+0000 7fb3d90f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3d40b5b40 0x7fb3d40d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:05.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.581+0000 7fb3d90f5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d40b6b50 con 0x7fb3d40b93b0 2024-05-08T04:22:05.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.581+0000 7fb3d90f5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d406c800 con 0x7fb3d415db30 2024-05-08T04:22:05.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.581+0000 7fb3d90f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d406cae0 con 0x7fb3d40b5b40 2024-05-08T04:22:05.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.581+0000 7fb3d2d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb3d415db30 0x7fb3d406bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:05.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.581+0000 7fb3d2d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb3d415db30 0x7fb3d406bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41042/0 (socket says 172.21.15.104:41042) 2024-05-08T04:22:05.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.581+0000 7fb3d2d9d640 1 -- 172.21.15.104:0/1633823457 learned_addr learned my addr 172.21.15.104:0/1633823457 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:05.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.581+0000 7fb3d359e640 1 --2- 172.21.15.104:0/1633823457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3d40b5b40 0x7fb3d40d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:05.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.581+0000 7fb3d2d9d640 1 -- 172.21.15.104:0/1633823457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3d40b5b40 msgr2=0x7fb3d40d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:05.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.581+0000 7fb3d2d9d640 1 --2- 172.21.15.104:0/1633823457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3d40b5b40 0x7fb3d40d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.581+0000 7fb3d2d9d640 1 -- 172.21.15.104:0/1633823457 >> v1:172.21.15.183:6789/0 conn(0x7fb3d40b93b0 legacy=0x7fb3d40b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:05.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.581+0000 7fb3d2d9d640 1 -- 172.21.15.104:0/1633823457 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d406cdc0 con 0x7fb3d415db30 2024-05-08T04:22:05.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.582+0000 7fb3d2d9d640 1 --2- 172.21.15.104:0/1633823457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3d415db30 0x7fb3d406bfb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009870 tx=0x7fb3c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaab2a006bfc287e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:05.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.582+0000 7fb3d259c640 1 -- 172.21.15.104:0/1633823457 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4037070 con 0x7fb3d415db30 2024-05-08T04:22:05.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.582+0000 7fb3d259c640 1 -- 172.21.15.104:0/1633823457 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c4032440 con 0x7fb3d415db30 2024-05-08T04:22:05.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.582+0000 7fb3d259c640 1 -- 172.21.15.104:0/1633823457 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4032810 con 0x7fb3d415db30 2024-05-08T04:22:05.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.583+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1633823457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3d415db30 msgr2=0x7fb3d406bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:05.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.583+0000 7fb3d90f5640 1 --2- 172.21.15.104:0/1633823457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3d415db30 0x7fb3d406bfb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009870 tx=0x7fb3c402a270 comp rx=0 tx=0).stop 2024-05-08T04:22:05.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.583+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1633823457 shutdown_connections 2024-05-08T04:22:05.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.583+0000 7fb3d90f5640 1 --2- 172.21.15.104:0/1633823457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3d40b5b40 0x7fb3d40d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.583+0000 7fb3d90f5640 1 --2- 172.21.15.104:0/1633823457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3d415db30 0x7fb3d406bfb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.583+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1633823457 >> 172.21.15.104:0/1633823457 conn(0x7fb3d40d0430 msgr2=0x7fb3d40d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.583+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1633823457 shutdown_connections 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.583+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1633823457 wait complete. 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.584+0000 7fb3d90f5640 1 Processor -- start 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.584+0000 7fb3d90f5640 1 -- start start 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d90f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3d40b5b40 0x7fb3d4151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d90f5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3d40b93b0 0x7fb3d4158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d90f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3d415db30 0x7fb3d41561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d90f5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d415df10 con 0x7fb3d415db30 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d90f5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d406c4f0 con 0x7fb3d40b93b0 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d90f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d41521b0 con 0x7fb3d40b5b40 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d359e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3d415db30 0x7fb3d41561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d359e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3d415db30 0x7fb3d41561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41048/0 (socket says 172.21.15.104:41048) 2024-05-08T04:22:05.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d359e640 1 -- 172.21.15.104:0/1880593076 learned_addr learned my addr 172.21.15.104:0/1880593076 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:05.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d2d9d640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3d40b5b40 0x7fb3d4151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:05.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3cbfff640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3d40b93b0 0x7fb3d4158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:05.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d359e640 1 -- 172.21.15.104:0/1880593076 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3d40b5b40 msgr2=0x7fb3d4151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:05.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d359e640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3d40b5b40 0x7fb3d4151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d359e640 1 -- 172.21.15.104:0/1880593076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3d40b93b0 msgr2=0x7fb3d4158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:05.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d359e640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3d40b93b0 0x7fb3d4158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:05.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d359e640 1 -- 172.21.15.104:0/1880593076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d41530c0 con 0x7fb3d415db30 2024-05-08T04:22:05.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3cbfff640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3d40b93b0 0x7fb3d4158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:05.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d359e640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3d415db30 0x7fb3d41561f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc007cd0 tx=0x7fb3cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:05.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3cb7fe640 1 -- 172.21.15.104:0/1880593076 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc014420 con 0x7fb3d415db30 2024-05-08T04:22:05.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3cb7fe640 1 -- 172.21.15.104:0/1880593076 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc019070 con 0x7fb3d415db30 2024-05-08T04:22:05.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3cb7fe640 1 -- 172.21.15.104:0/1880593076 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc014800 con 0x7fb3d415db30 2024-05-08T04:22:05.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1880593076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d41533a0 con 0x7fb3d415db30 2024-05-08T04:22:05.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.585+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1880593076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d4153960 con 0x7fb3d415db30 2024-05-08T04:22:05.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.586+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1880593076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d4075010 con 0x7fb3d415db30 2024-05-08T04:22:05.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.587+0000 7fb3cb7fe640 1 -- 172.21.15.104:0/1880593076 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb3cc0149a0 con 0x7fb3d415db30 2024-05-08T04:22:05.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.587+0000 7fb3cb7fe640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3b406b4d0 0x7fb3b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:05.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.587+0000 7fb3cb7fe640 1 -- 172.21.15.104:0/1880593076 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb3cc08a6a0 con 0x7fb3d415db30 2024-05-08T04:22:05.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.587+0000 7fb3d2d9d640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3b406b4d0 0x7fb3b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:05.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.588+0000 7fb3d2d9d640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3b406b4d0 0x7fb3b406d990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4034000 tx=0x7fb3c402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:05.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.592+0000 7fb3cb7fe640 1 -- 172.21.15.104:0/1880593076 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb3cc0597e0 con 0x7fb3d415db30 2024-05-08T04:22:05.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:05.766+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1880593076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb3d40d2d80 con 0x7fb3d415db30 2024-05-08T04:22:06.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.579+0000 7fb3cb7fe640 1 -- 172.21.15.104:0/1880593076 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb3cc0590e0 con 0x7fb3d415db30 2024-05-08T04:22:06.581 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-05-08T04:22:06.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.582+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1880593076 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3b406b4d0 msgr2=0x7fb3b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:06.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.582+0000 7fb3d90f5640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3b406b4d0 0x7fb3b406d990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4034000 tx=0x7fb3c402e000 comp rx=0 tx=0).stop 2024-05-08T04:22:06.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.582+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1880593076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3d415db30 msgr2=0x7fb3d41561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:06.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.582+0000 7fb3d90f5640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3d415db30 0x7fb3d41561f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc007cd0 tx=0x7fb3cc00e4b0 comp rx=0 tx=0).stop 2024-05-08T04:22:06.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.582+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1880593076 shutdown_connections 2024-05-08T04:22:06.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.582+0000 7fb3d90f5640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3b406b4d0 0x7fb3b406d990 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:06.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.582+0000 7fb3d90f5640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3d40b93b0 0x7fb3d4158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:06.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.582+0000 7fb3d90f5640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3d415db30 0x7fb3d41561f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:06.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.582+0000 7fb3d90f5640 1 --2- 172.21.15.104:0/1880593076 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3d40b5b40 0x7fb3d4151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:06.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.582+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1880593076 >> 172.21.15.104:0/1880593076 conn(0x7fb3d40d0430 msgr2=0x7fb3d40b7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:06.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.582+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1880593076 shutdown_connections 2024-05-08T04:22:06.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.582+0000 7fb3d90f5640 1 -- 172.21.15.104:0/1880593076 wait complete. 2024-05-08T04:22:06.601 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T04:22:06.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.711+0000 7f831203f640 1 Processor -- start 2024-05-08T04:22:06.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.711+0000 7f831203f640 1 -- start start 2024-05-08T04:22:06.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.712+0000 7f831203f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f830c157f80 0x7f830c15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.712+0000 7f831203f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f830c158360 0x7f830c162160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.712+0000 7f831203f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830c1616c0 con 0x7f830c0c6960 2024-05-08T04:22:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.712+0000 7f831203f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830c0c7170 con 0x7f830c157f80 2024-05-08T04:22:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.712+0000 7f831203f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830c0c7450 con 0x7f830c158360 2024-05-08T04:22:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.712+0000 7f830b7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f830c157f80 0x7f830c15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.712+0000 7f830bfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f830c0c6960 0x7f830c0ce030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:53516/0 (socket says 172.21.15.104:53516) 2024-05-08T04:22:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.712+0000 7f830bfff640 1 -- 172.21.15.104:0/4137443112 learned_addr learned my addr 172.21.15.104:0/4137443112 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.712+0000 7f830b7fe640 1 -- 172.21.15.104:0/4137443112 >> v2:172.21.15.183:3300/0 conn(0x7f830c158360 msgr2=0x7f830c162160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T04:22:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.712+0000 7f830b7fe640 1 --2- 172.21.15.104:0/4137443112 >> v2:172.21.15.183:3300/0 conn(0x7f830c158360 0x7f830c162160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.712+0000 7f830b7fe640 1 -- 172.21.15.104:0/4137443112 >> v1:172.21.15.104:6789/0 conn(0x7f830c0c6960 legacy=0x7f830c0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.712+0000 7f830b7fe640 1 -- 172.21.15.104:0/4137443112 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c161960 con 0x7f830c157f80 2024-05-08T04:22:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.713+0000 7f830b7fe640 1 --2- 172.21.15.104:0/4137443112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f830c157f80 0x7f830c15ece0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f830c0d0530 tx=0x7f82fc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7bd6cea6ba7f41 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:06.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.713+0000 7f830affd640 1 -- 172.21.15.104:0/4137443112 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc037070 con 0x7f830c157f80 2024-05-08T04:22:06.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.713+0000 7f830affd640 1 -- 172.21.15.104:0/4137443112 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc032440 con 0x7f830c157f80 2024-05-08T04:22:06.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.713+0000 7f830affd640 1 -- 172.21.15.104:0/4137443112 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc032810 con 0x7f830c157f80 2024-05-08T04:22:06.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.714+0000 7f831203f640 1 -- 172.21.15.104:0/4137443112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f830c157f80 msgr2=0x7f830c15ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:06.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.714+0000 7f831203f640 1 --2- 172.21.15.104:0/4137443112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f830c157f80 0x7f830c15ece0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f830c0d0530 tx=0x7f82fc02a250 comp rx=0 tx=0).stop 2024-05-08T04:22:06.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.714+0000 7f831203f640 1 -- 172.21.15.104:0/4137443112 shutdown_connections 2024-05-08T04:22:06.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.714+0000 7f831203f640 1 --2- 172.21.15.104:0/4137443112 >> v2:172.21.15.183:3300/0 conn(0x7f830c158360 0x7f830c162160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:06.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.714+0000 7f831203f640 1 --2- 172.21.15.104:0/4137443112 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f830c157f80 0x7f830c15ece0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:06.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.714+0000 7f831203f640 1 -- 172.21.15.104:0/4137443112 >> 172.21.15.104:0/4137443112 conn(0x7f830c0b33e0 msgr2=0x7f830c0b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:06.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.714+0000 7f831203f640 1 -- 172.21.15.104:0/4137443112 shutdown_connections 2024-05-08T04:22:06.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.714+0000 7f831203f640 1 -- 172.21.15.104:0/4137443112 wait complete. 2024-05-08T04:22:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.715+0000 7f831203f640 1 Processor -- start 2024-05-08T04:22:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.715+0000 7f831203f640 1 -- start start 2024-05-08T04:22:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f831203f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f830c0c6960 0x7f830c156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f831203f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f830c157f80 0x7f830c1f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f831203f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f830c158360 0x7f830c0af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f831203f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0c6ec0 con 0x7f830c158360 2024-05-08T04:22:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f831203f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0c6d40 con 0x7f830c157f80 2024-05-08T04:22:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f831203f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0ce740 con 0x7f830c0c6960 2024-05-08T04:22:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f830bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f830c158360 0x7f830c0af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f830bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f830c158360 0x7f830c0af6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41056/0 (socket says 172.21.15.104:41056) 2024-05-08T04:22:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f830bfff640 1 -- 172.21.15.104:0/943958608 learned_addr learned my addr 172.21.15.104:0/943958608 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f830bfff640 1 -- 172.21.15.104:0/943958608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f830c0c6960 msgr2=0x7f830c156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f830b7fe640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f830c0c6960 0x7f830c156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f830bfff640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f830c0c6960 0x7f830c156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f8303fff640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f830c157f80 0x7f830c1f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f830bfff640 1 -- 172.21.15.104:0/943958608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f830c157f80 msgr2=0x7f830c1f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:06.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f830bfff640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f830c157f80 0x7f830c1f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:06.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f830bfff640 1 -- 172.21.15.104:0/943958608 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c0acf50 con 0x7f830c158360 2024-05-08T04:22:06.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f8303fff640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f830c157f80 0x7f830c1f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:06.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.716+0000 7f830bfff640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f830c158360 0x7f830c0af6f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f830400cbc0 tx=0x7f830400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:06.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.717+0000 7f8308ff9640 1 -- 172.21.15.104:0/943958608 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304017070 con 0x7f830c158360 2024-05-08T04:22:06.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.717+0000 7f8308ff9640 1 -- 172.21.15.104:0/943958608 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830400ad40 con 0x7f830c158360 2024-05-08T04:22:06.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.717+0000 7f8308ff9640 1 -- 172.21.15.104:0/943958608 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304012600 con 0x7f830c158360 2024-05-08T04:22:06.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.717+0000 7f831203f640 1 -- 172.21.15.104:0/943958608 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c0ad230 con 0x7f830c158360 2024-05-08T04:22:06.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.717+0000 7f831203f640 1 -- 172.21.15.104:0/943958608 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830c1f5230 con 0x7f830c158360 2024-05-08T04:22:06.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.718+0000 7f831203f640 1 -- 172.21.15.104:0/943958608 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830c074830 con 0x7f830c158360 2024-05-08T04:22:06.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.718+0000 7f8308ff9640 1 -- 172.21.15.104:0/943958608 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f830401a070 con 0x7f830c158360 2024-05-08T04:22:06.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.719+0000 7f8308ff9640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f82ec06b4d0 0x7f82ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:06.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.719+0000 7f8308ff9640 1 -- 172.21.15.104:0/943958608 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f8304089cd0 con 0x7f830c158360 2024-05-08T04:22:06.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.719+0000 7f830b7fe640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f82ec06b4d0 0x7f82ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:06.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.719+0000 7f830b7fe640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f82ec06b4d0 0x7f82ec06d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f82fc034000 tx=0x7f82fc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:06.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.723+0000 7f8308ff9640 1 -- 172.21.15.104:0/943958608 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f83040586e0 con 0x7f830c158360 2024-05-08T04:22:06.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:06.897+0000 7f831203f640 1 -- 172.21.15.104:0/943958608 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f830c0d03b0 con 0x7f830c158360 2024-05-08T04:22:07.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.586+0000 7f8308ff9640 1 -- 172.21.15.104:0/943958608 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f830405c780 con 0x7f830c158360 2024-05-08T04:22:07.589 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-05-08T04:22:07.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.588+0000 7f831203f640 1 -- 172.21.15.104:0/943958608 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f82ec06b4d0 msgr2=0x7f82ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:07.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.588+0000 7f831203f640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f82ec06b4d0 0x7f82ec06d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f82fc034000 tx=0x7f82fc02e000 comp rx=0 tx=0).stop 2024-05-08T04:22:07.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.588+0000 7f831203f640 1 -- 172.21.15.104:0/943958608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f830c158360 msgr2=0x7f830c0af6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:07.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.588+0000 7f831203f640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f830c158360 0x7f830c0af6f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f830400cbc0 tx=0x7f830400a430 comp rx=0 tx=0).stop 2024-05-08T04:22:07.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.589+0000 7f831203f640 1 -- 172.21.15.104:0/943958608 shutdown_connections 2024-05-08T04:22:07.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.589+0000 7f831203f640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f82ec06b4d0 0x7f82ec06d990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:07.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.589+0000 7f831203f640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f830c157f80 0x7f830c1f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:07.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.589+0000 7f831203f640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f830c158360 0x7f830c0af6f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:07.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.589+0000 7f831203f640 1 --2- 172.21.15.104:0/943958608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f830c0c6960 0x7f830c156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:07.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.589+0000 7f831203f640 1 -- 172.21.15.104:0/943958608 >> 172.21.15.104:0/943958608 conn(0x7f830c0b33e0 msgr2=0x7f830c1570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:07.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.589+0000 7f831203f640 1 -- 172.21.15.104:0/943958608 shutdown_connections 2024-05-08T04:22:07.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.589+0000 7f831203f640 1 -- 172.21.15.104:0/943958608 wait complete. 2024-05-08T04:22:07.613 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T04:22:07.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.715+0000 7efdc065d640 1 Processor -- start 2024-05-08T04:22:07.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.715+0000 7efdc065d640 1 -- start start 2024-05-08T04:22:07.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.716+0000 7efdc065d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efdb815edf0 0x7efdb80b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:07.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.716+0000 7efdc065d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efdb8157ac0 0x7efdb8157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:07.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.716+0000 7efdc065d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb80d15c0 con 0x7efdb8070c70 2024-05-08T04:22:07.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.716+0000 7efdc065d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb806bc70 con 0x7efdb815edf0 2024-05-08T04:22:07.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.716+0000 7efdc065d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb815f550 con 0x7efdb8157ac0 2024-05-08T04:22:07.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.717+0000 7efdbdbf8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efdb815edf0 0x7efdb80b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:07.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.717+0000 7efdbdbf8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efdb815edf0 0x7efdb80b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49720/0 (socket says 172.21.15.104:49720) 2024-05-08T04:22:07.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.717+0000 7efdbdbf8640 1 -- 172.21.15.104:0/4055905306 learned_addr learned my addr 172.21.15.104:0/4055905306 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:07.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.717+0000 7efdbebfa640 1 --2- 172.21.15.104:0/4055905306 >> v2:172.21.15.183:3300/0 conn(0x7efdb8157ac0 0x7efdb8157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:07.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.717+0000 7efdbdbf8640 1 -- 172.21.15.104:0/4055905306 >> v2:172.21.15.183:3300/0 conn(0x7efdb8157ac0 msgr2=0x7efdb8157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:07.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.717+0000 7efdbdbf8640 1 --2- 172.21.15.104:0/4055905306 >> v2:172.21.15.183:3300/0 conn(0x7efdb8157ac0 0x7efdb8157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:07.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.717+0000 7efdbdbf8640 1 -- 172.21.15.104:0/4055905306 >> v1:172.21.15.183:6789/0 conn(0x7efdb8070c70 legacy=0x7efdb8071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:07.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.717+0000 7efdbdbf8640 1 -- 172.21.15.104:0/4055905306 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb815f830 con 0x7efdb815edf0 2024-05-08T04:22:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.718+0000 7efdbdbf8640 1 --2- 172.21.15.104:0/4055905306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdb815edf0 0x7efdb80b52a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7efdb80b1350 tx=0x7efdac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70030cb0f061f94e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.718+0000 7efdbd3f7640 1 -- 172.21.15.104:0/4055905306 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac037070 con 0x7efdb815edf0 2024-05-08T04:22:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.718+0000 7efdbd3f7640 1 -- 172.21.15.104:0/4055905306 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac032440 con 0x7efdb815edf0 2024-05-08T04:22:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.718+0000 7efdbd3f7640 1 -- 172.21.15.104:0/4055905306 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac032810 con 0x7efdb815edf0 2024-05-08T04:22:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.718+0000 7efdc065d640 1 -- 172.21.15.104:0/4055905306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdb815edf0 msgr2=0x7efdb80b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.718+0000 7efdc065d640 1 --2- 172.21.15.104:0/4055905306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdb815edf0 0x7efdb80b52a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7efdb80b1350 tx=0x7efdac02a230 comp rx=0 tx=0).stop 2024-05-08T04:22:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.718+0000 7efdc065d640 1 -- 172.21.15.104:0/4055905306 shutdown_connections 2024-05-08T04:22:07.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.718+0000 7efdc065d640 1 --2- 172.21.15.104:0/4055905306 >> v2:172.21.15.183:3300/0 conn(0x7efdb8157ac0 0x7efdb8157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:07.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.718+0000 7efdc065d640 1 --2- 172.21.15.104:0/4055905306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdb815edf0 0x7efdb80b52a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:07.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.718+0000 7efdc065d640 1 -- 172.21.15.104:0/4055905306 >> 172.21.15.104:0/4055905306 conn(0x7efdb80b3450 msgr2=0x7efdb80b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:07.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.718+0000 7efdc065d640 1 -- 172.21.15.104:0/4055905306 shutdown_connections 2024-05-08T04:22:07.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.719+0000 7efdc065d640 1 -- 172.21.15.104:0/4055905306 wait complete. 2024-05-08T04:22:07.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.720+0000 7efdc065d640 1 Processor -- start 2024-05-08T04:22:07.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.720+0000 7efdc065d640 1 -- start start 2024-05-08T04:22:07.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.720+0000 7efdc065d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdb8070c70 0x7efdb80cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:07.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.720+0000 7efdc065d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdb8157ac0 0x7efdb80ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:07.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.720+0000 7efdc065d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb815edf0 0x7efdb80cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.720+0000 7efdc065d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80b57e0 con 0x7efdb8070c70 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.720+0000 7efdc065d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80b5b80 con 0x7efdb8157ac0 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.720+0000 7efdc065d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80b5960 con 0x7efdb815edf0 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdbe3f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdb8070c70 0x7efdb80cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdbe3f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdb8070c70 0x7efdb80cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49728/0 (socket says 172.21.15.104:49728) 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdbe3f9640 1 -- 172.21.15.104:0/474628868 learned_addr learned my addr 172.21.15.104:0/474628868 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdbdbf8640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdb8157ac0 0x7efdb80ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdbebfa640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb815edf0 0x7efdb80cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdbe3f9640 1 -- 172.21.15.104:0/474628868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb815edf0 msgr2=0x7efdb80cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdbe3f9640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb815edf0 0x7efdb80cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdbe3f9640 1 -- 172.21.15.104:0/474628868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdb8157ac0 msgr2=0x7efdb80ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdbe3f9640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdb8157ac0 0x7efdb80ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdbe3f9640 1 -- 172.21.15.104:0/474628868 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb80cd8b0 con 0x7efdb8070c70 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdbe3f9640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdb8070c70 0x7efdb80cb2a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efda800c430 tx=0x7efda800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdb6ffd640 1 -- 172.21.15.104:0/474628868 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8011790 con 0x7efdb8070c70 2024-05-08T04:22:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdb6ffd640 1 -- 172.21.15.104:0/474628868 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda8017070 con 0x7efdb8070c70 2024-05-08T04:22:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdc065d640 1 -- 172.21.15.104:0/474628868 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb80cdb90 con 0x7efdb8070c70 2024-05-08T04:22:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdb6ffd640 1 -- 172.21.15.104:0/474628868 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8011bb0 con 0x7efdb8070c70 2024-05-08T04:22:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.721+0000 7efdc065d640 1 -- 172.21.15.104:0/474628868 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb8158bd0 con 0x7efdb8070c70 2024-05-08T04:22:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.722+0000 7efdc065d640 1 -- 172.21.15.104:0/474628868 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb8075010 con 0x7efdb8070c70 2024-05-08T04:22:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.723+0000 7efdb6ffd640 1 -- 172.21.15.104:0/474628868 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efda801c460 con 0x7efdb8070c70 2024-05-08T04:22:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.723+0000 7efdb6ffd640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efda406b4d0 0x7efda406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.723+0000 7efdb6ffd640 1 -- 172.21.15.104:0/474628868 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7efda8089f20 con 0x7efdb8070c70 2024-05-08T04:22:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.723+0000 7efdbdbf8640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efda406b4d0 0x7efda406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.724+0000 7efdbdbf8640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efda406b4d0 0x7efda406d990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efdac034000 tx=0x7efdac02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:07.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.728+0000 7efdb6ffd640 1 -- 172.21.15.104:0/474628868 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efda80587b0 con 0x7efdb8070c70 2024-05-08T04:22:07.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:07.931+0000 7efdc065d640 1 -- 172.21.15.104:0/474628868 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7efdb8071a50 con 0x7efdb8070c70 2024-05-08T04:22:08.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.588+0000 7efdb6ffd640 1 -- 172.21.15.104:0/474628868 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7efda805c850 con 0x7efdb8070c70 2024-05-08T04:22:08.590 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 4 and data pool 5 2024-05-08T04:22:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.593+0000 7efdc065d640 1 -- 172.21.15.104:0/474628868 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efda406b4d0 msgr2=0x7efda406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.593+0000 7efdc065d640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efda406b4d0 0x7efda406d990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efdac034000 tx=0x7efdac02e000 comp rx=0 tx=0).stop 2024-05-08T04:22:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.593+0000 7efdc065d640 1 -- 172.21.15.104:0/474628868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdb8070c70 msgr2=0x7efdb80cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.593+0000 7efdc065d640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdb8070c70 0x7efdb80cb2a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efda800c430 tx=0x7efda800c8f0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.593+0000 7efdc065d640 1 -- 172.21.15.104:0/474628868 shutdown_connections 2024-05-08T04:22:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.593+0000 7efdc065d640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efda406b4d0 0x7efda406d990 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.593+0000 7efdc065d640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efdb8157ac0 0x7efdb80ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.593+0000 7efdc065d640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efdb815edf0 0x7efdb80cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.593+0000 7efdc065d640 1 --2- 172.21.15.104:0/474628868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efdb8070c70 0x7efdb80cb2a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.593+0000 7efdc065d640 1 -- 172.21.15.104:0/474628868 >> 172.21.15.104:0/474628868 conn(0x7efdb80b3450 msgr2=0x7efdb8157320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:08.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.593+0000 7efdc065d640 1 -- 172.21.15.104:0/474628868 shutdown_connections 2024-05-08T04:22:08.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.593+0000 7efdc065d640 1 -- 172.21.15.104:0/474628868 wait complete. 2024-05-08T04:22:08.624 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:08.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.725+0000 7f8841e83640 1 Processor -- start 2024-05-08T04:22:08.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.725+0000 7f8841e83640 1 -- start start 2024-05-08T04:22:08.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.726+0000 7f8841e83640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f883c15cd20 0x7f883c1668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:08.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.726+0000 7f8841e83640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c0cf680 con 0x7f883c0715d0 2024-05-08T04:22:08.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.726+0000 7f8841e83640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c15c240 con 0x7f883c0725b0 2024-05-08T04:22:08.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.726+0000 7f8841e83640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883c15c520 con 0x7f883c15cd20 2024-05-08T04:22:08.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.726+0000 7f883bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f883c15cd20 0x7f883c1668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:08.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.726+0000 7f883bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f883c15cd20 0x7f883c1668f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49742/0 (socket says 172.21.15.104:49742) 2024-05-08T04:22:08.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.726+0000 7f883bfff640 1 -- 172.21.15.104:0/4170530923 learned_addr learned my addr 172.21.15.104:0/4170530923 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:08.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.726+0000 7f883b7fe640 1 --1- 172.21.15.104:0/4170530923 >> v1:172.21.15.104:6789/0 conn(0x7f883c0715d0 0x7f883c0719b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41184/0 (socket says 172.21.15.104:41184) 2024-05-08T04:22:08.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.726+0000 7f883bfff640 1 -- 172.21.15.104:0/4170530923 >> v1:172.21.15.183:6789/0 conn(0x7f883c0725b0 legacy=0x7f883c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:08.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.726+0000 7f883bfff640 1 -- 172.21.15.104:0/4170530923 >> v1:172.21.15.104:6789/0 conn(0x7f883c0715d0 legacy=0x7f883c0719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:08.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.726+0000 7f883a7fc640 1 -- 172.21.15.104:0/4170530923 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121021152 0 0) 0x7f883c0cf680 con 0x7f883c0715d0 2024-05-08T04:22:08.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.726+0000 7f883bfff640 1 -- 172.21.15.104:0/4170530923 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c15c800 con 0x7f883c15cd20 2024-05-08T04:22:08.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.727+0000 7f883bfff640 1 --2- 172.21.15.104:0/4170530923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f883c15cd20 0x7f883c1668f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8834009870 tx=0x7f883402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872b0d219a2c4660 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:08.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.727+0000 7f883a7fc640 1 -- 172.21.15.104:0/4170530923 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834037070 con 0x7f883c15cd20 2024-05-08T04:22:08.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.727+0000 7f883a7fc640 1 -- 172.21.15.104:0/4170530923 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8834032440 con 0x7f883c15cd20 2024-05-08T04:22:08.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.727+0000 7f883a7fc640 1 -- 172.21.15.104:0/4170530923 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834032810 con 0x7f883c15cd20 2024-05-08T04:22:08.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.728+0000 7f8841e83640 1 -- 172.21.15.104:0/4170530923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f883c15cd20 msgr2=0x7f883c1668f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:08.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.728+0000 7f8841e83640 1 --2- 172.21.15.104:0/4170530923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f883c15cd20 0x7f883c1668f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8834009870 tx=0x7f883402a1e0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.728+0000 7f8841e83640 1 -- 172.21.15.104:0/4170530923 shutdown_connections 2024-05-08T04:22:08.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.728+0000 7f8841e83640 1 --2- 172.21.15.104:0/4170530923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f883c15cd20 0x7f883c1668f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.728+0000 7f8841e83640 1 -- 172.21.15.104:0/4170530923 >> 172.21.15.104:0/4170530923 conn(0x7f883c0cfa60 msgr2=0x7f883c0cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:08.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.728+0000 7f8841e83640 1 -- 172.21.15.104:0/4170530923 shutdown_connections 2024-05-08T04:22:08.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.728+0000 7f8841e83640 1 -- 172.21.15.104:0/4170530923 wait complete. 2024-05-08T04:22:08.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.729+0000 7f8841e83640 1 Processor -- start 2024-05-08T04:22:08.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.729+0000 7f8841e83640 1 -- start start 2024-05-08T04:22:08.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f8841e83640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f883c0715d0 0x7f883c13eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:08.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f8841e83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f883c0725b0 0x7f883c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:08.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f8841e83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f883c15cd20 0x7f883c1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:08.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f8841e83640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c166fb0 con 0x7f883c0725b0 2024-05-08T04:22:08.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f8841e83640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c166e30 con 0x7f883c0715d0 2024-05-08T04:22:08.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f8841e83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c167130 con 0x7f883c15cd20 2024-05-08T04:22:08.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f883affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f883c0725b0 0x7f883c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:08.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f883affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f883c0725b0 0x7f883c1531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49744/0 (socket says 172.21.15.104:49744) 2024-05-08T04:22:08.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f883affd640 1 -- 172.21.15.104:0/4285362431 learned_addr learned my addr 172.21.15.104:0/4285362431 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:08.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f883b7fe640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f883c0715d0 0x7f883c13eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:08.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f883bfff640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f883c15cd20 0x7f883c1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:08.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f883affd640 1 -- 172.21.15.104:0/4285362431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f883c15cd20 msgr2=0x7f883c1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:08.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f883affd640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f883c15cd20 0x7f883c1547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f883affd640 1 -- 172.21.15.104:0/4285362431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f883c0715d0 msgr2=0x7f883c13eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:08.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f883affd640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f883c0715d0 0x7f883c13eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f883affd640 1 -- 172.21.15.104:0/4285362431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c153a10 con 0x7f883c0725b0 2024-05-08T04:22:08.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.730+0000 7f883b7fe640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f883c0715d0 0x7f883c13eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:08.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.731+0000 7f883affd640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f883c0725b0 0x7f883c1531b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f883000c430 tx=0x7f883000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:08.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.731+0000 7f8823fff640 1 -- 172.21.15.104:0/4285362431 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830017070 con 0x7f883c0725b0 2024-05-08T04:22:08.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.731+0000 7f8823fff640 1 -- 172.21.15.104:0/4285362431 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88300052d0 con 0x7f883c0725b0 2024-05-08T04:22:08.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.731+0000 7f8841e83640 1 -- 172.21.15.104:0/4285362431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c153cf0 con 0x7f883c0725b0 2024-05-08T04:22:08.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.731+0000 7f8823fff640 1 -- 172.21.15.104:0/4285362431 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830003830 con 0x7f883c0725b0 2024-05-08T04:22:08.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.731+0000 7f8841e83640 1 -- 172.21.15.104:0/4285362431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c1542b0 con 0x7f883c0725b0 2024-05-08T04:22:08.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.732+0000 7f8841e83640 1 -- 172.21.15.104:0/4285362431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c075010 con 0x7f883c0725b0 2024-05-08T04:22:08.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.732+0000 7f8823fff640 1 -- 172.21.15.104:0/4285362431 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f883001a070 con 0x7f883c0725b0 2024-05-08T04:22:08.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.733+0000 7f8823fff640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f882806b4d0 0x7f882806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:08.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.733+0000 7f8823fff640 1 -- 172.21.15.104:0/4285362431 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8830089580 con 0x7f883c0725b0 2024-05-08T04:22:08.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.733+0000 7f883b7fe640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f882806b4d0 0x7f882806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:08.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.733+0000 7f883b7fe640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f882806b4d0 0x7f882806d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f882c0012e0 tx=0x7f882c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:08.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.737+0000 7f8823fff640 1 -- 172.21.15.104:0/4285362431 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8830058400 con 0x7f883c0725b0 2024-05-08T04:22:08.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.910+0000 7f8841e83640 1 -- 172.21.15.104:0/4285362431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f883c0cca30 con 0x7f883c0725b0 2024-05-08T04:22:08.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.911+0000 7f8823fff640 1 -- 172.21.15.104:0/4285362431 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16682 (secure 0 0 0) 0x7f8830057d00 con 0x7f883c0725b0 2024-05-08T04:22:08.914 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:08.914 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":32,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:07.933434+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:05.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:06.917080+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:08.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.913+0000 7f8841e83640 1 -- 172.21.15.104:0/4285362431 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f882806b4d0 msgr2=0x7f882806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:08.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.913+0000 7f8841e83640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f882806b4d0 0x7f882806d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f882c0012e0 tx=0x7f882c009040 comp rx=0 tx=0).stop 2024-05-08T04:22:08.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.913+0000 7f8841e83640 1 -- 172.21.15.104:0/4285362431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f883c0725b0 msgr2=0x7f883c1531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:08.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.913+0000 7f8841e83640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f883c0725b0 0x7f883c1531b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f883000c430 tx=0x7f883000c8f0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.913+0000 7f8841e83640 1 -- 172.21.15.104:0/4285362431 shutdown_connections 2024-05-08T04:22:08.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.913+0000 7f8841e83640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f882806b4d0 0x7f882806d990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.913+0000 7f8841e83640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f883c15cd20 0x7f883c1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.913+0000 7f8841e83640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f883c0725b0 0x7f883c1531b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.913+0000 7f8841e83640 1 --2- 172.21.15.104:0/4285362431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f883c0715d0 0x7f883c13eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.913+0000 7f8841e83640 1 -- 172.21.15.104:0/4285362431 >> 172.21.15.104:0/4285362431 conn(0x7f883c0cfa60 msgr2=0x7f883c0ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.914+0000 7f8841e83640 1 -- 172.21.15.104:0/4285362431 shutdown_connections 2024-05-08T04:22:08.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:08.914+0000 7f8841e83640 1 -- 172.21.15.104:0/4285362431 wait complete. 2024-05-08T04:22:08.927 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:09.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.025+0000 7f80ea37e640 1 Processor -- start 2024-05-08T04:22:09.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.025+0000 7f80ea37e640 1 -- start start 2024-05-08T04:22:09.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80ea37e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80e40acdf0 0x7f80e40ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80ea37e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e4072c40 con 0x7f80e4161190 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80ea37e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e406de30 con 0x7f80e406bb70 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80ea37e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40b4db0 con 0x7f80e40acdf0 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e3fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f80e4161190 0x7f80e4072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41200/0 (socket says 172.21.15.104:41200) 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e3fff640 1 -- 172.21.15.104:0/457954601 learned_addr learned my addr 172.21.15.104:0/457954601 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166144750 0 0) 0x7f80e4072c40 con 0x7f80e4161190 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80cc003520 con 0x7f80e4161190 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e37fe640 1 --2- 172.21.15.104:0/457954601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80e40acdf0 0x7f80e40ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2116673579 0 0) 0x7f80cc003520 con 0x7f80e4161190 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80e40acdf0 msgr2=0x7f80e40ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 --2- 172.21.15.104:0/457954601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80e40acdf0 0x7f80e40ad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 >> v1:172.21.15.183:6789/0 conn(0x7f80e406bb70 legacy=0x7f80e406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e406e110 con 0x7f80e4161190 2024-05-08T04:22:09.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f80d4001670 con 0x7f80e4161190 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 >> v1:172.21.15.104:6789/0 conn(0x7f80e4161190 legacy=0x7f80e4072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 --2- 172.21.15.104:0/457954601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80cc0039e0 0x7f80cc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 --2- 172.21.15.104:0/457954601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80e40acdf0 0x7f80cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 --2- 172.21.15.104:0/457954601 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80cc004d40 0x7f80cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc00ba70 con 0x7f80cc004d40 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc00bbf0 con 0x7f80cc0039e0 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc00bdf0 con 0x7f80e40acdf0 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e891b640 1 --2- 172.21.15.104:0/457954601 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80cc004d40 0x7f80cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.026+0000 7f80e3fff640 1 --2- 172.21.15.104:0/457954601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80cc0039e0 0x7f80cc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.027+0000 7f80e37fe640 1 --2- 172.21.15.104:0/457954601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80e40acdf0 0x7f80cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.027+0000 7f80e891b640 1 -- 172.21.15.104:0/457954601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80e40acdf0 msgr2=0x7f80cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.027+0000 7f80e891b640 1 --2- 172.21.15.104:0/457954601 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80e40acdf0 0x7f80cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.027+0000 7f80e891b640 1 -- 172.21.15.104:0/457954601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80cc0039e0 msgr2=0x7f80cc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:09.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.027+0000 7f80e891b640 1 --2- 172.21.15.104:0/457954601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80cc0039e0 0x7f80cc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.027+0000 7f80e891b640 1 -- 172.21.15.104:0/457954601 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc003520 con 0x7f80cc004d40 2024-05-08T04:22:09.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.027+0000 7f80e891b640 1 --2- 172.21.15.104:0/457954601 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80cc004d40 0x7f80cc0051c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f80dc001e20 tx=0x7f80cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca680e624173ae6f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:09.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.027+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc001a70 con 0x7f80cc004d40 2024-05-08T04:22:09.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.027+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc02ae40 con 0x7f80cc004d40 2024-05-08T04:22:09.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.028+0000 7f80e2ffd640 1 -- 172.21.15.104:0/457954601 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc003bb0 con 0x7f80cc004d40 2024-05-08T04:22:09.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.028+0000 7f80ea37e640 1 -- 172.21.15.104:0/457954601 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80cc004d40 msgr2=0x7f80cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.028+0000 7f80ea37e640 1 --2- 172.21.15.104:0/457954601 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80cc004d40 0x7f80cc0051c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f80dc001e20 tx=0x7f80cc005830 comp rx=0 tx=0).stop 2024-05-08T04:22:09.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.028+0000 7f80e891b640 1 -- 172.21.15.104:0/457954601 reap_dead start 2024-05-08T04:22:09.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.028+0000 7f80ea37e640 1 -- 172.21.15.104:0/457954601 shutdown_connections 2024-05-08T04:22:09.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.028+0000 7f80ea37e640 1 -- 172.21.15.104:0/457954601 >> 172.21.15.104:0/457954601 conn(0x7f80e4071a10 msgr2=0x7f80e4071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:09.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.028+0000 7f80ea37e640 1 -- 172.21.15.104:0/457954601 shutdown_connections 2024-05-08T04:22:09.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.028+0000 7f80ea37e640 1 -- 172.21.15.104:0/457954601 wait complete. 2024-05-08T04:22:09.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.029+0000 7f80ea37e640 1 Processor -- start 2024-05-08T04:22:09.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.029+0000 7f80ea37e640 1 -- start start 2024-05-08T04:22:09.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.030+0000 7f80ea37e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80e4149070 0x7f80e415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.030+0000 7f80ea37e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80e4149450 0x7f80e414ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.030+0000 7f80ea37e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80e41601d0 0x7f80e414cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.030+0000 7f80ea37e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e406e9b0 con 0x7f80e4149070 2024-05-08T04:22:09.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.030+0000 7f80ea37e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e406e6d0 con 0x7f80e4149450 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.030+0000 7f80ea37e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e406da70 con 0x7f80e41601d0 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.030+0000 7f80e3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80e4149070 0x7f80e415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.030+0000 7f80e3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80e4149070 0x7f80e415fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49770/0 (socket says 172.21.15.104:49770) 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.030+0000 7f80e3fff640 1 -- 172.21.15.104:0/608274022 learned_addr learned my addr 172.21.15.104:0/608274022 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.030+0000 7f80e37fe640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80e4149450 0x7f80e414ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.030+0000 7f80e891b640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80e41601d0 0x7f80e414cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.031+0000 7f80e3fff640 1 -- 172.21.15.104:0/608274022 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80e41601d0 msgr2=0x7f80e414cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.031+0000 7f80e3fff640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80e41601d0 0x7f80e414cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.031+0000 7f80e3fff640 1 -- 172.21.15.104:0/608274022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80e4149450 msgr2=0x7f80e414ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.031+0000 7f80e3fff640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80e4149450 0x7f80e414ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.031+0000 7f80e3fff640 1 -- 172.21.15.104:0/608274022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e4160790 con 0x7f80e4149070 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.031+0000 7f80e37fe640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80e4149450 0x7f80e414ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.031+0000 7f80e3fff640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80e4149070 0x7f80e415fc90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f80d40011e0 tx=0x7f80d4007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.031+0000 7f80e0ff9640 1 -- 172.21.15.104:0/608274022 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d400f9a0 con 0x7f80e4149070 2024-05-08T04:22:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.031+0000 7f80e0ff9640 1 -- 172.21.15.104:0/608274022 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d4018070 con 0x7f80e4149070 2024-05-08T04:22:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.031+0000 7f80ea37e640 1 -- 172.21.15.104:0/608274022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e41f8020 con 0x7f80e4149070 2024-05-08T04:22:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.031+0000 7f80e0ff9640 1 -- 172.21.15.104:0/608274022 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d400fd80 con 0x7f80e4149070 2024-05-08T04:22:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.031+0000 7f80ea37e640 1 -- 172.21.15.104:0/608274022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e41f7540 con 0x7f80e4149070 2024-05-08T04:22:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.032+0000 7f80ea37e640 1 -- 172.21.15.104:0/608274022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e4075010 con 0x7f80e4149070 2024-05-08T04:22:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.032+0000 7f80e0ff9640 1 -- 172.21.15.104:0/608274022 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f80d401d460 con 0x7f80e4149070 2024-05-08T04:22:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.033+0000 7f80e0ff9640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f80d006b4d0 0x7f80d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.033+0000 7f80e0ff9640 1 -- 172.21.15.104:0/608274022 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80d408a3f0 con 0x7f80e4149070 2024-05-08T04:22:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.033+0000 7f80e37fe640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f80d006b4d0 0x7f80d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.033+0000 7f80e37fe640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f80d006b4d0 0x7f80d006d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f80e40b41b0 tx=0x7f80d8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:09.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.037+0000 7f80e0ff9640 1 -- 172.21.15.104:0/608274022 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f80d4059300 con 0x7f80e4149070 2024-05-08T04:22:09.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.208+0000 7f80ea37e640 1 -- 172.21.15.104:0/608274022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80e4066a30 con 0x7f80e4149070 2024-05-08T04:22:09.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.209+0000 7f80e0ff9640 1 -- 172.21.15.104:0/608274022 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16682 (secure 0 0 0) 0x7f80d4058c00 con 0x7f80e4149070 2024-05-08T04:22:09.211 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:09.211 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":32,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:07.933434+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:05.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:06.917080+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:09.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.211+0000 7f80ea37e640 1 -- 172.21.15.104:0/608274022 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f80d006b4d0 msgr2=0x7f80d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.211+0000 7f80ea37e640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f80d006b4d0 0x7f80d006d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f80e40b41b0 tx=0x7f80d8008040 comp rx=0 tx=0).stop 2024-05-08T04:22:09.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.211+0000 7f80ea37e640 1 -- 172.21.15.104:0/608274022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80e4149070 msgr2=0x7f80e415fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.211+0000 7f80ea37e640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80e4149070 0x7f80e415fc90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f80d40011e0 tx=0x7f80d4007720 comp rx=0 tx=0).stop 2024-05-08T04:22:09.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.211+0000 7f80ea37e640 1 -- 172.21.15.104:0/608274022 shutdown_connections 2024-05-08T04:22:09.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.211+0000 7f80ea37e640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f80d006b4d0 0x7f80d006d990 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.211+0000 7f80ea37e640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80e4149450 0x7f80e414ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.211+0000 7f80ea37e640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80e41601d0 0x7f80e414cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.211+0000 7f80ea37e640 1 --2- 172.21.15.104:0/608274022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80e4149070 0x7f80e415fc90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.211+0000 7f80ea37e640 1 -- 172.21.15.104:0/608274022 >> 172.21.15.104:0/608274022 conn(0x7f80e4071a10 msgr2=0x7f80e4156430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:09.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.211+0000 7f80ea37e640 1 -- 172.21.15.104:0/608274022 shutdown_connections 2024-05-08T04:22:09.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.211+0000 7f80ea37e640 1 -- 172.21.15.104:0/608274022 wait complete. 2024-05-08T04:22:09.224 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T04:22:09.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.324+0000 7f12f6722640 1 Processor -- start 2024-05-08T04:22:09.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.324+0000 7f12f6722640 1 -- start start 2024-05-08T04:22:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.325+0000 7f12f6722640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f12f006ea40 0x7f12f00b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.325+0000 7f12f6722640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f00b3ff0 0x7f12f00b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.325+0000 7f12f6722640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f00b49c0 con 0x7f12f00ceee0 2024-05-08T04:22:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.325+0000 7f12f6722640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f015f390 con 0x7f12f006ea40 2024-05-08T04:22:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.325+0000 7f12f6722640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f015e780 con 0x7f12f00b3ff0 2024-05-08T04:22:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.325+0000 7f12ef7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f12f006ea40 0x7f12f00b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.325+0000 7f12ef7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f12f006ea40 0x7f12f00b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49776/0 (socket says 172.21.15.104:49776) 2024-05-08T04:22:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.325+0000 7f12ef7fe640 1 -- 172.21.15.104:0/848952252 learned_addr learned my addr 172.21.15.104:0/848952252 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.325+0000 7f12f4cbf640 1 --2- 172.21.15.104:0/848952252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f00b3ff0 0x7f12f00b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.326+0000 7f12ef7fe640 1 -- 172.21.15.104:0/848952252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f00b3ff0 msgr2=0x7f12f00b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:09.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.326+0000 7f12ef7fe640 1 --2- 172.21.15.104:0/848952252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f00b3ff0 0x7f12f00b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.326+0000 7f12ef7fe640 1 -- 172.21.15.104:0/848952252 >> v1:172.21.15.183:6789/0 conn(0x7f12f00ceee0 legacy=0x7f12f006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.326+0000 7f12ef7fe640 1 -- 172.21.15.104:0/848952252 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f015ea60 con 0x7f12f006ea40 2024-05-08T04:22:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.326+0000 7f12ef7fe640 1 --2- 172.21.15.104:0/848952252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f006ea40 0x7f12f00b26f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009870 tx=0x7f12e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4502ac07d0cede0d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.327+0000 7f12eeffd640 1 -- 172.21.15.104:0/848952252 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e4037070 con 0x7f12f006ea40 2024-05-08T04:22:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.327+0000 7f12eeffd640 1 -- 172.21.15.104:0/848952252 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e4032440 con 0x7f12f006ea40 2024-05-08T04:22:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.327+0000 7f12eeffd640 1 -- 172.21.15.104:0/848952252 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e4032810 con 0x7f12f006ea40 2024-05-08T04:22:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.327+0000 7f12f6722640 1 -- 172.21.15.104:0/848952252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f006ea40 msgr2=0x7f12f00b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.327+0000 7f12f6722640 1 --2- 172.21.15.104:0/848952252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f006ea40 0x7f12f00b26f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009870 tx=0x7f12e402a270 comp rx=0 tx=0).stop 2024-05-08T04:22:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.327+0000 7f12f6722640 1 -- 172.21.15.104:0/848952252 shutdown_connections 2024-05-08T04:22:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.327+0000 7f12f6722640 1 --2- 172.21.15.104:0/848952252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f00b3ff0 0x7f12f00b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.327+0000 7f12f6722640 1 --2- 172.21.15.104:0/848952252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f006ea40 0x7f12f00b26f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.327+0000 7f12f6722640 1 -- 172.21.15.104:0/848952252 >> 172.21.15.104:0/848952252 conn(0x7f12f00b13f0 msgr2=0x7f12f00b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:09.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.327+0000 7f12f6722640 1 -- 172.21.15.104:0/848952252 shutdown_connections 2024-05-08T04:22:09.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.327+0000 7f12f6722640 1 -- 172.21.15.104:0/848952252 wait complete. 2024-05-08T04:22:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.328+0000 7f12f6722640 1 Processor -- start 2024-05-08T04:22:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.328+0000 7f12f6722640 1 -- start start 2024-05-08T04:22:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.329+0000 7f12f6722640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f006ea40 0x7f12f015d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.329+0000 7f12f6722640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12f00b3ff0 0x7f12f015c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.329+0000 7f12f6722640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f00ceee0 0x7f12f015c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.329+0000 7f12f6722640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f00cf2c0 con 0x7f12f006ea40 2024-05-08T04:22:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.329+0000 7f12f6722640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f015f020 con 0x7f12f00b3ff0 2024-05-08T04:22:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.329+0000 7f12f6722640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f00cf440 con 0x7f12f00ceee0 2024-05-08T04:22:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.329+0000 7f12effff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f006ea40 0x7f12f015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.329+0000 7f12effff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f006ea40 0x7f12f015d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49788/0 (socket says 172.21.15.104:49788) 2024-05-08T04:22:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.329+0000 7f12effff640 1 -- 172.21.15.104:0/1709990309 learned_addr learned my addr 172.21.15.104:0/1709990309 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:09.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.330+0000 7f12f4cbf640 1 --2- 172.21.15.104:0/1709990309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f00ceee0 0x7f12f015c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.330+0000 7f12effff640 1 -- 172.21.15.104:0/1709990309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f00ceee0 msgr2=0x7f12f015c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.330+0000 7f12effff640 1 --2- 172.21.15.104:0/1709990309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f00ceee0 0x7f12f015c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.330+0000 7f12effff640 1 -- 172.21.15.104:0/1709990309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12f00b3ff0 msgr2=0x7f12f015c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.330+0000 7f12effff640 1 --2- 172.21.15.104:0/1709990309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12f00b3ff0 0x7f12f015c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.330+0000 7f12effff640 1 -- 172.21.15.104:0/1709990309 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f0153b80 con 0x7f12f006ea40 2024-05-08T04:22:09.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.330+0000 7f12effff640 1 --2- 172.21.15.104:0/1709990309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f006ea40 0x7f12f015d730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c3c0 tx=0x7f12e000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:09.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.330+0000 7f12ecff9640 1 -- 172.21.15.104:0/1709990309 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e00052d0 con 0x7f12f006ea40 2024-05-08T04:22:09.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.330+0000 7f12ecff9640 1 -- 172.21.15.104:0/1709990309 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0005490 con 0x7f12f006ea40 2024-05-08T04:22:09.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.330+0000 7f12f6722640 1 -- 172.21.15.104:0/1709990309 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f0140050 con 0x7f12f006ea40 2024-05-08T04:22:09.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.330+0000 7f12ecff9640 1 -- 172.21.15.104:0/1709990309 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0007260 con 0x7f12f006ea40 2024-05-08T04:22:09.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.330+0000 7f12f6722640 1 -- 172.21.15.104:0/1709990309 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f01537c0 con 0x7f12f006ea40 2024-05-08T04:22:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.331+0000 7f12f6722640 1 -- 172.21.15.104:0/1709990309 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f0075010 con 0x7f12f006ea40 2024-05-08T04:22:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.331+0000 7f12ecff9640 1 -- 172.21.15.104:0/1709990309 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f12e0007400 con 0x7f12f006ea40 2024-05-08T04:22:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.332+0000 7f12ecff9640 1 --2- 172.21.15.104:0/1709990309 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f12dc06b4d0 0x7f12dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.332+0000 7f12ecff9640 1 -- 172.21.15.104:0/1709990309 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12e0089650 con 0x7f12f006ea40 2024-05-08T04:22:09.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.332+0000 7f12ef7fe640 1 --2- 172.21.15.104:0/1709990309 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f12dc06b4d0 0x7f12dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.332+0000 7f12ef7fe640 1 --2- 172.21.15.104:0/1709990309 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f12dc06b4d0 0x7f12dc06d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f12e4034000 tx=0x7f12e402c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:09.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.336+0000 7f12ecff9640 1 -- 172.21.15.104:0/1709990309 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f12e0058560 con 0x7f12f006ea40 2024-05-08T04:22:09.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.541+0000 7f12f6722640 1 -- 172.21.15.104:0/1709990309 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f12f00ce820 con 0x7f12f006ea40 2024-05-08T04:22:09.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.601+0000 7f12ecff9640 1 -- 172.21.15.104:0/1709990309 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f12e0057e60 con 0x7f12f006ea40 2024-05-08T04:22:09.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.603+0000 7f12f6722640 1 -- 172.21.15.104:0/1709990309 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f12dc06b4d0 msgr2=0x7f12dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.603+0000 7f12f6722640 1 --2- 172.21.15.104:0/1709990309 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f12dc06b4d0 0x7f12dc06d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f12e4034000 tx=0x7f12e402c000 comp rx=0 tx=0).stop 2024-05-08T04:22:09.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.603+0000 7f12f6722640 1 -- 172.21.15.104:0/1709990309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f006ea40 msgr2=0x7f12f015d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.603+0000 7f12f6722640 1 --2- 172.21.15.104:0/1709990309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f006ea40 0x7f12f015d730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c3c0 tx=0x7f12e000c880 comp rx=0 tx=0).stop 2024-05-08T04:22:09.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.603+0000 7f12f6722640 1 -- 172.21.15.104:0/1709990309 shutdown_connections 2024-05-08T04:22:09.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.603+0000 7f12f6722640 1 --2- 172.21.15.104:0/1709990309 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f12dc06b4d0 0x7f12dc06d990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.603+0000 7f12f6722640 1 --2- 172.21.15.104:0/1709990309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12f00b3ff0 0x7f12f015c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.603+0000 7f12f6722640 1 --2- 172.21.15.104:0/1709990309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12f00ceee0 0x7f12f015c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.603+0000 7f12f6722640 1 --2- 172.21.15.104:0/1709990309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f006ea40 0x7f12f015d730 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.603+0000 7f12f6722640 1 -- 172.21.15.104:0/1709990309 >> 172.21.15.104:0/1709990309 conn(0x7f12f00b13f0 msgr2=0x7f12f00b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:09.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.603+0000 7f12f6722640 1 -- 172.21.15.104:0/1709990309 shutdown_connections 2024-05-08T04:22:09.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.603+0000 7f12f6722640 1 -- 172.21.15.104:0/1709990309 wait complete. 2024-05-08T04:22:09.617 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-08T04:22:09.617 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-08T04:22:09.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.718+0000 7fba81e6b640 1 Processor -- start 2024-05-08T04:22:09.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.718+0000 7fba81e6b640 1 -- start start 2024-05-08T04:22:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.719+0000 7fba81e6b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba7c0ceee0 0x7fba7c0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.719+0000 7fba81e6b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fba7c06e330 0x7fba7c06e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.719+0000 7fba81e6b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c15e780 con 0x7fba7c0b3ff0 2024-05-08T04:22:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.719+0000 7fba81e6b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c15f390 con 0x7fba7c06e330 2024-05-08T04:22:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.719+0000 7fba81e6b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c15ea60 con 0x7fba7c0ceee0 2024-05-08T04:22:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.719+0000 7fba7affd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fba7c06e330 0x7fba7c06e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.719+0000 7fba7affd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fba7c06e330 0x7fba7c06e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49804/0 (socket says 172.21.15.104:49804) 2024-05-08T04:22:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.719+0000 7fba7affd640 1 -- 172.21.15.104:0/4135845045 learned_addr learned my addr 172.21.15.104:0/4135845045 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.719+0000 7fba7b7fe640 1 --2- 172.21.15.104:0/4135845045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba7c0ceee0 0x7fba7c0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.719+0000 7fba7affd640 1 -- 172.21.15.104:0/4135845045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba7c0ceee0 msgr2=0x7fba7c0b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.719+0000 7fba7affd640 1 --2- 172.21.15.104:0/4135845045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba7c0ceee0 0x7fba7c0b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.719+0000 7fba7affd640 1 -- 172.21.15.104:0/4135845045 >> v1:172.21.15.183:6789/0 conn(0x7fba7c0b3ff0 legacy=0x7fba7c0b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.719+0000 7fba7affd640 1 -- 172.21.15.104:0/4135845045 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c15ed40 con 0x7fba7c06e330 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.720+0000 7fba7affd640 1 --2- 172.21.15.104:0/4135845045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba7c06e330 0x7fba7c06e7b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fba70009870 tx=0x7fba7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f714dcd11b364c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.720+0000 7fba7a7fc640 1 -- 172.21.15.104:0/4135845045 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba70037070 con 0x7fba7c06e330 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.720+0000 7fba7a7fc640 1 -- 172.21.15.104:0/4135845045 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba70032440 con 0x7fba7c06e330 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.720+0000 7fba7a7fc640 1 -- 172.21.15.104:0/4135845045 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba70032810 con 0x7fba7c06e330 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.720+0000 7fba81e6b640 1 -- 172.21.15.104:0/4135845045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba7c06e330 msgr2=0x7fba7c06e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.720+0000 7fba81e6b640 1 --2- 172.21.15.104:0/4135845045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba7c06e330 0x7fba7c06e7b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fba70009870 tx=0x7fba7002a270 comp rx=0 tx=0).stop 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.721+0000 7fba81e6b640 1 -- 172.21.15.104:0/4135845045 shutdown_connections 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.721+0000 7fba81e6b640 1 --2- 172.21.15.104:0/4135845045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba7c06e330 0x7fba7c06e7b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.721+0000 7fba81e6b640 1 --2- 172.21.15.104:0/4135845045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba7c0ceee0 0x7fba7c0b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.721+0000 7fba81e6b640 1 -- 172.21.15.104:0/4135845045 >> 172.21.15.104:0/4135845045 conn(0x7fba7c0b13f0 msgr2=0x7fba7c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.721+0000 7fba81e6b640 1 -- 172.21.15.104:0/4135845045 shutdown_connections 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.721+0000 7fba81e6b640 1 -- 172.21.15.104:0/4135845045 wait complete. 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.722+0000 7fba81e6b640 1 Processor -- start 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.722+0000 7fba81e6b640 1 -- start start 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba81e6b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba7c06e330 0x7fba7c0aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba81e6b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba7c0b3ff0 0x7fba7c146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba81e6b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba7c0ceee0 0x7fba7c15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba81e6b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0cf440 con 0x7fba7c0b3ff0 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba81e6b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0cf2c0 con 0x7fba7c0ceee0 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba81e6b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c15b210 con 0x7fba7c06e330 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba7affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba7c0b3ff0 0x7fba7c146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba7affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba7c0b3ff0 0x7fba7c146040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49818/0 (socket says 172.21.15.104:49818) 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba7affd640 1 -- 172.21.15.104:0/3240855045 learned_addr learned my addr 172.21.15.104:0/3240855045 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba7b7fe640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba7c06e330 0x7fba7c0aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba7bfff640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba7c0ceee0 0x7fba7c15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba7affd640 1 -- 172.21.15.104:0/3240855045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba7c06e330 msgr2=0x7fba7c0aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba7affd640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba7c06e330 0x7fba7c0aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba7affd640 1 -- 172.21.15.104:0/3240855045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba7c0ceee0 msgr2=0x7fba7c15d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba7affd640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba7c0ceee0 0x7fba7c15d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba7affd640 1 -- 172.21.15.104:0/3240855045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c146580 con 0x7fba7c0b3ff0 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba7affd640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba7c0b3ff0 0x7fba7c146040 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fba70000c00 tx=0x7fba700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba63fff640 1 -- 172.21.15.104:0/3240855045 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba70041020 con 0x7fba7c0b3ff0 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba63fff640 1 -- 172.21.15.104:0/3240855045 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba700306c0 con 0x7fba7c0b3ff0 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba81e6b640 1 -- 172.21.15.104:0/3240855045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c146940 con 0x7fba7c0b3ff0 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba63fff640 1 -- 172.21.15.104:0/3240855045 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba70037040 con 0x7fba7c0b3ff0 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.723+0000 7fba81e6b640 1 -- 172.21.15.104:0/3240855045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c146f00 con 0x7fba7c0b3ff0 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.724+0000 7fba81e6b640 1 -- 172.21.15.104:0/3240855045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c075010 con 0x7fba7c0b3ff0 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.725+0000 7fba63fff640 1 -- 172.21.15.104:0/3240855045 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fba70044020 con 0x7fba7c0b3ff0 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.725+0000 7fba63fff640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fba6806b4d0 0x7fba6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.725+0000 7fba63fff640 1 -- 172.21.15.104:0/3240855045 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba700aaa20 con 0x7fba7c0b3ff0 2024-05-08T04:22:09.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.725+0000 7fba7b7fe640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fba6806b4d0 0x7fba6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:09.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.726+0000 7fba7b7fe640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fba6806b4d0 0x7fba6806d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba6c006fd0 tx=0x7fba6c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:09.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.730+0000 7fba63fff640 1 -- 172.21.15.104:0/3240855045 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fba7004b030 con 0x7fba7c0b3ff0 2024-05-08T04:22:09.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:09.939+0000 7fba81e6b640 1 -- 172.21.15.104:0/3240855045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fba7c06f3f0 con 0x7fba7c0b3ff0 2024-05-08T04:22:10.488 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:22:10.491 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:22:10.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.611+0000 7fba63fff640 1 -- 172.21.15.104:0/3240855045 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fba700798a0 con 0x7fba7c0b3ff0 2024-05-08T04:22:10.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.614+0000 7fba81e6b640 1 -- 172.21.15.104:0/3240855045 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fba6806b4d0 msgr2=0x7fba6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:10.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.614+0000 7fba81e6b640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fba6806b4d0 0x7fba6806d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba6c006fd0 tx=0x7fba6c008040 comp rx=0 tx=0).stop 2024-05-08T04:22:10.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.614+0000 7fba81e6b640 1 -- 172.21.15.104:0/3240855045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba7c0b3ff0 msgr2=0x7fba7c146040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:10.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.614+0000 7fba81e6b640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba7c0b3ff0 0x7fba7c146040 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fba70000c00 tx=0x7fba700046c0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.614+0000 7fba81e6b640 1 -- 172.21.15.104:0/3240855045 shutdown_connections 2024-05-08T04:22:10.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.614+0000 7fba81e6b640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fba6806b4d0 0x7fba6806d990 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.614+0000 7fba81e6b640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba7c0ceee0 0x7fba7c15d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.614+0000 7fba81e6b640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba7c0b3ff0 0x7fba7c146040 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.614+0000 7fba81e6b640 1 --2- 172.21.15.104:0/3240855045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba7c06e330 0x7fba7c0aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.614+0000 7fba81e6b640 1 -- 172.21.15.104:0/3240855045 >> 172.21.15.104:0/3240855045 conn(0x7fba7c0b13f0 msgr2=0x7fba7c0cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:10.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.614+0000 7fba81e6b640 1 -- 172.21.15.104:0/3240855045 shutdown_connections 2024-05-08T04:22:10.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.614+0000 7fba81e6b640 1 -- 172.21.15.104:0/3240855045 wait complete. 2024-05-08T04:22:10.628 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-08T04:22:10.628 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:22:10.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.726+0000 7fb8941ab640 1 Processor -- start 2024-05-08T04:22:10.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.727+0000 7fb8941ab640 1 -- start start 2024-05-08T04:22:10.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.728+0000 7fb8941ab640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb88c0ceee0 0x7fb88c0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:10.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.728+0000 7fb8941ab640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c0b4700 0x7fb88c06e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:10.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.728+0000 7fb8941ab640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88c15e780 con 0x7fb88c06e330 2024-05-08T04:22:10.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.728+0000 7fb8941ab640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb88c15f390 con 0x7fb88c0ceee0 2024-05-08T04:22:10.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.728+0000 7fb8941ab640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c15ea60 con 0x7fb88c0b4700 2024-05-08T04:22:10.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.728+0000 7fb891f47640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb88c0ceee0 0x7fb88c0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:10.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.728+0000 7fb891f47640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb88c0ceee0 0x7fb88c0b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49830/0 (socket says 172.21.15.104:49830) 2024-05-08T04:22:10.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.728+0000 7fb891f47640 1 -- 172.21.15.104:0/3570369179 learned_addr learned my addr 172.21.15.104:0/3570369179 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:10.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.728+0000 7fb892748640 1 --2- 172.21.15.104:0/3570369179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c0b4700 0x7fb88c06e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:10.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.728+0000 7fb891f47640 1 -- 172.21.15.104:0/3570369179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c0b4700 msgr2=0x7fb88c06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:10.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.728+0000 7fb891f47640 1 --2- 172.21.15.104:0/3570369179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c0b4700 0x7fb88c06e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.728+0000 7fb891f47640 1 -- 172.21.15.104:0/3570369179 >> v1:172.21.15.183:6789/0 conn(0x7fb88c06e330 legacy=0x7fb88c0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:10.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.728+0000 7fb891f47640 1 -- 172.21.15.104:0/3570369179 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c15ed40 con 0x7fb88c0ceee0 2024-05-08T04:22:10.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.729+0000 7fb891f47640 1 --2- 172.21.15.104:0/3570369179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb88c0ceee0 0x7fb88c0b26f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb88800bb10 tx=0x7fb88802c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791ae4cbc4dd107 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:10.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.729+0000 7fb890f45640 1 -- 172.21.15.104:0/3570369179 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb888032790 con 0x7fb88c0ceee0 2024-05-08T04:22:10.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.729+0000 7fb890f45640 1 -- 172.21.15.104:0/3570369179 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb888038070 con 0x7fb88c0ceee0 2024-05-08T04:22:10.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.729+0000 7fb890f45640 1 -- 172.21.15.104:0/3570369179 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb888032b50 con 0x7fb88c0ceee0 2024-05-08T04:22:10.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.729+0000 7fb8941ab640 1 -- 172.21.15.104:0/3570369179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb88c0ceee0 msgr2=0x7fb88c0b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:10.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.729+0000 7fb8941ab640 1 --2- 172.21.15.104:0/3570369179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb88c0ceee0 0x7fb88c0b26f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb88800bb10 tx=0x7fb88802c8d0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.729+0000 7fb8941ab640 1 -- 172.21.15.104:0/3570369179 shutdown_connections 2024-05-08T04:22:10.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.729+0000 7fb8941ab640 1 --2- 172.21.15.104:0/3570369179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c0b4700 0x7fb88c06e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.729+0000 7fb8941ab640 1 --2- 172.21.15.104:0/3570369179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb88c0ceee0 0x7fb88c0b26f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.729+0000 7fb8941ab640 1 -- 172.21.15.104:0/3570369179 >> 172.21.15.104:0/3570369179 conn(0x7fb88c0b13f0 msgr2=0x7fb88c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:10.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.730+0000 7fb8941ab640 1 -- 172.21.15.104:0/3570369179 shutdown_connections 2024-05-08T04:22:10.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.730+0000 7fb8941ab640 1 -- 172.21.15.104:0/3570369179 wait complete. 2024-05-08T04:22:10.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.731+0000 7fb8941ab640 1 Processor -- start 2024-05-08T04:22:10.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.731+0000 7fb8941ab640 1 -- start start 2024-05-08T04:22:10.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.731+0000 7fb8941ab640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c06e330 0x7fb88c1f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:10.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.731+0000 7fb8941ab640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0b4700 0x7fb88c0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:10.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.731+0000 7fb8941ab640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb88c0ceee0 0x7fb88c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:10.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.731+0000 7fb8941ab640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c0cf440 con 0x7fb88c0ceee0 2024-05-08T04:22:10.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.731+0000 7fb8941ab640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c0cf2c0 con 0x7fb88c0b4700 2024-05-08T04:22:10.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.731+0000 7fb8941ab640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c15b210 con 0x7fb88c06e330 2024-05-08T04:22:10.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.731+0000 7fb892748640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb88c0ceee0 0x7fb88c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:10.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.731+0000 7fb892748640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb88c0ceee0 0x7fb88c0cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49840/0 (socket says 172.21.15.104:49840) 2024-05-08T04:22:10.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb892748640 1 -- 172.21.15.104:0/1115470503 learned_addr learned my addr 172.21.15.104:0/1115470503 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:10.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb891f47640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c06e330 0x7fb88c1f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:10.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb891746640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0b4700 0x7fb88c0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:10.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb892748640 1 -- 172.21.15.104:0/1115470503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c06e330 msgr2=0x7fb88c1f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:10.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb892748640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c06e330 0x7fb88c1f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb892748640 1 -- 172.21.15.104:0/1115470503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0b4700 msgr2=0x7fb88c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:10.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb892748640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0b4700 0x7fb88c0cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb892748640 1 -- 172.21.15.104:0/1115470503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c15d120 con 0x7fb88c0ceee0 2024-05-08T04:22:10.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb891f47640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c06e330 0x7fb88c1f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:10.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb891746640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0b4700 0x7fb88c0cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:10.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb892748640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb88c0ceee0 0x7fb88c0cdc20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb884007e40 tx=0x7fb88400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:10.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb87e7fc640 1 -- 172.21.15.104:0/1115470503 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884014620 con 0x7fb88c0ceee0 2024-05-08T04:22:10.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb87e7fc640 1 -- 172.21.15.104:0/1115470503 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb884019070 con 0x7fb88c0ceee0 2024-05-08T04:22:10.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb8941ab640 1 -- 172.21.15.104:0/1115470503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb88c15d400 con 0x7fb88c0ceee0 2024-05-08T04:22:10.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb87e7fc640 1 -- 172.21.15.104:0/1115470503 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884014a20 con 0x7fb88c0ceee0 2024-05-08T04:22:10.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.732+0000 7fb8941ab640 1 -- 172.21.15.104:0/1115470503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88c15d9c0 con 0x7fb88c0ceee0 2024-05-08T04:22:10.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.733+0000 7fb8941ab640 1 -- 172.21.15.104:0/1115470503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88c075010 con 0x7fb88c0ceee0 2024-05-08T04:22:10.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.733+0000 7fb87e7fc640 1 -- 172.21.15.104:0/1115470503 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb884014bc0 con 0x7fb88c0ceee0 2024-05-08T04:22:10.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.734+0000 7fb87e7fc640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb87006b500 0x7fb87006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:10.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.734+0000 7fb87e7fc640 1 -- 172.21.15.104:0/1115470503 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb88408aa40 con 0x7fb88c0ceee0 2024-05-08T04:22:10.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.734+0000 7fb891f47640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb87006b500 0x7fb87006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:10.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.734+0000 7fb891f47640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb87006b500 0x7fb87006d9c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb888037000 tx=0x7fb88803e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:10.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.738+0000 7fb87e7fc640 1 -- 172.21.15.104:0/1115470503 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb884059950 con 0x7fb88c0ceee0 2024-05-08T04:22:10.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.941+0000 7fb8941ab640 1 -- 172.21.15.104:0/1115470503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb88c156c00 con 0x7fb88c0ceee0 2024-05-08T04:22:10.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.941+0000 7fb87e7fc640 1 -- 172.21.15.104:0/1115470503 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fb88408ae20 con 0x7fb88c0ceee0 2024-05-08T04:22:10.944 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:10.944 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4933,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3121320604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3121320604},{"type":"v1","addr":"172.21.15.183:6834","nonce":3121320604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/207909171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":207909171},{"type":"v1","addr":"172.21.15.183:6835","nonce":207909171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/4245686743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4245686743},{"type":"v1","addr":"172.21.15.104:6836","nonce":4245686743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:07.933747+0000","modified":"2024-05-08T04:22:09.941364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/4038606624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":4038606624},{"type":"v1","addr":"172.21.15.104:6837","nonce":4038606624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T04:22:10.944 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 14 2024-05-08T04:22:10.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.943+0000 7fb8941ab640 1 -- 172.21.15.104:0/1115470503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb87006b500 msgr2=0x7fb87006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:10.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.943+0000 7fb8941ab640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb87006b500 0x7fb87006d9c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb888037000 tx=0x7fb88803e040 comp rx=0 tx=0).stop 2024-05-08T04:22:10.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.943+0000 7fb8941ab640 1 -- 172.21.15.104:0/1115470503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb88c0ceee0 msgr2=0x7fb88c0cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:10.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.943+0000 7fb8941ab640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb88c0ceee0 0x7fb88c0cdc20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb884007e40 tx=0x7fb88400e4b0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.943+0000 7fb8941ab640 1 -- 172.21.15.104:0/1115470503 shutdown_connections 2024-05-08T04:22:10.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.943+0000 7fb8941ab640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb87006b500 0x7fb87006d9c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.943+0000 7fb8941ab640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0b4700 0x7fb88c0cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.943+0000 7fb8941ab640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb88c0ceee0 0x7fb88c0cdc20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.943+0000 7fb8941ab640 1 --2- 172.21.15.104:0/1115470503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c06e330 0x7fb88c1f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:10.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.943+0000 7fb8941ab640 1 -- 172.21.15.104:0/1115470503 >> 172.21.15.104:0/1115470503 conn(0x7fb88c0b13f0 msgr2=0x7fb88c0711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:10.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.943+0000 7fb8941ab640 1 -- 172.21.15.104:0/1115470503 shutdown_connections 2024-05-08T04:22:10.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:10.943+0000 7fb8941ab640 1 -- 172.21.15.104:0/1115470503 wait complete. 2024-05-08T04:22:10.957 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:11.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.053+0000 7fb3ab8dd640 1 Processor -- start 2024-05-08T04:22:11.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.054+0000 7fb3ab8dd640 1 -- start start 2024-05-08T04:22:11.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.054+0000 7fb3ab8dd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3a4161780 0x7fb3a40ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.054+0000 7fb3ab8dd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb3a40d4010 0x7fb3a40cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.054+0000 7fb3ab8dd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a40b5540 con 0x7fb3a4162150 2024-05-08T04:22:11.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.054+0000 7fb3ab8dd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a40b57e0 con 0x7fb3a40d4010 2024-05-08T04:22:11.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.054+0000 7fb3ab8dd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a40b5ac0 con 0x7fb3a4161780 2024-05-08T04:22:11.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.055+0000 7fb3a9e7a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb3a40d4010 0x7fb3a40cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.055+0000 7fb3a9679640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb3a4162150 0x7fb3a40d2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41204/0 (socket says 172.21.15.104:41204) 2024-05-08T04:22:11.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.055+0000 7fb3a9679640 1 -- 172.21.15.104:0/1951205475 learned_addr learned my addr 172.21.15.104:0/1951205475 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:11.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.055+0000 7fb3a8e78640 1 --2- 172.21.15.104:0/1951205475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3a4161780 0x7fb3a40ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.055+0000 7fb3a9e7a640 1 -- 172.21.15.104:0/1951205475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3a4161780 msgr2=0x7fb3a40ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:11.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.055+0000 7fb3a9e7a640 1 --2- 172.21.15.104:0/1951205475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3a4161780 0x7fb3a40ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.055+0000 7fb39bfff640 1 -- 172.21.15.104:0/1951205475 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437902423 0 0) 0x7fb3a40b5540 con 0x7fb3a4162150 2024-05-08T04:22:11.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.055+0000 7fb3a9e7a640 1 -- 172.21.15.104:0/1951205475 >> v1:172.21.15.104:6789/0 conn(0x7fb3a4162150 legacy=0x7fb3a40d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.055+0000 7fb3a9e7a640 1 -- 172.21.15.104:0/1951205475 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a40b5da0 con 0x7fb3a40d4010 2024-05-08T04:22:11.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.056+0000 7fb3a9e7a640 1 --2- 172.21.15.104:0/1951205475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3a40d4010 0x7fb3a40cec80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009d90 tx=0x7fb39c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6774d38cb0345d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:11.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.056+0000 7fb39bfff640 1 -- 172.21.15.104:0/1951205475 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c031600 con 0x7fb3a40d4010 2024-05-08T04:22:11.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.056+0000 7fb39bfff640 1 -- 172.21.15.104:0/1951205475 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c0317a0 con 0x7fb3a40d4010 2024-05-08T04:22:11.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.056+0000 7fb39bfff640 1 -- 172.21.15.104:0/1951205475 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c031b70 con 0x7fb3a40d4010 2024-05-08T04:22:11.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.056+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1951205475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3a40d4010 msgr2=0x7fb3a40cec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.056+0000 7fb3ab8dd640 1 --2- 172.21.15.104:0/1951205475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3a40d4010 0x7fb3a40cec80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009d90 tx=0x7fb39c02a5d0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.056+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1951205475 shutdown_connections 2024-05-08T04:22:11.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.056+0000 7fb3ab8dd640 1 --2- 172.21.15.104:0/1951205475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3a40d4010 0x7fb3a40cec80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.056+0000 7fb3ab8dd640 1 --2- 172.21.15.104:0/1951205475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3a4161780 0x7fb3a40ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.056+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1951205475 >> 172.21.15.104:0/1951205475 conn(0x7fb3a406c330 msgr2=0x7fb3a406c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:11.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.056+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1951205475 shutdown_connections 2024-05-08T04:22:11.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.056+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1951205475 wait complete. 2024-05-08T04:22:11.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.058+0000 7fb3ab8dd640 1 Processor -- start 2024-05-08T04:22:11.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.058+0000 7fb3ab8dd640 1 -- start start 2024-05-08T04:22:11.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.058+0000 7fb3ab8dd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3a40d4010 0x7fb3a40cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.058+0000 7fb3ab8dd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3a4161780 0x7fb3a41574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.058+0000 7fb3ab8dd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3a4162150 0x7fb3a4159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.058+0000 7fb3ab8dd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a40b8f30 con 0x7fb3a4161780 2024-05-08T04:22:11.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.058+0000 7fb3ab8dd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a40b8db0 con 0x7fb3a40d4010 2024-05-08T04:22:11.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.058+0000 7fb3ab8dd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a40b90b0 con 0x7fb3a4162150 2024-05-08T04:22:11.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.058+0000 7fb3a8e78640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3a4161780 0x7fb3a41574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.058+0000 7fb3a8e78640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3a4161780 0x7fb3a41574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49860/0 (socket says 172.21.15.104:49860) 2024-05-08T04:22:11.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.058+0000 7fb3a8e78640 1 -- 172.21.15.104:0/1739201385 learned_addr learned my addr 172.21.15.104:0/1739201385 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:11.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.059+0000 7fb3a9679640 1 --2- 172.21.15.104:0/1739201385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3a40d4010 0x7fb3a40cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.059+0000 7fb3a8e78640 1 -- 172.21.15.104:0/1739201385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3a4162150 msgr2=0x7fb3a4159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.059+0000 7fb3a8e78640 1 --2- 172.21.15.104:0/1739201385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3a4162150 0x7fb3a4159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.059+0000 7fb3a8e78640 1 -- 172.21.15.104:0/1739201385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3a40d4010 msgr2=0x7fb3a40cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.059+0000 7fb3a8e78640 1 --2- 172.21.15.104:0/1739201385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3a40d4010 0x7fb3a40cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.059+0000 7fb3a8e78640 1 -- 172.21.15.104:0/1739201385 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a40cd7b0 con 0x7fb3a4161780 2024-05-08T04:22:11.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.059+0000 7fb3a8e78640 1 --2- 172.21.15.104:0/1739201385 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3a4161780 0x7fb3a41574d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb39400c820 tx=0x7fb39400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:11.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.059+0000 7fb399ffb640 1 -- 172.21.15.104:0/1739201385 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb394015070 con 0x7fb3a4161780 2024-05-08T04:22:11.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.059+0000 7fb399ffb640 1 -- 172.21.15.104:0/1739201385 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb394004220 con 0x7fb3a4161780 2024-05-08T04:22:11.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.059+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1739201385 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a40cc540 con 0x7fb3a4161780 2024-05-08T04:22:11.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.059+0000 7fb399ffb640 1 -- 172.21.15.104:0/1739201385 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39400ce10 con 0x7fb3a4161780 2024-05-08T04:22:11.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.059+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1739201385 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a40ccb00 con 0x7fb3a4161780 2024-05-08T04:22:11.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.060+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1739201385 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a4075010 con 0x7fb3a4161780 2024-05-08T04:22:11.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.061+0000 7fb399ffb640 1 -- 172.21.15.104:0/1739201385 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb394007830 con 0x7fb3a4161780 2024-05-08T04:22:11.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.061+0000 7fb399ffb640 1 --2- 172.21.15.104:0/1739201385 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb38806b4d0 0x7fb38806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.061+0000 7fb399ffb640 1 -- 172.21.15.104:0/1739201385 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb39408a030 con 0x7fb3a4161780 2024-05-08T04:22:11.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.061+0000 7fb3a9679640 1 --2- 172.21.15.104:0/1739201385 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb38806b4d0 0x7fb38806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.062+0000 7fb3a9679640 1 --2- 172.21.15.104:0/1739201385 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb38806b4d0 0x7fb38806d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0000f60 tx=0x7fb3a0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:11.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.066+0000 7fb399ffb640 1 -- 172.21.15.104:0/1739201385 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb394058eb0 con 0x7fb3a4161780 2024-05-08T04:22:11.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.236+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1739201385 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3a406c810 con 0x7fb3a4161780 2024-05-08T04:22:11.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.237+0000 7fb399ffb640 1 -- 172.21.15.104:0/1739201385 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16669 (secure 0 0 0) 0x7fb3940587b0 con 0x7fb3a4161780 2024-05-08T04:22:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:11.240 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":33,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:09.602236+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:05.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:06.917080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:11.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.239+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1739201385 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb38806b4d0 msgr2=0x7fb38806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.239+0000 7fb3ab8dd640 1 --2- 172.21.15.104:0/1739201385 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb38806b4d0 0x7fb38806d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0000f60 tx=0x7fb3a0009040 comp rx=0 tx=0).stop 2024-05-08T04:22:11.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.239+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1739201385 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3a4161780 msgr2=0x7fb3a41574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.239+0000 7fb3ab8dd640 1 --2- 172.21.15.104:0/1739201385 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3a4161780 0x7fb3a41574d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb39400c820 tx=0x7fb39400cce0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.239+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1739201385 shutdown_connections 2024-05-08T04:22:11.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.239+0000 7fb3ab8dd640 1 --2- 172.21.15.104:0/1739201385 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb38806b4d0 0x7fb38806d990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.239+0000 7fb3ab8dd640 1 --2- 172.21.15.104:0/1739201385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3a4162150 0x7fb3a4159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.239+0000 7fb3ab8dd640 1 --2- 172.21.15.104:0/1739201385 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3a4161780 0x7fb3a41574d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.239+0000 7fb3ab8dd640 1 --2- 172.21.15.104:0/1739201385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3a40d4010 0x7fb3a40cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.239+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1739201385 >> 172.21.15.104:0/1739201385 conn(0x7fb3a406c330 msgr2=0x7fb3a415d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:11.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.239+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1739201385 shutdown_connections 2024-05-08T04:22:11.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.239+0000 7fb3ab8dd640 1 -- 172.21.15.104:0/1739201385 wait complete. 2024-05-08T04:22:11.253 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-08T04:22:11.253 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:22:11.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.350+0000 7ff9fb3b0640 1 Processor -- start 2024-05-08T04:22:11.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.350+0000 7ff9fb3b0640 1 -- start start 2024-05-08T04:22:11.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.351+0000 7ff9fb3b0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff9f415bac0 0x7ff9f40b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.351+0000 7ff9fb3b0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff9f406ab60 0x7ff9f406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.351+0000 7ff9fb3b0640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f40b1e30 con 0x7ff9f40cc3a0 2024-05-08T04:22:11.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.351+0000 7ff9fb3b0640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f40b1c00 con 0x7ff9f415bac0 2024-05-08T04:22:11.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.351+0000 7ff9fb3b0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f406b500 con 0x7ff9f406ab60 2024-05-08T04:22:11.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.351+0000 7ff9f914c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff9f415bac0 0x7ff9f40b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.351+0000 7ff9f994d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff9f40cc3a0 0x7ff9f40cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41210/0 (socket says 172.21.15.104:41210) 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.351+0000 7ff9f994d640 1 -- 172.21.15.104:0/540271046 learned_addr learned my addr 172.21.15.104:0/540271046 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.352+0000 7ff9f894b640 1 --2- 172.21.15.104:0/540271046 >> v2:172.21.15.183:3300/0 conn(0x7ff9f406ab60 0x7ff9f406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.352+0000 7ff9f914c640 1 -- 172.21.15.104:0/540271046 >> v2:172.21.15.183:3300/0 conn(0x7ff9f406ab60 msgr2=0x7ff9f406afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.352+0000 7ff9f914c640 1 --2- 172.21.15.104:0/540271046 >> v2:172.21.15.183:3300/0 conn(0x7ff9f406ab60 0x7ff9f406afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.352+0000 7ff9f914c640 1 -- 172.21.15.104:0/540271046 >> v1:172.21.15.104:6789/0 conn(0x7ff9f40cc3a0 legacy=0x7ff9f40cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.352+0000 7ff9f914c640 1 -- 172.21.15.104:0/540271046 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f40b36c0 con 0x7ff9f415bac0 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.352+0000 7ff9ebfff640 1 -- 172.21.15.104:0/540271046 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102667148 0 0) 0x7ff9f40b1e30 con 0x7ff9f40cc3a0 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.352+0000 7ff9f894b640 1 --2- 172.21.15.104:0/540271046 >> v2:172.21.15.183:3300/0 conn(0x7ff9f406ab60 0x7ff9f406afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.352+0000 7ff9f914c640 1 --2- 172.21.15.104:0/540271046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f415bac0 0x7ff9f40b16c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4072210 tx=0x7ff9f002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7744e340bbcd32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.352+0000 7ff9ebfff640 1 -- 172.21.15.104:0/540271046 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0037070 con 0x7ff9f415bac0 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.352+0000 7ff9ebfff640 1 -- 172.21.15.104:0/540271046 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f0032440 con 0x7ff9f415bac0 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.353+0000 7ff9ebfff640 1 -- 172.21.15.104:0/540271046 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f002ae60 con 0x7ff9f415bac0 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.353+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/540271046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f415bac0 msgr2=0x7ff9f40b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.353+0000 7ff9fb3b0640 1 --2- 172.21.15.104:0/540271046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f415bac0 0x7ff9f40b16c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4072210 tx=0x7ff9f002a110 comp rx=0 tx=0).stop 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.353+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/540271046 shutdown_connections 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.353+0000 7ff9fb3b0640 1 --2- 172.21.15.104:0/540271046 >> v2:172.21.15.183:3300/0 conn(0x7ff9f406ab60 0x7ff9f406afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.353+0000 7ff9fb3b0640 1 --2- 172.21.15.104:0/540271046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f415bac0 0x7ff9f40b16c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.353+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/540271046 >> 172.21.15.104:0/540271046 conn(0x7ff9f40b2220 msgr2=0x7ff9f40b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.353+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/540271046 shutdown_connections 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.353+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/540271046 wait complete. 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.354+0000 7ff9fb3b0640 1 Processor -- start 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.354+0000 7ff9fb3b0640 1 -- start start 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9fb3b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f406ab60 0x7ff9f4150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9fb3b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f40cc3a0 0x7ff9f40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9fb3b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f415bac0 0x7ff9f40c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9fb3b0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f40c3f00 con 0x7ff9f406ab60 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9fb3b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f40b3d10 con 0x7ff9f415bac0 2024-05-08T04:22:11.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9fb3b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f415bea0 con 0x7ff9f40cc3a0 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9f914c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f406ab60 0x7ff9f4150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9f914c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f406ab60 0x7ff9f4150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49884/0 (socket says 172.21.15.104:49884) 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9f914c640 1 -- 172.21.15.104:0/444535789 learned_addr learned my addr 172.21.15.104:0/444535789 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9f914c640 1 -- 172.21.15.104:0/444535789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f40cc3a0 msgr2=0x7ff9f40c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9f914c640 1 --2- 172.21.15.104:0/444535789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f40cc3a0 0x7ff9f40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9f914c640 1 -- 172.21.15.104:0/444535789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f415bac0 msgr2=0x7ff9f40c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9f914c640 1 --2- 172.21.15.104:0/444535789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f415bac0 0x7ff9f40c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.355+0000 7ff9f914c640 1 -- 172.21.15.104:0/444535789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f4150fe0 con 0x7ff9f406ab60 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.356+0000 7ff9f914c640 1 --2- 172.21.15.104:0/444535789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f406ab60 0x7ff9f4150aa0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009890 tx=0x7ff9f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.356+0000 7ff9e9ffb640 1 -- 172.21.15.104:0/444535789 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0037040 con 0x7ff9f406ab60 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.356+0000 7ff9e9ffb640 1 -- 172.21.15.104:0/444535789 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f0042070 con 0x7ff9f406ab60 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.356+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/444535789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f40c82d0 con 0x7ff9f406ab60 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.356+0000 7ff9e9ffb640 1 -- 172.21.15.104:0/444535789 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0030a50 con 0x7ff9f406ab60 2024-05-08T04:22:11.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.356+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/444535789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f40c8890 con 0x7ff9f406ab60 2024-05-08T04:22:11.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.357+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/444535789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f406ba50 con 0x7ff9f406ab60 2024-05-08T04:22:11.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.357+0000 7ff9e9ffb640 1 -- 172.21.15.104:0/444535789 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff9f0030bf0 con 0x7ff9f406ab60 2024-05-08T04:22:11.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.358+0000 7ff9e9ffb640 1 --2- 172.21.15.104:0/444535789 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff9d806b4d0 0x7ff9d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.358+0000 7ff9e9ffb640 1 -- 172.21.15.104:0/444535789 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9f00aac80 con 0x7ff9f406ab60 2024-05-08T04:22:11.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.358+0000 7ff9f894b640 1 --2- 172.21.15.104:0/444535789 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff9d806b4d0 0x7ff9d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.358+0000 7ff9f894b640 1 --2- 172.21.15.104:0/444535789 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff9d806b4d0 0x7ff9d806d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4006fd0 tx=0x7ff9e4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:11.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.363+0000 7ff9e9ffb640 1 -- 172.21.15.104:0/444535789 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9f406ba50 con 0x7ff9f406ab60 2024-05-08T04:22:11.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.529+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/444535789 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9f4075010 con 0x7ff9d806b4d0 2024-05-08T04:22:11.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.535+0000 7ff9e9ffb640 1 -- 172.21.15.104:0/444535789 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246634 (secure 0 0 0) 0x7ff9f4075010 con 0x7ff9d806b4d0 2024-05-08T04:22:11.540 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:11.541 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:22:11.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.538+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/444535789 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff9d806b4d0 msgr2=0x7ff9d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.538+0000 7ff9fb3b0640 1 --2- 172.21.15.104:0/444535789 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff9d806b4d0 0x7ff9d806d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4006fd0 tx=0x7ff9e4008040 comp rx=0 tx=0).stop 2024-05-08T04:22:11.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.538+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/444535789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f406ab60 msgr2=0x7ff9f4150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.538+0000 7ff9fb3b0640 1 --2- 172.21.15.104:0/444535789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f406ab60 0x7ff9f4150aa0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009890 tx=0x7ff9f00046c0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.538+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/444535789 shutdown_connections 2024-05-08T04:22:11.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.538+0000 7ff9fb3b0640 1 --2- 172.21.15.104:0/444535789 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff9d806b4d0 0x7ff9d806d990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.538+0000 7ff9fb3b0640 1 --2- 172.21.15.104:0/444535789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f415bac0 0x7ff9f40c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.538+0000 7ff9fb3b0640 1 --2- 172.21.15.104:0/444535789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f40cc3a0 0x7ff9f40c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.538+0000 7ff9fb3b0640 1 --2- 172.21.15.104:0/444535789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9f406ab60 0x7ff9f4150aa0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.538+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/444535789 >> 172.21.15.104:0/444535789 conn(0x7ff9f40b2220 msgr2=0x7ff9f4159960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:11.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.538+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/444535789 shutdown_connections 2024-05-08T04:22:11.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.538+0000 7ff9fb3b0640 1 -- 172.21.15.104:0/444535789 wait complete. 2024-05-08T04:22:11.551 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-05-08T04:22:10.648179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219944,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3874816,"data_stored":2194912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.064477"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598877+0000","last_change":"2024-05-08T04:22:07.598877+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598877+0000","last_undegraded":"2024-05-08T04:22:07.598877+0000","last_fullsized":"2024-05-08T04:22:07.598877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591580+0000","last_change":"2024-05-08T04:22:07.591580+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591580+0000","last_undegraded":"2024-05-08T04:22:07.591580+0000","last_fullsized":"2024-05-08T04:22:07.591580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599870+0000","last_change":"2024-05-08T04:22:07.599870+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599870+0000","last_undegraded":"2024-05-08T04:22:07.599870+0000","last_fullsized":"2024-05-08T04:22:07.599870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.603655+0000","last_change":"2024-05-08T04:22:07.603655+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.603655+0000","last_undegraded":"2024-05-08T04:22:07.603655+0000","last_fullsized":"2024-05-08T04:22:07.603655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.592100+0000","last_change":"2024-05-08T04:22:07.592100+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.592100+0000","last_undegraded":"2024-05-08T04:22:07.592100+0000","last_fullsized":"2024-05-08T04:22:07.592100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.593923+0000","last_change":"2024-05-08T04:22:07.593923+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.593923+0000","last_undegraded":"2024-05-08T04:22:07.593923+0000","last_fullsized":"2024-05-08T04:22:07.593923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598863+0000","last_change":"2024-05-08T04:22:07.598863+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598863+0000","last_undegraded":"2024-05-08T04:22:07.598863+0000","last_fullsized":"2024-05-08T04:22:07.598863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598470+0000","last_change":"2024-05-08T04:22:07.598470+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598470+0000","last_undegraded":"2024-05-08T04:22:07.598470+0000","last_fullsized":"2024-05-08T04:22:07.598470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599509+0000","last_change":"2024-05-08T04:22:07.599509+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599509+0000","last_undegraded":"2024-05-08T04:22:07.599509+0000","last_fullsized":"2024-05-08T04:22:07.599509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.603785+0000","last_change":"2024-05-08T04:22:07.603785+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.603785+0000","last_undegraded":"2024-05-08T04:22:07.603785+0000","last_fullsized":"2024-05-08T04:22:07.603785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601173+0000","last_change":"2024-05-08T04:22:07.601173+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601173+0000","last_undegraded":"2024-05-08T04:22:07.601173+0000","last_fullsized":"2024-05-08T04:22:07.601173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599562+0000","last_change":"2024-05-08T04:22:07.599562+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599562+0000","last_undegraded":"2024-05-08T04:22:07.599562+0000","last_fullsized":"2024-05-08T04:22:07.599562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599301+0000","last_change":"2024-05-08T04:22:07.599301+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599301+0000","last_undegraded":"2024-05-08T04:22:07.599301+0000","last_fullsized":"2024-05-08T04:22:07.599301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.603583+0000","last_change":"2024-05-08T04:22:07.603583+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.603583+0000","last_undegraded":"2024-05-08T04:22:07.603583+0000","last_fullsized":"2024-05-08T04:22:07.603583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598743+0000","last_change":"2024-05-08T04:22:07.598743+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598743+0000","last_undegraded":"2024-05-08T04:22:07.598743+0000","last_fullsized":"2024-05-08T04:22:07.598743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598229+0000","last_change":"2024-05-08T04:22:07.598229+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598229+0000","last_undegraded":"2024-05-08T04:22:07.598229+0000","last_fullsized":"2024-05-08T04:22:07.598229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602514+0000","last_change":"2024-05-08T04:22:07.602514+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602514+0000","last_undegraded":"2024-05-08T04:22:07.602514+0000","last_fullsized":"2024-05-08T04:22:07.602514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.595546+0000","last_change":"2024-05-08T04:22:07.595546+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.595546+0000","last_undegraded":"2024-05-08T04:22:07.595546+0000","last_fullsized":"2024-05-08T04:22:07.595546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.595104+0000","last_change":"2024-05-08T04:22:07.595104+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.595104+0000","last_undegraded":"2024-05-08T04:22:07.595104+0000","last_fullsized":"2024-05-08T04:22:07.595104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599209+0000","last_change":"2024-05-08T04:22:07.599209+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599209+0000","last_undegraded":"2024-05-08T04:22:07.599209+0000","last_fullsized":"2024-05-08T04:22:07.599209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598675+0000","last_change":"2024-05-08T04:22:07.598675+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598675+0000","last_undegraded":"2024-05-08T04:22:07.598675+0000","last_fullsized":"2024-05-08T04:22:07.598675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598001+0000","last_change":"2024-05-08T04:22:07.598001+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598001+0000","last_undegraded":"2024-05-08T04:22:07.598001+0000","last_fullsized":"2024-05-08T04:22:07.598001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598363+0000","last_change":"2024-05-08T04:22:07.598363+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598363+0000","last_undegraded":"2024-05-08T04:22:07.598363+0000","last_fullsized":"2024-05-08T04:22:07.598363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597568+0000","last_change":"2024-05-08T04:22:07.597568+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597568+0000","last_undegraded":"2024-05-08T04:22:07.597568+0000","last_fullsized":"2024-05-08T04:22:07.597568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.604025+0000","last_change":"2024-05-08T04:22:07.604025+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.604025+0000","last_undegraded":"2024-05-08T04:22:07.604025+0000","last_fullsized":"2024-05-08T04:22:07.604025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602968+0000","last_change":"2024-05-08T04:22:07.602968+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602968+0000","last_undegraded":"2024-05-08T04:22:07.602968+0000","last_fullsized":"2024-05-08T04:22:07.602968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591026+0000","last_change":"2024-05-08T04:22:07.591026+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591026+0000","last_undegraded":"2024-05-08T04:22:07.591026+0000","last_fullsized":"2024-05-08T04:22:07.591026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597363+0000","last_change":"2024-05-08T04:22:07.597363+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597363+0000","last_undegraded":"2024-05-08T04:22:07.597363+0000","last_fullsized":"2024-05-08T04:22:07.597363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598205+0000","last_change":"2024-05-08T04:22:07.598205+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598205+0000","last_undegraded":"2024-05-08T04:22:07.598205+0000","last_fullsized":"2024-05-08T04:22:07.598205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597388+0000","last_change":"2024-05-08T04:22:07.597388+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597388+0000","last_undegraded":"2024-05-08T04:22:07.597388+0000","last_fullsized":"2024-05-08T04:22:07.597388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597398+0000","last_change":"2024-05-08T04:22:07.597398+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597398+0000","last_undegraded":"2024-05-08T04:22:07.597398+0000","last_fullsized":"2024-05-08T04:22:07.597398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600951+0000","last_change":"2024-05-08T04:22:07.600951+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600951+0000","last_undegraded":"2024-05-08T04:22:07.600951+0000","last_fullsized":"2024-05-08T04:22:07.600951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597972+0000","last_change":"2024-05-08T04:22:07.597972+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597972+0000","last_undegraded":"2024-05-08T04:22:07.597972+0000","last_fullsized":"2024-05-08T04:22:07.597972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612424+0000","last_change":"2024-05-08T04:22:07.608133+0000","last_active":"2024-05-08T04:22:07.612424+0000","last_peered":"2024-05-08T04:22:07.612424+0000","last_clean":"2024-05-08T04:22:07.612424+0000","last_became_active":"2024-05-08T04:22:07.607766+0000","last_became_peered":"2024-05-08T04:22:07.607766+0000","last_unstale":"2024-05-08T04:22:07.612424+0000","last_undegraded":"2024-05-08T04:22:07.612424+0000","last_fullsized":"2024-05-08T04:22:07.612424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:34:51.573503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597651+0000","last_change":"2024-05-08T04:22:07.597651+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597651+0000","last_undegraded":"2024-05-08T04:22:07.597651+0000","last_fullsized":"2024-05-08T04:22:07.597651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614390+0000","last_change":"2024-05-08T04:22:07.610820+0000","last_active":"2024-05-08T04:22:07.614390+0000","last_peered":"2024-05-08T04:22:07.614390+0000","last_clean":"2024-05-08T04:22:07.614390+0000","last_became_active":"2024-05-08T04:22:07.610602+0000","last_became_peered":"2024-05-08T04:22:07.610602+0000","last_unstale":"2024-05-08T04:22:07.614390+0000","last_undegraded":"2024-05-08T04:22:07.614390+0000","last_fullsized":"2024-05-08T04:22:07.614390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:12:21.539620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596898+0000","last_change":"2024-05-08T04:22:07.596898+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596898+0000","last_undegraded":"2024-05-08T04:22:07.596898+0000","last_fullsized":"2024-05-08T04:22:07.596898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.608779+0000","last_change":"2024-05-08T04:22:07.606521+0000","last_active":"2024-05-08T04:22:07.608779+0000","last_peered":"2024-05-08T04:22:07.608779+0000","last_clean":"2024-05-08T04:22:07.608779+0000","last_became_active":"2024-05-08T04:22:07.606168+0000","last_became_peered":"2024-05-08T04:22:07.606168+0000","last_unstale":"2024-05-08T04:22:07.608779+0000","last_undegraded":"2024-05-08T04:22:07.608779+0000","last_fullsized":"2024-05-08T04:22:07.608779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:33.286349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601750+0000","last_change":"2024-05-08T04:22:07.601750+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601750+0000","last_undegraded":"2024-05-08T04:22:07.601750+0000","last_fullsized":"2024-05-08T04:22:07.601750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613977+0000","last_change":"2024-05-08T04:22:07.607498+0000","last_active":"2024-05-08T04:22:07.613977+0000","last_peered":"2024-05-08T04:22:07.613977+0000","last_clean":"2024-05-08T04:22:07.613977+0000","last_became_active":"2024-05-08T04:22:07.607217+0000","last_became_peered":"2024-05-08T04:22:07.607217+0000","last_unstale":"2024-05-08T04:22:07.613977+0000","last_undegraded":"2024-05-08T04:22:07.613977+0000","last_fullsized":"2024-05-08T04:22:07.613977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:37.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598452+0000","last_change":"2024-05-08T04:22:07.598452+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598452+0000","last_undegraded":"2024-05-08T04:22:07.598452+0000","last_fullsized":"2024-05-08T04:22:07.598452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610469+0000","last_change":"2024-05-08T04:22:07.606651+0000","last_active":"2024-05-08T04:22:07.610469+0000","last_peered":"2024-05-08T04:22:07.610469+0000","last_clean":"2024-05-08T04:22:07.610469+0000","last_became_active":"2024-05-08T04:22:07.606386+0000","last_became_peered":"2024-05-08T04:22:07.606386+0000","last_unstale":"2024-05-08T04:22:07.610469+0000","last_undegraded":"2024-05-08T04:22:07.610469+0000","last_fullsized":"2024-05-08T04:22:07.610469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:27:15.090679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596862+0000","last_change":"2024-05-08T04:22:07.596862+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596862+0000","last_undegraded":"2024-05-08T04:22:07.596862+0000","last_fullsized":"2024-05-08T04:22:07.596862+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610235+0000","last_change":"2024-05-08T04:22:07.605296+0000","last_active":"2024-05-08T04:22:07.610235+0000","last_peered":"2024-05-08T04:22:07.610235+0000","last_clean":"2024-05-08T04:22:07.610235+0000","last_became_active":"2024-05-08T04:22:07.605050+0000","last_became_peered":"2024-05-08T04:22:07.605050+0000","last_unstale":"2024-05-08T04:22:07.610235+0000","last_undegraded":"2024-05-08T04:22:07.610235+0000","last_fullsized":"2024-05-08T04:22:07.610235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:38:33.843667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597988+0000","last_change":"2024-05-08T04:22:07.597988+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597988+0000","last_undegraded":"2024-05-08T04:22:07.597988+0000","last_fullsized":"2024-05-08T04:22:07.597988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.608758+0000","last_change":"2024-05-08T04:22:07.606390+0000","last_active":"2024-05-08T04:22:07.608758+0000","last_peered":"2024-05-08T04:22:07.608758+0000","last_clean":"2024-05-08T04:22:07.608758+0000","last_became_active":"2024-05-08T04:22:07.606065+0000","last_became_peered":"2024-05-08T04:22:07.606065+0000","last_unstale":"2024-05-08T04:22:07.608758+0000","last_undegraded":"2024-05-08T04:22:07.608758+0000","last_fullsized":"2024-05-08T04:22:07.608758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:18.934495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601737+0000","last_change":"2024-05-08T04:22:07.601737+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601737+0000","last_undegraded":"2024-05-08T04:22:07.601737+0000","last_fullsized":"2024-05-08T04:22:07.601737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610272+0000","last_change":"2024-05-08T04:22:07.604688+0000","last_active":"2024-05-08T04:22:07.610272+0000","last_peered":"2024-05-08T04:22:07.610272+0000","last_clean":"2024-05-08T04:22:07.610272+0000","last_became_active":"2024-05-08T04:22:07.604437+0000","last_became_peered":"2024-05-08T04:22:07.604437+0000","last_unstale":"2024-05-08T04:22:07.610272+0000","last_undegraded":"2024-05-08T04:22:07.610272+0000","last_fullsized":"2024-05-08T04:22:07.610272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:35.814239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602087+0000","last_change":"2024-05-08T04:22:07.602087+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602087+0000","last_undegraded":"2024-05-08T04:22:07.602087+0000","last_fullsized":"2024-05-08T04:22:07.602087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.605419+0000","last_change":"2024-05-08T04:22:07.596652+0000","last_active":"2024-05-08T04:22:07.605419+0000","last_peered":"2024-05-08T04:22:07.605419+0000","last_clean":"2024-05-08T04:22:07.605419+0000","last_became_active":"2024-05-08T04:22:07.596330+0000","last_became_peered":"2024-05-08T04:22:07.596330+0000","last_unstale":"2024-05-08T04:22:07.605419+0000","last_undegraded":"2024-05-08T04:22:07.605419+0000","last_fullsized":"2024-05-08T04:22:07.605419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:09.248136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601843+0000","last_change":"2024-05-08T04:22:07.601843+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601843+0000","last_undegraded":"2024-05-08T04:22:07.601843+0000","last_fullsized":"2024-05-08T04:22:07.601843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.605466+0000","last_change":"2024-05-08T04:22:07.598633+0000","last_active":"2024-05-08T04:22:07.605466+0000","last_peered":"2024-05-08T04:22:07.605466+0000","last_clean":"2024-05-08T04:22:07.605466+0000","last_became_active":"2024-05-08T04:22:07.598319+0000","last_became_peered":"2024-05-08T04:22:07.598319+0000","last_unstale":"2024-05-08T04:22:07.605466+0000","last_undegraded":"2024-05-08T04:22:07.605466+0000","last_fullsized":"2024-05-08T04:22:07.605466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:39:07.152177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602159+0000","last_change":"2024-05-08T04:22:07.602159+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602159+0000","last_undegraded":"2024-05-08T04:22:07.602159+0000","last_fullsized":"2024-05-08T04:22:07.602159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.618257+0000","last_change":"2024-05-08T04:22:07.614017+0000","last_active":"2024-05-08T04:22:07.618257+0000","last_peered":"2024-05-08T04:22:07.618257+0000","last_clean":"2024-05-08T04:22:07.618257+0000","last_became_active":"2024-05-08T04:22:07.613730+0000","last_became_peered":"2024-05-08T04:22:07.613730+0000","last_unstale":"2024-05-08T04:22:07.618257+0000","last_undegraded":"2024-05-08T04:22:07.618257+0000","last_fullsized":"2024-05-08T04:22:07.618257+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:44:18.282843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601752+0000","last_change":"2024-05-08T04:22:07.601752+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601752+0000","last_undegraded":"2024-05-08T04:22:07.601752+0000","last_fullsized":"2024-05-08T04:22:07.601752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.607900+0000","last_change":"2024-05-08T04:22:07.604862+0000","last_active":"2024-05-08T04:22:07.607900+0000","last_peered":"2024-05-08T04:22:07.607900+0000","last_clean":"2024-05-08T04:22:07.607900+0000","last_became_active":"2024-05-08T04:22:07.604578+0000","last_became_peered":"2024-05-08T04:22:07.604578+0000","last_unstale":"2024-05-08T04:22:07.607900+0000","last_undegraded":"2024-05-08T04:22:07.607900+0000","last_fullsized":"2024-05-08T04:22:07.607900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:37.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598682+0000","last_change":"2024-05-08T04:22:07.598682+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598682+0000","last_undegraded":"2024-05-08T04:22:07.598682+0000","last_fullsized":"2024-05-08T04:22:07.598682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613349+0000","last_change":"2024-05-08T04:22:07.608202+0000","last_active":"2024-05-08T04:22:07.613349+0000","last_peered":"2024-05-08T04:22:07.613349+0000","last_clean":"2024-05-08T04:22:07.613349+0000","last_became_active":"2024-05-08T04:22:07.607933+0000","last_became_peered":"2024-05-08T04:22:07.607933+0000","last_unstale":"2024-05-08T04:22:07.613349+0000","last_undegraded":"2024-05-08T04:22:07.613349+0000","last_fullsized":"2024-05-08T04:22:07.613349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:19.196550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601201+0000","last_change":"2024-05-08T04:22:07.601201+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601201+0000","last_undegraded":"2024-05-08T04:22:07.601201+0000","last_fullsized":"2024-05-08T04:22:07.601201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614354+0000","last_change":"2024-05-08T04:22:07.610082+0000","last_active":"2024-05-08T04:22:07.614354+0000","last_peered":"2024-05-08T04:22:07.614354+0000","last_clean":"2024-05-08T04:22:07.614354+0000","last_became_active":"2024-05-08T04:22:07.609805+0000","last_became_peered":"2024-05-08T04:22:07.609805+0000","last_unstale":"2024-05-08T04:22:07.614354+0000","last_undegraded":"2024-05-08T04:22:07.614354+0000","last_fullsized":"2024-05-08T04:22:07.614354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:23.503181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596849+0000","last_change":"2024-05-08T04:22:07.596849+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596849+0000","last_undegraded":"2024-05-08T04:22:07.596849+0000","last_fullsized":"2024-05-08T04:22:07.596849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.616885+0000","last_change":"2024-05-08T04:22:07.613948+0000","last_active":"2024-05-08T04:22:07.616885+0000","last_peered":"2024-05-08T04:22:07.616885+0000","last_clean":"2024-05-08T04:22:07.616885+0000","last_became_active":"2024-05-08T04:22:07.613685+0000","last_became_peered":"2024-05-08T04:22:07.613685+0000","last_unstale":"2024-05-08T04:22:07.616885+0000","last_undegraded":"2024-05-08T04:22:07.616885+0000","last_fullsized":"2024-05-08T04:22:07.616885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:48:25.191717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600995+0000","last_change":"2024-05-08T04:22:07.600995+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600995+0000","last_undegraded":"2024-05-08T04:22:07.600995+0000","last_fullsized":"2024-05-08T04:22:07.600995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614140+0000","last_change":"2024-05-08T04:22:07.608520+0000","last_active":"2024-05-08T04:22:07.614140+0000","last_peered":"2024-05-08T04:22:07.614140+0000","last_clean":"2024-05-08T04:22:07.614140+0000","last_became_active":"2024-05-08T04:22:07.608215+0000","last_became_peered":"2024-05-08T04:22:07.608215+0000","last_unstale":"2024-05-08T04:22:07.614140+0000","last_undegraded":"2024-05-08T04:22:07.614140+0000","last_fullsized":"2024-05-08T04:22:07.614140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:30:41.000788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601645+0000","last_change":"2024-05-08T04:22:07.601645+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601645+0000","last_undegraded":"2024-05-08T04:22:07.601645+0000","last_fullsized":"2024-05-08T04:22:07.601645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.608708+0000","last_change":"2024-05-08T04:22:07.606016+0000","last_active":"2024-05-08T04:22:07.608708+0000","last_peered":"2024-05-08T04:22:07.608708+0000","last_clean":"2024-05-08T04:22:07.608708+0000","last_became_active":"2024-05-08T04:22:07.605696+0000","last_became_peered":"2024-05-08T04:22:07.605696+0000","last_unstale":"2024-05-08T04:22:07.608708+0000","last_undegraded":"2024-05-08T04:22:07.608708+0000","last_fullsized":"2024-05-08T04:22:07.608708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:57.965625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598911+0000","last_change":"2024-05-08T04:22:07.598911+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598911+0000","last_undegraded":"2024-05-08T04:22:07.598911+0000","last_fullsized":"2024-05-08T04:22:07.598911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613388+0000","last_change":"2024-05-08T04:22:07.608876+0000","last_active":"2024-05-08T04:22:07.613388+0000","last_peered":"2024-05-08T04:22:07.613388+0000","last_clean":"2024-05-08T04:22:07.613388+0000","last_became_active":"2024-05-08T04:22:07.607923+0000","last_became_peered":"2024-05-08T04:22:07.607923+0000","last_unstale":"2024-05-08T04:22:07.613388+0000","last_undegraded":"2024-05-08T04:22:07.613388+0000","last_fullsized":"2024-05-08T04:22:07.613388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:37.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591144+0000","last_change":"2024-05-08T04:22:07.591144+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591144+0000","last_undegraded":"2024-05-08T04:22:07.591144+0000","last_fullsized":"2024-05-08T04:22:07.591144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612388+0000","last_change":"2024-05-08T04:22:07.607881+0000","last_active":"2024-05-08T04:22:07.612388+0000","last_peered":"2024-05-08T04:22:07.612388+0000","last_clean":"2024-05-08T04:22:07.612388+0000","last_became_active":"2024-05-08T04:22:07.607596+0000","last_became_peered":"2024-05-08T04:22:07.607596+0000","last_unstale":"2024-05-08T04:22:07.612388+0000","last_undegraded":"2024-05-08T04:22:07.612388+0000","last_fullsized":"2024-05-08T04:22:07.612388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:31:16.484162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.594609+0000","last_change":"2024-05-08T04:22:07.594609+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.594609+0000","last_undegraded":"2024-05-08T04:22:07.594609+0000","last_fullsized":"2024-05-08T04:22:07.594609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613403+0000","last_change":"2024-05-08T04:22:07.606217+0000","last_active":"2024-05-08T04:22:07.613403+0000","last_peered":"2024-05-08T04:22:07.613403+0000","last_clean":"2024-05-08T04:22:07.613403+0000","last_became_active":"2024-05-08T04:22:07.605718+0000","last_became_peered":"2024-05-08T04:22:07.605718+0000","last_unstale":"2024-05-08T04:22:07.613403+0000","last_undegraded":"2024-05-08T04:22:07.613403+0000","last_fullsized":"2024-05-08T04:22:07.613403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:39:07.152177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598204+0000","last_change":"2024-05-08T04:22:07.598204+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598204+0000","last_undegraded":"2024-05-08T04:22:07.598204+0000","last_fullsized":"2024-05-08T04:22:07.598204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.606221+0000","last_change":"2024-05-08T04:22:07.604104+0000","last_active":"2024-05-08T04:22:07.606221+0000","last_peered":"2024-05-08T04:22:07.606221+0000","last_clean":"2024-05-08T04:22:07.606221+0000","last_became_active":"2024-05-08T04:22:07.603790+0000","last_became_peered":"2024-05-08T04:22:07.603790+0000","last_unstale":"2024-05-08T04:22:07.606221+0000","last_undegraded":"2024-05-08T04:22:07.606221+0000","last_fullsized":"2024-05-08T04:22:07.606221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:41.097192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591573+0000","last_change":"2024-05-08T04:22:07.591573+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591573+0000","last_undegraded":"2024-05-08T04:22:07.591573+0000","last_fullsized":"2024-05-08T04:22:07.591573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613415+0000","last_change":"2024-05-08T04:22:07.609907+0000","last_active":"2024-05-08T04:22:07.613415+0000","last_peered":"2024-05-08T04:22:07.613415+0000","last_clean":"2024-05-08T04:22:07.613415+0000","last_became_active":"2024-05-08T04:22:07.609656+0000","last_became_peered":"2024-05-08T04:22:07.609656+0000","last_unstale":"2024-05-08T04:22:07.613415+0000","last_undegraded":"2024-05-08T04:22:07.613415+0000","last_fullsized":"2024-05-08T04:22:07.613415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:23.503181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597335+0000","last_change":"2024-05-08T04:22:07.597335+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597335+0000","last_undegraded":"2024-05-08T04:22:07.597335+0000","last_fullsized":"2024-05-08T04:22:07.597335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610267+0000","last_change":"2024-05-08T04:22:07.606077+0000","last_active":"2024-05-08T04:22:07.610267+0000","last_peered":"2024-05-08T04:22:07.610267+0000","last_clean":"2024-05-08T04:22:07.610267+0000","last_became_active":"2024-05-08T04:22:07.605826+0000","last_became_peered":"2024-05-08T04:22:07.605826+0000","last_unstale":"2024-05-08T04:22:07.610267+0000","last_undegraded":"2024-05-08T04:22:07.610267+0000","last_fullsized":"2024-05-08T04:22:07.610267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:30:41.000788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597115+0000","last_change":"2024-05-08T04:22:07.597115+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597115+0000","last_undegraded":"2024-05-08T04:22:07.597115+0000","last_fullsized":"2024-05-08T04:22:07.597115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612748+0000","last_change":"2024-05-08T04:22:07.609551+0000","last_active":"2024-05-08T04:22:07.612748+0000","last_peered":"2024-05-08T04:22:07.612748+0000","last_clean":"2024-05-08T04:22:07.612748+0000","last_became_active":"2024-05-08T04:22:07.609262+0000","last_became_peered":"2024-05-08T04:22:07.609262+0000","last_unstale":"2024-05-08T04:22:07.612748+0000","last_undegraded":"2024-05-08T04:22:07.612748+0000","last_fullsized":"2024-05-08T04:22:07.612748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:00.284324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.595079+0000","last_change":"2024-05-08T04:22:07.595079+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.595079+0000","last_undegraded":"2024-05-08T04:22:07.595079+0000","last_fullsized":"2024-05-08T04:22:07.595079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.607715+0000","last_change":"2024-05-08T04:22:07.602513+0000","last_active":"2024-05-08T04:22:07.607715+0000","last_peered":"2024-05-08T04:22:07.607715+0000","last_clean":"2024-05-08T04:22:07.607715+0000","last_became_active":"2024-05-08T04:22:07.601926+0000","last_became_peered":"2024-05-08T04:22:07.601926+0000","last_unstale":"2024-05-08T04:22:07.607715+0000","last_undegraded":"2024-05-08T04:22:07.607715+0000","last_fullsized":"2024-05-08T04:22:07.607715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:19.196550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600899+0000","last_change":"2024-05-08T04:22:07.600899+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600899+0000","last_undegraded":"2024-05-08T04:22:07.600899+0000","last_fullsized":"2024-05-08T04:22:07.600899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.605487+0000","last_change":"2024-05-08T04:22:07.599148+0000","last_active":"2024-05-08T04:22:07.605487+0000","last_peered":"2024-05-08T04:22:07.605487+0000","last_clean":"2024-05-08T04:22:07.605487+0000","last_became_active":"2024-05-08T04:22:07.598845+0000","last_became_peered":"2024-05-08T04:22:07.598845+0000","last_unstale":"2024-05-08T04:22:07.605487+0000","last_undegraded":"2024-05-08T04:22:07.605487+0000","last_fullsized":"2024-05-08T04:22:07.605487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:25:46.596230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.593974+0000","last_change":"2024-05-08T04:22:07.593974+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.593974+0000","last_undegraded":"2024-05-08T04:22:07.593974+0000","last_fullsized":"2024-05-08T04:22:07.593974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613913+0000","last_change":"2024-05-08T04:22:07.607364+0000","last_active":"2024-05-08T04:22:07.613913+0000","last_peered":"2024-05-08T04:22:07.613913+0000","last_clean":"2024-05-08T04:22:07.613913+0000","last_became_active":"2024-05-08T04:22:07.607023+0000","last_became_peered":"2024-05-08T04:22:07.607023+0000","last_unstale":"2024-05-08T04:22:07.613913+0000","last_undegraded":"2024-05-08T04:22:07.613913+0000","last_fullsized":"2024-05-08T04:22:07.613913+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:23.503181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596759+0000","last_change":"2024-05-08T04:22:07.596759+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596759+0000","last_undegraded":"2024-05-08T04:22:07.596759+0000","last_fullsized":"2024-05-08T04:22:07.596759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.607787+0000","last_change":"2024-05-08T04:22:07.602890+0000","last_active":"2024-05-08T04:22:07.607787+0000","last_peered":"2024-05-08T04:22:07.607787+0000","last_clean":"2024-05-08T04:22:07.607787+0000","last_became_active":"2024-05-08T04:22:07.602498+0000","last_became_peered":"2024-05-08T04:22:07.602498+0000","last_unstale":"2024-05-08T04:22:07.607787+0000","last_undegraded":"2024-05-08T04:22:07.607787+0000","last_fullsized":"2024-05-08T04:22:07.607787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:43.886509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600256+0000","last_change":"2024-05-08T04:22:07.600256+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600256+0000","last_undegraded":"2024-05-08T04:22:07.600256+0000","last_fullsized":"2024-05-08T04:22:07.600256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614329+0000","last_change":"2024-05-08T04:22:07.609908+0000","last_active":"2024-05-08T04:22:07.614329+0000","last_peered":"2024-05-08T04:22:07.614329+0000","last_clean":"2024-05-08T04:22:07.614329+0000","last_became_active":"2024-05-08T04:22:07.609669+0000","last_became_peered":"2024-05-08T04:22:07.609669+0000","last_unstale":"2024-05-08T04:22:07.614329+0000","last_undegraded":"2024-05-08T04:22:07.614329+0000","last_fullsized":"2024-05-08T04:22:07.614329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:28.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598788+0000","last_change":"2024-05-08T04:22:07.598788+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598788+0000","last_undegraded":"2024-05-08T04:22:07.598788+0000","last_fullsized":"2024-05-08T04:22:07.598788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613387+0000","last_change":"2024-05-08T04:22:07.608739+0000","last_active":"2024-05-08T04:22:07.613387+0000","last_peered":"2024-05-08T04:22:07.613387+0000","last_clean":"2024-05-08T04:22:07.613387+0000","last_became_active":"2024-05-08T04:22:07.608391+0000","last_became_peered":"2024-05-08T04:22:07.608391+0000","last_unstale":"2024-05-08T04:22:07.613387+0000","last_undegraded":"2024-05-08T04:22:07.613387+0000","last_fullsized":"2024-05-08T04:22:07.613387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:43.886509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600514+0000","last_change":"2024-05-08T04:22:07.600514+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600514+0000","last_undegraded":"2024-05-08T04:22:07.600514+0000","last_fullsized":"2024-05-08T04:22:07.600514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614386+0000","last_change":"2024-05-08T04:22:07.610730+0000","last_active":"2024-05-08T04:22:07.614386+0000","last_peered":"2024-05-08T04:22:07.614386+0000","last_clean":"2024-05-08T04:22:07.614386+0000","last_became_active":"2024-05-08T04:22:07.610527+0000","last_became_peered":"2024-05-08T04:22:07.610527+0000","last_unstale":"2024-05-08T04:22:07.614386+0000","last_undegraded":"2024-05-08T04:22:07.614386+0000","last_fullsized":"2024-05-08T04:22:07.614386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:28.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596752+0000","last_change":"2024-05-08T04:22:07.596752+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596752+0000","last_undegraded":"2024-05-08T04:22:07.596752+0000","last_fullsized":"2024-05-08T04:22:07.596752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612816+0000","last_change":"2024-05-08T04:22:07.611008+0000","last_active":"2024-05-08T04:22:07.612816+0000","last_peered":"2024-05-08T04:22:07.612816+0000","last_clean":"2024-05-08T04:22:07.612816+0000","last_became_active":"2024-05-08T04:22:07.610754+0000","last_became_peered":"2024-05-08T04:22:07.610754+0000","last_unstale":"2024-05-08T04:22:07.612816+0000","last_undegraded":"2024-05-08T04:22:07.612816+0000","last_fullsized":"2024-05-08T04:22:07.612816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:25:28.841648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.593372+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:22:07.593372+0000","last_peered":"2024-05-08T04:22:07.593372+0000","last_clean":"2024-05-08T04:22:07.593372+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:22:07.593372+0000","last_undegraded":"2024-05-08T04:22:07.593372+0000","last_fullsized":"2024-05-08T04:22:07.593372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:22:11.555 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:22:11.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.689+0000 7f18603d5640 1 Processor -- start 2024-05-08T04:22:11.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.689+0000 7f18603d5640 1 -- start start 2024-05-08T04:22:11.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.690+0000 7f18603d5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1858158540 0x7f185815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.690+0000 7f18603d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18580cd830 0x7f1858070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.690+0000 7f18603d5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1858073030 con 0x7f18580701a0 2024-05-08T04:22:11.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.690+0000 7f18603d5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18580cbf50 con 0x7f1858158540 2024-05-08T04:22:11.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.690+0000 7f18603d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1858072210 con 0x7f18580cd830 2024-05-08T04:22:11.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.690+0000 7f185e171640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1858158540 0x7f185815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.690+0000 7f185d970640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f18580701a0 0x7f18580cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41216/0 (socket says 172.21.15.104:41216) 2024-05-08T04:22:11.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.690+0000 7f185d970640 1 -- 172.21.15.104:0/2516151869 learned_addr learned my addr 172.21.15.104:0/2516151869 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:11.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.691+0000 7f185e972640 1 --2- 172.21.15.104:0/2516151869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18580cd830 0x7f1858070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.691+0000 7f185e171640 1 -- 172.21.15.104:0/2516151869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18580cd830 msgr2=0x7f1858070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:11.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.691+0000 7f185e171640 1 --2- 172.21.15.104:0/2516151869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18580cd830 0x7f1858070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.691+0000 7f185e171640 1 -- 172.21.15.104:0/2516151869 >> v1:172.21.15.104:6789/0 conn(0x7f18580701a0 legacy=0x7f18580cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.691+0000 7f185d16f640 1 -- 172.21.15.104:0/2516151869 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224390349 0 0) 0x7f1858073030 con 0x7f18580701a0 2024-05-08T04:22:11.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.691+0000 7f185e171640 1 -- 172.21.15.104:0/2516151869 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185815e900 con 0x7f1858158540 2024-05-08T04:22:11.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.691+0000 7f185e972640 1 --2- 172.21.15.104:0/2516151869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18580cd830 0x7f1858070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:11.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.691+0000 7f185e171640 1 --2- 172.21.15.104:0/2516151869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1858158540 0x7f185815e3c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1848009d90 tx=0x7f184802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd9a606a0e10a4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:11.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.692+0000 7f185d16f640 1 -- 172.21.15.104:0/2516151869 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848007740 con 0x7f1858158540 2024-05-08T04:22:11.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.692+0000 7f185d16f640 1 -- 172.21.15.104:0/2516151869 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18480078e0 con 0x7f1858158540 2024-05-08T04:22:11.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.692+0000 7f185d16f640 1 -- 172.21.15.104:0/2516151869 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848007cb0 con 0x7f1858158540 2024-05-08T04:22:11.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.692+0000 7f18603d5640 1 -- 172.21.15.104:0/2516151869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1858158540 msgr2=0x7f185815e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.692+0000 7f18603d5640 1 --2- 172.21.15.104:0/2516151869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1858158540 0x7f185815e3c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1848009d90 tx=0x7f184802a660 comp rx=0 tx=0).stop 2024-05-08T04:22:11.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.692+0000 7f18603d5640 1 -- 172.21.15.104:0/2516151869 shutdown_connections 2024-05-08T04:22:11.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.692+0000 7f18603d5640 1 --2- 172.21.15.104:0/2516151869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18580cd830 0x7f1858070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.692+0000 7f18603d5640 1 --2- 172.21.15.104:0/2516151869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1858158540 0x7f185815e3c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.692+0000 7f18603d5640 1 -- 172.21.15.104:0/2516151869 >> 172.21.15.104:0/2516151869 conn(0x7f18580b23e0 msgr2=0x7f18580b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:11.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.692+0000 7f18603d5640 1 -- 172.21.15.104:0/2516151869 shutdown_connections 2024-05-08T04:22:11.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.692+0000 7f18603d5640 1 -- 172.21.15.104:0/2516151869 wait complete. 2024-05-08T04:22:11.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.693+0000 7f18603d5640 1 Processor -- start 2024-05-08T04:22:11.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.693+0000 7f18603d5640 1 -- start start 2024-05-08T04:22:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f18603d5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18580701a0 0x7f1858153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f18603d5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18580cd830 0x7f18581544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f18603d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1858158540 0x7f1858148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f18603d5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1858072a70 con 0x7f18580cd830 2024-05-08T04:22:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f18603d5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1858072790 con 0x7f18580701a0 2024-05-08T04:22:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f18603d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1858072d50 con 0x7f1858158540 2024-05-08T04:22:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f185d970640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18580cd830 0x7f18581544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f185d970640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18580cd830 0x7f18581544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49900/0 (socket says 172.21.15.104:49900) 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f185d970640 1 -- 172.21.15.104:0/2338406822 learned_addr learned my addr 172.21.15.104:0/2338406822 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f185e972640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1858158540 0x7f1858148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f185e171640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18580701a0 0x7f1858153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f185d970640 1 -- 172.21.15.104:0/2338406822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1858158540 msgr2=0x7f1858148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f185d970640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1858158540 0x7f1858148e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f185d970640 1 -- 172.21.15.104:0/2338406822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18580701a0 msgr2=0x7f1858153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f185d970640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18580701a0 0x7f1858153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.694+0000 7f185d970640 1 -- 172.21.15.104:0/2338406822 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18580b4370 con 0x7f18580cd830 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.695+0000 7f185e171640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18580701a0 0x7f1858153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.695+0000 7f185d970640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18580cd830 0x7f18581544b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f184c00c4d0 tx=0x7f184c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.695+0000 7f1856ffd640 1 -- 172.21.15.104:0/2338406822 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c018070 con 0x7f18580cd830 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.695+0000 7f1856ffd640 1 -- 172.21.15.104:0/2338406822 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c007500 con 0x7f18580cd830 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.695+0000 7f18603d5640 1 -- 172.21.15.104:0/2338406822 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18580b4650 con 0x7f18580cd830 2024-05-08T04:22:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.695+0000 7f1856ffd640 1 -- 172.21.15.104:0/2338406822 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c004a20 con 0x7f18580cd830 2024-05-08T04:22:11.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.695+0000 7f18603d5640 1 -- 172.21.15.104:0/2338406822 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18580b4c10 con 0x7f18580cd830 2024-05-08T04:22:11.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.696+0000 7f18603d5640 1 -- 172.21.15.104:0/2338406822 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1858075010 con 0x7f18580cd830 2024-05-08T04:22:11.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.696+0000 7f1856ffd640 1 -- 172.21.15.104:0/2338406822 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f184c01b070 con 0x7f18580cd830 2024-05-08T04:22:11.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.697+0000 7f1856ffd640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f184406b4d0 0x7f184406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:11.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.697+0000 7f185e171640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f184406b4d0 0x7f184406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:11.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.697+0000 7f1856ffd640 1 -- 172.21.15.104:0/2338406822 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f184c0894b0 con 0x7f18580cd830 2024-05-08T04:22:11.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.697+0000 7f185e171640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f184406b4d0 0x7f184406d990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1848034000 tx=0x7f184802f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.701+0000 7f1856ffd640 1 -- 172.21.15.104:0/2338406822 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f184c0583c0 con 0x7f18580cd830 2024-05-08T04:22:11.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.868+0000 7f18603d5640 1 -- 172.21.15.104:0/2338406822 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18580caaf0 con 0x7f184406b4d0 2024-05-08T04:22:11.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.874+0000 7f1856ffd640 1 -- 172.21.15.104:0/2338406822 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246634 (secure 0 0 0) 0x7f18580caaf0 con 0x7f184406b4d0 2024-05-08T04:22:11.878 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:11.880 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:22:11.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.877+0000 7f18603d5640 1 -- 172.21.15.104:0/2338406822 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f184406b4d0 msgr2=0x7f184406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.877+0000 7f18603d5640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f184406b4d0 0x7f184406d990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1848034000 tx=0x7f184802f000 comp rx=0 tx=0).stop 2024-05-08T04:22:11.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.877+0000 7f18603d5640 1 -- 172.21.15.104:0/2338406822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18580cd830 msgr2=0x7f18581544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:11.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.877+0000 7f18603d5640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18580cd830 0x7f18581544b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f184c00c4d0 tx=0x7f184c00c990 comp rx=0 tx=0).stop 2024-05-08T04:22:11.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.877+0000 7f18603d5640 1 -- 172.21.15.104:0/2338406822 shutdown_connections 2024-05-08T04:22:11.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.877+0000 7f18603d5640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f184406b4d0 0x7f184406d990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.877+0000 7f18603d5640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1858158540 0x7f1858148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.877+0000 7f18603d5640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18580cd830 0x7f18581544b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.877+0000 7f18603d5640 1 --2- 172.21.15.104:0/2338406822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18580701a0 0x7f1858153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:11.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.877+0000 7f18603d5640 1 -- 172.21.15.104:0/2338406822 >> 172.21.15.104:0/2338406822 conn(0x7f18580b23e0 msgr2=0x7f18580b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:11.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.877+0000 7f18603d5640 1 -- 172.21.15.104:0/2338406822 shutdown_connections 2024-05-08T04:22:11.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:11.877+0000 7f18603d5640 1 -- 172.21.15.104:0/2338406822 wait complete. 2024-05-08T04:22:11.890 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-05-08T04:22:10.648179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219944,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3874816,"data_stored":2194912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.064477"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598877+0000","last_change":"2024-05-08T04:22:07.598877+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598877+0000","last_undegraded":"2024-05-08T04:22:07.598877+0000","last_fullsized":"2024-05-08T04:22:07.598877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591580+0000","last_change":"2024-05-08T04:22:07.591580+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591580+0000","last_undegraded":"2024-05-08T04:22:07.591580+0000","last_fullsized":"2024-05-08T04:22:07.591580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599870+0000","last_change":"2024-05-08T04:22:07.599870+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599870+0000","last_undegraded":"2024-05-08T04:22:07.599870+0000","last_fullsized":"2024-05-08T04:22:07.599870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.603655+0000","last_change":"2024-05-08T04:22:07.603655+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.603655+0000","last_undegraded":"2024-05-08T04:22:07.603655+0000","last_fullsized":"2024-05-08T04:22:07.603655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.592100+0000","last_change":"2024-05-08T04:22:07.592100+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.592100+0000","last_undegraded":"2024-05-08T04:22:07.592100+0000","last_fullsized":"2024-05-08T04:22:07.592100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.593923+0000","last_change":"2024-05-08T04:22:07.593923+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.593923+0000","last_undegraded":"2024-05-08T04:22:07.593923+0000","last_fullsized":"2024-05-08T04:22:07.593923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598863+0000","last_change":"2024-05-08T04:22:07.598863+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598863+0000","last_undegraded":"2024-05-08T04:22:07.598863+0000","last_fullsized":"2024-05-08T04:22:07.598863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598470+0000","last_change":"2024-05-08T04:22:07.598470+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598470+0000","last_undegraded":"2024-05-08T04:22:07.598470+0000","last_fullsized":"2024-05-08T04:22:07.598470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599509+0000","last_change":"2024-05-08T04:22:07.599509+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599509+0000","last_undegraded":"2024-05-08T04:22:07.599509+0000","last_fullsized":"2024-05-08T04:22:07.599509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.603785+0000","last_change":"2024-05-08T04:22:07.603785+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.603785+0000","last_undegraded":"2024-05-08T04:22:07.603785+0000","last_fullsized":"2024-05-08T04:22:07.603785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601173+0000","last_change":"2024-05-08T04:22:07.601173+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601173+0000","last_undegraded":"2024-05-08T04:22:07.601173+0000","last_fullsized":"2024-05-08T04:22:07.601173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599562+0000","last_change":"2024-05-08T04:22:07.599562+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599562+0000","last_undegraded":"2024-05-08T04:22:07.599562+0000","last_fullsized":"2024-05-08T04:22:07.599562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599301+0000","last_change":"2024-05-08T04:22:07.599301+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599301+0000","last_undegraded":"2024-05-08T04:22:07.599301+0000","last_fullsized":"2024-05-08T04:22:07.599301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.603583+0000","last_change":"2024-05-08T04:22:07.603583+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.603583+0000","last_undegraded":"2024-05-08T04:22:07.603583+0000","last_fullsized":"2024-05-08T04:22:07.603583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598743+0000","last_change":"2024-05-08T04:22:07.598743+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598743+0000","last_undegraded":"2024-05-08T04:22:07.598743+0000","last_fullsized":"2024-05-08T04:22:07.598743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598229+0000","last_change":"2024-05-08T04:22:07.598229+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598229+0000","last_undegraded":"2024-05-08T04:22:07.598229+0000","last_fullsized":"2024-05-08T04:22:07.598229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602514+0000","last_change":"2024-05-08T04:22:07.602514+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602514+0000","last_undegraded":"2024-05-08T04:22:07.602514+0000","last_fullsized":"2024-05-08T04:22:07.602514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.595546+0000","last_change":"2024-05-08T04:22:07.595546+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.595546+0000","last_undegraded":"2024-05-08T04:22:07.595546+0000","last_fullsized":"2024-05-08T04:22:07.595546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.595104+0000","last_change":"2024-05-08T04:22:07.595104+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.595104+0000","last_undegraded":"2024-05-08T04:22:07.595104+0000","last_fullsized":"2024-05-08T04:22:07.595104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599209+0000","last_change":"2024-05-08T04:22:07.599209+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599209+0000","last_undegraded":"2024-05-08T04:22:07.599209+0000","last_fullsized":"2024-05-08T04:22:07.599209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598675+0000","last_change":"2024-05-08T04:22:07.598675+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598675+0000","last_undegraded":"2024-05-08T04:22:07.598675+0000","last_fullsized":"2024-05-08T04:22:07.598675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598001+0000","last_change":"2024-05-08T04:22:07.598001+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598001+0000","last_undegraded":"2024-05-08T04:22:07.598001+0000","last_fullsized":"2024-05-08T04:22:07.598001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598363+0000","last_change":"2024-05-08T04:22:07.598363+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598363+0000","last_undegraded":"2024-05-08T04:22:07.598363+0000","last_fullsized":"2024-05-08T04:22:07.598363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597568+0000","last_change":"2024-05-08T04:22:07.597568+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597568+0000","last_undegraded":"2024-05-08T04:22:07.597568+0000","last_fullsized":"2024-05-08T04:22:07.597568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.604025+0000","last_change":"2024-05-08T04:22:07.604025+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.604025+0000","last_undegraded":"2024-05-08T04:22:07.604025+0000","last_fullsized":"2024-05-08T04:22:07.604025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602968+0000","last_change":"2024-05-08T04:22:07.602968+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602968+0000","last_undegraded":"2024-05-08T04:22:07.602968+0000","last_fullsized":"2024-05-08T04:22:07.602968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591026+0000","last_change":"2024-05-08T04:22:07.591026+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591026+0000","last_undegraded":"2024-05-08T04:22:07.591026+0000","last_fullsized":"2024-05-08T04:22:07.591026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597363+0000","last_change":"2024-05-08T04:22:07.597363+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597363+0000","last_undegraded":"2024-05-08T04:22:07.597363+0000","last_fullsized":"2024-05-08T04:22:07.597363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598205+0000","last_change":"2024-05-08T04:22:07.598205+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598205+0000","last_undegraded":"2024-05-08T04:22:07.598205+0000","last_fullsized":"2024-05-08T04:22:07.598205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597388+0000","last_change":"2024-05-08T04:22:07.597388+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597388+0000","last_undegraded":"2024-05-08T04:22:07.597388+0000","last_fullsized":"2024-05-08T04:22:07.597388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597398+0000","last_change":"2024-05-08T04:22:07.597398+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597398+0000","last_undegraded":"2024-05-08T04:22:07.597398+0000","last_fullsized":"2024-05-08T04:22:07.597398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600951+0000","last_change":"2024-05-08T04:22:07.600951+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600951+0000","last_undegraded":"2024-05-08T04:22:07.600951+0000","last_fullsized":"2024-05-08T04:22:07.600951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597972+0000","last_change":"2024-05-08T04:22:07.597972+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597972+0000","last_undegraded":"2024-05-08T04:22:07.597972+0000","last_fullsized":"2024-05-08T04:22:07.597972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612424+0000","last_change":"2024-05-08T04:22:07.608133+0000","last_active":"2024-05-08T04:22:07.612424+0000","last_peered":"2024-05-08T04:22:07.612424+0000","last_clean":"2024-05-08T04:22:07.612424+0000","last_became_active":"2024-05-08T04:22:07.607766+0000","last_became_peered":"2024-05-08T04:22:07.607766+0000","last_unstale":"2024-05-08T04:22:07.612424+0000","last_undegraded":"2024-05-08T04:22:07.612424+0000","last_fullsized":"2024-05-08T04:22:07.612424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:34:51.573503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597651+0000","last_change":"2024-05-08T04:22:07.597651+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597651+0000","last_undegraded":"2024-05-08T04:22:07.597651+0000","last_fullsized":"2024-05-08T04:22:07.597651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614390+0000","last_change":"2024-05-08T04:22:07.610820+0000","last_active":"2024-05-08T04:22:07.614390+0000","last_peered":"2024-05-08T04:22:07.614390+0000","last_clean":"2024-05-08T04:22:07.614390+0000","last_became_active":"2024-05-08T04:22:07.610602+0000","last_became_peered":"2024-05-08T04:22:07.610602+0000","last_unstale":"2024-05-08T04:22:07.614390+0000","last_undegraded":"2024-05-08T04:22:07.614390+0000","last_fullsized":"2024-05-08T04:22:07.614390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:12:21.539620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596898+0000","last_change":"2024-05-08T04:22:07.596898+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596898+0000","last_undegraded":"2024-05-08T04:22:07.596898+0000","last_fullsized":"2024-05-08T04:22:07.596898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.608779+0000","last_change":"2024-05-08T04:22:07.606521+0000","last_active":"2024-05-08T04:22:07.608779+0000","last_peered":"2024-05-08T04:22:07.608779+0000","last_clean":"2024-05-08T04:22:07.608779+0000","last_became_active":"2024-05-08T04:22:07.606168+0000","last_became_peered":"2024-05-08T04:22:07.606168+0000","last_unstale":"2024-05-08T04:22:07.608779+0000","last_undegraded":"2024-05-08T04:22:07.608779+0000","last_fullsized":"2024-05-08T04:22:07.608779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:33.286349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601750+0000","last_change":"2024-05-08T04:22:07.601750+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601750+0000","last_undegraded":"2024-05-08T04:22:07.601750+0000","last_fullsized":"2024-05-08T04:22:07.601750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613977+0000","last_change":"2024-05-08T04:22:07.607498+0000","last_active":"2024-05-08T04:22:07.613977+0000","last_peered":"2024-05-08T04:22:07.613977+0000","last_clean":"2024-05-08T04:22:07.613977+0000","last_became_active":"2024-05-08T04:22:07.607217+0000","last_became_peered":"2024-05-08T04:22:07.607217+0000","last_unstale":"2024-05-08T04:22:07.613977+0000","last_undegraded":"2024-05-08T04:22:07.613977+0000","last_fullsized":"2024-05-08T04:22:07.613977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:37.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598452+0000","last_change":"2024-05-08T04:22:07.598452+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598452+0000","last_undegraded":"2024-05-08T04:22:07.598452+0000","last_fullsized":"2024-05-08T04:22:07.598452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610469+0000","last_change":"2024-05-08T04:22:07.606651+0000","last_active":"2024-05-08T04:22:07.610469+0000","last_peered":"2024-05-08T04:22:07.610469+0000","last_clean":"2024-05-08T04:22:07.610469+0000","last_became_active":"2024-05-08T04:22:07.606386+0000","last_became_peered":"2024-05-08T04:22:07.606386+0000","last_unstale":"2024-05-08T04:22:07.610469+0000","last_undegraded":"2024-05-08T04:22:07.610469+0000","last_fullsized":"2024-05-08T04:22:07.610469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:27:15.090679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596862+0000","last_change":"2024-05-08T04:22:07.596862+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596862+0000","last_undegraded":"2024-05-08T04:22:07.596862+0000","last_fullsized":"2024-05-08T04:22:07.596862+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610235+0000","last_change":"2024-05-08T04:22:07.605296+0000","last_active":"2024-05-08T04:22:07.610235+0000","last_peered":"2024-05-08T04:22:07.610235+0000","last_clean":"2024-05-08T04:22:07.610235+0000","last_became_active":"2024-05-08T04:22:07.605050+0000","last_became_peered":"2024-05-08T04:22:07.605050+0000","last_unstale":"2024-05-08T04:22:07.610235+0000","last_undegraded":"2024-05-08T04:22:07.610235+0000","last_fullsized":"2024-05-08T04:22:07.610235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:38:33.843667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597988+0000","last_change":"2024-05-08T04:22:07.597988+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597988+0000","last_undegraded":"2024-05-08T04:22:07.597988+0000","last_fullsized":"2024-05-08T04:22:07.597988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.608758+0000","last_change":"2024-05-08T04:22:07.606390+0000","last_active":"2024-05-08T04:22:07.608758+0000","last_peered":"2024-05-08T04:22:07.608758+0000","last_clean":"2024-05-08T04:22:07.608758+0000","last_became_active":"2024-05-08T04:22:07.606065+0000","last_became_peered":"2024-05-08T04:22:07.606065+0000","last_unstale":"2024-05-08T04:22:07.608758+0000","last_undegraded":"2024-05-08T04:22:07.608758+0000","last_fullsized":"2024-05-08T04:22:07.608758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:18.934495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601737+0000","last_change":"2024-05-08T04:22:07.601737+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601737+0000","last_undegraded":"2024-05-08T04:22:07.601737+0000","last_fullsized":"2024-05-08T04:22:07.601737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610272+0000","last_change":"2024-05-08T04:22:07.604688+0000","last_active":"2024-05-08T04:22:07.610272+0000","last_peered":"2024-05-08T04:22:07.610272+0000","last_clean":"2024-05-08T04:22:07.610272+0000","last_became_active":"2024-05-08T04:22:07.604437+0000","last_became_peered":"2024-05-08T04:22:07.604437+0000","last_unstale":"2024-05-08T04:22:07.610272+0000","last_undegraded":"2024-05-08T04:22:07.610272+0000","last_fullsized":"2024-05-08T04:22:07.610272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:35.814239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602087+0000","last_change":"2024-05-08T04:22:07.602087+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602087+0000","last_undegraded":"2024-05-08T04:22:07.602087+0000","last_fullsized":"2024-05-08T04:22:07.602087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.605419+0000","last_change":"2024-05-08T04:22:07.596652+0000","last_active":"2024-05-08T04:22:07.605419+0000","last_peered":"2024-05-08T04:22:07.605419+0000","last_clean":"2024-05-08T04:22:07.605419+0000","last_became_active":"2024-05-08T04:22:07.596330+0000","last_became_peered":"2024-05-08T04:22:07.596330+0000","last_unstale":"2024-05-08T04:22:07.605419+0000","last_undegraded":"2024-05-08T04:22:07.605419+0000","last_fullsized":"2024-05-08T04:22:07.605419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:09.248136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601843+0000","last_change":"2024-05-08T04:22:07.601843+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601843+0000","last_undegraded":"2024-05-08T04:22:07.601843+0000","last_fullsized":"2024-05-08T04:22:07.601843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.605466+0000","last_change":"2024-05-08T04:22:07.598633+0000","last_active":"2024-05-08T04:22:07.605466+0000","last_peered":"2024-05-08T04:22:07.605466+0000","last_clean":"2024-05-08T04:22:07.605466+0000","last_became_active":"2024-05-08T04:22:07.598319+0000","last_became_peered":"2024-05-08T04:22:07.598319+0000","last_unstale":"2024-05-08T04:22:07.605466+0000","last_undegraded":"2024-05-08T04:22:07.605466+0000","last_fullsized":"2024-05-08T04:22:07.605466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:39:07.152177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602159+0000","last_change":"2024-05-08T04:22:07.602159+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602159+0000","last_undegraded":"2024-05-08T04:22:07.602159+0000","last_fullsized":"2024-05-08T04:22:07.602159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.618257+0000","last_change":"2024-05-08T04:22:07.614017+0000","last_active":"2024-05-08T04:22:07.618257+0000","last_peered":"2024-05-08T04:22:07.618257+0000","last_clean":"2024-05-08T04:22:07.618257+0000","last_became_active":"2024-05-08T04:22:07.613730+0000","last_became_peered":"2024-05-08T04:22:07.613730+0000","last_unstale":"2024-05-08T04:22:07.618257+0000","last_undegraded":"2024-05-08T04:22:07.618257+0000","last_fullsized":"2024-05-08T04:22:07.618257+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:44:18.282843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601752+0000","last_change":"2024-05-08T04:22:07.601752+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601752+0000","last_undegraded":"2024-05-08T04:22:07.601752+0000","last_fullsized":"2024-05-08T04:22:07.601752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.607900+0000","last_change":"2024-05-08T04:22:07.604862+0000","last_active":"2024-05-08T04:22:07.607900+0000","last_peered":"2024-05-08T04:22:07.607900+0000","last_clean":"2024-05-08T04:22:07.607900+0000","last_became_active":"2024-05-08T04:22:07.604578+0000","last_became_peered":"2024-05-08T04:22:07.604578+0000","last_unstale":"2024-05-08T04:22:07.607900+0000","last_undegraded":"2024-05-08T04:22:07.607900+0000","last_fullsized":"2024-05-08T04:22:07.607900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:37.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598682+0000","last_change":"2024-05-08T04:22:07.598682+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598682+0000","last_undegraded":"2024-05-08T04:22:07.598682+0000","last_fullsized":"2024-05-08T04:22:07.598682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613349+0000","last_change":"2024-05-08T04:22:07.608202+0000","last_active":"2024-05-08T04:22:07.613349+0000","last_peered":"2024-05-08T04:22:07.613349+0000","last_clean":"2024-05-08T04:22:07.613349+0000","last_became_active":"2024-05-08T04:22:07.607933+0000","last_became_peered":"2024-05-08T04:22:07.607933+0000","last_unstale":"2024-05-08T04:22:07.613349+0000","last_undegraded":"2024-05-08T04:22:07.613349+0000","last_fullsized":"2024-05-08T04:22:07.613349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:19.196550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601201+0000","last_change":"2024-05-08T04:22:07.601201+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601201+0000","last_undegraded":"2024-05-08T04:22:07.601201+0000","last_fullsized":"2024-05-08T04:22:07.601201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614354+0000","last_change":"2024-05-08T04:22:07.610082+0000","last_active":"2024-05-08T04:22:07.614354+0000","last_peered":"2024-05-08T04:22:07.614354+0000","last_clean":"2024-05-08T04:22:07.614354+0000","last_became_active":"2024-05-08T04:22:07.609805+0000","last_became_peered":"2024-05-08T04:22:07.609805+0000","last_unstale":"2024-05-08T04:22:07.614354+0000","last_undegraded":"2024-05-08T04:22:07.614354+0000","last_fullsized":"2024-05-08T04:22:07.614354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:23.503181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596849+0000","last_change":"2024-05-08T04:22:07.596849+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596849+0000","last_undegraded":"2024-05-08T04:22:07.596849+0000","last_fullsized":"2024-05-08T04:22:07.596849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.616885+0000","last_change":"2024-05-08T04:22:07.613948+0000","last_active":"2024-05-08T04:22:07.616885+0000","last_peered":"2024-05-08T04:22:07.616885+0000","last_clean":"2024-05-08T04:22:07.616885+0000","last_became_active":"2024-05-08T04:22:07.613685+0000","last_became_peered":"2024-05-08T04:22:07.613685+0000","last_unstale":"2024-05-08T04:22:07.616885+0000","last_undegraded":"2024-05-08T04:22:07.616885+0000","last_fullsized":"2024-05-08T04:22:07.616885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:48:25.191717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600995+0000","last_change":"2024-05-08T04:22:07.600995+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600995+0000","last_undegraded":"2024-05-08T04:22:07.600995+0000","last_fullsized":"2024-05-08T04:22:07.600995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614140+0000","last_change":"2024-05-08T04:22:07.608520+0000","last_active":"2024-05-08T04:22:07.614140+0000","last_peered":"2024-05-08T04:22:07.614140+0000","last_clean":"2024-05-08T04:22:07.614140+0000","last_became_active":"2024-05-08T04:22:07.608215+0000","last_became_peered":"2024-05-08T04:22:07.608215+0000","last_unstale":"2024-05-08T04:22:07.614140+0000","last_undegraded":"2024-05-08T04:22:07.614140+0000","last_fullsized":"2024-05-08T04:22:07.614140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:30:41.000788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601645+0000","last_change":"2024-05-08T04:22:07.601645+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601645+0000","last_undegraded":"2024-05-08T04:22:07.601645+0000","last_fullsized":"2024-05-08T04:22:07.601645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.608708+0000","last_change":"2024-05-08T04:22:07.606016+0000","last_active":"2024-05-08T04:22:07.608708+0000","last_peered":"2024-05-08T04:22:07.608708+0000","last_clean":"2024-05-08T04:22:07.608708+0000","last_became_active":"2024-05-08T04:22:07.605696+0000","last_became_peered":"2024-05-08T04:22:07.605696+0000","last_unstale":"2024-05-08T04:22:07.608708+0000","last_undegraded":"2024-05-08T04:22:07.608708+0000","last_fullsized":"2024-05-08T04:22:07.608708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:57.965625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598911+0000","last_change":"2024-05-08T04:22:07.598911+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598911+0000","last_undegraded":"2024-05-08T04:22:07.598911+0000","last_fullsized":"2024-05-08T04:22:07.598911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613388+0000","last_change":"2024-05-08T04:22:07.608876+0000","last_active":"2024-05-08T04:22:07.613388+0000","last_peered":"2024-05-08T04:22:07.613388+0000","last_clean":"2024-05-08T04:22:07.613388+0000","last_became_active":"2024-05-08T04:22:07.607923+0000","last_became_peered":"2024-05-08T04:22:07.607923+0000","last_unstale":"2024-05-08T04:22:07.613388+0000","last_undegraded":"2024-05-08T04:22:07.613388+0000","last_fullsized":"2024-05-08T04:22:07.613388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:37.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591144+0000","last_change":"2024-05-08T04:22:07.591144+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591144+0000","last_undegraded":"2024-05-08T04:22:07.591144+0000","last_fullsized":"2024-05-08T04:22:07.591144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612388+0000","last_change":"2024-05-08T04:22:07.607881+0000","last_active":"2024-05-08T04:22:07.612388+0000","last_peered":"2024-05-08T04:22:07.612388+0000","last_clean":"2024-05-08T04:22:07.612388+0000","last_became_active":"2024-05-08T04:22:07.607596+0000","last_became_peered":"2024-05-08T04:22:07.607596+0000","last_unstale":"2024-05-08T04:22:07.612388+0000","last_undegraded":"2024-05-08T04:22:07.612388+0000","last_fullsized":"2024-05-08T04:22:07.612388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:31:16.484162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.594609+0000","last_change":"2024-05-08T04:22:07.594609+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.594609+0000","last_undegraded":"2024-05-08T04:22:07.594609+0000","last_fullsized":"2024-05-08T04:22:07.594609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613403+0000","last_change":"2024-05-08T04:22:07.606217+0000","last_active":"2024-05-08T04:22:07.613403+0000","last_peered":"2024-05-08T04:22:07.613403+0000","last_clean":"2024-05-08T04:22:07.613403+0000","last_became_active":"2024-05-08T04:22:07.605718+0000","last_became_peered":"2024-05-08T04:22:07.605718+0000","last_unstale":"2024-05-08T04:22:07.613403+0000","last_undegraded":"2024-05-08T04:22:07.613403+0000","last_fullsized":"2024-05-08T04:22:07.613403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:39:07.152177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598204+0000","last_change":"2024-05-08T04:22:07.598204+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598204+0000","last_undegraded":"2024-05-08T04:22:07.598204+0000","last_fullsized":"2024-05-08T04:22:07.598204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.606221+0000","last_change":"2024-05-08T04:22:07.604104+0000","last_active":"2024-05-08T04:22:07.606221+0000","last_peered":"2024-05-08T04:22:07.606221+0000","last_clean":"2024-05-08T04:22:07.606221+0000","last_became_active":"2024-05-08T04:22:07.603790+0000","last_became_peered":"2024-05-08T04:22:07.603790+0000","last_unstale":"2024-05-08T04:22:07.606221+0000","last_undegraded":"2024-05-08T04:22:07.606221+0000","last_fullsized":"2024-05-08T04:22:07.606221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:41.097192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591573+0000","last_change":"2024-05-08T04:22:07.591573+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591573+0000","last_undegraded":"2024-05-08T04:22:07.591573+0000","last_fullsized":"2024-05-08T04:22:07.591573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613415+0000","last_change":"2024-05-08T04:22:07.609907+0000","last_active":"2024-05-08T04:22:07.613415+0000","last_peered":"2024-05-08T04:22:07.613415+0000","last_clean":"2024-05-08T04:22:07.613415+0000","last_became_active":"2024-05-08T04:22:07.609656+0000","last_became_peered":"2024-05-08T04:22:07.609656+0000","last_unstale":"2024-05-08T04:22:07.613415+0000","last_undegraded":"2024-05-08T04:22:07.613415+0000","last_fullsized":"2024-05-08T04:22:07.613415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:23.503181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597335+0000","last_change":"2024-05-08T04:22:07.597335+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597335+0000","last_undegraded":"2024-05-08T04:22:07.597335+0000","last_fullsized":"2024-05-08T04:22:07.597335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610267+0000","last_change":"2024-05-08T04:22:07.606077+0000","last_active":"2024-05-08T04:22:07.610267+0000","last_peered":"2024-05-08T04:22:07.610267+0000","last_clean":"2024-05-08T04:22:07.610267+0000","last_became_active":"2024-05-08T04:22:07.605826+0000","last_became_peered":"2024-05-08T04:22:07.605826+0000","last_unstale":"2024-05-08T04:22:07.610267+0000","last_undegraded":"2024-05-08T04:22:07.610267+0000","last_fullsized":"2024-05-08T04:22:07.610267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:30:41.000788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597115+0000","last_change":"2024-05-08T04:22:07.597115+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597115+0000","last_undegraded":"2024-05-08T04:22:07.597115+0000","last_fullsized":"2024-05-08T04:22:07.597115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612748+0000","last_change":"2024-05-08T04:22:07.609551+0000","last_active":"2024-05-08T04:22:07.612748+0000","last_peered":"2024-05-08T04:22:07.612748+0000","last_clean":"2024-05-08T04:22:07.612748+0000","last_became_active":"2024-05-08T04:22:07.609262+0000","last_became_peered":"2024-05-08T04:22:07.609262+0000","last_unstale":"2024-05-08T04:22:07.612748+0000","last_undegraded":"2024-05-08T04:22:07.612748+0000","last_fullsized":"2024-05-08T04:22:07.612748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:00.284324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.595079+0000","last_change":"2024-05-08T04:22:07.595079+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.595079+0000","last_undegraded":"2024-05-08T04:22:07.595079+0000","last_fullsized":"2024-05-08T04:22:07.595079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.607715+0000","last_change":"2024-05-08T04:22:07.602513+0000","last_active":"2024-05-08T04:22:07.607715+0000","last_peered":"2024-05-08T04:22:07.607715+0000","last_clean":"2024-05-08T04:22:07.607715+0000","last_became_active":"2024-05-08T04:22:07.601926+0000","last_became_peered":"2024-05-08T04:22:07.601926+0000","last_unstale":"2024-05-08T04:22:07.607715+0000","last_undegraded":"2024-05-08T04:22:07.607715+0000","last_fullsized":"2024-05-08T04:22:07.607715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:19.196550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600899+0000","last_change":"2024-05-08T04:22:07.600899+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600899+0000","last_undegraded":"2024-05-08T04:22:07.600899+0000","last_fullsized":"2024-05-08T04:22:07.600899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.605487+0000","last_change":"2024-05-08T04:22:07.599148+0000","last_active":"2024-05-08T04:22:07.605487+0000","last_peered":"2024-05-08T04:22:07.605487+0000","last_clean":"2024-05-08T04:22:07.605487+0000","last_became_active":"2024-05-08T04:22:07.598845+0000","last_became_peered":"2024-05-08T04:22:07.598845+0000","last_unstale":"2024-05-08T04:22:07.605487+0000","last_undegraded":"2024-05-08T04:22:07.605487+0000","last_fullsized":"2024-05-08T04:22:07.605487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:25:46.596230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.593974+0000","last_change":"2024-05-08T04:22:07.593974+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.593974+0000","last_undegraded":"2024-05-08T04:22:07.593974+0000","last_fullsized":"2024-05-08T04:22:07.593974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613913+0000","last_change":"2024-05-08T04:22:07.607364+0000","last_active":"2024-05-08T04:22:07.613913+0000","last_peered":"2024-05-08T04:22:07.613913+0000","last_clean":"2024-05-08T04:22:07.613913+0000","last_became_active":"2024-05-08T04:22:07.607023+0000","last_became_peered":"2024-05-08T04:22:07.607023+0000","last_unstale":"2024-05-08T04:22:07.613913+0000","last_undegraded":"2024-05-08T04:22:07.613913+0000","last_fullsized":"2024-05-08T04:22:07.613913+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:23.503181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596759+0000","last_change":"2024-05-08T04:22:07.596759+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596759+0000","last_undegraded":"2024-05-08T04:22:07.596759+0000","last_fullsized":"2024-05-08T04:22:07.596759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.607787+0000","last_change":"2024-05-08T04:22:07.602890+0000","last_active":"2024-05-08T04:22:07.607787+0000","last_peered":"2024-05-08T04:22:07.607787+0000","last_clean":"2024-05-08T04:22:07.607787+0000","last_became_active":"2024-05-08T04:22:07.602498+0000","last_became_peered":"2024-05-08T04:22:07.602498+0000","last_unstale":"2024-05-08T04:22:07.607787+0000","last_undegraded":"2024-05-08T04:22:07.607787+0000","last_fullsized":"2024-05-08T04:22:07.607787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:43.886509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600256+0000","last_change":"2024-05-08T04:22:07.600256+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600256+0000","last_undegraded":"2024-05-08T04:22:07.600256+0000","last_fullsized":"2024-05-08T04:22:07.600256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614329+0000","last_change":"2024-05-08T04:22:07.609908+0000","last_active":"2024-05-08T04:22:07.614329+0000","last_peered":"2024-05-08T04:22:07.614329+0000","last_clean":"2024-05-08T04:22:07.614329+0000","last_became_active":"2024-05-08T04:22:07.609669+0000","last_became_peered":"2024-05-08T04:22:07.609669+0000","last_unstale":"2024-05-08T04:22:07.614329+0000","last_undegraded":"2024-05-08T04:22:07.614329+0000","last_fullsized":"2024-05-08T04:22:07.614329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:28.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598788+0000","last_change":"2024-05-08T04:22:07.598788+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598788+0000","last_undegraded":"2024-05-08T04:22:07.598788+0000","last_fullsized":"2024-05-08T04:22:07.598788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613387+0000","last_change":"2024-05-08T04:22:07.608739+0000","last_active":"2024-05-08T04:22:07.613387+0000","last_peered":"2024-05-08T04:22:07.613387+0000","last_clean":"2024-05-08T04:22:07.613387+0000","last_became_active":"2024-05-08T04:22:07.608391+0000","last_became_peered":"2024-05-08T04:22:07.608391+0000","last_unstale":"2024-05-08T04:22:07.613387+0000","last_undegraded":"2024-05-08T04:22:07.613387+0000","last_fullsized":"2024-05-08T04:22:07.613387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:43.886509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600514+0000","last_change":"2024-05-08T04:22:07.600514+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600514+0000","last_undegraded":"2024-05-08T04:22:07.600514+0000","last_fullsized":"2024-05-08T04:22:07.600514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614386+0000","last_change":"2024-05-08T04:22:07.610730+0000","last_active":"2024-05-08T04:22:07.614386+0000","last_peered":"2024-05-08T04:22:07.614386+0000","last_clean":"2024-05-08T04:22:07.614386+0000","last_became_active":"2024-05-08T04:22:07.610527+0000","last_became_peered":"2024-05-08T04:22:07.610527+0000","last_unstale":"2024-05-08T04:22:07.614386+0000","last_undegraded":"2024-05-08T04:22:07.614386+0000","last_fullsized":"2024-05-08T04:22:07.614386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:28.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596752+0000","last_change":"2024-05-08T04:22:07.596752+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596752+0000","last_undegraded":"2024-05-08T04:22:07.596752+0000","last_fullsized":"2024-05-08T04:22:07.596752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612816+0000","last_change":"2024-05-08T04:22:07.611008+0000","last_active":"2024-05-08T04:22:07.612816+0000","last_peered":"2024-05-08T04:22:07.612816+0000","last_clean":"2024-05-08T04:22:07.612816+0000","last_became_active":"2024-05-08T04:22:07.610754+0000","last_became_peered":"2024-05-08T04:22:07.610754+0000","last_unstale":"2024-05-08T04:22:07.612816+0000","last_undegraded":"2024-05-08T04:22:07.612816+0000","last_fullsized":"2024-05-08T04:22:07.612816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:25:28.841648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.593372+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:22:07.593372+0000","last_peered":"2024-05-08T04:22:07.593372+0000","last_clean":"2024-05-08T04:22:07.593372+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:22:07.593372+0000","last_undegraded":"2024-05-08T04:22:07.593372+0000","last_fullsized":"2024-05-08T04:22:07.593372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:22:11.893 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:22:12.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.028+0000 7f7678d1d640 1 Processor -- start 2024-05-08T04:22:12.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.028+0000 7f7678d1d640 1 -- start start 2024-05-08T04:22:12.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7678d1d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7674159ec0 0x7f767406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7678d1d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767415dce0 con 0x7f767415a2a0 2024-05-08T04:22:12.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7678d1d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767406eb60 con 0x7f7674072160 2024-05-08T04:22:12.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7678d1d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767406ee40 con 0x7f7674159ec0 2024-05-08T04:22:12.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7669d9b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f767415a2a0 0x7f7674071a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41232/0 (socket says 172.21.15.104:41232) 2024-05-08T04:22:12.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7669d9b640 1 -- 172.21.15.104:0/7372652 learned_addr learned my addr 172.21.15.104:0/7372652 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:12.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f767259c640 1 --2- 172.21.15.104:0/7372652 >> v2:172.21.15.183:3300/0 conn(0x7f7674159ec0 0x7f767406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837277867 0 0) 0x7f767415dce0 con 0x7f767415a2a0 2024-05-08T04:22:12.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7660003440 con 0x7f767415a2a0 2024-05-08T04:22:12.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4219532305 0 0) 0x7f7660003440 con 0x7f767415a2a0 2024-05-08T04:22:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 >> v2:172.21.15.183:3300/0 conn(0x7f7674159ec0 msgr2=0x7f767406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 --2- 172.21.15.104:0/7372652 >> v2:172.21.15.183:3300/0 conn(0x7f7674159ec0 0x7f767406e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 >> v1:172.21.15.183:6789/0 conn(0x7f7674072160 legacy=0x7f76740b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767415df80 con 0x7f767415a2a0 2024-05-08T04:22:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f765c001670 con 0x7f767415a2a0 2024-05-08T04:22:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 >> v1:172.21.15.104:6789/0 conn(0x7f767415a2a0 legacy=0x7f7674071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 --2- 172.21.15.104:0/7372652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7660003af0 0x7f7660003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 --2- 172.21.15.104:0/7372652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76600088a0 0x7f766000ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 --2- 172.21.15.104:0/7372652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f766000b510 0x7f766000d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767406ee40 con 0x7f7660003af0 2024-05-08T04:22:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766000e2b0 con 0x7f76600088a0 2024-05-08T04:22:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766000e4b0 con 0x7f766000b510 2024-05-08T04:22:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.029+0000 7f767259c640 1 --2- 172.21.15.104:0/7372652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7660003af0 0x7f7660003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.030+0000 7f7669d9b640 1 --2- 172.21.15.104:0/7372652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76600088a0 0x7f766000ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.030+0000 7f7672d9d640 1 --2- 172.21.15.104:0/7372652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f766000b510 0x7f766000d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.030+0000 7f767259c640 1 -- 172.21.15.104:0/7372652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f766000b510 msgr2=0x7f766000d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.030+0000 7f767259c640 1 --2- 172.21.15.104:0/7372652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f766000b510 0x7f766000d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.030+0000 7f767259c640 1 -- 172.21.15.104:0/7372652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76600088a0 msgr2=0x7f766000ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.030+0000 7f767259c640 1 --2- 172.21.15.104:0/7372652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76600088a0 0x7f766000ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.030+0000 7f7672d9d640 1 -- 172.21.15.104:0/7372652 reap_dead start 2024-05-08T04:22:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.030+0000 7f767259c640 1 -- 172.21.15.104:0/7372652 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7660003440 con 0x7f7660003af0 2024-05-08T04:22:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.030+0000 7f7669d9b640 1 --2- 172.21.15.104:0/7372652 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76600088a0 0x7f766000ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.030+0000 7f767259c640 1 --2- 172.21.15.104:0/7372652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7660003af0 0x7f7660003f10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7664009ac0 tx=0x7f7660003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c61d00561ebe61 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.030+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7664036070 con 0x7f7660003af0 2024-05-08T04:22:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.030+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7664031400 con 0x7f7660003af0 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.031+0000 7f7671d9b640 1 -- 172.21.15.104:0/7372652 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7664009690 con 0x7f7660003af0 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.031+0000 7f7678d1d640 1 -- 172.21.15.104:0/7372652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7660003af0 msgr2=0x7f7660003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.031+0000 7f7678d1d640 1 --2- 172.21.15.104:0/7372652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7660003af0 0x7f7660003f10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7664009ac0 tx=0x7f7660003730 comp rx=0 tx=0).stop 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.031+0000 7f7678d1d640 1 -- 172.21.15.104:0/7372652 shutdown_connections 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.031+0000 7f7678d1d640 1 --2- 172.21.15.104:0/7372652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7660003af0 0x7f7660003f10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.031+0000 7f7678d1d640 1 -- 172.21.15.104:0/7372652 >> 172.21.15.104:0/7372652 conn(0x7f76740b13f0 msgr2=0x7f76740b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.031+0000 7f7678d1d640 1 -- 172.21.15.104:0/7372652 shutdown_connections 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.031+0000 7f7678d1d640 1 -- 172.21.15.104:0/7372652 wait complete. 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.032+0000 7f7678d1d640 1 Processor -- start 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.033+0000 7f7678d1d640 1 -- start start 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.033+0000 7f7678d1d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7660003af0 0x7f7674151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.033+0000 7f7678d1d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f767415cbc0 0x7f76740b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.033+0000 7f7678d1d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f767415d040 0x7f76740b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.033+0000 7f7678d1d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767406e650 con 0x7f767415cbc0 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.033+0000 7f7678d1d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767406e4d0 con 0x7f767415d040 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.033+0000 7f7678d1d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767406e7d0 con 0x7f7660003af0 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.033+0000 7f7669d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f767415cbc0 0x7f76740b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.033+0000 7f7669d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f767415cbc0 0x7f76740b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49920/0 (socket says 172.21.15.104:49920) 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.033+0000 7f7669d9b640 1 -- 172.21.15.104:0/1146409751 learned_addr learned my addr 172.21.15.104:0/1146409751 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.033+0000 7f767259c640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7660003af0 0x7f7674151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.033+0000 7f7672d9d640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f767415d040 0x7f76740b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.034+0000 7f7669d9b640 1 -- 172.21.15.104:0/1146409751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7660003af0 msgr2=0x7f7674151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.034+0000 7f7669d9b640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7660003af0 0x7f7674151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.034+0000 7f7669d9b640 1 -- 172.21.15.104:0/1146409751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f767415d040 msgr2=0x7f76740b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.034+0000 7f7669d9b640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f767415d040 0x7f76740b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.034+0000 7f7669d9b640 1 -- 172.21.15.104:0/1146409751 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76741f2d30 con 0x7f767415cbc0 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.034+0000 7f7672d9d640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f767415d040 0x7f76740b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.034+0000 7f767259c640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7660003af0 0x7f7674151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:12.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.034+0000 7f7669d9b640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f767415cbc0 0x7f76740b3340 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f765c00e780 tx=0x7f765c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.034+0000 7f766b7fe640 1 -- 172.21.15.104:0/1146409751 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c00ee30 con 0x7f767415cbc0 2024-05-08T04:22:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.034+0000 7f766b7fe640 1 -- 172.21.15.104:0/1146409751 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c018070 con 0x7f767415cbc0 2024-05-08T04:22:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.034+0000 7f7678d1d640 1 -- 172.21.15.104:0/1146409751 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76741f3010 con 0x7f767415cbc0 2024-05-08T04:22:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.034+0000 7f766b7fe640 1 -- 172.21.15.104:0/1146409751 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c00ca70 con 0x7f767415cbc0 2024-05-08T04:22:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.034+0000 7f7678d1d640 1 -- 172.21.15.104:0/1146409751 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76741f35d0 con 0x7f767415cbc0 2024-05-08T04:22:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.035+0000 7f7678d1d640 1 -- 172.21.15.104:0/1146409751 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7674075010 con 0x7f767415cbc0 2024-05-08T04:22:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.035+0000 7f766b7fe640 1 -- 172.21.15.104:0/1146409751 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f765c00cc10 con 0x7f767415cbc0 2024-05-08T04:22:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.036+0000 7f766b7fe640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f765406b4d0 0x7f765406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.036+0000 7f766b7fe640 1 -- 172.21.15.104:0/1146409751 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f765c089f80 con 0x7f767415cbc0 2024-05-08T04:22:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.036+0000 7f767259c640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f765406b4d0 0x7f765406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.036+0000 7f767259c640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f765406b4d0 0x7f765406d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7664033000 tx=0x7f7664008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.040+0000 7f766b7fe640 1 -- 172.21.15.104:0/1146409751 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f765c058e00 con 0x7f767415cbc0 2024-05-08T04:22:12.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.206+0000 7f7678d1d640 1 -- 172.21.15.104:0/1146409751 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76740b11d0 con 0x7f765406b4d0 2024-05-08T04:22:12.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.211+0000 7f766b7fe640 1 -- 172.21.15.104:0/1146409751 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246634 (secure 0 0 0) 0x7f76740b11d0 con 0x7f765406b4d0 2024-05-08T04:22:12.216 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:12.217 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:22:12.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.214+0000 7f7678d1d640 1 -- 172.21.15.104:0/1146409751 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f765406b4d0 msgr2=0x7f765406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.214+0000 7f7678d1d640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f765406b4d0 0x7f765406d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7664033000 tx=0x7f7664008030 comp rx=0 tx=0).stop 2024-05-08T04:22:12.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.214+0000 7f7678d1d640 1 -- 172.21.15.104:0/1146409751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f767415cbc0 msgr2=0x7f76740b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.214+0000 7f7678d1d640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f767415cbc0 0x7f76740b3340 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f765c00e780 tx=0x7f765c00ec40 comp rx=0 tx=0).stop 2024-05-08T04:22:12.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.214+0000 7f7678d1d640 1 -- 172.21.15.104:0/1146409751 shutdown_connections 2024-05-08T04:22:12.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.214+0000 7f7678d1d640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f765406b4d0 0x7f765406d990 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.214+0000 7f7678d1d640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f767415d040 0x7f76740b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.214+0000 7f7678d1d640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f767415cbc0 0x7f76740b3340 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.214+0000 7f7678d1d640 1 --2- 172.21.15.104:0/1146409751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7660003af0 0x7f7674151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.214+0000 7f7678d1d640 1 -- 172.21.15.104:0/1146409751 >> 172.21.15.104:0/1146409751 conn(0x7f76740b13f0 msgr2=0x7f767406d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:12.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.214+0000 7f7678d1d640 1 -- 172.21.15.104:0/1146409751 shutdown_connections 2024-05-08T04:22:12.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.214+0000 7f7678d1d640 1 -- 172.21.15.104:0/1146409751 wait complete. 2024-05-08T04:22:12.227 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-05-08T04:22:10.648179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219944,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3874816,"data_stored":2194912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.064477"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598877+0000","last_change":"2024-05-08T04:22:07.598877+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598877+0000","last_undegraded":"2024-05-08T04:22:07.598877+0000","last_fullsized":"2024-05-08T04:22:07.598877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591580+0000","last_change":"2024-05-08T04:22:07.591580+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591580+0000","last_undegraded":"2024-05-08T04:22:07.591580+0000","last_fullsized":"2024-05-08T04:22:07.591580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599870+0000","last_change":"2024-05-08T04:22:07.599870+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599870+0000","last_undegraded":"2024-05-08T04:22:07.599870+0000","last_fullsized":"2024-05-08T04:22:07.599870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.603655+0000","last_change":"2024-05-08T04:22:07.603655+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.603655+0000","last_undegraded":"2024-05-08T04:22:07.603655+0000","last_fullsized":"2024-05-08T04:22:07.603655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.592100+0000","last_change":"2024-05-08T04:22:07.592100+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.592100+0000","last_undegraded":"2024-05-08T04:22:07.592100+0000","last_fullsized":"2024-05-08T04:22:07.592100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.593923+0000","last_change":"2024-05-08T04:22:07.593923+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.593923+0000","last_undegraded":"2024-05-08T04:22:07.593923+0000","last_fullsized":"2024-05-08T04:22:07.593923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598863+0000","last_change":"2024-05-08T04:22:07.598863+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598863+0000","last_undegraded":"2024-05-08T04:22:07.598863+0000","last_fullsized":"2024-05-08T04:22:07.598863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598470+0000","last_change":"2024-05-08T04:22:07.598470+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598470+0000","last_undegraded":"2024-05-08T04:22:07.598470+0000","last_fullsized":"2024-05-08T04:22:07.598470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599509+0000","last_change":"2024-05-08T04:22:07.599509+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599509+0000","last_undegraded":"2024-05-08T04:22:07.599509+0000","last_fullsized":"2024-05-08T04:22:07.599509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.603785+0000","last_change":"2024-05-08T04:22:07.603785+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.603785+0000","last_undegraded":"2024-05-08T04:22:07.603785+0000","last_fullsized":"2024-05-08T04:22:07.603785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601173+0000","last_change":"2024-05-08T04:22:07.601173+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601173+0000","last_undegraded":"2024-05-08T04:22:07.601173+0000","last_fullsized":"2024-05-08T04:22:07.601173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599562+0000","last_change":"2024-05-08T04:22:07.599562+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599562+0000","last_undegraded":"2024-05-08T04:22:07.599562+0000","last_fullsized":"2024-05-08T04:22:07.599562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599301+0000","last_change":"2024-05-08T04:22:07.599301+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599301+0000","last_undegraded":"2024-05-08T04:22:07.599301+0000","last_fullsized":"2024-05-08T04:22:07.599301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.603583+0000","last_change":"2024-05-08T04:22:07.603583+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.603583+0000","last_undegraded":"2024-05-08T04:22:07.603583+0000","last_fullsized":"2024-05-08T04:22:07.603583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598743+0000","last_change":"2024-05-08T04:22:07.598743+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598743+0000","last_undegraded":"2024-05-08T04:22:07.598743+0000","last_fullsized":"2024-05-08T04:22:07.598743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598229+0000","last_change":"2024-05-08T04:22:07.598229+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598229+0000","last_undegraded":"2024-05-08T04:22:07.598229+0000","last_fullsized":"2024-05-08T04:22:07.598229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602514+0000","last_change":"2024-05-08T04:22:07.602514+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602514+0000","last_undegraded":"2024-05-08T04:22:07.602514+0000","last_fullsized":"2024-05-08T04:22:07.602514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.595546+0000","last_change":"2024-05-08T04:22:07.595546+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.595546+0000","last_undegraded":"2024-05-08T04:22:07.595546+0000","last_fullsized":"2024-05-08T04:22:07.595546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.595104+0000","last_change":"2024-05-08T04:22:07.595104+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.595104+0000","last_undegraded":"2024-05-08T04:22:07.595104+0000","last_fullsized":"2024-05-08T04:22:07.595104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599209+0000","last_change":"2024-05-08T04:22:07.599209+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599209+0000","last_undegraded":"2024-05-08T04:22:07.599209+0000","last_fullsized":"2024-05-08T04:22:07.599209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598675+0000","last_change":"2024-05-08T04:22:07.598675+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598675+0000","last_undegraded":"2024-05-08T04:22:07.598675+0000","last_fullsized":"2024-05-08T04:22:07.598675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598001+0000","last_change":"2024-05-08T04:22:07.598001+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598001+0000","last_undegraded":"2024-05-08T04:22:07.598001+0000","last_fullsized":"2024-05-08T04:22:07.598001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598363+0000","last_change":"2024-05-08T04:22:07.598363+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598363+0000","last_undegraded":"2024-05-08T04:22:07.598363+0000","last_fullsized":"2024-05-08T04:22:07.598363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597568+0000","last_change":"2024-05-08T04:22:07.597568+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597568+0000","last_undegraded":"2024-05-08T04:22:07.597568+0000","last_fullsized":"2024-05-08T04:22:07.597568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.604025+0000","last_change":"2024-05-08T04:22:07.604025+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.604025+0000","last_undegraded":"2024-05-08T04:22:07.604025+0000","last_fullsized":"2024-05-08T04:22:07.604025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602968+0000","last_change":"2024-05-08T04:22:07.602968+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602968+0000","last_undegraded":"2024-05-08T04:22:07.602968+0000","last_fullsized":"2024-05-08T04:22:07.602968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591026+0000","last_change":"2024-05-08T04:22:07.591026+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591026+0000","last_undegraded":"2024-05-08T04:22:07.591026+0000","last_fullsized":"2024-05-08T04:22:07.591026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597363+0000","last_change":"2024-05-08T04:22:07.597363+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597363+0000","last_undegraded":"2024-05-08T04:22:07.597363+0000","last_fullsized":"2024-05-08T04:22:07.597363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598205+0000","last_change":"2024-05-08T04:22:07.598205+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598205+0000","last_undegraded":"2024-05-08T04:22:07.598205+0000","last_fullsized":"2024-05-08T04:22:07.598205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597388+0000","last_change":"2024-05-08T04:22:07.597388+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597388+0000","last_undegraded":"2024-05-08T04:22:07.597388+0000","last_fullsized":"2024-05-08T04:22:07.597388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597398+0000","last_change":"2024-05-08T04:22:07.597398+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597398+0000","last_undegraded":"2024-05-08T04:22:07.597398+0000","last_fullsized":"2024-05-08T04:22:07.597398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600951+0000","last_change":"2024-05-08T04:22:07.600951+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600951+0000","last_undegraded":"2024-05-08T04:22:07.600951+0000","last_fullsized":"2024-05-08T04:22:07.600951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597972+0000","last_change":"2024-05-08T04:22:07.597972+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597972+0000","last_undegraded":"2024-05-08T04:22:07.597972+0000","last_fullsized":"2024-05-08T04:22:07.597972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612424+0000","last_change":"2024-05-08T04:22:07.608133+0000","last_active":"2024-05-08T04:22:07.612424+0000","last_peered":"2024-05-08T04:22:07.612424+0000","last_clean":"2024-05-08T04:22:07.612424+0000","last_became_active":"2024-05-08T04:22:07.607766+0000","last_became_peered":"2024-05-08T04:22:07.607766+0000","last_unstale":"2024-05-08T04:22:07.612424+0000","last_undegraded":"2024-05-08T04:22:07.612424+0000","last_fullsized":"2024-05-08T04:22:07.612424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:34:51.573503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597651+0000","last_change":"2024-05-08T04:22:07.597651+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597651+0000","last_undegraded":"2024-05-08T04:22:07.597651+0000","last_fullsized":"2024-05-08T04:22:07.597651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614390+0000","last_change":"2024-05-08T04:22:07.610820+0000","last_active":"2024-05-08T04:22:07.614390+0000","last_peered":"2024-05-08T04:22:07.614390+0000","last_clean":"2024-05-08T04:22:07.614390+0000","last_became_active":"2024-05-08T04:22:07.610602+0000","last_became_peered":"2024-05-08T04:22:07.610602+0000","last_unstale":"2024-05-08T04:22:07.614390+0000","last_undegraded":"2024-05-08T04:22:07.614390+0000","last_fullsized":"2024-05-08T04:22:07.614390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:12:21.539620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596898+0000","last_change":"2024-05-08T04:22:07.596898+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596898+0000","last_undegraded":"2024-05-08T04:22:07.596898+0000","last_fullsized":"2024-05-08T04:22:07.596898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.608779+0000","last_change":"2024-05-08T04:22:07.606521+0000","last_active":"2024-05-08T04:22:07.608779+0000","last_peered":"2024-05-08T04:22:07.608779+0000","last_clean":"2024-05-08T04:22:07.608779+0000","last_became_active":"2024-05-08T04:22:07.606168+0000","last_became_peered":"2024-05-08T04:22:07.606168+0000","last_unstale":"2024-05-08T04:22:07.608779+0000","last_undegraded":"2024-05-08T04:22:07.608779+0000","last_fullsized":"2024-05-08T04:22:07.608779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:33.286349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601750+0000","last_change":"2024-05-08T04:22:07.601750+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601750+0000","last_undegraded":"2024-05-08T04:22:07.601750+0000","last_fullsized":"2024-05-08T04:22:07.601750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613977+0000","last_change":"2024-05-08T04:22:07.607498+0000","last_active":"2024-05-08T04:22:07.613977+0000","last_peered":"2024-05-08T04:22:07.613977+0000","last_clean":"2024-05-08T04:22:07.613977+0000","last_became_active":"2024-05-08T04:22:07.607217+0000","last_became_peered":"2024-05-08T04:22:07.607217+0000","last_unstale":"2024-05-08T04:22:07.613977+0000","last_undegraded":"2024-05-08T04:22:07.613977+0000","last_fullsized":"2024-05-08T04:22:07.613977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:37.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598452+0000","last_change":"2024-05-08T04:22:07.598452+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598452+0000","last_undegraded":"2024-05-08T04:22:07.598452+0000","last_fullsized":"2024-05-08T04:22:07.598452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610469+0000","last_change":"2024-05-08T04:22:07.606651+0000","last_active":"2024-05-08T04:22:07.610469+0000","last_peered":"2024-05-08T04:22:07.610469+0000","last_clean":"2024-05-08T04:22:07.610469+0000","last_became_active":"2024-05-08T04:22:07.606386+0000","last_became_peered":"2024-05-08T04:22:07.606386+0000","last_unstale":"2024-05-08T04:22:07.610469+0000","last_undegraded":"2024-05-08T04:22:07.610469+0000","last_fullsized":"2024-05-08T04:22:07.610469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:27:15.090679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596862+0000","last_change":"2024-05-08T04:22:07.596862+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596862+0000","last_undegraded":"2024-05-08T04:22:07.596862+0000","last_fullsized":"2024-05-08T04:22:07.596862+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610235+0000","last_change":"2024-05-08T04:22:07.605296+0000","last_active":"2024-05-08T04:22:07.610235+0000","last_peered":"2024-05-08T04:22:07.610235+0000","last_clean":"2024-05-08T04:22:07.610235+0000","last_became_active":"2024-05-08T04:22:07.605050+0000","last_became_peered":"2024-05-08T04:22:07.605050+0000","last_unstale":"2024-05-08T04:22:07.610235+0000","last_undegraded":"2024-05-08T04:22:07.610235+0000","last_fullsized":"2024-05-08T04:22:07.610235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:38:33.843667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597988+0000","last_change":"2024-05-08T04:22:07.597988+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597988+0000","last_undegraded":"2024-05-08T04:22:07.597988+0000","last_fullsized":"2024-05-08T04:22:07.597988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.608758+0000","last_change":"2024-05-08T04:22:07.606390+0000","last_active":"2024-05-08T04:22:07.608758+0000","last_peered":"2024-05-08T04:22:07.608758+0000","last_clean":"2024-05-08T04:22:07.608758+0000","last_became_active":"2024-05-08T04:22:07.606065+0000","last_became_peered":"2024-05-08T04:22:07.606065+0000","last_unstale":"2024-05-08T04:22:07.608758+0000","last_undegraded":"2024-05-08T04:22:07.608758+0000","last_fullsized":"2024-05-08T04:22:07.608758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:18.934495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601737+0000","last_change":"2024-05-08T04:22:07.601737+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601737+0000","last_undegraded":"2024-05-08T04:22:07.601737+0000","last_fullsized":"2024-05-08T04:22:07.601737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610272+0000","last_change":"2024-05-08T04:22:07.604688+0000","last_active":"2024-05-08T04:22:07.610272+0000","last_peered":"2024-05-08T04:22:07.610272+0000","last_clean":"2024-05-08T04:22:07.610272+0000","last_became_active":"2024-05-08T04:22:07.604437+0000","last_became_peered":"2024-05-08T04:22:07.604437+0000","last_unstale":"2024-05-08T04:22:07.610272+0000","last_undegraded":"2024-05-08T04:22:07.610272+0000","last_fullsized":"2024-05-08T04:22:07.610272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:35.814239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602087+0000","last_change":"2024-05-08T04:22:07.602087+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602087+0000","last_undegraded":"2024-05-08T04:22:07.602087+0000","last_fullsized":"2024-05-08T04:22:07.602087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.605419+0000","last_change":"2024-05-08T04:22:07.596652+0000","last_active":"2024-05-08T04:22:07.605419+0000","last_peered":"2024-05-08T04:22:07.605419+0000","last_clean":"2024-05-08T04:22:07.605419+0000","last_became_active":"2024-05-08T04:22:07.596330+0000","last_became_peered":"2024-05-08T04:22:07.596330+0000","last_unstale":"2024-05-08T04:22:07.605419+0000","last_undegraded":"2024-05-08T04:22:07.605419+0000","last_fullsized":"2024-05-08T04:22:07.605419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:09.248136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601843+0000","last_change":"2024-05-08T04:22:07.601843+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601843+0000","last_undegraded":"2024-05-08T04:22:07.601843+0000","last_fullsized":"2024-05-08T04:22:07.601843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.605466+0000","last_change":"2024-05-08T04:22:07.598633+0000","last_active":"2024-05-08T04:22:07.605466+0000","last_peered":"2024-05-08T04:22:07.605466+0000","last_clean":"2024-05-08T04:22:07.605466+0000","last_became_active":"2024-05-08T04:22:07.598319+0000","last_became_peered":"2024-05-08T04:22:07.598319+0000","last_unstale":"2024-05-08T04:22:07.605466+0000","last_undegraded":"2024-05-08T04:22:07.605466+0000","last_fullsized":"2024-05-08T04:22:07.605466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:39:07.152177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602159+0000","last_change":"2024-05-08T04:22:07.602159+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602159+0000","last_undegraded":"2024-05-08T04:22:07.602159+0000","last_fullsized":"2024-05-08T04:22:07.602159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.618257+0000","last_change":"2024-05-08T04:22:07.614017+0000","last_active":"2024-05-08T04:22:07.618257+0000","last_peered":"2024-05-08T04:22:07.618257+0000","last_clean":"2024-05-08T04:22:07.618257+0000","last_became_active":"2024-05-08T04:22:07.613730+0000","last_became_peered":"2024-05-08T04:22:07.613730+0000","last_unstale":"2024-05-08T04:22:07.618257+0000","last_undegraded":"2024-05-08T04:22:07.618257+0000","last_fullsized":"2024-05-08T04:22:07.618257+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:44:18.282843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601752+0000","last_change":"2024-05-08T04:22:07.601752+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601752+0000","last_undegraded":"2024-05-08T04:22:07.601752+0000","last_fullsized":"2024-05-08T04:22:07.601752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.607900+0000","last_change":"2024-05-08T04:22:07.604862+0000","last_active":"2024-05-08T04:22:07.607900+0000","last_peered":"2024-05-08T04:22:07.607900+0000","last_clean":"2024-05-08T04:22:07.607900+0000","last_became_active":"2024-05-08T04:22:07.604578+0000","last_became_peered":"2024-05-08T04:22:07.604578+0000","last_unstale":"2024-05-08T04:22:07.607900+0000","last_undegraded":"2024-05-08T04:22:07.607900+0000","last_fullsized":"2024-05-08T04:22:07.607900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:37.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598682+0000","last_change":"2024-05-08T04:22:07.598682+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598682+0000","last_undegraded":"2024-05-08T04:22:07.598682+0000","last_fullsized":"2024-05-08T04:22:07.598682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613349+0000","last_change":"2024-05-08T04:22:07.608202+0000","last_active":"2024-05-08T04:22:07.613349+0000","last_peered":"2024-05-08T04:22:07.613349+0000","last_clean":"2024-05-08T04:22:07.613349+0000","last_became_active":"2024-05-08T04:22:07.607933+0000","last_became_peered":"2024-05-08T04:22:07.607933+0000","last_unstale":"2024-05-08T04:22:07.613349+0000","last_undegraded":"2024-05-08T04:22:07.613349+0000","last_fullsized":"2024-05-08T04:22:07.613349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:19.196550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601201+0000","last_change":"2024-05-08T04:22:07.601201+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601201+0000","last_undegraded":"2024-05-08T04:22:07.601201+0000","last_fullsized":"2024-05-08T04:22:07.601201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614354+0000","last_change":"2024-05-08T04:22:07.610082+0000","last_active":"2024-05-08T04:22:07.614354+0000","last_peered":"2024-05-08T04:22:07.614354+0000","last_clean":"2024-05-08T04:22:07.614354+0000","last_became_active":"2024-05-08T04:22:07.609805+0000","last_became_peered":"2024-05-08T04:22:07.609805+0000","last_unstale":"2024-05-08T04:22:07.614354+0000","last_undegraded":"2024-05-08T04:22:07.614354+0000","last_fullsized":"2024-05-08T04:22:07.614354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:23.503181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596849+0000","last_change":"2024-05-08T04:22:07.596849+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596849+0000","last_undegraded":"2024-05-08T04:22:07.596849+0000","last_fullsized":"2024-05-08T04:22:07.596849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.616885+0000","last_change":"2024-05-08T04:22:07.613948+0000","last_active":"2024-05-08T04:22:07.616885+0000","last_peered":"2024-05-08T04:22:07.616885+0000","last_clean":"2024-05-08T04:22:07.616885+0000","last_became_active":"2024-05-08T04:22:07.613685+0000","last_became_peered":"2024-05-08T04:22:07.613685+0000","last_unstale":"2024-05-08T04:22:07.616885+0000","last_undegraded":"2024-05-08T04:22:07.616885+0000","last_fullsized":"2024-05-08T04:22:07.616885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:48:25.191717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600995+0000","last_change":"2024-05-08T04:22:07.600995+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600995+0000","last_undegraded":"2024-05-08T04:22:07.600995+0000","last_fullsized":"2024-05-08T04:22:07.600995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614140+0000","last_change":"2024-05-08T04:22:07.608520+0000","last_active":"2024-05-08T04:22:07.614140+0000","last_peered":"2024-05-08T04:22:07.614140+0000","last_clean":"2024-05-08T04:22:07.614140+0000","last_became_active":"2024-05-08T04:22:07.608215+0000","last_became_peered":"2024-05-08T04:22:07.608215+0000","last_unstale":"2024-05-08T04:22:07.614140+0000","last_undegraded":"2024-05-08T04:22:07.614140+0000","last_fullsized":"2024-05-08T04:22:07.614140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:30:41.000788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601645+0000","last_change":"2024-05-08T04:22:07.601645+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601645+0000","last_undegraded":"2024-05-08T04:22:07.601645+0000","last_fullsized":"2024-05-08T04:22:07.601645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.608708+0000","last_change":"2024-05-08T04:22:07.606016+0000","last_active":"2024-05-08T04:22:07.608708+0000","last_peered":"2024-05-08T04:22:07.608708+0000","last_clean":"2024-05-08T04:22:07.608708+0000","last_became_active":"2024-05-08T04:22:07.605696+0000","last_became_peered":"2024-05-08T04:22:07.605696+0000","last_unstale":"2024-05-08T04:22:07.608708+0000","last_undegraded":"2024-05-08T04:22:07.608708+0000","last_fullsized":"2024-05-08T04:22:07.608708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:57.965625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598911+0000","last_change":"2024-05-08T04:22:07.598911+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598911+0000","last_undegraded":"2024-05-08T04:22:07.598911+0000","last_fullsized":"2024-05-08T04:22:07.598911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613388+0000","last_change":"2024-05-08T04:22:07.608876+0000","last_active":"2024-05-08T04:22:07.613388+0000","last_peered":"2024-05-08T04:22:07.613388+0000","last_clean":"2024-05-08T04:22:07.613388+0000","last_became_active":"2024-05-08T04:22:07.607923+0000","last_became_peered":"2024-05-08T04:22:07.607923+0000","last_unstale":"2024-05-08T04:22:07.613388+0000","last_undegraded":"2024-05-08T04:22:07.613388+0000","last_fullsized":"2024-05-08T04:22:07.613388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:37.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591144+0000","last_change":"2024-05-08T04:22:07.591144+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591144+0000","last_undegraded":"2024-05-08T04:22:07.591144+0000","last_fullsized":"2024-05-08T04:22:07.591144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612388+0000","last_change":"2024-05-08T04:22:07.607881+0000","last_active":"2024-05-08T04:22:07.612388+0000","last_peered":"2024-05-08T04:22:07.612388+0000","last_clean":"2024-05-08T04:22:07.612388+0000","last_became_active":"2024-05-08T04:22:07.607596+0000","last_became_peered":"2024-05-08T04:22:07.607596+0000","last_unstale":"2024-05-08T04:22:07.612388+0000","last_undegraded":"2024-05-08T04:22:07.612388+0000","last_fullsized":"2024-05-08T04:22:07.612388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:31:16.484162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.594609+0000","last_change":"2024-05-08T04:22:07.594609+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.594609+0000","last_undegraded":"2024-05-08T04:22:07.594609+0000","last_fullsized":"2024-05-08T04:22:07.594609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613403+0000","last_change":"2024-05-08T04:22:07.606217+0000","last_active":"2024-05-08T04:22:07.613403+0000","last_peered":"2024-05-08T04:22:07.613403+0000","last_clean":"2024-05-08T04:22:07.613403+0000","last_became_active":"2024-05-08T04:22:07.605718+0000","last_became_peered":"2024-05-08T04:22:07.605718+0000","last_unstale":"2024-05-08T04:22:07.613403+0000","last_undegraded":"2024-05-08T04:22:07.613403+0000","last_fullsized":"2024-05-08T04:22:07.613403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:39:07.152177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598204+0000","last_change":"2024-05-08T04:22:07.598204+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598204+0000","last_undegraded":"2024-05-08T04:22:07.598204+0000","last_fullsized":"2024-05-08T04:22:07.598204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.606221+0000","last_change":"2024-05-08T04:22:07.604104+0000","last_active":"2024-05-08T04:22:07.606221+0000","last_peered":"2024-05-08T04:22:07.606221+0000","last_clean":"2024-05-08T04:22:07.606221+0000","last_became_active":"2024-05-08T04:22:07.603790+0000","last_became_peered":"2024-05-08T04:22:07.603790+0000","last_unstale":"2024-05-08T04:22:07.606221+0000","last_undegraded":"2024-05-08T04:22:07.606221+0000","last_fullsized":"2024-05-08T04:22:07.606221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:41.097192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591573+0000","last_change":"2024-05-08T04:22:07.591573+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591573+0000","last_undegraded":"2024-05-08T04:22:07.591573+0000","last_fullsized":"2024-05-08T04:22:07.591573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613415+0000","last_change":"2024-05-08T04:22:07.609907+0000","last_active":"2024-05-08T04:22:07.613415+0000","last_peered":"2024-05-08T04:22:07.613415+0000","last_clean":"2024-05-08T04:22:07.613415+0000","last_became_active":"2024-05-08T04:22:07.609656+0000","last_became_peered":"2024-05-08T04:22:07.609656+0000","last_unstale":"2024-05-08T04:22:07.613415+0000","last_undegraded":"2024-05-08T04:22:07.613415+0000","last_fullsized":"2024-05-08T04:22:07.613415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:23.503181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597335+0000","last_change":"2024-05-08T04:22:07.597335+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597335+0000","last_undegraded":"2024-05-08T04:22:07.597335+0000","last_fullsized":"2024-05-08T04:22:07.597335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610267+0000","last_change":"2024-05-08T04:22:07.606077+0000","last_active":"2024-05-08T04:22:07.610267+0000","last_peered":"2024-05-08T04:22:07.610267+0000","last_clean":"2024-05-08T04:22:07.610267+0000","last_became_active":"2024-05-08T04:22:07.605826+0000","last_became_peered":"2024-05-08T04:22:07.605826+0000","last_unstale":"2024-05-08T04:22:07.610267+0000","last_undegraded":"2024-05-08T04:22:07.610267+0000","last_fullsized":"2024-05-08T04:22:07.610267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:30:41.000788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597115+0000","last_change":"2024-05-08T04:22:07.597115+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597115+0000","last_undegraded":"2024-05-08T04:22:07.597115+0000","last_fullsized":"2024-05-08T04:22:07.597115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612748+0000","last_change":"2024-05-08T04:22:07.609551+0000","last_active":"2024-05-08T04:22:07.612748+0000","last_peered":"2024-05-08T04:22:07.612748+0000","last_clean":"2024-05-08T04:22:07.612748+0000","last_became_active":"2024-05-08T04:22:07.609262+0000","last_became_peered":"2024-05-08T04:22:07.609262+0000","last_unstale":"2024-05-08T04:22:07.612748+0000","last_undegraded":"2024-05-08T04:22:07.612748+0000","last_fullsized":"2024-05-08T04:22:07.612748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:00.284324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.595079+0000","last_change":"2024-05-08T04:22:07.595079+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.595079+0000","last_undegraded":"2024-05-08T04:22:07.595079+0000","last_fullsized":"2024-05-08T04:22:07.595079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.607715+0000","last_change":"2024-05-08T04:22:07.602513+0000","last_active":"2024-05-08T04:22:07.607715+0000","last_peered":"2024-05-08T04:22:07.607715+0000","last_clean":"2024-05-08T04:22:07.607715+0000","last_became_active":"2024-05-08T04:22:07.601926+0000","last_became_peered":"2024-05-08T04:22:07.601926+0000","last_unstale":"2024-05-08T04:22:07.607715+0000","last_undegraded":"2024-05-08T04:22:07.607715+0000","last_fullsized":"2024-05-08T04:22:07.607715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:19.196550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600899+0000","last_change":"2024-05-08T04:22:07.600899+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600899+0000","last_undegraded":"2024-05-08T04:22:07.600899+0000","last_fullsized":"2024-05-08T04:22:07.600899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.605487+0000","last_change":"2024-05-08T04:22:07.599148+0000","last_active":"2024-05-08T04:22:07.605487+0000","last_peered":"2024-05-08T04:22:07.605487+0000","last_clean":"2024-05-08T04:22:07.605487+0000","last_became_active":"2024-05-08T04:22:07.598845+0000","last_became_peered":"2024-05-08T04:22:07.598845+0000","last_unstale":"2024-05-08T04:22:07.605487+0000","last_undegraded":"2024-05-08T04:22:07.605487+0000","last_fullsized":"2024-05-08T04:22:07.605487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:25:46.596230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.593974+0000","last_change":"2024-05-08T04:22:07.593974+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.593974+0000","last_undegraded":"2024-05-08T04:22:07.593974+0000","last_fullsized":"2024-05-08T04:22:07.593974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613913+0000","last_change":"2024-05-08T04:22:07.607364+0000","last_active":"2024-05-08T04:22:07.613913+0000","last_peered":"2024-05-08T04:22:07.613913+0000","last_clean":"2024-05-08T04:22:07.613913+0000","last_became_active":"2024-05-08T04:22:07.607023+0000","last_became_peered":"2024-05-08T04:22:07.607023+0000","last_unstale":"2024-05-08T04:22:07.613913+0000","last_undegraded":"2024-05-08T04:22:07.613913+0000","last_fullsized":"2024-05-08T04:22:07.613913+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:23.503181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596759+0000","last_change":"2024-05-08T04:22:07.596759+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596759+0000","last_undegraded":"2024-05-08T04:22:07.596759+0000","last_fullsized":"2024-05-08T04:22:07.596759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.607787+0000","last_change":"2024-05-08T04:22:07.602890+0000","last_active":"2024-05-08T04:22:07.607787+0000","last_peered":"2024-05-08T04:22:07.607787+0000","last_clean":"2024-05-08T04:22:07.607787+0000","last_became_active":"2024-05-08T04:22:07.602498+0000","last_became_peered":"2024-05-08T04:22:07.602498+0000","last_unstale":"2024-05-08T04:22:07.607787+0000","last_undegraded":"2024-05-08T04:22:07.607787+0000","last_fullsized":"2024-05-08T04:22:07.607787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:43.886509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600256+0000","last_change":"2024-05-08T04:22:07.600256+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600256+0000","last_undegraded":"2024-05-08T04:22:07.600256+0000","last_fullsized":"2024-05-08T04:22:07.600256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614329+0000","last_change":"2024-05-08T04:22:07.609908+0000","last_active":"2024-05-08T04:22:07.614329+0000","last_peered":"2024-05-08T04:22:07.614329+0000","last_clean":"2024-05-08T04:22:07.614329+0000","last_became_active":"2024-05-08T04:22:07.609669+0000","last_became_peered":"2024-05-08T04:22:07.609669+0000","last_unstale":"2024-05-08T04:22:07.614329+0000","last_undegraded":"2024-05-08T04:22:07.614329+0000","last_fullsized":"2024-05-08T04:22:07.614329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:28.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598788+0000","last_change":"2024-05-08T04:22:07.598788+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598788+0000","last_undegraded":"2024-05-08T04:22:07.598788+0000","last_fullsized":"2024-05-08T04:22:07.598788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613387+0000","last_change":"2024-05-08T04:22:07.608739+0000","last_active":"2024-05-08T04:22:07.613387+0000","last_peered":"2024-05-08T04:22:07.613387+0000","last_clean":"2024-05-08T04:22:07.613387+0000","last_became_active":"2024-05-08T04:22:07.608391+0000","last_became_peered":"2024-05-08T04:22:07.608391+0000","last_unstale":"2024-05-08T04:22:07.613387+0000","last_undegraded":"2024-05-08T04:22:07.613387+0000","last_fullsized":"2024-05-08T04:22:07.613387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:43.886509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600514+0000","last_change":"2024-05-08T04:22:07.600514+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600514+0000","last_undegraded":"2024-05-08T04:22:07.600514+0000","last_fullsized":"2024-05-08T04:22:07.600514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614386+0000","last_change":"2024-05-08T04:22:07.610730+0000","last_active":"2024-05-08T04:22:07.614386+0000","last_peered":"2024-05-08T04:22:07.614386+0000","last_clean":"2024-05-08T04:22:07.614386+0000","last_became_active":"2024-05-08T04:22:07.610527+0000","last_became_peered":"2024-05-08T04:22:07.610527+0000","last_unstale":"2024-05-08T04:22:07.614386+0000","last_undegraded":"2024-05-08T04:22:07.614386+0000","last_fullsized":"2024-05-08T04:22:07.614386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:28.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596752+0000","last_change":"2024-05-08T04:22:07.596752+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596752+0000","last_undegraded":"2024-05-08T04:22:07.596752+0000","last_fullsized":"2024-05-08T04:22:07.596752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612816+0000","last_change":"2024-05-08T04:22:07.611008+0000","last_active":"2024-05-08T04:22:07.612816+0000","last_peered":"2024-05-08T04:22:07.612816+0000","last_clean":"2024-05-08T04:22:07.612816+0000","last_became_active":"2024-05-08T04:22:07.610754+0000","last_became_peered":"2024-05-08T04:22:07.610754+0000","last_unstale":"2024-05-08T04:22:07.612816+0000","last_undegraded":"2024-05-08T04:22:07.612816+0000","last_fullsized":"2024-05-08T04:22:07.612816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:25:28.841648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.593372+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:22:07.593372+0000","last_peered":"2024-05-08T04:22:07.593372+0000","last_clean":"2024-05-08T04:22:07.593372+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:22:07.593372+0000","last_undegraded":"2024-05-08T04:22:07.593372+0000","last_fullsized":"2024-05-08T04:22:07.593372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:22:12.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-05-08T04:22:12.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598877+0000', 'last_change': '2024-05-08T04:22:07.598877+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598877+0000', 'last_undegraded': '2024-05-08T04:22:07.598877+0000', 'last_fullsized': '2024-05-08T04:22:07.598877+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:22:12.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-05-08T04:22:12.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.591580+0000', 'last_change': '2024-05-08T04:22:07.591580+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.591580+0000', 'last_undegraded': '2024-05-08T04:22:07.591580+0000', 'last_fullsized': '2024-05-08T04:22:07.591580+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T04:22:12.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-05-08T04:22:12.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.599870+0000', 'last_change': '2024-05-08T04:22:07.599870+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.599870+0000', 'last_undegraded': '2024-05-08T04:22:07.599870+0000', 'last_fullsized': '2024-05-08T04:22:07.599870+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T04:22:12.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-05-08T04:22:12.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.603655+0000', 'last_change': '2024-05-08T04:22:07.603655+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.603655+0000', 'last_undegraded': '2024-05-08T04:22:07.603655+0000', 'last_fullsized': '2024-05-08T04:22:07.603655+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:22:12.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-05-08T04:22:12.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.592100+0000', 'last_change': '2024-05-08T04:22:07.592100+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.592100+0000', 'last_undegraded': '2024-05-08T04:22:07.592100+0000', 'last_fullsized': '2024-05-08T04:22:07.592100+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T04:22:12.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-05-08T04:22:12.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.593923+0000', 'last_change': '2024-05-08T04:22:07.593923+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.593923+0000', 'last_undegraded': '2024-05-08T04:22:07.593923+0000', 'last_fullsized': '2024-05-08T04:22:07.593923+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T04:22:12.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-05-08T04:22:12.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598863+0000', 'last_change': '2024-05-08T04:22:07.598863+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598863+0000', 'last_undegraded': '2024-05-08T04:22:07.598863+0000', 'last_fullsized': '2024-05-08T04:22:07.598863+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:22:12.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-05-08T04:22:12.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598470+0000', 'last_change': '2024-05-08T04:22:07.598470+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598470+0000', 'last_undegraded': '2024-05-08T04:22:07.598470+0000', 'last_fullsized': '2024-05-08T04:22:07.598470+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:22:12.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-05-08T04:22:12.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.599509+0000', 'last_change': '2024-05-08T04:22:07.599509+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.599509+0000', 'last_undegraded': '2024-05-08T04:22:07.599509+0000', 'last_fullsized': '2024-05-08T04:22:07.599509+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T04:22:12.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-05-08T04:22:12.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.603785+0000', 'last_change': '2024-05-08T04:22:07.603785+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.603785+0000', 'last_undegraded': '2024-05-08T04:22:07.603785+0000', 'last_fullsized': '2024-05-08T04:22:07.603785+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:22:12.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-05-08T04:22:12.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.601173+0000', 'last_change': '2024-05-08T04:22:07.601173+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.601173+0000', 'last_undegraded': '2024-05-08T04:22:07.601173+0000', 'last_fullsized': '2024-05-08T04:22:07.601173+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:22:12.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-05-08T04:22:12.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.599562+0000', 'last_change': '2024-05-08T04:22:07.599562+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.599562+0000', 'last_undegraded': '2024-05-08T04:22:07.599562+0000', 'last_fullsized': '2024-05-08T04:22:07.599562+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T04:22:12.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-05-08T04:22:12.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.599301+0000', 'last_change': '2024-05-08T04:22:07.599301+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.599301+0000', 'last_undegraded': '2024-05-08T04:22:07.599301+0000', 'last_fullsized': '2024-05-08T04:22:07.599301+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T04:22:12.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-05-08T04:22:12.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.603583+0000', 'last_change': '2024-05-08T04:22:07.603583+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.603583+0000', 'last_undegraded': '2024-05-08T04:22:07.603583+0000', 'last_fullsized': '2024-05-08T04:22:07.603583+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:22:12.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-05-08T04:22:12.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598743+0000', 'last_change': '2024-05-08T04:22:07.598743+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598743+0000', 'last_undegraded': '2024-05-08T04:22:07.598743+0000', 'last_fullsized': '2024-05-08T04:22:07.598743+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T04:22:12.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-05-08T04:22:12.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598229+0000', 'last_change': '2024-05-08T04:22:07.598229+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598229+0000', 'last_undegraded': '2024-05-08T04:22:07.598229+0000', 'last_fullsized': '2024-05-08T04:22:07.598229+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T04:22:12.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-05-08T04:22:12.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.602514+0000', 'last_change': '2024-05-08T04:22:07.602514+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.602514+0000', 'last_undegraded': '2024-05-08T04:22:07.602514+0000', 'last_fullsized': '2024-05-08T04:22:07.602514+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:22:12.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-05-08T04:22:12.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.595546+0000', 'last_change': '2024-05-08T04:22:07.595546+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.595546+0000', 'last_undegraded': '2024-05-08T04:22:07.595546+0000', 'last_fullsized': '2024-05-08T04:22:07.595546+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T04:22:12.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-05-08T04:22:12.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.595104+0000', 'last_change': '2024-05-08T04:22:07.595104+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.595104+0000', 'last_undegraded': '2024-05-08T04:22:07.595104+0000', 'last_fullsized': '2024-05-08T04:22:07.595104+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T04:22:12.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-05-08T04:22:12.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.599209+0000', 'last_change': '2024-05-08T04:22:07.599209+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.599209+0000', 'last_undegraded': '2024-05-08T04:22:07.599209+0000', 'last_fullsized': '2024-05-08T04:22:07.599209+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T04:22:12.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-05-08T04:22:12.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598675+0000', 'last_change': '2024-05-08T04:22:07.598675+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598675+0000', 'last_undegraded': '2024-05-08T04:22:07.598675+0000', 'last_fullsized': '2024-05-08T04:22:07.598675+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T04:22:12.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-05-08T04:22:12.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598001+0000', 'last_change': '2024-05-08T04:22:07.598001+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598001+0000', 'last_undegraded': '2024-05-08T04:22:07.598001+0000', 'last_fullsized': '2024-05-08T04:22:07.598001+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:22:12.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-05-08T04:22:12.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598363+0000', 'last_change': '2024-05-08T04:22:07.598363+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598363+0000', 'last_undegraded': '2024-05-08T04:22:07.598363+0000', 'last_fullsized': '2024-05-08T04:22:07.598363+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T04:22:12.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-05-08T04:22:12.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.597568+0000', 'last_change': '2024-05-08T04:22:07.597568+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.597568+0000', 'last_undegraded': '2024-05-08T04:22:07.597568+0000', 'last_fullsized': '2024-05-08T04:22:07.597568+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:22:12.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-05-08T04:22:12.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.604025+0000', 'last_change': '2024-05-08T04:22:07.604025+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.604025+0000', 'last_undegraded': '2024-05-08T04:22:07.604025+0000', 'last_fullsized': '2024-05-08T04:22:07.604025+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:22:12.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-05-08T04:22:12.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.602968+0000', 'last_change': '2024-05-08T04:22:07.602968+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.602968+0000', 'last_undegraded': '2024-05-08T04:22:07.602968+0000', 'last_fullsized': '2024-05-08T04:22:07.602968+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:22:12.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-05-08T04:22:12.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.591026+0000', 'last_change': '2024-05-08T04:22:07.591026+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.591026+0000', 'last_undegraded': '2024-05-08T04:22:07.591026+0000', 'last_fullsized': '2024-05-08T04:22:07.591026+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T04:22:12.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-05-08T04:22:12.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.597363+0000', 'last_change': '2024-05-08T04:22:07.597363+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.597363+0000', 'last_undegraded': '2024-05-08T04:22:07.597363+0000', 'last_fullsized': '2024-05-08T04:22:07.597363+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:22:12.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-05-08T04:22:12.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598205+0000', 'last_change': '2024-05-08T04:22:07.598205+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598205+0000', 'last_undegraded': '2024-05-08T04:22:07.598205+0000', 'last_fullsized': '2024-05-08T04:22:07.598205+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T04:22:12.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-05-08T04:22:12.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.597388+0000', 'last_change': '2024-05-08T04:22:07.597388+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.597388+0000', 'last_undegraded': '2024-05-08T04:22:07.597388+0000', 'last_fullsized': '2024-05-08T04:22:07.597388+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T04:22:12.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-05-08T04:22:12.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.597398+0000', 'last_change': '2024-05-08T04:22:07.597398+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.597398+0000', 'last_undegraded': '2024-05-08T04:22:07.597398+0000', 'last_fullsized': '2024-05-08T04:22:07.597398+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:22:12.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-05-08T04:22:12.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.600951+0000', 'last_change': '2024-05-08T04:22:07.600951+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.600951+0000', 'last_undegraded': '2024-05-08T04:22:07.600951+0000', 'last_fullsized': '2024-05-08T04:22:07.600951+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:22:12.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-05-08T04:22:12.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.597972+0000', 'last_change': '2024-05-08T04:22:07.597972+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.597972+0000', 'last_undegraded': '2024-05-08T04:22:07.597972+0000', 'last_fullsized': '2024-05-08T04:22:07.597972+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T04:22:12.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-05-08T04:22:12.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.597651+0000', 'last_change': '2024-05-08T04:22:07.597651+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.597651+0000', 'last_undegraded': '2024-05-08T04:22:07.597651+0000', 'last_fullsized': '2024-05-08T04:22:07.597651+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:22:12.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-05-08T04:22:12.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.596898+0000', 'last_change': '2024-05-08T04:22:07.596898+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.596898+0000', 'last_undegraded': '2024-05-08T04:22:07.596898+0000', 'last_fullsized': '2024-05-08T04:22:07.596898+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:22:12.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-05-08T04:22:12.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.601750+0000', 'last_change': '2024-05-08T04:22:07.601750+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.601750+0000', 'last_undegraded': '2024-05-08T04:22:07.601750+0000', 'last_fullsized': '2024-05-08T04:22:07.601750+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:22:12.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-05-08T04:22:12.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598452+0000', 'last_change': '2024-05-08T04:22:07.598452+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598452+0000', 'last_undegraded': '2024-05-08T04:22:07.598452+0000', 'last_fullsized': '2024-05-08T04:22:07.598452+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T04:22:12.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-05-08T04:22:12.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.596862+0000', 'last_change': '2024-05-08T04:22:07.596862+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.596862+0000', 'last_undegraded': '2024-05-08T04:22:07.596862+0000', 'last_fullsized': '2024-05-08T04:22:07.596862+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:22:12.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-05-08T04:22:12.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.597988+0000', 'last_change': '2024-05-08T04:22:07.597988+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.597988+0000', 'last_undegraded': '2024-05-08T04:22:07.597988+0000', 'last_fullsized': '2024-05-08T04:22:07.597988+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T04:22:12.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-05-08T04:22:12.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.601737+0000', 'last_change': '2024-05-08T04:22:07.601737+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.601737+0000', 'last_undegraded': '2024-05-08T04:22:07.601737+0000', 'last_fullsized': '2024-05-08T04:22:07.601737+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:22:12.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-05-08T04:22:12.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.602087+0000', 'last_change': '2024-05-08T04:22:07.602087+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.602087+0000', 'last_undegraded': '2024-05-08T04:22:07.602087+0000', 'last_fullsized': '2024-05-08T04:22:07.602087+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:22:12.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-05-08T04:22:12.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.601843+0000', 'last_change': '2024-05-08T04:22:07.601843+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.601843+0000', 'last_undegraded': '2024-05-08T04:22:07.601843+0000', 'last_fullsized': '2024-05-08T04:22:07.601843+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:22:12.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-05-08T04:22:12.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.602159+0000', 'last_change': '2024-05-08T04:22:07.602159+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.602159+0000', 'last_undegraded': '2024-05-08T04:22:07.602159+0000', 'last_fullsized': '2024-05-08T04:22:07.602159+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:22:12.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-05-08T04:22:12.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.601752+0000', 'last_change': '2024-05-08T04:22:07.601752+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.601752+0000', 'last_undegraded': '2024-05-08T04:22:07.601752+0000', 'last_fullsized': '2024-05-08T04:22:07.601752+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:22:12.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-05-08T04:22:12.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598682+0000', 'last_change': '2024-05-08T04:22:07.598682+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598682+0000', 'last_undegraded': '2024-05-08T04:22:07.598682+0000', 'last_fullsized': '2024-05-08T04:22:07.598682+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T04:22:12.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-05-08T04:22:12.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.601201+0000', 'last_change': '2024-05-08T04:22:07.601201+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.601201+0000', 'last_undegraded': '2024-05-08T04:22:07.601201+0000', 'last_fullsized': '2024-05-08T04:22:07.601201+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:22:12.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-05-08T04:22:12.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.596849+0000', 'last_change': '2024-05-08T04:22:07.596849+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.596849+0000', 'last_undegraded': '2024-05-08T04:22:07.596849+0000', 'last_fullsized': '2024-05-08T04:22:07.596849+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:22:12.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-05-08T04:22:12.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.600995+0000', 'last_change': '2024-05-08T04:22:07.600995+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.600995+0000', 'last_undegraded': '2024-05-08T04:22:07.600995+0000', 'last_fullsized': '2024-05-08T04:22:07.600995+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:22:12.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-05-08T04:22:12.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.601645+0000', 'last_change': '2024-05-08T04:22:07.601645+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.601645+0000', 'last_undegraded': '2024-05-08T04:22:07.601645+0000', 'last_fullsized': '2024-05-08T04:22:07.601645+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:22:12.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-05-08T04:22:12.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598911+0000', 'last_change': '2024-05-08T04:22:07.598911+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598911+0000', 'last_undegraded': '2024-05-08T04:22:07.598911+0000', 'last_fullsized': '2024-05-08T04:22:07.598911+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T04:22:12.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-05-08T04:22:12.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.591144+0000', 'last_change': '2024-05-08T04:22:07.591144+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.591144+0000', 'last_undegraded': '2024-05-08T04:22:07.591144+0000', 'last_fullsized': '2024-05-08T04:22:07.591144+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T04:22:12.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-05-08T04:22:12.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.594609+0000', 'last_change': '2024-05-08T04:22:07.594609+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.594609+0000', 'last_undegraded': '2024-05-08T04:22:07.594609+0000', 'last_fullsized': '2024-05-08T04:22:07.594609+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T04:22:12.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-05-08T04:22:12.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598204+0000', 'last_change': '2024-05-08T04:22:07.598204+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598204+0000', 'last_undegraded': '2024-05-08T04:22:07.598204+0000', 'last_fullsized': '2024-05-08T04:22:07.598204+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T04:22:12.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-05-08T04:22:12.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.591573+0000', 'last_change': '2024-05-08T04:22:07.591573+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.591573+0000', 'last_undegraded': '2024-05-08T04:22:07.591573+0000', 'last_fullsized': '2024-05-08T04:22:07.591573+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T04:22:12.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-05-08T04:22:12.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.597335+0000', 'last_change': '2024-05-08T04:22:07.597335+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.597335+0000', 'last_undegraded': '2024-05-08T04:22:07.597335+0000', 'last_fullsized': '2024-05-08T04:22:07.597335+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T04:22:12.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-05-08T04:22:12.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.597115+0000', 'last_change': '2024-05-08T04:22:07.597115+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.597115+0000', 'last_undegraded': '2024-05-08T04:22:07.597115+0000', 'last_fullsized': '2024-05-08T04:22:07.597115+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T04:22:12.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-05-08T04:22:12.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.595079+0000', 'last_change': '2024-05-08T04:22:07.595079+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.595079+0000', 'last_undegraded': '2024-05-08T04:22:07.595079+0000', 'last_fullsized': '2024-05-08T04:22:07.595079+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T04:22:12.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-05-08T04:22:12.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.600899+0000', 'last_change': '2024-05-08T04:22:07.600899+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.600899+0000', 'last_undegraded': '2024-05-08T04:22:07.600899+0000', 'last_fullsized': '2024-05-08T04:22:07.600899+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:22:12.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-05-08T04:22:12.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.593974+0000', 'last_change': '2024-05-08T04:22:07.593974+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.593974+0000', 'last_undegraded': '2024-05-08T04:22:07.593974+0000', 'last_fullsized': '2024-05-08T04:22:07.593974+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T04:22:12.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-05-08T04:22:12.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.596759+0000', 'last_change': '2024-05-08T04:22:07.596759+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.596759+0000', 'last_undegraded': '2024-05-08T04:22:07.596759+0000', 'last_fullsized': '2024-05-08T04:22:07.596759+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T04:22:12.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-05-08T04:22:12.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.600256+0000', 'last_change': '2024-05-08T04:22:07.600256+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.600256+0000', 'last_undegraded': '2024-05-08T04:22:07.600256+0000', 'last_fullsized': '2024-05-08T04:22:07.600256+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:22:12.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-05-08T04:22:12.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.598788+0000', 'last_change': '2024-05-08T04:22:07.598788+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.598788+0000', 'last_undegraded': '2024-05-08T04:22:07.598788+0000', 'last_fullsized': '2024-05-08T04:22:07.598788+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:22:12.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-05-08T04:22:12.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.600514+0000', 'last_change': '2024-05-08T04:22:07.600514+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.600514+0000', 'last_undegraded': '2024-05-08T04:22:07.600514+0000', 'last_fullsized': '2024-05-08T04:22:07.600514+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:22:12.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-05-08T04:22:12.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:22:07.596752+0000', 'last_change': '2024-05-08T04:22:07.596752+0000', 'last_active': '2024-05-08T04:22:07.581217+0000', 'last_peered': '2024-05-08T04:22:07.581217+0000', 'last_clean': '2024-05-08T04:22:07.581217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:07.596752+0000', 'last_undegraded': '2024-05-08T04:22:07.596752+0000', 'last_fullsized': '2024-05-08T04:22:07.596752+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:07.581217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T04:22:12.244 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-08T04:22:12.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.363+0000 7fe367e8f640 1 Processor -- start 2024-05-08T04:22:12.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.363+0000 7fe367e8f640 1 -- start start 2024-05-08T04:22:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.364+0000 7fe367e8f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe36015de10 0x7fe360161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.364+0000 7fe367e8f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36015e1f0 con 0x7fe3600d07c0 2024-05-08T04:22:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.364+0000 7fe367e8f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe360162090 con 0x7fe3600ce5a0 2024-05-08T04:22:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.364+0000 7fe367e8f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3600d0f50 con 0x7fe36015de10 2024-05-08T04:22:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.364+0000 7fe365c2b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe36015de10 0x7fe360161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.364+0000 7fe36642c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe3600d07c0 0x7fe3600d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41246/0 (socket says 172.21.15.104:41246) 2024-05-08T04:22:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.364+0000 7fe36642c640 1 -- 172.21.15.104:0/2448269398 learned_addr learned my addr 172.21.15.104:0/2448269398 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.365+0000 7fe365c2b640 1 -- 172.21.15.104:0/2448269398 >> v1:172.21.15.183:6789/0 conn(0x7fe3600ce5a0 legacy=0x7fe3600d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.365+0000 7fe365c2b640 1 -- 172.21.15.104:0/2448269398 >> v1:172.21.15.104:6789/0 conn(0x7fe3600d07c0 legacy=0x7fe3600d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.365+0000 7fe365c2b640 1 -- 172.21.15.104:0/2448269398 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe360162370 con 0x7fe36015de10 2024-05-08T04:22:12.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.365+0000 7fe364c29640 1 -- 172.21.15.104:0/2448269398 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141330711 0 0) 0x7fe36015e1f0 con 0x7fe3600d07c0 2024-05-08T04:22:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.365+0000 7fe365c2b640 1 --2- 172.21.15.104:0/2448269398 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe36015de10 0x7fe360161920 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe350009d90 tx=0x7fe35002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfe024e129b348f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.366+0000 7fe364c29640 1 -- 172.21.15.104:0/2448269398 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350031600 con 0x7fe36015de10 2024-05-08T04:22:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.366+0000 7fe364c29640 1 -- 172.21.15.104:0/2448269398 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3500317a0 con 0x7fe36015de10 2024-05-08T04:22:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.366+0000 7fe364c29640 1 -- 172.21.15.104:0/2448269398 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350031b70 con 0x7fe36015de10 2024-05-08T04:22:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.366+0000 7fe367e8f640 1 -- 172.21.15.104:0/2448269398 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe36015de10 msgr2=0x7fe360161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.366+0000 7fe367e8f640 1 --2- 172.21.15.104:0/2448269398 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe36015de10 0x7fe360161920 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe350009d90 tx=0x7fe35002a610 comp rx=0 tx=0).stop 2024-05-08T04:22:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.366+0000 7fe367e8f640 1 -- 172.21.15.104:0/2448269398 shutdown_connections 2024-05-08T04:22:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.366+0000 7fe367e8f640 1 --2- 172.21.15.104:0/2448269398 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe36015de10 0x7fe360161920 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.366+0000 7fe367e8f640 1 -- 172.21.15.104:0/2448269398 >> 172.21.15.104:0/2448269398 conn(0x7fe360072290 msgr2=0x7fe360072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.366+0000 7fe367e8f640 1 -- 172.21.15.104:0/2448269398 shutdown_connections 2024-05-08T04:22:12.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.366+0000 7fe367e8f640 1 -- 172.21.15.104:0/2448269398 wait complete. 2024-05-08T04:22:12.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.367+0000 7fe367e8f640 1 Processor -- start 2024-05-08T04:22:12.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.368+0000 7fe367e8f640 1 -- start start 2024-05-08T04:22:12.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.368+0000 7fe367e8f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3600ce5a0 0x7fe360157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.368+0000 7fe367e8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3600d07c0 0x7fe3600b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.368+0000 7fe367e8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe36015de10 0x7fe360152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.368+0000 7fe367e8f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3600d1a90 con 0x7fe3600ce5a0 2024-05-08T04:22:12.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.368+0000 7fe367e8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3600d1ce0 con 0x7fe36015de10 2024-05-08T04:22:12.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.368+0000 7fe367e8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3600b6dc0 con 0x7fe3600d07c0 2024-05-08T04:22:12.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.368+0000 7fe365c2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3600ce5a0 0x7fe360157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.368+0000 7fe365c2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3600ce5a0 0x7fe360157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49938/0 (socket says 172.21.15.104:49938) 2024-05-08T04:22:12.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.368+0000 7fe365c2b640 1 -- 172.21.15.104:0/3736571769 learned_addr learned my addr 172.21.15.104:0/3736571769 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:12.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.368+0000 7fe36642c640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe36015de10 0x7fe360152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.368+0000 7fe36542a640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3600d07c0 0x7fe3600b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.369+0000 7fe365c2b640 1 -- 172.21.15.104:0/3736571769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3600d07c0 msgr2=0x7fe3600b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.369+0000 7fe365c2b640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3600d07c0 0x7fe3600b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.369+0000 7fe365c2b640 1 -- 172.21.15.104:0/3736571769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe36015de10 msgr2=0x7fe360152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.369+0000 7fe365c2b640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe36015de10 0x7fe360152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.369+0000 7fe365c2b640 1 -- 172.21.15.104:0/3736571769 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3600b3a20 con 0x7fe3600ce5a0 2024-05-08T04:22:12.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.369+0000 7fe365c2b640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3600ce5a0 0x7fe360157880 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe350009d90 tx=0x7fe350004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:12.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.369+0000 7fe35e7fc640 1 -- 172.21.15.104:0/3736571769 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350040070 con 0x7fe3600ce5a0 2024-05-08T04:22:12.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.369+0000 7fe35e7fc640 1 -- 172.21.15.104:0/3736571769 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe350030be0 con 0x7fe3600ce5a0 2024-05-08T04:22:12.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.369+0000 7fe367e8f640 1 -- 172.21.15.104:0/3736571769 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3600b3cf0 con 0x7fe3600ce5a0 2024-05-08T04:22:12.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.369+0000 7fe35e7fc640 1 -- 172.21.15.104:0/3736571769 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35003c420 con 0x7fe3600ce5a0 2024-05-08T04:22:12.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.369+0000 7fe367e8f640 1 -- 172.21.15.104:0/3736571769 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3600b42b0 con 0x7fe3600ce5a0 2024-05-08T04:22:12.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.370+0000 7fe367e8f640 1 -- 172.21.15.104:0/3736571769 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe360075010 con 0x7fe3600ce5a0 2024-05-08T04:22:12.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.371+0000 7fe35e7fc640 1 -- 172.21.15.104:0/3736571769 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe350039040 con 0x7fe3600ce5a0 2024-05-08T04:22:12.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.371+0000 7fe35e7fc640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe34c06b4d0 0x7fe34c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.371+0000 7fe35e7fc640 1 -- 172.21.15.104:0/3736571769 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3500ab670 con 0x7fe3600ce5a0 2024-05-08T04:22:12.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.371+0000 7fe36542a640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe34c06b4d0 0x7fe34c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.372+0000 7fe36542a640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe34c06b4d0 0x7fe34c06d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe3600b5d80 tx=0x7fe354009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:12.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.375+0000 7fe35e7fc640 1 -- 172.21.15.104:0/3736571769 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe35007a5b0 con 0x7fe3600ce5a0 2024-05-08T04:22:12.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.615+0000 7fe367e8f640 1 -- 172.21.15.104:0/3736571769 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe3600d1870 con 0x7fe3600ce5a0 2024-05-08T04:22:12.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.615+0000 7fe35e7fc640 1 -- 172.21.15.104:0/3736571769 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1452 (secure 0 0 0) 0x7fe350079eb0 con 0x7fe3600ce5a0 2024-05-08T04:22:12.617 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:12.617 INFO:teuthology.orchestra.run.smithi104.stdout:{"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":86,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1715142057,"num_in_osds":8,"osd_in_since":1715142048,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225222656,"bytes_avail":772868890624,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":14,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5214}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-05-08T04:21:58.646448+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-08T04:22:12.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.617+0000 7fe367e8f640 1 -- 172.21.15.104:0/3736571769 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe34c06b4d0 msgr2=0x7fe34c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.617+0000 7fe367e8f640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe34c06b4d0 0x7fe34c06d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe3600b5d80 tx=0x7fe354009040 comp rx=0 tx=0).stop 2024-05-08T04:22:12.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.617+0000 7fe367e8f640 1 -- 172.21.15.104:0/3736571769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3600ce5a0 msgr2=0x7fe360157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.617+0000 7fe367e8f640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3600ce5a0 0x7fe360157880 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe350009d90 tx=0x7fe350004a40 comp rx=0 tx=0).stop 2024-05-08T04:22:12.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.617+0000 7fe367e8f640 1 -- 172.21.15.104:0/3736571769 shutdown_connections 2024-05-08T04:22:12.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.617+0000 7fe367e8f640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe34c06b4d0 0x7fe34c06d990 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.617+0000 7fe367e8f640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe36015de10 0x7fe360152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.617+0000 7fe367e8f640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3600d07c0 0x7fe3600b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.617+0000 7fe367e8f640 1 --2- 172.21.15.104:0/3736571769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3600ce5a0 0x7fe360157880 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.617+0000 7fe367e8f640 1 -- 172.21.15.104:0/3736571769 >> 172.21.15.104:0/3736571769 conn(0x7fe360072290 msgr2=0x7fe3600cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:12.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.617+0000 7fe367e8f640 1 -- 172.21.15.104:0/3736571769 shutdown_connections 2024-05-08T04:22:12.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.617+0000 7fe367e8f640 1 -- 172.21.15.104:0/3736571769 wait complete. 2024-05-08T04:22:12.630 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-08T04:22:12.630 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:22:12.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.728+0000 7f622e6e1640 1 Processor -- start 2024-05-08T04:22:12.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.728+0000 7f622e6e1640 1 -- start start 2024-05-08T04:22:12.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f622e6e1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f622806ea40 0x7f62280b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f622e6e1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f62280b3ff0 0x7f62280b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f622e6e1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62280b49e0 con 0x7f62280ceee0 2024-05-08T04:22:12.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f622e6e1640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622815f390 con 0x7f62280b3ff0 2024-05-08T04:22:12.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f622e6e1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622815e780 con 0x7f622806ea40 2024-05-08T04:22:12.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f622cc7e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f62280b3ff0 0x7f62280b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f622cc7e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f62280b3ff0 0x7f62280b44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49954/0 (socket says 172.21.15.104:49954) 2024-05-08T04:22:12.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f622cc7e640 1 -- 172.21.15.104:0/3516818879 learned_addr learned my addr 172.21.15.104:0/3516818879 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:12.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f622cc7e640 1 -- 172.21.15.104:0/3516818879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f622806ea40 msgr2=0x7f62280b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:12.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f62277fe640 1 --2- 172.21.15.104:0/3516818879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f622806ea40 0x7f62280b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f622cc7e640 1 --2- 172.21.15.104:0/3516818879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f622806ea40 0x7f62280b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f622cc7e640 1 -- 172.21.15.104:0/3516818879 >> v1:172.21.15.183:6789/0 conn(0x7f62280ceee0 legacy=0x7f622806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:12.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f622cc7e640 1 -- 172.21.15.104:0/3516818879 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622815ea60 con 0x7f62280b3ff0 2024-05-08T04:22:12.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.729+0000 7f62277fe640 1 --2- 172.21.15.104:0/3516818879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f622806ea40 0x7f62280b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:12.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.730+0000 7f622cc7e640 1 --2- 172.21.15.104:0/3516818879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62280b3ff0 0x7f62280b44a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6220009e80 tx=0x7f622002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb566aa93f93d86 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:12.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.730+0000 7f6226ffd640 1 -- 172.21.15.104:0/3516818879 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220036070 con 0x7f62280b3ff0 2024-05-08T04:22:12.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.730+0000 7f6226ffd640 1 -- 172.21.15.104:0/3516818879 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6220031600 con 0x7f62280b3ff0 2024-05-08T04:22:12.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.730+0000 7f6226ffd640 1 -- 172.21.15.104:0/3516818879 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62200319d0 con 0x7f62280b3ff0 2024-05-08T04:22:12.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.731+0000 7f622e6e1640 1 -- 172.21.15.104:0/3516818879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62280b3ff0 msgr2=0x7f62280b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.731+0000 7f622e6e1640 1 --2- 172.21.15.104:0/3516818879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62280b3ff0 0x7f62280b44a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6220009e80 tx=0x7f622002a6f0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.731+0000 7f622e6e1640 1 -- 172.21.15.104:0/3516818879 shutdown_connections 2024-05-08T04:22:12.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.731+0000 7f622e6e1640 1 --2- 172.21.15.104:0/3516818879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62280b3ff0 0x7f62280b44a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.731+0000 7f622e6e1640 1 --2- 172.21.15.104:0/3516818879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f622806ea40 0x7f62280b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.731+0000 7f622e6e1640 1 -- 172.21.15.104:0/3516818879 >> 172.21.15.104:0/3516818879 conn(0x7f62280b13f0 msgr2=0x7f62280b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:12.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.731+0000 7f622e6e1640 1 -- 172.21.15.104:0/3516818879 shutdown_connections 2024-05-08T04:22:12.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.731+0000 7f622e6e1640 1 -- 172.21.15.104:0/3516818879 wait complete. 2024-05-08T04:22:12.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.732+0000 7f622e6e1640 1 Processor -- start 2024-05-08T04:22:12.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.732+0000 7f622e6e1640 1 -- start start 2024-05-08T04:22:12.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f622e6e1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f622806ea40 0x7f622815d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f622e6e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62280b3ff0 0x7f62281458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f622e6e1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62280ceee0 0x7f62280a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f622e6e1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62280cf2c0 con 0x7f62280b3ff0 2024-05-08T04:22:12.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f622e6e1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622815f020 con 0x7f622806ea40 2024-05-08T04:22:12.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f622e6e1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62280cf440 con 0x7f62280ceee0 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f62277fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62280b3ff0 0x7f62281458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f62277fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62280b3ff0 0x7f62281458e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49966/0 (socket says 172.21.15.104:49966) 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f62277fe640 1 -- 172.21.15.104:0/1363090861 learned_addr learned my addr 172.21.15.104:0/1363090861 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f622cc7e640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62280ceee0 0x7f62280a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f6227fff640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f622806ea40 0x7f622815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f62277fe640 1 -- 172.21.15.104:0/1363090861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62280ceee0 msgr2=0x7f62280a8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f62277fe640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62280ceee0 0x7f62280a8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f62277fe640 1 -- 172.21.15.104:0/1363090861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f622806ea40 msgr2=0x7f622815d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f62277fe640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f622806ea40 0x7f622815d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f62277fe640 1 -- 172.21.15.104:0/1363090861 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622815dc50 con 0x7f62280b3ff0 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f622cc7e640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62280ceee0 0x7f62280a8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f6227fff640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f622806ea40 0x7f622815d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f62277fe640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62280b3ff0 0x7f62281458e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c820 tx=0x7f621c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:12.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f6224ff9640 1 -- 172.21.15.104:0/1363090861 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c015070 con 0x7f62280b3ff0 2024-05-08T04:22:12.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f6224ff9640 1 -- 172.21.15.104:0/1363090861 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c007a30 con 0x7f62280b3ff0 2024-05-08T04:22:12.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f622e6e1640 1 -- 172.21.15.104:0/1363090861 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622815df30 con 0x7f62280b3ff0 2024-05-08T04:22:12.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f6224ff9640 1 -- 172.21.15.104:0/1363090861 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c007e00 con 0x7f62280b3ff0 2024-05-08T04:22:12.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.733+0000 7f622e6e1640 1 -- 172.21.15.104:0/1363090861 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622815d960 con 0x7f62280b3ff0 2024-05-08T04:22:12.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.734+0000 7f622e6e1640 1 -- 172.21.15.104:0/1363090861 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6228075010 con 0x7f62280b3ff0 2024-05-08T04:22:12.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.735+0000 7f6224ff9640 1 -- 172.21.15.104:0/1363090861 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f621c018070 con 0x7f62280b3ff0 2024-05-08T04:22:12.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.735+0000 7f6224ff9640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f621406b4d0 0x7f621406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:12.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.735+0000 7f6224ff9640 1 -- 172.21.15.104:0/1363090861 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f621c08a1e0 con 0x7f62280b3ff0 2024-05-08T04:22:12.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.735+0000 7f6227fff640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f621406b4d0 0x7f621406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:12.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.736+0000 7f6227fff640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f621406b4d0 0x7f621406d990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6218006fd0 tx=0x7f6218008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:12.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.739+0000 7f6224ff9640 1 -- 172.21.15.104:0/1363090861 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f621c059060 con 0x7f62280b3ff0 2024-05-08T04:22:12.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.906+0000 7f622e6e1640 1 -- 172.21.15.104:0/1363090861 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6228154820 con 0x7f621406b4d0 2024-05-08T04:22:12.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.912+0000 7f6224ff9640 1 -- 172.21.15.104:0/1363090861 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246634 (secure 0 0 0) 0x7f6228154820 con 0x7f621406b4d0 2024-05-08T04:22:12.917 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:12.918 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:22:12.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.915+0000 7f622e6e1640 1 -- 172.21.15.104:0/1363090861 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f621406b4d0 msgr2=0x7f621406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.915+0000 7f622e6e1640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f621406b4d0 0x7f621406d990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6218006fd0 tx=0x7f6218008040 comp rx=0 tx=0).stop 2024-05-08T04:22:12.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.915+0000 7f622e6e1640 1 -- 172.21.15.104:0/1363090861 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62280b3ff0 msgr2=0x7f62281458e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:12.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.915+0000 7f622e6e1640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62280b3ff0 0x7f62281458e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c820 tx=0x7f621c00cc20 comp rx=0 tx=0).stop 2024-05-08T04:22:12.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.915+0000 7f622e6e1640 1 -- 172.21.15.104:0/1363090861 shutdown_connections 2024-05-08T04:22:12.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.915+0000 7f622e6e1640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f621406b4d0 0x7f621406d990 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.915+0000 7f622e6e1640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62280ceee0 0x7f62280a8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.915+0000 7f622e6e1640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62280b3ff0 0x7f62281458e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.915+0000 7f622e6e1640 1 --2- 172.21.15.104:0/1363090861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f622806ea40 0x7f622815d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:12.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.915+0000 7f622e6e1640 1 -- 172.21.15.104:0/1363090861 >> 172.21.15.104:0/1363090861 conn(0x7f62280b13f0 msgr2=0x7f62280b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:12.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.915+0000 7f622e6e1640 1 -- 172.21.15.104:0/1363090861 shutdown_connections 2024-05-08T04:22:12.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:12.915+0000 7f622e6e1640 1 -- 172.21.15.104:0/1363090861 wait complete. 2024-05-08T04:22:12.928 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-05-08T04:22:12.648482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219944,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754776,"statfs":{"total":773094113280,"available":772868890624,"internally_reserved":0,"allocated":3874816,"data_stored":2194912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000896"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598877+0000","last_change":"2024-05-08T04:22:07.598877+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598877+0000","last_undegraded":"2024-05-08T04:22:07.598877+0000","last_fullsized":"2024-05-08T04:22:07.598877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591580+0000","last_change":"2024-05-08T04:22:07.591580+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591580+0000","last_undegraded":"2024-05-08T04:22:07.591580+0000","last_fullsized":"2024-05-08T04:22:07.591580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599870+0000","last_change":"2024-05-08T04:22:07.599870+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599870+0000","last_undegraded":"2024-05-08T04:22:07.599870+0000","last_fullsized":"2024-05-08T04:22:07.599870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.603655+0000","last_change":"2024-05-08T04:22:07.603655+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.603655+0000","last_undegraded":"2024-05-08T04:22:07.603655+0000","last_fullsized":"2024-05-08T04:22:07.603655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.592100+0000","last_change":"2024-05-08T04:22:07.592100+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.592100+0000","last_undegraded":"2024-05-08T04:22:07.592100+0000","last_fullsized":"2024-05-08T04:22:07.592100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.593923+0000","last_change":"2024-05-08T04:22:07.593923+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.593923+0000","last_undegraded":"2024-05-08T04:22:07.593923+0000","last_fullsized":"2024-05-08T04:22:07.593923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598863+0000","last_change":"2024-05-08T04:22:07.598863+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598863+0000","last_undegraded":"2024-05-08T04:22:07.598863+0000","last_fullsized":"2024-05-08T04:22:07.598863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598470+0000","last_change":"2024-05-08T04:22:07.598470+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598470+0000","last_undegraded":"2024-05-08T04:22:07.598470+0000","last_fullsized":"2024-05-08T04:22:07.598470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599509+0000","last_change":"2024-05-08T04:22:07.599509+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599509+0000","last_undegraded":"2024-05-08T04:22:07.599509+0000","last_fullsized":"2024-05-08T04:22:07.599509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.603785+0000","last_change":"2024-05-08T04:22:07.603785+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.603785+0000","last_undegraded":"2024-05-08T04:22:07.603785+0000","last_fullsized":"2024-05-08T04:22:07.603785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601173+0000","last_change":"2024-05-08T04:22:07.601173+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601173+0000","last_undegraded":"2024-05-08T04:22:07.601173+0000","last_fullsized":"2024-05-08T04:22:07.601173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599562+0000","last_change":"2024-05-08T04:22:07.599562+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599562+0000","last_undegraded":"2024-05-08T04:22:07.599562+0000","last_fullsized":"2024-05-08T04:22:07.599562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599301+0000","last_change":"2024-05-08T04:22:07.599301+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599301+0000","last_undegraded":"2024-05-08T04:22:07.599301+0000","last_fullsized":"2024-05-08T04:22:07.599301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.603583+0000","last_change":"2024-05-08T04:22:07.603583+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.603583+0000","last_undegraded":"2024-05-08T04:22:07.603583+0000","last_fullsized":"2024-05-08T04:22:07.603583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598743+0000","last_change":"2024-05-08T04:22:07.598743+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598743+0000","last_undegraded":"2024-05-08T04:22:07.598743+0000","last_fullsized":"2024-05-08T04:22:07.598743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598229+0000","last_change":"2024-05-08T04:22:07.598229+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598229+0000","last_undegraded":"2024-05-08T04:22:07.598229+0000","last_fullsized":"2024-05-08T04:22:07.598229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602514+0000","last_change":"2024-05-08T04:22:07.602514+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602514+0000","last_undegraded":"2024-05-08T04:22:07.602514+0000","last_fullsized":"2024-05-08T04:22:07.602514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.595546+0000","last_change":"2024-05-08T04:22:07.595546+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.595546+0000","last_undegraded":"2024-05-08T04:22:07.595546+0000","last_fullsized":"2024-05-08T04:22:07.595546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.595104+0000","last_change":"2024-05-08T04:22:07.595104+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.595104+0000","last_undegraded":"2024-05-08T04:22:07.595104+0000","last_fullsized":"2024-05-08T04:22:07.595104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.599209+0000","last_change":"2024-05-08T04:22:07.599209+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.599209+0000","last_undegraded":"2024-05-08T04:22:07.599209+0000","last_fullsized":"2024-05-08T04:22:07.599209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598675+0000","last_change":"2024-05-08T04:22:07.598675+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598675+0000","last_undegraded":"2024-05-08T04:22:07.598675+0000","last_fullsized":"2024-05-08T04:22:07.598675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598001+0000","last_change":"2024-05-08T04:22:07.598001+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598001+0000","last_undegraded":"2024-05-08T04:22:07.598001+0000","last_fullsized":"2024-05-08T04:22:07.598001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598363+0000","last_change":"2024-05-08T04:22:07.598363+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598363+0000","last_undegraded":"2024-05-08T04:22:07.598363+0000","last_fullsized":"2024-05-08T04:22:07.598363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597568+0000","last_change":"2024-05-08T04:22:07.597568+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597568+0000","last_undegraded":"2024-05-08T04:22:07.597568+0000","last_fullsized":"2024-05-08T04:22:07.597568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.604025+0000","last_change":"2024-05-08T04:22:07.604025+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.604025+0000","last_undegraded":"2024-05-08T04:22:07.604025+0000","last_fullsized":"2024-05-08T04:22:07.604025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602968+0000","last_change":"2024-05-08T04:22:07.602968+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602968+0000","last_undegraded":"2024-05-08T04:22:07.602968+0000","last_fullsized":"2024-05-08T04:22:07.602968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591026+0000","last_change":"2024-05-08T04:22:07.591026+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591026+0000","last_undegraded":"2024-05-08T04:22:07.591026+0000","last_fullsized":"2024-05-08T04:22:07.591026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597363+0000","last_change":"2024-05-08T04:22:07.597363+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597363+0000","last_undegraded":"2024-05-08T04:22:07.597363+0000","last_fullsized":"2024-05-08T04:22:07.597363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598205+0000","last_change":"2024-05-08T04:22:07.598205+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598205+0000","last_undegraded":"2024-05-08T04:22:07.598205+0000","last_fullsized":"2024-05-08T04:22:07.598205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597388+0000","last_change":"2024-05-08T04:22:07.597388+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597388+0000","last_undegraded":"2024-05-08T04:22:07.597388+0000","last_fullsized":"2024-05-08T04:22:07.597388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597398+0000","last_change":"2024-05-08T04:22:07.597398+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597398+0000","last_undegraded":"2024-05-08T04:22:07.597398+0000","last_fullsized":"2024-05-08T04:22:07.597398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600951+0000","last_change":"2024-05-08T04:22:07.600951+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600951+0000","last_undegraded":"2024-05-08T04:22:07.600951+0000","last_fullsized":"2024-05-08T04:22:07.600951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597972+0000","last_change":"2024-05-08T04:22:07.597972+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597972+0000","last_undegraded":"2024-05-08T04:22:07.597972+0000","last_fullsized":"2024-05-08T04:22:07.597972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612424+0000","last_change":"2024-05-08T04:22:07.608133+0000","last_active":"2024-05-08T04:22:07.612424+0000","last_peered":"2024-05-08T04:22:07.612424+0000","last_clean":"2024-05-08T04:22:07.612424+0000","last_became_active":"2024-05-08T04:22:07.607766+0000","last_became_peered":"2024-05-08T04:22:07.607766+0000","last_unstale":"2024-05-08T04:22:07.612424+0000","last_undegraded":"2024-05-08T04:22:07.612424+0000","last_fullsized":"2024-05-08T04:22:07.612424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:34:51.573503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597651+0000","last_change":"2024-05-08T04:22:07.597651+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597651+0000","last_undegraded":"2024-05-08T04:22:07.597651+0000","last_fullsized":"2024-05-08T04:22:07.597651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614390+0000","last_change":"2024-05-08T04:22:07.610820+0000","last_active":"2024-05-08T04:22:07.614390+0000","last_peered":"2024-05-08T04:22:07.614390+0000","last_clean":"2024-05-08T04:22:07.614390+0000","last_became_active":"2024-05-08T04:22:07.610602+0000","last_became_peered":"2024-05-08T04:22:07.610602+0000","last_unstale":"2024-05-08T04:22:07.614390+0000","last_undegraded":"2024-05-08T04:22:07.614390+0000","last_fullsized":"2024-05-08T04:22:07.614390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:12:21.539620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596898+0000","last_change":"2024-05-08T04:22:07.596898+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596898+0000","last_undegraded":"2024-05-08T04:22:07.596898+0000","last_fullsized":"2024-05-08T04:22:07.596898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.608779+0000","last_change":"2024-05-08T04:22:07.606521+0000","last_active":"2024-05-08T04:22:07.608779+0000","last_peered":"2024-05-08T04:22:07.608779+0000","last_clean":"2024-05-08T04:22:07.608779+0000","last_became_active":"2024-05-08T04:22:07.606168+0000","last_became_peered":"2024-05-08T04:22:07.606168+0000","last_unstale":"2024-05-08T04:22:07.608779+0000","last_undegraded":"2024-05-08T04:22:07.608779+0000","last_fullsized":"2024-05-08T04:22:07.608779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:33.286349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601750+0000","last_change":"2024-05-08T04:22:07.601750+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601750+0000","last_undegraded":"2024-05-08T04:22:07.601750+0000","last_fullsized":"2024-05-08T04:22:07.601750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613977+0000","last_change":"2024-05-08T04:22:07.607498+0000","last_active":"2024-05-08T04:22:07.613977+0000","last_peered":"2024-05-08T04:22:07.613977+0000","last_clean":"2024-05-08T04:22:07.613977+0000","last_became_active":"2024-05-08T04:22:07.607217+0000","last_became_peered":"2024-05-08T04:22:07.607217+0000","last_unstale":"2024-05-08T04:22:07.613977+0000","last_undegraded":"2024-05-08T04:22:07.613977+0000","last_fullsized":"2024-05-08T04:22:07.613977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:37.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598452+0000","last_change":"2024-05-08T04:22:07.598452+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598452+0000","last_undegraded":"2024-05-08T04:22:07.598452+0000","last_fullsized":"2024-05-08T04:22:07.598452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610469+0000","last_change":"2024-05-08T04:22:07.606651+0000","last_active":"2024-05-08T04:22:07.610469+0000","last_peered":"2024-05-08T04:22:07.610469+0000","last_clean":"2024-05-08T04:22:07.610469+0000","last_became_active":"2024-05-08T04:22:07.606386+0000","last_became_peered":"2024-05-08T04:22:07.606386+0000","last_unstale":"2024-05-08T04:22:07.610469+0000","last_undegraded":"2024-05-08T04:22:07.610469+0000","last_fullsized":"2024-05-08T04:22:07.610469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:27:15.090679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596862+0000","last_change":"2024-05-08T04:22:07.596862+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596862+0000","last_undegraded":"2024-05-08T04:22:07.596862+0000","last_fullsized":"2024-05-08T04:22:07.596862+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610235+0000","last_change":"2024-05-08T04:22:07.605296+0000","last_active":"2024-05-08T04:22:07.610235+0000","last_peered":"2024-05-08T04:22:07.610235+0000","last_clean":"2024-05-08T04:22:07.610235+0000","last_became_active":"2024-05-08T04:22:07.605050+0000","last_became_peered":"2024-05-08T04:22:07.605050+0000","last_unstale":"2024-05-08T04:22:07.610235+0000","last_undegraded":"2024-05-08T04:22:07.610235+0000","last_fullsized":"2024-05-08T04:22:07.610235+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:38:33.843667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597988+0000","last_change":"2024-05-08T04:22:07.597988+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597988+0000","last_undegraded":"2024-05-08T04:22:07.597988+0000","last_fullsized":"2024-05-08T04:22:07.597988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.608758+0000","last_change":"2024-05-08T04:22:07.606390+0000","last_active":"2024-05-08T04:22:07.608758+0000","last_peered":"2024-05-08T04:22:07.608758+0000","last_clean":"2024-05-08T04:22:07.608758+0000","last_became_active":"2024-05-08T04:22:07.606065+0000","last_became_peered":"2024-05-08T04:22:07.606065+0000","last_unstale":"2024-05-08T04:22:07.608758+0000","last_undegraded":"2024-05-08T04:22:07.608758+0000","last_fullsized":"2024-05-08T04:22:07.608758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:18.934495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601737+0000","last_change":"2024-05-08T04:22:07.601737+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601737+0000","last_undegraded":"2024-05-08T04:22:07.601737+0000","last_fullsized":"2024-05-08T04:22:07.601737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610272+0000","last_change":"2024-05-08T04:22:07.604688+0000","last_active":"2024-05-08T04:22:07.610272+0000","last_peered":"2024-05-08T04:22:07.610272+0000","last_clean":"2024-05-08T04:22:07.610272+0000","last_became_active":"2024-05-08T04:22:07.604437+0000","last_became_peered":"2024-05-08T04:22:07.604437+0000","last_unstale":"2024-05-08T04:22:07.610272+0000","last_undegraded":"2024-05-08T04:22:07.610272+0000","last_fullsized":"2024-05-08T04:22:07.610272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:35.814239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602087+0000","last_change":"2024-05-08T04:22:07.602087+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602087+0000","last_undegraded":"2024-05-08T04:22:07.602087+0000","last_fullsized":"2024-05-08T04:22:07.602087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.605419+0000","last_change":"2024-05-08T04:22:07.596652+0000","last_active":"2024-05-08T04:22:07.605419+0000","last_peered":"2024-05-08T04:22:07.605419+0000","last_clean":"2024-05-08T04:22:07.605419+0000","last_became_active":"2024-05-08T04:22:07.596330+0000","last_became_peered":"2024-05-08T04:22:07.596330+0000","last_unstale":"2024-05-08T04:22:07.605419+0000","last_undegraded":"2024-05-08T04:22:07.605419+0000","last_fullsized":"2024-05-08T04:22:07.605419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:09.248136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601843+0000","last_change":"2024-05-08T04:22:07.601843+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601843+0000","last_undegraded":"2024-05-08T04:22:07.601843+0000","last_fullsized":"2024-05-08T04:22:07.601843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.605466+0000","last_change":"2024-05-08T04:22:07.598633+0000","last_active":"2024-05-08T04:22:07.605466+0000","last_peered":"2024-05-08T04:22:07.605466+0000","last_clean":"2024-05-08T04:22:07.605466+0000","last_became_active":"2024-05-08T04:22:07.598319+0000","last_became_peered":"2024-05-08T04:22:07.598319+0000","last_unstale":"2024-05-08T04:22:07.605466+0000","last_undegraded":"2024-05-08T04:22:07.605466+0000","last_fullsized":"2024-05-08T04:22:07.605466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:39:07.152177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.602159+0000","last_change":"2024-05-08T04:22:07.602159+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.602159+0000","last_undegraded":"2024-05-08T04:22:07.602159+0000","last_fullsized":"2024-05-08T04:22:07.602159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.618257+0000","last_change":"2024-05-08T04:22:07.614017+0000","last_active":"2024-05-08T04:22:07.618257+0000","last_peered":"2024-05-08T04:22:07.618257+0000","last_clean":"2024-05-08T04:22:07.618257+0000","last_became_active":"2024-05-08T04:22:07.613730+0000","last_became_peered":"2024-05-08T04:22:07.613730+0000","last_unstale":"2024-05-08T04:22:07.618257+0000","last_undegraded":"2024-05-08T04:22:07.618257+0000","last_fullsized":"2024-05-08T04:22:07.618257+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:44:18.282843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601752+0000","last_change":"2024-05-08T04:22:07.601752+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601752+0000","last_undegraded":"2024-05-08T04:22:07.601752+0000","last_fullsized":"2024-05-08T04:22:07.601752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.607900+0000","last_change":"2024-05-08T04:22:07.604862+0000","last_active":"2024-05-08T04:22:07.607900+0000","last_peered":"2024-05-08T04:22:07.607900+0000","last_clean":"2024-05-08T04:22:07.607900+0000","last_became_active":"2024-05-08T04:22:07.604578+0000","last_became_peered":"2024-05-08T04:22:07.604578+0000","last_unstale":"2024-05-08T04:22:07.607900+0000","last_undegraded":"2024-05-08T04:22:07.607900+0000","last_fullsized":"2024-05-08T04:22:07.607900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:37.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598682+0000","last_change":"2024-05-08T04:22:07.598682+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598682+0000","last_undegraded":"2024-05-08T04:22:07.598682+0000","last_fullsized":"2024-05-08T04:22:07.598682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613349+0000","last_change":"2024-05-08T04:22:07.608202+0000","last_active":"2024-05-08T04:22:07.613349+0000","last_peered":"2024-05-08T04:22:07.613349+0000","last_clean":"2024-05-08T04:22:07.613349+0000","last_became_active":"2024-05-08T04:22:07.607933+0000","last_became_peered":"2024-05-08T04:22:07.607933+0000","last_unstale":"2024-05-08T04:22:07.613349+0000","last_undegraded":"2024-05-08T04:22:07.613349+0000","last_fullsized":"2024-05-08T04:22:07.613349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:19.196550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601201+0000","last_change":"2024-05-08T04:22:07.601201+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601201+0000","last_undegraded":"2024-05-08T04:22:07.601201+0000","last_fullsized":"2024-05-08T04:22:07.601201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614354+0000","last_change":"2024-05-08T04:22:07.610082+0000","last_active":"2024-05-08T04:22:07.614354+0000","last_peered":"2024-05-08T04:22:07.614354+0000","last_clean":"2024-05-08T04:22:07.614354+0000","last_became_active":"2024-05-08T04:22:07.609805+0000","last_became_peered":"2024-05-08T04:22:07.609805+0000","last_unstale":"2024-05-08T04:22:07.614354+0000","last_undegraded":"2024-05-08T04:22:07.614354+0000","last_fullsized":"2024-05-08T04:22:07.614354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:23.503181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596849+0000","last_change":"2024-05-08T04:22:07.596849+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596849+0000","last_undegraded":"2024-05-08T04:22:07.596849+0000","last_fullsized":"2024-05-08T04:22:07.596849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.616885+0000","last_change":"2024-05-08T04:22:07.613948+0000","last_active":"2024-05-08T04:22:07.616885+0000","last_peered":"2024-05-08T04:22:07.616885+0000","last_clean":"2024-05-08T04:22:07.616885+0000","last_became_active":"2024-05-08T04:22:07.613685+0000","last_became_peered":"2024-05-08T04:22:07.613685+0000","last_unstale":"2024-05-08T04:22:07.616885+0000","last_undegraded":"2024-05-08T04:22:07.616885+0000","last_fullsized":"2024-05-08T04:22:07.616885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:48:25.191717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600995+0000","last_change":"2024-05-08T04:22:07.600995+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600995+0000","last_undegraded":"2024-05-08T04:22:07.600995+0000","last_fullsized":"2024-05-08T04:22:07.600995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614140+0000","last_change":"2024-05-08T04:22:07.608520+0000","last_active":"2024-05-08T04:22:07.614140+0000","last_peered":"2024-05-08T04:22:07.614140+0000","last_clean":"2024-05-08T04:22:07.614140+0000","last_became_active":"2024-05-08T04:22:07.608215+0000","last_became_peered":"2024-05-08T04:22:07.608215+0000","last_unstale":"2024-05-08T04:22:07.614140+0000","last_undegraded":"2024-05-08T04:22:07.614140+0000","last_fullsized":"2024-05-08T04:22:07.614140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:30:41.000788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.601645+0000","last_change":"2024-05-08T04:22:07.601645+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.601645+0000","last_undegraded":"2024-05-08T04:22:07.601645+0000","last_fullsized":"2024-05-08T04:22:07.601645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.608708+0000","last_change":"2024-05-08T04:22:07.606016+0000","last_active":"2024-05-08T04:22:07.608708+0000","last_peered":"2024-05-08T04:22:07.608708+0000","last_clean":"2024-05-08T04:22:07.608708+0000","last_became_active":"2024-05-08T04:22:07.605696+0000","last_became_peered":"2024-05-08T04:22:07.605696+0000","last_unstale":"2024-05-08T04:22:07.608708+0000","last_undegraded":"2024-05-08T04:22:07.608708+0000","last_fullsized":"2024-05-08T04:22:07.608708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:57.965625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598911+0000","last_change":"2024-05-08T04:22:07.598911+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598911+0000","last_undegraded":"2024-05-08T04:22:07.598911+0000","last_fullsized":"2024-05-08T04:22:07.598911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613388+0000","last_change":"2024-05-08T04:22:07.608876+0000","last_active":"2024-05-08T04:22:07.613388+0000","last_peered":"2024-05-08T04:22:07.613388+0000","last_clean":"2024-05-08T04:22:07.613388+0000","last_became_active":"2024-05-08T04:22:07.607923+0000","last_became_peered":"2024-05-08T04:22:07.607923+0000","last_unstale":"2024-05-08T04:22:07.613388+0000","last_undegraded":"2024-05-08T04:22:07.613388+0000","last_fullsized":"2024-05-08T04:22:07.613388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:37.547338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591144+0000","last_change":"2024-05-08T04:22:07.591144+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591144+0000","last_undegraded":"2024-05-08T04:22:07.591144+0000","last_fullsized":"2024-05-08T04:22:07.591144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612388+0000","last_change":"2024-05-08T04:22:07.607881+0000","last_active":"2024-05-08T04:22:07.612388+0000","last_peered":"2024-05-08T04:22:07.612388+0000","last_clean":"2024-05-08T04:22:07.612388+0000","last_became_active":"2024-05-08T04:22:07.607596+0000","last_became_peered":"2024-05-08T04:22:07.607596+0000","last_unstale":"2024-05-08T04:22:07.612388+0000","last_undegraded":"2024-05-08T04:22:07.612388+0000","last_fullsized":"2024-05-08T04:22:07.612388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:31:16.484162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.594609+0000","last_change":"2024-05-08T04:22:07.594609+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.594609+0000","last_undegraded":"2024-05-08T04:22:07.594609+0000","last_fullsized":"2024-05-08T04:22:07.594609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613403+0000","last_change":"2024-05-08T04:22:07.606217+0000","last_active":"2024-05-08T04:22:07.613403+0000","last_peered":"2024-05-08T04:22:07.613403+0000","last_clean":"2024-05-08T04:22:07.613403+0000","last_became_active":"2024-05-08T04:22:07.605718+0000","last_became_peered":"2024-05-08T04:22:07.605718+0000","last_unstale":"2024-05-08T04:22:07.613403+0000","last_undegraded":"2024-05-08T04:22:07.613403+0000","last_fullsized":"2024-05-08T04:22:07.613403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:39:07.152177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598204+0000","last_change":"2024-05-08T04:22:07.598204+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598204+0000","last_undegraded":"2024-05-08T04:22:07.598204+0000","last_fullsized":"2024-05-08T04:22:07.598204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.606221+0000","last_change":"2024-05-08T04:22:07.604104+0000","last_active":"2024-05-08T04:22:07.606221+0000","last_peered":"2024-05-08T04:22:07.606221+0000","last_clean":"2024-05-08T04:22:07.606221+0000","last_became_active":"2024-05-08T04:22:07.603790+0000","last_became_peered":"2024-05-08T04:22:07.603790+0000","last_unstale":"2024-05-08T04:22:07.606221+0000","last_undegraded":"2024-05-08T04:22:07.606221+0000","last_fullsized":"2024-05-08T04:22:07.606221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:41.097192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.591573+0000","last_change":"2024-05-08T04:22:07.591573+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.591573+0000","last_undegraded":"2024-05-08T04:22:07.591573+0000","last_fullsized":"2024-05-08T04:22:07.591573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613415+0000","last_change":"2024-05-08T04:22:07.609907+0000","last_active":"2024-05-08T04:22:07.613415+0000","last_peered":"2024-05-08T04:22:07.613415+0000","last_clean":"2024-05-08T04:22:07.613415+0000","last_became_active":"2024-05-08T04:22:07.609656+0000","last_became_peered":"2024-05-08T04:22:07.609656+0000","last_unstale":"2024-05-08T04:22:07.613415+0000","last_undegraded":"2024-05-08T04:22:07.613415+0000","last_fullsized":"2024-05-08T04:22:07.613415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:23.503181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597335+0000","last_change":"2024-05-08T04:22:07.597335+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597335+0000","last_undegraded":"2024-05-08T04:22:07.597335+0000","last_fullsized":"2024-05-08T04:22:07.597335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.610267+0000","last_change":"2024-05-08T04:22:07.606077+0000","last_active":"2024-05-08T04:22:07.610267+0000","last_peered":"2024-05-08T04:22:07.610267+0000","last_clean":"2024-05-08T04:22:07.610267+0000","last_became_active":"2024-05-08T04:22:07.605826+0000","last_became_peered":"2024-05-08T04:22:07.605826+0000","last_unstale":"2024-05-08T04:22:07.610267+0000","last_undegraded":"2024-05-08T04:22:07.610267+0000","last_fullsized":"2024-05-08T04:22:07.610267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:30:41.000788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.597115+0000","last_change":"2024-05-08T04:22:07.597115+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.597115+0000","last_undegraded":"2024-05-08T04:22:07.597115+0000","last_fullsized":"2024-05-08T04:22:07.597115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612748+0000","last_change":"2024-05-08T04:22:07.609551+0000","last_active":"2024-05-08T04:22:07.612748+0000","last_peered":"2024-05-08T04:22:07.612748+0000","last_clean":"2024-05-08T04:22:07.612748+0000","last_became_active":"2024-05-08T04:22:07.609262+0000","last_became_peered":"2024-05-08T04:22:07.609262+0000","last_unstale":"2024-05-08T04:22:07.612748+0000","last_undegraded":"2024-05-08T04:22:07.612748+0000","last_fullsized":"2024-05-08T04:22:07.612748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:00.284324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.595079+0000","last_change":"2024-05-08T04:22:07.595079+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.595079+0000","last_undegraded":"2024-05-08T04:22:07.595079+0000","last_fullsized":"2024-05-08T04:22:07.595079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.607715+0000","last_change":"2024-05-08T04:22:07.602513+0000","last_active":"2024-05-08T04:22:07.607715+0000","last_peered":"2024-05-08T04:22:07.607715+0000","last_clean":"2024-05-08T04:22:07.607715+0000","last_became_active":"2024-05-08T04:22:07.601926+0000","last_became_peered":"2024-05-08T04:22:07.601926+0000","last_unstale":"2024-05-08T04:22:07.607715+0000","last_undegraded":"2024-05-08T04:22:07.607715+0000","last_fullsized":"2024-05-08T04:22:07.607715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:19.196550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600899+0000","last_change":"2024-05-08T04:22:07.600899+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600899+0000","last_undegraded":"2024-05-08T04:22:07.600899+0000","last_fullsized":"2024-05-08T04:22:07.600899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.605487+0000","last_change":"2024-05-08T04:22:07.599148+0000","last_active":"2024-05-08T04:22:07.605487+0000","last_peered":"2024-05-08T04:22:07.605487+0000","last_clean":"2024-05-08T04:22:07.605487+0000","last_became_active":"2024-05-08T04:22:07.598845+0000","last_became_peered":"2024-05-08T04:22:07.598845+0000","last_unstale":"2024-05-08T04:22:07.605487+0000","last_undegraded":"2024-05-08T04:22:07.605487+0000","last_fullsized":"2024-05-08T04:22:07.605487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:25:46.596230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.593974+0000","last_change":"2024-05-08T04:22:07.593974+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.593974+0000","last_undegraded":"2024-05-08T04:22:07.593974+0000","last_fullsized":"2024-05-08T04:22:07.593974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613913+0000","last_change":"2024-05-08T04:22:07.607364+0000","last_active":"2024-05-08T04:22:07.613913+0000","last_peered":"2024-05-08T04:22:07.613913+0000","last_clean":"2024-05-08T04:22:07.613913+0000","last_became_active":"2024-05-08T04:22:07.607023+0000","last_became_peered":"2024-05-08T04:22:07.607023+0000","last_unstale":"2024-05-08T04:22:07.613913+0000","last_undegraded":"2024-05-08T04:22:07.613913+0000","last_fullsized":"2024-05-08T04:22:07.613913+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:23.503181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596759+0000","last_change":"2024-05-08T04:22:07.596759+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596759+0000","last_undegraded":"2024-05-08T04:22:07.596759+0000","last_fullsized":"2024-05-08T04:22:07.596759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.607787+0000","last_change":"2024-05-08T04:22:07.602890+0000","last_active":"2024-05-08T04:22:07.607787+0000","last_peered":"2024-05-08T04:22:07.607787+0000","last_clean":"2024-05-08T04:22:07.607787+0000","last_became_active":"2024-05-08T04:22:07.602498+0000","last_became_peered":"2024-05-08T04:22:07.602498+0000","last_unstale":"2024-05-08T04:22:07.607787+0000","last_undegraded":"2024-05-08T04:22:07.607787+0000","last_fullsized":"2024-05-08T04:22:07.607787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:43.886509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600256+0000","last_change":"2024-05-08T04:22:07.600256+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600256+0000","last_undegraded":"2024-05-08T04:22:07.600256+0000","last_fullsized":"2024-05-08T04:22:07.600256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614329+0000","last_change":"2024-05-08T04:22:07.609908+0000","last_active":"2024-05-08T04:22:07.614329+0000","last_peered":"2024-05-08T04:22:07.614329+0000","last_clean":"2024-05-08T04:22:07.614329+0000","last_became_active":"2024-05-08T04:22:07.609669+0000","last_became_peered":"2024-05-08T04:22:07.609669+0000","last_unstale":"2024-05-08T04:22:07.614329+0000","last_undegraded":"2024-05-08T04:22:07.614329+0000","last_fullsized":"2024-05-08T04:22:07.614329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:28.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.598788+0000","last_change":"2024-05-08T04:22:07.598788+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.598788+0000","last_undegraded":"2024-05-08T04:22:07.598788+0000","last_fullsized":"2024-05-08T04:22:07.598788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.613387+0000","last_change":"2024-05-08T04:22:07.608739+0000","last_active":"2024-05-08T04:22:07.613387+0000","last_peered":"2024-05-08T04:22:07.613387+0000","last_clean":"2024-05-08T04:22:07.613387+0000","last_became_active":"2024-05-08T04:22:07.608391+0000","last_became_peered":"2024-05-08T04:22:07.608391+0000","last_unstale":"2024-05-08T04:22:07.613387+0000","last_undegraded":"2024-05-08T04:22:07.613387+0000","last_fullsized":"2024-05-08T04:22:07.613387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:43.886509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.600514+0000","last_change":"2024-05-08T04:22:07.600514+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.600514+0000","last_undegraded":"2024-05-08T04:22:07.600514+0000","last_fullsized":"2024-05-08T04:22:07.600514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.614386+0000","last_change":"2024-05-08T04:22:07.610730+0000","last_active":"2024-05-08T04:22:07.614386+0000","last_peered":"2024-05-08T04:22:07.614386+0000","last_clean":"2024-05-08T04:22:07.614386+0000","last_became_active":"2024-05-08T04:22:07.610527+0000","last_became_peered":"2024-05-08T04:22:07.610527+0000","last_unstale":"2024-05-08T04:22:07.614386+0000","last_undegraded":"2024-05-08T04:22:07.614386+0000","last_fullsized":"2024-05-08T04:22:07.614386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:28.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-05-08T04:22:07.596752+0000","last_change":"2024-05-08T04:22:07.596752+0000","last_active":"2024-05-08T04:22:07.581217+0000","last_peered":"2024-05-08T04:22:07.581217+0000","last_clean":"2024-05-08T04:22:07.581217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:07.596752+0000","last_undegraded":"2024-05-08T04:22:07.596752+0000","last_fullsized":"2024-05-08T04:22:07.596752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.612816+0000","last_change":"2024-05-08T04:22:07.611008+0000","last_active":"2024-05-08T04:22:07.612816+0000","last_peered":"2024-05-08T04:22:07.612816+0000","last_clean":"2024-05-08T04:22:07.612816+0000","last_became_active":"2024-05-08T04:22:07.610754+0000","last_became_peered":"2024-05-08T04:22:07.610754+0000","last_unstale":"2024-05-08T04:22:07.612816+0000","last_undegraded":"2024-05-08T04:22:07.612816+0000","last_fullsized":"2024-05-08T04:22:07.612816+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:25:28.841648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-08T04:22:07.593372+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:22:07.593372+0000","last_peered":"2024-05-08T04:22:07.593372+0000","last_clean":"2024-05-08T04:22:07.593372+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:22:07.593372+0000","last_undegraded":"2024-05-08T04:22:07.593372+0000","last_fullsized":"2024-05-08T04:22:07.593372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":126772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:22:13.021 INFO:tasks.ceph.mds.a.smithi104.stderr:2024-05-08T04:22:13.020+0000 7eff42c93640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T04:22:15.932 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:22:16.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.043+0000 7f253b35c640 1 Processor -- start 2024-05-08T04:22:16.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.043+0000 7f253b35c640 1 -- start start 2024-05-08T04:22:16.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.044+0000 7f253b35c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2534070c70 0x7f2534071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.044+0000 7f253b35c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2534157ac0 0x7f2534157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.044+0000 7f253b35c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2534071590 con 0x7f253415edf0 2024-05-08T04:22:16.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.044+0000 7f253b35c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253406bc70 con 0x7f2534157ac0 2024-05-08T04:22:16.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.044+0000 7f253b35c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25340d15c0 con 0x7f2534070c70 2024-05-08T04:22:16.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.044+0000 7f25398f9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2534157ac0 0x7f2534157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.044+0000 7f25398f9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2534157ac0 0x7f2534157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49976/0 (socket says 172.21.15.104:49976) 2024-05-08T04:22:16.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.044+0000 7f25398f9640 1 -- 172.21.15.104:0/3483231158 learned_addr learned my addr 172.21.15.104:0/3483231158 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:16.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.044+0000 7f25390f8640 1 --2- 172.21.15.104:0/3483231158 >> v2:172.21.15.183:3300/0 conn(0x7f2534070c70 0x7f2534071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.045+0000 7f25398f9640 1 -- 172.21.15.104:0/3483231158 >> v2:172.21.15.183:3300/0 conn(0x7f2534070c70 msgr2=0x7f2534071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:16.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.045+0000 7f25398f9640 1 --2- 172.21.15.104:0/3483231158 >> v2:172.21.15.183:3300/0 conn(0x7f2534070c70 0x7f2534071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.045+0000 7f25398f9640 1 -- 172.21.15.104:0/3483231158 >> v1:172.21.15.183:6789/0 conn(0x7f253415edf0 legacy=0x7f25340b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.045+0000 7f25398f9640 1 -- 172.21.15.104:0/3483231158 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253415f550 con 0x7f2534157ac0 2024-05-08T04:22:16.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.045+0000 7f25398f9640 1 --2- 172.21.15.104:0/3483231158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2534157ac0 0x7f2534157f10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2534071f80 tx=0x7f252c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8017bc97ac60593a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:16.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.046+0000 7f252bfff640 1 -- 172.21.15.104:0/3483231158 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c037070 con 0x7f2534157ac0 2024-05-08T04:22:16.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.046+0000 7f252bfff640 1 -- 172.21.15.104:0/3483231158 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c032440 con 0x7f2534157ac0 2024-05-08T04:22:16.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.046+0000 7f252bfff640 1 -- 172.21.15.104:0/3483231158 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c032810 con 0x7f2534157ac0 2024-05-08T04:22:16.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.046+0000 7f253b35c640 1 -- 172.21.15.104:0/3483231158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2534157ac0 msgr2=0x7f2534157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.046+0000 7f253b35c640 1 --2- 172.21.15.104:0/3483231158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2534157ac0 0x7f2534157f10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2534071f80 tx=0x7f252c02a270 comp rx=0 tx=0).stop 2024-05-08T04:22:16.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.046+0000 7f253b35c640 1 -- 172.21.15.104:0/3483231158 shutdown_connections 2024-05-08T04:22:16.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.046+0000 7f253b35c640 1 --2- 172.21.15.104:0/3483231158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2534157ac0 0x7f2534157f10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.046+0000 7f253b35c640 1 --2- 172.21.15.104:0/3483231158 >> v2:172.21.15.183:3300/0 conn(0x7f2534070c70 0x7f2534071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.046+0000 7f253b35c640 1 -- 172.21.15.104:0/3483231158 >> 172.21.15.104:0/3483231158 conn(0x7f25340b3450 msgr2=0x7f25340b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:16.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.046+0000 7f253b35c640 1 -- 172.21.15.104:0/3483231158 shutdown_connections 2024-05-08T04:22:16.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.046+0000 7f253b35c640 1 -- 172.21.15.104:0/3483231158 wait complete. 2024-05-08T04:22:16.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.047+0000 7f253b35c640 1 Processor -- start 2024-05-08T04:22:16.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.047+0000 7f253b35c640 1 -- start start 2024-05-08T04:22:16.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.048+0000 7f253b35c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2534070c70 0x7f253415a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.048+0000 7f253b35c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2534157ac0 0x7f25340b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.048+0000 7f253b35c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f253415edf0 0x7f25340b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.048+0000 7f253b35c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25340b5b80 con 0x7f253415edf0 2024-05-08T04:22:16.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.048+0000 7f253b35c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253415fb10 con 0x7f2534070c70 2024-05-08T04:22:16.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.048+0000 7f253b35c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2534158450 con 0x7f2534157ac0 2024-05-08T04:22:16.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.048+0000 7f25398f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f253415edf0 0x7f25340b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.048+0000 7f25398f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f253415edf0 0x7f25340b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49988/0 (socket says 172.21.15.104:49988) 2024-05-08T04:22:16.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.048+0000 7f25398f9640 1 -- 172.21.15.104:0/3002069186 learned_addr learned my addr 172.21.15.104:0/3002069186 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:16.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.048+0000 7f25390f8640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2534070c70 0x7f253415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.049+0000 7f25388f7640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2534157ac0 0x7f25340b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.049+0000 7f25398f9640 1 -- 172.21.15.104:0/3002069186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2534157ac0 msgr2=0x7f25340b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.049+0000 7f25398f9640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2534157ac0 0x7f25340b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.049+0000 7f25398f9640 1 -- 172.21.15.104:0/3002069186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2534070c70 msgr2=0x7f253415a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.049+0000 7f25398f9640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2534070c70 0x7f253415a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.049+0000 7f25398f9640 1 -- 172.21.15.104:0/3002069186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534160310 con 0x7f253415edf0 2024-05-08T04:22:16.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.049+0000 7f25390f8640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2534070c70 0x7f253415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:16.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.049+0000 7f25398f9640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f253415edf0 0x7f25340b1da0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f252c0090b0 tx=0x7f252c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:16.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.049+0000 7f2529ffb640 1 -- 172.21.15.104:0/3002069186 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c041020 con 0x7f253415edf0 2024-05-08T04:22:16.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.049+0000 7f2529ffb640 1 -- 172.21.15.104:0/3002069186 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c03d640 con 0x7f253415edf0 2024-05-08T04:22:16.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.049+0000 7f253b35c640 1 -- 172.21.15.104:0/3002069186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25341605f0 con 0x7f253415edf0 2024-05-08T04:22:16.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.049+0000 7f2529ffb640 1 -- 172.21.15.104:0/3002069186 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c037040 con 0x7f253415edf0 2024-05-08T04:22:16.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.049+0000 7f253b35c640 1 -- 172.21.15.104:0/3002069186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2534160bb0 con 0x7f253415edf0 2024-05-08T04:22:16.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.050+0000 7f253b35c640 1 -- 172.21.15.104:0/3002069186 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253406aff0 con 0x7f253415edf0 2024-05-08T04:22:16.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.051+0000 7f2529ffb640 1 -- 172.21.15.104:0/3002069186 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f252c044020 con 0x7f253415edf0 2024-05-08T04:22:16.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.051+0000 7f2529ffb640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f251806b4d0 0x7f251806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.051+0000 7f2529ffb640 1 -- 172.21.15.104:0/3002069186 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f252c0aa970 con 0x7f253415edf0 2024-05-08T04:22:16.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.051+0000 7f25390f8640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f251806b4d0 0x7f251806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.052+0000 7f25390f8640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f251806b4d0 0x7f251806d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f25300074c0 tx=0x7f253000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:16.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.056+0000 7f2529ffb640 1 -- 172.21.15.104:0/3002069186 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f253406aff0 con 0x7f253415edf0 2024-05-08T04:22:16.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.222+0000 7f253b35c640 1 -- 172.21.15.104:0/3002069186 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25340683d0 con 0x7f251806b4d0 2024-05-08T04:22:16.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.228+0000 7f2529ffb640 1 -- 172.21.15.104:0/3002069186 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251955 (secure 0 0 0) 0x7f2530003990 con 0x7f251806b4d0 2024-05-08T04:22:16.232 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:16.233 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:22:16.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.231+0000 7f253b35c640 1 -- 172.21.15.104:0/3002069186 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f251806b4d0 msgr2=0x7f251806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.231+0000 7f253b35c640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f251806b4d0 0x7f251806d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f25300074c0 tx=0x7f253000b040 comp rx=0 tx=0).stop 2024-05-08T04:22:16.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.231+0000 7f253b35c640 1 -- 172.21.15.104:0/3002069186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f253415edf0 msgr2=0x7f25340b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.231+0000 7f253b35c640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f253415edf0 0x7f25340b1da0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f252c0090b0 tx=0x7f252c0046c0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.231+0000 7f253b35c640 1 -- 172.21.15.104:0/3002069186 shutdown_connections 2024-05-08T04:22:16.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.231+0000 7f253b35c640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f251806b4d0 0x7f251806d990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.231+0000 7f253b35c640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f253415edf0 0x7f25340b1da0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.231+0000 7f253b35c640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2534157ac0 0x7f25340b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.231+0000 7f253b35c640 1 --2- 172.21.15.104:0/3002069186 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2534070c70 0x7f253415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.231+0000 7f253b35c640 1 -- 172.21.15.104:0/3002069186 >> 172.21.15.104:0/3002069186 conn(0x7f25340b3450 msgr2=0x7f253415c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:16.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.231+0000 7f253b35c640 1 -- 172.21.15.104:0/3002069186 shutdown_connections 2024-05-08T04:22:16.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.231+0000 7f253b35c640 1 -- 172.21.15.104:0/3002069186 wait complete. 2024-05-08T04:22:16.244 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-05-08T04:22:14.648818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220316,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754404,"statfs":{"total":773094113280,"available":772868509696,"internally_reserved":0,"allocated":4235264,"data_stored":2354532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.058121"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117215+0000","last_change":"2024-05-08T04:22:08.603699+0000","last_active":"2024-05-08T04:22:11.117215+0000","last_peered":"2024-05-08T04:22:11.117215+0000","last_clean":"2024-05-08T04:22:11.117215+0000","last_became_active":"2024-05-08T04:22:08.603413+0000","last_became_peered":"2024-05-08T04:22:08.603413+0000","last_unstale":"2024-05-08T04:22:11.117215+0000","last_undegraded":"2024-05-08T04:22:11.117215+0000","last_fullsized":"2024-05-08T04:22:11.117215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:51:35.712252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.613358+0000","last_change":"2024-05-08T04:22:08.609059+0000","last_active":"2024-05-08T04:22:09.613358+0000","last_peered":"2024-05-08T04:22:09.613358+0000","last_clean":"2024-05-08T04:22:09.613358+0000","last_became_active":"2024-05-08T04:22:08.608599+0000","last_became_peered":"2024-05-08T04:22:08.608599+0000","last_unstale":"2024-05-08T04:22:09.613358+0000","last_undegraded":"2024-05-08T04:22:09.613358+0000","last_fullsized":"2024-05-08T04:22:09.613358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:00:46.553650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.368938+0000","last_change":"2024-05-08T04:22:08.620055+0000","last_active":"2024-05-08T04:22:10.368938+0000","last_peered":"2024-05-08T04:22:10.368938+0000","last_clean":"2024-05-08T04:22:10.368938+0000","last_became_active":"2024-05-08T04:22:08.619762+0000","last_became_peered":"2024-05-08T04:22:08.619762+0000","last_unstale":"2024-05-08T04:22:10.368938+0000","last_undegraded":"2024-05-08T04:22:10.368938+0000","last_fullsized":"2024-05-08T04:22:10.368938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:06:57.063043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034494+0000","last_change":"2024-05-08T04:22:08.617850+0000","last_active":"2024-05-08T04:22:10.034494+0000","last_peered":"2024-05-08T04:22:10.034494+0000","last_clean":"2024-05-08T04:22:10.034494+0000","last_became_active":"2024-05-08T04:22:08.617315+0000","last_became_peered":"2024-05-08T04:22:08.617315+0000","last_unstale":"2024-05-08T04:22:10.034494+0000","last_undegraded":"2024-05-08T04:22:10.034494+0000","last_fullsized":"2024-05-08T04:22:10.034494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:23.863130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.613122+0000","last_change":"2024-05-08T04:22:08.601686+0000","last_active":"2024-05-08T04:22:09.613122+0000","last_peered":"2024-05-08T04:22:09.613122+0000","last_clean":"2024-05-08T04:22:09.613122+0000","last_became_active":"2024-05-08T04:22:08.601386+0000","last_became_peered":"2024-05-08T04:22:08.601386+0000","last_unstale":"2024-05-08T04:22:09.613122+0000","last_undegraded":"2024-05-08T04:22:09.613122+0000","last_fullsized":"2024-05-08T04:22:09.613122+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:44:19.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.596857+0000","last_change":"2024-05-08T04:22:08.620840+0000","last_active":"2024-05-08T04:22:10.596857+0000","last_peered":"2024-05-08T04:22:10.596857+0000","last_clean":"2024-05-08T04:22:10.596857+0000","last_became_active":"2024-05-08T04:22:08.620599+0000","last_became_peered":"2024-05-08T04:22:08.620599+0000","last_unstale":"2024-05-08T04:22:10.596857+0000","last_undegraded":"2024-05-08T04:22:10.596857+0000","last_fullsized":"2024-05-08T04:22:10.596857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:20:13.282623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117093+0000","last_change":"2024-05-08T04:22:08.614324+0000","last_active":"2024-05-08T04:22:11.117093+0000","last_peered":"2024-05-08T04:22:11.117093+0000","last_clean":"2024-05-08T04:22:11.117093+0000","last_became_active":"2024-05-08T04:22:08.614041+0000","last_became_peered":"2024-05-08T04:22:08.614041+0000","last_unstale":"2024-05-08T04:22:11.117093+0000","last_undegraded":"2024-05-08T04:22:11.117093+0000","last_fullsized":"2024-05-08T04:22:11.117093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:25:29.845836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.116955+0000","last_change":"2024-05-08T04:22:08.612491+0000","last_active":"2024-05-08T04:22:11.116955+0000","last_peered":"2024-05-08T04:22:11.116955+0000","last_clean":"2024-05-08T04:22:11.116955+0000","last_became_active":"2024-05-08T04:22:08.612210+0000","last_became_peered":"2024-05-08T04:22:08.612210+0000","last_unstale":"2024-05-08T04:22:11.116955+0000","last_undegraded":"2024-05-08T04:22:11.116955+0000","last_fullsized":"2024-05-08T04:22:11.116955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:34:52.577692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.368907+0000","last_change":"2024-05-08T04:22:08.616391+0000","last_active":"2024-05-08T04:22:10.368907+0000","last_peered":"2024-05-08T04:22:10.368907+0000","last_clean":"2024-05-08T04:22:10.368907+0000","last_became_active":"2024-05-08T04:22:08.616116+0000","last_became_peered":"2024-05-08T04:22:08.616116+0000","last_unstale":"2024-05-08T04:22:10.368907+0000","last_undegraded":"2024-05-08T04:22:10.368907+0000","last_fullsized":"2024-05-08T04:22:10.368907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:58:18.922928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034572+0000","last_change":"2024-05-08T04:22:08.606391+0000","last_active":"2024-05-08T04:22:10.034572+0000","last_peered":"2024-05-08T04:22:10.034572+0000","last_clean":"2024-05-08T04:22:10.034572+0000","last_became_active":"2024-05-08T04:22:08.605168+0000","last_became_peered":"2024-05-08T04:22:08.605168+0000","last_unstale":"2024-05-08T04:22:10.034572+0000","last_undegraded":"2024-05-08T04:22:10.034572+0000","last_fullsized":"2024-05-08T04:22:10.034572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:32:15.196191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.118106+0000","last_change":"2024-05-08T04:22:08.607895+0000","last_active":"2024-05-08T04:22:11.118106+0000","last_peered":"2024-05-08T04:22:11.118106+0000","last_clean":"2024-05-08T04:22:11.118106+0000","last_became_active":"2024-05-08T04:22:08.607611+0000","last_became_peered":"2024-05-08T04:22:08.607611+0000","last_unstale":"2024-05-08T04:22:11.118106+0000","last_undegraded":"2024-05-08T04:22:11.118106+0000","last_fullsized":"2024-05-08T04:22:11.118106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:10:33.130976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.368898+0000","last_change":"2024-05-08T04:22:08.620247+0000","last_active":"2024-05-08T04:22:10.368898+0000","last_peered":"2024-05-08T04:22:10.368898+0000","last_clean":"2024-05-08T04:22:10.368898+0000","last_became_active":"2024-05-08T04:22:08.619984+0000","last_became_peered":"2024-05-08T04:22:08.619984+0000","last_unstale":"2024-05-08T04:22:10.368898+0000","last_undegraded":"2024-05-08T04:22:10.368898+0000","last_fullsized":"2024-05-08T04:22:10.368898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:20:13.282623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117904+0000","last_change":"2024-05-08T04:22:08.615598+0000","last_active":"2024-05-08T04:22:11.117904+0000","last_peered":"2024-05-08T04:22:11.117904+0000","last_clean":"2024-05-08T04:22:11.117904+0000","last_became_active":"2024-05-08T04:22:08.615193+0000","last_became_peered":"2024-05-08T04:22:08.615193+0000","last_unstale":"2024-05-08T04:22:11.117904+0000","last_undegraded":"2024-05-08T04:22:11.117904+0000","last_fullsized":"2024-05-08T04:22:11.117904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:34:52.577692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034207+0000","last_change":"2024-05-08T04:22:08.608860+0000","last_active":"2024-05-08T04:22:10.034207+0000","last_peered":"2024-05-08T04:22:10.034207+0000","last_clean":"2024-05-08T04:22:10.034207+0000","last_became_active":"2024-05-08T04:22:08.603700+0000","last_became_peered":"2024-05-08T04:22:08.603700+0000","last_unstale":"2024-05-08T04:22:10.034207+0000","last_undegraded":"2024-05-08T04:22:10.034207+0000","last_fullsized":"2024-05-08T04:22:10.034207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:00:46.553650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.607937+0000","last_change":"2024-05-08T04:22:08.618440+0000","last_active":"2024-05-08T04:22:09.607937+0000","last_peered":"2024-05-08T04:22:09.607937+0000","last_clean":"2024-05-08T04:22:09.607937+0000","last_became_active":"2024-05-08T04:22:08.616426+0000","last_became_peered":"2024-05-08T04:22:08.616426+0000","last_unstale":"2024-05-08T04:22:09.607937+0000","last_undegraded":"2024-05-08T04:22:09.607937+0000","last_fullsized":"2024-05-08T04:22:09.607937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:25:29.845836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.607861+0000","last_change":"2024-05-08T04:22:08.603287+0000","last_active":"2024-05-08T04:22:09.607861+0000","last_peered":"2024-05-08T04:22:09.607861+0000","last_clean":"2024-05-08T04:22:09.607861+0000","last_became_active":"2024-05-08T04:22:08.603036+0000","last_became_peered":"2024-05-08T04:22:08.603036+0000","last_unstale":"2024-05-08T04:22:09.607861+0000","last_undegraded":"2024-05-08T04:22:09.607861+0000","last_fullsized":"2024-05-08T04:22:09.607861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:34:52.577692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.118220+0000","last_change":"2024-05-08T04:22:08.613370+0000","last_active":"2024-05-08T04:22:11.118220+0000","last_peered":"2024-05-08T04:22:11.118220+0000","last_clean":"2024-05-08T04:22:11.118220+0000","last_became_active":"2024-05-08T04:22:08.613101+0000","last_became_peered":"2024-05-08T04:22:08.613101+0000","last_unstale":"2024-05-08T04:22:11.118220+0000","last_undegraded":"2024-05-08T04:22:11.118220+0000","last_fullsized":"2024-05-08T04:22:11.118220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:15:36.280325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.596950+0000","last_change":"2024-05-08T04:22:08.616814+0000","last_active":"2024-05-08T04:22:10.596950+0000","last_peered":"2024-05-08T04:22:10.596950+0000","last_clean":"2024-05-08T04:22:10.596950+0000","last_became_active":"2024-05-08T04:22:08.616526+0000","last_became_peered":"2024-05-08T04:22:08.616526+0000","last_unstale":"2024-05-08T04:22:10.596950+0000","last_undegraded":"2024-05-08T04:22:10.596950+0000","last_fullsized":"2024-05-08T04:22:10.596950+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:58:18.922928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.597011+0000","last_change":"2024-05-08T04:22:08.607672+0000","last_active":"2024-05-08T04:22:10.597011+0000","last_peered":"2024-05-08T04:22:10.597011+0000","last_clean":"2024-05-08T04:22:10.597011+0000","last_became_active":"2024-05-08T04:22:08.607390+0000","last_became_peered":"2024-05-08T04:22:08.607390+0000","last_unstale":"2024-05-08T04:22:10.597011+0000","last_undegraded":"2024-05-08T04:22:10.597011+0000","last_fullsized":"2024-05-08T04:22:10.597011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:10.252324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.118166+0000","last_change":"2024-05-08T04:22:08.608471+0000","last_active":"2024-05-08T04:22:11.118166+0000","last_peered":"2024-05-08T04:22:11.118166+0000","last_clean":"2024-05-08T04:22:11.118166+0000","last_became_active":"2024-05-08T04:22:08.608116+0000","last_became_peered":"2024-05-08T04:22:08.608116+0000","last_unstale":"2024-05-08T04:22:11.118166+0000","last_undegraded":"2024-05-08T04:22:11.118166+0000","last_fullsized":"2024-05-08T04:22:11.118166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:01.288513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.608075+0000","last_change":"2024-05-08T04:22:08.605761+0000","last_active":"2024-05-08T04:22:09.608075+0000","last_peered":"2024-05-08T04:22:09.608075+0000","last_clean":"2024-05-08T04:22:09.608075+0000","last_became_active":"2024-05-08T04:22:08.605493+0000","last_became_peered":"2024-05-08T04:22:08.605493+0000","last_unstale":"2024-05-08T04:22:09.608075+0000","last_undegraded":"2024-05-08T04:22:09.608075+0000","last_fullsized":"2024-05-08T04:22:09.608075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:44:19.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117485+0000","last_change":"2024-05-08T04:22:08.614142+0000","last_active":"2024-05-08T04:22:11.117485+0000","last_peered":"2024-05-08T04:22:11.117485+0000","last_clean":"2024-05-08T04:22:11.117485+0000","last_became_active":"2024-05-08T04:22:08.613767+0000","last_became_peered":"2024-05-08T04:22:08.613767+0000","last_unstale":"2024-05-08T04:22:11.117485+0000","last_undegraded":"2024-05-08T04:22:11.117485+0000","last_fullsized":"2024-05-08T04:22:11.117485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:11.702548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117736+0000","last_change":"2024-05-08T04:22:08.612886+0000","last_active":"2024-05-08T04:22:11.117736+0000","last_peered":"2024-05-08T04:22:11.117736+0000","last_clean":"2024-05-08T04:22:11.117736+0000","last_became_active":"2024-05-08T04:22:08.611465+0000","last_became_peered":"2024-05-08T04:22:08.611465+0000","last_unstale":"2024-05-08T04:22:11.117736+0000","last_undegraded":"2024-05-08T04:22:11.117736+0000","last_fullsized":"2024-05-08T04:22:11.117736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:31:17.488350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117024+0000","last_change":"2024-05-08T04:22:08.614732+0000","last_active":"2024-05-08T04:22:11.117024+0000","last_peered":"2024-05-08T04:22:11.117024+0000","last_clean":"2024-05-08T04:22:11.117024+0000","last_became_active":"2024-05-08T04:22:08.614470+0000","last_became_peered":"2024-05-08T04:22:08.614470+0000","last_unstale":"2024-05-08T04:22:11.117024+0000","last_undegraded":"2024-05-08T04:22:11.117024+0000","last_fullsized":"2024-05-08T04:22:11.117024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:01.288513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034819+0000","last_change":"2024-05-08T04:22:08.613924+0000","last_active":"2024-05-08T04:22:10.034819+0000","last_peered":"2024-05-08T04:22:10.034819+0000","last_clean":"2024-05-08T04:22:10.034819+0000","last_became_active":"2024-05-08T04:22:08.613675+0000","last_became_peered":"2024-05-08T04:22:08.613675+0000","last_unstale":"2024-05-08T04:22:10.034819+0000","last_undegraded":"2024-05-08T04:22:10.034819+0000","last_fullsized":"2024-05-08T04:22:10.034819+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:22:30.158762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034651+0000","last_change":"2024-05-08T04:22:08.613805+0000","last_active":"2024-05-08T04:22:10.034651+0000","last_peered":"2024-05-08T04:22:10.034651+0000","last_clean":"2024-05-08T04:22:10.034651+0000","last_became_active":"2024-05-08T04:22:08.613263+0000","last_became_peered":"2024-05-08T04:22:08.613263+0000","last_unstale":"2024-05-08T04:22:10.034651+0000","last_undegraded":"2024-05-08T04:22:10.034651+0000","last_fullsized":"2024-05-08T04:22:10.034651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:40:45.438780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.613150+0000","last_change":"2024-05-08T04:22:08.607247+0000","last_active":"2024-05-08T04:22:09.613150+0000","last_peered":"2024-05-08T04:22:09.613150+0000","last_clean":"2024-05-08T04:22:09.613150+0000","last_became_active":"2024-05-08T04:22:08.606978+0000","last_became_peered":"2024-05-08T04:22:08.606978+0000","last_unstale":"2024-05-08T04:22:09.613150+0000","last_undegraded":"2024-05-08T04:22:09.613150+0000","last_fullsized":"2024-05-08T04:22:09.613150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:13:59.083027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117736+0000","last_change":"2024-05-08T04:22:08.607234+0000","last_active":"2024-05-08T04:22:11.117736+0000","last_peered":"2024-05-08T04:22:11.117736+0000","last_clean":"2024-05-08T04:22:11.117736+0000","last_became_active":"2024-05-08T04:22:08.606925+0000","last_became_peered":"2024-05-08T04:22:08.606925+0000","last_unstale":"2024-05-08T04:22:11.117736+0000","last_undegraded":"2024-05-08T04:22:11.117736+0000","last_fullsized":"2024-05-08T04:22:11.117736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:32:15.196191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.607939+0000","last_change":"2024-05-08T04:22:08.613294+0000","last_active":"2024-05-08T04:22:09.607939+0000","last_peered":"2024-05-08T04:22:09.607939+0000","last_clean":"2024-05-08T04:22:09.607939+0000","last_became_active":"2024-05-08T04:22:08.613029+0000","last_became_peered":"2024-05-08T04:22:08.613029+0000","last_unstale":"2024-05-08T04:22:09.607939+0000","last_undegraded":"2024-05-08T04:22:09.607939+0000","last_fullsized":"2024-05-08T04:22:09.607939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:01.288513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.608316+0000","last_change":"2024-05-08T04:22:08.611412+0000","last_active":"2024-05-08T04:22:09.608316+0000","last_peered":"2024-05-08T04:22:09.608316+0000","last_clean":"2024-05-08T04:22:09.608316+0000","last_became_active":"2024-05-08T04:22:08.611126+0000","last_became_peered":"2024-05-08T04:22:08.611126+0000","last_unstale":"2024-05-08T04:22:09.608316+0000","last_undegraded":"2024-05-08T04:22:09.608316+0000","last_fullsized":"2024-05-08T04:22:09.608316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:13:59.083027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117233+0000","last_change":"2024-05-08T04:22:08.610018+0000","last_active":"2024-05-08T04:22:11.117233+0000","last_peered":"2024-05-08T04:22:11.117233+0000","last_clean":"2024-05-08T04:22:11.117233+0000","last_became_active":"2024-05-08T04:22:08.609700+0000","last_became_peered":"2024-05-08T04:22:08.609700+0000","last_unstale":"2024-05-08T04:22:11.117233+0000","last_undegraded":"2024-05-08T04:22:11.117233+0000","last_fullsized":"2024-05-08T04:22:11.117233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:13:59.083027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117035+0000","last_change":"2024-05-08T04:22:08.613423+0000","last_active":"2024-05-08T04:22:11.117035+0000","last_peered":"2024-05-08T04:22:11.117035+0000","last_clean":"2024-05-08T04:22:11.117035+0000","last_became_active":"2024-05-08T04:22:08.613131+0000","last_became_peered":"2024-05-08T04:22:08.613131+0000","last_unstale":"2024-05-08T04:22:11.117035+0000","last_undegraded":"2024-05-08T04:22:11.117035+0000","last_fullsized":"2024-05-08T04:22:11.117035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:49:01.256186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.118168+0000","last_change":"2024-05-08T04:22:08.613407+0000","last_active":"2024-05-08T04:22:11.118168+0000","last_peered":"2024-05-08T04:22:11.118168+0000","last_clean":"2024-05-08T04:22:11.118168+0000","last_became_active":"2024-05-08T04:22:08.613129+0000","last_became_peered":"2024-05-08T04:22:08.613129+0000","last_unstale":"2024-05-08T04:22:11.118168+0000","last_undegraded":"2024-05-08T04:22:11.118168+0000","last_fullsized":"2024-05-08T04:22:11.118168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:25:29.845836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.118300+0000","last_change":"2024-05-08T04:22:07.608133+0000","last_active":"2024-05-08T04:22:11.118300+0000","last_peered":"2024-05-08T04:22:11.118300+0000","last_clean":"2024-05-08T04:22:11.118300+0000","last_became_active":"2024-05-08T04:22:07.607766+0000","last_became_peered":"2024-05-08T04:22:07.607766+0000","last_unstale":"2024-05-08T04:22:11.118300+0000","last_undegraded":"2024-05-08T04:22:11.118300+0000","last_fullsized":"2024-05-08T04:22:11.118300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:56:43.221714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117387+0000","last_change":"2024-05-08T04:22:08.608052+0000","last_active":"2024-05-08T04:22:11.117387+0000","last_peered":"2024-05-08T04:22:11.117387+0000","last_clean":"2024-05-08T04:22:11.117387+0000","last_became_active":"2024-05-08T04:22:08.607045+0000","last_became_peered":"2024-05-08T04:22:08.607045+0000","last_unstale":"2024-05-08T04:22:11.117387+0000","last_undegraded":"2024-05-08T04:22:11.117387+0000","last_fullsized":"2024-05-08T04:22:11.117387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:56:44.225902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034719+0000","last_change":"2024-05-08T04:22:07.610820+0000","last_active":"2024-05-08T04:22:10.034719+0000","last_peered":"2024-05-08T04:22:10.034719+0000","last_clean":"2024-05-08T04:22:10.034719+0000","last_became_active":"2024-05-08T04:22:07.610602+0000","last_became_peered":"2024-05-08T04:22:07.610602+0000","last_unstale":"2024-05-08T04:22:10.034719+0000","last_undegraded":"2024-05-08T04:22:10.034719+0000","last_fullsized":"2024-05-08T04:22:10.034719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:09.248136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117324+0000","last_change":"2024-05-08T04:22:08.613370+0000","last_active":"2024-05-08T04:22:11.117324+0000","last_peered":"2024-05-08T04:22:11.117324+0000","last_clean":"2024-05-08T04:22:11.117324+0000","last_became_active":"2024-05-08T04:22:08.613085+0000","last_became_peered":"2024-05-08T04:22:08.613085+0000","last_unstale":"2024-05-08T04:22:11.117324+0000","last_undegraded":"2024-05-08T04:22:11.117324+0000","last_fullsized":"2024-05-08T04:22:11.117324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:00:46.553650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.597145+0000","last_change":"2024-05-08T04:22:07.606521+0000","last_active":"2024-05-08T04:22:10.597145+0000","last_peered":"2024-05-08T04:22:10.597145+0000","last_clean":"2024-05-08T04:22:10.597145+0000","last_became_active":"2024-05-08T04:22:07.606168+0000","last_became_peered":"2024-05-08T04:22:07.606168+0000","last_unstale":"2024-05-08T04:22:10.597145+0000","last_undegraded":"2024-05-08T04:22:10.597145+0000","last_fullsized":"2024-05-08T04:22:10.597145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:27:15.090679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034577+0000","last_change":"2024-05-08T04:22:08.605312+0000","last_active":"2024-05-08T04:22:10.034577+0000","last_peered":"2024-05-08T04:22:10.034577+0000","last_clean":"2024-05-08T04:22:10.034577+0000","last_became_active":"2024-05-08T04:22:08.604982+0000","last_became_peered":"2024-05-08T04:22:08.604982+0000","last_unstale":"2024-05-08T04:22:10.034577+0000","last_undegraded":"2024-05-08T04:22:10.034577+0000","last_fullsized":"2024-05-08T04:22:10.034577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:32:28.628681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034723+0000","last_change":"2024-05-08T04:22:07.607498+0000","last_active":"2024-05-08T04:22:10.034723+0000","last_peered":"2024-05-08T04:22:10.034723+0000","last_clean":"2024-05-08T04:22:10.034723+0000","last_became_active":"2024-05-08T04:22:07.607217+0000","last_became_peered":"2024-05-08T04:22:07.607217+0000","last_unstale":"2024-05-08T04:22:10.034723+0000","last_undegraded":"2024-05-08T04:22:10.034723+0000","last_fullsized":"2024-05-08T04:22:10.034723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:06:56.058855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.368868+0000","last_change":"2024-05-08T04:22:08.615650+0000","last_active":"2024-05-08T04:22:10.368868+0000","last_peered":"2024-05-08T04:22:10.368868+0000","last_clean":"2024-05-08T04:22:10.368868+0000","last_became_active":"2024-05-08T04:22:08.615385+0000","last_became_peered":"2024-05-08T04:22:08.615385+0000","last_unstale":"2024-05-08T04:22:10.368868+0000","last_undegraded":"2024-05-08T04:22:10.368868+0000","last_fullsized":"2024-05-08T04:22:10.368868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:55:20.333003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117756+0000","last_change":"2024-05-08T04:22:07.606651+0000","last_active":"2024-05-08T04:22:11.117756+0000","last_peered":"2024-05-08T04:22:11.117756+0000","last_clean":"2024-05-08T04:22:11.117756+0000","last_became_active":"2024-05-08T04:22:07.606386+0000","last_became_peered":"2024-05-08T04:22:07.606386+0000","last_unstale":"2024-05-08T04:22:11.117756+0000","last_undegraded":"2024-05-08T04:22:11.117756+0000","last_fullsized":"2024-05-08T04:22:11.117756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:20:12.278435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117669+0000","last_change":"2024-05-08T04:22:08.618424+0000","last_active":"2024-05-08T04:22:11.117669+0000","last_peered":"2024-05-08T04:22:11.117669+0000","last_clean":"2024-05-08T04:22:11.117669+0000","last_became_active":"2024-05-08T04:22:08.618020+0000","last_became_peered":"2024-05-08T04:22:08.618020+0000","last_unstale":"2024-05-08T04:22:11.117669+0000","last_undegraded":"2024-05-08T04:22:11.117669+0000","last_fullsized":"2024-05-08T04:22:11.117669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:23.863130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117571+0000","last_change":"2024-05-08T04:22:07.605296+0000","last_active":"2024-05-08T04:22:11.117571+0000","last_peered":"2024-05-08T04:22:11.117571+0000","last_clean":"2024-05-08T04:22:11.117571+0000","last_became_active":"2024-05-08T04:22:07.605050+0000","last_became_peered":"2024-05-08T04:22:07.605050+0000","last_unstale":"2024-05-08T04:22:11.117571+0000","last_undegraded":"2024-05-08T04:22:11.117571+0000","last_fullsized":"2024-05-08T04:22:11.117571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:28.152699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.368846+0000","last_change":"2024-05-08T04:22:08.619578+0000","last_active":"2024-05-08T04:22:10.368846+0000","last_peered":"2024-05-08T04:22:10.368846+0000","last_clean":"2024-05-08T04:22:10.368846+0000","last_became_active":"2024-05-08T04:22:08.618733+0000","last_became_peered":"2024-05-08T04:22:08.618733+0000","last_unstale":"2024-05-08T04:22:10.368846+0000","last_undegraded":"2024-05-08T04:22:10.368846+0000","last_fullsized":"2024-05-08T04:22:10.368846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:48:26.195905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.596840+0000","last_change":"2024-05-08T04:22:07.606390+0000","last_active":"2024-05-08T04:22:10.596840+0000","last_peered":"2024-05-08T04:22:10.596840+0000","last_clean":"2024-05-08T04:22:10.596840+0000","last_became_active":"2024-05-08T04:22:07.606065+0000","last_became_peered":"2024-05-08T04:22:07.606065+0000","last_unstale":"2024-05-08T04:22:10.596840+0000","last_undegraded":"2024-05-08T04:22:10.596840+0000","last_fullsized":"2024-05-08T04:22:10.596840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:42:43.886509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034048+0000","last_change":"2024-05-08T04:22:08.613057+0000","last_active":"2024-05-08T04:22:10.034048+0000","last_peered":"2024-05-08T04:22:10.034048+0000","last_clean":"2024-05-08T04:22:10.034048+0000","last_became_active":"2024-05-08T04:22:08.612656+0000","last_became_peered":"2024-05-08T04:22:08.612656+0000","last_unstale":"2024-05-08T04:22:10.034048+0000","last_undegraded":"2024-05-08T04:22:10.034048+0000","last_fullsized":"2024-05-08T04:22:10.034048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:44:19.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117125+0000","last_change":"2024-05-08T04:22:07.604688+0000","last_active":"2024-05-08T04:22:11.117125+0000","last_peered":"2024-05-08T04:22:11.117125+0000","last_clean":"2024-05-08T04:22:11.117125+0000","last_became_active":"2024-05-08T04:22:07.604437+0000","last_became_peered":"2024-05-08T04:22:07.604437+0000","last_unstale":"2024-05-08T04:22:11.117125+0000","last_undegraded":"2024-05-08T04:22:11.117125+0000","last_fullsized":"2024-05-08T04:22:11.117125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:41:43.587550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117791+0000","last_change":"2024-05-08T04:22:08.604296+0000","last_active":"2024-05-08T04:22:11.117791+0000","last_peered":"2024-05-08T04:22:11.117791+0000","last_clean":"2024-05-08T04:22:11.117791+0000","last_became_active":"2024-05-08T04:22:08.604003+0000","last_became_peered":"2024-05-08T04:22:08.604003+0000","last_unstale":"2024-05-08T04:22:11.117791+0000","last_undegraded":"2024-05-08T04:22:11.117791+0000","last_fullsized":"2024-05-08T04:22:11.117791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:37:35.776329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.613532+0000","last_change":"2024-05-08T04:22:07.596652+0000","last_active":"2024-05-08T04:22:09.613532+0000","last_peered":"2024-05-08T04:22:09.613532+0000","last_clean":"2024-05-08T04:22:09.613532+0000","last_became_active":"2024-05-08T04:22:07.596330+0000","last_became_peered":"2024-05-08T04:22:07.596330+0000","last_unstale":"2024-05-08T04:22:09.613532+0000","last_undegraded":"2024-05-08T04:22:09.613532+0000","last_fullsized":"2024-05-08T04:22:09.613532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:35:27.332213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034843+0000","last_change":"2024-05-08T04:22:08.611652+0000","last_active":"2024-05-08T04:22:10.034843+0000","last_peered":"2024-05-08T04:22:10.034843+0000","last_clean":"2024-05-08T04:22:10.034843+0000","last_became_active":"2024-05-08T04:22:08.610990+0000","last_became_peered":"2024-05-08T04:22:08.610990+0000","last_unstale":"2024-05-08T04:22:10.034843+0000","last_undegraded":"2024-05-08T04:22:10.034843+0000","last_fullsized":"2024-05-08T04:22:10.034843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:58:47.243369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.613352+0000","last_change":"2024-05-08T04:22:07.598633+0000","last_active":"2024-05-08T04:22:09.613352+0000","last_peered":"2024-05-08T04:22:09.613352+0000","last_clean":"2024-05-08T04:22:09.613352+0000","last_became_active":"2024-05-08T04:22:07.598319+0000","last_became_peered":"2024-05-08T04:22:07.598319+0000","last_unstale":"2024-05-08T04:22:09.613352+0000","last_undegraded":"2024-05-08T04:22:09.613352+0000","last_fullsized":"2024-05-08T04:22:09.613352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:03.931695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034490+0000","last_change":"2024-05-08T04:22:08.617523+0000","last_active":"2024-05-08T04:22:10.034490+0000","last_peered":"2024-05-08T04:22:10.034490+0000","last_clean":"2024-05-08T04:22:10.034490+0000","last_became_active":"2024-05-08T04:22:08.617114+0000","last_became_peered":"2024-05-08T04:22:08.617114+0000","last_unstale":"2024-05-08T04:22:10.034490+0000","last_undegraded":"2024-05-08T04:22:10.034490+0000","last_fullsized":"2024-05-08T04:22:10.034490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:11.702548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117997+0000","last_change":"2024-05-08T04:22:07.614017+0000","last_active":"2024-05-08T04:22:11.117997+0000","last_peered":"2024-05-08T04:22:11.117997+0000","last_clean":"2024-05-08T04:22:11.117997+0000","last_became_active":"2024-05-08T04:22:07.613730+0000","last_became_peered":"2024-05-08T04:22:07.613730+0000","last_unstale":"2024-05-08T04:22:11.117997+0000","last_undegraded":"2024-05-08T04:22:11.117997+0000","last_fullsized":"2024-05-08T04:22:11.117997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:00:45.549461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117960+0000","last_change":"2024-05-08T04:22:08.608114+0000","last_active":"2024-05-08T04:22:11.117960+0000","last_peered":"2024-05-08T04:22:11.117960+0000","last_clean":"2024-05-08T04:22:11.117960+0000","last_became_active":"2024-05-08T04:22:08.607650+0000","last_became_peered":"2024-05-08T04:22:08.607650+0000","last_unstale":"2024-05-08T04:22:11.117960+0000","last_undegraded":"2024-05-08T04:22:11.117960+0000","last_fullsized":"2024-05-08T04:22:11.117960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:25:03.059718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.118155+0000","last_change":"2024-05-08T04:22:07.604862+0000","last_active":"2024-05-08T04:22:11.118155+0000","last_peered":"2024-05-08T04:22:11.118155+0000","last_clean":"2024-05-08T04:22:11.118155+0000","last_became_active":"2024-05-08T04:22:07.604578+0000","last_became_peered":"2024-05-08T04:22:07.604578+0000","last_unstale":"2024-05-08T04:22:11.118155+0000","last_undegraded":"2024-05-08T04:22:11.118155+0000","last_fullsized":"2024-05-08T04:22:11.118155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:58:17.918739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117635+0000","last_change":"2024-05-08T04:22:08.612010+0000","last_active":"2024-05-08T04:22:11.117635+0000","last_peered":"2024-05-08T04:22:11.117635+0000","last_clean":"2024-05-08T04:22:11.117635+0000","last_became_active":"2024-05-08T04:22:08.611741+0000","last_became_peered":"2024-05-08T04:22:08.611741+0000","last_unstale":"2024-05-08T04:22:11.117635+0000","last_undegraded":"2024-05-08T04:22:11.117635+0000","last_fullsized":"2024-05-08T04:22:11.117635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:14:29.288751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117783+0000","last_change":"2024-05-08T04:22:07.608202+0000","last_active":"2024-05-08T04:22:11.117783+0000","last_peered":"2024-05-08T04:22:11.117783+0000","last_clean":"2024-05-08T04:22:11.117783+0000","last_became_active":"2024-05-08T04:22:07.607933+0000","last_became_peered":"2024-05-08T04:22:07.607933+0000","last_unstale":"2024-05-08T04:22:11.117783+0000","last_undegraded":"2024-05-08T04:22:11.117783+0000","last_fullsized":"2024-05-08T04:22:11.117783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:58:17.918739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034166+0000","last_change":"2024-05-08T04:22:08.611832+0000","last_active":"2024-05-08T04:22:10.034166+0000","last_peered":"2024-05-08T04:22:10.034166+0000","last_clean":"2024-05-08T04:22:10.034166+0000","last_became_active":"2024-05-08T04:22:08.611486+0000","last_became_peered":"2024-05-08T04:22:08.611486+0000","last_unstale":"2024-05-08T04:22:10.034166+0000","last_undegraded":"2024-05-08T04:22:10.034166+0000","last_fullsized":"2024-05-08T04:22:10.034166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:51:35.712252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034151+0000","last_change":"2024-05-08T04:22:07.610082+0000","last_active":"2024-05-08T04:22:10.034151+0000","last_peered":"2024-05-08T04:22:10.034151+0000","last_clean":"2024-05-08T04:22:10.034151+0000","last_became_active":"2024-05-08T04:22:07.609805+0000","last_became_peered":"2024-05-08T04:22:07.609805+0000","last_unstale":"2024-05-08T04:22:10.034151+0000","last_undegraded":"2024-05-08T04:22:10.034151+0000","last_fullsized":"2024-05-08T04:22:10.034151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:41:43.587550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117103+0000","last_change":"2024-05-08T04:22:08.616038+0000","last_active":"2024-05-08T04:22:11.117103+0000","last_peered":"2024-05-08T04:22:11.117103+0000","last_clean":"2024-05-08T04:22:11.117103+0000","last_became_active":"2024-05-08T04:22:08.615723+0000","last_became_peered":"2024-05-08T04:22:08.615723+0000","last_unstale":"2024-05-08T04:22:11.117103+0000","last_undegraded":"2024-05-08T04:22:11.117103+0000","last_fullsized":"2024-05-08T04:22:11.117103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:44:19.287032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.033985+0000","last_change":"2024-05-08T04:22:07.613948+0000","last_active":"2024-05-08T04:22:10.033985+0000","last_peered":"2024-05-08T04:22:10.033985+0000","last_clean":"2024-05-08T04:22:10.033985+0000","last_became_active":"2024-05-08T04:22:07.613685+0000","last_became_peered":"2024-05-08T04:22:07.613685+0000","last_unstale":"2024-05-08T04:22:10.033985+0000","last_undegraded":"2024-05-08T04:22:10.033985+0000","last_fullsized":"2024-05-08T04:22:10.033985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:20:12.278435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117487+0000","last_change":"2024-05-08T04:22:08.612944+0000","last_active":"2024-05-08T04:22:11.117487+0000","last_peered":"2024-05-08T04:22:11.117487+0000","last_clean":"2024-05-08T04:22:11.117487+0000","last_became_active":"2024-05-08T04:22:08.612648+0000","last_became_peered":"2024-05-08T04:22:08.612648+0000","last_unstale":"2024-05-08T04:22:11.117487+0000","last_undegraded":"2024-05-08T04:22:11.117487+0000","last_fullsized":"2024-05-08T04:22:11.117487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:50:35.776214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.596663+0000","last_change":"2024-05-08T04:22:07.608520+0000","last_active":"2024-05-08T04:22:10.596663+0000","last_peered":"2024-05-08T04:22:10.596663+0000","last_clean":"2024-05-08T04:22:10.596663+0000","last_became_active":"2024-05-08T04:22:07.608215+0000","last_became_peered":"2024-05-08T04:22:07.608215+0000","last_unstale":"2024-05-08T04:22:10.596663+0000","last_undegraded":"2024-05-08T04:22:10.596663+0000","last_fullsized":"2024-05-08T04:22:10.596663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:38:33.843667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117931+0000","last_change":"2024-05-08T04:22:08.610027+0000","last_active":"2024-05-08T04:22:11.117931+0000","last_peered":"2024-05-08T04:22:11.117931+0000","last_clean":"2024-05-08T04:22:11.117931+0000","last_became_active":"2024-05-08T04:22:08.609729+0000","last_became_peered":"2024-05-08T04:22:08.609729+0000","last_unstale":"2024-05-08T04:22:11.117931+0000","last_undegraded":"2024-05-08T04:22:11.117931+0000","last_fullsized":"2024-05-08T04:22:11.117931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:03:56.531398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.597029+0000","last_change":"2024-05-08T04:22:07.606016+0000","last_active":"2024-05-08T04:22:10.597029+0000","last_peered":"2024-05-08T04:22:10.597029+0000","last_clean":"2024-05-08T04:22:10.597029+0000","last_became_active":"2024-05-08T04:22:07.605696+0000","last_became_peered":"2024-05-08T04:22:07.605696+0000","last_unstale":"2024-05-08T04:22:10.597029+0000","last_undegraded":"2024-05-08T04:22:10.597029+0000","last_fullsized":"2024-05-08T04:22:10.597029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:19.196550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.368998+0000","last_change":"2024-05-08T04:22:08.619425+0000","last_active":"2024-05-08T04:22:10.368998+0000","last_peered":"2024-05-08T04:22:10.368998+0000","last_clean":"2024-05-08T04:22:10.368998+0000","last_became_active":"2024-05-08T04:22:08.619111+0000","last_became_peered":"2024-05-08T04:22:08.619111+0000","last_unstale":"2024-05-08T04:22:10.368998+0000","last_undegraded":"2024-05-08T04:22:10.368998+0000","last_fullsized":"2024-05-08T04:22:10.368998+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:10.252324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117234+0000","last_change":"2024-05-08T04:22:07.608876+0000","last_active":"2024-05-08T04:22:11.117234+0000","last_peered":"2024-05-08T04:22:11.117234+0000","last_clean":"2024-05-08T04:22:11.117234+0000","last_became_active":"2024-05-08T04:22:07.607923+0000","last_became_peered":"2024-05-08T04:22:07.607923+0000","last_unstale":"2024-05-08T04:22:11.117234+0000","last_undegraded":"2024-05-08T04:22:11.117234+0000","last_fullsized":"2024-05-08T04:22:11.117234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:48:25.191717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.613097+0000","last_change":"2024-05-08T04:22:08.609995+0000","last_active":"2024-05-08T04:22:09.613097+0000","last_peered":"2024-05-08T04:22:09.613097+0000","last_clean":"2024-05-08T04:22:09.613097+0000","last_became_active":"2024-05-08T04:22:08.609703+0000","last_became_peered":"2024-05-08T04:22:08.609703+0000","last_unstale":"2024-05-08T04:22:09.613097+0000","last_undegraded":"2024-05-08T04:22:09.613097+0000","last_fullsized":"2024-05-08T04:22:09.613097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:25:29.845836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.118104+0000","last_change":"2024-05-08T04:22:07.607881+0000","last_active":"2024-05-08T04:22:11.118104+0000","last_peered":"2024-05-08T04:22:11.118104+0000","last_clean":"2024-05-08T04:22:11.118104+0000","last_became_active":"2024-05-08T04:22:07.607596+0000","last_became_peered":"2024-05-08T04:22:07.607596+0000","last_unstale":"2024-05-08T04:22:11.118104+0000","last_undegraded":"2024-05-08T04:22:11.118104+0000","last_fullsized":"2024-05-08T04:22:11.118104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:10.698359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.597012+0000","last_change":"2024-05-08T04:22:08.609559+0000","last_active":"2024-05-08T04:22:10.597012+0000","last_peered":"2024-05-08T04:22:10.597012+0000","last_clean":"2024-05-08T04:22:10.597012+0000","last_became_active":"2024-05-08T04:22:08.609054+0000","last_became_peered":"2024-05-08T04:22:08.609054+0000","last_unstale":"2024-05-08T04:22:10.597012+0000","last_undegraded":"2024-05-08T04:22:10.597012+0000","last_fullsized":"2024-05-08T04:22:10.597012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:06:57.063043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.608181+0000","last_change":"2024-05-08T04:22:07.606217+0000","last_active":"2024-05-08T04:22:09.608181+0000","last_peered":"2024-05-08T04:22:09.608181+0000","last_clean":"2024-05-08T04:22:09.608181+0000","last_became_active":"2024-05-08T04:22:07.605718+0000","last_became_peered":"2024-05-08T04:22:07.605718+0000","last_unstale":"2024-05-08T04:22:09.608181+0000","last_undegraded":"2024-05-08T04:22:09.608181+0000","last_fullsized":"2024-05-08T04:22:09.608181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:25:46.596230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117724+0000","last_change":"2024-05-08T04:22:08.607192+0000","last_active":"2024-05-08T04:22:11.117724+0000","last_peered":"2024-05-08T04:22:11.117724+0000","last_clean":"2024-05-08T04:22:11.117724+0000","last_became_active":"2024-05-08T04:22:08.606950+0000","last_became_peered":"2024-05-08T04:22:08.606950+0000","last_unstale":"2024-05-08T04:22:11.117724+0000","last_undegraded":"2024-05-08T04:22:11.117724+0000","last_fullsized":"2024-05-08T04:22:11.117724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:14:09.899917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.613248+0000","last_change":"2024-05-08T04:22:07.604104+0000","last_active":"2024-05-08T04:22:09.613248+0000","last_peered":"2024-05-08T04:22:09.613248+0000","last_clean":"2024-05-08T04:22:09.613248+0000","last_became_active":"2024-05-08T04:22:07.603790+0000","last_became_peered":"2024-05-08T04:22:07.603790+0000","last_unstale":"2024-05-08T04:22:09.613248+0000","last_undegraded":"2024-05-08T04:22:09.613248+0000","last_fullsized":"2024-05-08T04:22:09.613248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:38:04.275531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.613139+0000","last_change":"2024-05-08T04:22:08.603460+0000","last_active":"2024-05-08T04:22:09.613139+0000","last_peered":"2024-05-08T04:22:09.613139+0000","last_clean":"2024-05-08T04:22:09.613139+0000","last_became_active":"2024-05-08T04:22:08.603167+0000","last_became_peered":"2024-05-08T04:22:08.603167+0000","last_unstale":"2024-05-08T04:22:09.613139+0000","last_undegraded":"2024-05-08T04:22:09.613139+0000","last_fullsized":"2024-05-08T04:22:09.613139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:51:35.712252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117657+0000","last_change":"2024-05-08T04:22:07.609907+0000","last_active":"2024-05-08T04:22:11.117657+0000","last_peered":"2024-05-08T04:22:11.117657+0000","last_clean":"2024-05-08T04:22:11.117657+0000","last_became_active":"2024-05-08T04:22:07.609656+0000","last_became_peered":"2024-05-08T04:22:07.609656+0000","last_unstale":"2024-05-08T04:22:11.117657+0000","last_undegraded":"2024-05-08T04:22:11.117657+0000","last_fullsized":"2024-05-08T04:22:11.117657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:12:21.539620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117629+0000","last_change":"2024-05-08T04:22:08.615571+0000","last_active":"2024-05-08T04:22:11.117629+0000","last_peered":"2024-05-08T04:22:11.117629+0000","last_clean":"2024-05-08T04:22:11.117629+0000","last_became_active":"2024-05-08T04:22:08.615248+0000","last_became_peered":"2024-05-08T04:22:08.615248+0000","last_unstale":"2024-05-08T04:22:11.117629+0000","last_undegraded":"2024-05-08T04:22:11.117629+0000","last_fullsized":"2024-05-08T04:22:11.117629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:33:47.330145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.368783+0000","last_change":"2024-05-08T04:22:07.606077+0000","last_active":"2024-05-08T04:22:10.368783+0000","last_peered":"2024-05-08T04:22:10.368783+0000","last_clean":"2024-05-08T04:22:10.368783+0000","last_became_active":"2024-05-08T04:22:07.605826+0000","last_became_peered":"2024-05-08T04:22:07.605826+0000","last_unstale":"2024-05-08T04:22:10.368783+0000","last_undegraded":"2024-05-08T04:22:10.368783+0000","last_fullsized":"2024-05-08T04:22:10.368783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:35.814239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.368916+0000","last_change":"2024-05-08T04:22:08.617343+0000","last_active":"2024-05-08T04:22:10.368916+0000","last_peered":"2024-05-08T04:22:10.368916+0000","last_clean":"2024-05-08T04:22:10.368916+0000","last_became_active":"2024-05-08T04:22:08.617076+0000","last_became_peered":"2024-05-08T04:22:08.617076+0000","last_unstale":"2024-05-08T04:22:10.368916+0000","last_undegraded":"2024-05-08T04:22:10.368916+0000","last_fullsized":"2024-05-08T04:22:10.368916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:41:44.591738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117879+0000","last_change":"2024-05-08T04:22:07.609551+0000","last_active":"2024-05-08T04:22:11.117879+0000","last_peered":"2024-05-08T04:22:11.117879+0000","last_clean":"2024-05-08T04:22:11.117879+0000","last_became_active":"2024-05-08T04:22:07.609262+0000","last_became_peered":"2024-05-08T04:22:07.609262+0000","last_unstale":"2024-05-08T04:22:11.117879+0000","last_undegraded":"2024-05-08T04:22:11.117879+0000","last_fullsized":"2024-05-08T04:22:11.117879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:13:58.078838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.596970+0000","last_change":"2024-05-08T04:22:08.609754+0000","last_active":"2024-05-08T04:22:10.596970+0000","last_peered":"2024-05-08T04:22:10.596970+0000","last_clean":"2024-05-08T04:22:10.596970+0000","last_became_active":"2024-05-08T04:22:08.609208+0000","last_became_peered":"2024-05-08T04:22:08.609208+0000","last_unstale":"2024-05-08T04:22:10.596970+0000","last_undegraded":"2024-05-08T04:22:10.596970+0000","last_fullsized":"2024-05-08T04:22:10.596970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:41:44.591738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.118043+0000","last_change":"2024-05-08T04:22:07.602513+0000","last_active":"2024-05-08T04:22:11.118043+0000","last_peered":"2024-05-08T04:22:11.118043+0000","last_clean":"2024-05-08T04:22:11.118043+0000","last_became_active":"2024-05-08T04:22:07.601926+0000","last_became_peered":"2024-05-08T04:22:07.601926+0000","last_unstale":"2024-05-08T04:22:11.118043+0000","last_undegraded":"2024-05-08T04:22:11.118043+0000","last_fullsized":"2024-05-08T04:22:11.118043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:48:25.191717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.118263+0000","last_change":"2024-05-08T04:22:08.606209+0000","last_active":"2024-05-08T04:22:11.118263+0000","last_peered":"2024-05-08T04:22:11.118263+0000","last_clean":"2024-05-08T04:22:11.118263+0000","last_became_active":"2024-05-08T04:22:08.605948+0000","last_became_peered":"2024-05-08T04:22:08.605948+0000","last_unstale":"2024-05-08T04:22:11.118263+0000","last_undegraded":"2024-05-08T04:22:11.118263+0000","last_fullsized":"2024-05-08T04:22:11.118263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:17:24.767231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.613514+0000","last_change":"2024-05-08T04:22:07.599148+0000","last_active":"2024-05-08T04:22:09.613514+0000","last_peered":"2024-05-08T04:22:09.613514+0000","last_clean":"2024-05-08T04:22:09.613514+0000","last_became_active":"2024-05-08T04:22:07.598845+0000","last_became_peered":"2024-05-08T04:22:07.598845+0000","last_unstale":"2024-05-08T04:22:09.613514+0000","last_undegraded":"2024-05-08T04:22:09.613514+0000","last_fullsized":"2024-05-08T04:22:09.613514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:33:46.325956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.597170+0000","last_change":"2024-05-08T04:22:08.615152+0000","last_active":"2024-05-08T04:22:10.597170+0000","last_peered":"2024-05-08T04:22:10.597170+0000","last_clean":"2024-05-08T04:22:10.597170+0000","last_became_active":"2024-05-08T04:22:08.614816+0000","last_became_peered":"2024-05-08T04:22:08.614816+0000","last_unstale":"2024-05-08T04:22:10.597170+0000","last_undegraded":"2024-05-08T04:22:10.597170+0000","last_fullsized":"2024-05-08T04:22:10.597170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:39:08.156365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.118245+0000","last_change":"2024-05-08T04:22:07.607364+0000","last_active":"2024-05-08T04:22:11.118245+0000","last_peered":"2024-05-08T04:22:11.118245+0000","last_clean":"2024-05-08T04:22:11.118245+0000","last_became_active":"2024-05-08T04:22:07.607023+0000","last_became_peered":"2024-05-08T04:22:07.607023+0000","last_unstale":"2024-05-08T04:22:11.118245+0000","last_undegraded":"2024-05-08T04:22:11.118245+0000","last_fullsized":"2024-05-08T04:22:11.118245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:41:43.587550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.608442+0000","last_change":"2024-05-08T04:22:08.615640+0000","last_active":"2024-05-08T04:22:09.608442+0000","last_peered":"2024-05-08T04:22:09.608442+0000","last_clean":"2024-05-08T04:22:09.608442+0000","last_became_active":"2024-05-08T04:22:08.615374+0000","last_became_peered":"2024-05-08T04:22:08.615374+0000","last_unstale":"2024-05-08T04:22:09.608442+0000","last_undegraded":"2024-05-08T04:22:09.608442+0000","last_fullsized":"2024-05-08T04:22:09.608442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:00:46.553650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.118027+0000","last_change":"2024-05-08T04:22:07.602890+0000","last_active":"2024-05-08T04:22:11.118027+0000","last_peered":"2024-05-08T04:22:11.118027+0000","last_clean":"2024-05-08T04:22:11.118027+0000","last_became_active":"2024-05-08T04:22:07.602498+0000","last_became_peered":"2024-05-08T04:22:07.602498+0000","last_unstale":"2024-05-08T04:22:11.118027+0000","last_undegraded":"2024-05-08T04:22:11.118027+0000","last_fullsized":"2024-05-08T04:22:11.118027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:20:12.278435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034266+0000","last_change":"2024-05-08T04:22:08.612348+0000","last_active":"2024-05-08T04:22:10.034266+0000","last_peered":"2024-05-08T04:22:10.034266+0000","last_clean":"2024-05-08T04:22:10.034266+0000","last_became_active":"2024-05-08T04:22:08.611881+0000","last_became_peered":"2024-05-08T04:22:08.611881+0000","last_unstale":"2024-05-08T04:22:10.034266+0000","last_undegraded":"2024-05-08T04:22:10.034266+0000","last_fullsized":"2024-05-08T04:22:10.034266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:56:44.225902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117837+0000","last_change":"2024-05-08T04:22:07.609908+0000","last_active":"2024-05-08T04:22:11.117837+0000","last_peered":"2024-05-08T04:22:11.117837+0000","last_clean":"2024-05-08T04:22:11.117837+0000","last_became_active":"2024-05-08T04:22:07.609669+0000","last_became_peered":"2024-05-08T04:22:07.609669+0000","last_unstale":"2024-05-08T04:22:11.117837+0000","last_undegraded":"2024-05-08T04:22:11.117837+0000","last_fullsized":"2024-05-08T04:22:11.117837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:55:19.328814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034196+0000","last_change":"2024-05-08T04:22:08.617262+0000","last_active":"2024-05-08T04:22:10.034196+0000","last_peered":"2024-05-08T04:22:10.034196+0000","last_clean":"2024-05-08T04:22:10.034196+0000","last_became_active":"2024-05-08T04:22:08.616789+0000","last_became_peered":"2024-05-08T04:22:08.616789+0000","last_unstale":"2024-05-08T04:22:10.034196+0000","last_undegraded":"2024-05-08T04:22:10.034196+0000","last_fullsized":"2024-05-08T04:22:10.034196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:13:59.083027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117324+0000","last_change":"2024-05-08T04:22:07.608739+0000","last_active":"2024-05-08T04:22:11.117324+0000","last_peered":"2024-05-08T04:22:11.117324+0000","last_clean":"2024-05-08T04:22:11.117324+0000","last_became_active":"2024-05-08T04:22:07.608391+0000","last_became_peered":"2024-05-08T04:22:07.608391+0000","last_unstale":"2024-05-08T04:22:11.117324+0000","last_undegraded":"2024-05-08T04:22:11.117324+0000","last_fullsized":"2024-05-08T04:22:11.117324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:55:19.328814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.117597+0000","last_change":"2024-05-08T04:22:08.606959+0000","last_active":"2024-05-08T04:22:11.117597+0000","last_peered":"2024-05-08T04:22:11.117597+0000","last_clean":"2024-05-08T04:22:11.117597+0000","last_became_active":"2024-05-08T04:22:08.606690+0000","last_became_peered":"2024-05-08T04:22:08.606690+0000","last_unstale":"2024-05-08T04:22:11.117597+0000","last_undegraded":"2024-05-08T04:22:11.117597+0000","last_fullsized":"2024-05-08T04:22:11.117597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:09:05.361196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.034179+0000","last_change":"2024-05-08T04:22:07.610730+0000","last_active":"2024-05-08T04:22:10.034179+0000","last_peered":"2024-05-08T04:22:10.034179+0000","last_clean":"2024-05-08T04:22:10.034179+0000","last_became_active":"2024-05-08T04:22:07.610527+0000","last_became_peered":"2024-05-08T04:22:07.610527+0000","last_unstale":"2024-05-08T04:22:10.034179+0000","last_undegraded":"2024-05-08T04:22:10.034179+0000","last_fullsized":"2024-05-08T04:22:10.034179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:58:17.918739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:09.608228+0000","last_change":"2024-05-08T04:22:08.614939+0000","last_active":"2024-05-08T04:22:09.608228+0000","last_peered":"2024-05-08T04:22:09.608228+0000","last_clean":"2024-05-08T04:22:09.608228+0000","last_became_active":"2024-05-08T04:22:08.614685+0000","last_became_peered":"2024-05-08T04:22:08.614685+0000","last_unstale":"2024-05-08T04:22:09.608228+0000","last_undegraded":"2024-05-08T04:22:09.608228+0000","last_fullsized":"2024-05-08T04:22:09.608228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:07.581217+0000","last_clean_scrub_stamp":"2024-05-08T04:22:07.581217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:51:35.712252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:11.118203+0000","last_change":"2024-05-08T04:22:07.611008+0000","last_active":"2024-05-08T04:22:11.118203+0000","last_peered":"2024-05-08T04:22:11.118203+0000","last_clean":"2024-05-08T04:22:11.118203+0000","last_became_active":"2024-05-08T04:22:07.610754+0000","last_became_peered":"2024-05-08T04:22:07.610754+0000","last_unstale":"2024-05-08T04:22:11.118203+0000","last_undegraded":"2024-05-08T04:22:11.118203+0000","last_fullsized":"2024-05-08T04:22:11.118203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:06.577029+0000","last_clean_scrub_stamp":"2024-05-08T04:22:06.577029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:22.858941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T04:22:10.368755+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:22:10.368755+0000","last_peered":"2024-05-08T04:22:10.368755+0000","last_clean":"2024-05-08T04:22:10.368755+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:22:10.368755+0000","last_undegraded":"2024-05-08T04:22:10.368755+0000","last_fullsized":"2024-05-08T04:22:10.368755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":146144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":147734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":737072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":147756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":146898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":146156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":736560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":146212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:22:16.248 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-08T04:22:16.248 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-08T04:22:16.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.390+0000 7fd60b577640 1 Processor -- start 2024-05-08T04:22:16.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.390+0000 7fd60b577640 1 -- start start 2024-05-08T04:22:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd60b577640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd6040ce740 0x7fd60415ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd60b577640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6041616c0 con 0x7fd604157f80 2024-05-08T04:22:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd60b577640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6040c7170 con 0x7fd604158360 2024-05-08T04:22:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd60b577640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6040c7450 con 0x7fd6040ce740 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd609313640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd604157f80 0x7fd6040c6960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:41248/0 (socket says 172.21.15.104:41248) 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd609313640 1 -- 172.21.15.104:0/2882450245 learned_addr learned my addr 172.21.15.104:0/2882450245 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906898224 0 0) 0x7fd6041616c0 con 0x7fd604157f80 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f0003520 con 0x7fd604157f80 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd609b14640 1 --2- 172.21.15.104:0/2882450245 >> v2:172.21.15.183:3300/0 conn(0x7fd6040ce740 0x7fd60415ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2201999141 0 0) 0x7fd5f0003520 con 0x7fd604157f80 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 >> v2:172.21.15.183:3300/0 conn(0x7fd6040ce740 msgr2=0x7fd60415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 --2- 172.21.15.104:0/2882450245 >> v2:172.21.15.183:3300/0 conn(0x7fd6040ce740 0x7fd60415ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 >> v1:172.21.15.183:6789/0 conn(0x7fd604158360 legacy=0x7fd6040ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd604161960 con 0x7fd604157f80 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fd600001670 con 0x7fd604157f80 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 >> v1:172.21.15.104:6789/0 conn(0x7fd604157f80 legacy=0x7fd6040c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 --2- 172.21.15.104:0/2882450245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5f00039b0 0x7fd5f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 --2- 172.21.15.104:0/2882450245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5f0004800 0x7fd5f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 --2- 172.21.15.104:0/2882450245 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5f00051c0 0x7fd5f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6040c7450 con 0x7fd5f00039b0 2024-05-08T04:22:16.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f000c070 con 0x7fd5f0004800 2024-05-08T04:22:16.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f000c270 con 0x7fd5f00051c0 2024-05-08T04:22:16.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.391+0000 7fd609313640 1 --2- 172.21.15.104:0/2882450245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5f00039b0 0x7fd5f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.392+0000 7fd608b12640 1 --2- 172.21.15.104:0/2882450245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5f0004800 0x7fd5f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.392+0000 7fd609b14640 1 --2- 172.21.15.104:0/2882450245 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5f00051c0 0x7fd5f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.392+0000 7fd609313640 1 -- 172.21.15.104:0/2882450245 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5f00051c0 msgr2=0x7fd5f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:16.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.392+0000 7fd609313640 1 --2- 172.21.15.104:0/2882450245 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5f00051c0 0x7fd5f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.392+0000 7fd609313640 1 -- 172.21.15.104:0/2882450245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5f0004800 msgr2=0x7fd5f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:16.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.392+0000 7fd609313640 1 --2- 172.21.15.104:0/2882450245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5f0004800 0x7fd5f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.392+0000 7fd609313640 1 -- 172.21.15.104:0/2882450245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f0003520 con 0x7fd5f00039b0 2024-05-08T04:22:16.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.392+0000 7fd609b14640 1 --2- 172.21.15.104:0/2882450245 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5f00051c0 0x7fd5f000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:16.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.392+0000 7fd609b14640 1 -- 172.21.15.104:0/2882450245 reap_dead start 2024-05-08T04:22:16.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.392+0000 7fd609313640 1 --2- 172.21.15.104:0/2882450245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5f00039b0 0x7fd5f0003dd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd60000c240 tx=0x7fd5f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653a966b3de9ec02 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:16.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.393+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600007d10 con 0x7fd5f00039b0 2024-05-08T04:22:16.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.393+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd600005ad0 con 0x7fd5f00039b0 2024-05-08T04:22:16.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.393+0000 7fd5fbfff640 1 -- 172.21.15.104:0/2882450245 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600007070 con 0x7fd5f00039b0 2024-05-08T04:22:16.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.393+0000 7fd60b577640 1 -- 172.21.15.104:0/2882450245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5f00039b0 msgr2=0x7fd5f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.393+0000 7fd60b577640 1 --2- 172.21.15.104:0/2882450245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5f00039b0 0x7fd5f0003dd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd60000c240 tx=0x7fd5f0005830 comp rx=0 tx=0).stop 2024-05-08T04:22:16.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.393+0000 7fd60b577640 1 -- 172.21.15.104:0/2882450245 shutdown_connections 2024-05-08T04:22:16.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.393+0000 7fd60b577640 1 --2- 172.21.15.104:0/2882450245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5f00039b0 0x7fd5f0003dd0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.393+0000 7fd60b577640 1 -- 172.21.15.104:0/2882450245 >> 172.21.15.104:0/2882450245 conn(0x7fd6040b33e0 msgr2=0x7fd6040b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:16.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.393+0000 7fd60b577640 1 -- 172.21.15.104:0/2882450245 shutdown_connections 2024-05-08T04:22:16.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.393+0000 7fd60b577640 1 -- 172.21.15.104:0/2882450245 wait complete. 2024-05-08T04:22:16.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.394+0000 7fd60b577640 1 Processor -- start 2024-05-08T04:22:16.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.394+0000 7fd60b577640 1 -- start start 2024-05-08T04:22:16.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd60b577640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5f00039b0 0x7fd6041f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd60b577640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd604150670 0x7fd604153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd60b577640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd604153b90 0x7fd6041603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd60b577640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60415ee60 con 0x7fd604153b90 2024-05-08T04:22:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd60b577640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60415ece0 con 0x7fd5f00039b0 2024-05-08T04:22:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd60b577640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60415efe0 con 0x7fd604150670 2024-05-08T04:22:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd609b14640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd604153b90 0x7fd6041603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd609b14640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd604153b90 0x7fd6041603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50018/0 (socket says 172.21.15.104:50018) 2024-05-08T04:22:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd609b14640 1 -- 172.21.15.104:0/4283569117 learned_addr learned my addr 172.21.15.104:0/4283569117 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd608b12640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd604150670 0x7fd604153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd609313640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5f00039b0 0x7fd6041f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd609b14640 1 -- 172.21.15.104:0/4283569117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd604150670 msgr2=0x7fd604153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd609b14640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd604150670 0x7fd604153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd609b14640 1 -- 172.21.15.104:0/4283569117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5f00039b0 msgr2=0x7fd6041f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd609b14640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5f00039b0 0x7fd6041f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.395+0000 7fd609b14640 1 -- 172.21.15.104:0/4283569117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6040d2450 con 0x7fd604153b90 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.396+0000 7fd609b14640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd604153b90 0x7fd6041603f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd604071fc0 tx=0x7fd5fc010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.396+0000 7fd5f9ffb640 1 -- 172.21.15.104:0/4283569117 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc010e60 con 0x7fd604153b90 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.396+0000 7fd5f9ffb640 1 -- 172.21.15.104:0/4283569117 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc003990 con 0x7fd604153b90 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.396+0000 7fd5f9ffb640 1 -- 172.21.15.104:0/4283569117 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc003da0 con 0x7fd604153b90 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.396+0000 7fd60b577640 1 -- 172.21.15.104:0/4283569117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6040d2170 con 0x7fd604153b90 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.396+0000 7fd60b577640 1 -- 172.21.15.104:0/4283569117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6041f4450 con 0x7fd604153b90 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.397+0000 7fd60b577640 1 -- 172.21.15.104:0/4283569117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd604074830 con 0x7fd604153b90 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.397+0000 7fd5f9ffb640 1 -- 172.21.15.104:0/4283569117 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd5fc01e020 con 0x7fd604153b90 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.398+0000 7fd5f9ffb640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd5e806b4d0 0x7fd5e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.398+0000 7fd5f9ffb640 1 -- 172.21.15.104:0/4283569117 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5fc08a880 con 0x7fd604153b90 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.398+0000 7fd609313640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd5e806b4d0 0x7fd5e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.398+0000 7fd609313640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd5e806b4d0 0x7fd5e806d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd600032000 tx=0x7fd600034040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:16.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.402+0000 7fd5f9ffb640 1 -- 172.21.15.104:0/4283569117 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd5fc059700 con 0x7fd604153b90 2024-05-08T04:22:16.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.644+0000 7fd60b577640 1 -- 172.21.15.104:0/4283569117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd6040b7780 con 0x7fd604153b90 2024-05-08T04:22:16.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.646+0000 7fd5f9ffb640 1 -- 172.21.15.104:0/4283569117 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7fd5fc059000 con 0x7fd604153b90 2024-05-08T04:22:16.647 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-05-08T04:22:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQB9/TpmmVCJDBAA7kFxGuTTRTJge+xrcPo3lw== 2024-05-08T04:22:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: caps mds = "allow" 2024-05-08T04:22:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: caps mon = "allow r" 2024-05-08T04:22:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-08T04:22:16.648 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-05-08T04:22:16.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.648+0000 7fd60b577640 1 -- 172.21.15.104:0/4283569117 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd5e806b4d0 msgr2=0x7fd5e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.648+0000 7fd60b577640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd5e806b4d0 0x7fd5e806d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd600032000 tx=0x7fd600034040 comp rx=0 tx=0).stop 2024-05-08T04:22:16.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.648+0000 7fd60b577640 1 -- 172.21.15.104:0/4283569117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd604153b90 msgr2=0x7fd6041603f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.648+0000 7fd60b577640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd604153b90 0x7fd6041603f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd604071fc0 tx=0x7fd5fc010590 comp rx=0 tx=0).stop 2024-05-08T04:22:16.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.648+0000 7fd60b577640 1 -- 172.21.15.104:0/4283569117 shutdown_connections 2024-05-08T04:22:16.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.648+0000 7fd60b577640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd5e806b4d0 0x7fd5e806d990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.648+0000 7fd60b577640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd604153b90 0x7fd6041603f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.648+0000 7fd60b577640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd604150670 0x7fd604153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.648+0000 7fd60b577640 1 --2- 172.21.15.104:0/4283569117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5f00039b0 0x7fd6041f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.648+0000 7fd60b577640 1 -- 172.21.15.104:0/4283569117 >> 172.21.15.104:0/4283569117 conn(0x7fd6040b33e0 msgr2=0x7fd6040b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:16.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.648+0000 7fd60b577640 1 -- 172.21.15.104:0/4283569117 shutdown_connections 2024-05-08T04:22:16.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.648+0000 7fd60b577640 1 -- 172.21.15.104:0/4283569117 wait complete. 2024-05-08T04:22:16.660 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:22:16.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.760+0000 7fba31c6f640 1 Processor -- start 2024-05-08T04:22:16.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.760+0000 7fba31c6f640 1 -- start start 2024-05-08T04:22:16.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.760+0000 7fba31c6f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fba2c15bca0 0x7fba2c0ada00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.761+0000 7fba31c6f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fba2c072810 0x7fba2c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.761+0000 7fba31c6f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c160010 0x7fba2c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.761+0000 7fba31c6f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2c06f4f0 con 0x7fba2c072810 2024-05-08T04:22:16.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.761+0000 7fba31c6f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2c06f7b0 con 0x7fba2c15bca0 2024-05-08T04:22:16.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.761+0000 7fba31c6f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c0af570 con 0x7fba2c160010 2024-05-08T04:22:16.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.761+0000 7fba2affd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fba2c072810 0x7fba2c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.761+0000 7fba2affd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fba2c072810 0x7fba2c15c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50032/0 (socket says 172.21.15.104:50032) 2024-05-08T04:22:16.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.761+0000 7fba2affd640 1 -- 172.21.15.104:0/2871492298 learned_addr learned my addr 172.21.15.104:0/2871492298 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:16.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.761+0000 7fba2affd640 1 -- 172.21.15.104:0/2871492298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c160010 msgr2=0x7fba2c0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:16.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.761+0000 7fba2affd640 1 --2- 172.21.15.104:0/2871492298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c160010 0x7fba2c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.761+0000 7fba2affd640 1 -- 172.21.15.104:0/2871492298 >> v2:172.21.15.183:3300/0 conn(0x7fba2c15bca0 msgr2=0x7fba2c0ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:16.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.761+0000 7fba2affd640 1 --2- 172.21.15.104:0/2871492298 >> v2:172.21.15.183:3300/0 conn(0x7fba2c15bca0 0x7fba2c0ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.761+0000 7fba2affd640 1 -- 172.21.15.104:0/2871492298 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c0af240 con 0x7fba2c072810 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.762+0000 7fba2affd640 1 --2- 172.21.15.104:0/2871492298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba2c072810 0x7fba2c15c080 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fba2c06c9c0 tx=0x7fba2002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4875b4772ec7e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.762+0000 7fba2a7fc640 1 -- 172.21.15.104:0/2871492298 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20037070 con 0x7fba2c072810 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.762+0000 7fba2a7fc640 1 -- 172.21.15.104:0/2871492298 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba20032440 con 0x7fba2c072810 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.762+0000 7fba2a7fc640 1 -- 172.21.15.104:0/2871492298 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20032810 con 0x7fba2c072810 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.762+0000 7fba31c6f640 1 -- 172.21.15.104:0/2871492298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba2c072810 msgr2=0x7fba2c15c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.762+0000 7fba31c6f640 1 --2- 172.21.15.104:0/2871492298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba2c072810 0x7fba2c15c080 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fba2c06c9c0 tx=0x7fba2002a140 comp rx=0 tx=0).stop 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.762+0000 7fba31c6f640 1 -- 172.21.15.104:0/2871492298 shutdown_connections 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.762+0000 7fba31c6f640 1 --2- 172.21.15.104:0/2871492298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c160010 0x7fba2c0acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.762+0000 7fba31c6f640 1 --2- 172.21.15.104:0/2871492298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba2c072810 0x7fba2c15c080 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.762+0000 7fba31c6f640 1 --2- 172.21.15.104:0/2871492298 >> v2:172.21.15.183:3300/0 conn(0x7fba2c15bca0 0x7fba2c0ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.762+0000 7fba31c6f640 1 -- 172.21.15.104:0/2871492298 >> 172.21.15.104:0/2871492298 conn(0x7fba2c071a10 msgr2=0x7fba2c071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.762+0000 7fba31c6f640 1 -- 172.21.15.104:0/2871492298 shutdown_connections 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.762+0000 7fba31c6f640 1 -- 172.21.15.104:0/2871492298 wait complete. 2024-05-08T04:22:16.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.764+0000 7fba31c6f640 1 Processor -- start 2024-05-08T04:22:16.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.764+0000 7fba31c6f640 1 -- start start 2024-05-08T04:22:16.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.764+0000 7fba31c6f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c072810 0x7fba2c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.764+0000 7fba31c6f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba2c15bca0 0x7fba2c14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.764+0000 7fba31c6f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba2c160010 0x7fba2c14fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.764+0000 7fba31c6f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c0ad330 con 0x7fba2c160010 2024-05-08T04:22:16.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.764+0000 7fba31c6f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c0af850 con 0x7fba2c15bca0 2024-05-08T04:22:16.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.764+0000 7fba31c6f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c0ad4b0 con 0x7fba2c072810 2024-05-08T04:22:16.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba2bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba2c160010 0x7fba2c14fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba2bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba2c160010 0x7fba2c14fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50034/0 (socket says 172.21.15.104:50034) 2024-05-08T04:22:16.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba2bfff640 1 -- 172.21.15.104:0/3600828720 learned_addr learned my addr 172.21.15.104:0/3600828720 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:16.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba2b7fe640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c072810 0x7fba2c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba2affd640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba2c15bca0 0x7fba2c14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba2bfff640 1 -- 172.21.15.104:0/3600828720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c072810 msgr2=0x7fba2c0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba2bfff640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c072810 0x7fba2c0ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba2bfff640 1 -- 172.21.15.104:0/3600828720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba2c15bca0 msgr2=0x7fba2c14f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba2bfff640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba2c15bca0 0x7fba2c14f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba2bfff640 1 -- 172.21.15.104:0/3600828720 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c156620 con 0x7fba2c160010 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba2b7fe640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c072810 0x7fba2c0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba2affd640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba2c15bca0 0x7fba2c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba2bfff640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba2c160010 0x7fba2c14fd90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fba2400b970 tx=0x7fba2400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba13fff640 1 -- 172.21.15.104:0/3600828720 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba24019070 con 0x7fba2c160010 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba13fff640 1 -- 172.21.15.104:0/3600828720 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2400cb60 con 0x7fba2c160010 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba31c6f640 1 -- 172.21.15.104:0/3600828720 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2c0cd2b0 con 0x7fba2c160010 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba13fff640 1 -- 172.21.15.104:0/3600828720 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba24014440 con 0x7fba2c160010 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.765+0000 7fba31c6f640 1 -- 172.21.15.104:0/3600828720 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2c1548e0 con 0x7fba2c160010 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.766+0000 7fba31c6f640 1 -- 172.21.15.104:0/3600828720 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2c075010 con 0x7fba2c160010 2024-05-08T04:22:16.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.767+0000 7fba13fff640 1 -- 172.21.15.104:0/3600828720 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fba2401c070 con 0x7fba2c160010 2024-05-08T04:22:16.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.767+0000 7fba13fff640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fba1806b4d0 0x7fba1806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:16.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.767+0000 7fba2b7fe640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fba1806b4d0 0x7fba1806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:16.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.767+0000 7fba13fff640 1 -- 172.21.15.104:0/3600828720 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba24089e90 con 0x7fba2c160010 2024-05-08T04:22:16.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.768+0000 7fba2b7fe640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fba1806b4d0 0x7fba1806d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fba1c006fd0 tx=0x7fba1c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:16.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.772+0000 7fba13fff640 1 -- 172.21.15.104:0/3600828720 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fba2c156620 con 0x7fba2c160010 2024-05-08T04:22:16.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.976+0000 7fba31c6f640 1 -- 172.21.15.104:0/3600828720 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba2c0b5380 con 0x7fba2c160010 2024-05-08T04:22:16.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.976+0000 7fba13fff640 1 -- 172.21.15.104:0/3600828720 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fba24058da0 con 0x7fba2c160010 2024-05-08T04:22:16.978 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:16.978 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4933,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3121320604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3121320604},{"type":"v1","addr":"172.21.15.183:6834","nonce":3121320604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/207909171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":207909171},{"type":"v1","addr":"172.21.15.183:6835","nonce":207909171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/4245686743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4245686743},{"type":"v1","addr":"172.21.15.104:6836","nonce":4245686743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:07.933747+0000","modified":"2024-05-08T04:22:09.941364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/4038606624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":4038606624},{"type":"v1","addr":"172.21.15.104:6837","nonce":4038606624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T04:22:16.978 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 14 2024-05-08T04:22:16.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.978+0000 7fba31c6f640 1 -- 172.21.15.104:0/3600828720 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fba1806b4d0 msgr2=0x7fba1806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.978+0000 7fba31c6f640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fba1806b4d0 0x7fba1806d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fba1c006fd0 tx=0x7fba1c008040 comp rx=0 tx=0).stop 2024-05-08T04:22:16.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.978+0000 7fba31c6f640 1 -- 172.21.15.104:0/3600828720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba2c160010 msgr2=0x7fba2c14fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:16.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.978+0000 7fba31c6f640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba2c160010 0x7fba2c14fd90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fba2400b970 tx=0x7fba2400be30 comp rx=0 tx=0).stop 2024-05-08T04:22:16.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.978+0000 7fba31c6f640 1 -- 172.21.15.104:0/3600828720 shutdown_connections 2024-05-08T04:22:16.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.978+0000 7fba31c6f640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fba1806b4d0 0x7fba1806d990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.978+0000 7fba31c6f640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba2c15bca0 0x7fba2c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.978+0000 7fba31c6f640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fba2c160010 0x7fba2c14fd90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.978+0000 7fba31c6f640 1 --2- 172.21.15.104:0/3600828720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c072810 0x7fba2c0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:16.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.978+0000 7fba31c6f640 1 -- 172.21.15.104:0/3600828720 >> 172.21.15.104:0/3600828720 conn(0x7fba2c071a10 msgr2=0x7fba2c0b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:16.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.978+0000 7fba31c6f640 1 -- 172.21.15.104:0/3600828720 shutdown_connections 2024-05-08T04:22:16.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:16.978+0000 7fba31c6f640 1 -- 172.21.15.104:0/3600828720 wait complete. 2024-05-08T04:22:17.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T04:22:07.933747+0000', 'modified': '2024-05-08T04:22:09.941364+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5214}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5214': {'gid': 5214, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6837/4038606624', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6835', 'nonce': 4038606624}, {'type': 'v1', 'addr': '172.21.15.104:6837', 'nonce': 4038606624}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T04:22:17.395 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T04:22:17.395 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-08T04:22:17.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.499+0000 7fb696553640 1 Processor -- start 2024-05-08T04:22:17.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.499+0000 7fb696553640 1 -- start start 2024-05-08T04:22:17.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.500+0000 7fb696553640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb690070c70 0x7fb6900d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.500+0000 7fb696553640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb690071050 0x7fb69015c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.500+0000 7fb696553640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb69015cad0 0x7fb69015f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.500+0000 7fb696553640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6900d16a0 con 0x7fb69015cad0 2024-05-08T04:22:17.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.500+0000 7fb696553640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6900d0eb0 con 0x7fb690071050 2024-05-08T04:22:17.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.500+0000 7fb696553640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69015d420 con 0x7fb690070c70 2024-05-08T04:22:17.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.500+0000 7fb694af0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb69015cad0 0x7fb69015f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.500+0000 7fb694af0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb69015cad0 0x7fb69015f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34430/0 (socket says 172.21.15.104:34430) 2024-05-08T04:22:17.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.500+0000 7fb694af0640 1 -- 172.21.15.104:0/333958568 learned_addr learned my addr 172.21.15.104:0/333958568 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:17.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.501+0000 7fb68ffff640 1 --2- 172.21.15.104:0/333958568 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb690070c70 0x7fb6900d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.501+0000 7fb687fff640 1 --2- 172.21.15.104:0/333958568 >> v2:172.21.15.183:3300/0 conn(0x7fb690071050 0x7fb69015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.501+0000 7fb694af0640 1 -- 172.21.15.104:0/333958568 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb690070c70 msgr2=0x7fb6900d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:17.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.501+0000 7fb694af0640 1 --2- 172.21.15.104:0/333958568 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb690070c70 0x7fb6900d0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.501+0000 7fb694af0640 1 -- 172.21.15.104:0/333958568 >> v2:172.21.15.183:3300/0 conn(0x7fb690071050 msgr2=0x7fb69015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:17.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.501+0000 7fb694af0640 1 --2- 172.21.15.104:0/333958568 >> v2:172.21.15.183:3300/0 conn(0x7fb690071050 0x7fb69015c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.501+0000 7fb694af0640 1 -- 172.21.15.104:0/333958568 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6900d10e0 con 0x7fb69015cad0 2024-05-08T04:22:17.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.501+0000 7fb694af0640 1 --2- 172.21.15.104:0/333958568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb69015cad0 0x7fb69015f450 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb690070a30 tx=0x7fb68802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afd3ca2033b1c39 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:17.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.501+0000 7fb68f7fe640 1 -- 172.21.15.104:0/333958568 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688036070 con 0x7fb69015cad0 2024-05-08T04:22:17.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.501+0000 7fb68f7fe640 1 -- 172.21.15.104:0/333958568 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb688031600 con 0x7fb69015cad0 2024-05-08T04:22:17.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.502+0000 7fb68f7fe640 1 -- 172.21.15.104:0/333958568 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6880319d0 con 0x7fb69015cad0 2024-05-08T04:22:17.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.502+0000 7fb696553640 1 -- 172.21.15.104:0/333958568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb69015cad0 msgr2=0x7fb69015f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.502+0000 7fb696553640 1 --2- 172.21.15.104:0/333958568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb69015cad0 0x7fb69015f450 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb690070a30 tx=0x7fb68802a6a0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.502+0000 7fb696553640 1 -- 172.21.15.104:0/333958568 shutdown_connections 2024-05-08T04:22:17.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.502+0000 7fb696553640 1 --2- 172.21.15.104:0/333958568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb69015cad0 0x7fb69015f450 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.502+0000 7fb696553640 1 --2- 172.21.15.104:0/333958568 >> v2:172.21.15.183:3300/0 conn(0x7fb690071050 0x7fb69015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.502+0000 7fb696553640 1 --2- 172.21.15.104:0/333958568 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb690070c70 0x7fb6900d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.502+0000 7fb696553640 1 -- 172.21.15.104:0/333958568 >> 172.21.15.104:0/333958568 conn(0x7fb6900b3450 msgr2=0x7fb6900b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:17.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.502+0000 7fb696553640 1 -- 172.21.15.104:0/333958568 shutdown_connections 2024-05-08T04:22:17.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.502+0000 7fb696553640 1 -- 172.21.15.104:0/333958568 wait complete. 2024-05-08T04:22:17.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.503+0000 7fb696553640 1 Processor -- start 2024-05-08T04:22:17.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.503+0000 7fb696553640 1 -- start start 2024-05-08T04:22:17.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb696553640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb690070c70 0x7fb69013e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb696553640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb690071050 0x7fb69014d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb696553640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb69015cad0 0x7fb69014dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb696553640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900714d0 con 0x7fb690071050 2024-05-08T04:22:17.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb696553640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69015d6c0 con 0x7fb690070c70 2024-05-08T04:22:17.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb696553640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69015f990 con 0x7fb69015cad0 2024-05-08T04:22:17.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb687fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb690071050 0x7fb69014d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb687fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb690071050 0x7fb69014d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34444/0 (socket says 172.21.15.104:34444) 2024-05-08T04:22:17.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb687fff640 1 -- 172.21.15.104:0/3999089732 learned_addr learned my addr 172.21.15.104:0/3999089732 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:17.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb694af0640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb69015cad0 0x7fb69014dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb68ffff640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb690070c70 0x7fb69013e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb687fff640 1 -- 172.21.15.104:0/3999089732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb69015cad0 msgr2=0x7fb69014dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb687fff640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb69015cad0 0x7fb69014dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb687fff640 1 -- 172.21.15.104:0/3999089732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb690070c70 msgr2=0x7fb69013e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.504+0000 7fb687fff640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb690070c70 0x7fb69013e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.505+0000 7fb687fff640 1 -- 172.21.15.104:0/3999089732 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6901f51c0 con 0x7fb690071050 2024-05-08T04:22:17.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.505+0000 7fb694af0640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb69015cad0 0x7fb69014dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:17.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.505+0000 7fb68ffff640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb690070c70 0x7fb69013e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:17.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.505+0000 7fb687fff640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb690071050 0x7fb69014d660 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb67800d800 tx=0x7fb67800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:17.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.505+0000 7fb68d7fa640 1 -- 172.21.15.104:0/3999089732 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800b6c0 con 0x7fb690071050 2024-05-08T04:22:17.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.505+0000 7fb68d7fa640 1 -- 172.21.15.104:0/3999089732 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb678019070 con 0x7fb690071050 2024-05-08T04:22:17.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.505+0000 7fb696553640 1 -- 172.21.15.104:0/3999089732 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6901f54a0 con 0x7fb690071050 2024-05-08T04:22:17.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.505+0000 7fb68d7fa640 1 -- 172.21.15.104:0/3999089732 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800ba80 con 0x7fb690071050 2024-05-08T04:22:17.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.505+0000 7fb696553640 1 -- 172.21.15.104:0/3999089732 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6901f5a60 con 0x7fb690071050 2024-05-08T04:22:17.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.506+0000 7fb68d7fa640 1 -- 172.21.15.104:0/3999089732 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb67800bc20 con 0x7fb690071050 2024-05-08T04:22:17.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.507+0000 7fb68d7fa640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb67006b4d0 0x7fb67006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.507+0000 7fb68ffff640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb67006b4d0 0x7fb67006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.507+0000 7fb68d7fa640 1 -- 172.21.15.104:0/3999089732 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb67808a5a0 con 0x7fb690071050 2024-05-08T04:22:17.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.507+0000 7fb68ffff640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb67006b4d0 0x7fb67006d990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb680006fd0 tx=0x7fb680008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:17.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.508+0000 7fb699253740 1 Processor -- start 2024-05-08T04:22:17.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.508+0000 7fb699253740 1 -- start start 2024-05-08T04:22:17.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.508+0000 7fb699253740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614137230 0x557614137610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.508+0000 7fb699253740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614154ad0 0x557614155020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.508+0000 7fb699253740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55761410cf10 0x557614153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.508+0000 7fb699253740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55761406fa10 con 0x557614154ad0 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.508+0000 7fb699253740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x557614018b30 con 0x557614137230 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.508+0000 7fb699253740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55761406bc50 con 0x55761410cf10 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb687fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614154ad0 0x557614155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb687fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614154ad0 0x557614155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34456/0 (socket says 172.21.15.104:34456) 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb687fff640 1 -- 172.21.15.104:0/1424210666 learned_addr learned my addr 172.21.15.104:0/1424210666 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb694af0640 1 --2- 172.21.15.104:0/1424210666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55761410cf10 0x557614153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb68ffff640 1 --2- 172.21.15.104:0/1424210666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614137230 0x557614137610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb687fff640 1 -- 172.21.15.104:0/1424210666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55761410cf10 msgr2=0x557614153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb687fff640 1 --2- 172.21.15.104:0/1424210666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55761410cf10 0x557614153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb687fff640 1 -- 172.21.15.104:0/1424210666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614137230 msgr2=0x557614137610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb687fff640 1 --2- 172.21.15.104:0/1424210666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614137230 0x557614137610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb687fff640 1 -- 172.21.15.104:0/1424210666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55761402de10 con 0x557614154ad0 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb687fff640 1 --2- 172.21.15.104:0/1424210666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614154ad0 0x557614155020 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb678060f90 tx=0x7fb6780594b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ca4e558a91af4c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:17.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb685ffb640 1 -- 172.21.15.104:0/1424210666 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67805cf00 con 0x557614154ad0 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb685ffb640 1 -- 172.21.15.104:0/1424210666 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67805c070 con 0x557614154ad0 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.509+0000 7fb685ffb640 1 -- 172.21.15.104:0/1424210666 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780614c0 con 0x557614154ad0 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.510+0000 7fb699253740 1 -- 172.21.15.104:0/1424210666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614154ad0 msgr2=0x557614155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.510+0000 7fb699253740 1 --2- 172.21.15.104:0/1424210666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614154ad0 0x557614155020 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb678060f90 tx=0x7fb6780594b0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.510+0000 7fb699253740 1 -- 172.21.15.104:0/1424210666 shutdown_connections 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.510+0000 7fb699253740 1 --2- 172.21.15.104:0/1424210666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55761410cf10 0x557614153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.510+0000 7fb699253740 1 --2- 172.21.15.104:0/1424210666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614154ad0 0x557614155020 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.510+0000 7fb699253740 1 --2- 172.21.15.104:0/1424210666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614137230 0x557614137610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.510+0000 7fb699253740 1 -- 172.21.15.104:0/1424210666 >> 172.21.15.104:0/1424210666 conn(0x557614109840 msgr2=0x557614152040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.510+0000 7fb699253740 1 -- 172.21.15.104:0/1424210666 shutdown_connections 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.510+0000 7fb699253740 1 -- 172.21.15.104:0/1424210666 wait complete. 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.510+0000 7fb699253740 1 -- start start 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.511+0000 7fb699253740 1 Processor -- start 2024-05-08T04:22:17.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.511+0000 7fb699253740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 0x5576141505e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.511+0000 7fb699253740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 0x557614163190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.511+0000 7fb699253740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614138f40 0x5576141555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.511+0000 7fb699253740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55761410dcb0 con 0x557614137230 2024-05-08T04:22:17.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.511+0000 7fb699253740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55761402c0c0 con 0x557614154ad0 2024-05-08T04:22:17.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.511+0000 7fb699253740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x557614107770 con 0x557614138f40 2024-05-08T04:22:17.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.511+0000 7fb699253740 10 client.0 _ll_register_callbacks cb 0x55761401fec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T04:22:17.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.511+0000 7fb68ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 0x5576141505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.511+0000 7fb68ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 0x5576141505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34460/0 (socket says 172.21.15.104:34460) 2024-05-08T04:22:17.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.511+0000 7fb68ffff640 1 -- 172.21.15.104:0/197120871 learned_addr learned my addr 172.21.15.104:0/197120871 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:17.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.511+0000 7fb694af0640 1 --2- 172.21.15.104:0/197120871 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614138f40 0x5576141555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.511+0000 7fb687fff640 1 --2- 172.21.15.104:0/197120871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 0x557614163190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb68ffff640 1 -- 172.21.15.104:0/197120871 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614138f40 msgr2=0x5576141555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:17.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb68ffff640 1 --2- 172.21.15.104:0/197120871 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614138f40 0x5576141555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb68ffff640 1 -- 172.21.15.104:0/197120871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 msgr2=0x557614163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb68ffff640 1 --2- 172.21.15.104:0/197120871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 0x557614163190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb68ffff640 1 -- 172.21.15.104:0/197120871 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557613d842d0 con 0x557614137230 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb68ffff640 1 --2- 172.21.15.104:0/197120871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 0x5576141505e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb680014740 tx=0x7fb680004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f6513e86c8d9db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb66effd640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb66effd640 1 -- 172.21.15.104:0/197120871 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680025020 con 0x557614137230 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb66effd640 1 -- 172.21.15.104:0/197120871 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb680015960 con 0x557614137230 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb699253740 1 -- 172.21.15.104:0/197120871 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb67805c070 con 0x557614137230 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb66effd640 1 -- 172.21.15.104:0/197120871 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb68002f050 con 0x557614137230 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb699253740 10 client.5436 fetch_fsmap learned FSMap version 14 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb699253740 1 -- 172.21.15.104:0/197120871 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x557613e4e6b0 con 0x557614137230 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb66effd640 1 -- 172.21.15.104:0/197120871 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67805c070 con 0x557614137230 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb66effd640 1 -- 172.21.15.104:0/197120871 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb680032020 con 0x557614137230 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb699253740 10 client.5436 fetch_fsmap finished waiting for FSMap version 14 2024-05-08T04:22:17.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb699253740 10 client.5436 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb699253740 20 client.5436 populate_metadata read hostname 'smithi104' 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb699253740 1 --2- 172.21.15.104:0/197120871 >> [v2:172.21.15.104:6835/4038606624,v1:172.21.15.104:6837/4038606624] conn(0x55761414ad90 0x5576141662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb699253740 4 client.5436 mds_command: new command op to 5214 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb699253740 1 -- 172.21.15.104:0/197120871 --> [v2:172.21.15.104:6835/4038606624,v1:172.21.15.104:6837/4038606624] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5576140ce920 con 0x55761414ad90 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.512+0000 7fb687fff640 1 --2- 172.21.15.104:0/197120871 >> [v2:172.21.15.104:6835/4038606624,v1:172.21.15.104:6837/4038606624] conn(0x55761414ad90 0x5576141662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.513+0000 7fb66effd640 10 client.5436 ms_handle_connect on v2:172.21.15.104:6835/4038606624 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.513+0000 7fb687fff640 1 --2- 172.21.15.104:0/197120871 >> [v2:172.21.15.104:6835/4038606624,v1:172.21.15.104:6837/4038606624] conn(0x55761414ad90 0x5576141662f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3361d4ff6a47085c server_cookie=c11bf88a2247cc76 in_seq=0 out_seq=0 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.513+0000 7fb66effd640 1 -- 172.21.15.104:0/197120871 <== mds.0 v2:172.21.15.104:6835/4038606624 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5576140ce920 con 0x55761414ad90 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.513+0000 7fb66effd640 10 client.5436 handle_command_reply: tid=0 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.513+0000 7fb699253740 1 client.5436 shutdown 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.513+0000 7fb699253740 1 -- 172.21.15.104:0/197120871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 msgr2=0x5576141505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.513+0000 7fb699253740 1 --2- 172.21.15.104:0/197120871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 0x5576141505e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb680014740 tx=0x7fb680004730 comp rx=0 tx=0).stop 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.514+0000 7fb699253740 1 -- 172.21.15.104:0/197120871 shutdown_connections 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.514+0000 7fb699253740 1 --2- 172.21.15.104:0/197120871 >> [v2:172.21.15.104:6835/4038606624,v1:172.21.15.104:6837/4038606624] conn(0x55761414ad90 0x5576141662f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.514+0000 7fb699253740 1 --2- 172.21.15.104:0/197120871 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 0x557614163190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.514+0000 7fb699253740 1 --2- 172.21.15.104:0/197120871 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614138f40 0x5576141555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.514+0000 7fb66effd640 0 client.5436 ms_handle_reset on v2:172.21.15.104:6835/4038606624 2024-05-08T04:22:17.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.514+0000 7fb699253740 1 --2- 172.21.15.104:0/197120871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 0x5576141505e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.514+0000 7fb699253740 1 -- 172.21.15.104:0/197120871 >> 172.21.15.104:0/197120871 conn(0x55761410cf10 msgr2=0x557614106eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:17.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.514+0000 7fb699253740 1 -- 172.21.15.104:0/197120871 shutdown_connections 2024-05-08T04:22:17.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.514+0000 7fb699253740 1 -- 172.21.15.104:0/197120871 wait complete. 2024-05-08T04:22:17.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.514+0000 7fb699253740 20 client.5436 trim_cache size 0 max 16384 2024-05-08T04:22:17.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.529+0000 7fb699253740 1 Processor -- start 2024-05-08T04:22:17.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.529+0000 7fb699253740 1 -- start start 2024-05-08T04:22:17.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb699253740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614137230 0x557614149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb699253740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614138f40 0x55761410d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb699253740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 0x55761416c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb699253740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6901fcd20 con 0x557614138f40 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb699253740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6901fc150 con 0x557614154ad0 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb699253740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6901fc720 con 0x557614137230 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb687fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614138f40 0x55761410d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb687fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614138f40 0x55761410d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34464/0 (socket says 172.21.15.104:34464) 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb687fff640 1 -- 172.21.15.104:0/3671528430 learned_addr learned my addr 172.21.15.104:0/3671528430 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb687fff640 1 -- 172.21.15.104:0/3671528430 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614137230 msgr2=0x557614149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb687fff640 1 --2- 172.21.15.104:0/3671528430 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614137230 0x557614149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb687fff640 1 -- 172.21.15.104:0/3671528430 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 msgr2=0x55761416c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb687fff640 1 --2- 172.21.15.104:0/3671528430 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 0x55761416c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb687fff640 1 -- 172.21.15.104:0/3671528430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557614108d00 con 0x557614138f40 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb687fff640 1 --2- 172.21.15.104:0/3671528430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614138f40 0x55761410d2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb678088bb0 tx=0x7fb678020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13fc646deeaf91 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:17.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb6857fa640 1 -- 172.21.15.104:0/3671528430 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780614c0 con 0x557614138f40 2024-05-08T04:22:17.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb6857fa640 1 -- 172.21.15.104:0/3671528430 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67805c040 con 0x557614138f40 2024-05-08T04:22:17.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.530+0000 7fb6857fa640 1 -- 172.21.15.104:0/3671528430 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780570b0 con 0x557614138f40 2024-05-08T04:22:17.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.531+0000 7fb699253740 1 -- 172.21.15.104:0/3671528430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614138f40 msgr2=0x55761410d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.531+0000 7fb699253740 1 --2- 172.21.15.104:0/3671528430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614138f40 0x55761410d2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb678088bb0 tx=0x7fb678020000 comp rx=0 tx=0).stop 2024-05-08T04:22:17.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.531+0000 7fb699253740 1 -- 172.21.15.104:0/3671528430 shutdown_connections 2024-05-08T04:22:17.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.531+0000 7fb699253740 1 --2- 172.21.15.104:0/3671528430 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 0x55761416c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.531+0000 7fb699253740 1 --2- 172.21.15.104:0/3671528430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614138f40 0x55761410d2f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.531+0000 7fb699253740 1 --2- 172.21.15.104:0/3671528430 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614137230 0x557614149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.531+0000 7fb699253740 1 -- 172.21.15.104:0/3671528430 >> 172.21.15.104:0/3671528430 conn(0x55761410cf10 msgr2=0x557614152360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:17.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.531+0000 7fb699253740 1 -- 172.21.15.104:0/3671528430 shutdown_connections 2024-05-08T04:22:17.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.531+0000 7fb699253740 1 -- 172.21.15.104:0/3671528430 wait complete. 2024-05-08T04:22:17.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.532+0000 7fb699253740 1 -- start start 2024-05-08T04:22:17.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.532+0000 7fb699253740 1 Processor -- start 2024-05-08T04:22:17.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb699253740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 0x5576141c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb699253740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614138f40 0x557614161a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb699253740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 0x557614150be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb699253740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55761414ac10 con 0x557614137230 2024-05-08T04:22:17.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb699253740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x557614148ff0 con 0x557614154ad0 2024-05-08T04:22:17.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb699253740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55761414b1b0 con 0x557614138f40 2024-05-08T04:22:17.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb699253740 10 client.0 _ll_register_callbacks cb 0x557614107c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T04:22:17.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb68ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 0x5576141c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb68ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 0x5576141c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34472/0 (socket says 172.21.15.104:34472) 2024-05-08T04:22:17.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb68ffff640 1 -- 172.21.15.104:0/2595640614 learned_addr learned my addr 172.21.15.104:0/2595640614 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:17.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb687fff640 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614138f40 0x557614161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb694af0640 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 0x557614150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb68ffff640 1 -- 172.21.15.104:0/2595640614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614138f40 msgr2=0x557614161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:17.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb68ffff640 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614138f40 0x557614161a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb68ffff640 1 -- 172.21.15.104:0/2595640614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 msgr2=0x557614150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:17.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb68ffff640 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 0x557614150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb68ffff640 1 -- 172.21.15.104:0/2595640614 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557614149d50 con 0x557614137230 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb694af0640 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 0x557614150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb687fff640 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614138f40 0x557614161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb68ffff640 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 0x5576141c5c60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb68000f6a0 tx=0x7fb6800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515b7010cec871f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb66effd640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb66effd640 1 -- 172.21.15.104:0/2595640614 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680038060 con 0x557614137230 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb66effd640 1 -- 172.21.15.104:0/2595640614 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb680015960 con 0x557614137230 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb699253740 1 -- 172.21.15.104:0/2595640614 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb67805c040 con 0x557614137230 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb66effd640 1 -- 172.21.15.104:0/2595640614 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb68003e050 con 0x557614137230 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb699253740 10 client.5442 fetch_fsmap learned FSMap version 14 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.533+0000 7fb699253740 1 -- 172.21.15.104:0/2595640614 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x557614135ae0 con 0x557614137230 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb66effd640 1 -- 172.21.15.104:0/2595640614 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67805c040 con 0x557614137230 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb66effd640 1 -- 172.21.15.104:0/2595640614 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb680041020 con 0x557614137230 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb699253740 10 client.5442 fetch_fsmap finished waiting for FSMap version 14 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb699253740 10 client.5442 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb699253740 20 client.5442 populate_metadata read hostname 'smithi104' 2024-05-08T04:22:17.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb699253740 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.104:6835/4038606624,v1:172.21.15.104:6837/4038606624] conn(0x55761410d8f0 0x55761414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb699253740 4 client.5442 mds_command: new command op to 5214 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb699253740 1 -- 172.21.15.104:0/2595640614 --> [v2:172.21.15.104:6835/4038606624,v1:172.21.15.104:6837/4038606624] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557614154540 con 0x55761410d8f0 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb687fff640 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.104:6835/4038606624,v1:172.21.15.104:6837/4038606624] conn(0x55761410d8f0 0x55761414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb66effd640 10 client.5442 ms_handle_connect on v2:172.21.15.104:6835/4038606624 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb687fff640 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.104:6835/4038606624,v1:172.21.15.104:6837/4038606624] conn(0x55761410d8f0 0x55761414eac0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2616b0701ed8fabe server_cookie=dbd8da5f04712e75 in_seq=0 out_seq=0 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb66effd640 1 -- 172.21.15.104:0/2595640614 <== mds.0 v2:172.21.15.104:6835/4038606624 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x557614154540 con 0x55761410d8f0 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb66effd640 10 client.5442 handle_command_reply: tid=0 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb699253740 1 client.5442 shutdown 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb699253740 1 -- 172.21.15.104:0/2595640614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 msgr2=0x5576141c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.534+0000 7fb699253740 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 0x5576141c5c60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb68000f6a0 tx=0x7fb6800046c0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb699253740 1 -- 172.21.15.104:0/2595640614 shutdown_connections 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb699253740 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.104:6835/4038606624,v1:172.21.15.104:6837/4038606624] conn(0x55761410d8f0 0x55761414eac0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb699253740 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557614154ad0 0x557614150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb66effd640 0 client.5442 ms_handle_reset on v2:172.21.15.104:6835/4038606624 2024-05-08T04:22:17.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb699253740 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557614138f40 0x557614161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb699253740 1 --2- 172.21.15.104:0/2595640614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x557614137230 0x5576141c5c60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb699253740 1 -- 172.21.15.104:0/2595640614 >> 172.21.15.104:0/2595640614 conn(0x55761410cf10 msgr2=0x55761414bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:17.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb699253740 1 -- 172.21.15.104:0/2595640614 shutdown_connections 2024-05-08T04:22:17.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb699253740 1 -- 172.21.15.104:0/2595640614 wait complete. 2024-05-08T04:22:17.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb699253740 20 client.5442 trim_cache size 0 max 16384 2024-05-08T04:22:17.542 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:22:17.542 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "c8b1f73b-90d2-40b8-ad3c-a036617abfed", 2024-05-08T04:22:17.542 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-05-08T04:22:17.542 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 5214, 2024-05-08T04:22:17.543 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-05-08T04:22:17.543 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-05-08T04:22:17.543 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-05-08T04:22:17.543 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 8.9449313830000001, 2024-05-08T04:22:17.543 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 14, 2024-05-08T04:22:17.543 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 33, 2024-05-08T04:22:17.543 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 33, 2024-05-08T04:22:17.543 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 16.386480284000001 2024-05-08T04:22:17.543 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:22:17.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb696553640 1 -- 172.21.15.104:0/3999089732 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb67006b4d0 msgr2=0x7fb67006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb696553640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb67006b4d0 0x7fb67006d990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb680006fd0 tx=0x7fb680008040 comp rx=0 tx=0).stop 2024-05-08T04:22:17.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb696553640 1 -- 172.21.15.104:0/3999089732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb690071050 msgr2=0x7fb69014d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb696553640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb690071050 0x7fb69014d660 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb67800d800 tx=0x7fb67800dcc0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb696553640 1 -- 172.21.15.104:0/3999089732 shutdown_connections 2024-05-08T04:22:17.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb696553640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb67006b4d0 0x7fb67006d990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb696553640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb69015cad0 0x7fb69014dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb696553640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb690071050 0x7fb69014d660 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb696553640 1 --2- 172.21.15.104:0/3999089732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb690070c70 0x7fb69013e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb696553640 1 -- 172.21.15.104:0/3999089732 >> 172.21.15.104:0/3999089732 conn(0x7fb6900b3450 msgr2=0x7fb6900b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:17.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb696553640 1 -- 172.21.15.104:0/3999089732 shutdown_connections 2024-05-08T04:22:17.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.535+0000 7fb696553640 1 -- 172.21.15.104:0/3999089732 wait complete. 2024-05-08T04:22:17.547 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T04:22:17.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.646+0000 7f6c5a1be640 1 Processor -- start 2024-05-08T04:22:17.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.646+0000 7f6c5a1be640 1 -- start start 2024-05-08T04:22:17.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c5a1be640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c540cf360 0x7f6c540cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c5a1be640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6c540ccbe0 0x7f6c540cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c5a1be640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540cc700 con 0x7f6c54099a40 2024-05-08T04:22:17.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c5a1be640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5415ced0 con 0x7f6c540ccbe0 2024-05-08T04:22:17.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c5a1be640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540d0020 con 0x7f6c540cf360 2024-05-08T04:22:17.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c53fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6c540ccbe0 0x7f6c540cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c53fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6c540ccbe0 0x7f6c540cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34474/0 (socket says 172.21.15.104:34474) 2024-05-08T04:22:17.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c537fe640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f6c54099a40 0x7f6c54099e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:42782/0 (socket says 172.21.15.104:42782) 2024-05-08T04:22:17.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c53fff640 1 -- 172.21.15.104:0/2753638492 learned_addr learned my addr 172.21.15.104:0/2753638492 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:17.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c52ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c540cf360 0x7f6c540cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c53fff640 1 -- 172.21.15.104:0/2753638492 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c540cf360 msgr2=0x7f6c540cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:17.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c53fff640 1 --2- 172.21.15.104:0/2753638492 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c540cf360 0x7f6c540cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c53fff640 1 -- 172.21.15.104:0/2753638492 >> v1:172.21.15.183:6789/0 conn(0x7f6c54099a40 legacy=0x7f6c54099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.647+0000 7f6c53fff640 1 -- 172.21.15.104:0/2753638492 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540d0300 con 0x7f6c540ccbe0 2024-05-08T04:22:17.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.648+0000 7f6c53fff640 1 --2- 172.21.15.104:0/2753638492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c540ccbe0 0x7f6c540cd050 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009e50 tx=0x7f6c4c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920289c6813ec831 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:17.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.649+0000 7f6c527fc640 1 -- 172.21.15.104:0/2753638492 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c036070 con 0x7f6c540ccbe0 2024-05-08T04:22:17.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.649+0000 7f6c527fc640 1 -- 172.21.15.104:0/2753638492 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c031600 con 0x7f6c540ccbe0 2024-05-08T04:22:17.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.649+0000 7f6c527fc640 1 -- 172.21.15.104:0/2753638492 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0319d0 con 0x7f6c540ccbe0 2024-05-08T04:22:17.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.649+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2753638492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c540ccbe0 msgr2=0x7f6c540cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.649+0000 7f6c5a1be640 1 --2- 172.21.15.104:0/2753638492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c540ccbe0 0x7f6c540cd050 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009e50 tx=0x7f6c4c02a710 comp rx=0 tx=0).stop 2024-05-08T04:22:17.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.650+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2753638492 shutdown_connections 2024-05-08T04:22:17.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.650+0000 7f6c5a1be640 1 --2- 172.21.15.104:0/2753638492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c540ccbe0 0x7f6c540cd050 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.650+0000 7f6c5a1be640 1 --2- 172.21.15.104:0/2753638492 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c540cf360 0x7f6c540cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.650+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2753638492 >> 172.21.15.104:0/2753638492 conn(0x7f6c540b3280 msgr2=0x7f6c540b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:17.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.650+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2753638492 shutdown_connections 2024-05-08T04:22:17.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.650+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2753638492 wait complete. 2024-05-08T04:22:17.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.651+0000 7f6c5a1be640 1 Processor -- start 2024-05-08T04:22:17.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.651+0000 7f6c5a1be640 1 -- start start 2024-05-08T04:22:17.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c5a1be640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c54099a40 0x7f6c541f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c5a1be640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c540ccbe0 0x7f6c5415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c5a1be640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c540cf360 0x7f6c5415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c5a1be640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540cfd00 con 0x7f6c540cf360 2024-05-08T04:22:17.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c5a1be640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54159860 con 0x7f6c540ccbe0 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c5a1be640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540d08c0 con 0x7f6c54099a40 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c53fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c540cf360 0x7f6c5415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c53fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c540cf360 0x7f6c5415b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34484/0 (socket says 172.21.15.104:34484) 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c53fff640 1 -- 172.21.15.104:0/2908148182 learned_addr learned my addr 172.21.15.104:0/2908148182 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c537fe640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c54099a40 0x7f6c541f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c52ffd640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c540ccbe0 0x7f6c5415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c53fff640 1 -- 172.21.15.104:0/2908148182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c54099a40 msgr2=0x7f6c541f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c53fff640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c54099a40 0x7f6c541f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c53fff640 1 -- 172.21.15.104:0/2908148182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c540ccbe0 msgr2=0x7f6c5415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c53fff640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c540ccbe0 0x7f6c5415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c53fff640 1 -- 172.21.15.104:0/2908148182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540b4550 con 0x7f6c540cf360 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c52ffd640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c540ccbe0 0x7f6c5415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c53fff640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c540cf360 0x7f6c5415b210 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009e50 tx=0x7f6c4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c3bfff640 1 -- 172.21.15.104:0/2908148182 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c036050 con 0x7f6c540cf360 2024-05-08T04:22:17.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c3bfff640 1 -- 172.21.15.104:0/2908148182 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c042070 con 0x7f6c540cf360 2024-05-08T04:22:17.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c3bfff640 1 -- 172.21.15.104:0/2908148182 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c009510 con 0x7f6c540cf360 2024-05-08T04:22:17.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2908148182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c540b47f0 con 0x7f6c540cf360 2024-05-08T04:22:17.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.652+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2908148182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c540b4db0 con 0x7f6c540cf360 2024-05-08T04:22:17.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.654+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2908148182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c540b42a0 con 0x7f6c540cf360 2024-05-08T04:22:17.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.654+0000 7f6c3bfff640 1 -- 172.21.15.104:0/2908148182 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c4c007bf0 con 0x7f6c540cf360 2024-05-08T04:22:17.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.654+0000 7f6c3bfff640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c4006b500 0x7f6c4006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:17.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.654+0000 7f6c3bfff640 1 -- 172.21.15.104:0/2908148182 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c4c0aafb0 con 0x7f6c540cf360 2024-05-08T04:22:17.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.654+0000 7f6c537fe640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c4006b500 0x7f6c4006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:17.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.655+0000 7f6c537fe640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c4006b500 0x7f6c4006d9c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6c44000fb0 tx=0x7f6c44007c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:17.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.659+0000 7f6c3bfff640 1 -- 172.21.15.104:0/2908148182 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c4c079f50 con 0x7f6c540cf360 2024-05-08T04:22:17.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.866+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2908148182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6c54071b90 con 0x7f6c540cf360 2024-05-08T04:22:17.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.867+0000 7f6c3bfff640 1 -- 172.21.15.104:0/2908148182 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6c4c079850 con 0x7f6c540cf360 2024-05-08T04:22:17.868 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T04:22:17.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.868+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2908148182 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c4006b500 msgr2=0x7f6c4006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.868+0000 7f6c5a1be640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c4006b500 0x7f6c4006d9c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6c44000fb0 tx=0x7f6c44007c90 comp rx=0 tx=0).stop 2024-05-08T04:22:17.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.868+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2908148182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c540cf360 msgr2=0x7f6c5415b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:17.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.868+0000 7f6c5a1be640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c540cf360 0x7f6c5415b210 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009e50 tx=0x7f6c4c004a40 comp rx=0 tx=0).stop 2024-05-08T04:22:17.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.869+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2908148182 shutdown_connections 2024-05-08T04:22:17.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.869+0000 7f6c5a1be640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c4006b500 0x7f6c4006d9c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.869+0000 7f6c5a1be640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c540ccbe0 0x7f6c5415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.869+0000 7f6c5a1be640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c540cf360 0x7f6c5415b210 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.869+0000 7f6c5a1be640 1 --2- 172.21.15.104:0/2908148182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c54099a40 0x7f6c541f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:17.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.869+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2908148182 >> 172.21.15.104:0/2908148182 conn(0x7f6c540b3280 msgr2=0x7f6c540b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:17.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.869+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2908148182 shutdown_connections 2024-05-08T04:22:17.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:17.869+0000 7f6c5a1be640 1 -- 172.21.15.104:0/2908148182 wait complete. 2024-05-08T04:22:17.881 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T04:22:17.881 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T04:22:17.881 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-05-08T04:22:17.881 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T04:22:17.881 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T04:22:17.881 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T04:22:17.881 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T04:22:17.881 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T04:22:17.881 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T04:22:17.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:17.882 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-05-08T04:22:17.898 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:22:17.898 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:22:17.898 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:22:17.898 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:17.898 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-05-08T04:22:17.898 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:17.898 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:22:17.898 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:17.898 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-05-08T04:22:17.898 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42639sec preferred_lft 42639sec 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether c6:d6:f9:07:c5:21 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:17.899 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::fc58:88ff:fed3:93d7/64 scope link 2024-05-08T04:22:17.900 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:17.900 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:22:17.900 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether ca:ef:a4:8b:34:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:22:17.900 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::c8ef:a4ff:fe8b:34e2/64 scope link 2024-05-08T04:22:17.900 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:17.900 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:22:17.900 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether c6:d6:f9:07:c5:21 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:22:17.900 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::c4d6:f9ff:fe07:c521/64 scope link 2024-05-08T04:22:17.900 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:17.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:17.900 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T04:22:17.961 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-05-08T04:22:17.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:17.963 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-05-08T04:22:18.019 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-05-08T04:22:18.019 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T04:22:18.020 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T04:22:18.020 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T04:22:18.020 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T04:22:18.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:18.020 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-05-08T04:22:18.020 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-08T04:22:18.020 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T04:22:18.020 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T04:22:18.020 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T04:22:18.021 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-08T04:22:18.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:18.107 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-05-08T04:22:18.123 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-08T04:22:18.123 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T04:22:18.123 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T04:22:18.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:18.123 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-05-08T04:22:18.188 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-08T04:22:18.189 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:22:18.189 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T04:22:18.244 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T04:22:18.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:22:18.244 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T04:22:18.299 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-05-08T04:22:18.364 DEBUG:teuthology.orchestra.run.smithi104:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:22:18.420 INFO:teuthology.orchestra.run.smithi104.stdout:/proc 2024-05-08T04:22:18.420 INFO:teuthology.orchestra.run.smithi104.stdout:/sys 2024-05-08T04:22:18.420 INFO:teuthology.orchestra.run.smithi104.stdout:/dev 2024-05-08T04:22:18.420 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/security 2024-05-08T04:22:18.420 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/shm 2024-05-08T04:22:18.420 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/pts 2024-05-08T04:22:18.420 INFO:teuthology.orchestra.run.smithi104.stdout:/run 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/cgroup 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/pstore 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/bpf 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/ 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/selinux 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/mqueue 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/hugepages 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/debug 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/tracing 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/fuse/connections 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/config 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:22:18.421 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:22:18.422 INFO:teuthology.orchestra.run.smithi104.stdout:/run/user/1000 2024-05-08T04:22:18.422 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph 2024-05-08T04:22:18.422 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-0 2024-05-08T04:22:18.422 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-1 2024-05-08T04:22:18.422 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-2 2024-05-08T04:22:18.422 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-3 2024-05-08T04:22:18.422 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns 2024-05-08T04:22:18.422 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:22:18.422 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:22:18.422 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:22:18.422 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:22:18.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:18.423 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-05-08T04:22:18.476 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T04:22:18.477 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-08T04:22:18.520 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-05-08T04:22:18.544 DEBUG:teuthology.orchestra.run.smithi104:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:22:18.600 INFO:teuthology.orchestra.run.smithi104.stdout:/proc 2024-05-08T04:22:18.600 INFO:teuthology.orchestra.run.smithi104.stdout:/sys 2024-05-08T04:22:18.600 INFO:teuthology.orchestra.run.smithi104.stdout:/dev 2024-05-08T04:22:18.600 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/security 2024-05-08T04:22:18.600 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/shm 2024-05-08T04:22:18.601 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/pts 2024-05-08T04:22:18.601 INFO:teuthology.orchestra.run.smithi104.stdout:/run 2024-05-08T04:22:18.601 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/cgroup 2024-05-08T04:22:18.601 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/pstore 2024-05-08T04:22:18.601 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/bpf 2024-05-08T04:22:18.601 INFO:teuthology.orchestra.run.smithi104.stdout:/ 2024-05-08T04:22:18.601 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/selinux 2024-05-08T04:22:18.601 INFO:teuthology.orchestra.run.smithi104.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:22:18.601 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/mqueue 2024-05-08T04:22:18.601 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/hugepages 2024-05-08T04:22:18.601 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/debug 2024-05-08T04:22:18.601 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/tracing 2024-05-08T04:22:18.601 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:22:18.602 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/fuse/connections 2024-05-08T04:22:18.602 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/config 2024-05-08T04:22:18.602 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:22:18.602 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:22:18.602 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:22:18.602 INFO:teuthology.orchestra.run.smithi104.stdout:/run/user/1000 2024-05-08T04:22:18.602 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph 2024-05-08T04:22:18.602 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-0 2024-05-08T04:22:18.602 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-1 2024-05-08T04:22:18.602 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-2 2024-05-08T04:22:18.602 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-3 2024-05-08T04:22:18.602 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns 2024-05-08T04:22:18.603 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:22:18.603 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:22:18.603 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:22:18.603 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:22:18.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:18.603 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-05-08T04:22:18.604 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:2024-05-08T04:22:18.601+0000 7fd211b22480 -1 init, newargv = 0x559185867620 newargc=15 2024-05-08T04:22:18.604 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[50300]: starting ceph client 2024-05-08T04:22:18.606 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[50300]: starting fuse 2024-05-08T04:22:18.618 INFO:teuthology.orchestra.run.smithi104.stdout:41 2024-05-08T04:22:18.619 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-05-08T04:22:18.619 DEBUG:teuthology.orchestra.run.smithi104:> sudo stdin-killer -- python3 -c ' 2024-05-08T04:22:18.619 DEBUG:teuthology.orchestra.run.smithi104:> import glob 2024-05-08T04:22:18.619 DEBUG:teuthology.orchestra.run.smithi104:> import re 2024-05-08T04:22:18.619 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-05-08T04:22:18.619 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2024-05-08T04:22:18.619 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:22:18.619 DEBUG:teuthology.orchestra.run.smithi104:> def _find_admin_socket(client_name): 2024-05-08T04:22:18.619 DEBUG:teuthology.orchestra.run.smithi104:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-08T04:22:18.619 DEBUG:teuthology.orchestra.run.smithi104:> files = glob.glob(asok_path) 2024-05-08T04:22:18.619 DEBUG:teuthology.orchestra.run.smithi104:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> # Given a non-glob path, it better be there 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> if "*" not in asok_path: 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> assert(len(files) == 1) 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> return files[0] 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> for f in files: 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> contents = proc_f.read() 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> if mountpoint in contents: 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> return f 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:22:18.620 DEBUG:teuthology.orchestra.run.smithi104:> print(_find_admin_socket("client.0")) 2024-05-08T04:22:18.621 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-05-08T04:22:18.738 INFO:teuthology.orchestra.run.smithi104.stdout:/var/run/ceph/ceph-client.0.50300.asok 2024-05-08T04:22:18.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T04:22:18.749 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50300.asok 2024-05-08T04:22:18.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:18.750 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50300.asok status 2024-05-08T04:22:18.884 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:22:18.884 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": { 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "entity_id": "0", 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "hostname": "smithi104", 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "pid": "50300", 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "root": "/" 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_count": 0, 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_pinned_count": 0, 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 5457, 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "inst": { 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "name": { 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "client", 2024-05-08T04:22:18.885 INFO:teuthology.orchestra.run.smithi104.stdout: "num": 5457 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 781567196 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 781567196 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: "inst_str": "client.5457 192.168.0.1:0/781567196", 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: "addr_str": "192.168.0.1:0/781567196", 2024-05-08T04:22:18.886 INFO:teuthology.orchestra.run.smithi104.stdout: "inode_count": 1, 2024-05-08T04:22:18.887 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_epoch": 14, 2024-05-08T04:22:18.887 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch": 33, 2024-05-08T04:22:18.887 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch_barrier": 0, 2024-05-08T04:22:18.887 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklisted": false, 2024-05-08T04:22:18.887 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs" 2024-05-08T04:22:18.887 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:22:18.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:18.893 DEBUG:teuthology.orchestra.run.smithi104:> stat --file-system '--printf=%T 2024-05-08T04:22:18.893 DEBUG:teuthology.orchestra.run.smithi104:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-08T04:22:18.909 INFO:teuthology.orchestra.run.smithi104.stdout:fuseblk 2024-05-08T04:22:18.909 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-08T04:22:18.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:18.909 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T04:22:18.974 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T04:22:19.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.113+0000 7f37a6189640 1 Processor -- start 2024-05-08T04:22:19.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.113+0000 7f37a6189640 1 -- start start 2024-05-08T04:22:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.113+0000 7f37a6189640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37a00ceee0 0x7f37a00b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.113+0000 7f37a6189640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f37a006e330 0x7f37a006e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.113+0000 7f37a6189640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f37a00b3ff0 0x7f37a00b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.113+0000 7f37a6189640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a015f390 con 0x7f37a006e330 2024-05-08T04:22:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.113+0000 7f37a6189640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a00b49c0 con 0x7f37a00b3ff0 2024-05-08T04:22:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.113+0000 7f37a6189640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a015e780 con 0x7f37a00ceee0 2024-05-08T04:22:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.114+0000 7f3796ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f37a006e330 0x7f37a006e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.114+0000 7f3796ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f37a006e330 0x7f37a006e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34500/0 (socket says 172.21.15.104:34500) 2024-05-08T04:22:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.114+0000 7f3796ffd640 1 -- 172.21.15.104:0/766898074 learned_addr learned my addr 172.21.15.104:0/766898074 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.114+0000 7f379f7fe640 1 --2- 172.21.15.104:0/766898074 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37a00ceee0 0x7f37a00b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.114+0000 7f379ffff640 1 --2- 172.21.15.104:0/766898074 >> v2:172.21.15.183:3300/0 conn(0x7f37a00b3ff0 0x7f37a00b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.114+0000 7f3796ffd640 1 -- 172.21.15.104:0/766898074 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37a00ceee0 msgr2=0x7f37a00b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.114+0000 7f3796ffd640 1 --2- 172.21.15.104:0/766898074 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37a00ceee0 0x7f37a00b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.114+0000 7f3796ffd640 1 -- 172.21.15.104:0/766898074 >> v2:172.21.15.183:3300/0 conn(0x7f37a00b3ff0 msgr2=0x7f37a00b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.114+0000 7f3796ffd640 1 --2- 172.21.15.104:0/766898074 >> v2:172.21.15.183:3300/0 conn(0x7f37a00b3ff0 0x7f37a00b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.114+0000 7f3796ffd640 1 -- 172.21.15.104:0/766898074 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a015ea60 con 0x7f37a006e330 2024-05-08T04:22:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.115+0000 7f3796ffd640 1 --2- 172.21.15.104:0/766898074 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37a006e330 0x7f37a006e7b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3788009870 tx=0x7f378802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6956f89074577f91 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.115+0000 7f379effd640 1 -- 172.21.15.104:0/766898074 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788037070 con 0x7f37a006e330 2024-05-08T04:22:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.115+0000 7f379effd640 1 -- 172.21.15.104:0/766898074 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3788032440 con 0x7f37a006e330 2024-05-08T04:22:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.115+0000 7f379effd640 1 -- 172.21.15.104:0/766898074 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788032810 con 0x7f37a006e330 2024-05-08T04:22:19.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.115+0000 7f37a6189640 1 -- 172.21.15.104:0/766898074 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37a006e330 msgr2=0x7f37a006e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:19.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.115+0000 7f37a6189640 1 --2- 172.21.15.104:0/766898074 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37a006e330 0x7f37a006e7b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3788009870 tx=0x7f378802a210 comp rx=0 tx=0).stop 2024-05-08T04:22:19.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.115+0000 7f37a6189640 1 -- 172.21.15.104:0/766898074 shutdown_connections 2024-05-08T04:22:19.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.115+0000 7f37a6189640 1 --2- 172.21.15.104:0/766898074 >> v2:172.21.15.183:3300/0 conn(0x7f37a00b3ff0 0x7f37a00b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:19.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.115+0000 7f37a6189640 1 --2- 172.21.15.104:0/766898074 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37a006e330 0x7f37a006e7b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:19.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.115+0000 7f37a6189640 1 --2- 172.21.15.104:0/766898074 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37a00ceee0 0x7f37a00b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:19.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.115+0000 7f37a6189640 1 -- 172.21.15.104:0/766898074 >> 172.21.15.104:0/766898074 conn(0x7f37a00b13f0 msgr2=0x7f37a00b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:19.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.115+0000 7f37a6189640 1 -- 172.21.15.104:0/766898074 shutdown_connections 2024-05-08T04:22:19.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.115+0000 7f37a6189640 1 -- 172.21.15.104:0/766898074 wait complete. 2024-05-08T04:22:19.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.116+0000 7f37a6189640 1 Processor -- start 2024-05-08T04:22:19.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.117+0000 7f37a6189640 1 -- start start 2024-05-08T04:22:19.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.117+0000 7f37a6189640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37a006e330 0x7f37a0165450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.117+0000 7f37a6189640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37a00b3ff0 0x7f37a0155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.117+0000 7f37a6189640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37a00ceee0 0x7f37a015d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.117+0000 7f37a6189640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00cf2c0 con 0x7f37a00b3ff0 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.117+0000 7f37a6189640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a015f020 con 0x7f37a00ceee0 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.117+0000 7f37a6189640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00cf440 con 0x7f37a006e330 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.117+0000 7f3796ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37a00b3ff0 0x7f37a0155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.117+0000 7f3796ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37a00b3ff0 0x7f37a0155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34506/0 (socket says 172.21.15.104:34506) 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.117+0000 7f3796ffd640 1 -- 172.21.15.104:0/3210643834 learned_addr learned my addr 172.21.15.104:0/3210643834 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f379f7fe640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37a006e330 0x7f37a0165450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f379ffff640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37a00ceee0 0x7f37a015d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f3796ffd640 1 -- 172.21.15.104:0/3210643834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37a006e330 msgr2=0x7f37a0165450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f3796ffd640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37a006e330 0x7f37a0165450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f3796ffd640 1 -- 172.21.15.104:0/3210643834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37a00ceee0 msgr2=0x7f37a015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:19.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f3796ffd640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37a00ceee0 0x7f37a015d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:19.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f3796ffd640 1 -- 172.21.15.104:0/3210643834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a0152a90 con 0x7f37a00b3ff0 2024-05-08T04:22:19.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f379f7fe640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37a006e330 0x7f37a0165450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:19.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f379ffff640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37a00ceee0 0x7f37a015d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:19.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f3796ffd640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37a00b3ff0 0x7f37a0155250 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3788000c00 tx=0x7f37880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:19.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f379cff9640 1 -- 172.21.15.104:0/3210643834 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788037040 con 0x7f37a00b3ff0 2024-05-08T04:22:19.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f379cff9640 1 -- 172.21.15.104:0/3210643834 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3788042070 con 0x7f37a00b3ff0 2024-05-08T04:22:19.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f379cff9640 1 -- 172.21.15.104:0/3210643834 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788030bd0 con 0x7f37a00b3ff0 2024-05-08T04:22:19.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f37a6189640 1 -- 172.21.15.104:0/3210643834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a0165cd0 con 0x7f37a00b3ff0 2024-05-08T04:22:19.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.118+0000 7f37a6189640 1 -- 172.21.15.104:0/3210643834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a015c9d0 con 0x7f37a00b3ff0 2024-05-08T04:22:19.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.119+0000 7f37a6189640 1 -- 172.21.15.104:0/3210643834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a0075010 con 0x7f37a00b3ff0 2024-05-08T04:22:19.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.120+0000 7f379cff9640 1 -- 172.21.15.104:0/3210643834 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3788047460 con 0x7f37a00b3ff0 2024-05-08T04:22:19.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.120+0000 7f379cff9640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f378006b4d0 0x7f378006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:19.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.120+0000 7f379cff9640 1 -- 172.21.15.104:0/3210643834 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37880aaed0 con 0x7f37a00b3ff0 2024-05-08T04:22:19.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.120+0000 7f379f7fe640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f378006b4d0 0x7f378006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:19.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.121+0000 7f379f7fe640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f378006b4d0 0x7f378006d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3790006fd0 tx=0x7f3790008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:19.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.124+0000 7f379cff9640 1 -- 172.21.15.104:0/3210643834 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f37a0152a90 con 0x7f37a00b3ff0 2024-05-08T04:22:19.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.329+0000 7f37a6189640 1 -- 172.21.15.104:0/3210643834 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f37a006f3f0 con 0x7f37a00b3ff0 2024-05-08T04:22:19.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.330+0000 7f379cff9640 1 -- 172.21.15.104:0/3210643834 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3788045360 con 0x7f37a00b3ff0 2024-05-08T04:22:19.331 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T04:22:19.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.332+0000 7f37a6189640 1 -- 172.21.15.104:0/3210643834 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f378006b4d0 msgr2=0x7f378006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:19.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.332+0000 7f37a6189640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f378006b4d0 0x7f378006d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3790006fd0 tx=0x7f3790008040 comp rx=0 tx=0).stop 2024-05-08T04:22:19.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.332+0000 7f37a6189640 1 -- 172.21.15.104:0/3210643834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37a00b3ff0 msgr2=0x7f37a0155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:19.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.332+0000 7f37a6189640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37a00b3ff0 0x7f37a0155250 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3788000c00 tx=0x7f37880046c0 comp rx=0 tx=0).stop 2024-05-08T04:22:19.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.332+0000 7f37a6189640 1 -- 172.21.15.104:0/3210643834 shutdown_connections 2024-05-08T04:22:19.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.332+0000 7f37a6189640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f378006b4d0 0x7f378006d990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:19.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.332+0000 7f37a6189640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37a00ceee0 0x7f37a015d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:19.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.332+0000 7f37a6189640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f37a00b3ff0 0x7f37a0155250 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:19.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.332+0000 7f37a6189640 1 --2- 172.21.15.104:0/3210643834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37a006e330 0x7f37a0165450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:19.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.332+0000 7f37a6189640 1 -- 172.21.15.104:0/3210643834 >> 172.21.15.104:0/3210643834 conn(0x7f37a00b13f0 msgr2=0x7f37a006e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:19.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.332+0000 7f37a6189640 1 -- 172.21.15.104:0/3210643834 shutdown_connections 2024-05-08T04:22:19.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:19.332+0000 7f37a6189640 1 -- 172.21.15.104:0/3210643834 wait complete. 2024-05-08T04:22:19.343 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T04:22:19.344 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T04:22:19.344 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2024-05-08T04:22:19.344 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-08T04:22:19.344 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T04:22:19.344 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T04:22:19.344 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T04:22:19.344 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T04:22:19.344 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-08T04:22:19.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:19.344 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2024-05-08T04:22:19.364 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:22:19.365 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:22:19.365 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:22:19.365 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:19.365 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2024-05-08T04:22:19.365 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:19.365 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:22:19.365 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:19.365 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2024-05-08T04:22:19.365 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:22:19.365 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:19.365 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2024-05-08T04:22:19.365 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:22:19.366 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:19.366 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T04:22:19.366 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:19.366 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T04:22:19.366 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42686sec preferred_lft 42686sec 2024-05-08T04:22:19.366 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2024-05-08T04:22:19.366 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:19.366 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T04:22:19.366 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 8a:51:89:24:45:ec brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:19.366 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T04:22:19.366 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:19.366 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::b018:2eff:fef9:2486/64 scope link 2024-05-08T04:22:19.366 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:19.367 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:22:19.367 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 8a:51:89:24:45:ec brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:22:19.367 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::8851:89ff:fe24:45ec/64 scope link 2024-05-08T04:22:19.367 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:19.367 INFO:teuthology.orchestra.run.smithi183.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:22:19.367 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether f6:96:c9:db:32:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:22:19.367 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::f496:c9ff:fedb:327c/64 scope link 2024-05-08T04:22:19.367 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:19.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:19.367 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T04:22:19.432 INFO:teuthology.orchestra.run.smithi183.stdout:1 2024-05-08T04:22:19.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:19.434 DEBUG:teuthology.orchestra.run.smithi183:> route 2024-05-08T04:22:19.492 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2024-05-08T04:22:19.492 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T04:22:19.492 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T04:22:19.493 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T04:22:19.493 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T04:22:19.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:19.493 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-05-08T04:22:19.493 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-05-08T04:22:19.493 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T04:22:19.493 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T04:22:19.493 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T04:22:19.493 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-05-08T04:22:19.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:19.584 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2024-05-08T04:22:19.600 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-08T04:22:19.600 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-08T04:22:19.600 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-08T04:22:19.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:19.600 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2024-05-08T04:22:19.665 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-05-08T04:22:19.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:22:19.666 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-08T04:22:19.722 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-08T04:22:19.722 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:22:19.722 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-08T04:22:19.778 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2024-05-08T04:22:19.844 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:22:19.901 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2024-05-08T04:22:19.901 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2024-05-08T04:22:19.901 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2024-05-08T04:22:19.901 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2024-05-08T04:22:19.902 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2024-05-08T04:22:19.902 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2024-05-08T04:22:19.902 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2024-05-08T04:22:19.902 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2024-05-08T04:22:19.902 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2024-05-08T04:22:19.902 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/bpf 2024-05-08T04:22:19.902 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2024-05-08T04:22:19.902 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2024-05-08T04:22:19.902 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:22:19.902 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2024-05-08T04:22:19.902 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2024-05-08T04:22:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2024-05-08T04:22:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2024-05-08T04:22:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2024-05-08T04:22:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2024-05-08T04:22:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:22:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:22:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:22:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:22:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2024-05-08T04:22:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2024-05-08T04:22:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2024-05-08T04:22:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2024-05-08T04:22:19.903 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2024-05-08T04:22:19.904 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2024-05-08T04:22:19.904 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2024-05-08T04:22:19.904 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:22:19.904 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:22:19.904 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:22:19.904 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:22:19.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:19.904 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2024-05-08T04:22:19.957 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T04:22:19.958 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-05-08T04:22:20.000 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2024-05-08T04:22:20.025 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:22:20.082 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2024-05-08T04:22:20.082 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2024-05-08T04:22:20.082 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2024-05-08T04:22:20.082 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/bpf 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2024-05-08T04:22:20.083 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2024-05-08T04:22:20.084 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:22:20.084 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:22:20.084 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:22:20.084 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:22:20.084 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2024-05-08T04:22:20.084 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2024-05-08T04:22:20.084 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2024-05-08T04:22:20.084 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2024-05-08T04:22:20.084 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2024-05-08T04:22:20.084 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2024-05-08T04:22:20.084 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2024-05-08T04:22:20.084 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:22:20.084 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:22:20.085 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:22:20.085 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:22:20.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:20.085 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2024-05-08T04:22:20.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:2024-05-08T04:22:20.082+0000 7f0603c0d480 -1 init, newargv = 0x5586c2291b70 newargc=15 2024-05-08T04:22:20.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[42864]: starting ceph client 2024-05-08T04:22:20.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[42864]: starting fuse 2024-05-08T04:22:20.102 INFO:teuthology.orchestra.run.smithi183.stdout:42 2024-05-08T04:22:20.102 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-08T04:22:20.102 DEBUG:teuthology.orchestra.run.smithi183:> sudo stdin-killer -- python3 -c ' 2024-05-08T04:22:20.102 DEBUG:teuthology.orchestra.run.smithi183:> import glob 2024-05-08T04:22:20.102 DEBUG:teuthology.orchestra.run.smithi183:> import re 2024-05-08T04:22:20.102 DEBUG:teuthology.orchestra.run.smithi183:> import os 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> import subprocess 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> def _find_admin_socket(client_name): 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> files = glob.glob(asok_path) 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> # Given a non-glob path, it better be there 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> if "*" not in asok_path: 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> assert(len(files) == 1) 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> return files[0] 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> for f in files: 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T04:22:20.103 DEBUG:teuthology.orchestra.run.smithi183:> contents = proc_f.read() 2024-05-08T04:22:20.104 DEBUG:teuthology.orchestra.run.smithi183:> if mountpoint in contents: 2024-05-08T04:22:20.104 DEBUG:teuthology.orchestra.run.smithi183:> return f 2024-05-08T04:22:20.104 DEBUG:teuthology.orchestra.run.smithi183:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T04:22:20.104 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:22:20.104 DEBUG:teuthology.orchestra.run.smithi183:> print(_find_admin_socket("client.1")) 2024-05-08T04:22:20.104 DEBUG:teuthology.orchestra.run.smithi183:> ' 2024-05-08T04:22:20.221 INFO:teuthology.orchestra.run.smithi183.stdout:/var/run/ceph/ceph-client.1.42864.asok 2024-05-08T04:22:20.224 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:22:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T04:22:20.231 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42864.asok 2024-05-08T04:22:20.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:20.232 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42864.asok status 2024-05-08T04:22:20.365 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-05-08T04:22:20.365 INFO:teuthology.orchestra.run.smithi183.stdout: "metadata": { 2024-05-08T04:22:20.365 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", 2024-05-08T04:22:20.365 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", 2024-05-08T04:22:20.365 INFO:teuthology.orchestra.run.smithi183.stdout: "entity_id": "1", 2024-05-08T04:22:20.365 INFO:teuthology.orchestra.run.smithi183.stdout: "hostname": "smithi183", 2024-05-08T04:22:20.365 INFO:teuthology.orchestra.run.smithi183.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-08T04:22:20.365 INFO:teuthology.orchestra.run.smithi183.stdout: "pid": "42864", 2024-05-08T04:22:20.366 INFO:teuthology.orchestra.run.smithi183.stdout: "root": "/" 2024-05-08T04:22:20.366 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:22:20.366 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_count": 0, 2024-05-08T04:22:20.366 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_pinned_count": 0, 2024-05-08T04:22:20.366 INFO:teuthology.orchestra.run.smithi183.stdout: "id": 5071, 2024-05-08T04:22:20.366 INFO:teuthology.orchestra.run.smithi183.stdout: "inst": { 2024-05-08T04:22:20.366 INFO:teuthology.orchestra.run.smithi183.stdout: "name": { 2024-05-08T04:22:20.366 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "client", 2024-05-08T04:22:20.366 INFO:teuthology.orchestra.run.smithi183.stdout: "num": 5071 2024-05-08T04:22:20.366 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:22:20.367 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-05-08T04:22:20.367 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-05-08T04:22:20.367 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:22:20.367 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 3333433413 2024-05-08T04:22:20.367 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-05-08T04:22:20.367 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:22:20.367 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-05-08T04:22:20.367 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-05-08T04:22:20.367 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:22:20.367 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 3333433413 2024-05-08T04:22:20.367 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:22:20.367 INFO:teuthology.orchestra.run.smithi183.stdout: "inst_str": "client.5071 192.168.0.1:0/3333433413", 2024-05-08T04:22:20.368 INFO:teuthology.orchestra.run.smithi183.stdout: "addr_str": "192.168.0.1:0/3333433413", 2024-05-08T04:22:20.368 INFO:teuthology.orchestra.run.smithi183.stdout: "inode_count": 1, 2024-05-08T04:22:20.368 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_epoch": 14, 2024-05-08T04:22:20.368 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch": 33, 2024-05-08T04:22:20.368 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch_barrier": 0, 2024-05-08T04:22:20.368 INFO:teuthology.orchestra.run.smithi183.stdout: "blocklisted": false, 2024-05-08T04:22:20.368 INFO:teuthology.orchestra.run.smithi183.stdout: "fs_name": "cephfs" 2024-05-08T04:22:20.369 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-05-08T04:22:20.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:20.374 DEBUG:teuthology.orchestra.run.smithi183:> stat --file-system '--printf=%T 2024-05-08T04:22:20.374 DEBUG:teuthology.orchestra.run.smithi183:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-08T04:22:20.391 INFO:teuthology.orchestra.run.smithi183.stdout:fuseblk 2024-05-08T04:22:20.391 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-08T04:22:20.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:20.392 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-08T04:22:20.458 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-08T04:22:20.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.571+0000 7f5867431640 1 Processor -- start 2024-05-08T04:22:20.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.572+0000 7f5867431640 1 -- start start 2024-05-08T04:22:20.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.572+0000 7f5867431640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f586015de10 0x7f5860161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:20.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.572+0000 7f5867431640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f58600d07c0 0x7f58600d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:20.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.572+0000 7f5867431640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586015e1f0 con 0x7f58600ce5a0 2024-05-08T04:22:20.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.572+0000 7f5867431640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58600d0f50 con 0x7f586015de10 2024-05-08T04:22:20.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.572+0000 7f5867431640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5860161e60 con 0x7f58600d07c0 2024-05-08T04:22:20.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.572+0000 7f58651cd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f586015de10 0x7f5860161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:20.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.573+0000 7f58651cd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f586015de10 0x7f5860161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34508/0 (socket says 172.21.15.104:34508) 2024-05-08T04:22:20.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.573+0000 7f58651cd640 1 -- 172.21.15.104:0/1303049240 learned_addr learned my addr 172.21.15.104:0/1303049240 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:20.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.573+0000 7f58651cd640 1 -- 172.21.15.104:0/1303049240 >> v2:172.21.15.183:3300/0 conn(0x7f58600d07c0 msgr2=0x7f58600d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:20.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.573+0000 7f58651cd640 1 --2- 172.21.15.104:0/1303049240 >> v2:172.21.15.183:3300/0 conn(0x7f58600d07c0 0x7f58600d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:20.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.573+0000 7f58651cd640 1 -- 172.21.15.104:0/1303049240 >> v1:172.21.15.183:6789/0 conn(0x7f58600ce5a0 legacy=0x7f58600d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:20.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.573+0000 7f58651cd640 1 -- 172.21.15.104:0/1303049240 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5860162090 con 0x7f586015de10 2024-05-08T04:22:20.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.573+0000 7f58651cd640 1 --2- 172.21.15.104:0/1303049240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f586015de10 0x7f5860161920 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f58600b3420 tx=0x7f585c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ba9a94e30db8bf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:20.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.574+0000 7f5857fff640 1 -- 172.21.15.104:0/1303049240 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c036070 con 0x7f586015de10 2024-05-08T04:22:20.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.574+0000 7f5857fff640 1 -- 172.21.15.104:0/1303049240 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c031600 con 0x7f586015de10 2024-05-08T04:22:20.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.574+0000 7f5857fff640 1 -- 172.21.15.104:0/1303049240 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c0319d0 con 0x7f586015de10 2024-05-08T04:22:20.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.574+0000 7f5867431640 1 -- 172.21.15.104:0/1303049240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f586015de10 msgr2=0x7f5860161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:20.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.574+0000 7f5867431640 1 --2- 172.21.15.104:0/1303049240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f586015de10 0x7f5860161920 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f58600b3420 tx=0x7f585c02a660 comp rx=0 tx=0).stop 2024-05-08T04:22:20.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.574+0000 7f5867431640 1 -- 172.21.15.104:0/1303049240 shutdown_connections 2024-05-08T04:22:20.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.574+0000 7f5867431640 1 --2- 172.21.15.104:0/1303049240 >> v2:172.21.15.183:3300/0 conn(0x7f58600d07c0 0x7f58600d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:20.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.574+0000 7f5867431640 1 --2- 172.21.15.104:0/1303049240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f586015de10 0x7f5860161920 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:20.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.574+0000 7f5867431640 1 -- 172.21.15.104:0/1303049240 >> 172.21.15.104:0/1303049240 conn(0x7f5860072290 msgr2=0x7f5860072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:20.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.574+0000 7f5867431640 1 -- 172.21.15.104:0/1303049240 shutdown_connections 2024-05-08T04:22:20.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.574+0000 7f5867431640 1 -- 172.21.15.104:0/1303049240 wait complete. 2024-05-08T04:22:20.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.576+0000 7f5867431640 1 Processor -- start 2024-05-08T04:22:20.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.576+0000 7f5867431640 1 -- start start 2024-05-08T04:22:20.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.576+0000 7f5867431640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58600ce5a0 0x7f5860153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:20.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.576+0000 7f5867431640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58600d07c0 0x7f58600c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:20.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.576+0000 7f5867431640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f586015de10 0x7f58601e9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:20.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.576+0000 7f5867431640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5860162650 con 0x7f586015de10 2024-05-08T04:22:20.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.576+0000 7f5867431640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58600d1a90 con 0x7f58600d07c0 2024-05-08T04:22:20.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.576+0000 7f5867431640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58600d1ce0 con 0x7f58600ce5a0 2024-05-08T04:22:20.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.576+0000 7f58659ce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f586015de10 0x7f58601e9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:20.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.576+0000 7f58659ce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f586015de10 0x7f58601e9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34510/0 (socket says 172.21.15.104:34510) 2024-05-08T04:22:20.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.576+0000 7f58659ce640 1 -- 172.21.15.104:0/2679455442 learned_addr learned my addr 172.21.15.104:0/2679455442 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:20.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f58651cd640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58600ce5a0 0x7f5860153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:20.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f58649cc640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58600d07c0 0x7f58600c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f58659ce640 1 -- 172.21.15.104:0/2679455442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58600ce5a0 msgr2=0x7f5860153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f58659ce640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58600ce5a0 0x7f5860153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f58659ce640 1 -- 172.21.15.104:0/2679455442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58600d07c0 msgr2=0x7f58600c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f58659ce640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58600d07c0 0x7f58600c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f58659ce640 1 -- 172.21.15.104:0/2679455442 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58601e8180 con 0x7f586015de10 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f58651cd640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58600ce5a0 0x7f5860153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f58659ce640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f586015de10 0x7f58601e9210 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5858009fd0 tx=0x7f585800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f5855ffb640 1 -- 172.21.15.104:0/2679455442 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858011830 con 0x7f586015de10 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f5855ffb640 1 -- 172.21.15.104:0/2679455442 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5858016070 con 0x7f586015de10 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f5867431640 1 -- 172.21.15.104:0/2679455442 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58601e8460 con 0x7f586015de10 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f5855ffb640 1 -- 172.21.15.104:0/2679455442 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858011bf0 con 0x7f586015de10 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.577+0000 7f5867431640 1 -- 172.21.15.104:0/2679455442 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58601e8a20 con 0x7f586015de10 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.578+0000 7f5867431640 1 -- 172.21.15.104:0/2679455442 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5860075010 con 0x7f586015de10 2024-05-08T04:22:20.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.579+0000 7f5855ffb640 1 -- 172.21.15.104:0/2679455442 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f585801b460 con 0x7f586015de10 2024-05-08T04:22:20.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.579+0000 7f5855ffb640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f584406b500 0x7f584406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:20.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.579+0000 7f5855ffb640 1 -- 172.21.15.104:0/2679455442 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5858089f30 con 0x7f586015de10 2024-05-08T04:22:20.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.579+0000 7f58651cd640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f584406b500 0x7f584406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:20.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.580+0000 7f58651cd640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f584406b500 0x7f584406d9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f585c033000 tx=0x7f585c009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:20.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.583+0000 7f5855ffb640 1 -- 172.21.15.104:0/2679455442 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5858058db0 con 0x7f586015de10 2024-05-08T04:22:20.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:20.792+0000 7f5867431640 1 -- 172.21.15.104:0/2679455442 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f58600b7f70 con 0x7f586015de10 2024-05-08T04:22:21.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.717+0000 7f5855ffb640 1 -- 172.21.15.104:0/2679455442 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 136+0+0 (secure 0 0 0) 0x7f58580586b0 con 0x7f586015de10 2024-05-08T04:22:21.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.720+0000 7f5867431640 1 -- 172.21.15.104:0/2679455442 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f584406b500 msgr2=0x7f584406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:21.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.720+0000 7f5867431640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f584406b500 0x7f584406d9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f585c033000 tx=0x7f585c009000 comp rx=0 tx=0).stop 2024-05-08T04:22:21.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.720+0000 7f5867431640 1 -- 172.21.15.104:0/2679455442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f586015de10 msgr2=0x7f58601e9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:21.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.720+0000 7f5867431640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f586015de10 0x7f58601e9210 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5858009fd0 tx=0x7f585800b8e0 comp rx=0 tx=0).stop 2024-05-08T04:22:21.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.720+0000 7f5867431640 1 -- 172.21.15.104:0/2679455442 shutdown_connections 2024-05-08T04:22:21.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.720+0000 7f5867431640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f584406b500 0x7f584406d9c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:21.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.720+0000 7f5867431640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58600d07c0 0x7f58600c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:21.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.720+0000 7f5867431640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f586015de10 0x7f58601e9210 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:21.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.720+0000 7f5867431640 1 --2- 172.21.15.104:0/2679455442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58600ce5a0 0x7f5860153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:21.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.720+0000 7f5867431640 1 -- 172.21.15.104:0/2679455442 >> 172.21.15.104:0/2679455442 conn(0x7f5860072290 msgr2=0x7f58600cac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:21.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.720+0000 7f5867431640 1 -- 172.21.15.104:0/2679455442 shutdown_connections 2024-05-08T04:22:21.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.720+0000 7f5867431640 1 -- 172.21.15.104:0/2679455442 wait complete. 2024-05-08T04:22:21.734 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-08T04:22:21.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.839+0000 7f3d1f55c640 1 Processor -- start 2024-05-08T04:22:21.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.839+0000 7f3d1f55c640 1 -- start start 2024-05-08T04:22:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.840+0000 7f3d1f55c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3d180ada00 0x7f3d18072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.840+0000 7f3d1f55c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1815c4f0 con 0x7f3d1815c080 2024-05-08T04:22:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.840+0000 7f3d1f55c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1806f4f0 con 0x7f3d1815bca0 2024-05-08T04:22:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.840+0000 7f3d1f55c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1806f7b0 con 0x7f3d180ada00 2024-05-08T04:22:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.840+0000 7f3d1daf9640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f3d1815c080 0x7f3d180acdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:58448/0 (socket says 172.21.15.104:58448) 2024-05-08T04:22:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.840+0000 7f3d1daf9640 1 -- 172.21.15.104:0/1880058827 learned_addr learned my addr 172.21.15.104:0/1880058827 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.840+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667946423 0 0) 0x7f3d10001490 con 0x7f3d1815c080 2024-05-08T04:22:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.840+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d04003520 con 0x7f3d1815c080 2024-05-08T04:22:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.840+0000 7f3d1caf7640 1 --2- 172.21.15.104:0/1880058827 >> v2:172.21.15.183:3300/0 conn(0x7f3d180ada00 0x7f3d18072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1003086500 0 0) 0x7f3d04003520 con 0x7f3d1815c080 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 >> v2:172.21.15.183:3300/0 conn(0x7f3d180ada00 msgr2=0x7f3d18072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d0ffff640 1 --2- 172.21.15.104:0/1880058827 >> v2:172.21.15.183:3300/0 conn(0x7f3d180ada00 0x7f3d18072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 >> v1:172.21.15.183:6789/0 conn(0x7f3d1815bca0 legacy=0x7f3d18160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d180af570 con 0x7f3d1815c080 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f3d10001bc0 con 0x7f3d1815c080 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 >> v1:172.21.15.104:6789/0 conn(0x7f3d1815c080 legacy=0x7f3d180acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d0ffff640 1 --2- 172.21.15.104:0/1880058827 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d040039b0 0x7f3d04003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d0ffff640 1 --2- 172.21.15.104:0/1880058827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d04004800 0x7f3d04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d0ffff640 1 --2- 172.21.15.104:0/1880058827 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d040051c0 0x7f3d0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1806f7b0 con 0x7f3d040039b0 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0400c0f0 con 0x7f3d04004800 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0400c2f0 con 0x7f3d040051c0 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d1d2f8640 1 --2- 172.21.15.104:0/1880058827 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d040039b0 0x7f3d04003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d1caf7640 1 --2- 172.21.15.104:0/1880058827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d04004800 0x7f3d04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d1daf9640 1 --2- 172.21.15.104:0/1880058827 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d040051c0 0x7f3d0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d1d2f8640 1 -- 172.21.15.104:0/1880058827 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d040051c0 msgr2=0x7f3d0400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d1d2f8640 1 --2- 172.21.15.104:0/1880058827 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d040051c0 0x7f3d0400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d1d2f8640 1 -- 172.21.15.104:0/1880058827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d04004800 msgr2=0x7f3d04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d1d2f8640 1 --2- 172.21.15.104:0/1880058827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d04004800 0x7f3d04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d1d2f8640 1 -- 172.21.15.104:0/1880058827 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d04003520 con 0x7f3d040039b0 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.841+0000 7f3d1daf9640 1 -- 172.21.15.104:0/1880058827 reap_dead start 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.842+0000 7f3d1d2f8640 1 --2- 172.21.15.104:0/1880058827 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d040039b0 0x7f3d04003db0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3d14003db0 tx=0x7f3d04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e099fa6bb7fa9e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.842+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14037070 con 0x7f3d040039b0 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.842+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1402a9f0 con 0x7f3d040039b0 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.842+0000 7f3d0ffff640 1 -- 172.21.15.104:0/1880058827 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14003980 con 0x7f3d040039b0 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.842+0000 7f3d1f55c640 1 -- 172.21.15.104:0/1880058827 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d040039b0 msgr2=0x7f3d04003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.842+0000 7f3d1f55c640 1 --2- 172.21.15.104:0/1880058827 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d040039b0 0x7f3d04003db0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3d14003db0 tx=0x7f3d04005830 comp rx=0 tx=0).stop 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.842+0000 7f3d1f55c640 1 -- 172.21.15.104:0/1880058827 shutdown_connections 2024-05-08T04:22:21.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.842+0000 7f3d1f55c640 1 --2- 172.21.15.104:0/1880058827 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d040039b0 0x7f3d04003db0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:21.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.842+0000 7f3d1f55c640 1 -- 172.21.15.104:0/1880058827 >> 172.21.15.104:0/1880058827 conn(0x7f3d18071a10 msgr2=0x7f3d18071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:21.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.843+0000 7f3d1f55c640 1 -- 172.21.15.104:0/1880058827 shutdown_connections 2024-05-08T04:22:21.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.843+0000 7f3d1f55c640 1 -- 172.21.15.104:0/1880058827 wait complete. 2024-05-08T04:22:21.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.844+0000 7f3d1f55c640 1 Processor -- start 2024-05-08T04:22:21.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.844+0000 7f3d1f55c640 1 -- start start 2024-05-08T04:22:21.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.844+0000 7f3d1f55c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d040039b0 0x7f3d1814e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:21.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.844+0000 7f3d1f55c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d181f18b0 0x7f3d1809c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:21.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.844+0000 7f3d1f55c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d1809cd30 0x7f3d180cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:21.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1f55c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18072810 con 0x7f3d181f18b0 2024-05-08T04:22:21.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1f55c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180af850 con 0x7f3d1809cd30 2024-05-08T04:22:21.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1f55c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18072990 con 0x7f3d040039b0 2024-05-08T04:22:21.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1caf7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d181f18b0 0x7f3d1809c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:21.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1caf7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d181f18b0 0x7f3d1809c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34528/0 (socket says 172.21.15.104:34528) 2024-05-08T04:22:21.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1caf7640 1 -- 172.21.15.104:0/3122731718 learned_addr learned my addr 172.21.15.104:0/3122731718 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:21.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1d2f8640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d040039b0 0x7f3d1814e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:21.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1daf9640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d1809cd30 0x7f3d180cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:21.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1caf7640 1 -- 172.21.15.104:0/3122731718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d040039b0 msgr2=0x7f3d1814e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:21.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1caf7640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d040039b0 0x7f3d1814e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:21.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1caf7640 1 -- 172.21.15.104:0/3122731718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d1809cd30 msgr2=0x7f3d180cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1caf7640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d1809cd30 0x7f3d180cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1caf7640 1 -- 172.21.15.104:0/3122731718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d180cebb0 con 0x7f3d181f18b0 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1caf7640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d181f18b0 0x7f3d1809c7f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3d08011510 tx=0x7f3d080119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d0dffb640 1 -- 172.21.15.104:0/3122731718 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d08015870 con 0x7f3d181f18b0 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d0dffb640 1 -- 172.21.15.104:0/3122731718 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d08015a10 con 0x7f3d181f18b0 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1f55c640 1 -- 172.21.15.104:0/3122731718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1809a2e0 con 0x7f3d181f18b0 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d0dffb640 1 -- 172.21.15.104:0/3122731718 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d08015dc0 con 0x7f3d181f18b0 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.845+0000 7f3d1f55c640 1 -- 172.21.15.104:0/3122731718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1809a8a0 con 0x7f3d181f18b0 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.846+0000 7f3d1f55c640 1 -- 172.21.15.104:0/3122731718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d18075010 con 0x7f3d181f18b0 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.847+0000 7f3d0dffb640 1 -- 172.21.15.104:0/3122731718 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3d08013400 con 0x7f3d181f18b0 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.847+0000 7f3d0dffb640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3cfc06b4d0 0x7f3cfc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.848+0000 7f3d0dffb640 1 -- 172.21.15.104:0/3122731718 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d0808a910 con 0x7f3d181f18b0 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.848+0000 7f3d1d2f8640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3cfc06b4d0 0x7f3cfc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:21.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.848+0000 7f3d1d2f8640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3cfc06b4d0 0x7f3cfc06d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3d14034000 tx=0x7f3d1402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:21.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:21.852+0000 7f3d0dffb640 1 -- 172.21.15.104:0/3122731718 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3d08019030 con 0x7f3d181f18b0 2024-05-08T04:22:22.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.042+0000 7f3d1f55c640 1 -- 172.21.15.104:0/3122731718 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d180b5380 con 0x7f3cfc06b4d0 2024-05-08T04:22:22.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.043+0000 7f3d0dffb640 1 -- 172.21.15.104:0/3122731718 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3d180b5380 con 0x7f3cfc06b4d0 2024-05-08T04:22:22.044 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-05-08T04:22:22.044 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:22.044 INFO:teuthology.orchestra.run.smithi104.stdout: "name": "cephfs" 2024-05-08T04:22:22.044 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:22.045 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-05-08T04:22:22.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.045+0000 7f3d1f55c640 1 -- 172.21.15.104:0/3122731718 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3cfc06b4d0 msgr2=0x7f3cfc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.045+0000 7f3d1f55c640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3cfc06b4d0 0x7f3cfc06d990 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3d14034000 tx=0x7f3d1402e000 comp rx=0 tx=0).stop 2024-05-08T04:22:22.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.045+0000 7f3d1f55c640 1 -- 172.21.15.104:0/3122731718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d181f18b0 msgr2=0x7f3d1809c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.045+0000 7f3d1f55c640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d181f18b0 0x7f3d1809c7f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3d08011510 tx=0x7f3d080119d0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.045+0000 7f3d1f55c640 1 -- 172.21.15.104:0/3122731718 shutdown_connections 2024-05-08T04:22:22.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.045+0000 7f3d1f55c640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3cfc06b4d0 0x7f3cfc06d990 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.045+0000 7f3d1f55c640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d1809cd30 0x7f3d180cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.045+0000 7f3d1f55c640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d181f18b0 0x7f3d1809c7f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.045+0000 7f3d1f55c640 1 --2- 172.21.15.104:0/3122731718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d040039b0 0x7f3d1814e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.045+0000 7f3d1f55c640 1 -- 172.21.15.104:0/3122731718 >> 172.21.15.104:0/3122731718 conn(0x7f3d18071a10 msgr2=0x7f3d180b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:22.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.045+0000 7f3d1f55c640 1 -- 172.21.15.104:0/3122731718 shutdown_connections 2024-05-08T04:22:22.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.045+0000 7f3d1f55c640 1 -- 172.21.15.104:0/3122731718 wait complete. 2024-05-08T04:22:22.057 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-08T04:22:22.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.159+0000 7f93792c4640 1 Processor -- start 2024-05-08T04:22:22.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.159+0000 7f93792c4640 1 -- start start 2024-05-08T04:22:22.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.159+0000 7f93792c4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f93740ce5a0 0x7f9374161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:22.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.159+0000 7f93792c4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f93740d07c0 0x7f93740d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:22.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.159+0000 7f93792c4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937415e1f0 con 0x7f937415de10 2024-05-08T04:22:22.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.159+0000 7f93792c4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93740d0f50 con 0x7f93740ce5a0 2024-05-08T04:22:22.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.159+0000 7f93792c4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9374161e60 con 0x7f93740d07c0 2024-05-08T04:22:22.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.160+0000 7f93727fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f93740ce5a0 0x7f9374161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:22.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.160+0000 7f9372ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f937415de10 0x7f93740d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:58450/0 (socket says 172.21.15.104:58450) 2024-05-08T04:22:22.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.160+0000 7f9372ffd640 1 -- 172.21.15.104:0/702635380 learned_addr learned my addr 172.21.15.104:0/702635380 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:22.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.160+0000 7f93737fe640 1 --2- 172.21.15.104:0/702635380 >> v2:172.21.15.183:3300/0 conn(0x7f93740d07c0 0x7f93740d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:22.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.160+0000 7f93727fc640 1 -- 172.21.15.104:0/702635380 >> v2:172.21.15.183:3300/0 conn(0x7f93740d07c0 msgr2=0x7f93740d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:22.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.160+0000 7f93727fc640 1 --2- 172.21.15.104:0/702635380 >> v2:172.21.15.183:3300/0 conn(0x7f93740d07c0 0x7f93740d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.160+0000 7f93727fc640 1 -- 172.21.15.104:0/702635380 >> v1:172.21.15.104:6789/0 conn(0x7f937415de10 legacy=0x7f93740d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.160+0000 7f93727fc640 1 -- 172.21.15.104:0/702635380 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9374162090 con 0x7f93740ce5a0 2024-05-08T04:22:22.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.161+0000 7f93727fc640 1 --2- 172.21.15.104:0/702635380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93740ce5a0 0x7f9374161920 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f93740b3420 tx=0x7f935c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a9646cf35bd7d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:22.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.161+0000 7f9371ffb640 1 -- 172.21.15.104:0/702635380 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c037070 con 0x7f93740ce5a0 2024-05-08T04:22:22.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.161+0000 7f9371ffb640 1 -- 172.21.15.104:0/702635380 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c032440 con 0x7f93740ce5a0 2024-05-08T04:22:22.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.161+0000 7f9371ffb640 1 -- 172.21.15.104:0/702635380 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c02ae60 con 0x7f93740ce5a0 2024-05-08T04:22:22.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.161+0000 7f93792c4640 1 -- 172.21.15.104:0/702635380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93740ce5a0 msgr2=0x7f9374161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.161+0000 7f93792c4640 1 --2- 172.21.15.104:0/702635380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93740ce5a0 0x7f9374161920 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f93740b3420 tx=0x7f935c02a110 comp rx=0 tx=0).stop 2024-05-08T04:22:22.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.161+0000 7f93792c4640 1 -- 172.21.15.104:0/702635380 shutdown_connections 2024-05-08T04:22:22.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.161+0000 7f93792c4640 1 --2- 172.21.15.104:0/702635380 >> v2:172.21.15.183:3300/0 conn(0x7f93740d07c0 0x7f93740d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.161+0000 7f93792c4640 1 --2- 172.21.15.104:0/702635380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93740ce5a0 0x7f9374161920 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.161+0000 7f93792c4640 1 -- 172.21.15.104:0/702635380 >> 172.21.15.104:0/702635380 conn(0x7f9374072290 msgr2=0x7f9374072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:22.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.161+0000 7f93792c4640 1 -- 172.21.15.104:0/702635380 shutdown_connections 2024-05-08T04:22:22.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.161+0000 7f93792c4640 1 -- 172.21.15.104:0/702635380 wait complete. 2024-05-08T04:22:22.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.163+0000 7f93792c4640 1 Processor -- start 2024-05-08T04:22:22.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.163+0000 7f93792c4640 1 -- start start 2024-05-08T04:22:22.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.163+0000 7f93792c4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93740ce5a0 0x7f9374160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:22.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.163+0000 7f93792c4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93740d07c0 0x7f93740cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:22.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.163+0000 7f93792c4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f937415de10 0x7f9374159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.163+0000 7f93792c4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9374162650 con 0x7f93740d07c0 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.163+0000 7f93792c4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93740d1a90 con 0x7f937415de10 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.163+0000 7f93792c4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93740d1ce0 con 0x7f93740ce5a0 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.163+0000 7f93727fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93740d07c0 0x7f93740cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f93727fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93740d07c0 0x7f93740cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34542/0 (socket says 172.21.15.104:34542) 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f93727fc640 1 -- 172.21.15.104:0/2388120137 learned_addr learned my addr 172.21.15.104:0/2388120137 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f9372ffd640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93740ce5a0 0x7f9374160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f93737fe640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f937415de10 0x7f9374159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f93727fc640 1 -- 172.21.15.104:0/2388120137 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93740ce5a0 msgr2=0x7f9374160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f93727fc640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93740ce5a0 0x7f9374160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f93727fc640 1 -- 172.21.15.104:0/2388120137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f937415de10 msgr2=0x7f9374159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f93727fc640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f937415de10 0x7f9374159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f93727fc640 1 -- 172.21.15.104:0/2388120137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9374160150 con 0x7f93740d07c0 2024-05-08T04:22:22.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f93727fc640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93740d07c0 0x7f93740cc160 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f935c009890 tx=0x7f935c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:22.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f936b7fe640 1 -- 172.21.15.104:0/2388120137 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c037040 con 0x7f93740d07c0 2024-05-08T04:22:22.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f936b7fe640 1 -- 172.21.15.104:0/2388120137 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c042070 con 0x7f93740d07c0 2024-05-08T04:22:22.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f936b7fe640 1 -- 172.21.15.104:0/2388120137 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c030bd0 con 0x7f93740d07c0 2024-05-08T04:22:22.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f93792c4640 1 -- 172.21.15.104:0/2388120137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f937415e550 con 0x7f93740d07c0 2024-05-08T04:22:22.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.164+0000 7f93792c4640 1 -- 172.21.15.104:0/2388120137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93741610d0 con 0x7f93740d07c0 2024-05-08T04:22:22.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.165+0000 7f93792c4640 1 -- 172.21.15.104:0/2388120137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9374075010 con 0x7f93740d07c0 2024-05-08T04:22:22.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.166+0000 7f936b7fe640 1 -- 172.21.15.104:0/2388120137 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f935c047460 con 0x7f93740d07c0 2024-05-08T04:22:22.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.166+0000 7f936b7fe640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f935406b4d0 0x7f935406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:22.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.166+0000 7f936b7fe640 1 -- 172.21.15.104:0/2388120137 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f935c0aac00 con 0x7f93740d07c0 2024-05-08T04:22:22.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.166+0000 7f9372ffd640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f935406b4d0 0x7f935406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:22.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.166+0000 7f9372ffd640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f935406b4d0 0x7f935406d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9364007fd0 tx=0x7f9364007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:22.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.170+0000 7f936b7fe640 1 -- 172.21.15.104:0/2388120137 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f935c0b1080 con 0x7f93740d07c0 2024-05-08T04:22:22.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.339+0000 7f93792c4640 1 -- 172.21.15.104:0/2388120137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f93740d1870 con 0x7f93740d07c0 2024-05-08T04:22:22.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.339+0000 7f936b7fe640 1 -- 172.21.15.104:0/2388120137 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f935c032e20 con 0x7f93740d07c0 2024-05-08T04:22:22.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.341+0000 7f93792c4640 1 -- 172.21.15.104:0/2388120137 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f935406b4d0 msgr2=0x7f935406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.341+0000 7f93792c4640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f935406b4d0 0x7f935406d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9364007fd0 tx=0x7f9364007e80 comp rx=0 tx=0).stop 2024-05-08T04:22:22.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.341+0000 7f93792c4640 1 -- 172.21.15.104:0/2388120137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93740d07c0 msgr2=0x7f93740cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.341+0000 7f93792c4640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93740d07c0 0x7f93740cc160 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f935c009890 tx=0x7f935c0046c0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.341+0000 7f93792c4640 1 -- 172.21.15.104:0/2388120137 shutdown_connections 2024-05-08T04:22:22.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.341+0000 7f93792c4640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f935406b4d0 0x7f935406d990 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.341+0000 7f93792c4640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f937415de10 0x7f9374159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.341+0000 7f93792c4640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93740d07c0 0x7f93740cc160 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.341+0000 7f93792c4640 1 --2- 172.21.15.104:0/2388120137 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93740ce5a0 0x7f9374160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.341+0000 7f93792c4640 1 -- 172.21.15.104:0/2388120137 >> 172.21.15.104:0/2388120137 conn(0x7f9374072290 msgr2=0x7f93740b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:22.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.341+0000 7f93792c4640 1 -- 172.21.15.104:0/2388120137 shutdown_connections 2024-05-08T04:22:22.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.341+0000 7f93792c4640 1 -- 172.21.15.104:0/2388120137 wait complete. 2024-05-08T04:22:22.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:22.353 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp54930/subvol6390) 2024-05-08T04:22:22.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:22.386 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-05-08T04:22:22.443 INFO:teuthology.orchestra.run.smithi104.stdout:cephfs_data 2024-05-08T04:22:22.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:22.443 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp54930/subvol6390) 2024-05-08T04:22:22.526 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:22:22.526 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp54930/subvol6390/.meta 2024-05-08T04:22:22.597 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol6390 subvol_grp54930 2024-05-08T04:22:22.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.742+0000 7fb3e262a640 1 Processor -- start 2024-05-08T04:22:22.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.742+0000 7fb3e262a640 1 -- start start 2024-05-08T04:22:22.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.742+0000 7fb3e262a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb3dc158540 0x7fb3dc15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.742+0000 7fb3e262a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb3dc0cd830 0x7fb3dc070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.742+0000 7fb3e262a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc073030 con 0x7fb3dc0701a0 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.742+0000 7fb3e262a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0cbf50 con 0x7fb3dc158540 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.742+0000 7fb3e262a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc072210 con 0x7fb3dc0cd830 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.743+0000 7fb3dbfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb3dc158540 0x7fb3dc15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.743+0000 7fb3d3fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb3dc0701a0 0x7fb3dc0cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:58460/0 (socket says 172.21.15.104:58460) 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.743+0000 7fb3d3fff640 1 -- 172.21.15.104:0/2096608179 learned_addr learned my addr 172.21.15.104:0/2096608179 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.743+0000 7fb3e0bc7640 1 --2- 172.21.15.104:0/2096608179 >> v2:172.21.15.183:3300/0 conn(0x7fb3dc0cd830 0x7fb3dc070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.743+0000 7fb3dbfff640 1 -- 172.21.15.104:0/2096608179 >> v2:172.21.15.183:3300/0 conn(0x7fb3dc0cd830 msgr2=0x7fb3dc070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.743+0000 7fb3dbfff640 1 --2- 172.21.15.104:0/2096608179 >> v2:172.21.15.183:3300/0 conn(0x7fb3dc0cd830 0x7fb3dc070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.743+0000 7fb3dbfff640 1 -- 172.21.15.104:0/2096608179 >> v1:172.21.15.104:6789/0 conn(0x7fb3dc0701a0 legacy=0x7fb3dc0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.743+0000 7fb3dbfff640 1 -- 172.21.15.104:0/2096608179 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc15e900 con 0x7fb3dc158540 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.743+0000 7fb3db7fe640 1 -- 172.21.15.104:0/2096608179 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006793592 0 0) 0x7fb3dc073030 con 0x7fb3dc0701a0 2024-05-08T04:22:22.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.743+0000 7fb3e0bc7640 1 --2- 172.21.15.104:0/2096608179 >> v2:172.21.15.183:3300/0 conn(0x7fb3dc0cd830 0x7fb3dc070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:22.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.744+0000 7fb3dbfff640 1 --2- 172.21.15.104:0/2096608179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3dc158540 0x7fb3dc15e3c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc06db00 tx=0x7fb3cc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13b97d4d9eef79f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:22.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.744+0000 7fb3db7fe640 1 -- 172.21.15.104:0/2096608179 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc037070 con 0x7fb3dc158540 2024-05-08T04:22:22.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.744+0000 7fb3db7fe640 1 -- 172.21.15.104:0/2096608179 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc032440 con 0x7fb3dc158540 2024-05-08T04:22:22.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.744+0000 7fb3db7fe640 1 -- 172.21.15.104:0/2096608179 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc032810 con 0x7fb3dc158540 2024-05-08T04:22:22.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.744+0000 7fb3e262a640 1 -- 172.21.15.104:0/2096608179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3dc158540 msgr2=0x7fb3dc15e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.744+0000 7fb3e262a640 1 --2- 172.21.15.104:0/2096608179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3dc158540 0x7fb3dc15e3c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc06db00 tx=0x7fb3cc02a1a0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.744+0000 7fb3e262a640 1 -- 172.21.15.104:0/2096608179 shutdown_connections 2024-05-08T04:22:22.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.744+0000 7fb3e262a640 1 --2- 172.21.15.104:0/2096608179 >> v2:172.21.15.183:3300/0 conn(0x7fb3dc0cd830 0x7fb3dc070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.744+0000 7fb3e262a640 1 --2- 172.21.15.104:0/2096608179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3dc158540 0x7fb3dc15e3c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.744+0000 7fb3e262a640 1 -- 172.21.15.104:0/2096608179 >> 172.21.15.104:0/2096608179 conn(0x7fb3dc0b23e0 msgr2=0x7fb3dc0b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:22.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.744+0000 7fb3e262a640 1 -- 172.21.15.104:0/2096608179 shutdown_connections 2024-05-08T04:22:22.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.744+0000 7fb3e262a640 1 -- 172.21.15.104:0/2096608179 wait complete. 2024-05-08T04:22:22.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.745+0000 7fb3e262a640 1 Processor -- start 2024-05-08T04:22:22.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.746+0000 7fb3e262a640 1 -- start start 2024-05-08T04:22:22.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.746+0000 7fb3e262a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3dc0701a0 0x7fb3dc0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:22.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.746+0000 7fb3e262a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3dc0cd830 0x7fb3dc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:22.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.746+0000 7fb3e262a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3dc158540 0x7fb3dc0b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.746+0000 7fb3e262a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc072a70 con 0x7fb3dc0cd830 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.746+0000 7fb3e262a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc072790 con 0x7fb3dc0701a0 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.746+0000 7fb3e262a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc072d50 con 0x7fb3dc158540 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.746+0000 7fb3d3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3dc0cd830 0x7fb3dc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.746+0000 7fb3d3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3dc0cd830 0x7fb3dc15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34560/0 (socket says 172.21.15.104:34560) 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.746+0000 7fb3d3fff640 1 -- 172.21.15.104:0/2788246288 learned_addr learned my addr 172.21.15.104:0/2788246288 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3e0bc7640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3dc158540 0x7fb3dc0b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3dbfff640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3dc0701a0 0x7fb3dc0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3d3fff640 1 -- 172.21.15.104:0/2788246288 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3dc158540 msgr2=0x7fb3dc0b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3d3fff640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3dc158540 0x7fb3dc0b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3d3fff640 1 -- 172.21.15.104:0/2788246288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3dc0701a0 msgr2=0x7fb3dc0c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3d3fff640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3dc0701a0 0x7fb3dc0c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3d3fff640 1 -- 172.21.15.104:0/2788246288 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc1489e0 con 0x7fb3dc0cd830 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3e0bc7640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3dc158540 0x7fb3dc0b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:22.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3dbfff640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3dc0701a0 0x7fb3dc0c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:22.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3d3fff640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3dc0cd830 0x7fb3dc15abd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb3c400c4d0 tx=0x7fb3c400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:22.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3d97fa640 1 -- 172.21.15.104:0/2788246288 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4018070 con 0x7fb3dc0cd830 2024-05-08T04:22:22.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3d97fa640 1 -- 172.21.15.104:0/2788246288 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c4007500 con 0x7fb3dc0cd830 2024-05-08T04:22:22.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3e262a640 1 -- 172.21.15.104:0/2788246288 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc148c80 con 0x7fb3dc0cd830 2024-05-08T04:22:22.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3d97fa640 1 -- 172.21.15.104:0/2788246288 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4004a20 con 0x7fb3dc0cd830 2024-05-08T04:22:22.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.747+0000 7fb3e262a640 1 -- 172.21.15.104:0/2788246288 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc149240 con 0x7fb3dc0cd830 2024-05-08T04:22:22.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.748+0000 7fb3e262a640 1 -- 172.21.15.104:0/2788246288 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc074ff0 con 0x7fb3dc0cd830 2024-05-08T04:22:22.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.748+0000 7fb3d97fa640 1 -- 172.21.15.104:0/2788246288 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb3c401b070 con 0x7fb3dc0cd830 2024-05-08T04:22:22.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.749+0000 7fb3d97fa640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3bc06b4d0 0x7fb3bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:22.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.749+0000 7fb3d97fa640 1 -- 172.21.15.104:0/2788246288 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3c4089510 con 0x7fb3dc0cd830 2024-05-08T04:22:22.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.749+0000 7fb3dbfff640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3bc06b4d0 0x7fb3bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:22.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.749+0000 7fb3dbfff640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3bc06b4d0 0x7fb3bc06d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc034000 tx=0x7fb3cc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:22.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.753+0000 7fb3d97fa640 1 -- 172.21.15.104:0/2788246288 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb3c4058390 con 0x7fb3dc0cd830 2024-05-08T04:22:22.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.952+0000 7fb3e262a640 1 -- 172.21.15.104:0/2788246288 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol6390", "group_name": "subvol_grp54930", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3dc0ca420 con 0x7fb3bc06b4d0 2024-05-08T04:22:22.958 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:22.957+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:22.958 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:22.957+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:22.958 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:22.957+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:22.958 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:22.957+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:22.958 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:22.957+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:22.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.990+0000 7fb3d97fa640 1 -- 172.21.15.104:0/2788246288 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7fb3dc0ca420 con 0x7fb3bc06b4d0 2024-05-08T04:22:22.991 INFO:teuthology.orchestra.run.smithi104.stdout:/volumes/subvol_grp54930/subvol6390 2024-05-08T04:22:22.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.992+0000 7fb3e262a640 1 -- 172.21.15.104:0/2788246288 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3bc06b4d0 msgr2=0x7fb3bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.992+0000 7fb3e262a640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3bc06b4d0 0x7fb3bc06d990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc034000 tx=0x7fb3cc02e000 comp rx=0 tx=0).stop 2024-05-08T04:22:22.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.992+0000 7fb3e262a640 1 -- 172.21.15.104:0/2788246288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3dc0cd830 msgr2=0x7fb3dc15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:22.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.992+0000 7fb3e262a640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3dc0cd830 0x7fb3dc15abd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb3c400c4d0 tx=0x7fb3c400c990 comp rx=0 tx=0).stop 2024-05-08T04:22:22.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.992+0000 7fb3e262a640 1 -- 172.21.15.104:0/2788246288 shutdown_connections 2024-05-08T04:22:22.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.992+0000 7fb3e262a640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb3bc06b4d0 0x7fb3bc06d990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.992+0000 7fb3e262a640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3dc158540 0x7fb3dc0b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.992+0000 7fb3e262a640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3dc0cd830 0x7fb3dc15abd0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.992+0000 7fb3e262a640 1 --2- 172.21.15.104:0/2788246288 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3dc0701a0 0x7fb3dc0c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:22.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.992+0000 7fb3e262a640 1 -- 172.21.15.104:0/2788246288 >> 172.21.15.104:0/2788246288 conn(0x7fb3dc0b23e0 msgr2=0x7fb3dc0cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:22.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.993+0000 7fb3e262a640 1 -- 172.21.15.104:0/2788246288 shutdown_connections 2024-05-08T04:22:22.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:22.993+0000 7fb3e262a640 1 -- 172.21.15.104:0/2788246288 wait complete. 2024-05-08T04:22:23.005 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol6390 subvol_grp54930 2024-05-08T04:22:23.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.106+0000 7fbd9bc83640 1 Processor -- start 2024-05-08T04:22:23.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.106+0000 7fbd9bc83640 1 -- start start 2024-05-08T04:22:23.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.107+0000 7fbd9bc83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9415de10 0x7fbd94161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:23.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.107+0000 7fbd9bc83640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbd940ce5a0 0x7fbd940d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:23.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.107+0000 7fbd9bc83640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd940d3210 con 0x7fbd940d05f0 2024-05-08T04:22:23.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.107+0000 7fbd9bc83640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd940d0f50 con 0x7fbd940ce5a0 2024-05-08T04:22:23.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.107+0000 7fbd9bc83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd94161e60 con 0x7fbd9415de10 2024-05-08T04:22:23.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.107+0000 7fbd9921e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbd940ce5a0 0x7fbd940d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:23.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.108+0000 7fbd9921e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbd940ce5a0 0x7fbd940d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34582/0 (socket says 172.21.15.104:34582) 2024-05-08T04:22:23.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.108+0000 7fbd9921e640 1 -- 172.21.15.104:0/1450835147 learned_addr learned my addr 172.21.15.104:0/1450835147 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:23.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.108+0000 7fbd99a1f640 1 --2- 172.21.15.104:0/1450835147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9415de10 0x7fbd94161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:23.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.108+0000 7fbd9921e640 1 -- 172.21.15.104:0/1450835147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9415de10 msgr2=0x7fbd94161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:23.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.108+0000 7fbd9921e640 1 --2- 172.21.15.104:0/1450835147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9415de10 0x7fbd94161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:23.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.108+0000 7fbd9921e640 1 -- 172.21.15.104:0/1450835147 >> v1:172.21.15.183:6789/0 conn(0x7fbd940d05f0 legacy=0x7fbd940b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:23.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.108+0000 7fbd9921e640 1 -- 172.21.15.104:0/1450835147 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9415e1f0 con 0x7fbd940ce5a0 2024-05-08T04:22:23.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.108+0000 7fbd9921e640 1 --2- 172.21.15.104:0/1450835147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd940ce5a0 0x7fbd940d00b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009870 tx=0x7fbd8402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e323851e55668fcb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:23.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.109+0000 7fbd98a1d640 1 -- 172.21.15.104:0/1450835147 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84037070 con 0x7fbd940ce5a0 2024-05-08T04:22:23.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.109+0000 7fbd98a1d640 1 -- 172.21.15.104:0/1450835147 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd84032440 con 0x7fbd940ce5a0 2024-05-08T04:22:23.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.109+0000 7fbd98a1d640 1 -- 172.21.15.104:0/1450835147 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd84032810 con 0x7fbd940ce5a0 2024-05-08T04:22:23.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.109+0000 7fbd9bc83640 1 -- 172.21.15.104:0/1450835147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd940ce5a0 msgr2=0x7fbd940d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:23.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.109+0000 7fbd9bc83640 1 --2- 172.21.15.104:0/1450835147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd940ce5a0 0x7fbd940d00b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009870 tx=0x7fbd8402a180 comp rx=0 tx=0).stop 2024-05-08T04:22:23.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.109+0000 7fbd9bc83640 1 -- 172.21.15.104:0/1450835147 shutdown_connections 2024-05-08T04:22:23.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.109+0000 7fbd9bc83640 1 --2- 172.21.15.104:0/1450835147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd940ce5a0 0x7fbd940d00b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:23.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.109+0000 7fbd9bc83640 1 --2- 172.21.15.104:0/1450835147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd9415de10 0x7fbd94161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:23.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.109+0000 7fbd9bc83640 1 -- 172.21.15.104:0/1450835147 >> 172.21.15.104:0/1450835147 conn(0x7fbd94072290 msgr2=0x7fbd94072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:23.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.109+0000 7fbd9bc83640 1 -- 172.21.15.104:0/1450835147 shutdown_connections 2024-05-08T04:22:23.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.109+0000 7fbd9bc83640 1 -- 172.21.15.104:0/1450835147 wait complete. 2024-05-08T04:22:23.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.110+0000 7fbd9bc83640 1 Processor -- start 2024-05-08T04:22:23.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.110+0000 7fbd9bc83640 1 -- start start 2024-05-08T04:22:23.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.111+0000 7fbd9bc83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd940ce5a0 0x7fbd94160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:23.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.111+0000 7fbd9bc83640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd940d05f0 0x7fbd940cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:23.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.111+0000 7fbd9bc83640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd9415de10 0x7fbd9415a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:23.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.111+0000 7fbd9bc83640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd94162090 con 0x7fbd940ce5a0 2024-05-08T04:22:23.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.111+0000 7fbd9bc83640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940d1a90 con 0x7fbd9415de10 2024-05-08T04:22:23.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.111+0000 7fbd9bc83640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd94162370 con 0x7fbd940d05f0 2024-05-08T04:22:23.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.111+0000 7fbd99a1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd940ce5a0 0x7fbd94160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:23.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.111+0000 7fbd99a1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd940ce5a0 0x7fbd94160c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34586/0 (socket says 172.21.15.104:34586) 2024-05-08T04:22:23.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.111+0000 7fbd99a1f640 1 -- 172.21.15.104:0/2554652460 learned_addr learned my addr 172.21.15.104:0/2554652460 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:23.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.111+0000 7fbd99a1f640 1 -- 172.21.15.104:0/2554652460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd940d05f0 msgr2=0x7fbd940cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:23.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.111+0000 7fbd99a1f640 1 --2- 172.21.15.104:0/2554652460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd940d05f0 0x7fbd940cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:23.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.112+0000 7fbd99a1f640 1 -- 172.21.15.104:0/2554652460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd9415de10 msgr2=0x7fbd9415a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:23.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.112+0000 7fbd99a1f640 1 --2- 172.21.15.104:0/2554652460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd9415de10 0x7fbd9415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:23.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.112+0000 7fbd99a1f640 1 -- 172.21.15.104:0/2554652460 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd941611c0 con 0x7fbd940ce5a0 2024-05-08T04:22:23.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.112+0000 7fbd99a1f640 1 --2- 172.21.15.104:0/2554652460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd940ce5a0 0x7fbd94160c80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00d620 tx=0x7fbd8c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:23.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.112+0000 7fbd8a7fc640 1 -- 172.21.15.104:0/2554652460 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00b620 con 0x7fbd940ce5a0 2024-05-08T04:22:23.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.112+0000 7fbd8a7fc640 1 -- 172.21.15.104:0/2554652460 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c019070 con 0x7fbd940ce5a0 2024-05-08T04:22:23.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.112+0000 7fbd9bc83640 1 -- 172.21.15.104:0/2554652460 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd940cbe30 con 0x7fbd940ce5a0 2024-05-08T04:22:23.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.112+0000 7fbd8a7fc640 1 -- 172.21.15.104:0/2554652460 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c00ba00 con 0x7fbd940ce5a0 2024-05-08T04:22:23.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.112+0000 7fbd9bc83640 1 -- 172.21.15.104:0/2554652460 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd940cc3f0 con 0x7fbd940ce5a0 2024-05-08T04:22:23.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.113+0000 7fbd9bc83640 1 -- 172.21.15.104:0/2554652460 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd94067420 con 0x7fbd940ce5a0 2024-05-08T04:22:23.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.113+0000 7fbd8a7fc640 1 -- 172.21.15.104:0/2554652460 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbd8c00bba0 con 0x7fbd940ce5a0 2024-05-08T04:22:23.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.114+0000 7fbd8a7fc640 1 --2- 172.21.15.104:0/2554652460 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbd7806b500 0x7fbd7806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:23.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.114+0000 7fbd8a7fc640 1 -- 172.21.15.104:0/2554652460 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd8c08a610 con 0x7fbd940ce5a0 2024-05-08T04:22:23.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.114+0000 7fbd9921e640 1 --2- 172.21.15.104:0/2554652460 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbd7806b500 0x7fbd7806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:23.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.114+0000 7fbd9921e640 1 --2- 172.21.15.104:0/2554652460 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbd7806b500 0x7fbd7806d9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd84034000 tx=0x7fbd8402c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:23.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.118+0000 7fbd8a7fc640 1 -- 172.21.15.104:0/2554652460 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbd94067420 con 0x7fbd940ce5a0 2024-05-08T04:22:23.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.314+0000 7fbd9bc83640 1 -- 172.21.15.104:0/2554652460 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol6390", "group_name": "subvol_grp54930", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd940d1870 con 0x7fbd7806b500 2024-05-08T04:22:23.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.317+0000 7fbd8a7fc640 1 -- 172.21.15.104:0/2554652460 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7fbd940d1870 con 0x7fbd7806b500 2024-05-08T04:22:23.319 INFO:teuthology.orchestra.run.smithi104.stdout:/volumes/subvol_grp54930/subvol6390 2024-05-08T04:22:23.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.319+0000 7fbd9bc83640 1 -- 172.21.15.104:0/2554652460 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbd7806b500 msgr2=0x7fbd7806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:23.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.319+0000 7fbd9bc83640 1 --2- 172.21.15.104:0/2554652460 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbd7806b500 0x7fbd7806d9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd84034000 tx=0x7fbd8402c000 comp rx=0 tx=0).stop 2024-05-08T04:22:23.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.319+0000 7fbd9bc83640 1 -- 172.21.15.104:0/2554652460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd940ce5a0 msgr2=0x7fbd94160c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:23.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.319+0000 7fbd9bc83640 1 --2- 172.21.15.104:0/2554652460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd940ce5a0 0x7fbd94160c80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00d620 tx=0x7fbd8c00dae0 comp rx=0 tx=0).stop 2024-05-08T04:22:23.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.319+0000 7fbd9bc83640 1 -- 172.21.15.104:0/2554652460 shutdown_connections 2024-05-08T04:22:23.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.319+0000 7fbd9bc83640 1 --2- 172.21.15.104:0/2554652460 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbd7806b500 0x7fbd7806d9c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:23.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.319+0000 7fbd9bc83640 1 --2- 172.21.15.104:0/2554652460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd9415de10 0x7fbd9415a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:23.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.319+0000 7fbd9bc83640 1 --2- 172.21.15.104:0/2554652460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd940d05f0 0x7fbd940cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:23.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.319+0000 7fbd9bc83640 1 --2- 172.21.15.104:0/2554652460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbd940ce5a0 0x7fbd94160c80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:23.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.320+0000 7fbd9bc83640 1 -- 172.21.15.104:0/2554652460 >> 172.21.15.104:0/2554652460 conn(0x7fbd94072290 msgr2=0x7fbd9415bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:23.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.320+0000 7fbd9bc83640 1 -- 172.21.15.104:0/2554652460 shutdown_connections 2024-05-08T04:22:23.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:23.320+0000 7fbd9bc83640 1 -- 172.21.15.104:0/2554652460 wait complete. 2024-05-08T04:22:23.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:23.332 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/25fe1eb7bd0b561f8f929e562d03ee62.meta) 2024-05-08T04:22:26.157 INFO:teuthology.orchestra.run.smithi104.stdout:[GLOBAL] 2024-05-08T04:22:26.157 INFO:teuthology.orchestra.run.smithi104.stdout:version = 1 2024-05-08T04:22:26.157 INFO:teuthology.orchestra.run.smithi104.stdout:type = subvolume 2024-05-08T04:22:26.157 INFO:teuthology.orchestra.run.smithi104.stdout:path = /volumes/subvol_grp54930/subvol6390 2024-05-08T04:22:26.157 INFO:teuthology.orchestra.run.smithi104.stdout:state = complete 2024-05-08T04:22:26.157 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:26.159 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol6390 subvol_grp54930 2024-05-08T04:22:26.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.272+0000 7f4d97b5a640 1 Processor -- start 2024-05-08T04:22:26.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.272+0000 7f4d97b5a640 1 -- start start 2024-05-08T04:22:26.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d97b5a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d900b2d40 0x7f4d900cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d97b5a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d900c4280 con 0x7f4d900c4a10 2024-05-08T04:22:26.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d97b5a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d900cbe90 con 0x7f4d9015ab60 2024-05-08T04:22:26.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d97b5a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900cbc40 con 0x7f4d900b2d40 2024-05-08T04:22:26.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d960f7640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f4d900c4a10 0x7f4d900c4e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:58470/0 (socket says 172.21.15.104:58470) 2024-05-08T04:22:26.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d960f7640 1 -- 172.21.15.104:0/1444061818 learned_addr learned my addr 172.21.15.104:0/1444061818 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:26.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d950f5640 1 --2- 172.21.15.104:0/1444061818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d900b2d40 0x7f4d900cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743905986 0 0) 0x7f4d900c4280 con 0x7f4d900c4a10 2024-05-08T04:22:26.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d7c003520 con 0x7f4d900c4a10 2024-05-08T04:22:26.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393859839 0 0) 0x7f4d900cbe90 con 0x7f4d9015ab60 2024-05-08T04:22:26.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d900c4280 con 0x7f4d9015ab60 2024-05-08T04:22:26.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1787212877 0 0) 0x7f4d7c003520 con 0x7f4d900c4a10 2024-05-08T04:22:26.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d900b2d40 msgr2=0x7f4d900cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:26.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 --2- 172.21.15.104:0/1444061818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d900b2d40 0x7f4d900cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 >> v1:172.21.15.183:6789/0 conn(0x7f4d9015ab60 legacy=0x7f4d900ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:26.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d900cc170 con 0x7f4d900c4a10 2024-05-08T04:22:26.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f4d880019f0 con 0x7f4d900c4a10 2024-05-08T04:22:26.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 >> v1:172.21.15.104:6789/0 conn(0x7f4d900c4a10 legacy=0x7f4d900c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:26.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 --2- 172.21.15.104:0/1444061818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d900b2d40 0x7f4d7c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 --2- 172.21.15.104:0/1444061818 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d7c0040d0 0x7f4d7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 --2- 172.21.15.104:0/1444061818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d7c004d40 0x7f4d7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900cbc40 con 0x7f4d7c0040d0 2024-05-08T04:22:26.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.273+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c00baa0 con 0x7f4d7c004d40 2024-05-08T04:22:26.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.274+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c00bca0 con 0x7f4d900b2d40 2024-05-08T04:22:26.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.274+0000 7f4d950f5640 1 --2- 172.21.15.104:0/1444061818 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d7c0040d0 0x7f4d7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.274+0000 7f4d958f6640 1 --2- 172.21.15.104:0/1444061818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d900b2d40 0x7f4d7c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.274+0000 7f4d960f7640 1 --2- 172.21.15.104:0/1444061818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d7c004d40 0x7f4d7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.274+0000 7f4d950f5640 1 -- 172.21.15.104:0/1444061818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d900b2d40 msgr2=0x7f4d7c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:26.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.274+0000 7f4d950f5640 1 --2- 172.21.15.104:0/1444061818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d900b2d40 0x7f4d7c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.274+0000 7f4d950f5640 1 -- 172.21.15.104:0/1444061818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d7c004d40 msgr2=0x7f4d7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:26.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.274+0000 7f4d950f5640 1 --2- 172.21.15.104:0/1444061818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d7c004d40 0x7f4d7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.274+0000 7f4d950f5640 1 -- 172.21.15.104:0/1444061818 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c003520 con 0x7f4d7c0040d0 2024-05-08T04:22:26.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.274+0000 7f4d960f7640 1 --2- 172.21.15.104:0/1444061818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d7c004d40 0x7f4d7c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:26.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.275+0000 7f4d950f5640 1 --2- 172.21.15.104:0/1444061818 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d7c0040d0 0x7f4d7c004800 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009ac0 tx=0x7f4d7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4898970311650ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:26.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.275+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80036070 con 0x7f4d7c0040d0 2024-05-08T04:22:26.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.275+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d80031400 con 0x7f4d7c0040d0 2024-05-08T04:22:26.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.275+0000 7f4d948f4640 1 -- 172.21.15.104:0/1444061818 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80009690 con 0x7f4d7c0040d0 2024-05-08T04:22:26.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.275+0000 7f4d97b5a640 1 -- 172.21.15.104:0/1444061818 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d7c0040d0 msgr2=0x7f4d7c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:26.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.275+0000 7f4d97b5a640 1 --2- 172.21.15.104:0/1444061818 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d7c0040d0 0x7f4d7c004800 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009ac0 tx=0x7f4d7c005830 comp rx=0 tx=0).stop 2024-05-08T04:22:26.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.275+0000 7f4d960f7640 1 -- 172.21.15.104:0/1444061818 reap_dead start 2024-05-08T04:22:26.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.275+0000 7f4d97b5a640 1 -- 172.21.15.104:0/1444061818 shutdown_connections 2024-05-08T04:22:26.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.275+0000 7f4d97b5a640 1 -- 172.21.15.104:0/1444061818 >> 172.21.15.104:0/1444061818 conn(0x7f4d900b2220 msgr2=0x7f4d900b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:26.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.275+0000 7f4d97b5a640 1 -- 172.21.15.104:0/1444061818 shutdown_connections 2024-05-08T04:22:26.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.275+0000 7f4d97b5a640 1 -- 172.21.15.104:0/1444061818 wait complete. 2024-05-08T04:22:26.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.277+0000 7f4d97b5a640 1 Processor -- start 2024-05-08T04:22:26.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.277+0000 7f4d97b5a640 1 -- start start 2024-05-08T04:22:26.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.277+0000 7f4d97b5a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d7c0040d0 0x7f4d9015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.277+0000 7f4d97b5a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d900ca800 0x7f4d901f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.277+0000 7f4d97b5a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d901f5910 0x7f4d9006f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.277+0000 7f4d97b5a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900cee20 con 0x7f4d901f5910 2024-05-08T04:22:26.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.277+0000 7f4d97b5a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900cc450 con 0x7f4d900ca800 2024-05-08T04:22:26.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.277+0000 7f4d97b5a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900cefa0 con 0x7f4d7c0040d0 2024-05-08T04:22:26.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.277+0000 7f4d960f7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d901f5910 0x7f4d9006f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.277+0000 7f4d960f7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d901f5910 0x7f4d9006f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34602/0 (socket says 172.21.15.104:34602) 2024-05-08T04:22:26.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.277+0000 7f4d960f7640 1 -- 172.21.15.104:0/3706134804 learned_addr learned my addr 172.21.15.104:0/3706134804 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:26.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.278+0000 7f4d958f6640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d7c0040d0 0x7f4d9015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.278+0000 7f4d950f5640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d900ca800 0x7f4d901f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.278+0000 7f4d960f7640 1 -- 172.21.15.104:0/3706134804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d7c0040d0 msgr2=0x7f4d9015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.278+0000 7f4d960f7640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d7c0040d0 0x7f4d9015d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.278+0000 7f4d960f7640 1 -- 172.21.15.104:0/3706134804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d900ca800 msgr2=0x7f4d901f53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.278+0000 7f4d960f7640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d900ca800 0x7f4d901f53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.278+0000 7f4d960f7640 1 -- 172.21.15.104:0/3706134804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d900c8110 con 0x7f4d901f5910 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.278+0000 7f4d960f7640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d901f5910 0x7f4d9006f360 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4d90068910 tx=0x7f4d8800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.278+0000 7f4d867fc640 1 -- 172.21.15.104:0/3706134804 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8800ec10 con 0x7f4d901f5910 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.278+0000 7f4d867fc640 1 -- 172.21.15.104:0/3706134804 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8800edb0 con 0x7f4d901f5910 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.278+0000 7f4d97b5a640 1 -- 172.21.15.104:0/3706134804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d901f4c10 con 0x7f4d901f5910 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.278+0000 7f4d867fc640 1 -- 172.21.15.104:0/3706134804 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88014670 con 0x7f4d901f5910 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.278+0000 7f4d97b5a640 1 -- 172.21.15.104:0/3706134804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d900c8690 con 0x7f4d901f5910 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.279+0000 7f4d97b5a640 1 -- 172.21.15.104:0/3706134804 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d90075010 con 0x7f4d901f5910 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.280+0000 7f4d867fc640 1 -- 172.21.15.104:0/3706134804 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 6) v1 ==== 89831+0+0 (secure 0 0 0) 0x7f4d88014810 con 0x7f4d901f5910 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.280+0000 7f4d867fc640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d7406b560 0x7f4d7406da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.280+0000 7f4d867fc640 1 -- 172.21.15.104:0/3706134804 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d88089e80 con 0x7f4d901f5910 2024-05-08T04:22:26.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.280+0000 7f4d958f6640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d7406b560 0x7f4d7406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.281+0000 7f4d958f6640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d7406b560 0x7f4d7406da20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c001910 tx=0x7f4d8c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:26.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.285+0000 7f4d867fc640 1 -- 172.21.15.104:0/3706134804 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4d88058750 con 0x7f4d901f5910 2024-05-08T04:22:26.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.478+0000 7f4d97b5a640 1 -- 172.21.15.104:0/3706134804 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol6390", "group_name": "subvol_grp54930", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d9015c240 con 0x7f4d7406b560 2024-05-08T04:22:26.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.489+0000 7f4d867fc640 1 -- 172.21.15.104:0/3706134804 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4d9015c240 con 0x7f4d7406b560 2024-05-08T04:22:26.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.492+0000 7f4d97b5a640 1 -- 172.21.15.104:0/3706134804 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d7406b560 msgr2=0x7f4d7406da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:26.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.492+0000 7f4d97b5a640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d7406b560 0x7f4d7406da20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c001910 tx=0x7f4d8c009040 comp rx=0 tx=0).stop 2024-05-08T04:22:26.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.492+0000 7f4d97b5a640 1 -- 172.21.15.104:0/3706134804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d901f5910 msgr2=0x7f4d9006f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:26.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.492+0000 7f4d97b5a640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d901f5910 0x7f4d9006f360 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4d90068910 tx=0x7f4d8800e530 comp rx=0 tx=0).stop 2024-05-08T04:22:26.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.492+0000 7f4d97b5a640 1 -- 172.21.15.104:0/3706134804 shutdown_connections 2024-05-08T04:22:26.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.492+0000 7f4d97b5a640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d7406b560 0x7f4d7406da20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.492+0000 7f4d97b5a640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d900ca800 0x7f4d901f53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.492+0000 7f4d97b5a640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d901f5910 0x7f4d9006f360 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.492+0000 7f4d97b5a640 1 --2- 172.21.15.104:0/3706134804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d7c0040d0 0x7f4d9015d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.492+0000 7f4d97b5a640 1 -- 172.21.15.104:0/3706134804 >> 172.21.15.104:0/3706134804 conn(0x7f4d900b2220 msgr2=0x7f4d900c4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:26.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.492+0000 7f4d97b5a640 1 -- 172.21.15.104:0/3706134804 shutdown_connections 2024-05-08T04:22:26.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.492+0000 7f4d97b5a640 1 -- 172.21.15.104:0/3706134804 wait complete. 2024-05-08T04:22:26.495 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:26.493+0000 7f27f61d8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:26.495 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:26.493+0000 7f27f61d8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:26.495 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:26.493+0000 7f27f61d8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:26.495 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:26.493+0000 7f27f61d8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:26.495 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:26.493+0000 7f27f61d8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:26.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:26.505 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-08T04:22:26.507 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:26.506+0000 7f27f51d6640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:26.507 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:26.506+0000 7f27f51d6640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:26.508 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:26.506+0000 7f27f51d6640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:26.508 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:26.506+0000 7f27f51d6640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:26.508 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:22:26.506+0000 7f27f51d6640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:22:26.524 INFO:teuthology.orchestra.run.smithi104.stdout:2 2024-05-08T04:22:26.525 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp54930 2024-05-08T04:22:26.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.667+0000 7f6cf0cb3640 1 Processor -- start 2024-05-08T04:22:26.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.667+0000 7f6cf0cb3640 1 -- start start 2024-05-08T04:22:26.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.667+0000 7f6cf0cb3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6cec15de10 0x7f6cec161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.667+0000 7f6cf0cb3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0ce5a0 0x7f6cec0d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.667+0000 7f6cf0cb3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6cec0d05f0 0x7f6cec0b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.667+0000 7f6cf0cb3640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cec0d0f50 con 0x7f6cec0d05f0 2024-05-08T04:22:26.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.667+0000 7f6cf0cb3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cec161e60 con 0x7f6cec15de10 2024-05-08T04:22:26.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.667+0000 7f6cf0cb3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec0d1a90 con 0x7f6cec0ce5a0 2024-05-08T04:22:26.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.668+0000 7f6cead9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6cec0d05f0 0x7f6cec0b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.668+0000 7f6cead9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6cec0d05f0 0x7f6cec0b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34654/0 (socket says 172.21.15.104:34654) 2024-05-08T04:22:26.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.668+0000 7f6cead9d640 1 -- 172.21.15.104:0/1749610823 learned_addr learned my addr 172.21.15.104:0/1749610823 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:26.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.668+0000 7f6ce3fff640 1 --2- 172.21.15.104:0/1749610823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0ce5a0 0x7f6cec0d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.668+0000 7f6cea59c640 1 --2- 172.21.15.104:0/1749610823 >> v2:172.21.15.183:3300/0 conn(0x7f6cec15de10 0x7f6cec161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.668+0000 7f6cead9d640 1 -- 172.21.15.104:0/1749610823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0ce5a0 msgr2=0x7f6cec0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:26.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.668+0000 7f6cead9d640 1 --2- 172.21.15.104:0/1749610823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0ce5a0 0x7f6cec0d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.668+0000 7f6cead9d640 1 -- 172.21.15.104:0/1749610823 >> v2:172.21.15.183:3300/0 conn(0x7f6cec15de10 msgr2=0x7f6cec161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.668+0000 7f6cead9d640 1 --2- 172.21.15.104:0/1749610823 >> v2:172.21.15.183:3300/0 conn(0x7f6cec15de10 0x7f6cec161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.668+0000 7f6cead9d640 1 -- 172.21.15.104:0/1749610823 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec15e1f0 con 0x7f6cec0d05f0 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.668+0000 7f6cea59c640 1 --2- 172.21.15.104:0/1749610823 >> v2:172.21.15.183:3300/0 conn(0x7f6cec15de10 0x7f6cec161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.669+0000 7f6cead9d640 1 --2- 172.21.15.104:0/1749610823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cec0d05f0 0x7f6cec0b54a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0d15a0 tx=0x7f6ce402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bcbe445fef23e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.669+0000 7f6ce9d9b640 1 -- 172.21.15.104:0/1749610823 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4036070 con 0x7f6cec0d05f0 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.669+0000 7f6ce9d9b640 1 -- 172.21.15.104:0/1749610823 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4031600 con 0x7f6cec0d05f0 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.669+0000 7f6ce9d9b640 1 -- 172.21.15.104:0/1749610823 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce40319d0 con 0x7f6cec0d05f0 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.669+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/1749610823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cec0d05f0 msgr2=0x7f6cec0b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.669+0000 7f6cf0cb3640 1 --2- 172.21.15.104:0/1749610823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cec0d05f0 0x7f6cec0b54a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0d15a0 tx=0x7f6ce402a610 comp rx=0 tx=0).stop 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.669+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/1749610823 shutdown_connections 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.669+0000 7f6cf0cb3640 1 --2- 172.21.15.104:0/1749610823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cec0d05f0 0x7f6cec0b54a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.669+0000 7f6cf0cb3640 1 --2- 172.21.15.104:0/1749610823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0ce5a0 0x7f6cec0d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.669+0000 7f6cf0cb3640 1 --2- 172.21.15.104:0/1749610823 >> v2:172.21.15.183:3300/0 conn(0x7f6cec15de10 0x7f6cec161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.669+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/1749610823 >> 172.21.15.104:0/1749610823 conn(0x7f6cec072290 msgr2=0x7f6cec072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:26.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.669+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/1749610823 shutdown_connections 2024-05-08T04:22:26.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.669+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/1749610823 wait complete. 2024-05-08T04:22:26.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.671+0000 7f6cf0cb3640 1 Processor -- start 2024-05-08T04:22:26.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.671+0000 7f6cf0cb3640 1 -- start start 2024-05-08T04:22:26.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.671+0000 7f6cf0cb3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0ce5a0 0x7f6cec14ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.671+0000 7f6cf0cb3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cec0d05f0 0x7f6cec0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.671+0000 7f6cf0cb3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cec15de10 0x7f6cec0b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.671+0000 7f6cf0cb3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec162370 con 0x7f6cec0d05f0 2024-05-08T04:22:26.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.671+0000 7f6cf0cb3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec162090 con 0x7f6cec15de10 2024-05-08T04:22:26.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.671+0000 7f6cf0cb3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec162650 con 0x7f6cec0ce5a0 2024-05-08T04:22:26.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6ce3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cec0d05f0 0x7f6cec0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6ce3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cec0d05f0 0x7f6cec0b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34666/0 (socket says 172.21.15.104:34666) 2024-05-08T04:22:26.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6ce3fff640 1 -- 172.21.15.104:0/729274711 learned_addr learned my addr 172.21.15.104:0/729274711 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:26.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6cea59c640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0ce5a0 0x7f6cec14ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6cead9d640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cec15de10 0x7f6cec0b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6ce3fff640 1 -- 172.21.15.104:0/729274711 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0ce5a0 msgr2=0x7f6cec14ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6ce3fff640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0ce5a0 0x7f6cec14ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6ce3fff640 1 -- 172.21.15.104:0/729274711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cec15de10 msgr2=0x7f6cec0b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6ce3fff640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cec15de10 0x7f6cec0b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6ce3fff640 1 -- 172.21.15.104:0/729274711 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec14f4a0 con 0x7f6cec0d05f0 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6ce3fff640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cec0d05f0 0x7f6cec0b5cf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400d800 tx=0x7f6cd400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6ce2ffd640 1 -- 172.21.15.104:0/729274711 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4018020 con 0x7f6cec0d05f0 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6ce2ffd640 1 -- 172.21.15.104:0/729274711 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd40096a0 con 0x7f6cec0d05f0 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/729274711 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cec0b4350 con 0x7f6cec0d05f0 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6ce2ffd640 1 -- 172.21.15.104:0/729274711 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4009a70 con 0x7f6cec0d05f0 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.672+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/729274711 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cec0b4910 con 0x7f6cec0d05f0 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.673+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/729274711 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cec08b3a0 con 0x7f6cec0d05f0 2024-05-08T04:22:26.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.674+0000 7f6ce2ffd640 1 -- 172.21.15.104:0/729274711 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 6) v1 ==== 89831+0+0 (secure 0 0 0) 0x7f6cd401b020 con 0x7f6cec0d05f0 2024-05-08T04:22:26.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.674+0000 7f6ce2ffd640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6ccc06b560 0x7f6ccc06da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:26.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.674+0000 7f6ce2ffd640 1 -- 172.21.15.104:0/729274711 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cd408a750 con 0x7f6cec0d05f0 2024-05-08T04:22:26.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.674+0000 7f6cea59c640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6ccc06b560 0x7f6ccc06da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:26.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.675+0000 7f6cea59c640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6ccc06b560 0x7f6ccc06da20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00a950 tx=0x7f6cdc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:26.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.678+0000 7f6ce2ffd640 1 -- 172.21.15.104:0/729274711 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6cec08b3a0 con 0x7f6cec0d05f0 2024-05-08T04:22:26.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.745+0000 7f6ce2ffd640 1 -- 172.21.15.104:0/729274711 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f6cd4055600 con 0x7f6cec0d05f0 2024-05-08T04:22:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.877+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/729274711 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp54930", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cec0d1870 con 0x7f6ccc06b560 2024-05-08T04:22:26.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.881+0000 7f6ce2ffd640 1 -- 172.21.15.104:0/729274711 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6cec0d1870 con 0x7f6ccc06b560 2024-05-08T04:22:26.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.883+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/729274711 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6ccc06b560 msgr2=0x7f6ccc06da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:26.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.883+0000 7f6cf0cb3640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6ccc06b560 0x7f6ccc06da20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00a950 tx=0x7f6cdc008040 comp rx=0 tx=0).stop 2024-05-08T04:22:26.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.883+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/729274711 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cec0d05f0 msgr2=0x7f6cec0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:26.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.883+0000 7f6cf0cb3640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cec0d05f0 0x7f6cec0b5cf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400d800 tx=0x7f6cd400dcc0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.883+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/729274711 shutdown_connections 2024-05-08T04:22:26.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.883+0000 7f6cf0cb3640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6ccc06b560 0x7f6ccc06da20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.883+0000 7f6cf0cb3640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cec15de10 0x7f6cec0b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.883+0000 7f6cf0cb3640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cec0d05f0 0x7f6cec0b5cf0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.883+0000 7f6cf0cb3640 1 --2- 172.21.15.104:0/729274711 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0ce5a0 0x7f6cec14ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:26.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.883+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/729274711 >> 172.21.15.104:0/729274711 conn(0x7f6cec072290 msgr2=0x7f6cec0cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:26.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.883+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/729274711 shutdown_connections 2024-05-08T04:22:26.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:26.883+0000 7f6cf0cb3640 1 -- 172.21.15.104:0/729274711 wait complete. 2024-05-08T04:22:26.895 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-08T04:22:26.895 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T04:22:26.938 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T04:22:26.981 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-08T04:22:26.981 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:22:26.981 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:22:26.997 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:27.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.135+0000 7fd4caeb6640 1 Processor -- start 2024-05-08T04:22:27.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.135+0000 7fd4caeb6640 1 -- start start 2024-05-08T04:22:27.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.136+0000 7fd4caeb6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c415de10 0x7fd4c4161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.136+0000 7fd4caeb6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd4c40ce5a0 0x7fd4c40d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.136+0000 7fd4caeb6640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd4c40d05f0 0x7fd4c40b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.136+0000 7fd4caeb6640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c40d0f50 con 0x7fd4c40d05f0 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.136+0000 7fd4caeb6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c4161e60 con 0x7fd4c40ce5a0 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.136+0000 7fd4caeb6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c40d1a90 con 0x7fd4c415de10 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.136+0000 7fd4c9453640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd4c40d05f0 0x7fd4c40b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.136+0000 7fd4c9453640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd4c40d05f0 0x7fd4c40b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34670/0 (socket says 172.21.15.104:34670) 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.136+0000 7fd4c9453640 1 -- 172.21.15.104:0/632701640 learned_addr learned my addr 172.21.15.104:0/632701640 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.137+0000 7fd4c8c52640 1 --2- 172.21.15.104:0/632701640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c415de10 0x7fd4c4161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.137+0000 7fd4bbfff640 1 --2- 172.21.15.104:0/632701640 >> v2:172.21.15.183:3300/0 conn(0x7fd4c40ce5a0 0x7fd4c40d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.137+0000 7fd4c9453640 1 -- 172.21.15.104:0/632701640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c415de10 msgr2=0x7fd4c4161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.137+0000 7fd4c9453640 1 --2- 172.21.15.104:0/632701640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c415de10 0x7fd4c4161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.137+0000 7fd4c9453640 1 -- 172.21.15.104:0/632701640 >> v2:172.21.15.183:3300/0 conn(0x7fd4c40ce5a0 msgr2=0x7fd4c40d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.137+0000 7fd4c9453640 1 --2- 172.21.15.104:0/632701640 >> v2:172.21.15.183:3300/0 conn(0x7fd4c40ce5a0 0x7fd4c40d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.137+0000 7fd4c9453640 1 -- 172.21.15.104:0/632701640 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c415e1f0 con 0x7fd4c40d05f0 2024-05-08T04:22:27.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.137+0000 7fd4c9453640 1 --2- 172.21.15.104:0/632701640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4c40d05f0 0x7fd4c40b54a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40d4b20 tx=0x7fd4bc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17484e1a3ade7cb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:27.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.137+0000 7fd4bb7fe640 1 -- 172.21.15.104:0/632701640 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc036070 con 0x7fd4c40d05f0 2024-05-08T04:22:27.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.138+0000 7fd4bb7fe640 1 -- 172.21.15.104:0/632701640 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc031600 con 0x7fd4c40d05f0 2024-05-08T04:22:27.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.138+0000 7fd4bb7fe640 1 -- 172.21.15.104:0/632701640 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0319d0 con 0x7fd4c40d05f0 2024-05-08T04:22:27.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.138+0000 7fd4caeb6640 1 -- 172.21.15.104:0/632701640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4c40d05f0 msgr2=0x7fd4c40b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.138+0000 7fd4caeb6640 1 --2- 172.21.15.104:0/632701640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4c40d05f0 0x7fd4c40b54a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40d4b20 tx=0x7fd4bc02a610 comp rx=0 tx=0).stop 2024-05-08T04:22:27.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.138+0000 7fd4caeb6640 1 -- 172.21.15.104:0/632701640 shutdown_connections 2024-05-08T04:22:27.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.138+0000 7fd4caeb6640 1 --2- 172.21.15.104:0/632701640 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4c40d05f0 0x7fd4c40b54a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.138+0000 7fd4caeb6640 1 --2- 172.21.15.104:0/632701640 >> v2:172.21.15.183:3300/0 conn(0x7fd4c40ce5a0 0x7fd4c40d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.138+0000 7fd4caeb6640 1 --2- 172.21.15.104:0/632701640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c415de10 0x7fd4c4161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.138+0000 7fd4caeb6640 1 -- 172.21.15.104:0/632701640 >> 172.21.15.104:0/632701640 conn(0x7fd4c4072290 msgr2=0x7fd4c4072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:27.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.138+0000 7fd4caeb6640 1 -- 172.21.15.104:0/632701640 shutdown_connections 2024-05-08T04:22:27.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.138+0000 7fd4caeb6640 1 -- 172.21.15.104:0/632701640 wait complete. 2024-05-08T04:22:27.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.139+0000 7fd4caeb6640 1 Processor -- start 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.139+0000 7fd4caeb6640 1 -- start start 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.140+0000 7fd4caeb6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c40ce5a0 0x7fd4c414e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.140+0000 7fd4caeb6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4c40d05f0 0x7fd4c415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.140+0000 7fd4caeb6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4c415de10 0x7fd4c415f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.140+0000 7fd4caeb6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4162370 con 0x7fd4c415de10 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.140+0000 7fd4caeb6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4162090 con 0x7fd4c40d05f0 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.140+0000 7fd4caeb6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4162650 con 0x7fd4c40ce5a0 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.140+0000 7fd4c9453640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4c415de10 0x7fd4c415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.140+0000 7fd4c9453640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4c415de10 0x7fd4c415f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34678/0 (socket says 172.21.15.104:34678) 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.140+0000 7fd4c9453640 1 -- 172.21.15.104:0/1648192226 learned_addr learned my addr 172.21.15.104:0/1648192226 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.140+0000 7fd4c8c52640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c40ce5a0 0x7fd4c414e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.140+0000 7fd4bbfff640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4c40d05f0 0x7fd4c415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.141+0000 7fd4c9453640 1 -- 172.21.15.104:0/1648192226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c40ce5a0 msgr2=0x7fd4c414e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.141+0000 7fd4c9453640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c40ce5a0 0x7fd4c414e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.141+0000 7fd4c9453640 1 -- 172.21.15.104:0/1648192226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4c40d05f0 msgr2=0x7fd4c415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.141+0000 7fd4c9453640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4c40d05f0 0x7fd4c415cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.141+0000 7fd4c9453640 1 -- 172.21.15.104:0/1648192226 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c415ab90 con 0x7fd4c415de10 2024-05-08T04:22:27.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.141+0000 7fd4c9453640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4c415de10 0x7fd4c415f8f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009f40 tx=0x7fd4bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:27.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.141+0000 7fd4b97fa640 1 -- 172.21.15.104:0/1648192226 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc041020 con 0x7fd4c415de10 2024-05-08T04:22:27.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.141+0000 7fd4b97fa640 1 -- 172.21.15.104:0/1648192226 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc0077a0 con 0x7fd4c415de10 2024-05-08T04:22:27.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.141+0000 7fd4caeb6640 1 -- 172.21.15.104:0/1648192226 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c414ef90 con 0x7fd4c415de10 2024-05-08T04:22:27.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.141+0000 7fd4b97fa640 1 -- 172.21.15.104:0/1648192226 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc036040 con 0x7fd4c415de10 2024-05-08T04:22:27.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.141+0000 7fd4caeb6640 1 -- 172.21.15.104:0/1648192226 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c414f550 con 0x7fd4c415de10 2024-05-08T04:22:27.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.142+0000 7fd4caeb6640 1 -- 172.21.15.104:0/1648192226 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c4075010 con 0x7fd4c415de10 2024-05-08T04:22:27.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.143+0000 7fd4b97fa640 1 -- 172.21.15.104:0/1648192226 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fd4bc044020 con 0x7fd4c415de10 2024-05-08T04:22:27.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.143+0000 7fd4b97fa640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd4b006b680 0x7fd4b006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.143+0000 7fd4b97fa640 1 -- 172.21.15.104:0/1648192226 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4bc0ab120 con 0x7fd4c415de10 2024-05-08T04:22:27.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.143+0000 7fd4c8c52640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd4b006b680 0x7fd4b006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.143+0000 7fd4c8c52640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd4b006b680 0x7fd4b006db40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00079a0 tx=0x7fd4c0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:27.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.147+0000 7fd4b97fa640 1 -- 172.21.15.104:0/1648192226 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd4bc04b030 con 0x7fd4c415de10 2024-05-08T04:22:27.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.320+0000 7fd4caeb6640 1 -- 172.21.15.104:0/1648192226 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4c40ccb30 con 0x7fd4c415de10 2024-05-08T04:22:27.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.322+0000 7fd4b97fa640 1 -- 172.21.15.104:0/1648192226 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16669 (secure 0 0 0) 0x7fd4bc079650 con 0x7fd4c415de10 2024-05-08T04:22:27.323 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:27.323 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":33,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:09.602236+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:05.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:06.917080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:27.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.323+0000 7fd4caeb6640 1 -- 172.21.15.104:0/1648192226 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd4b006b680 msgr2=0x7fd4b006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.323+0000 7fd4caeb6640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd4b006b680 0x7fd4b006db40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00079a0 tx=0x7fd4c0008040 comp rx=0 tx=0).stop 2024-05-08T04:22:27.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.323+0000 7fd4caeb6640 1 -- 172.21.15.104:0/1648192226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4c415de10 msgr2=0x7fd4c415f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.323+0000 7fd4caeb6640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4c415de10 0x7fd4c415f8f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009f40 tx=0x7fd4bc004a40 comp rx=0 tx=0).stop 2024-05-08T04:22:27.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.324+0000 7fd4caeb6640 1 -- 172.21.15.104:0/1648192226 shutdown_connections 2024-05-08T04:22:27.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.324+0000 7fd4caeb6640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd4b006b680 0x7fd4b006db40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.324+0000 7fd4caeb6640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4c40d05f0 0x7fd4c415cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.324+0000 7fd4caeb6640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4c415de10 0x7fd4c415f8f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.324+0000 7fd4caeb6640 1 --2- 172.21.15.104:0/1648192226 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4c40ce5a0 0x7fd4c414e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.324+0000 7fd4caeb6640 1 -- 172.21.15.104:0/1648192226 >> 172.21.15.104:0/1648192226 conn(0x7fd4c4072290 msgr2=0x7fd4c40cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:27.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.324+0000 7fd4caeb6640 1 -- 172.21.15.104:0/1648192226 shutdown_connections 2024-05-08T04:22:27.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.324+0000 7fd4caeb6640 1 -- 172.21.15.104:0/1648192226 wait complete. 2024-05-08T04:22:27.336 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:22:05.786250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:22:06.917080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:22:27.336 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:22:27.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.438+0000 7f0863d1d640 1 Processor -- start 2024-05-08T04:22:27.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.438+0000 7f0863d1d640 1 -- start start 2024-05-08T04:22:27.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.439+0000 7f0863d1d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f085c070c70 0x7f085c0d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.439+0000 7f0863d1d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f085c15dbe0 0x7f085c15dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.439+0000 7f0863d1d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085c15d420 con 0x7f085c071050 2024-05-08T04:22:27.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.439+0000 7f0863d1d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085c0d16a0 con 0x7f085c070c70 2024-05-08T04:22:27.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.439+0000 7f0863d1d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085c0d0eb0 con 0x7f085c15dbe0 2024-05-08T04:22:27.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.439+0000 7f0861ab9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f085c070c70 0x7f085c0d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.439+0000 7f08612b8640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f085c071050 0x7f085c15c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:58480/0 (socket says 172.21.15.104:58480) 2024-05-08T04:22:27.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.439+0000 7f08612b8640 1 -- 172.21.15.104:0/3390748264 learned_addr learned my addr 172.21.15.104:0/3390748264 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:27.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.439+0000 7f0861ab9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f085c070c70 0x7f085c0d0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34694/0 (socket says 172.21.15.104:34694) 2024-05-08T04:22:27.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.439+0000 7f0861ab9640 1 -- 172.21.15.104:0/3390748264 >> v2:172.21.15.183:3300/0 conn(0x7f085c15dbe0 msgr2=0x7f085c15dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:27.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.439+0000 7f0861ab9640 1 --2- 172.21.15.104:0/3390748264 >> v2:172.21.15.183:3300/0 conn(0x7f085c15dbe0 0x7f085c15dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.439+0000 7f0861ab9640 1 -- 172.21.15.104:0/3390748264 >> v1:172.21.15.104:6789/0 conn(0x7f085c071050 legacy=0x7f085c15c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.439+0000 7f0861ab9640 1 -- 172.21.15.104:0/3390748264 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c0d10e0 con 0x7f085c070c70 2024-05-08T04:22:27.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.440+0000 7f0861ab9640 1 --2- 172.21.15.104:0/3390748264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f085c070c70 0x7f085c0d0970 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f085c160460 tx=0x7f085802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e5d8721236a4e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:27.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.440+0000 7f0860ab7640 1 -- 172.21.15.104:0/3390748264 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858037070 con 0x7f085c070c70 2024-05-08T04:22:27.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.440+0000 7f0860ab7640 1 -- 172.21.15.104:0/3390748264 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0858032440 con 0x7f085c070c70 2024-05-08T04:22:27.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.440+0000 7f0860ab7640 1 -- 172.21.15.104:0/3390748264 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858032810 con 0x7f085c070c70 2024-05-08T04:22:27.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.441+0000 7f0863d1d640 1 -- 172.21.15.104:0/3390748264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f085c070c70 msgr2=0x7f085c0d0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.441+0000 7f0863d1d640 1 --2- 172.21.15.104:0/3390748264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f085c070c70 0x7f085c0d0970 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f085c160460 tx=0x7f085802a1a0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.441+0000 7f0863d1d640 1 -- 172.21.15.104:0/3390748264 shutdown_connections 2024-05-08T04:22:27.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.441+0000 7f0863d1d640 1 --2- 172.21.15.104:0/3390748264 >> v2:172.21.15.183:3300/0 conn(0x7f085c15dbe0 0x7f085c15dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.441+0000 7f0863d1d640 1 --2- 172.21.15.104:0/3390748264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f085c070c70 0x7f085c0d0970 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.441+0000 7f0863d1d640 1 -- 172.21.15.104:0/3390748264 >> 172.21.15.104:0/3390748264 conn(0x7f085c0b3450 msgr2=0x7f085c0b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:27.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.441+0000 7f0863d1d640 1 -- 172.21.15.104:0/3390748264 shutdown_connections 2024-05-08T04:22:27.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.441+0000 7f0863d1d640 1 -- 172.21.15.104:0/3390748264 wait complete. 2024-05-08T04:22:27.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.442+0000 7f0863d1d640 1 Processor -- start 2024-05-08T04:22:27.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.442+0000 7f0863d1d640 1 -- start start 2024-05-08T04:22:27.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f0863d1d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f085c070c70 0x7f085c13c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f0863d1d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f085c071050 0x7f085c13fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f0863d1d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f085c15dbe0 0x7f085c156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f0863d1d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c071500 con 0x7f085c071050 2024-05-08T04:22:27.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f0863d1d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c15d6c0 con 0x7f085c15dbe0 2024-05-08T04:22:27.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f0863d1d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085c15cca0 con 0x7f085c070c70 2024-05-08T04:22:27.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f08612b8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f085c071050 0x7f085c13fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f08612b8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f085c071050 0x7f085c13fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34696/0 (socket says 172.21.15.104:34696) 2024-05-08T04:22:27.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f08612b8640 1 -- 172.21.15.104:0/4275122280 learned_addr learned my addr 172.21.15.104:0/4275122280 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:27.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f0861ab9640 1 --2- 172.21.15.104:0/4275122280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f085c070c70 0x7f085c13c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f08612b8640 1 -- 172.21.15.104:0/4275122280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f085c070c70 msgr2=0x7f085c13c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f08612b8640 1 --2- 172.21.15.104:0/4275122280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f085c070c70 0x7f085c13c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f08612b8640 1 -- 172.21.15.104:0/4275122280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f085c15dbe0 msgr2=0x7f085c156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f08612b8640 1 --2- 172.21.15.104:0/4275122280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f085c15dbe0 0x7f085c156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f08612b8640 1 -- 172.21.15.104:0/4275122280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c154830 con 0x7f085c071050 2024-05-08T04:22:27.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f08612b8640 1 --2- 172.21.15.104:0/4275122280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f085c071050 0x7f085c13fe90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c450 tx=0x7f084c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:27.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f08527fc640 1 -- 172.21.15.104:0/4275122280 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c017070 con 0x7f085c071050 2024-05-08T04:22:27.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.443+0000 7f08527fc640 1 -- 172.21.15.104:0/4275122280 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c005ce0 con 0x7f085c071050 2024-05-08T04:22:27.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.444+0000 7f0863d1d640 1 -- 172.21.15.104:0/4275122280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085c154b10 con 0x7f085c071050 2024-05-08T04:22:27.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.444+0000 7f08527fc640 1 -- 172.21.15.104:0/4275122280 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c007310 con 0x7f085c071050 2024-05-08T04:22:27.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.444+0000 7f0863d1d640 1 -- 172.21.15.104:0/4275122280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085c1550d0 con 0x7f085c071050 2024-05-08T04:22:27.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.445+0000 7f0863d1d640 1 -- 172.21.15.104:0/4275122280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085c075010 con 0x7f085c071050 2024-05-08T04:22:27.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.445+0000 7f08527fc640 1 -- 172.21.15.104:0/4275122280 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f084c01a070 con 0x7f085c071050 2024-05-08T04:22:27.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.445+0000 7f08527fc640 1 --2- 172.21.15.104:0/4275122280 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f084006b680 0x7f084006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.445+0000 7f08527fc640 1 -- 172.21.15.104:0/4275122280 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f084c0898b0 con 0x7f085c071050 2024-05-08T04:22:27.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.445+0000 7f0861ab9640 1 --2- 172.21.15.104:0/4275122280 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f084006b680 0x7f084006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.446+0000 7f0861ab9640 1 --2- 172.21.15.104:0/4275122280 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f084006b680 0x7f084006db40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0858034000 tx=0x7f085802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:27.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.449+0000 7f08527fc640 1 -- 172.21.15.104:0/4275122280 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f084c0584b0 con 0x7f085c071050 2024-05-08T04:22:27.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.621+0000 7f0863d1d640 1 -- 172.21.15.104:0/4275122280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f085c06ebe0 con 0x7f085c071050 2024-05-08T04:22:27.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.621+0000 7f08527fc640 1 -- 172.21.15.104:0/4275122280 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f084c05ce20 con 0x7f085c071050 2024-05-08T04:22:27.622 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.623+0000 7f0863d1d640 1 -- 172.21.15.104:0/4275122280 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f084006b680 msgr2=0x7f084006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.623+0000 7f0863d1d640 1 --2- 172.21.15.104:0/4275122280 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f084006b680 0x7f084006db40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0858034000 tx=0x7f085802e000 comp rx=0 tx=0).stop 2024-05-08T04:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.623+0000 7f0863d1d640 1 -- 172.21.15.104:0/4275122280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f085c071050 msgr2=0x7f085c13fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.623+0000 7f0863d1d640 1 --2- 172.21.15.104:0/4275122280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f085c071050 0x7f085c13fe90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c450 tx=0x7f084c00c910 comp rx=0 tx=0).stop 2024-05-08T04:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.623+0000 7f0863d1d640 1 -- 172.21.15.104:0/4275122280 shutdown_connections 2024-05-08T04:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.623+0000 7f0863d1d640 1 --2- 172.21.15.104:0/4275122280 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f084006b680 0x7f084006db40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.623+0000 7f0863d1d640 1 --2- 172.21.15.104:0/4275122280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f085c15dbe0 0x7f085c156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.623+0000 7f0863d1d640 1 --2- 172.21.15.104:0/4275122280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f085c071050 0x7f085c13fe90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.623+0000 7f0863d1d640 1 --2- 172.21.15.104:0/4275122280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f085c070c70 0x7f085c13c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.623+0000 7f0863d1d640 1 -- 172.21.15.104:0/4275122280 >> 172.21.15.104:0/4275122280 conn(0x7f085c0b3450 msgr2=0x7f085c0b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.623+0000 7f0863d1d640 1 -- 172.21.15.104:0/4275122280 shutdown_connections 2024-05-08T04:22:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.623+0000 7f0863d1d640 1 -- 172.21.15.104:0/4275122280 wait complete. 2024-05-08T04:22:27.635 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:22:27.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.736+0000 7f2a0d407640 1 Processor -- start 2024-05-08T04:22:27.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.736+0000 7f2a0d407640 1 -- start start 2024-05-08T04:22:27.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.737+0000 7f2a0d407640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2a080b5b40 0x7f2a08168880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.737+0000 7f2a0d407640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a080b6b50 con 0x7f2a0815db30 2024-05-08T04:22:27.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.737+0000 7f2a0d407640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0806c800 con 0x7f2a080b93b0 2024-05-08T04:22:27.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.737+0000 7f2a0d407640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0806cae0 con 0x7f2a080b5b40 2024-05-08T04:22:27.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.737+0000 7f2a06ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f2a0815db30 0x7f2a0806bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46952/0 (socket says 172.21.15.104:46952) 2024-05-08T04:22:27.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.737+0000 7f2a06ffd640 1 -- 172.21.15.104:0/1317850859 learned_addr learned my addr 172.21.15.104:0/1317850859 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:27.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.737+0000 7f2a077fe640 1 --2- 172.21.15.104:0/1317850859 >> v2:172.21.15.183:3300/0 conn(0x7f2a080b5b40 0x7f2a08168880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.737+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055688975 0 0) 0x7f29f8001110 con 0x7f2a0815db30 2024-05-08T04:22:27.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.737+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29f0003520 con 0x7f2a0815db30 2024-05-08T04:22:27.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1391677728 0 0) 0x7f29f0003520 con 0x7f2a0815db30 2024-05-08T04:22:27.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 >> v2:172.21.15.183:3300/0 conn(0x7f2a080b5b40 msgr2=0x7f2a08168880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:27.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a05ffb640 1 --2- 172.21.15.104:0/1317850859 >> v2:172.21.15.183:3300/0 conn(0x7f2a080b5b40 0x7f2a08168880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 >> v1:172.21.15.183:6789/0 conn(0x7f2a080b93b0 legacy=0x7f2a080b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0806cdc0 con 0x7f2a0815db30 2024-05-08T04:22:27.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f29f8001840 con 0x7f2a0815db30 2024-05-08T04:22:27.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 >> v1:172.21.15.104:6789/0 conn(0x7f2a0815db30 legacy=0x7f2a0806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a05ffb640 1 --2- 172.21.15.104:0/1317850859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29f00039b0 0x7f29f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a05ffb640 1 --2- 172.21.15.104:0/1317850859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29f0004800 0x7f29f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a05ffb640 1 --2- 172.21.15.104:0/1317850859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f00051c0 0x7f29f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0806cae0 con 0x7f29f00051c0 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f000c060 con 0x7f29f00039b0 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f000c260 con 0x7f29f0004800 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a077fe640 1 --2- 172.21.15.104:0/1317850859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f00051c0 0x7f29f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a06ffd640 1 --2- 172.21.15.104:0/1317850859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29f00039b0 0x7f29f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a067fc640 1 --2- 172.21.15.104:0/1317850859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29f0004800 0x7f29f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a077fe640 1 -- 172.21.15.104:0/1317850859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29f0004800 msgr2=0x7f29f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a077fe640 1 --2- 172.21.15.104:0/1317850859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29f0004800 0x7f29f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a077fe640 1 -- 172.21.15.104:0/1317850859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29f00039b0 msgr2=0x7f29f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a077fe640 1 --2- 172.21.15.104:0/1317850859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29f00039b0 0x7f29f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.738+0000 7f2a077fe640 1 -- 172.21.15.104:0/1317850859 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f0003520 con 0x7f29f00051c0 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.739+0000 7f2a077fe640 1 -- 172.21.15.104:0/1317850859 reap_dead start 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.739+0000 7f2a077fe640 1 --2- 172.21.15.104:0/1317850859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f00051c0 0x7f29f000b9c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009fc0 tx=0x7f29f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661df455d8b21234 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.739+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00035020 con 0x7f29f00051c0 2024-05-08T04:22:27.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.739+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a00003bd0 con 0x7f29f00051c0 2024-05-08T04:22:27.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.739+0000 7f2a05ffb640 1 -- 172.21.15.104:0/1317850859 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00009c10 con 0x7f29f00051c0 2024-05-08T04:22:27.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.739+0000 7f2a0d407640 1 -- 172.21.15.104:0/1317850859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f00051c0 msgr2=0x7f29f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.739+0000 7f2a0d407640 1 --2- 172.21.15.104:0/1317850859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f00051c0 0x7f29f000b9c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009fc0 tx=0x7f29f0005830 comp rx=0 tx=0).stop 2024-05-08T04:22:27.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.739+0000 7f2a0d407640 1 -- 172.21.15.104:0/1317850859 shutdown_connections 2024-05-08T04:22:27.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.739+0000 7f2a0d407640 1 --2- 172.21.15.104:0/1317850859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f00051c0 0x7f29f000b9c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.739+0000 7f2a0d407640 1 -- 172.21.15.104:0/1317850859 >> 172.21.15.104:0/1317850859 conn(0x7f2a080d0430 msgr2=0x7f2a080d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:27.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.739+0000 7f2a0d407640 1 -- 172.21.15.104:0/1317850859 shutdown_connections 2024-05-08T04:22:27.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.739+0000 7f2a0d407640 1 -- 172.21.15.104:0/1317850859 wait complete. 2024-05-08T04:22:27.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.741+0000 7f2a0d407640 1 Processor -- start 2024-05-08T04:22:27.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.741+0000 7f2a0d407640 1 -- start start 2024-05-08T04:22:27.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a0d407640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29f00051c0 0x7f2a0814fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a0d407640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a0815f1e0 0x7f2a081f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a0d407640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08161d00 0x7f2a081f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a0d407640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0815df10 con 0x7f2a08161d00 2024-05-08T04:22:27.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a0d407640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a080b5430 con 0x7f2a0815f1e0 2024-05-08T04:22:27.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a0d407640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0815f710 con 0x7f29f00051c0 2024-05-08T04:22:27.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a077fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08161d00 0x7f2a081f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a077fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08161d00 0x7f2a081f68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37600/0 (socket says 172.21.15.104:37600) 2024-05-08T04:22:27.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a077fe640 1 -- 172.21.15.104:0/3501384152 learned_addr learned my addr 172.21.15.104:0/3501384152 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:27.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a06ffd640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29f00051c0 0x7f2a0814fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a067fc640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a0815f1e0 0x7f2a081f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a077fe640 1 -- 172.21.15.104:0/3501384152 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29f00051c0 msgr2=0x7f2a0814fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a077fe640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29f00051c0 0x7f2a0814fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a077fe640 1 -- 172.21.15.104:0/3501384152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a0815f1e0 msgr2=0x7f2a081f32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a077fe640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a0815f1e0 0x7f2a081f32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a077fe640 1 -- 172.21.15.104:0/3501384152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0815f9f0 con 0x7f2a08161d00 2024-05-08T04:22:27.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.742+0000 7f2a077fe640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08161d00 0x7f2a081f68a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000e230 tx=0x7f2a00009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:27.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.743+0000 7f29ef7fe640 1 -- 172.21.15.104:0/3501384152 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00040070 con 0x7f2a08161d00 2024-05-08T04:22:27.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.743+0000 7f29ef7fe640 1 -- 172.21.15.104:0/3501384152 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0003c680 con 0x7f2a08161d00 2024-05-08T04:22:27.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.743+0000 7f2a0d407640 1 -- 172.21.15.104:0/3501384152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0815fcd0 con 0x7f2a08161d00 2024-05-08T04:22:27.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.743+0000 7f29ef7fe640 1 -- 172.21.15.104:0/3501384152 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a00035030 con 0x7f2a08161d00 2024-05-08T04:22:27.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.743+0000 7f2a0d407640 1 -- 172.21.15.104:0/3501384152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a08160290 con 0x7f2a08161d00 2024-05-08T04:22:27.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.744+0000 7f2a0d407640 1 -- 172.21.15.104:0/3501384152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a08160490 con 0x7f2a08161d00 2024-05-08T04:22:27.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.744+0000 7f29ef7fe640 1 -- 172.21.15.104:0/3501384152 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f2a00043070 con 0x7f2a08161d00 2024-05-08T04:22:27.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.745+0000 7f29ef7fe640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29f406b6b0 0x7f29f406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:27.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.745+0000 7f29ef7fe640 1 -- 172.21.15.104:0/3501384152 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a000ab590 con 0x7f2a08161d00 2024-05-08T04:22:27.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.745+0000 7f2a06ffd640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29f406b6b0 0x7f29f406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:27.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.745+0000 7f2a06ffd640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29f406b6b0 0x7f29f406db70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29f80013d0 tx=0x7f29f8007a70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:27.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.749+0000 7f29ef7fe640 1 -- 172.21.15.104:0/3501384152 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2a08160490 con 0x7f2a08161d00 2024-05-08T04:22:27.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.917+0000 7f2a0d407640 1 -- 172.21.15.104:0/3501384152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a08075010 con 0x7f2a08161d00 2024-05-08T04:22:27.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.917+0000 7f29ef7fe640 1 -- 172.21.15.104:0/3501384152 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a00079b70 con 0x7f2a08161d00 2024-05-08T04:22:27.919 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.919+0000 7f2a0d407640 1 -- 172.21.15.104:0/3501384152 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29f406b6b0 msgr2=0x7f29f406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.919+0000 7f2a0d407640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29f406b6b0 0x7f29f406db70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29f80013d0 tx=0x7f29f8007a70 comp rx=0 tx=0).stop 2024-05-08T04:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.919+0000 7f2a0d407640 1 -- 172.21.15.104:0/3501384152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08161d00 msgr2=0x7f2a081f68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.920+0000 7f2a0d407640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08161d00 0x7f2a081f68a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000e230 tx=0x7f2a00009750 comp rx=0 tx=0).stop 2024-05-08T04:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.920+0000 7f2a0d407640 1 -- 172.21.15.104:0/3501384152 shutdown_connections 2024-05-08T04:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.920+0000 7f2a0d407640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29f406b6b0 0x7f29f406db70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.920+0000 7f2a0d407640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a0815f1e0 0x7f2a081f32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.920+0000 7f2a0d407640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08161d00 0x7f2a081f68a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.920+0000 7f2a0d407640 1 --2- 172.21.15.104:0/3501384152 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29f00051c0 0x7f2a0814fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:27.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.920+0000 7f2a0d407640 1 -- 172.21.15.104:0/3501384152 >> 172.21.15.104:0/3501384152 conn(0x7f2a080d0430 msgr2=0x7f2a080d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:27.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.920+0000 7f2a0d407640 1 -- 172.21.15.104:0/3501384152 shutdown_connections 2024-05-08T04:22:27.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:27.920+0000 7f2a0d407640 1 -- 172.21.15.104:0/3501384152 wait complete. 2024-05-08T04:22:27.932 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:22:28.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.033+0000 7fb14b763640 1 Processor -- start 2024-05-08T04:22:28.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.033+0000 7fb14b763640 1 -- start start 2024-05-08T04:22:28.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.034+0000 7fb14b763640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb144070c70 0x7fb144071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.034+0000 7fb14b763640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb144157ac0 0x7fb144157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.034+0000 7fb14b763640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb144071590 con 0x7fb14415edf0 2024-05-08T04:22:28.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.034+0000 7fb14b763640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14406bc70 con 0x7fb144157ac0 2024-05-08T04:22:28.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.034+0000 7fb14b763640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1440d15c0 con 0x7fb144070c70 2024-05-08T04:22:28.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.034+0000 7fb149d00640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb144157ac0 0x7fb144157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.034+0000 7fb149d00640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb144157ac0 0x7fb144157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37616/0 (socket says 172.21.15.104:37616) 2024-05-08T04:22:28.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.034+0000 7fb149d00640 1 -- 172.21.15.104:0/3135003543 learned_addr learned my addr 172.21.15.104:0/3135003543 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:28.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.034+0000 7fb1494ff640 1 --2- 172.21.15.104:0/3135003543 >> v2:172.21.15.183:3300/0 conn(0x7fb144070c70 0x7fb144071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.034+0000 7fb149d00640 1 -- 172.21.15.104:0/3135003543 >> v2:172.21.15.183:3300/0 conn(0x7fb144070c70 msgr2=0x7fb144071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:28.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.034+0000 7fb149d00640 1 --2- 172.21.15.104:0/3135003543 >> v2:172.21.15.183:3300/0 conn(0x7fb144070c70 0x7fb144071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.034+0000 7fb149d00640 1 -- 172.21.15.104:0/3135003543 >> v1:172.21.15.183:6789/0 conn(0x7fb14415edf0 legacy=0x7fb1440b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:28.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.034+0000 7fb149d00640 1 -- 172.21.15.104:0/3135003543 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14415f550 con 0x7fb144157ac0 2024-05-08T04:22:28.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.035+0000 7fb149d00640 1 --2- 172.21.15.104:0/3135003543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144157ac0 0x7fb144157f10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb144071f80 tx=0x7fb13c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6defd512815dc7dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:28.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.035+0000 7fb13bfff640 1 -- 172.21.15.104:0/3135003543 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c036070 con 0x7fb144157ac0 2024-05-08T04:22:28.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.035+0000 7fb13bfff640 1 -- 172.21.15.104:0/3135003543 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c031600 con 0x7fb144157ac0 2024-05-08T04:22:28.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.035+0000 7fb13bfff640 1 -- 172.21.15.104:0/3135003543 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0319d0 con 0x7fb144157ac0 2024-05-08T04:22:28.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.036+0000 7fb14b763640 1 -- 172.21.15.104:0/3135003543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144157ac0 msgr2=0x7fb144157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.036+0000 7fb14b763640 1 --2- 172.21.15.104:0/3135003543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144157ac0 0x7fb144157f10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb144071f80 tx=0x7fb13c02a6f0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.036+0000 7fb14b763640 1 -- 172.21.15.104:0/3135003543 shutdown_connections 2024-05-08T04:22:28.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.036+0000 7fb14b763640 1 --2- 172.21.15.104:0/3135003543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144157ac0 0x7fb144157f10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.036+0000 7fb14b763640 1 --2- 172.21.15.104:0/3135003543 >> v2:172.21.15.183:3300/0 conn(0x7fb144070c70 0x7fb144071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.036+0000 7fb14b763640 1 -- 172.21.15.104:0/3135003543 >> 172.21.15.104:0/3135003543 conn(0x7fb1440b3450 msgr2=0x7fb1440b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:28.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.036+0000 7fb14b763640 1 -- 172.21.15.104:0/3135003543 shutdown_connections 2024-05-08T04:22:28.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.036+0000 7fb14b763640 1 -- 172.21.15.104:0/3135003543 wait complete. 2024-05-08T04:22:28.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.037+0000 7fb14b763640 1 Processor -- start 2024-05-08T04:22:28.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.037+0000 7fb14b763640 1 -- start start 2024-05-08T04:22:28.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb14b763640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144070c70 0x7fb14414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb14b763640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb144157ac0 0x7fb144158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb14b763640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb14415edf0 0x7fb144155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb14b763640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440b5b80 con 0x7fb144070c70 2024-05-08T04:22:28.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb14b763640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14415fb10 con 0x7fb144157ac0 2024-05-08T04:22:28.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb14b763640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb144158450 con 0x7fb14415edf0 2024-05-08T04:22:28.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb1494ff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144070c70 0x7fb14414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb1494ff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144070c70 0x7fb14414e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37620/0 (socket says 172.21.15.104:37620) 2024-05-08T04:22:28.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb1494ff640 1 -- 172.21.15.104:0/3511205524 learned_addr learned my addr 172.21.15.104:0/3511205524 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:28.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb149d00640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb14415edf0 0x7fb144155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb148cfe640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb144157ac0 0x7fb144158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb1494ff640 1 -- 172.21.15.104:0/3511205524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb14415edf0 msgr2=0x7fb144155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb1494ff640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb14415edf0 0x7fb144155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb1494ff640 1 -- 172.21.15.104:0/3511205524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb144157ac0 msgr2=0x7fb144158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb1494ff640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb144157ac0 0x7fb144158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb1494ff640 1 -- 172.21.15.104:0/3511205524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb144155d20 con 0x7fb144070c70 2024-05-08T04:22:28.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb149d00640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb14415edf0 0x7fb144155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:28.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb148cfe640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb144157ac0 0x7fb144158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:28.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb1494ff640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144070c70 0x7fb14414e4a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb14000d800 tx=0x7fb14000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:28.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb139ffb640 1 -- 172.21.15.104:0/3511205524 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14000b6c0 con 0x7fb144070c70 2024-05-08T04:22:28.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb139ffb640 1 -- 172.21.15.104:0/3511205524 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb140019070 con 0x7fb144070c70 2024-05-08T04:22:28.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb14b763640 1 -- 172.21.15.104:0/3511205524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1440ce870 con 0x7fb144070c70 2024-05-08T04:22:28.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.038+0000 7fb139ffb640 1 -- 172.21.15.104:0/3511205524 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14000ba80 con 0x7fb144070c70 2024-05-08T04:22:28.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.039+0000 7fb14b763640 1 -- 172.21.15.104:0/3511205524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1440cee30 con 0x7fb144070c70 2024-05-08T04:22:28.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.039+0000 7fb14b763640 1 -- 172.21.15.104:0/3511205524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb144150ca0 con 0x7fb144070c70 2024-05-08T04:22:28.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.040+0000 7fb139ffb640 1 -- 172.21.15.104:0/3511205524 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fb14000bc20 con 0x7fb144070c70 2024-05-08T04:22:28.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.041+0000 7fb139ffb640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb12806b680 0x7fb12806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.041+0000 7fb148cfe640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb12806b680 0x7fb12806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.041+0000 7fb139ffb640 1 -- 172.21.15.104:0/3511205524 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb14008a9e0 con 0x7fb144070c70 2024-05-08T04:22:28.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.041+0000 7fb148cfe640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb12806b680 0x7fb12806db40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb134006fd0 tx=0x7fb134008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:28.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.045+0000 7fb139ffb640 1 -- 172.21.15.104:0/3511205524 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb144150ca0 con 0x7fb144070c70 2024-05-08T04:22:28.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.216+0000 7fb14b763640 1 -- 172.21.15.104:0/3511205524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb144075010 con 0x7fb144070c70 2024-05-08T04:22:28.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.217+0000 7fb139ffb640 1 -- 172.21.15.104:0/3511205524 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1400595d0 con 0x7fb144070c70 2024-05-08T04:22:28.218 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:22:28.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.219+0000 7fb14b763640 1 -- 172.21.15.104:0/3511205524 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb12806b680 msgr2=0x7fb12806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.219+0000 7fb14b763640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb12806b680 0x7fb12806db40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb134006fd0 tx=0x7fb134008040 comp rx=0 tx=0).stop 2024-05-08T04:22:28.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.219+0000 7fb14b763640 1 -- 172.21.15.104:0/3511205524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144070c70 msgr2=0x7fb14414e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.219+0000 7fb14b763640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144070c70 0x7fb14414e4a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb14000d800 tx=0x7fb14000dcc0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.219+0000 7fb14b763640 1 -- 172.21.15.104:0/3511205524 shutdown_connections 2024-05-08T04:22:28.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.219+0000 7fb14b763640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb12806b680 0x7fb12806db40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.219+0000 7fb14b763640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb144157ac0 0x7fb144158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.219+0000 7fb14b763640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb14415edf0 0x7fb144155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.219+0000 7fb14b763640 1 --2- 172.21.15.104:0/3511205524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb144070c70 0x7fb14414e4a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.219+0000 7fb14b763640 1 -- 172.21.15.104:0/3511205524 >> 172.21.15.104:0/3511205524 conn(0x7fb1440b3450 msgr2=0x7fb14415c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:28.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.219+0000 7fb14b763640 1 -- 172.21.15.104:0/3511205524 shutdown_connections 2024-05-08T04:22:28.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.219+0000 7fb14b763640 1 -- 172.21.15.104:0/3511205524 wait complete. 2024-05-08T04:22:28.231 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:22:28.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.330+0000 7f2b8ac8f640 1 Processor -- start 2024-05-08T04:22:28.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.330+0000 7f2b8ac8f640 1 -- start start 2024-05-08T04:22:28.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.331+0000 7f2b8ac8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b8415bca0 0x7f2b840ada00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.331+0000 7f2b8ac8f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2b84072810 0x7f2b8415c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.331+0000 7f2b8ac8f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8406f4f0 con 0x7f2b84160010 2024-05-08T04:22:28.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.331+0000 7f2b8ac8f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8406f7b0 con 0x7f2b84072810 2024-05-08T04:22:28.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.331+0000 7f2b8ac8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b840af570 con 0x7f2b8415bca0 2024-05-08T04:22:28.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.331+0000 7f2b7bfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2b84072810 0x7f2b8415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.331+0000 7f2b88a2b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b8415bca0 0x7f2b840ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.331+0000 7f2b8922c640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f2b84160010 0x7f2b840acdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:58186/0 (socket says 172.21.15.104:58186) 2024-05-08T04:22:28.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.331+0000 7f2b8922c640 1 -- 172.21.15.104:0/2589311070 learned_addr learned my addr 172.21.15.104:0/2589311070 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:28.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.332+0000 7f2b7bfff640 1 -- 172.21.15.104:0/2589311070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b8415bca0 msgr2=0x7f2b840ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:28.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.332+0000 7f2b7bfff640 1 --2- 172.21.15.104:0/2589311070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b8415bca0 0x7f2b840ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.332+0000 7f2b7bfff640 1 -- 172.21.15.104:0/2589311070 >> v1:172.21.15.183:6789/0 conn(0x7f2b84160010 legacy=0x7f2b840acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.332+0000 7f2b7bfff640 1 -- 172.21.15.104:0/2589311070 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b840af240 con 0x7f2b84072810 2024-05-08T04:22:28.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.332+0000 7f2b7b7fe640 1 -- 172.21.15.104:0/2589311070 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921366702 0 0) 0x7f2b8406f4f0 con 0x7f2b84160010 2024-05-08T04:22:28.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.332+0000 7f2b7bfff640 1 --2- 172.21.15.104:0/2589311070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b84072810 0x7f2b8415c080 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2b740097a0 tx=0x7f2b7402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0fc4ff2a5dae5eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:28.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.333+0000 7f2b7b7fe640 1 -- 172.21.15.104:0/2589311070 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74037070 con 0x7f2b84072810 2024-05-08T04:22:28.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.333+0000 7f2b7b7fe640 1 -- 172.21.15.104:0/2589311070 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7402ae50 con 0x7f2b84072810 2024-05-08T04:22:28.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.333+0000 7f2b7b7fe640 1 -- 172.21.15.104:0/2589311070 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74032660 con 0x7f2b84072810 2024-05-08T04:22:28.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.333+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2589311070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b84072810 msgr2=0x7f2b8415c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.333+0000 7f2b8ac8f640 1 --2- 172.21.15.104:0/2589311070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b84072810 0x7f2b8415c080 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2b740097a0 tx=0x7f2b7402a100 comp rx=0 tx=0).stop 2024-05-08T04:22:28.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.333+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2589311070 shutdown_connections 2024-05-08T04:22:28.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.333+0000 7f2b8ac8f640 1 --2- 172.21.15.104:0/2589311070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b84072810 0x7f2b8415c080 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.333+0000 7f2b8ac8f640 1 --2- 172.21.15.104:0/2589311070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b8415bca0 0x7f2b840ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.333+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2589311070 >> 172.21.15.104:0/2589311070 conn(0x7f2b84071a10 msgr2=0x7f2b84071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:28.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.333+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2589311070 shutdown_connections 2024-05-08T04:22:28.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.333+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2589311070 wait complete. 2024-05-08T04:22:28.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.334+0000 7f2b8ac8f640 1 Processor -- start 2024-05-08T04:22:28.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.334+0000 7f2b8ac8f640 1 -- start start 2024-05-08T04:22:28.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.335+0000 7f2b8ac8f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b84072810 0x7f2b84151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.335+0000 7f2b8ac8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b8415bca0 0x7f2b841469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.335+0000 7f2b8ac8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b84160010 0x7f2b8415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.335+0000 7f2b8ac8f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b840ad500 con 0x7f2b84072810 2024-05-08T04:22:28.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.335+0000 7f2b8ac8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b840af850 con 0x7f2b8415bca0 2024-05-08T04:22:28.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.335+0000 7f2b8ac8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8406bb70 con 0x7f2b84160010 2024-05-08T04:22:28.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.335+0000 7f2b88a2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b84072810 0x7f2b84151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.335+0000 7f2b88a2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b84072810 0x7f2b84151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37636/0 (socket says 172.21.15.104:37636) 2024-05-08T04:22:28.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.335+0000 7f2b88a2b640 1 -- 172.21.15.104:0/2145030566 learned_addr learned my addr 172.21.15.104:0/2145030566 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:28.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b8922c640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b84160010 0x7f2b8415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b7bfff640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b8415bca0 0x7f2b841469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b88a2b640 1 -- 172.21.15.104:0/2145030566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b84160010 msgr2=0x7f2b8415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b88a2b640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b84160010 0x7f2b8415d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b88a2b640 1 -- 172.21.15.104:0/2145030566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b8415bca0 msgr2=0x7f2b841469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b88a2b640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b8415bca0 0x7f2b841469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b88a2b640 1 -- 172.21.15.104:0/2145030566 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8415e340 con 0x7f2b84072810 2024-05-08T04:22:28.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b8922c640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b84160010 0x7f2b8415d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:28.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b7bfff640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b8415bca0 0x7f2b841469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:28.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b88a2b640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b84072810 0x7f2b84151840 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000e9e0 tx=0x7f2b8000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:28.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b797fa640 1 -- 172.21.15.104:0/2145030566 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80017070 con 0x7f2b84072810 2024-05-08T04:22:28.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b797fa640 1 -- 172.21.15.104:0/2145030566 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8000c9d0 con 0x7f2b84072810 2024-05-08T04:22:28.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2145030566 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8415e620 con 0x7f2b84072810 2024-05-08T04:22:28.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b797fa640 1 -- 172.21.15.104:0/2145030566 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000cdc0 con 0x7f2b84072810 2024-05-08T04:22:28.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.336+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2145030566 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b840cc520 con 0x7f2b84072810 2024-05-08T04:22:28.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.337+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2145030566 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b84075010 con 0x7f2b84072810 2024-05-08T04:22:28.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.338+0000 7f2b797fa640 1 -- 172.21.15.104:0/2145030566 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f2b8001a070 con 0x7f2b84072810 2024-05-08T04:22:28.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.338+0000 7f2b797fa640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2b7006b680 0x7f2b7006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.338+0000 7f2b797fa640 1 -- 172.21.15.104:0/2145030566 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b8008a960 con 0x7f2b84072810 2024-05-08T04:22:28.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.338+0000 7f2b7bfff640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2b7006b680 0x7f2b7006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.338+0000 7f2b7bfff640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2b7006b680 0x7f2b7006db40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2b74034000 tx=0x7f2b7402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:28.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.342+0000 7f2b797fa640 1 -- 172.21.15.104:0/2145030566 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2b800594e0 con 0x7f2b84072810 2024-05-08T04:22:28.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.525+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2145030566 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2b840b5380 con 0x7f2b84072810 2024-05-08T04:22:28.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.526+0000 7f2b797fa640 1 -- 172.21.15.104:0/2145030566 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2b80058de0 con 0x7f2b84072810 2024-05-08T04:22:28.527 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:22:28.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.528+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2145030566 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2b7006b680 msgr2=0x7f2b7006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.528+0000 7f2b8ac8f640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2b7006b680 0x7f2b7006db40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2b74034000 tx=0x7f2b7402e000 comp rx=0 tx=0).stop 2024-05-08T04:22:28.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.528+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2145030566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b84072810 msgr2=0x7f2b84151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.528+0000 7f2b8ac8f640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b84072810 0x7f2b84151840 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000e9e0 tx=0x7f2b8000eea0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.528+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2145030566 shutdown_connections 2024-05-08T04:22:28.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.528+0000 7f2b8ac8f640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2b7006b680 0x7f2b7006db40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.528+0000 7f2b8ac8f640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b8415bca0 0x7f2b841469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.528+0000 7f2b8ac8f640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b84160010 0x7f2b8415d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.528+0000 7f2b8ac8f640 1 --2- 172.21.15.104:0/2145030566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b84072810 0x7f2b84151840 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.528+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2145030566 >> 172.21.15.104:0/2145030566 conn(0x7f2b84071a10 msgr2=0x7f2b840b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:28.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.528+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2145030566 shutdown_connections 2024-05-08T04:22:28.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.528+0000 7f2b8ac8f640 1 -- 172.21.15.104:0/2145030566 wait complete. 2024-05-08T04:22:28.542 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi104.front.sepia.ceph.com... 2024-05-08T04:22:28.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:28.543 DEBUG:teuthology.orchestra.run.smithi104:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-08T04:22:28.566 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[50300]: fuse finished with error 0 and tester_r 0 2024-05-08T04:22:28.568 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:22:28.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:28.568 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T04:22:28.662 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:22:28.662 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:22:28.682 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:28.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.801+0000 7f6a76e3f640 1 Processor -- start 2024-05-08T04:22:28.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.801+0000 7f6a76e3f640 1 -- start start 2024-05-08T04:22:28.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.802+0000 7f6a76e3f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a70159ec0 0x7f6a7006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.802+0000 7f6a76e3f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6a7015a2a0 0x7f6a7015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.802+0000 7f6a76e3f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7015dce0 con 0x7f6a7015e780 2024-05-08T04:22:28.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.802+0000 7f6a76e3f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7006eb60 con 0x7f6a7015a2a0 2024-05-08T04:22:28.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.802+0000 7f6a76e3f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7006ee40 con 0x7f6a70159ec0 2024-05-08T04:22:28.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.802+0000 7f6a753dc640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f6a7015e780 0x7f6a70071a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:58188/0 (socket says 172.21.15.104:58188) 2024-05-08T04:22:28.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.802+0000 7f6a753dc640 1 -- 172.21.15.104:0/2991276444 learned_addr learned my addr 172.21.15.104:0/2991276444 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:28.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.802+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319178677 0 0) 0x7f6a7015dce0 con 0x7f6a7015e780 2024-05-08T04:22:28.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a60003520 con 0x7f6a7015e780 2024-05-08T04:22:28.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6ffff640 1 --2- 172.21.15.104:0/2991276444 >> v2:172.21.15.183:3300/0 conn(0x7f6a7015a2a0 0x7f6a7015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a74bdb640 1 --2- 172.21.15.104:0/2991276444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a70159ec0 0x7f6a7006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3679575797 0 0) 0x7f6a60003520 con 0x7f6a7015e780 2024-05-08T04:22:28.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a70159ec0 msgr2=0x7f6a7006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:28.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 --2- 172.21.15.104:0/2991276444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a70159ec0 0x7f6a7006e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 >> v2:172.21.15.183:3300/0 conn(0x7f6a7015a2a0 msgr2=0x7f6a7015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:28.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 --2- 172.21.15.104:0/2991276444 >> v2:172.21.15.183:3300/0 conn(0x7f6a7015a2a0 0x7f6a7015b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7015df80 con 0x7f6a7015e780 2024-05-08T04:22:28.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f6a68001a10 con 0x7f6a7015e780 2024-05-08T04:22:28.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 >> v1:172.21.15.183:6789/0 conn(0x7f6a7015e780 legacy=0x7f6a70071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 --2- 172.21.15.104:0/2991276444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a70159ec0 0x7f6a600039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 --2- 172.21.15.104:0/2991276444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a60003fe0 0x7f6a60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 --2- 172.21.15.104:0/2991276444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a60004d40 0x7f6a600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7006eb60 con 0x7f6a60004d40 2024-05-08T04:22:28.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7006ee40 con 0x7f6a60003fe0 2024-05-08T04:22:28.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6000bac0 con 0x7f6a70159ec0 2024-05-08T04:22:28.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a753dc640 1 --2- 172.21.15.104:0/2991276444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a60004d40 0x7f6a600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a6ffff640 1 --2- 172.21.15.104:0/2991276444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a60003fe0 0x7f6a60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a753dc640 1 -- 172.21.15.104:0/2991276444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a70159ec0 msgr2=0x7f6a600039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:28.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a753dc640 1 --2- 172.21.15.104:0/2991276444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a70159ec0 0x7f6a600039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a753dc640 1 -- 172.21.15.104:0/2991276444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a60003fe0 msgr2=0x7f6a60004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:28.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a753dc640 1 --2- 172.21.15.104:0/2991276444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a60003fe0 0x7f6a60004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.803+0000 7f6a753dc640 1 -- 172.21.15.104:0/2991276444 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a60003520 con 0x7f6a60004d40 2024-05-08T04:22:28.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.804+0000 7f6a753dc640 1 --2- 172.21.15.104:0/2991276444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a60004d40 0x7f6a600051c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800a890 tx=0x7f6a60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8adea470133a0a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:28.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.804+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800a4e0 con 0x7f6a60004d40 2024-05-08T04:22:28.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.804+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6802f070 con 0x7f6a60004d40 2024-05-08T04:22:28.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.804+0000 7f6a6f7fe640 1 -- 172.21.15.104:0/2991276444 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6802bce0 con 0x7f6a60004d40 2024-05-08T04:22:28.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.805+0000 7f6a76e3f640 1 -- 172.21.15.104:0/2991276444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a60004d40 msgr2=0x7f6a600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.805+0000 7f6a76e3f640 1 --2- 172.21.15.104:0/2991276444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a60004d40 0x7f6a600051c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800a890 tx=0x7f6a60005830 comp rx=0 tx=0).stop 2024-05-08T04:22:28.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.805+0000 7f6a753dc640 1 -- 172.21.15.104:0/2991276444 reap_dead start 2024-05-08T04:22:28.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.805+0000 7f6a76e3f640 1 -- 172.21.15.104:0/2991276444 shutdown_connections 2024-05-08T04:22:28.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.805+0000 7f6a76e3f640 1 -- 172.21.15.104:0/2991276444 >> 172.21.15.104:0/2991276444 conn(0x7f6a700b13f0 msgr2=0x7f6a700b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:28.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.805+0000 7f6a76e3f640 1 -- 172.21.15.104:0/2991276444 shutdown_connections 2024-05-08T04:22:28.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.805+0000 7f6a76e3f640 1 -- 172.21.15.104:0/2991276444 wait complete. 2024-05-08T04:22:28.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.806+0000 7f6a76e3f640 1 Processor -- start 2024-05-08T04:22:28.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.806+0000 7f6a76e3f640 1 -- start start 2024-05-08T04:22:28.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a76e3f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a60004d40 0x7f6a70145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a76e3f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a700cfb50 0x7f6a700b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a76e3f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a700b3d10 0x7f6a700cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a76e3f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a70072160 con 0x7f6a60004d40 2024-05-08T04:22:28.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a76e3f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7015ec10 con 0x7f6a700b3d10 2024-05-08T04:22:28.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a76e3f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700722e0 con 0x7f6a700cfb50 2024-05-08T04:22:28.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a74bdb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a60004d40 0x7f6a70145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a74bdb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a60004d40 0x7f6a70145470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37658/0 (socket says 172.21.15.104:37658) 2024-05-08T04:22:28.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a74bdb640 1 -- 172.21.15.104:0/27424359 learned_addr learned my addr 172.21.15.104:0/27424359 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:28.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a6ffff640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a700cfb50 0x7f6a700b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a74bdb640 1 -- 172.21.15.104:0/27424359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a700cfb50 msgr2=0x7f6a700b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a74bdb640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a700cfb50 0x7f6a700b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a74bdb640 1 -- 172.21.15.104:0/27424359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a700b3d10 msgr2=0x7f6a700cdd50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T04:22:28.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a74bdb640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a700b3d10 0x7f6a700cdd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a74bdb640 1 -- 172.21.15.104:0/27424359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700ceab0 con 0x7f6a60004d40 2024-05-08T04:22:28.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a6ffff640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a700cfb50 0x7f6a700b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:28.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.807+0000 7f6a74bdb640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a60004d40 0x7f6a70145470 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400d830 tx=0x7f6a6400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:28.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.808+0000 7f6a6d7fa640 1 -- 172.21.15.104:0/27424359 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64018020 con 0x7f6a60004d40 2024-05-08T04:22:28.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.808+0000 7f6a6d7fa640 1 -- 172.21.15.104:0/27424359 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6400b640 con 0x7f6a60004d40 2024-05-08T04:22:28.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.808+0000 7f6a76e3f640 1 -- 172.21.15.104:0/27424359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a700ced90 con 0x7f6a60004d40 2024-05-08T04:22:28.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.808+0000 7f6a6d7fa640 1 -- 172.21.15.104:0/27424359 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6400ba10 con 0x7f6a60004d40 2024-05-08T04:22:28.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.808+0000 7f6a76e3f640 1 -- 172.21.15.104:0/27424359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a700cf350 con 0x7f6a60004d40 2024-05-08T04:22:28.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.808+0000 7f6a76e3f640 1 -- 172.21.15.104:0/27424359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7006fbd0 con 0x7f6a60004d40 2024-05-08T04:22:28.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.809+0000 7f6a6d7fa640 1 -- 172.21.15.104:0/27424359 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f6a6401b020 con 0x7f6a60004d40 2024-05-08T04:22:28.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.809+0000 7f6a6d7fa640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6a5406b6b0 0x7f6a5406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:28.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.810+0000 7f6a6d7fa640 1 -- 172.21.15.104:0/27424359 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a6408a690 con 0x7f6a60004d40 2024-05-08T04:22:28.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.810+0000 7f6a6ffff640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6a5406b6b0 0x7f6a5406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:28.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.810+0000 7f6a6ffff640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6a5406b6b0 0x7f6a5406db70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6a701f4cf0 tx=0x7f6a5c00c320 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:28.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.814+0000 7f6a6d7fa640 1 -- 172.21.15.104:0/27424359 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a7006fbd0 con 0x7f6a60004d40 2024-05-08T04:22:28.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.986+0000 7f6a76e3f640 1 -- 172.21.15.104:0/27424359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a70075010 con 0x7f6a60004d40 2024-05-08T04:22:28.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.987+0000 7f6a6d7fa640 1 -- 172.21.15.104:0/27424359 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f6a64022030 con 0x7f6a60004d40 2024-05-08T04:22:28.989 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:28.989 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":33,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:09.602236+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:05.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:06.917080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:28.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.990+0000 7f6a76e3f640 1 -- 172.21.15.104:0/27424359 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6a5406b6b0 msgr2=0x7f6a5406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.990+0000 7f6a76e3f640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6a5406b6b0 0x7f6a5406db70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6a701f4cf0 tx=0x7f6a5c00c320 comp rx=0 tx=0).stop 2024-05-08T04:22:28.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.990+0000 7f6a76e3f640 1 -- 172.21.15.104:0/27424359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a60004d40 msgr2=0x7f6a70145470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:28.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.990+0000 7f6a76e3f640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a60004d40 0x7f6a70145470 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400d830 tx=0x7f6a6400dcf0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.990+0000 7f6a76e3f640 1 -- 172.21.15.104:0/27424359 shutdown_connections 2024-05-08T04:22:28.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.990+0000 7f6a76e3f640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6a5406b6b0 0x7f6a5406db70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.990+0000 7f6a76e3f640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a700b3d10 0x7f6a700cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.990+0000 7f6a76e3f640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a700cfb50 0x7f6a700b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.990+0000 7f6a76e3f640 1 --2- 172.21.15.104:0/27424359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6a60004d40 0x7f6a70145470 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:28.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.990+0000 7f6a76e3f640 1 -- 172.21.15.104:0/27424359 >> 172.21.15.104:0/27424359 conn(0x7f6a700b13f0 msgr2=0x7f6a70155610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:28.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.990+0000 7f6a76e3f640 1 -- 172.21.15.104:0/27424359 shutdown_connections 2024-05-08T04:22:28.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:28.990+0000 7f6a76e3f640 1 -- 172.21.15.104:0/27424359 wait complete. 2024-05-08T04:22:29.002 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:22:05.786250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:22:06.917080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:22:29.003 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:22:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.104+0000 7fbe44a88640 1 Processor -- start 2024-05-08T04:22:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.104+0000 7fbe44a88640 1 -- start start 2024-05-08T04:22:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe44a88640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbe400ceee0 0x7fbe400b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe44a88640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbe4006e330 0x7fbe4006e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe44a88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe400b3ff0 0x7fbe400b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe44a88640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4015f390 con 0x7fbe4006e330 2024-05-08T04:22:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe44a88640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe400b49c0 con 0x7fbe400ceee0 2024-05-08T04:22:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe44a88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4015e780 con 0x7fbe400b3ff0 2024-05-08T04:22:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe3dd9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbe4006e330 0x7fbe4006e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe3dd9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbe4006e330 0x7fbe4006e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37672/0 (socket says 172.21.15.104:37672) 2024-05-08T04:22:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe3dd9b640 1 -- 172.21.15.104:0/2818931473 learned_addr learned my addr 172.21.15.104:0/2818931473 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe3ed9d640 1 --2- 172.21.15.104:0/2818931473 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe400b3ff0 0x7fbe400b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe3e59c640 1 --2- 172.21.15.104:0/2818931473 >> v2:172.21.15.183:3300/0 conn(0x7fbe400ceee0 0x7fbe400b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe3dd9b640 1 -- 172.21.15.104:0/2818931473 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe400b3ff0 msgr2=0x7fbe400b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:29.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe3dd9b640 1 --2- 172.21.15.104:0/2818931473 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe400b3ff0 0x7fbe400b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe3dd9b640 1 -- 172.21.15.104:0/2818931473 >> v2:172.21.15.183:3300/0 conn(0x7fbe400ceee0 msgr2=0x7fbe400b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:29.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe3dd9b640 1 --2- 172.21.15.104:0/2818931473 >> v2:172.21.15.183:3300/0 conn(0x7fbe400ceee0 0x7fbe400b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.105+0000 7fbe3dd9b640 1 -- 172.21.15.104:0/2818931473 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4015ea60 con 0x7fbe4006e330 2024-05-08T04:22:29.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.106+0000 7fbe3dd9b640 1 --2- 172.21.15.104:0/2818931473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe4006e330 0x7fbe4006e7e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbe40072a60 tx=0x7fbe3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc43a9204b30afb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:29.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.106+0000 7fbe3d59a640 1 -- 172.21.15.104:0/2818931473 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30037070 con 0x7fbe4006e330 2024-05-08T04:22:29.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.106+0000 7fbe3d59a640 1 -- 172.21.15.104:0/2818931473 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe30032440 con 0x7fbe4006e330 2024-05-08T04:22:29.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.106+0000 7fbe3d59a640 1 -- 172.21.15.104:0/2818931473 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30032810 con 0x7fbe4006e330 2024-05-08T04:22:29.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.106+0000 7fbe44a88640 1 -- 172.21.15.104:0/2818931473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe4006e330 msgr2=0x7fbe4006e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.106+0000 7fbe44a88640 1 --2- 172.21.15.104:0/2818931473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe4006e330 0x7fbe4006e7e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbe40072a60 tx=0x7fbe3002a1e0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.106+0000 7fbe44a88640 1 -- 172.21.15.104:0/2818931473 shutdown_connections 2024-05-08T04:22:29.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.107+0000 7fbe44a88640 1 --2- 172.21.15.104:0/2818931473 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe400b3ff0 0x7fbe400b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.107+0000 7fbe44a88640 1 --2- 172.21.15.104:0/2818931473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe4006e330 0x7fbe4006e7e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.107+0000 7fbe44a88640 1 --2- 172.21.15.104:0/2818931473 >> v2:172.21.15.183:3300/0 conn(0x7fbe400ceee0 0x7fbe400b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.107+0000 7fbe44a88640 1 -- 172.21.15.104:0/2818931473 >> 172.21.15.104:0/2818931473 conn(0x7fbe400b13f0 msgr2=0x7fbe400b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:29.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.107+0000 7fbe44a88640 1 -- 172.21.15.104:0/2818931473 shutdown_connections 2024-05-08T04:22:29.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.107+0000 7fbe44a88640 1 -- 172.21.15.104:0/2818931473 wait complete. 2024-05-08T04:22:29.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.108+0000 7fbe44a88640 1 Processor -- start 2024-05-08T04:22:29.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.108+0000 7fbe44a88640 1 -- start start 2024-05-08T04:22:29.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe44a88640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe4006e330 0x7fbe4014dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe44a88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe400b3ff0 0x7fbe401527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe44a88640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe400ceee0 0x7fbe4014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe44a88640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe400cf2c0 con 0x7fbe400ceee0 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe44a88640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4015f020 con 0x7fbe4006e330 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe44a88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe400cf440 con 0x7fbe400b3ff0 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe3ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe400ceee0 0x7fbe4014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe3ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe400ceee0 0x7fbe4014e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37684/0 (socket says 172.21.15.104:37684) 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe3ed9d640 1 -- 172.21.15.104:0/2703450887 learned_addr learned my addr 172.21.15.104:0/2703450887 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe3dd9b640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe400b3ff0 0x7fbe401527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe3e59c640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe4006e330 0x7fbe4014dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe3ed9d640 1 -- 172.21.15.104:0/2703450887 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe400b3ff0 msgr2=0x7fbe401527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe3ed9d640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe400b3ff0 0x7fbe401527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe3ed9d640 1 -- 172.21.15.104:0/2703450887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe4006e330 msgr2=0x7fbe4014dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe3ed9d640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe4006e330 0x7fbe4014dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe3ed9d640 1 -- 172.21.15.104:0/2703450887 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe40152ce0 con 0x7fbe400ceee0 2024-05-08T04:22:29.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe3ed9d640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe400ceee0 0x7fbe4014e8e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbe38007e60 tx=0x7fbe3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:29.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe36ffd640 1 -- 172.21.15.104:0/2703450887 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38014620 con 0x7fbe400ceee0 2024-05-08T04:22:29.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe36ffd640 1 -- 172.21.15.104:0/2703450887 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe38019070 con 0x7fbe400ceee0 2024-05-08T04:22:29.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe44a88640 1 -- 172.21.15.104:0/2703450887 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe40155d60 con 0x7fbe400ceee0 2024-05-08T04:22:29.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe36ffd640 1 -- 172.21.15.104:0/2703450887 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38014a20 con 0x7fbe400ceee0 2024-05-08T04:22:29.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.109+0000 7fbe44a88640 1 -- 172.21.15.104:0/2703450887 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe40156320 con 0x7fbe400ceee0 2024-05-08T04:22:29.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.110+0000 7fbe44a88640 1 -- 172.21.15.104:0/2703450887 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe40075010 con 0x7fbe400ceee0 2024-05-08T04:22:29.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.111+0000 7fbe36ffd640 1 -- 172.21.15.104:0/2703450887 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fbe38014bc0 con 0x7fbe400ceee0 2024-05-08T04:22:29.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.111+0000 7fbe36ffd640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbe2006b680 0x7fbe2006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.111+0000 7fbe36ffd640 1 -- 172.21.15.104:0/2703450887 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe3808ae60 con 0x7fbe400ceee0 2024-05-08T04:22:29.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.111+0000 7fbe3e59c640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbe2006b680 0x7fbe2006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.112+0000 7fbe3e59c640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbe2006b680 0x7fbe2006db40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbe28006fd0 tx=0x7fbe28008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:29.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.115+0000 7fbe36ffd640 1 -- 172.21.15.104:0/2703450887 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbe380599d0 con 0x7fbe400ceee0 2024-05-08T04:22:29.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.284+0000 7fbe44a88640 1 -- 172.21.15.104:0/2703450887 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe400b11d0 con 0x7fbe400ceee0 2024-05-08T04:22:29.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.284+0000 7fbe36ffd640 1 -- 172.21.15.104:0/2703450887 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe380592d0 con 0x7fbe400ceee0 2024-05-08T04:22:29.286 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:22:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.286+0000 7fbe44a88640 1 -- 172.21.15.104:0/2703450887 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbe2006b680 msgr2=0x7fbe2006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.286+0000 7fbe44a88640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbe2006b680 0x7fbe2006db40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbe28006fd0 tx=0x7fbe28008040 comp rx=0 tx=0).stop 2024-05-08T04:22:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.286+0000 7fbe44a88640 1 -- 172.21.15.104:0/2703450887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe400ceee0 msgr2=0x7fbe4014e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.286+0000 7fbe44a88640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe400ceee0 0x7fbe4014e8e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbe38007e60 tx=0x7fbe3800e4b0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.286+0000 7fbe44a88640 1 -- 172.21.15.104:0/2703450887 shutdown_connections 2024-05-08T04:22:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.286+0000 7fbe44a88640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbe2006b680 0x7fbe2006db40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.286+0000 7fbe44a88640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe400ceee0 0x7fbe4014e8e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.286+0000 7fbe44a88640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe400b3ff0 0x7fbe401527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.286+0000 7fbe44a88640 1 --2- 172.21.15.104:0/2703450887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe4006e330 0x7fbe4014dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.286+0000 7fbe44a88640 1 -- 172.21.15.104:0/2703450887 >> 172.21.15.104:0/2703450887 conn(0x7fbe400b13f0 msgr2=0x7fbe40153470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.286+0000 7fbe44a88640 1 -- 172.21.15.104:0/2703450887 shutdown_connections 2024-05-08T04:22:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.286+0000 7fbe44a88640 1 -- 172.21.15.104:0/2703450887 wait complete. 2024-05-08T04:22:29.299 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:22:29.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.401+0000 7f9ec5a5d640 1 Processor -- start 2024-05-08T04:22:29.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.401+0000 7f9ec5a5d640 1 -- start start 2024-05-08T04:22:29.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.401+0000 7f9ec5a5d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec0162150 0x7f9ec00d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.401+0000 7f9ec5a5d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9ec00cee50 0x7f9ec00b8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.401+0000 7f9ec5a5d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec00b5540 con 0x7f9ec0161780 2024-05-08T04:22:29.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.401+0000 7f9ec5a5d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec00b57e0 con 0x7f9ec00cee50 2024-05-08T04:22:29.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.401+0000 7f9ec5a5d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00b5ac0 con 0x7f9ec0162150 2024-05-08T04:22:29.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.402+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec0162150 0x7f9ec00d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.402+0000 7f9ebf7fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9ec00cee50 0x7f9ec00b8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.402+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec0162150 0x7f9ec00d2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:39710/0 (socket says 172.21.15.104:39710) 2024-05-08T04:22:29.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.402+0000 7f9ebeffd640 1 -- 172.21.15.104:0/101883390 learned_addr learned my addr 172.21.15.104:0/101883390 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:29.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.402+0000 7f9ebe7fc640 1 --1- 172.21.15.104:0/101883390 >> v1:172.21.15.183:6789/0 conn(0x7f9ec0161780 0x7f9ec00ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:58196/0 (socket says 172.21.15.104:58196) 2024-05-08T04:22:29.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.402+0000 7f9ebeffd640 1 -- 172.21.15.104:0/101883390 >> v2:172.21.15.183:3300/0 conn(0x7f9ec00cee50 msgr2=0x7f9ec00b8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:29.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.402+0000 7f9ebeffd640 1 --2- 172.21.15.104:0/101883390 >> v2:172.21.15.183:3300/0 conn(0x7f9ec00cee50 0x7f9ec00b8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.402+0000 7f9ebeffd640 1 -- 172.21.15.104:0/101883390 >> v1:172.21.15.183:6789/0 conn(0x7f9ec0161780 legacy=0x7f9ec00ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.402+0000 7f9ebeffd640 1 -- 172.21.15.104:0/101883390 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00b5da0 con 0x7f9ec0162150 2024-05-08T04:22:29.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.403+0000 7f9ebeffd640 1 --2- 172.21.15.104:0/101883390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec0162150 0x7f9ec00d2c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009e50 tx=0x7f9eb002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33c92168e43d1bc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:29.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.403+0000 7f9ebdffb640 1 -- 172.21.15.104:0/101883390 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0036070 con 0x7f9ec0162150 2024-05-08T04:22:29.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.403+0000 7f9ebdffb640 1 -- 172.21.15.104:0/101883390 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb0031600 con 0x7f9ec0162150 2024-05-08T04:22:29.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.403+0000 7f9ebdffb640 1 -- 172.21.15.104:0/101883390 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00319d0 con 0x7f9ec0162150 2024-05-08T04:22:29.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.404+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/101883390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec0162150 msgr2=0x7f9ec00d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.404+0000 7f9ec5a5d640 1 --2- 172.21.15.104:0/101883390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec0162150 0x7f9ec00d2c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009e50 tx=0x7f9eb002a680 comp rx=0 tx=0).stop 2024-05-08T04:22:29.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.404+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/101883390 shutdown_connections 2024-05-08T04:22:29.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.404+0000 7f9ec5a5d640 1 --2- 172.21.15.104:0/101883390 >> v2:172.21.15.183:3300/0 conn(0x7f9ec00cee50 0x7f9ec00b8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.404+0000 7f9ec5a5d640 1 --2- 172.21.15.104:0/101883390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec0162150 0x7f9ec00d2c70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.404+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/101883390 >> 172.21.15.104:0/101883390 conn(0x7f9ec006c330 msgr2=0x7f9ec006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:29.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.404+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/101883390 shutdown_connections 2024-05-08T04:22:29.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.404+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/101883390 wait complete. 2024-05-08T04:22:29.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.405+0000 7f9ec5a5d640 1 Processor -- start 2024-05-08T04:22:29.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.405+0000 7f9ec5a5d640 1 -- start start 2024-05-08T04:22:29.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.405+0000 7f9ec5a5d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec00cee50 0x7f9ec00c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ec5a5d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ec0161780 0x7f9ec00c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ec5a5d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ec0162150 0x7f9ec0159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ec5a5d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec01626b0 con 0x7f9ec0162150 2024-05-08T04:22:29.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ec5a5d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0162530 con 0x7f9ec0161780 2024-05-08T04:22:29.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ec5a5d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00d4010 con 0x7f9ec00cee50 2024-05-08T04:22:29.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ec0162150 0x7f9ec0159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ec0162150 0x7f9ec0159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37696/0 (socket says 172.21.15.104:37696) 2024-05-08T04:22:29.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ebf7fe640 1 -- 172.21.15.104:0/2038489451 learned_addr learned my addr 172.21.15.104:0/2038489451 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:29.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ebf7fe640 1 -- 172.21.15.104:0/2038489451 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec00cee50 msgr2=0x7f9ec00c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ebf7fe640 1 --2- 172.21.15.104:0/2038489451 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec00cee50 0x7f9ec00c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ebf7fe640 1 -- 172.21.15.104:0/2038489451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ec0161780 msgr2=0x7f9ec00c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ebf7fe640 1 --2- 172.21.15.104:0/2038489451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ec0161780 0x7f9ec00c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ebf7fe640 1 -- 172.21.15.104:0/2038489451 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00c7a90 con 0x7f9ec0162150 2024-05-08T04:22:29.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ebf7fe640 1 --2- 172.21.15.104:0/2038489451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ec0162150 0x7f9ec0159ba0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8004650 tx=0x7f9eb800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:29.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9eb7fff640 1 -- 172.21.15.104:0/2038489451 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8017070 con 0x7f9ec0162150 2024-05-08T04:22:29.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9eb7fff640 1 -- 172.21.15.104:0/2038489451 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb800c940 con 0x7f9ec0162150 2024-05-08T04:22:29.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9eb7fff640 1 -- 172.21.15.104:0/2038489451 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800cd30 con 0x7f9ec0162150 2024-05-08T04:22:29.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/2038489451 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec00c7d60 con 0x7f9ec0162150 2024-05-08T04:22:29.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.406+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/2038489451 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec00c8320 con 0x7f9ec0162150 2024-05-08T04:22:29.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.407+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/2038489451 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec0075010 con 0x7f9ec0162150 2024-05-08T04:22:29.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.408+0000 7f9eb7fff640 1 -- 172.21.15.104:0/2038489451 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f9eb801a070 con 0x7f9ec0162150 2024-05-08T04:22:29.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.408+0000 7f9eb7fff640 1 --2- 172.21.15.104:0/2038489451 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9ea006b680 0x7f9ea006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.409+0000 7f9ebeffd640 1 --2- 172.21.15.104:0/2038489451 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9ea006b680 0x7f9ea006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.409+0000 7f9eb7fff640 1 -- 172.21.15.104:0/2038489451 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9eb808a4d0 con 0x7f9ec0162150 2024-05-08T04:22:29.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.409+0000 7f9ebeffd640 1 --2- 172.21.15.104:0/2038489451 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9ea006b680 0x7f9ea006db40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0033000 tx=0x7f9eb002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:29.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.413+0000 7f9eb7fff640 1 -- 172.21.15.104:0/2038489451 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9eb80590c0 con 0x7f9ec0162150 2024-05-08T04:22:29.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.581+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/2038489451 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ec00d1810 con 0x7f9ec0162150 2024-05-08T04:22:29.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.581+0000 7f9eb7fff640 1 -- 172.21.15.104:0/2038489451 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9eb80589c0 con 0x7f9ec0162150 2024-05-08T04:22:29.583 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:22:29.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.583+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/2038489451 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9ea006b680 msgr2=0x7f9ea006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.583+0000 7f9ec5a5d640 1 --2- 172.21.15.104:0/2038489451 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9ea006b680 0x7f9ea006db40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0033000 tx=0x7f9eb002e000 comp rx=0 tx=0).stop 2024-05-08T04:22:29.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.583+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/2038489451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ec0162150 msgr2=0x7f9ec0159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.583+0000 7f9ec5a5d640 1 --2- 172.21.15.104:0/2038489451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ec0162150 0x7f9ec0159ba0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8004650 tx=0x7f9eb800ece0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.583+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/2038489451 shutdown_connections 2024-05-08T04:22:29.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.583+0000 7f9ec5a5d640 1 --2- 172.21.15.104:0/2038489451 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9ea006b680 0x7f9ea006db40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.583+0000 7f9ec5a5d640 1 --2- 172.21.15.104:0/2038489451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ec0161780 0x7f9ec00c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.583+0000 7f9ec5a5d640 1 --2- 172.21.15.104:0/2038489451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ec0162150 0x7f9ec0159ba0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.583+0000 7f9ec5a5d640 1 --2- 172.21.15.104:0/2038489451 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec00cee50 0x7f9ec00c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.583+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/2038489451 >> 172.21.15.104:0/2038489451 conn(0x7f9ec006c330 msgr2=0x7f9ec015afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:29.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.584+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/2038489451 shutdown_connections 2024-05-08T04:22:29.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.584+0000 7f9ec5a5d640 1 -- 172.21.15.104:0/2038489451 wait complete. 2024-05-08T04:22:29.595 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:22:29.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.697+0000 7f91b4530640 1 Processor -- start 2024-05-08T04:22:29.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.697+0000 7f91b4530640 1 -- start start 2024-05-08T04:22:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b4530640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f91ac161190 0x7f91ac072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b4530640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f91ac072a70 0x7f91ac0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b4530640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91ac0ad330 0x7f91ac06bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b4530640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ac0b4db0 con 0x7f91ac072a70 2024-05-08T04:22:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b4530640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ac06de30 con 0x7f91ac161190 2024-05-08T04:22:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b4530640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac06e110 con 0x7f91ac0ad330 2024-05-08T04:22:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b1acb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f91ac072a70 0x7f91ac0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b1acb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f91ac072a70 0x7f91ac0acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37710/0 (socket says 172.21.15.104:37710) 2024-05-08T04:22:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b1acb640 1 -- 172.21.15.104:0/2627482748 learned_addr learned my addr 172.21.15.104:0/2627482748 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b2acd640 1 --2- 172.21.15.104:0/2627482748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91ac0ad330 0x7f91ac06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b1acb640 1 -- 172.21.15.104:0/2627482748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91ac0ad330 msgr2=0x7f91ac06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b1acb640 1 --2- 172.21.15.104:0/2627482748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91ac0ad330 0x7f91ac06bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b1acb640 1 -- 172.21.15.104:0/2627482748 >> v2:172.21.15.183:3300/0 conn(0x7f91ac161190 msgr2=0x7f91ac072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:29.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b22cc640 1 --2- 172.21.15.104:0/2627482748 >> v2:172.21.15.183:3300/0 conn(0x7f91ac161190 0x7f91ac072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b1acb640 1 --2- 172.21.15.104:0/2627482748 >> v2:172.21.15.183:3300/0 conn(0x7f91ac161190 0x7f91ac072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b1acb640 1 -- 172.21.15.104:0/2627482748 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac06e3f0 con 0x7f91ac072a70 2024-05-08T04:22:29.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b2acd640 1 --2- 172.21.15.104:0/2627482748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91ac0ad330 0x7f91ac06bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:29.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.698+0000 7f91b22cc640 1 --2- 172.21.15.104:0/2627482748 >> v2:172.21.15.183:3300/0 conn(0x7f91ac161190 0x7f91ac072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:29.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.699+0000 7f91b1acb640 1 --2- 172.21.15.104:0/2627482748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91ac072a70 0x7f91ac0acdf0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f91ac06faa0 tx=0x7f919c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1775a120f974d041 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:29.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.699+0000 7f91b12ca640 1 -- 172.21.15.104:0/2627482748 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c037070 con 0x7f91ac072a70 2024-05-08T04:22:29.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.699+0000 7f91b12ca640 1 -- 172.21.15.104:0/2627482748 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c032440 con 0x7f91ac072a70 2024-05-08T04:22:29.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.699+0000 7f91b12ca640 1 -- 172.21.15.104:0/2627482748 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c032810 con 0x7f91ac072a70 2024-05-08T04:22:29.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.700+0000 7f91b4530640 1 -- 172.21.15.104:0/2627482748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91ac072a70 msgr2=0x7f91ac0acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.700+0000 7f91b4530640 1 --2- 172.21.15.104:0/2627482748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91ac072a70 0x7f91ac0acdf0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f91ac06faa0 tx=0x7f919c02a140 comp rx=0 tx=0).stop 2024-05-08T04:22:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.700+0000 7f91b4530640 1 -- 172.21.15.104:0/2627482748 shutdown_connections 2024-05-08T04:22:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.700+0000 7f91b4530640 1 --2- 172.21.15.104:0/2627482748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91ac0ad330 0x7f91ac06bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.700+0000 7f91b4530640 1 --2- 172.21.15.104:0/2627482748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91ac072a70 0x7f91ac0acdf0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.700+0000 7f91b4530640 1 --2- 172.21.15.104:0/2627482748 >> v2:172.21.15.183:3300/0 conn(0x7f91ac161190 0x7f91ac072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.700+0000 7f91b4530640 1 -- 172.21.15.104:0/2627482748 >> 172.21.15.104:0/2627482748 conn(0x7f91ac071a10 msgr2=0x7f91ac071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.700+0000 7f91b4530640 1 -- 172.21.15.104:0/2627482748 shutdown_connections 2024-05-08T04:22:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.700+0000 7f91b4530640 1 -- 172.21.15.104:0/2627482748 wait complete. 2024-05-08T04:22:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.701+0000 7f91b4530640 1 Processor -- start 2024-05-08T04:22:29.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.701+0000 7f91b4530640 1 -- start start 2024-05-08T04:22:29.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b4530640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91ac0ad330 0x7f91ac14d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b4530640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91ac161190 0x7f91ac15f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b4530640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91ac158690 0x7f91ac1517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b4530640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac06da70 con 0x7f91ac0ad330 2024-05-08T04:22:29.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b4530640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac06e9b0 con 0x7f91ac158690 2024-05-08T04:22:29.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b4530640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac06dbf0 con 0x7f91ac161190 2024-05-08T04:22:29.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b22cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91ac0ad330 0x7f91ac14d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b22cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91ac0ad330 0x7f91ac14d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37720/0 (socket says 172.21.15.104:37720) 2024-05-08T04:22:29.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b22cc640 1 -- 172.21.15.104:0/2311155789 learned_addr learned my addr 172.21.15.104:0/2311155789 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b22cc640 1 -- 172.21.15.104:0/2311155789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91ac161190 msgr2=0x7f91ac15f610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T04:22:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b22cc640 1 --2- 172.21.15.104:0/2311155789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91ac161190 0x7f91ac15f610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b22cc640 1 -- 172.21.15.104:0/2311155789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91ac158690 msgr2=0x7f91ac1517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b22cc640 1 --2- 172.21.15.104:0/2311155789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91ac158690 0x7f91ac1517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b22cc640 1 -- 172.21.15.104:0/2311155789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac14d970 con 0x7f91ac0ad330 2024-05-08T04:22:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b22cc640 1 --2- 172.21.15.104:0/2311155789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91ac0ad330 0x7f91ac14d430 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f91a800c7f0 tx=0x7f91a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91a2ffd640 1 -- 172.21.15.104:0/2311155789 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8015070 con 0x7f91ac0ad330 2024-05-08T04:22:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91a2ffd640 1 -- 172.21.15.104:0/2311155789 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a8007820 con 0x7f91ac0ad330 2024-05-08T04:22:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91b4530640 1 -- 172.21.15.104:0/2311155789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac158b90 con 0x7f91ac0ad330 2024-05-08T04:22:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.702+0000 7f91a2ffd640 1 -- 172.21.15.104:0/2311155789 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8007bd0 con 0x7f91ac0ad330 2024-05-08T04:22:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.703+0000 7f91b4530640 1 -- 172.21.15.104:0/2311155789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac159150 con 0x7f91ac0ad330 2024-05-08T04:22:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.704+0000 7f91b4530640 1 -- 172.21.15.104:0/2311155789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ac075010 con 0x7f91ac0ad330 2024-05-08T04:22:29.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.704+0000 7f91a2ffd640 1 -- 172.21.15.104:0/2311155789 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f91a8018070 con 0x7f91ac0ad330 2024-05-08T04:22:29.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.705+0000 7f91a2ffd640 1 --2- 172.21.15.104:0/2311155789 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f919006b6b0 0x7f919006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:29.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.705+0000 7f91a2ffd640 1 -- 172.21.15.104:0/2311155789 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91a808a640 con 0x7f91ac0ad330 2024-05-08T04:22:29.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.705+0000 7f91b1acb640 1 --2- 172.21.15.104:0/2311155789 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f919006b6b0 0x7f919006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:29.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.705+0000 7f91b1acb640 1 --2- 172.21.15.104:0/2311155789 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f919006b6b0 0x7f919006db70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f919c034000 tx=0x7f919c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:29.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.709+0000 7f91a2ffd640 1 -- 172.21.15.104:0/2311155789 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f91a80591c0 con 0x7f91ac0ad330 2024-05-08T04:22:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.879+0000 7f91b4530640 1 -- 172.21.15.104:0/2311155789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91ac159850 con 0x7f91ac0ad330 2024-05-08T04:22:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.879+0000 7f91a2ffd640 1 -- 172.21.15.104:0/2311155789 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91a8058ac0 con 0x7f91ac0ad330 2024-05-08T04:22:29.880 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:22:29.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.881+0000 7f91b4530640 1 -- 172.21.15.104:0/2311155789 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f919006b6b0 msgr2=0x7f919006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.881+0000 7f91b4530640 1 --2- 172.21.15.104:0/2311155789 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f919006b6b0 0x7f919006db70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f919c034000 tx=0x7f919c02e000 comp rx=0 tx=0).stop 2024-05-08T04:22:29.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.881+0000 7f91b4530640 1 -- 172.21.15.104:0/2311155789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91ac0ad330 msgr2=0x7f91ac14d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:29.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.881+0000 7f91b4530640 1 --2- 172.21.15.104:0/2311155789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91ac0ad330 0x7f91ac14d430 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f91a800c7f0 tx=0x7f91a800ccb0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.881+0000 7f91b4530640 1 -- 172.21.15.104:0/2311155789 shutdown_connections 2024-05-08T04:22:29.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.881+0000 7f91b4530640 1 --2- 172.21.15.104:0/2311155789 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f919006b6b0 0x7f919006db70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.881+0000 7f91b4530640 1 --2- 172.21.15.104:0/2311155789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91ac158690 0x7f91ac1517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.881+0000 7f91b4530640 1 --2- 172.21.15.104:0/2311155789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91ac161190 0x7f91ac15f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.881+0000 7f91b4530640 1 --2- 172.21.15.104:0/2311155789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91ac0ad330 0x7f91ac14d430 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:29.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.881+0000 7f91b4530640 1 -- 172.21.15.104:0/2311155789 >> 172.21.15.104:0/2311155789 conn(0x7f91ac071a10 msgr2=0x7f91ac0afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:29.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.881+0000 7f91b4530640 1 -- 172.21.15.104:0/2311155789 shutdown_connections 2024-05-08T04:22:29.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.881+0000 7f91b4530640 1 -- 172.21.15.104:0/2311155789 wait complete. 2024-05-08T04:22:29.893 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:22:29.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.993+0000 7fb59126f640 1 Processor -- start 2024-05-08T04:22:29.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.994+0000 7fb59126f640 1 -- start start 2024-05-08T04:22:30.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.994+0000 7fb59126f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb58c06ab60 0x7fb58c070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.994+0000 7fb59126f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58c0d0450 con 0x7fb58c0cff50 2024-05-08T04:22:30.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.994+0000 7fb59126f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58c072ab0 con 0x7fb58c15de30 2024-05-08T04:22:30.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.994+0000 7fb59126f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58c161630 con 0x7fb58c06ab60 2024-05-08T04:22:30.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.994+0000 7fb58a7fc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb58c0cff50 0x7fb58c06af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46968/0 (socket says 172.21.15.104:46968) 2024-05-08T04:22:30.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb58a7fc640 1 -- 172.21.15.104:0/71391969 learned_addr learned my addr 172.21.15.104:0/71391969 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:30.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb58affd640 1 --2- 172.21.15.104:0/71391969 >> v2:172.21.15.183:3300/0 conn(0x7fb58c06ab60 0x7fb58c070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029654476 0 0) 0x7fb58c0d0450 con 0x7fb58c0cff50 2024-05-08T04:22:30.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb578003520 con 0x7fb58c0cff50 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2940999669 0 0) 0x7fb578003520 con 0x7fb58c0cff50 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 >> v2:172.21.15.183:3300/0 conn(0x7fb58c06ab60 msgr2=0x7fb58c070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 --2- 172.21.15.104:0/71391969 >> v2:172.21.15.183:3300/0 conn(0x7fb58c06ab60 0x7fb58c070820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 >> v1:172.21.15.183:6789/0 conn(0x7fb58c15de30 legacy=0x7fb58c161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c072d90 con 0x7fb58c0cff50 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fb574001670 con 0x7fb58c0cff50 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 >> v1:172.21.15.104:6789/0 conn(0x7fb58c0cff50 legacy=0x7fb58c06af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 --2- 172.21.15.104:0/71391969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5780039b0 0x7fb578003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 --2- 172.21.15.104:0/71391969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb578004800 0x7fb578004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 --2- 172.21.15.104:0/71391969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5780051c0 0x7fb57800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c161630 con 0x7fb5780051c0 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57800c160 con 0x7fb578004800 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57800c360 con 0x7fb5780039b0 2024-05-08T04:22:30.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb58b7fe640 1 --2- 172.21.15.104:0/71391969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5780051c0 0x7fb57800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb58a7fc640 1 --2- 172.21.15.104:0/71391969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb578004800 0x7fb578004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb58affd640 1 --2- 172.21.15.104:0/71391969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5780039b0 0x7fb578003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb58b7fe640 1 -- 172.21.15.104:0/71391969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5780039b0 msgr2=0x7fb578003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb58b7fe640 1 --2- 172.21.15.104:0/71391969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5780039b0 0x7fb578003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb58b7fe640 1 -- 172.21.15.104:0/71391969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb578004800 msgr2=0x7fb578004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb58b7fe640 1 --2- 172.21.15.104:0/71391969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb578004800 0x7fb578004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.995+0000 7fb58b7fe640 1 -- 172.21.15.104:0/71391969 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb578003520 con 0x7fb5780051c0 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.996+0000 7fb58b7fe640 1 -- 172.21.15.104:0/71391969 reap_dead start 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.996+0000 7fb58b7fe640 1 --2- 172.21.15.104:0/71391969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5780051c0 0x7fb57800b9c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb584001750 tx=0x7fb578005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142ab518af0438eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.996+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb584001370 con 0x7fb5780051c0 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.996+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5840052f0 con 0x7fb5780051c0 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.996+0000 7fb589ffb640 1 -- 172.21.15.104:0/71391969 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58402abe0 con 0x7fb5780051c0 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.997+0000 7fb59126f640 1 -- 172.21.15.104:0/71391969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5780051c0 msgr2=0x7fb57800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.997+0000 7fb59126f640 1 --2- 172.21.15.104:0/71391969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5780051c0 0x7fb57800b9c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb584001750 tx=0x7fb578005830 comp rx=0 tx=0).stop 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.997+0000 7fb59126f640 1 -- 172.21.15.104:0/71391969 shutdown_connections 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.997+0000 7fb59126f640 1 --2- 172.21.15.104:0/71391969 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5780051c0 0x7fb57800b9c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.997+0000 7fb59126f640 1 -- 172.21.15.104:0/71391969 >> 172.21.15.104:0/71391969 conn(0x7fb58c0b23e0 msgr2=0x7fb58c0b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.997+0000 7fb59126f640 1 -- 172.21.15.104:0/71391969 shutdown_connections 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.997+0000 7fb59126f640 1 -- 172.21.15.104:0/71391969 wait complete. 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.998+0000 7fb59126f640 1 Processor -- start 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.998+0000 7fb59126f640 1 -- start start 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb59126f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5780051c0 0x7fb58c154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb59126f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb58c150000 0x7fb58c1f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb59126f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb58c150480 0x7fb58c1f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb59126f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c070820 con 0x7fb5780051c0 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb59126f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c070370 con 0x7fb58c150480 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb59126f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c0709a0 con 0x7fb58c150000 2024-05-08T04:22:30.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb58affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5780051c0 0x7fb58c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb58affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5780051c0 0x7fb58c154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37738/0 (socket says 172.21.15.104:37738) 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb58affd640 1 -- 172.21.15.104:0/2490884139 learned_addr learned my addr 172.21.15.104:0/2490884139 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb58a7fc640 1 --2- 172.21.15.104:0/2490884139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb58c150000 0x7fb58c1f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb58affd640 1 -- 172.21.15.104:0/2490884139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb58c150000 msgr2=0x7fb58c1f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb58affd640 1 --2- 172.21.15.104:0/2490884139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb58c150000 0x7fb58c1f3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb58affd640 1 -- 172.21.15.104:0/2490884139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb58c150480 msgr2=0x7fb58c1f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb58affd640 1 --2- 172.21.15.104:0/2490884139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb58c150480 0x7fb58c1f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:29.999+0000 7fb58affd640 1 -- 172.21.15.104:0/2490884139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c154d70 con 0x7fb5780051c0 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.000+0000 7fb58affd640 1 --2- 172.21.15.104:0/2490884139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5780051c0 0x7fb58c154830 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009fb0 tx=0x7fb57c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.000+0000 7fb5837fe640 1 -- 172.21.15.104:0/2490884139 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c01a020 con 0x7fb5780051c0 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.000+0000 7fb5837fe640 1 -- 172.21.15.104:0/2490884139 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c016470 con 0x7fb5780051c0 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.000+0000 7fb59126f640 1 -- 172.21.15.104:0/2490884139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58c1f4570 con 0x7fb5780051c0 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.000+0000 7fb5837fe640 1 -- 172.21.15.104:0/2490884139 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c016860 con 0x7fb5780051c0 2024-05-08T04:22:30.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.000+0000 7fb59126f640 1 -- 172.21.15.104:0/2490884139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58c154030 con 0x7fb5780051c0 2024-05-08T04:22:30.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.001+0000 7fb59126f640 1 -- 172.21.15.104:0/2490884139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58c075010 con 0x7fb5780051c0 2024-05-08T04:22:30.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.001+0000 7fb5837fe640 1 -- 172.21.15.104:0/2490884139 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fb57c005d10 con 0x7fb5780051c0 2024-05-08T04:22:30.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.001+0000 7fb5837fe640 1 --2- 172.21.15.104:0/2490884139 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb56c06b680 0x7fb56c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.002+0000 7fb5837fe640 1 -- 172.21.15.104:0/2490884139 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb57c08b4d0 con 0x7fb5780051c0 2024-05-08T04:22:30.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.002+0000 7fb58a7fc640 1 --2- 172.21.15.104:0/2490884139 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb56c06b680 0x7fb56c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.002+0000 7fb58a7fc640 1 --2- 172.21.15.104:0/2490884139 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb56c06b680 0x7fb56c06db40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0b4e30 tx=0x7fb574009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:30.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.006+0000 7fb5837fe640 1 -- 172.21.15.104:0/2490884139 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb57c024030 con 0x7fb5780051c0 2024-05-08T04:22:30.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.184+0000 7fb59126f640 1 -- 172.21.15.104:0/2490884139 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb58c0afe20 con 0x7fb5780051c0 2024-05-08T04:22:30.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.185+0000 7fb5837fe640 1 -- 172.21.15.104:0/2490884139 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb57c089e20 con 0x7fb5780051c0 2024-05-08T04:22:30.186 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:22:30.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.187+0000 7fb59126f640 1 -- 172.21.15.104:0/2490884139 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb56c06b680 msgr2=0x7fb56c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.187+0000 7fb59126f640 1 --2- 172.21.15.104:0/2490884139 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb56c06b680 0x7fb56c06db40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0b4e30 tx=0x7fb574009040 comp rx=0 tx=0).stop 2024-05-08T04:22:30.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.187+0000 7fb59126f640 1 -- 172.21.15.104:0/2490884139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5780051c0 msgr2=0x7fb58c154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.187+0000 7fb59126f640 1 --2- 172.21.15.104:0/2490884139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5780051c0 0x7fb58c154830 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009fb0 tx=0x7fb57c0115a0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.187+0000 7fb59126f640 1 -- 172.21.15.104:0/2490884139 shutdown_connections 2024-05-08T04:22:30.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.187+0000 7fb59126f640 1 --2- 172.21.15.104:0/2490884139 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb56c06b680 0x7fb56c06db40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.187+0000 7fb59126f640 1 --2- 172.21.15.104:0/2490884139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb58c150480 0x7fb58c1f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.187+0000 7fb59126f640 1 --2- 172.21.15.104:0/2490884139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb58c150000 0x7fb58c1f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.187+0000 7fb59126f640 1 --2- 172.21.15.104:0/2490884139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5780051c0 0x7fb58c154830 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.187+0000 7fb59126f640 1 -- 172.21.15.104:0/2490884139 >> 172.21.15.104:0/2490884139 conn(0x7fb58c0b23e0 msgr2=0x7fb58c0d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:30.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.187+0000 7fb59126f640 1 -- 172.21.15.104:0/2490884139 shutdown_connections 2024-05-08T04:22:30.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.187+0000 7fb59126f640 1 -- 172.21.15.104:0/2490884139 wait complete. 2024-05-08T04:22:30.199 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi183.front.sepia.ceph.com... 2024-05-08T04:22:30.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:30.199 DEBUG:teuthology.orchestra.run.smithi183:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-08T04:22:30.229 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[42864]: fuse finished with error 0 and tester_r 0 2024-05-08T04:22:30.231 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:22:30.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:30.232 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-08T04:22:30.290 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:22:30.290 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:22:30.306 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=587 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T04:22:30.306 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:22:30.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:30.306 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-08T04:22:30.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:22:30.361 INFO:teuthology.orchestra.run.smithi104.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-05-08T04:22:30.361 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:22:30.361 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:22:30.383 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13681 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T04:22:30.384 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:22:30.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:30.384 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-08T04:22:30.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:22:30.443 INFO:teuthology.orchestra.run.smithi183.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-05-08T04:22:30.443 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:22:30.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.541+0000 7f414fd5c640 1 Processor -- start 2024-05-08T04:22:30.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.542+0000 7f414fd5c640 1 -- start start 2024-05-08T04:22:30.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.542+0000 7f414fd5c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414815de10 0x7f4148161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.542+0000 7f414fd5c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f41480ce5a0 0x7f41480d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.542+0000 7f414fd5c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41480d3210 con 0x7f41480d05f0 2024-05-08T04:22:30.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.542+0000 7f414fd5c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41480d0f50 con 0x7f41480ce5a0 2024-05-08T04:22:30.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.542+0000 7f414fd5c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4148161e60 con 0x7f414815de10 2024-05-08T04:22:30.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.543+0000 7f414d2f7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f41480ce5a0 0x7f41480d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.543+0000 7f414e2f9640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f41480d05f0 0x7f41480b54a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46974/0 (socket says 172.21.15.104:46974) 2024-05-08T04:22:30.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.543+0000 7f414e2f9640 1 -- 172.21.15.104:0/3254867576 learned_addr learned my addr 172.21.15.104:0/3254867576 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:30.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.543+0000 7f414daf8640 1 --2- 172.21.15.104:0/3254867576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414815de10 0x7f4148161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.543+0000 7f414d2f7640 1 -- 172.21.15.104:0/3254867576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414815de10 msgr2=0x7f4148161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:30.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.543+0000 7f414d2f7640 1 --2- 172.21.15.104:0/3254867576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414815de10 0x7f4148161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.543+0000 7f414d2f7640 1 -- 172.21.15.104:0/3254867576 >> v1:172.21.15.104:6789/0 conn(0x7f41480d05f0 legacy=0x7f41480b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.543+0000 7f414caf6640 1 -- 172.21.15.104:0/3254867576 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761565126 0 0) 0x7f41480d3210 con 0x7f41480d05f0 2024-05-08T04:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.543+0000 7f414d2f7640 1 -- 172.21.15.104:0/3254867576 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414815e1f0 con 0x7f41480ce5a0 2024-05-08T04:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.544+0000 7f414d2f7640 1 --2- 172.21.15.104:0/3254867576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41480ce5a0 0x7f41480d00b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f41380097a0 tx=0x7f413802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8328f2b65e0b9cb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.544+0000 7f414caf6640 1 -- 172.21.15.104:0/3254867576 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138037070 con 0x7f41480ce5a0 2024-05-08T04:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.544+0000 7f414caf6640 1 -- 172.21.15.104:0/3254867576 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413802ae50 con 0x7f41480ce5a0 2024-05-08T04:22:30.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.544+0000 7f414caf6640 1 -- 172.21.15.104:0/3254867576 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138032660 con 0x7f41480ce5a0 2024-05-08T04:22:30.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.544+0000 7f414fd5c640 1 -- 172.21.15.104:0/3254867576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41480ce5a0 msgr2=0x7f41480d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.544+0000 7f414fd5c640 1 --2- 172.21.15.104:0/3254867576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41480ce5a0 0x7f41480d00b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f41380097a0 tx=0x7f413802a100 comp rx=0 tx=0).stop 2024-05-08T04:22:30.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.544+0000 7f414fd5c640 1 -- 172.21.15.104:0/3254867576 shutdown_connections 2024-05-08T04:22:30.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.544+0000 7f414fd5c640 1 --2- 172.21.15.104:0/3254867576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41480ce5a0 0x7f41480d00b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.544+0000 7f414fd5c640 1 --2- 172.21.15.104:0/3254867576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414815de10 0x7f4148161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.544+0000 7f414fd5c640 1 -- 172.21.15.104:0/3254867576 >> 172.21.15.104:0/3254867576 conn(0x7f4148072290 msgr2=0x7f4148072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:30.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.545+0000 7f414fd5c640 1 -- 172.21.15.104:0/3254867576 shutdown_connections 2024-05-08T04:22:30.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.545+0000 7f414fd5c640 1 -- 172.21.15.104:0/3254867576 wait complete. 2024-05-08T04:22:30.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.546+0000 7f414fd5c640 1 Processor -- start 2024-05-08T04:22:30.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.546+0000 7f414fd5c640 1 -- start start 2024-05-08T04:22:30.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.546+0000 7f414fd5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41480ce5a0 0x7f41481f0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.546+0000 7f414fd5c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41480d05f0 0x7f414815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.546+0000 7f414fd5c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414815de10 0x7f4148152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.546+0000 7f414fd5c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4148162090 con 0x7f41480ce5a0 2024-05-08T04:22:30.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.546+0000 7f414fd5c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41480d1a90 con 0x7f41480d05f0 2024-05-08T04:22:30.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.546+0000 7f414fd5c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4148162370 con 0x7f414815de10 2024-05-08T04:22:30.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.546+0000 7f414daf8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41480ce5a0 0x7f41481f0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.546+0000 7f414daf8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41480ce5a0 0x7f41481f0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37754/0 (socket says 172.21.15.104:37754) 2024-05-08T04:22:30.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.546+0000 7f414daf8640 1 -- 172.21.15.104:0/1024123782 learned_addr learned my addr 172.21.15.104:0/1024123782 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:30.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f414e2f9640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414815de10 0x7f4148152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f414d2f7640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41480d05f0 0x7f414815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f414daf8640 1 -- 172.21.15.104:0/1024123782 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414815de10 msgr2=0x7f4148152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f414daf8640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414815de10 0x7f4148152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f414daf8640 1 -- 172.21.15.104:0/1024123782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41480d05f0 msgr2=0x7f414815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f414daf8640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41480d05f0 0x7f414815f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f414daf8640 1 -- 172.21.15.104:0/1024123782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414815fa90 con 0x7f41480ce5a0 2024-05-08T04:22:30.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f414d2f7640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41480d05f0 0x7f414815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:30.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f414daf8640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41480ce5a0 0x7f41481f0f30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f414400d5f0 tx=0x7f414400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:30.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f413e7fc640 1 -- 172.21.15.104:0/1024123782 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440125f0 con 0x7f41480ce5a0 2024-05-08T04:22:30.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f413e7fc640 1 -- 172.21.15.104:0/1024123782 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4144019070 con 0x7f41480ce5a0 2024-05-08T04:22:30.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f414fd5c640 1 -- 172.21.15.104:0/1024123782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41481f3d40 con 0x7f41480ce5a0 2024-05-08T04:22:30.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f413e7fc640 1 -- 172.21.15.104:0/1024123782 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440129d0 con 0x7f41480ce5a0 2024-05-08T04:22:30.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.547+0000 7f414fd5c640 1 -- 172.21.15.104:0/1024123782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41481f4300 con 0x7f41480ce5a0 2024-05-08T04:22:30.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.548+0000 7f414fd5c640 1 -- 172.21.15.104:0/1024123782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4148075010 con 0x7f41480ce5a0 2024-05-08T04:22:30.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.548+0000 7f413e7fc640 1 -- 172.21.15.104:0/1024123782 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f4144012b70 con 0x7f41480ce5a0 2024-05-08T04:22:30.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.549+0000 7f413e7fc640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f412c06b680 0x7f412c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.549+0000 7f413e7fc640 1 -- 172.21.15.104:0/1024123782 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f414408a820 con 0x7f41480ce5a0 2024-05-08T04:22:30.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.549+0000 7f414d2f7640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f412c06b680 0x7f412c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.549+0000 7f414d2f7640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f412c06b680 0x7f412c06db40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4138034000 tx=0x7f413802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:30.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.553+0000 7f413e7fc640 1 -- 172.21.15.104:0/1024123782 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f41440594b0 con 0x7f41480ce5a0 2024-05-08T04:22:30.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.764+0000 7f414fd5c640 1 -- 172.21.15.104:0/1024123782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f414815ee40 con 0x7f41480ce5a0 2024-05-08T04:22:30.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.764+0000 7f413e7fc640 1 -- 172.21.15.104:0/1024123782 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f414405de20 con 0x7f41480ce5a0 2024-05-08T04:22:30.766 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:30.766 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4933,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3121320604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3121320604},{"type":"v1","addr":"172.21.15.183:6834","nonce":3121320604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/207909171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":207909171},{"type":"v1","addr":"172.21.15.183:6835","nonce":207909171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/4245686743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4245686743},{"type":"v1","addr":"172.21.15.104:6836","nonce":4245686743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:07.933747+0000","modified":"2024-05-08T04:22:09.941364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/4038606624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":4038606624},{"type":"v1","addr":"172.21.15.104:6837","nonce":4038606624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T04:22:30.766 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 15 2024-05-08T04:22:30.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.766+0000 7f414fd5c640 1 -- 172.21.15.104:0/1024123782 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f412c06b680 msgr2=0x7f412c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.766+0000 7f414fd5c640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f412c06b680 0x7f412c06db40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4138034000 tx=0x7f413802e000 comp rx=0 tx=0).stop 2024-05-08T04:22:30.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.766+0000 7f414fd5c640 1 -- 172.21.15.104:0/1024123782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41480ce5a0 msgr2=0x7f41481f0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.766+0000 7f414fd5c640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41480ce5a0 0x7f41481f0f30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f414400d5f0 tx=0x7f414400dab0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.766+0000 7f414fd5c640 1 -- 172.21.15.104:0/1024123782 shutdown_connections 2024-05-08T04:22:30.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.766+0000 7f414fd5c640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f412c06b680 0x7f412c06db40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.766+0000 7f414fd5c640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41480d05f0 0x7f414815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.766+0000 7f414fd5c640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f414815de10 0x7f4148152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.766+0000 7f414fd5c640 1 --2- 172.21.15.104:0/1024123782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41480ce5a0 0x7f41481f0f30 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.766+0000 7f414fd5c640 1 -- 172.21.15.104:0/1024123782 >> 172.21.15.104:0/1024123782 conn(0x7f4148072290 msgr2=0x7f4148158440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:30.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.766+0000 7f414fd5c640 1 -- 172.21.15.104:0/1024123782 shutdown_connections 2024-05-08T04:22:30.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.766+0000 7f414fd5c640 1 -- 172.21.15.104:0/1024123782 wait complete. 2024-05-08T04:22:30.778 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:30.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.875+0000 7f46cfefc640 1 Processor -- start 2024-05-08T04:22:30.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.876+0000 7f46cfefc640 1 -- start start 2024-05-08T04:22:30.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.876+0000 7f46cfefc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c8159ec0 0x7f46c806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.876+0000 7f46cfefc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f46c8072160 0x7f46c815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.876+0000 7f46cfefc640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c815dce0 con 0x7f46c815a2a0 2024-05-08T04:22:30.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.876+0000 7f46cfefc640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c806eb60 con 0x7f46c8072160 2024-05-08T04:22:30.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.876+0000 7f46cfefc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c806ee40 con 0x7f46c8159ec0 2024-05-08T04:22:30.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46cd497640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f46c815a2a0 0x7f46c8071a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46982/0 (socket says 172.21.15.104:46982) 2024-05-08T04:22:30.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46cd497640 1 -- 172.21.15.104:0/197977854 learned_addr learned my addr 172.21.15.104:0/197977854 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:30.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331859806 0 0) 0x7f46c815dce0 con 0x7f46c815a2a0 2024-05-08T04:22:30.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46cdc98640 1 --2- 172.21.15.104:0/197977854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c8159ec0 0x7f46c806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ce499640 1 --2- 172.21.15.104:0/197977854 >> v2:172.21.15.183:3300/0 conn(0x7f46c8072160 0x7f46c815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46b0003520 con 0x7f46c815a2a0 2024-05-08T04:22:30.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2250996992 0 0) 0x7f46b0003520 con 0x7f46c815a2a0 2024-05-08T04:22:30.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c8159ec0 msgr2=0x7f46c806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:30.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 --2- 172.21.15.104:0/197977854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c8159ec0 0x7f46c806e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 >> v2:172.21.15.183:3300/0 conn(0x7f46c8072160 msgr2=0x7f46c815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:30.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 --2- 172.21.15.104:0/197977854 >> v2:172.21.15.183:3300/0 conn(0x7f46c8072160 0x7f46c815b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c815df80 con 0x7f46c815a2a0 2024-05-08T04:22:30.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f46bc001670 con 0x7f46c815a2a0 2024-05-08T04:22:30.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 >> v1:172.21.15.104:6789/0 conn(0x7f46c815a2a0 legacy=0x7f46c8071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 --2- 172.21.15.104:0/197977854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46b00039b0 0x7f46b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 --2- 172.21.15.104:0/197977854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b0004800 0x7f46b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 --2- 172.21.15.104:0/197977854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c8159ec0 0x7f46b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c806eb60 con 0x7f46b00039b0 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c806ee40 con 0x7f46b0004800 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b000b9c0 con 0x7f46c8159ec0 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46cdc98640 1 --2- 172.21.15.104:0/197977854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46b00039b0 0x7f46b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46cd497640 1 --2- 172.21.15.104:0/197977854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b0004800 0x7f46b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46ce499640 1 --2- 172.21.15.104:0/197977854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c8159ec0 0x7f46b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46cdc98640 1 -- 172.21.15.104:0/197977854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c8159ec0 msgr2=0x7f46b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46cdc98640 1 --2- 172.21.15.104:0/197977854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c8159ec0 0x7f46b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46cdc98640 1 -- 172.21.15.104:0/197977854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b0004800 msgr2=0x7f46b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46cdc98640 1 --2- 172.21.15.104:0/197977854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b0004800 0x7f46b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.877+0000 7f46cdc98640 1 -- 172.21.15.104:0/197977854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b0003520 con 0x7f46b00039b0 2024-05-08T04:22:30.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.878+0000 7f46cd497640 1 --2- 172.21.15.104:0/197977854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b0004800 0x7f46b0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:30.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.878+0000 7f46cdc98640 1 --2- 172.21.15.104:0/197977854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46b00039b0 0x7f46b0003dd0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009fc0 tx=0x7f46b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc33a7e575e5548 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:30.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.878+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0009c10 con 0x7f46b00039b0 2024-05-08T04:22:30.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.878+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c002e610 con 0x7f46b00039b0 2024-05-08T04:22:30.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.878+0000 7f46ccc96640 1 -- 172.21.15.104:0/197977854 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c002ea00 con 0x7f46b00039b0 2024-05-08T04:22:30.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.879+0000 7f46cfefc640 1 -- 172.21.15.104:0/197977854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46b00039b0 msgr2=0x7f46b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.879+0000 7f46cfefc640 1 --2- 172.21.15.104:0/197977854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46b00039b0 0x7f46b0003dd0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009fc0 tx=0x7f46b0005830 comp rx=0 tx=0).stop 2024-05-08T04:22:30.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.879+0000 7f46ce499640 1 -- 172.21.15.104:0/197977854 reap_dead start 2024-05-08T04:22:30.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.879+0000 7f46cfefc640 1 -- 172.21.15.104:0/197977854 shutdown_connections 2024-05-08T04:22:30.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.879+0000 7f46cfefc640 1 -- 172.21.15.104:0/197977854 >> 172.21.15.104:0/197977854 conn(0x7f46c80b13f0 msgr2=0x7f46c80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:30.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.879+0000 7f46cfefc640 1 -- 172.21.15.104:0/197977854 shutdown_connections 2024-05-08T04:22:30.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.879+0000 7f46cfefc640 1 -- 172.21.15.104:0/197977854 wait complete. 2024-05-08T04:22:30.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.880+0000 7f46cfefc640 1 Processor -- start 2024-05-08T04:22:30.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.880+0000 7f46cfefc640 1 -- start start 2024-05-08T04:22:30.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cfefc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b00039b0 0x7f46c80b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cfefc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c81f0790 0x7f46c81f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cfefc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c81f3100 0x7f46c80cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cfefc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c806e650 con 0x7f46c81f0790 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cfefc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c806e4d0 con 0x7f46b00039b0 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cfefc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c806e7d0 con 0x7f46c81f3100 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cd497640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c81f0790 0x7f46c81f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cd497640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c81f0790 0x7f46c81f2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37782/0 (socket says 172.21.15.104:37782) 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cd497640 1 -- 172.21.15.104:0/1901872623 learned_addr learned my addr 172.21.15.104:0/1901872623 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46ce499640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c81f3100 0x7f46c80cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cdc98640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b00039b0 0x7f46c80b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cd497640 1 -- 172.21.15.104:0/1901872623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c81f3100 msgr2=0x7f46c80cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cd497640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c81f3100 0x7f46c80cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cd497640 1 -- 172.21.15.104:0/1901872623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b00039b0 msgr2=0x7f46c80b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cd497640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b00039b0 0x7f46c80b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cd497640 1 -- 172.21.15.104:0/1901872623 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c81f35a0 con 0x7f46c81f0790 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cd497640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c81f0790 0x7f46c81f2bc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00e7b0 tx=0x7f46bc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46c67fc640 1 -- 172.21.15.104:0/1901872623 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc00c8d0 con 0x7f46c81f0790 2024-05-08T04:22:30.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46c67fc640 1 -- 172.21.15.104:0/1901872623 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc018070 con 0x7f46c81f0790 2024-05-08T04:22:30.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.881+0000 7f46cfefc640 1 -- 172.21.15.104:0/1901872623 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c81f3880 con 0x7f46c81f0790 2024-05-08T04:22:30.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.882+0000 7f46c67fc640 1 -- 172.21.15.104:0/1901872623 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc00cc90 con 0x7f46c81f0790 2024-05-08T04:22:30.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.882+0000 7f46cfefc640 1 -- 172.21.15.104:0/1901872623 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c80aeba0 con 0x7f46c81f0790 2024-05-08T04:22:30.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.883+0000 7f46cfefc640 1 -- 172.21.15.104:0/1901872623 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c80aeda0 con 0x7f46c81f0790 2024-05-08T04:22:30.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.883+0000 7f46c67fc640 1 -- 172.21.15.104:0/1901872623 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f46bc01d460 con 0x7f46c81f0790 2024-05-08T04:22:30.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.884+0000 7f46c67fc640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f46b406b6b0 0x7f46b406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:30.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.884+0000 7f46cdc98640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f46b406b6b0 0x7f46b406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:30.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.884+0000 7f46c67fc640 1 -- 172.21.15.104:0/1901872623 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46bc08a430 con 0x7f46c81f0790 2024-05-08T04:22:30.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.884+0000 7f46cdc98640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f46b406b6b0 0x7f46b406db70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f46c0037000 tx=0x7f46c0031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:30.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:30.888+0000 7f46c67fc640 1 -- 172.21.15.104:0/1901872623 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f46c80aeda0 con 0x7f46c81f0790 2024-05-08T04:22:31.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.060+0000 7f46cfefc640 1 -- 172.21.15.104:0/1901872623 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46c8075010 con 0x7f46c81f0790 2024-05-08T04:22:31.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.061+0000 7f46c67fc640 1 -- 172.21.15.104:0/1901872623 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f46bc059030 con 0x7f46c81f0790 2024-05-08T04:22:31.062 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:31.063 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":33,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:09.602236+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:05.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:06.917080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:31.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.063+0000 7f46cfefc640 1 -- 172.21.15.104:0/1901872623 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f46b406b6b0 msgr2=0x7f46b406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.063+0000 7f46cfefc640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f46b406b6b0 0x7f46b406db70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f46c0037000 tx=0x7f46c0031000 comp rx=0 tx=0).stop 2024-05-08T04:22:31.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.063+0000 7f46cfefc640 1 -- 172.21.15.104:0/1901872623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c81f0790 msgr2=0x7f46c81f2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.063+0000 7f46cfefc640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c81f0790 0x7f46c81f2bc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00e7b0 tx=0x7f46bc00ec70 comp rx=0 tx=0).stop 2024-05-08T04:22:31.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.063+0000 7f46cfefc640 1 -- 172.21.15.104:0/1901872623 shutdown_connections 2024-05-08T04:22:31.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.063+0000 7f46cfefc640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f46b406b6b0 0x7f46b406db70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.063+0000 7f46cfefc640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c81f3100 0x7f46c80cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.063+0000 7f46cfefc640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c81f0790 0x7f46c81f2bc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.063+0000 7f46cfefc640 1 --2- 172.21.15.104:0/1901872623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46b00039b0 0x7f46c80b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.063+0000 7f46cfefc640 1 -- 172.21.15.104:0/1901872623 >> 172.21.15.104:0/1901872623 conn(0x7f46c80b13f0 msgr2=0x7f46c80cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:31.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.063+0000 7f46cfefc640 1 -- 172.21.15.104:0/1901872623 shutdown_connections 2024-05-08T04:22:31.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.063+0000 7f46cfefc640 1 -- 172.21.15.104:0/1901872623 wait complete. 2024-05-08T04:22:31.075 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:22:05.786250+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:22:06.917080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:22:31.076 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:22:31.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.177+0000 7f681f25d640 1 Processor -- start 2024-05-08T04:22:31.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.177+0000 7f681f25d640 1 -- start start 2024-05-08T04:22:31.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.178+0000 7f681f25d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6818161780 0x7f68180ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.178+0000 7f681f25d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f68180d4010 0x7f68180cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.178+0000 7f681f25d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68180b5540 con 0x7f6818162150 2024-05-08T04:22:31.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.178+0000 7f681f25d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68180b57e0 con 0x7f68180d4010 2024-05-08T04:22:31.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.178+0000 7f681f25d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68180b5ac0 con 0x7f6818161780 2024-05-08T04:22:31.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.179+0000 7f6817fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6818161780 0x7f68180ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.179+0000 7f6817fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6818161780 0x7f68180ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:39812/0 (socket says 172.21.15.104:39812) 2024-05-08T04:22:31.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.179+0000 7f6817fff640 1 -- 172.21.15.104:0/416320097 learned_addr learned my addr 172.21.15.104:0/416320097 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:31.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.179+0000 7f681d7fa640 1 --2- 172.21.15.104:0/416320097 >> v2:172.21.15.183:3300/0 conn(0x7f68180d4010 0x7f68180cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.179+0000 7f6817fff640 1 -- 172.21.15.104:0/416320097 >> v2:172.21.15.183:3300/0 conn(0x7f68180d4010 msgr2=0x7f68180cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:31.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.179+0000 7f6817fff640 1 --2- 172.21.15.104:0/416320097 >> v2:172.21.15.183:3300/0 conn(0x7f68180d4010 0x7f68180cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.179+0000 7f6817fff640 1 -- 172.21.15.104:0/416320097 >> v1:172.21.15.183:6789/0 conn(0x7f6818162150 legacy=0x7f68180d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.179+0000 7f6817fff640 1 -- 172.21.15.104:0/416320097 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68180b5da0 con 0x7f6818161780 2024-05-08T04:22:31.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.180+0000 7f6817fff640 1 --2- 172.21.15.104:0/416320097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6818161780 0x7f68180ce740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f680c009e50 tx=0x7f680c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74a06623cadbdb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:31.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.180+0000 7f68177fe640 1 -- 172.21.15.104:0/416320097 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c036070 con 0x7f6818161780 2024-05-08T04:22:31.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.180+0000 7f68177fe640 1 -- 172.21.15.104:0/416320097 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680c031600 con 0x7f6818161780 2024-05-08T04:22:31.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.180+0000 7f68177fe640 1 -- 172.21.15.104:0/416320097 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c0319d0 con 0x7f6818161780 2024-05-08T04:22:31.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.180+0000 7f681f25d640 1 -- 172.21.15.104:0/416320097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6818161780 msgr2=0x7f68180ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.180+0000 7f681f25d640 1 --2- 172.21.15.104:0/416320097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6818161780 0x7f68180ce740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f680c009e50 tx=0x7f680c02a680 comp rx=0 tx=0).stop 2024-05-08T04:22:31.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.180+0000 7f681f25d640 1 -- 172.21.15.104:0/416320097 shutdown_connections 2024-05-08T04:22:31.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.180+0000 7f681f25d640 1 --2- 172.21.15.104:0/416320097 >> v2:172.21.15.183:3300/0 conn(0x7f68180d4010 0x7f68180cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.180+0000 7f681f25d640 1 --2- 172.21.15.104:0/416320097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6818161780 0x7f68180ce740 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.180+0000 7f681f25d640 1 -- 172.21.15.104:0/416320097 >> 172.21.15.104:0/416320097 conn(0x7f681806c330 msgr2=0x7f681806c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:31.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.180+0000 7f681f25d640 1 -- 172.21.15.104:0/416320097 shutdown_connections 2024-05-08T04:22:31.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.181+0000 7f681f25d640 1 -- 172.21.15.104:0/416320097 wait complete. 2024-05-08T04:22:31.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.182+0000 7f681f25d640 1 Processor -- start 2024-05-08T04:22:31.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.182+0000 7f681f25d640 1 -- start start 2024-05-08T04:22:31.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.182+0000 7f681f25d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68180d4010 0x7f6818155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.182+0000 7f681f25d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6818161780 0x7f68180cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681f25d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6818162150 0x7f6818159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681f25d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68180b8f30 con 0x7f68180d4010 2024-05-08T04:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681f25d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68180b8db0 con 0x7f6818161780 2024-05-08T04:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681f25d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68180b90b0 con 0x7f6818162150 2024-05-08T04:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681cff9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68180d4010 0x7f6818155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681cff9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68180d4010 0x7f6818155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37786/0 (socket says 172.21.15.104:37786) 2024-05-08T04:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681cff9640 1 -- 172.21.15.104:0/2640340996 learned_addr learned my addr 172.21.15.104:0/2640340996 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681d7fa640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6818162150 0x7f6818159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f6817fff640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6818161780 0x7f68180cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681cff9640 1 -- 172.21.15.104:0/2640340996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6818162150 msgr2=0x7f6818159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681cff9640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6818162150 0x7f6818159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681cff9640 1 -- 172.21.15.104:0/2640340996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6818161780 msgr2=0x7f68180cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681cff9640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6818161780 0x7f68180cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681cff9640 1 -- 172.21.15.104:0/2640340996 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681815e410 con 0x7f68180d4010 2024-05-08T04:22:31.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681d7fa640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6818162150 0x7f6818159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:31.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681cff9640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68180d4010 0x7f6818155160 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f680800c340 tx=0x7f680800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:31.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f68157fa640 1 -- 172.21.15.104:0/2640340996 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808017070 con 0x7f68180d4010 2024-05-08T04:22:31.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f68157fa640 1 -- 172.21.15.104:0/2640340996 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68080052d0 con 0x7f68180d4010 2024-05-08T04:22:31.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681f25d640 1 -- 172.21.15.104:0/2640340996 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681815e6f0 con 0x7f68180d4010 2024-05-08T04:22:31.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f68157fa640 1 -- 172.21.15.104:0/2640340996 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808003850 con 0x7f68180d4010 2024-05-08T04:22:31.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.183+0000 7f681f25d640 1 -- 172.21.15.104:0/2640340996 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681815ecb0 con 0x7f68180d4010 2024-05-08T04:22:31.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.184+0000 7f681f25d640 1 -- 172.21.15.104:0/2640340996 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68180b2b20 con 0x7f68180d4010 2024-05-08T04:22:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.185+0000 7f68157fa640 1 -- 172.21.15.104:0/2640340996 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f680801a070 con 0x7f68180d4010 2024-05-08T04:22:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.185+0000 7f68157fa640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f680406b680 0x7f680406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.185+0000 7f68157fa640 1 -- 172.21.15.104:0/2640340996 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6808089820 con 0x7f68180d4010 2024-05-08T04:22:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.185+0000 7f6817fff640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f680406b680 0x7f680406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.186+0000 7f6817fff640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f680406b680 0x7f680406db40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f680c033000 tx=0x7f680c009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:31.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.189+0000 7f68157fa640 1 -- 172.21.15.104:0/2640340996 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f68180b2b20 con 0x7f68180d4010 2024-05-08T04:22:31.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.357+0000 7f681f25d640 1 -- 172.21.15.104:0/2640340996 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6818075010 con 0x7f68180d4010 2024-05-08T04:22:31.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.357+0000 7f68157fa640 1 -- 172.21.15.104:0/2640340996 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6808058420 con 0x7f68180d4010 2024-05-08T04:22:31.359 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:22:31.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.359+0000 7f681f25d640 1 -- 172.21.15.104:0/2640340996 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f680406b680 msgr2=0x7f680406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.359+0000 7f681f25d640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f680406b680 0x7f680406db40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f680c033000 tx=0x7f680c009000 comp rx=0 tx=0).stop 2024-05-08T04:22:31.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.359+0000 7f681f25d640 1 -- 172.21.15.104:0/2640340996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68180d4010 msgr2=0x7f6818155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.359+0000 7f681f25d640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68180d4010 0x7f6818155160 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f680800c340 tx=0x7f680800c800 comp rx=0 tx=0).stop 2024-05-08T04:22:31.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.359+0000 7f681f25d640 1 -- 172.21.15.104:0/2640340996 shutdown_connections 2024-05-08T04:22:31.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.359+0000 7f681f25d640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f680406b680 0x7f680406db40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.359+0000 7f681f25d640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6818161780 0x7f68180cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.359+0000 7f681f25d640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6818162150 0x7f6818159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.359+0000 7f681f25d640 1 --2- 172.21.15.104:0/2640340996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68180d4010 0x7f6818155160 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.359+0000 7f681f25d640 1 -- 172.21.15.104:0/2640340996 >> 172.21.15.104:0/2640340996 conn(0x7f681806c330 msgr2=0x7f68180b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:31.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.359+0000 7f681f25d640 1 -- 172.21.15.104:0/2640340996 shutdown_connections 2024-05-08T04:22:31.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.359+0000 7f681f25d640 1 -- 172.21.15.104:0/2640340996 wait complete. 2024-05-08T04:22:31.371 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:22:31.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.473+0000 7f2855d42640 1 Processor -- start 2024-05-08T04:22:31.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.473+0000 7f2855d42640 1 -- start start 2024-05-08T04:22:31.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.474+0000 7f2855d42640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f28500cc930 0x7f28500ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.474+0000 7f2855d42640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28500711c0 0x7f285015f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.474+0000 7f2855d42640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2850144c80 0x7f285015fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.474+0000 7f2855d42640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2850071fb0 con 0x7f2850144c80 2024-05-08T04:22:31.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.474+0000 7f2855d42640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28500cd250 con 0x7f28500cc930 2024-05-08T04:22:31.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.474+0000 7f2855d42640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2850071710 con 0x7f28500711c0 2024-05-08T04:22:31.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.474+0000 7f284ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2850144c80 0x7f285015fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.474+0000 7f284ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2850144c80 0x7f285015fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37798/0 (socket says 172.21.15.104:37798) 2024-05-08T04:22:31.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.474+0000 7f284ffff640 1 -- 172.21.15.104:0/3807225868 learned_addr learned my addr 172.21.15.104:0/3807225868 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:31.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.474+0000 7f284effd640 1 --2- 172.21.15.104:0/3807225868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28500711c0 0x7f285015f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.474+0000 7f284f7fe640 1 --2- 172.21.15.104:0/3807225868 >> v2:172.21.15.183:3300/0 conn(0x7f28500cc930 0x7f28500ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.475+0000 7f284ffff640 1 -- 172.21.15.104:0/3807225868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28500711c0 msgr2=0x7f285015f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:31.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.475+0000 7f284ffff640 1 --2- 172.21.15.104:0/3807225868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28500711c0 0x7f285015f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.475+0000 7f284ffff640 1 -- 172.21.15.104:0/3807225868 >> v2:172.21.15.183:3300/0 conn(0x7f28500cc930 msgr2=0x7f28500ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:31.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.475+0000 7f284ffff640 1 --2- 172.21.15.104:0/3807225868 >> v2:172.21.15.183:3300/0 conn(0x7f28500cc930 0x7f28500ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.475+0000 7f284ffff640 1 -- 172.21.15.104:0/3807225868 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500719f0 con 0x7f2850144c80 2024-05-08T04:22:31.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.475+0000 7f284ffff640 1 --2- 172.21.15.104:0/3807225868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2850144c80 0x7f285015fae0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f28500685c0 tx=0x7f284802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869b132cc3a5a5fa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:31.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.475+0000 7f284e7fc640 1 -- 172.21.15.104:0/3807225868 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848037070 con 0x7f2850144c80 2024-05-08T04:22:31.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.476+0000 7f284e7fc640 1 -- 172.21.15.104:0/3807225868 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2848032440 con 0x7f2850144c80 2024-05-08T04:22:31.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.476+0000 7f284e7fc640 1 -- 172.21.15.104:0/3807225868 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848032810 con 0x7f2850144c80 2024-05-08T04:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.476+0000 7f2855d42640 1 -- 172.21.15.104:0/3807225868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2850144c80 msgr2=0x7f285015fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.476+0000 7f2855d42640 1 --2- 172.21.15.104:0/3807225868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2850144c80 0x7f285015fae0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f28500685c0 tx=0x7f284802a140 comp rx=0 tx=0).stop 2024-05-08T04:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.476+0000 7f2855d42640 1 -- 172.21.15.104:0/3807225868 shutdown_connections 2024-05-08T04:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.476+0000 7f2855d42640 1 --2- 172.21.15.104:0/3807225868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2850144c80 0x7f285015fae0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.476+0000 7f2855d42640 1 --2- 172.21.15.104:0/3807225868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28500711c0 0x7f285015f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.476+0000 7f2855d42640 1 --2- 172.21.15.104:0/3807225868 >> v2:172.21.15.183:3300/0 conn(0x7f28500cc930 0x7f28500ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.476+0000 7f2855d42640 1 -- 172.21.15.104:0/3807225868 >> 172.21.15.104:0/3807225868 conn(0x7f28500b13f0 msgr2=0x7f28500b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.476+0000 7f2855d42640 1 -- 172.21.15.104:0/3807225868 shutdown_connections 2024-05-08T04:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.476+0000 7f2855d42640 1 -- 172.21.15.104:0/3807225868 wait complete. 2024-05-08T04:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.477+0000 7f2855d42640 1 Processor -- start 2024-05-08T04:22:31.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.477+0000 7f2855d42640 1 -- start start 2024-05-08T04:22:31.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.478+0000 7f2855d42640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28500711c0 0x7f2850140000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.478+0000 7f2855d42640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28500cc930 0x7f285015ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.478+0000 7f2855d42640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2850144c80 0x7f285015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.478+0000 7f2855d42640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28500cf3b0 con 0x7f28500711c0 2024-05-08T04:22:31.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.478+0000 7f2855d42640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285006d330 con 0x7f2850144c80 2024-05-08T04:22:31.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.478+0000 7f2855d42640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28501453f0 con 0x7f28500cc930 2024-05-08T04:22:31.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.478+0000 7f284f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28500711c0 0x7f2850140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.478+0000 7f284f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28500711c0 0x7f2850140000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37806/0 (socket says 172.21.15.104:37806) 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.478+0000 7f284f7fe640 1 -- 172.21.15.104:0/3467246504 learned_addr learned my addr 172.21.15.104:0/3467246504 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.479+0000 7f284f7fe640 1 -- 172.21.15.104:0/3467246504 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28500cc930 msgr2=0x7f285015ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.479+0000 7f284f7fe640 1 --2- 172.21.15.104:0/3467246504 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28500cc930 0x7f285015ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.479+0000 7f284f7fe640 1 -- 172.21.15.104:0/3467246504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2850144c80 msgr2=0x7f285015f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.479+0000 7f284f7fe640 1 --2- 172.21.15.104:0/3467246504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2850144c80 0x7f285015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.479+0000 7f284f7fe640 1 -- 172.21.15.104:0/3467246504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500ab1d0 con 0x7f28500711c0 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.479+0000 7f284f7fe640 1 --2- 172.21.15.104:0/3467246504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28500711c0 0x7f2850140000 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f284000e870 tx=0x7f284000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.479+0000 7f2837fff640 1 -- 172.21.15.104:0/3467246504 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840017070 con 0x7f28500711c0 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.479+0000 7f2837fff640 1 -- 172.21.15.104:0/3467246504 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284000c940 con 0x7f28500711c0 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.479+0000 7f2855d42640 1 -- 172.21.15.104:0/3467246504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28500ab4b0 con 0x7f28500711c0 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.479+0000 7f2837fff640 1 -- 172.21.15.104:0/3467246504 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000cd30 con 0x7f28500711c0 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.479+0000 7f2855d42640 1 -- 172.21.15.104:0/3467246504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2850140540 con 0x7f28500711c0 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.480+0000 7f2855d42640 1 -- 172.21.15.104:0/3467246504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2850075010 con 0x7f28500711c0 2024-05-08T04:22:31.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.480+0000 7f2837fff640 1 -- 172.21.15.104:0/3467246504 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f284001a070 con 0x7f28500711c0 2024-05-08T04:22:31.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.481+0000 7f2837fff640 1 --2- 172.21.15.104:0/3467246504 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f283c06b680 0x7f283c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.481+0000 7f284effd640 1 --2- 172.21.15.104:0/3467246504 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f283c06b680 0x7f283c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.481+0000 7f2837fff640 1 -- 172.21.15.104:0/3467246504 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f284008a790 con 0x7f28500711c0 2024-05-08T04:22:31.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.481+0000 7f284effd640 1 --2- 172.21.15.104:0/3467246504 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f283c06b680 0x7f283c06db40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f28500b0ba0 tx=0x7f284400d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:31.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.485+0000 7f2837fff640 1 -- 172.21.15.104:0/3467246504 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2840059390 con 0x7f28500711c0 2024-05-08T04:22:31.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.656+0000 7f2855d42640 1 -- 172.21.15.104:0/3467246504 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28500af040 con 0x7f28500711c0 2024-05-08T04:22:31.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.656+0000 7f2837fff640 1 -- 172.21.15.104:0/3467246504 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2840058c90 con 0x7f28500711c0 2024-05-08T04:22:31.658 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:22:31.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.658+0000 7f2855d42640 1 -- 172.21.15.104:0/3467246504 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f283c06b680 msgr2=0x7f283c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.658+0000 7f2855d42640 1 --2- 172.21.15.104:0/3467246504 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f283c06b680 0x7f283c06db40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f28500b0ba0 tx=0x7f284400d040 comp rx=0 tx=0).stop 2024-05-08T04:22:31.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.658+0000 7f2855d42640 1 -- 172.21.15.104:0/3467246504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28500711c0 msgr2=0x7f2850140000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.658+0000 7f2855d42640 1 --2- 172.21.15.104:0/3467246504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28500711c0 0x7f2850140000 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f284000e870 tx=0x7f284000ed30 comp rx=0 tx=0).stop 2024-05-08T04:22:31.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.658+0000 7f2855d42640 1 -- 172.21.15.104:0/3467246504 shutdown_connections 2024-05-08T04:22:31.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.658+0000 7f2855d42640 1 --2- 172.21.15.104:0/3467246504 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f283c06b680 0x7f283c06db40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.658+0000 7f2855d42640 1 --2- 172.21.15.104:0/3467246504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2850144c80 0x7f285015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.658+0000 7f2855d42640 1 --2- 172.21.15.104:0/3467246504 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f28500cc930 0x7f285015ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.658+0000 7f2855d42640 1 --2- 172.21.15.104:0/3467246504 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f28500711c0 0x7f2850140000 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.658+0000 7f2855d42640 1 -- 172.21.15.104:0/3467246504 >> 172.21.15.104:0/3467246504 conn(0x7f28500b13f0 msgr2=0x7f28500b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:31.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.659+0000 7f2855d42640 1 -- 172.21.15.104:0/3467246504 shutdown_connections 2024-05-08T04:22:31.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.659+0000 7f2855d42640 1 -- 172.21.15.104:0/3467246504 wait complete. 2024-05-08T04:22:31.671 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:22:31.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.774+0000 7f2e4e276640 1 Processor -- start 2024-05-08T04:22:31.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.774+0000 7f2e4e276640 1 -- start start 2024-05-08T04:22:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e4e276640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2e480ceee0 0x7f2e480b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e4e276640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e4806e330 0x7f2e4806e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e4e276640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4815e780 con 0x7f2e480b3ff0 2024-05-08T04:22:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e4e276640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4815f390 con 0x7f2e480ceee0 2024-05-08T04:22:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e4e276640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4815ea60 con 0x7f2e4806e330 2024-05-08T04:22:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e47fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2e480ceee0 0x7f2e480b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e4c813640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f2e480b3ff0 0x7f2e480b4480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:46990/0 (socket says 172.21.15.104:46990) 2024-05-08T04:22:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e4c813640 1 -- 172.21.15.104:0/3866746867 learned_addr learned my addr 172.21.15.104:0/3866746867 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e477fe640 1 --2- 172.21.15.104:0/3866746867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e4806e330 0x7f2e4806e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e47fff640 1 -- 172.21.15.104:0/3866746867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e4806e330 msgr2=0x7f2e4806e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e47fff640 1 --2- 172.21.15.104:0/3866746867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e4806e330 0x7f2e4806e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e47fff640 1 -- 172.21.15.104:0/3866746867 >> v1:172.21.15.104:6789/0 conn(0x7f2e480b3ff0 legacy=0x7f2e480b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e47fff640 1 -- 172.21.15.104:0/3866746867 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4815ed40 con 0x7f2e480ceee0 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.775+0000 7f2e46ffd640 1 -- 172.21.15.104:0/3866746867 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763224981 0 0) 0x7f2e4815e780 con 0x7f2e480b3ff0 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.776+0000 7f2e47fff640 1 --2- 172.21.15.104:0/3866746867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e480ceee0 0x7f2e480b26f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2e380097a0 tx=0x7f2e3802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f823bc8a83d33033 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.776+0000 7f2e46ffd640 1 -- 172.21.15.104:0/3866746867 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38037070 con 0x7f2e480ceee0 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.776+0000 7f2e46ffd640 1 -- 172.21.15.104:0/3866746867 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e38032440 con 0x7f2e480ceee0 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.776+0000 7f2e46ffd640 1 -- 172.21.15.104:0/3866746867 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38032810 con 0x7f2e480ceee0 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.777+0000 7f2e4e276640 1 -- 172.21.15.104:0/3866746867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e480ceee0 msgr2=0x7f2e480b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.777+0000 7f2e4e276640 1 --2- 172.21.15.104:0/3866746867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e480ceee0 0x7f2e480b26f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2e380097a0 tx=0x7f2e3802a180 comp rx=0 tx=0).stop 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.777+0000 7f2e4e276640 1 -- 172.21.15.104:0/3866746867 shutdown_connections 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.777+0000 7f2e4e276640 1 --2- 172.21.15.104:0/3866746867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e4806e330 0x7f2e4806e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.777+0000 7f2e4e276640 1 --2- 172.21.15.104:0/3866746867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e480ceee0 0x7f2e480b26f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.777+0000 7f2e4e276640 1 -- 172.21.15.104:0/3866746867 >> 172.21.15.104:0/3866746867 conn(0x7f2e480b13f0 msgr2=0x7f2e480b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:31.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.777+0000 7f2e4e276640 1 -- 172.21.15.104:0/3866746867 shutdown_connections 2024-05-08T04:22:31.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.777+0000 7f2e4e276640 1 -- 172.21.15.104:0/3866746867 wait complete. 2024-05-08T04:22:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.778+0000 7f2e4e276640 1 Processor -- start 2024-05-08T04:22:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.778+0000 7f2e4e276640 1 -- start start 2024-05-08T04:22:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e4e276640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e4806e330 0x7f2e481f1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e4e276640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e480b3ff0 0x7f2e480c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e4e276640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e480ceee0 0x7f2e48159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e4e276640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480cf440 con 0x7f2e480b3ff0 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e4e276640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480cf2c0 con 0x7f2e4806e330 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e4e276640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4815b210 con 0x7f2e480ceee0 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e477fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e480b3ff0 0x7f2e480c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e477fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e480b3ff0 0x7f2e480c4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37820/0 (socket says 172.21.15.104:37820) 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e477fe640 1 -- 172.21.15.104:0/2189046752 learned_addr learned my addr 172.21.15.104:0/2189046752 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e477fe640 1 -- 172.21.15.104:0/2189046752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e480ceee0 msgr2=0x7f2e48159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e4c813640 1 --2- 172.21.15.104:0/2189046752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e480ceee0 0x7f2e48159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e477fe640 1 --2- 172.21.15.104:0/2189046752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e480ceee0 0x7f2e48159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e477fe640 1 -- 172.21.15.104:0/2189046752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e4806e330 msgr2=0x7f2e481f1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e477fe640 1 --2- 172.21.15.104:0/2189046752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e4806e330 0x7f2e481f1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e477fe640 1 -- 172.21.15.104:0/2189046752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e481f2460 con 0x7f2e480b3ff0 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e477fe640 1 --2- 172.21.15.104:0/2189046752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e480b3ff0 0x7f2e480c4b30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00d800 tx=0x7f2e3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e44ff9640 1 -- 172.21.15.104:0/2189046752 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00b6c0 con 0x7f2e480b3ff0 2024-05-08T04:22:31.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e44ff9640 1 -- 172.21.15.104:0/2189046752 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c019070 con 0x7f2e480b3ff0 2024-05-08T04:22:31.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e4e276640 1 -- 172.21.15.104:0/2189046752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e481f1300 con 0x7f2e480b3ff0 2024-05-08T04:22:31.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e44ff9640 1 -- 172.21.15.104:0/2189046752 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00bac0 con 0x7f2e480b3ff0 2024-05-08T04:22:31.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.779+0000 7f2e4e276640 1 -- 172.21.15.104:0/2189046752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e480c6df0 con 0x7f2e480b3ff0 2024-05-08T04:22:31.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.781+0000 7f2e4e276640 1 -- 172.21.15.104:0/2189046752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e48158aa0 con 0x7f2e480b3ff0 2024-05-08T04:22:31.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.781+0000 7f2e44ff9640 1 -- 172.21.15.104:0/2189046752 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f2e3c00bc60 con 0x7f2e480b3ff0 2024-05-08T04:22:31.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.781+0000 7f2e44ff9640 1 --2- 172.21.15.104:0/2189046752 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2e3406b680 0x7f2e3406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:31.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.781+0000 7f2e44ff9640 1 -- 172.21.15.104:0/2189046752 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e3c08a9f0 con 0x7f2e480b3ff0 2024-05-08T04:22:31.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.781+0000 7f2e47fff640 1 --2- 172.21.15.104:0/2189046752 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2e3406b680 0x7f2e3406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:31.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.782+0000 7f2e47fff640 1 --2- 172.21.15.104:0/2189046752 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2e3406b680 0x7f2e3406db40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2e38034000 tx=0x7f2e3802c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:31.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.785+0000 7f2e44ff9640 1 -- 172.21.15.104:0/2189046752 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2e481f2460 con 0x7f2e480b3ff0 2024-05-08T04:22:31.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.955+0000 7f2e4e276640 1 -- 172.21.15.104:0/2189046752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e480c4910 con 0x7f2e480b3ff0 2024-05-08T04:22:31.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.955+0000 7f2e44ff9640 1 -- 172.21.15.104:0/2189046752 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e3c0595f0 con 0x7f2e480b3ff0 2024-05-08T04:22:31.957 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:22:31.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.957+0000 7f2e4e276640 1 -- 172.21.15.104:0/2189046752 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2e3406b680 msgr2=0x7f2e3406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.957+0000 7f2e4e276640 1 --2- 172.21.15.104:0/2189046752 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2e3406b680 0x7f2e3406db40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2e38034000 tx=0x7f2e3802c000 comp rx=0 tx=0).stop 2024-05-08T04:22:31.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.957+0000 7f2e4e276640 1 -- 172.21.15.104:0/2189046752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e480b3ff0 msgr2=0x7f2e480c4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:31.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.957+0000 7f2e4e276640 1 --2- 172.21.15.104:0/2189046752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e480b3ff0 0x7f2e480c4b30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00d800 tx=0x7f2e3c00dcc0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.957+0000 7f2e4e276640 1 -- 172.21.15.104:0/2189046752 shutdown_connections 2024-05-08T04:22:31.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.957+0000 7f2e4e276640 1 --2- 172.21.15.104:0/2189046752 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2e3406b680 0x7f2e3406db40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.957+0000 7f2e4e276640 1 --2- 172.21.15.104:0/2189046752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e480ceee0 0x7f2e48159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.957+0000 7f2e4e276640 1 --2- 172.21.15.104:0/2189046752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2e480b3ff0 0x7f2e480c4b30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.957+0000 7f2e4e276640 1 --2- 172.21.15.104:0/2189046752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e4806e330 0x7f2e481f1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:31.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.957+0000 7f2e4e276640 1 -- 172.21.15.104:0/2189046752 >> 172.21.15.104:0/2189046752 conn(0x7f2e480b13f0 msgr2=0x7f2e48158230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:31.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.957+0000 7f2e4e276640 1 -- 172.21.15.104:0/2189046752 shutdown_connections 2024-05-08T04:22:31.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:31.957+0000 7f2e4e276640 1 -- 172.21.15.104:0/2189046752 wait complete. 2024-05-08T04:22:31.970 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:22:32.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.069+0000 7ff548ccb640 1 Processor -- start 2024-05-08T04:22:32.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.069+0000 7ff548ccb640 1 -- start start 2024-05-08T04:22:32.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.069+0000 7ff548ccb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff5440ce5a0 0x7ff544161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.069+0000 7ff548ccb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5440d07c0 0x7ff5440d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.069+0000 7ff548ccb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff54415e1f0 con 0x7ff54415de10 2024-05-08T04:22:32.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.069+0000 7ff548ccb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5440d0f50 con 0x7ff5440ce5a0 2024-05-08T04:22:32.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.069+0000 7ff548ccb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff544161e60 con 0x7ff5440d07c0 2024-05-08T04:22:32.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.070+0000 7ff54259c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff54415de10 0x7ff5440d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:47000/0 (socket says 172.21.15.104:47000) 2024-05-08T04:22:32.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.070+0000 7ff54259c640 1 -- 172.21.15.104:0/2359684847 learned_addr learned my addr 172.21.15.104:0/2359684847 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:32.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.070+0000 7ff542d9d640 1 --2- 172.21.15.104:0/2359684847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5440d07c0 0x7ff5440d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.070+0000 7ff53bfff640 1 --2- 172.21.15.104:0/2359684847 >> v2:172.21.15.183:3300/0 conn(0x7ff5440ce5a0 0x7ff544161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.070+0000 7ff541d9b640 1 -- 172.21.15.104:0/2359684847 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770319707 0 0) 0x7ff54415e1f0 con 0x7ff54415de10 2024-05-08T04:22:32.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.070+0000 7ff541d9b640 1 -- 172.21.15.104:0/2359684847 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff530003520 con 0x7ff54415de10 2024-05-08T04:22:32.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.070+0000 7ff542d9d640 1 -- 172.21.15.104:0/2359684847 >> v2:172.21.15.183:3300/0 conn(0x7ff5440ce5a0 msgr2=0x7ff544161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:32.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.070+0000 7ff541d9b640 1 -- 172.21.15.104:0/2359684847 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1173320349 0 0) 0x7ff530003520 con 0x7ff54415de10 2024-05-08T04:22:32.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.070+0000 7ff542d9d640 1 --2- 172.21.15.104:0/2359684847 >> v2:172.21.15.183:3300/0 conn(0x7ff5440ce5a0 0x7ff544161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.070+0000 7ff542d9d640 1 -- 172.21.15.104:0/2359684847 >> v1:172.21.15.104:6789/0 conn(0x7ff54415de10 legacy=0x7ff5440d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.070+0000 7ff542d9d640 1 -- 172.21.15.104:0/2359684847 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff544162090 con 0x7ff5440d07c0 2024-05-08T04:22:32.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.071+0000 7ff542d9d640 1 --2- 172.21.15.104:0/2359684847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5440d07c0 0x7ff5440d2200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009d90 tx=0x7ff53c02a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7de24519acc610e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:32.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.071+0000 7ff541d9b640 1 -- 172.21.15.104:0/2359684847 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534001670 con 0x7ff5440d07c0 2024-05-08T04:22:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.071+0000 7ff541d9b640 1 -- 172.21.15.104:0/2359684847 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c007540 con 0x7ff5440d07c0 2024-05-08T04:22:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.071+0000 7ff541d9b640 1 -- 172.21.15.104:0/2359684847 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c007910 con 0x7ff5440d07c0 2024-05-08T04:22:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.072+0000 7ff548ccb640 1 -- 172.21.15.104:0/2359684847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5440d07c0 msgr2=0x7ff5440d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.072+0000 7ff548ccb640 1 --2- 172.21.15.104:0/2359684847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5440d07c0 0x7ff5440d2200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009d90 tx=0x7ff53c02a560 comp rx=0 tx=0).stop 2024-05-08T04:22:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.072+0000 7ff548ccb640 1 -- 172.21.15.104:0/2359684847 shutdown_connections 2024-05-08T04:22:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.072+0000 7ff548ccb640 1 --2- 172.21.15.104:0/2359684847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5440d07c0 0x7ff5440d2200 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.072+0000 7ff548ccb640 1 --2- 172.21.15.104:0/2359684847 >> v2:172.21.15.183:3300/0 conn(0x7ff5440ce5a0 0x7ff544161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.072+0000 7ff548ccb640 1 -- 172.21.15.104:0/2359684847 >> 172.21.15.104:0/2359684847 conn(0x7ff544072290 msgr2=0x7ff544072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.072+0000 7ff548ccb640 1 -- 172.21.15.104:0/2359684847 shutdown_connections 2024-05-08T04:22:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.072+0000 7ff548ccb640 1 -- 172.21.15.104:0/2359684847 wait complete. 2024-05-08T04:22:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.073+0000 7ff548ccb640 1 Processor -- start 2024-05-08T04:22:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.073+0000 7ff548ccb640 1 -- start start 2024-05-08T04:22:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff548ccb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5440ce5a0 0x7ff544142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff548ccb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5440d07c0 0x7ff544160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff548ccb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff54415de10 0x7ff5441608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff548ccb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff544162650 con 0x7ff54415de10 2024-05-08T04:22:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff548ccb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440d1a90 con 0x7ff5440ce5a0 2024-05-08T04:22:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff548ccb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440d1ce0 con 0x7ff5440d07c0 2024-05-08T04:22:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff542d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff54415de10 0x7ff5441608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff542d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff54415de10 0x7ff5441608d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37822/0 (socket says 172.21.15.104:37822) 2024-05-08T04:22:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff542d9d640 1 -- 172.21.15.104:0/1684731290 learned_addr learned my addr 172.21.15.104:0/1684731290 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff53bfff640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5440d07c0 0x7ff544160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff54259c640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5440ce5a0 0x7ff544142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff542d9d640 1 -- 172.21.15.104:0/1684731290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5440d07c0 msgr2=0x7ff544160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff542d9d640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5440d07c0 0x7ff544160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff542d9d640 1 -- 172.21.15.104:0/1684731290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5440ce5a0 msgr2=0x7ff544142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff542d9d640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5440ce5a0 0x7ff544142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff542d9d640 1 -- 172.21.15.104:0/1684731290 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff544160e10 con 0x7ff54415de10 2024-05-08T04:22:32.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff53bfff640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5440d07c0 0x7ff544160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:32.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff542d9d640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff54415de10 0x7ff5441608d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009d90 tx=0x7ff53c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:32.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff53affd640 1 -- 172.21.15.104:0/1684731290 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c040070 con 0x7ff54415de10 2024-05-08T04:22:32.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff53affd640 1 -- 172.21.15.104:0/1684731290 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c031b40 con 0x7ff54415de10 2024-05-08T04:22:32.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff548ccb640 1 -- 172.21.15.104:0/1684731290 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5441610c0 con 0x7ff54415de10 2024-05-08T04:22:32.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.074+0000 7ff53affd640 1 -- 172.21.15.104:0/1684731290 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c007e90 con 0x7ff54415de10 2024-05-08T04:22:32.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.075+0000 7ff548ccb640 1 -- 172.21.15.104:0/1684731290 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5440cb730 con 0x7ff54415de10 2024-05-08T04:22:32.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.075+0000 7ff548ccb640 1 -- 172.21.15.104:0/1684731290 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5440cb240 con 0x7ff54415de10 2024-05-08T04:22:32.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.076+0000 7ff53affd640 1 -- 172.21.15.104:0/1684731290 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7ff53c039040 con 0x7ff54415de10 2024-05-08T04:22:32.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.076+0000 7ff53affd640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff52406b680 0x7ff52406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.076+0000 7ff53affd640 1 -- 172.21.15.104:0/1684731290 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff53c0ab760 con 0x7ff54415de10 2024-05-08T04:22:32.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.076+0000 7ff54259c640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff52406b680 0x7ff52406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.077+0000 7ff54259c640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff52406b680 0x7ff52406db40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff534005880 tx=0x7ff534009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:32.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.080+0000 7ff53affd640 1 -- 172.21.15.104:0/1684731290 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff53c07a1d0 con 0x7ff54415de10 2024-05-08T04:22:32.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.287+0000 7ff548ccb640 1 -- 172.21.15.104:0/1684731290 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff544075010 con 0x7ff54415de10 2024-05-08T04:22:32.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.287+0000 7ff53affd640 1 -- 172.21.15.104:0/1684731290 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7ff53c079ad0 con 0x7ff54415de10 2024-05-08T04:22:32.289 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:32.289 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4933,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3121320604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3121320604},{"type":"v1","addr":"172.21.15.183:6834","nonce":3121320604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/207909171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":207909171},{"type":"v1","addr":"172.21.15.183:6835","nonce":207909171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/4245686743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4245686743},{"type":"v1","addr":"172.21.15.104:6836","nonce":4245686743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:07.933747+0000","modified":"2024-05-08T04:22:09.941364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/4038606624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":4038606624},{"type":"v1","addr":"172.21.15.104:6837","nonce":4038606624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T04:22:32.289 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 15 2024-05-08T04:22:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.290+0000 7ff548ccb640 1 -- 172.21.15.104:0/1684731290 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff52406b680 msgr2=0x7ff52406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.290+0000 7ff548ccb640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff52406b680 0x7ff52406db40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff534005880 tx=0x7ff534009040 comp rx=0 tx=0).stop 2024-05-08T04:22:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.290+0000 7ff548ccb640 1 -- 172.21.15.104:0/1684731290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff54415de10 msgr2=0x7ff5441608d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.290+0000 7ff548ccb640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff54415de10 0x7ff5441608d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff53c009d90 tx=0x7ff53c004a40 comp rx=0 tx=0).stop 2024-05-08T04:22:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.290+0000 7ff548ccb640 1 -- 172.21.15.104:0/1684731290 shutdown_connections 2024-05-08T04:22:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.290+0000 7ff548ccb640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff52406b680 0x7ff52406db40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.290+0000 7ff548ccb640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff54415de10 0x7ff5441608d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.290+0000 7ff548ccb640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5440d07c0 0x7ff544160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.290+0000 7ff548ccb640 1 --2- 172.21.15.104:0/1684731290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5440ce5a0 0x7ff544142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.290+0000 7ff548ccb640 1 -- 172.21.15.104:0/1684731290 >> 172.21.15.104:0/1684731290 conn(0x7ff544072290 msgr2=0x7ff54415a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:32.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.290+0000 7ff548ccb640 1 -- 172.21.15.104:0/1684731290 shutdown_connections 2024-05-08T04:22:32.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.290+0000 7ff548ccb640 1 -- 172.21.15.104:0/1684731290 wait complete. 2024-05-08T04:22:32.302 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.400+0000 7f9064a38640 1 Processor -- start 2024-05-08T04:22:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.400+0000 7f9064a38640 1 -- start start 2024-05-08T04:22:32.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.401+0000 7f9064a38640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f90600715d0 0x7f90600719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.401+0000 7f9064a38640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90600725b0 0x7f90600cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.401+0000 7f9064a38640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9060071ef0 con 0x7f90600cf190 2024-05-08T04:22:32.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.401+0000 7f9064a38640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90600cf680 con 0x7f90600715d0 2024-05-08T04:22:32.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.401+0000 7f9064a38640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906015c240 con 0x7f90600725b0 2024-05-08T04:22:32.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.401+0000 7f905dd9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90600725b0 0x7f90600cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.401+0000 7f905dd9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90600725b0 0x7f90600cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:39872/0 (socket says 172.21.15.104:39872) 2024-05-08T04:22:32.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.401+0000 7f905dd9b640 1 -- 172.21.15.104:0/1208321609 learned_addr learned my addr 172.21.15.104:0/1208321609 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:32.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.401+0000 7f905e59c640 1 --2- 172.21.15.104:0/1208321609 >> v2:172.21.15.183:3300/0 conn(0x7f90600715d0 0x7f90600719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.402+0000 7f905dd9b640 1 -- 172.21.15.104:0/1208321609 >> v2:172.21.15.183:3300/0 conn(0x7f90600715d0 msgr2=0x7f90600719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:32.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.402+0000 7f905dd9b640 1 --2- 172.21.15.104:0/1208321609 >> v2:172.21.15.183:3300/0 conn(0x7f90600715d0 0x7f90600719b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.402+0000 7f905dd9b640 1 -- 172.21.15.104:0/1208321609 >> v1:172.21.15.183:6789/0 conn(0x7f90600cf190 legacy=0x7f906015f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.402+0000 7f905dd9b640 1 -- 172.21.15.104:0/1208321609 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906015c520 con 0x7f90600725b0 2024-05-08T04:22:32.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.402+0000 7f905dd9b640 1 --2- 172.21.15.104:0/1208321609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90600725b0 0x7f90600cec50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9048009870 tx=0x7f904802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a51bf1d806d826fd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:32.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.403+0000 7f905d59a640 1 -- 172.21.15.104:0/1208321609 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048037070 con 0x7f90600725b0 2024-05-08T04:22:32.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.403+0000 7f905d59a640 1 -- 172.21.15.104:0/1208321609 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9048032440 con 0x7f90600725b0 2024-05-08T04:22:32.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.403+0000 7f905d59a640 1 -- 172.21.15.104:0/1208321609 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048032810 con 0x7f90600725b0 2024-05-08T04:22:32.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.403+0000 7f9064a38640 1 -- 172.21.15.104:0/1208321609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90600725b0 msgr2=0x7f90600cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.403+0000 7f9064a38640 1 --2- 172.21.15.104:0/1208321609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90600725b0 0x7f90600cec50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9048009870 tx=0x7f904802a130 comp rx=0 tx=0).stop 2024-05-08T04:22:32.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.403+0000 7f9064a38640 1 -- 172.21.15.104:0/1208321609 shutdown_connections 2024-05-08T04:22:32.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.403+0000 7f9064a38640 1 --2- 172.21.15.104:0/1208321609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90600725b0 0x7f90600cec50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.403+0000 7f9064a38640 1 --2- 172.21.15.104:0/1208321609 >> v2:172.21.15.183:3300/0 conn(0x7f90600715d0 0x7f90600719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.403+0000 7f9064a38640 1 -- 172.21.15.104:0/1208321609 >> 172.21.15.104:0/1208321609 conn(0x7f90600cfa60 msgr2=0x7f90600cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:32.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.403+0000 7f9064a38640 1 -- 172.21.15.104:0/1208321609 shutdown_connections 2024-05-08T04:22:32.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.403+0000 7f9064a38640 1 -- 172.21.15.104:0/1208321609 wait complete. 2024-05-08T04:22:32.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.405+0000 7f9064a38640 1 Processor -- start 2024-05-08T04:22:32.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.405+0000 7f9064a38640 1 -- start start 2024-05-08T04:22:32.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.405+0000 7f9064a38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90600715d0 0x7f906013d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.405+0000 7f9064a38640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90600725b0 0x7f906013b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.405+0000 7f9064a38640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90600cf190 0x7f9060143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.405+0000 7f9064a38640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906015cea0 con 0x7f90600715d0 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.405+0000 7f9064a38640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906015cd20 con 0x7f90600725b0 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.405+0000 7f9064a38640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90601f2270 con 0x7f90600cf190 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.405+0000 7f905e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90600715d0 0x7f906013d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.405+0000 7f905e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90600715d0 0x7f906013d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37830/0 (socket says 172.21.15.104:37830) 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.405+0000 7f905e59c640 1 -- 172.21.15.104:0/1002494404 learned_addr learned my addr 172.21.15.104:0/1002494404 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.406+0000 7f905ed9d640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90600cf190 0x7f9060143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.406+0000 7f905dd9b640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90600725b0 0x7f906013b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.406+0000 7f905e59c640 1 -- 172.21.15.104:0/1002494404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90600cf190 msgr2=0x7f9060143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.406+0000 7f905e59c640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90600cf190 0x7f9060143700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.406+0000 7f905e59c640 1 -- 172.21.15.104:0/1002494404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90600725b0 msgr2=0x7f906013b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.406+0000 7f905e59c640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90600725b0 0x7f906013b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.406+0000 7f905e59c640 1 -- 172.21.15.104:0/1002494404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90601f2550 con 0x7f90600715d0 2024-05-08T04:22:32.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.406+0000 7f905e59c640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90600715d0 0x7f906013d9d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f905000efc0 tx=0x7f905000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:32.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.406+0000 7f9056ffd640 1 -- 172.21.15.104:0/1002494404 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050018020 con 0x7f90600715d0 2024-05-08T04:22:32.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.406+0000 7f9056ffd640 1 -- 172.21.15.104:0/1002494404 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9050014480 con 0x7f90600715d0 2024-05-08T04:22:32.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.406+0000 7f9056ffd640 1 -- 172.21.15.104:0/1002494404 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050014850 con 0x7f90600715d0 2024-05-08T04:22:32.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.406+0000 7f9064a38640 1 -- 172.21.15.104:0/1002494404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90601f2830 con 0x7f90600715d0 2024-05-08T04:22:32.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.406+0000 7f9064a38640 1 -- 172.21.15.104:0/1002494404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906013b570 con 0x7f90600715d0 2024-05-08T04:22:32.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.407+0000 7f9064a38640 1 -- 172.21.15.104:0/1002494404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90601f2d50 con 0x7f90600715d0 2024-05-08T04:22:32.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.408+0000 7f9056ffd640 1 -- 172.21.15.104:0/1002494404 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f9050005d10 con 0x7f90600715d0 2024-05-08T04:22:32.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.408+0000 7f9056ffd640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f904006b680 0x7f904006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.408+0000 7f9056ffd640 1 -- 172.21.15.104:0/1002494404 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f905008af30 con 0x7f90600715d0 2024-05-08T04:22:32.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.408+0000 7f905dd9b640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f904006b680 0x7f904006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.408+0000 7f905dd9b640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f904006b680 0x7f904006db40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9048034000 tx=0x7f904802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:32.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.412+0000 7f9056ffd640 1 -- 172.21.15.104:0/1002494404 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f90601f2d50 con 0x7f90600715d0 2024-05-08T04:22:32.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.585+0000 7f9064a38640 1 -- 172.21.15.104:0/1002494404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9060075010 con 0x7f90600715d0 2024-05-08T04:22:32.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.586+0000 7f9056ffd640 1 -- 172.21.15.104:0/1002494404 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f9050022070 con 0x7f90600715d0 2024-05-08T04:22:32.588 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:32.588 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":33,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:09.602236+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:05.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:06.917080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:32.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.588+0000 7f9064a38640 1 -- 172.21.15.104:0/1002494404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f904006b680 msgr2=0x7f904006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.588+0000 7f9064a38640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f904006b680 0x7f904006db40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9048034000 tx=0x7f904802e000 comp rx=0 tx=0).stop 2024-05-08T04:22:32.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.588+0000 7f9064a38640 1 -- 172.21.15.104:0/1002494404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90600715d0 msgr2=0x7f906013d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.588+0000 7f9064a38640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90600715d0 0x7f906013d9d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f905000efc0 tx=0x7f905000c490 comp rx=0 tx=0).stop 2024-05-08T04:22:32.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.588+0000 7f9064a38640 1 -- 172.21.15.104:0/1002494404 shutdown_connections 2024-05-08T04:22:32.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.588+0000 7f9064a38640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f904006b680 0x7f904006db40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.588+0000 7f9064a38640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90600725b0 0x7f906013b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.588+0000 7f9064a38640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90600cf190 0x7f9060143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.588+0000 7f9064a38640 1 --2- 172.21.15.104:0/1002494404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90600715d0 0x7f906013d9d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.588+0000 7f9064a38640 1 -- 172.21.15.104:0/1002494404 >> 172.21.15.104:0/1002494404 conn(0x7f90600cfa60 msgr2=0x7f9060158330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:32.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.588+0000 7f9064a38640 1 -- 172.21.15.104:0/1002494404 shutdown_connections 2024-05-08T04:22:32.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.588+0000 7f9064a38640 1 -- 172.21.15.104:0/1002494404 wait complete. 2024-05-08T04:22:32.601 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T04:22:32.601 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:22:32.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.701+0000 7f9756fe7640 1 Processor -- start 2024-05-08T04:22:32.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.701+0000 7f9756fe7640 1 -- start start 2024-05-08T04:22:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f9756fe7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9750070c70 0x7f9750071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f9756fe7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9750157ac0 0x7f9750157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f9756fe7640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9750071590 con 0x7f975015edf0 2024-05-08T04:22:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f9756fe7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975006bc70 con 0x7f9750157ac0 2024-05-08T04:22:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f9756fe7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97500d15c0 con 0x7f9750070c70 2024-05-08T04:22:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f9747fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f975015edf0 0x7f97500b52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:47014/0 (socket says 172.21.15.104:47014) 2024-05-08T04:22:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f9747fff640 1 -- 172.21.15.104:0/3457586151 learned_addr learned my addr 172.21.15.104:0/3457586151 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f9754d83640 1 --2- 172.21.15.104:0/3457586151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9750070c70 0x7f9750071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f9755584640 1 --2- 172.21.15.104:0/3457586151 >> v2:172.21.15.183:3300/0 conn(0x7f9750157ac0 0x7f9750157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f97477fe640 1 -- 172.21.15.104:0/3457586151 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409475755 0 0) 0x7f9750071590 con 0x7f975015edf0 2024-05-08T04:22:32.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f97477fe640 1 -- 172.21.15.104:0/3457586151 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9738003520 con 0x7f975015edf0 2024-05-08T04:22:32.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f9754d83640 1 -- 172.21.15.104:0/3457586151 >> v2:172.21.15.183:3300/0 conn(0x7f9750157ac0 msgr2=0x7f9750157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:32.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f9754d83640 1 --2- 172.21.15.104:0/3457586151 >> v2:172.21.15.183:3300/0 conn(0x7f9750157ac0 0x7f9750157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f97477fe640 1 -- 172.21.15.104:0/3457586151 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2835508932 0 0) 0x7f9738003520 con 0x7f975015edf0 2024-05-08T04:22:32.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f9754d83640 1 -- 172.21.15.104:0/3457586151 >> v1:172.21.15.104:6789/0 conn(0x7f975015edf0 legacy=0x7f97500b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.702+0000 7f9754d83640 1 -- 172.21.15.104:0/3457586151 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975015f550 con 0x7f9750070c70 2024-05-08T04:22:32.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.703+0000 7f9754d83640 1 --2- 172.21.15.104:0/3457586151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9750070c70 0x7f9750071050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f974c0097a0 tx=0x7f974c02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fca1b3dfc5cd7406 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:32.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.703+0000 7f97477fe640 1 -- 172.21.15.104:0/3457586151 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c037070 con 0x7f9750070c70 2024-05-08T04:22:32.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.703+0000 7f97477fe640 1 -- 172.21.15.104:0/3457586151 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c02aba0 con 0x7f9750070c70 2024-05-08T04:22:32.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.703+0000 7f97477fe640 1 -- 172.21.15.104:0/3457586151 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740001670 con 0x7f9750070c70 2024-05-08T04:22:32.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.704+0000 7f9756fe7640 1 -- 172.21.15.104:0/3457586151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9750070c70 msgr2=0x7f9750071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.704+0000 7f9756fe7640 1 --2- 172.21.15.104:0/3457586151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9750070c70 0x7f9750071050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f974c0097a0 tx=0x7f974c02a110 comp rx=0 tx=0).stop 2024-05-08T04:22:32.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.704+0000 7f9756fe7640 1 -- 172.21.15.104:0/3457586151 shutdown_connections 2024-05-08T04:22:32.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.704+0000 7f9756fe7640 1 --2- 172.21.15.104:0/3457586151 >> v2:172.21.15.183:3300/0 conn(0x7f9750157ac0 0x7f9750157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.704+0000 7f9756fe7640 1 --2- 172.21.15.104:0/3457586151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9750070c70 0x7f9750071050 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.704+0000 7f9756fe7640 1 -- 172.21.15.104:0/3457586151 >> 172.21.15.104:0/3457586151 conn(0x7f97500b3450 msgr2=0x7f97500b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:32.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.704+0000 7f9756fe7640 1 -- 172.21.15.104:0/3457586151 shutdown_connections 2024-05-08T04:22:32.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.704+0000 7f9756fe7640 1 -- 172.21.15.104:0/3457586151 wait complete. 2024-05-08T04:22:32.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.705+0000 7f9756fe7640 1 Processor -- start 2024-05-08T04:22:32.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.705+0000 7f9756fe7640 1 -- start start 2024-05-08T04:22:32.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9756fe7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9750070c70 0x7f9750160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9756fe7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9750157ac0 0x7f9750161860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9756fe7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f975015edf0 0x7f97500cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9756fe7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97500b5b80 con 0x7f9750070c70 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9756fe7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975015fb10 con 0x7f975015edf0 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9756fe7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9750158490 con 0x7f9750157ac0 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9754d83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9750070c70 0x7f9750160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9754d83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9750070c70 0x7f9750160e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37840/0 (socket says 172.21.15.104:37840) 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9754d83640 1 -- 172.21.15.104:0/3384812073 learned_addr learned my addr 172.21.15.104:0/3384812073 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9754d83640 1 -- 172.21.15.104:0/3384812073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9750157ac0 msgr2=0x7f9750161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9755584640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f975015edf0 0x7f97500cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9747fff640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9750157ac0 0x7f9750161860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9754d83640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9750157ac0 0x7f9750161860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9754d83640 1 -- 172.21.15.104:0/3384812073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f975015edf0 msgr2=0x7f97500cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9754d83640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f975015edf0 0x7f97500cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9754d83640 1 -- 172.21.15.104:0/3384812073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9750161da0 con 0x7f9750070c70 2024-05-08T04:22:32.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9747fff640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9750157ac0 0x7f9750161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.706+0000 7f9755584640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f975015edf0 0x7f97500cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.707+0000 7f9754d83640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9750070c70 0x7f9750160e70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f974c035040 tx=0x7f974c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.707+0000 7f97457fa640 1 -- 172.21.15.104:0/3384812073 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c042020 con 0x7f9750070c70 2024-05-08T04:22:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.707+0000 7f97457fa640 1 -- 172.21.15.104:0/3384812073 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c03d670 con 0x7f9750070c70 2024-05-08T04:22:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.707+0000 7f9756fe7640 1 -- 172.21.15.104:0/3384812073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9750162040 con 0x7f9750070c70 2024-05-08T04:22:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.707+0000 7f97457fa640 1 -- 172.21.15.104:0/3384812073 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c037040 con 0x7f9750070c70 2024-05-08T04:22:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.707+0000 7f9756fe7640 1 -- 172.21.15.104:0/3384812073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97500ceaa0 con 0x7f9750070c70 2024-05-08T04:22:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.708+0000 7f9756fe7640 1 -- 172.21.15.104:0/3384812073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9750075010 con 0x7f9750070c70 2024-05-08T04:22:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.708+0000 7f97457fa640 1 -- 172.21.15.104:0/3384812073 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f974c045020 con 0x7f9750070c70 2024-05-08T04:22:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.708+0000 7f97457fa640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f973c06b680 0x7f973c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.709+0000 7f97457fa640 1 -- 172.21.15.104:0/3384812073 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f974c0aad60 con 0x7f9750070c70 2024-05-08T04:22:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.709+0000 7f9747fff640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f973c06b680 0x7f973c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:32.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.709+0000 7f9747fff640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f973c06b680 0x7f973c06db40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9740001eb0 tx=0x7f9740009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:32.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.713+0000 7f97457fa640 1 -- 172.21.15.104:0/3384812073 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f974c04c030 con 0x7f9750070c70 2024-05-08T04:22:32.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.924+0000 7f9756fe7640 1 -- 172.21.15.104:0/3384812073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9750071a50 con 0x7f9750070c70 2024-05-08T04:22:32.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.924+0000 7f97457fa640 1 -- 172.21.15.104:0/3384812073 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f974c0799f0 con 0x7f9750070c70 2024-05-08T04:22:32.926 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:32.926 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4933,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3121320604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3121320604},{"type":"v1","addr":"172.21.15.183:6834","nonce":3121320604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/207909171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":207909171},{"type":"v1","addr":"172.21.15.183:6835","nonce":207909171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/4245686743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4245686743},{"type":"v1","addr":"172.21.15.104:6836","nonce":4245686743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:07.933747+0000","modified":"2024-05-08T04:22:09.941364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/4038606624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":4038606624},{"type":"v1","addr":"172.21.15.104:6837","nonce":4038606624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T04:22:32.926 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 15 2024-05-08T04:22:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.926+0000 7f9756fe7640 1 -- 172.21.15.104:0/3384812073 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f973c06b680 msgr2=0x7f973c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.926+0000 7f9756fe7640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f973c06b680 0x7f973c06db40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9740001eb0 tx=0x7f9740009040 comp rx=0 tx=0).stop 2024-05-08T04:22:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.926+0000 7f9756fe7640 1 -- 172.21.15.104:0/3384812073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9750070c70 msgr2=0x7f9750160e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.926+0000 7f9756fe7640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9750070c70 0x7f9750160e70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f974c035040 tx=0x7f974c0046c0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.926+0000 7f9756fe7640 1 -- 172.21.15.104:0/3384812073 shutdown_connections 2024-05-08T04:22:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.926+0000 7f9756fe7640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f973c06b680 0x7f973c06db40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.926+0000 7f9756fe7640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f975015edf0 0x7f97500cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.926+0000 7f9756fe7640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9750157ac0 0x7f9750161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.926+0000 7f9756fe7640 1 --2- 172.21.15.104:0/3384812073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9750070c70 0x7f9750160e70 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.926+0000 7f9756fe7640 1 -- 172.21.15.104:0/3384812073 >> 172.21.15.104:0/3384812073 conn(0x7f97500b3450 msgr2=0x7f975015bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.927+0000 7f9756fe7640 1 -- 172.21.15.104:0/3384812073 shutdown_connections 2024-05-08T04:22:32.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:32.927+0000 7f9756fe7640 1 -- 172.21.15.104:0/3384812073 wait complete. 2024-05-08T04:22:32.939 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:22:33.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.038+0000 7f68ad2b6640 1 Processor -- start 2024-05-08T04:22:33.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.038+0000 7f68ad2b6640 1 -- start start 2024-05-08T04:22:33.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.038+0000 7f68ad2b6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f68a815de10 0x7f68a8161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.038+0000 7f68ad2b6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a80ce5a0 0x7f68a80d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.038+0000 7f68ad2b6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a80d3210 con 0x7f68a80d05f0 2024-05-08T04:22:33.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.038+0000 7f68ad2b6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a80d0f50 con 0x7f68a815de10 2024-05-08T04:22:33.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.038+0000 7f68ad2b6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a8161e60 con 0x7f68a80ce5a0 2024-05-08T04:22:33.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.039+0000 7f68a67fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a80ce5a0 0x7f68a80d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.039+0000 7f68a6ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f68a815de10 0x7f68a8161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.039+0000 7f68a67fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a80ce5a0 0x7f68a80d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:39906/0 (socket says 172.21.15.104:39906) 2024-05-08T04:22:33.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.039+0000 7f68a67fc640 1 -- 172.21.15.104:0/1507879228 learned_addr learned my addr 172.21.15.104:0/1507879228 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:33.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.039+0000 7f68a67fc640 1 -- 172.21.15.104:0/1507879228 >> v2:172.21.15.183:3300/0 conn(0x7f68a815de10 msgr2=0x7f68a8161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:33.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.039+0000 7f68a67fc640 1 --2- 172.21.15.104:0/1507879228 >> v2:172.21.15.183:3300/0 conn(0x7f68a815de10 0x7f68a8161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.039+0000 7f68a67fc640 1 -- 172.21.15.104:0/1507879228 >> v1:172.21.15.183:6789/0 conn(0x7f68a80d05f0 legacy=0x7f68a80b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.039+0000 7f68a67fc640 1 -- 172.21.15.104:0/1507879228 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a815e1f0 con 0x7f68a80ce5a0 2024-05-08T04:22:33.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.040+0000 7f68a67fc640 1 --2- 172.21.15.104:0/1507879228 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a80ce5a0 0x7f68a80d00b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f689c009870 tx=0x7f689c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2d8b08eb4ff4d0b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:33.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.040+0000 7f68a5ffb640 1 -- 172.21.15.104:0/1507879228 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c037070 con 0x7f68a80ce5a0 2024-05-08T04:22:33.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.040+0000 7f68a5ffb640 1 -- 172.21.15.104:0/1507879228 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c032440 con 0x7f68a80ce5a0 2024-05-08T04:22:33.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.040+0000 7f68a5ffb640 1 -- 172.21.15.104:0/1507879228 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c032810 con 0x7f68a80ce5a0 2024-05-08T04:22:33.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.041+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1507879228 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a80ce5a0 msgr2=0x7f68a80d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.041+0000 7f68ad2b6640 1 --2- 172.21.15.104:0/1507879228 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a80ce5a0 0x7f68a80d00b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f689c009870 tx=0x7f689c02a1c0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.041+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1507879228 shutdown_connections 2024-05-08T04:22:33.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.041+0000 7f68ad2b6640 1 --2- 172.21.15.104:0/1507879228 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a80ce5a0 0x7f68a80d00b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.041+0000 7f68ad2b6640 1 --2- 172.21.15.104:0/1507879228 >> v2:172.21.15.183:3300/0 conn(0x7f68a815de10 0x7f68a8161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.041+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1507879228 >> 172.21.15.104:0/1507879228 conn(0x7f68a8072290 msgr2=0x7f68a8072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:33.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.041+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1507879228 shutdown_connections 2024-05-08T04:22:33.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.041+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1507879228 wait complete. 2024-05-08T04:22:33.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.042+0000 7f68ad2b6640 1 Processor -- start 2024-05-08T04:22:33.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.042+0000 7f68ad2b6640 1 -- start start 2024-05-08T04:22:33.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68ad2b6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68a80ce5a0 0x7f68a80c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68ad2b6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68a80d05f0 0x7f68a8147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68ad2b6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a815de10 0x7f68a8160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68ad2b6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a8162090 con 0x7f68a80d05f0 2024-05-08T04:22:33.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68ad2b6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a80d1a90 con 0x7f68a80ce5a0 2024-05-08T04:22:33.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68ad2b6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a8162370 con 0x7f68a815de10 2024-05-08T04:22:33.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68a67fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68a80d05f0 0x7f68a8147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68a67fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68a80d05f0 0x7f68a8147840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37844/0 (socket says 172.21.15.104:37844) 2024-05-08T04:22:33.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68a67fc640 1 -- 172.21.15.104:0/1368638590 learned_addr learned my addr 172.21.15.104:0/1368638590 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:33.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68a77fe640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a815de10 0x7f68a8160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68a6ffd640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68a80ce5a0 0x7f68a80c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68a67fc640 1 -- 172.21.15.104:0/1368638590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a815de10 msgr2=0x7f68a8160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68a67fc640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a815de10 0x7f68a8160bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68a67fc640 1 -- 172.21.15.104:0/1368638590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68a80ce5a0 msgr2=0x7f68a80c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68a67fc640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68a80ce5a0 0x7f68a80c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68a67fc640 1 -- 172.21.15.104:0/1368638590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a80c9bc0 con 0x7f68a80d05f0 2024-05-08T04:22:33.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68a77fe640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a815de10 0x7f68a8160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:33.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68a67fc640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68a80d05f0 0x7f68a8147840 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f689c000c00 tx=0x7f689c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:33.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f688f7fe640 1 -- 172.21.15.104:0/1368638590 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c037040 con 0x7f68a80d05f0 2024-05-08T04:22:33.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f688f7fe640 1 -- 172.21.15.104:0/1368638590 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c042070 con 0x7f68a80d05f0 2024-05-08T04:22:33.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.043+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1368638590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a80cbd50 con 0x7f68a80d05f0 2024-05-08T04:22:33.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.044+0000 7f688f7fe640 1 -- 172.21.15.104:0/1368638590 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c030880 con 0x7f68a80d05f0 2024-05-08T04:22:33.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.044+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1368638590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a80cc310 con 0x7f68a80d05f0 2024-05-08T04:22:33.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.044+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1368638590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a8075010 con 0x7f68a80d05f0 2024-05-08T04:22:33.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.045+0000 7f688f7fe640 1 -- 172.21.15.104:0/1368638590 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f689c02ad10 con 0x7f68a80d05f0 2024-05-08T04:22:33.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.045+0000 7f688f7fe640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f689406b680 0x7f689406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.045+0000 7f688f7fe640 1 -- 172.21.15.104:0/1368638590 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f689c0aaa30 con 0x7f68a80d05f0 2024-05-08T04:22:33.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.045+0000 7f68a6ffd640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f689406b680 0x7f689406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.046+0000 7f68a6ffd640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f689406b680 0x7f689406db40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6898009a30 tx=0x7f6898008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:33.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.049+0000 7f688f7fe640 1 -- 172.21.15.104:0/1368638590 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f689c079630 con 0x7f68a80d05f0 2024-05-08T04:22:33.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.259+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1368638590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68a8162620 con 0x7f68a80d05f0 2024-05-08T04:22:33.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.259+0000 7f688f7fe640 1 -- 172.21.15.104:0/1368638590 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f689c078f30 con 0x7f68a80d05f0 2024-05-08T04:22:33.261 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:33.261 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4933,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3121320604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3121320604},{"type":"v1","addr":"172.21.15.183:6834","nonce":3121320604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/207909171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":207909171},{"type":"v1","addr":"172.21.15.183:6835","nonce":207909171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/4245686743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4245686743},{"type":"v1","addr":"172.21.15.104:6836","nonce":4245686743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:07.933747+0000","modified":"2024-05-08T04:22:09.941364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5214":{"gid":5214,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/4038606624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":4038606624},{"type":"v1","addr":"172.21.15.104:6837","nonce":4038606624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-08T04:22:33.261 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 15 2024-05-08T04:22:33.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.261+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1368638590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f689406b680 msgr2=0x7f689406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.261+0000 7f68ad2b6640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f689406b680 0x7f689406db40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6898009a30 tx=0x7f6898008040 comp rx=0 tx=0).stop 2024-05-08T04:22:33.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.261+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1368638590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68a80d05f0 msgr2=0x7f68a8147840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.261+0000 7f68ad2b6640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68a80d05f0 0x7f68a8147840 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f689c000c00 tx=0x7f689c0046c0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.261+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1368638590 shutdown_connections 2024-05-08T04:22:33.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.261+0000 7f68ad2b6640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f689406b680 0x7f689406db40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.261+0000 7f68ad2b6640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a815de10 0x7f68a8160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.261+0000 7f68ad2b6640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68a80d05f0 0x7f68a8147840 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.261+0000 7f68ad2b6640 1 --2- 172.21.15.104:0/1368638590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68a80ce5a0 0x7f68a80c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.261+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1368638590 >> 172.21.15.104:0/1368638590 conn(0x7f68a8072290 msgr2=0x7f68a815cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:33.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.262+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1368638590 shutdown_connections 2024-05-08T04:22:33.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.262+0000 7f68ad2b6640 1 -- 172.21.15.104:0/1368638590 wait complete. 2024-05-08T04:22:33.274 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:33.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.372+0000 7ff7929d5640 1 Processor -- start 2024-05-08T04:22:33.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.372+0000 7ff7929d5640 1 -- start start 2024-05-08T04:22:33.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.372+0000 7ff7929d5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff78c15de10 0x7ff78c161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.372+0000 7ff7929d5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff78c0ce5a0 0x7ff78c0d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.372+0000 7ff7929d5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c0d3210 con 0x7ff78c0d05f0 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.372+0000 7ff7929d5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c0d0f50 con 0x7ff78c0ce5a0 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.372+0000 7ff7929d5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c161e60 con 0x7ff78c15de10 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.373+0000 7ff783fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff78c0ce5a0 0x7ff78c0d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.373+0000 7ff790f72640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff78c0d05f0 0x7ff78c0b54a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:47026/0 (socket says 172.21.15.104:47026) 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.373+0000 7ff790f72640 1 -- 172.21.15.104:0/4136930972 learned_addr learned my addr 172.21.15.104:0/4136930972 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.373+0000 7ff78bfff640 1 --2- 172.21.15.104:0/4136930972 >> v2:172.21.15.183:3300/0 conn(0x7ff78c15de10 0x7ff78c161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.373+0000 7ff783fff640 1 -- 172.21.15.104:0/4136930972 >> v2:172.21.15.183:3300/0 conn(0x7ff78c15de10 msgr2=0x7ff78c161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.373+0000 7ff783fff640 1 --2- 172.21.15.104:0/4136930972 >> v2:172.21.15.183:3300/0 conn(0x7ff78c15de10 0x7ff78c161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.373+0000 7ff783fff640 1 -- 172.21.15.104:0/4136930972 >> v1:172.21.15.104:6789/0 conn(0x7ff78c0d05f0 legacy=0x7ff78c0b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.373+0000 7ff783fff640 1 -- 172.21.15.104:0/4136930972 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c15e1f0 con 0x7ff78c0ce5a0 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.373+0000 7ff78bfff640 1 --2- 172.21.15.104:0/4136930972 >> v2:172.21.15.183:3300/0 conn(0x7ff78c15de10 0x7ff78c161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.374+0000 7ff783fff640 1 --2- 172.21.15.104:0/4136930972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff78c0ce5a0 0x7ff78c0d00b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0d15a0 tx=0x7ff77402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b53e9cbb6fcddf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.374+0000 7ff78b7fe640 1 -- 172.21.15.104:0/4136930972 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774037070 con 0x7ff78c0ce5a0 2024-05-08T04:22:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.374+0000 7ff78b7fe640 1 -- 172.21.15.104:0/4136930972 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff774032440 con 0x7ff78c0ce5a0 2024-05-08T04:22:33.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.374+0000 7ff78b7fe640 1 -- 172.21.15.104:0/4136930972 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77402ae60 con 0x7ff78c0ce5a0 2024-05-08T04:22:33.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.374+0000 7ff7929d5640 1 -- 172.21.15.104:0/4136930972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff78c0ce5a0 msgr2=0x7ff78c0d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.374+0000 7ff7929d5640 1 --2- 172.21.15.104:0/4136930972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff78c0ce5a0 0x7ff78c0d00b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0d15a0 tx=0x7ff77402a110 comp rx=0 tx=0).stop 2024-05-08T04:22:33.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.374+0000 7ff7929d5640 1 -- 172.21.15.104:0/4136930972 shutdown_connections 2024-05-08T04:22:33.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.374+0000 7ff7929d5640 1 --2- 172.21.15.104:0/4136930972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff78c0ce5a0 0x7ff78c0d00b0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.374+0000 7ff7929d5640 1 --2- 172.21.15.104:0/4136930972 >> v2:172.21.15.183:3300/0 conn(0x7ff78c15de10 0x7ff78c161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.374+0000 7ff7929d5640 1 -- 172.21.15.104:0/4136930972 >> 172.21.15.104:0/4136930972 conn(0x7ff78c072290 msgr2=0x7ff78c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:33.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.374+0000 7ff7929d5640 1 -- 172.21.15.104:0/4136930972 shutdown_connections 2024-05-08T04:22:33.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.374+0000 7ff7929d5640 1 -- 172.21.15.104:0/4136930972 wait complete. 2024-05-08T04:22:33.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.375+0000 7ff7929d5640 1 Processor -- start 2024-05-08T04:22:33.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.376+0000 7ff7929d5640 1 -- start start 2024-05-08T04:22:33.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.376+0000 7ff7929d5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff78c0ce5a0 0x7ff78c14ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.376+0000 7ff7929d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff78c0d05f0 0x7ff78c15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.376+0000 7ff7929d5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff78c15de10 0x7ff78c0d2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.376+0000 7ff7929d5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c162090 con 0x7ff78c15de10 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.376+0000 7ff7929d5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c0d1a90 con 0x7ff78c0ce5a0 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.376+0000 7ff7929d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c162370 con 0x7ff78c0d05f0 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.376+0000 7ff790f72640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff78c15de10 0x7ff78c0d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.376+0000 7ff790f72640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff78c15de10 0x7ff78c0d2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37856/0 (socket says 172.21.15.104:37856) 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.376+0000 7ff790f72640 1 -- 172.21.15.104:0/1567353873 learned_addr learned my addr 172.21.15.104:0/1567353873 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.377+0000 7ff783fff640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff78c0d05f0 0x7ff78c15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.377+0000 7ff78bfff640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff78c0ce5a0 0x7ff78c14ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.377+0000 7ff790f72640 1 -- 172.21.15.104:0/1567353873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff78c0d05f0 msgr2=0x7ff78c15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.377+0000 7ff790f72640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff78c0d05f0 0x7ff78c15eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.377+0000 7ff790f72640 1 -- 172.21.15.104:0/1567353873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff78c0ce5a0 msgr2=0x7ff78c14ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.377+0000 7ff790f72640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff78c0ce5a0 0x7ff78c14ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.377+0000 7ff790f72640 1 -- 172.21.15.104:0/1567353873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c0cc980 con 0x7ff78c15de10 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.377+0000 7ff790f72640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff78c15de10 0x7ff78c0d2050 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff78400cbc0 tx=0x7ff78400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:33.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.377+0000 7ff7897fa640 1 -- 172.21.15.104:0/1567353873 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784017070 con 0x7ff78c15de10 2024-05-08T04:22:33.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.377+0000 7ff7897fa640 1 -- 172.21.15.104:0/1567353873 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78400ad40 con 0x7ff78c15de10 2024-05-08T04:22:33.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.377+0000 7ff7929d5640 1 -- 172.21.15.104:0/1567353873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c0ccc60 con 0x7ff78c15de10 2024-05-08T04:22:33.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.377+0000 7ff7897fa640 1 -- 172.21.15.104:0/1567353873 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784012600 con 0x7ff78c15de10 2024-05-08T04:22:33.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.377+0000 7ff7929d5640 1 -- 172.21.15.104:0/1567353873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c0cc640 con 0x7ff78c15de10 2024-05-08T04:22:33.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.378+0000 7ff7929d5640 1 -- 172.21.15.104:0/1567353873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78c075010 con 0x7ff78c15de10 2024-05-08T04:22:33.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.378+0000 7ff7897fa640 1 -- 172.21.15.104:0/1567353873 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7ff78401a070 con 0x7ff78c15de10 2024-05-08T04:22:33.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.379+0000 7ff7897fa640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff76c06b680 0x7ff76c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.379+0000 7ff78bfff640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff76c06b680 0x7ff76c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.379+0000 7ff7897fa640 1 -- 172.21.15.104:0/1567353873 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff78408a130 con 0x7ff78c15de10 2024-05-08T04:22:33.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.379+0000 7ff78bfff640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff76c06b680 0x7ff76c06db40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00a950 tx=0x7ff77c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:33.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.383+0000 7ff7897fa640 1 -- 172.21.15.104:0/1567353873 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff784058770 con 0x7ff78c15de10 2024-05-08T04:22:33.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.556+0000 7ff7929d5640 1 -- 172.21.15.104:0/1567353873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff78c15bb10 con 0x7ff78c15de10 2024-05-08T04:22:33.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.557+0000 7ff7897fa640 1 -- 172.21.15.104:0/1567353873 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16669 (secure 0 0 0) 0x7ff78405c810 con 0x7ff78c15de10 2024-05-08T04:22:33.559 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:33.559 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":33,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:09.602236+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:05.786250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:06.917080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:33.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.560+0000 7ff7929d5640 1 -- 172.21.15.104:0/1567353873 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff76c06b680 msgr2=0x7ff76c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.560+0000 7ff7929d5640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff76c06b680 0x7ff76c06db40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00a950 tx=0x7ff77c008040 comp rx=0 tx=0).stop 2024-05-08T04:22:33.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.560+0000 7ff7929d5640 1 -- 172.21.15.104:0/1567353873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff78c15de10 msgr2=0x7ff78c0d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.560+0000 7ff7929d5640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff78c15de10 0x7ff78c0d2050 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff78400cbc0 tx=0x7ff78400a430 comp rx=0 tx=0).stop 2024-05-08T04:22:33.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.560+0000 7ff7929d5640 1 -- 172.21.15.104:0/1567353873 shutdown_connections 2024-05-08T04:22:33.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.560+0000 7ff7929d5640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff76c06b680 0x7ff76c06db40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.560+0000 7ff7929d5640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff78c15de10 0x7ff78c0d2050 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.560+0000 7ff7929d5640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff78c0d05f0 0x7ff78c15eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.560+0000 7ff7929d5640 1 --2- 172.21.15.104:0/1567353873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff78c0ce5a0 0x7ff78c14ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.560+0000 7ff7929d5640 1 -- 172.21.15.104:0/1567353873 >> 172.21.15.104:0/1567353873 conn(0x7ff78c072290 msgr2=0x7ff78c0cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:33.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.560+0000 7ff7929d5640 1 -- 172.21.15.104:0/1567353873 shutdown_connections 2024-05-08T04:22:33.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.560+0000 7ff7929d5640 1 -- 172.21.15.104:0/1567353873 wait complete. 2024-05-08T04:22:33.572 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T04:22:33.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.672+0000 7f70e51b0640 1 Processor -- start 2024-05-08T04:22:33.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.672+0000 7f70e51b0640 1 -- start start 2024-05-08T04:22:33.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.672+0000 7f70e51b0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f70e015de10 0x7f70e0161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.672+0000 7f70e51b0640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e015e1f0 con 0x7f70e00d07c0 2024-05-08T04:22:33.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.672+0000 7f70e51b0640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e0162090 con 0x7f70e00ce5a0 2024-05-08T04:22:33.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.672+0000 7f70e51b0640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e00d0f50 con 0x7f70e015de10 2024-05-08T04:22:33.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.673+0000 7f70ded9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f70e015de10 0x7f70e0161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.673+0000 7f70df59e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f70e00d07c0 0x7f70e00d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:47028/0 (socket says 172.21.15.104:47028) 2024-05-08T04:22:33.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.673+0000 7f70df59e640 1 -- 172.21.15.104:0/4191362117 learned_addr learned my addr 172.21.15.104:0/4191362117 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:33.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.673+0000 7f70ded9d640 1 -- 172.21.15.104:0/4191362117 >> v1:172.21.15.183:6789/0 conn(0x7f70e00ce5a0 legacy=0x7f70e00d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.673+0000 7f70ded9d640 1 -- 172.21.15.104:0/4191362117 >> v1:172.21.15.104:6789/0 conn(0x7f70e00d07c0 legacy=0x7f70e00d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.673+0000 7f70ded9d640 1 -- 172.21.15.104:0/4191362117 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0162370 con 0x7f70e015de10 2024-05-08T04:22:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.674+0000 7f70ded9d640 1 --2- 172.21.15.104:0/4191362117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70e015de10 0x7f70e0161920 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f70d00097a0 tx=0x7f70d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1b54c61a4a940a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.674+0000 7f70de59c640 1 -- 172.21.15.104:0/4191362117 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0037070 con 0x7f70e015de10 2024-05-08T04:22:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.674+0000 7f70de59c640 1 -- 172.21.15.104:0/4191362117 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d0032440 con 0x7f70e015de10 2024-05-08T04:22:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.674+0000 7f70de59c640 1 -- 172.21.15.104:0/4191362117 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0032810 con 0x7f70e015de10 2024-05-08T04:22:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.674+0000 7f70e51b0640 1 -- 172.21.15.104:0/4191362117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70e015de10 msgr2=0x7f70e0161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.674+0000 7f70e51b0640 1 --2- 172.21.15.104:0/4191362117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70e015de10 0x7f70e0161920 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f70d00097a0 tx=0x7f70d002a1a0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.674+0000 7f70e51b0640 1 -- 172.21.15.104:0/4191362117 shutdown_connections 2024-05-08T04:22:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.674+0000 7f70e51b0640 1 --2- 172.21.15.104:0/4191362117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70e015de10 0x7f70e0161920 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.674+0000 7f70e51b0640 1 -- 172.21.15.104:0/4191362117 >> 172.21.15.104:0/4191362117 conn(0x7f70e0072290 msgr2=0x7f70e0072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:33.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.674+0000 7f70e51b0640 1 -- 172.21.15.104:0/4191362117 shutdown_connections 2024-05-08T04:22:33.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.674+0000 7f70e51b0640 1 -- 172.21.15.104:0/4191362117 wait complete. 2024-05-08T04:22:33.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.676+0000 7f70e51b0640 1 Processor -- start 2024-05-08T04:22:33.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.676+0000 7f70e51b0640 1 -- start start 2024-05-08T04:22:33.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.676+0000 7f70e51b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70e00ce5a0 0x7f70e014e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.676+0000 7f70e51b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70e00d07c0 0x7f70e01e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.676+0000 7f70e51b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70e015de10 0x7f70e01e8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.676+0000 7f70e51b0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00d1a90 con 0x7f70e00d07c0 2024-05-08T04:22:33.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.676+0000 7f70e51b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00d1ce0 con 0x7f70e00ce5a0 2024-05-08T04:22:33.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.676+0000 7f70e51b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00b6dc0 con 0x7f70e015de10 2024-05-08T04:22:33.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.676+0000 7f70d7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70e00d07c0 0x7f70e01e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.676+0000 7f70d7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70e00d07c0 0x7f70e01e7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37874/0 (socket says 172.21.15.104:37874) 2024-05-08T04:22:33.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.676+0000 7f70d7fff640 1 -- 172.21.15.104:0/2593454964 learned_addr learned my addr 172.21.15.104:0/2593454964 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:33.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.677+0000 7f70ded9d640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70e00ce5a0 0x7f70e014e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.677+0000 7f70df59e640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70e015de10 0x7f70e01e8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.677+0000 7f70d7fff640 1 -- 172.21.15.104:0/2593454964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70e015de10 msgr2=0x7f70e01e8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.677+0000 7f70d7fff640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70e015de10 0x7f70e01e8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.677+0000 7f70d7fff640 1 -- 172.21.15.104:0/2593454964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70e00ce5a0 msgr2=0x7f70e014e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.677+0000 7f70d7fff640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70e00ce5a0 0x7f70e014e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.677+0000 7f70d7fff640 1 -- 172.21.15.104:0/2593454964 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00b43e0 con 0x7f70e00d07c0 2024-05-08T04:22:33.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.677+0000 7f70d7fff640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70e00d07c0 0x7f70e01e7d30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f70c800c430 tx=0x7f70c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:33.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.677+0000 7f70d77fe640 1 -- 172.21.15.104:0/2593454964 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c80052d0 con 0x7f70e00d07c0 2024-05-08T04:22:33.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.677+0000 7f70d77fe640 1 -- 172.21.15.104:0/2593454964 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c8005490 con 0x7f70e00d07c0 2024-05-08T04:22:33.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.677+0000 7f70d77fe640 1 -- 172.21.15.104:0/2593454964 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8007260 con 0x7f70e00d07c0 2024-05-08T04:22:33.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.677+0000 7f70e51b0640 1 -- 172.21.15.104:0/2593454964 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e00b46c0 con 0x7f70e00d07c0 2024-05-08T04:22:33.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.677+0000 7f70e51b0640 1 -- 172.21.15.104:0/2593454964 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e015a160 con 0x7f70e00d07c0 2024-05-08T04:22:33.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.678+0000 7f70e51b0640 1 -- 172.21.15.104:0/2593454964 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e0075010 con 0x7f70e00d07c0 2024-05-08T04:22:33.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.678+0000 7f70d77fe640 1 -- 172.21.15.104:0/2593454964 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f70c8007400 con 0x7f70e00d07c0 2024-05-08T04:22:33.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.679+0000 7f70d77fe640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f70c006b680 0x7f70c006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:33.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.679+0000 7f70ded9d640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f70c006b680 0x7f70c006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:33.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.679+0000 7f70d77fe640 1 -- 172.21.15.104:0/2593454964 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70c8089970 con 0x7f70e00d07c0 2024-05-08T04:22:33.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.679+0000 7f70ded9d640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f70c006b680 0x7f70c006db40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70d0034000 tx=0x7f70d002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:33.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.683+0000 7f70d77fe640 1 -- 172.21.15.104:0/2593454964 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f70c8058600 con 0x7f70e00d07c0 2024-05-08T04:22:33.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.889+0000 7f70e51b0640 1 -- 172.21.15.104:0/2593454964 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f70e01599e0 con 0x7f70e00d07c0 2024-05-08T04:22:33.891 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-05-08T04:22:33.890+0000 7f0fa0f98640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T04:22:33.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.891+0000 7f70d77fe640 1 -- 172.21.15.104:0/2593454964 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f70c8057f00 con 0x7f70e00d07c0 2024-05-08T04:22:33.892 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T04:22:33.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.893+0000 7f70e51b0640 1 -- 172.21.15.104:0/2593454964 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f70c006b680 msgr2=0x7f70c006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.893+0000 7f70e51b0640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f70c006b680 0x7f70c006db40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70d0034000 tx=0x7f70d002e000 comp rx=0 tx=0).stop 2024-05-08T04:22:33.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.893+0000 7f70e51b0640 1 -- 172.21.15.104:0/2593454964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70e00d07c0 msgr2=0x7f70e01e7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:33.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.893+0000 7f70e51b0640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70e00d07c0 0x7f70e01e7d30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f70c800c430 tx=0x7f70c800c8f0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.893+0000 7f70e51b0640 1 -- 172.21.15.104:0/2593454964 shutdown_connections 2024-05-08T04:22:33.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.894+0000 7f70e51b0640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f70c006b680 0x7f70c006db40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.894+0000 7f70e51b0640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70e015de10 0x7f70e01e8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.894+0000 7f70e51b0640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f70e00d07c0 0x7f70e01e7d30 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.894+0000 7f70e51b0640 1 --2- 172.21.15.104:0/2593454964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70e00ce5a0 0x7f70e014e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:33.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.894+0000 7f70e51b0640 1 -- 172.21.15.104:0/2593454964 >> 172.21.15.104:0/2593454964 conn(0x7f70e0072290 msgr2=0x7f70e00caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:33.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.894+0000 7f70e51b0640 1 -- 172.21.15.104:0/2593454964 shutdown_connections 2024-05-08T04:22:33.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:33.894+0000 7f70e51b0640 1 -- 172.21.15.104:0/2593454964 wait complete. 2024-05-08T04:22:33.907 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T04:22:33.932 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-05-08T04:22:34.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.008+0000 7f1f011c8640 1 Processor -- start 2024-05-08T04:22:34.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.008+0000 7f1f011c8640 1 -- start start 2024-05-08T04:22:34.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.009+0000 7f1f011c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1efc09a150 0x7f1efc0cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.009+0000 7f1f011c8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1efc0cf600 0x7f1efc0b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.009+0000 7f1f011c8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1efc0cfb70 con 0x7f1efc0cd370 2024-05-08T04:22:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.009+0000 7f1f011c8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1efc0d0860 con 0x7f1efc09a150 2024-05-08T04:22:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.009+0000 7f1f011c8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc0cff30 con 0x7f1efc0cf600 2024-05-08T04:22:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.009+0000 7f1ef259c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1efc09a150 0x7f1efc0cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.009+0000 7f1efad9d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f1efc0cd370 0x7f1efc099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:47042/0 (socket says 172.21.15.104:47042) 2024-05-08T04:22:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.009+0000 7f1efad9d640 1 -- 172.21.15.104:0/1683850172 learned_addr learned my addr 172.21.15.104:0/1683850172 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.009+0000 7f1efb59e640 1 --2- 172.21.15.104:0/1683850172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1efc0cf600 0x7f1efc0b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.009+0000 7f1ef259c640 1 -- 172.21.15.104:0/1683850172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1efc0cf600 msgr2=0x7f1efc0b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.009+0000 7f1ef259c640 1 --2- 172.21.15.104:0/1683850172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1efc0cf600 0x7f1efc0b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.009+0000 7f1ef259c640 1 -- 172.21.15.104:0/1683850172 >> v1:172.21.15.104:6789/0 conn(0x7f1efc0cd370 legacy=0x7f1efc099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:34.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.009+0000 7f1ef259c640 1 -- 172.21.15.104:0/1683850172 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc0d0210 con 0x7f1efc09a150 2024-05-08T04:22:34.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.010+0000 7f1ef259c640 1 --2- 172.21.15.104:0/1683850172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1efc09a150 0x7f1efc0cc4a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40097a0 tx=0x7f1ee402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e4f6929c5fcdb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:34.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.010+0000 7f1efa59c640 1 -- 172.21.15.104:0/1683850172 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4037070 con 0x7f1efc09a150 2024-05-08T04:22:34.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.010+0000 7f1efa59c640 1 -- 172.21.15.104:0/1683850172 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee402ae50 con 0x7f1efc09a150 2024-05-08T04:22:34.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.010+0000 7f1efa59c640 1 -- 172.21.15.104:0/1683850172 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4032660 con 0x7f1efc09a150 2024-05-08T04:22:34.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.011+0000 7f1f011c8640 1 -- 172.21.15.104:0/1683850172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1efc09a150 msgr2=0x7f1efc0cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:34.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.011+0000 7f1f011c8640 1 --2- 172.21.15.104:0/1683850172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1efc09a150 0x7f1efc0cc4a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40097a0 tx=0x7f1ee402a100 comp rx=0 tx=0).stop 2024-05-08T04:22:34.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.011+0000 7f1f011c8640 1 -- 172.21.15.104:0/1683850172 shutdown_connections 2024-05-08T04:22:34.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.011+0000 7f1f011c8640 1 --2- 172.21.15.104:0/1683850172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1efc0cf600 0x7f1efc0b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:34.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.011+0000 7f1f011c8640 1 --2- 172.21.15.104:0/1683850172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1efc09a150 0x7f1efc0cc4a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:34.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.011+0000 7f1f011c8640 1 -- 172.21.15.104:0/1683850172 >> 172.21.15.104:0/1683850172 conn(0x7f1efc0b3310 msgr2=0x7f1efc0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:34.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.011+0000 7f1f011c8640 1 -- 172.21.15.104:0/1683850172 shutdown_connections 2024-05-08T04:22:34.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.011+0000 7f1f011c8640 1 -- 172.21.15.104:0/1683850172 wait complete. 2024-05-08T04:22:34.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.012+0000 7f1f011c8640 1 Processor -- start 2024-05-08T04:22:34.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.012+0000 7f1f011c8640 1 -- start start 2024-05-08T04:22:34.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1f011c8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1efc09a150 0x7f1efc159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:34.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1f011c8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1efc0cd370 0x7f1efc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:34.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1f011c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1efc0cf600 0x7f1efc1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:34.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1f011c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc0b2a30 con 0x7f1efc0cf600 2024-05-08T04:22:34.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1f011c8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc0cd750 con 0x7f1efc0cd370 2024-05-08T04:22:34.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1f011c8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc0b2bb0 con 0x7f1efc09a150 2024-05-08T04:22:34.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1efb59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1efc0cf600 0x7f1efc1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:34.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1efb59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1efc0cf600 0x7f1efc1548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37904/0 (socket says 172.21.15.104:37904) 2024-05-08T04:22:34.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1efb59e640 1 -- 172.21.15.104:0/2070594088 learned_addr learned my addr 172.21.15.104:0/2070594088 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:34.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1efad9d640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1efc09a150 0x7f1efc159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:34.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1ef259c640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1efc0cd370 0x7f1efc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:34.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1efb59e640 1 -- 172.21.15.104:0/2070594088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1efc09a150 msgr2=0x7f1efc159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:34.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1efb59e640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1efc09a150 0x7f1efc159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:34.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1efb59e640 1 -- 172.21.15.104:0/2070594088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1efc0cd370 msgr2=0x7f1efc06d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:34.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1efb59e640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1efc0cd370 0x7f1efc06d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:34.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.013+0000 7f1efb59e640 1 -- 172.21.15.104:0/2070594088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc0af980 con 0x7f1efc0cf600 2024-05-08T04:22:34.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.014+0000 7f1efb59e640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1efc0cf600 0x7f1efc1548c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4007e40 tx=0x7f1ef400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:34.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.014+0000 7f1ef3fff640 1 -- 172.21.15.104:0/2070594088 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4014620 con 0x7f1efc0cf600 2024-05-08T04:22:34.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.014+0000 7f1ef3fff640 1 -- 172.21.15.104:0/2070594088 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef4019070 con 0x7f1efc0cf600 2024-05-08T04:22:34.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.014+0000 7f1f011c8640 1 -- 172.21.15.104:0/2070594088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1efc0afc60 con 0x7f1efc0cf600 2024-05-08T04:22:34.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.014+0000 7f1ef3fff640 1 -- 172.21.15.104:0/2070594088 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4014a20 con 0x7f1efc0cf600 2024-05-08T04:22:34.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.014+0000 7f1f011c8640 1 -- 172.21.15.104:0/2070594088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1efc06dbc0 con 0x7f1efc0cf600 2024-05-08T04:22:34.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.015+0000 7f1f011c8640 1 -- 172.21.15.104:0/2070594088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1efc075010 con 0x7f1efc0cf600 2024-05-08T04:22:34.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.015+0000 7f1ef3fff640 1 -- 172.21.15.104:0/2070594088 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f1ef4014bc0 con 0x7f1efc0cf600 2024-05-08T04:22:34.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.015+0000 7f1ef3fff640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1edc06b680 0x7f1edc06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:34.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.016+0000 7f1ef3fff640 1 -- 172.21.15.104:0/2070594088 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1ef408adf0 con 0x7f1efc0cf600 2024-05-08T04:22:34.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.016+0000 7f1efad9d640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1edc06b680 0x7f1edc06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:34.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.016+0000 7f1efad9d640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1edc06b680 0x7f1edc06db40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1efc15aa00 tx=0x7f1eec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:34.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.020+0000 7f1ef3fff640 1 -- 172.21.15.104:0/2070594088 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1ef4059990 con 0x7f1efc0cf600 2024-05-08T04:22:34.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.228+0000 7f1f011c8640 1 -- 172.21.15.104:0/2070594088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1efc0b4120 con 0x7f1efc0cf600 2024-05-08T04:22:34.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.898+0000 7f1ef3fff640 1 -- 172.21.15.104:0/2070594088 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1ef4059290 con 0x7f1efc0cf600 2024-05-08T04:22:34.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.901+0000 7f1f011c8640 1 -- 172.21.15.104:0/2070594088 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1edc06b680 msgr2=0x7f1edc06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:34.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.901+0000 7f1f011c8640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1edc06b680 0x7f1edc06db40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1efc15aa00 tx=0x7f1eec009040 comp rx=0 tx=0).stop 2024-05-08T04:22:34.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.901+0000 7f1f011c8640 1 -- 172.21.15.104:0/2070594088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1efc0cf600 msgr2=0x7f1efc1548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:34.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.901+0000 7f1f011c8640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1efc0cf600 0x7f1efc1548c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4007e40 tx=0x7f1ef400e4b0 comp rx=0 tx=0).stop 2024-05-08T04:22:34.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.901+0000 7f1f011c8640 1 -- 172.21.15.104:0/2070594088 shutdown_connections 2024-05-08T04:22:34.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.901+0000 7f1f011c8640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1edc06b680 0x7f1edc06db40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:34.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.901+0000 7f1f011c8640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1efc0cd370 0x7f1efc06d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:34.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.901+0000 7f1f011c8640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1efc0cf600 0x7f1efc1548c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:34.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.901+0000 7f1f011c8640 1 --2- 172.21.15.104:0/2070594088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1efc09a150 0x7f1efc159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:34.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.901+0000 7f1f011c8640 1 -- 172.21.15.104:0/2070594088 >> 172.21.15.104:0/2070594088 conn(0x7f1efc0b3310 msgr2=0x7f1efc0b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:34.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.901+0000 7f1f011c8640 1 -- 172.21.15.104:0/2070594088 shutdown_connections 2024-05-08T04:22:34.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:34.901+0000 7f1f011c8640 1 -- 172.21.15.104:0/2070594088 wait complete. 2024-05-08T04:22:34.916 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T04:22:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.063+0000 7f9c24fe7640 1 Processor -- start 2024-05-08T04:22:35.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.063+0000 7f9c24fe7640 1 -- start start 2024-05-08T04:22:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.064+0000 7f9c24fe7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c2006ea40 0x7f9c200b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.064+0000 7f9c24fe7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c200b3ff0 0x7f9c200b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.064+0000 7f9c24fe7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c200b49c0 con 0x7f9c200ceee0 2024-05-08T04:22:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.064+0000 7f9c24fe7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2015f390 con 0x7f9c2006ea40 2024-05-08T04:22:35.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.064+0000 7f9c24fe7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2015e780 con 0x7f9c200b3ff0 2024-05-08T04:22:35.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.064+0000 7f9c1ed9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c200b3ff0 0x7f9c200b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:35.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.064+0000 7f9c15d9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c2006ea40 0x7f9c200b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:35.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.064+0000 7f9c15d9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c2006ea40 0x7f9c200b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:58522/0 (socket says 172.21.15.104:58522) 2024-05-08T04:22:35.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.064+0000 7f9c1ed9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c200b3ff0 0x7f9c200b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:39978/0 (socket says 172.21.15.104:39978) 2024-05-08T04:22:35.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.064+0000 7f9c15d9b640 1 -- 172.21.15.104:0/3733059440 learned_addr learned my addr 172.21.15.104:0/3733059440 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:35.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.065+0000 7f9c1ed9d640 1 -- 172.21.15.104:0/3733059440 >> v2:172.21.15.183:3300/0 conn(0x7f9c2006ea40 msgr2=0x7f9c200b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:35.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.065+0000 7f9c1ed9d640 1 --2- 172.21.15.104:0/3733059440 >> v2:172.21.15.183:3300/0 conn(0x7f9c2006ea40 0x7f9c200b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:35.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.065+0000 7f9c1ed9d640 1 -- 172.21.15.104:0/3733059440 >> v1:172.21.15.183:6789/0 conn(0x7f9c200ceee0 legacy=0x7f9c2006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:35.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.065+0000 7f9c1ed9d640 1 -- 172.21.15.104:0/3733059440 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2015ea60 con 0x7f9c200b3ff0 2024-05-08T04:22:35.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.065+0000 7f9c1ed9d640 1 --2- 172.21.15.104:0/3733059440 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c200b3ff0 0x7f9c200b4480 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009d90 tx=0x7f9c1802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bf8ac4d560edbd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:35.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.066+0000 7f9c1dd9b640 1 -- 172.21.15.104:0/3733059440 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18007740 con 0x7f9c200b3ff0 2024-05-08T04:22:35.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.066+0000 7f9c1dd9b640 1 -- 172.21.15.104:0/3733059440 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c180078e0 con 0x7f9c200b3ff0 2024-05-08T04:22:35.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.066+0000 7f9c1dd9b640 1 -- 172.21.15.104:0/3733059440 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18007cb0 con 0x7f9c200b3ff0 2024-05-08T04:22:35.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.066+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3733059440 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c200b3ff0 msgr2=0x7f9c200b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:35.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.066+0000 7f9c24fe7640 1 --2- 172.21.15.104:0/3733059440 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c200b3ff0 0x7f9c200b4480 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009d90 tx=0x7f9c1802a660 comp rx=0 tx=0).stop 2024-05-08T04:22:35.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.066+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3733059440 shutdown_connections 2024-05-08T04:22:35.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.066+0000 7f9c24fe7640 1 --2- 172.21.15.104:0/3733059440 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c200b3ff0 0x7f9c200b4480 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:35.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.066+0000 7f9c24fe7640 1 --2- 172.21.15.104:0/3733059440 >> v2:172.21.15.183:3300/0 conn(0x7f9c2006ea40 0x7f9c200b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:35.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.066+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3733059440 >> 172.21.15.104:0/3733059440 conn(0x7f9c200b13f0 msgr2=0x7f9c200b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:35.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.066+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3733059440 shutdown_connections 2024-05-08T04:22:35.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.066+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3733059440 wait complete. 2024-05-08T04:22:35.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.068+0000 7f9c24fe7640 1 Processor -- start 2024-05-08T04:22:35.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.068+0000 7f9c24fe7640 1 -- start start 2024-05-08T04:22:35.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.068+0000 7f9c24fe7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c2006ea40 0x7f9c2014ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:35.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.068+0000 7f9c24fe7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c200b3ff0 0x7f9c20147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:35.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c24fe7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c200ceee0 0x7f9c2006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:35.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c24fe7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200cf2c0 con 0x7f9c2006ea40 2024-05-08T04:22:35.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c24fe7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2015f020 con 0x7f9c200b3ff0 2024-05-08T04:22:35.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c24fe7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200cf440 con 0x7f9c200ceee0 2024-05-08T04:22:35.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c1e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c2006ea40 0x7f9c2014ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:35.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c1e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c2006ea40 0x7f9c2014ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37914/0 (socket says 172.21.15.104:37914) 2024-05-08T04:22:35.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c1e59c640 1 -- 172.21.15.104:0/3532982233 learned_addr learned my addr 172.21.15.104:0/3532982233 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:35.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c15d9b640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c200b3ff0 0x7f9c20147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:35.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c1ed9d640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c200ceee0 0x7f9c2006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:35.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c1e59c640 1 -- 172.21.15.104:0/3532982233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c200ceee0 msgr2=0x7f9c2006d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:35.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c1e59c640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c200ceee0 0x7f9c2006d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:35.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c1e59c640 1 -- 172.21.15.104:0/3532982233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c200b3ff0 msgr2=0x7f9c20147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:35.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c1e59c640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c200b3ff0 0x7f9c20147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:35.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c1e59c640 1 -- 172.21.15.104:0/3532982233 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2014b040 con 0x7f9c2006ea40 2024-05-08T04:22:35.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c1e59c640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c2006ea40 0x7f9c2014ab00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000c3c0 tx=0x7f9c1000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:35.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c177fe640 1 -- 172.21.15.104:0/3532982233 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c100052d0 con 0x7f9c2006ea40 2024-05-08T04:22:35.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c177fe640 1 -- 172.21.15.104:0/3532982233 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c10005490 con 0x7f9c2006ea40 2024-05-08T04:22:35.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3532982233 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c200ace10 con 0x7f9c2006ea40 2024-05-08T04:22:35.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c177fe640 1 -- 172.21.15.104:0/3532982233 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10007260 con 0x7f9c2006ea40 2024-05-08T04:22:35.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.069+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3532982233 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c200ad3d0 con 0x7f9c2006ea40 2024-05-08T04:22:35.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.070+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3532982233 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c20075010 con 0x7f9c2006ea40 2024-05-08T04:22:35.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.071+0000 7f9c177fe640 1 -- 172.21.15.104:0/3532982233 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f9c10007400 con 0x7f9c2006ea40 2024-05-08T04:22:35.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.071+0000 7f9c177fe640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c0006b6b0 0x7f9c0006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:35.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.071+0000 7f9c15d9b640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c0006b6b0 0x7f9c0006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:35.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.071+0000 7f9c177fe640 1 -- 172.21.15.104:0/3532982233 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9c10089860 con 0x7f9c2006ea40 2024-05-08T04:22:35.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.072+0000 7f9c15d9b640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c0006b6b0 0x7f9c0006db70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9c201f6ef0 tx=0x7f9c08009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:35.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.075+0000 7f9c177fe640 1 -- 172.21.15.104:0/3532982233 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9c10057e60 con 0x7f9c2006ea40 2024-05-08T04:22:35.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.249+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3532982233 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9c2006f3f0 con 0x7f9c2006ea40 2024-05-08T04:22:35.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.900+0000 7f9c177fe640 1 -- 172.21.15.104:0/3532982233 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9c1005ce20 con 0x7f9c2006ea40 2024-05-08T04:22:35.901 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-05-08T04:22:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.903+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3532982233 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c0006b6b0 msgr2=0x7f9c0006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.903+0000 7f9c24fe7640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c0006b6b0 0x7f9c0006db70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9c201f6ef0 tx=0x7f9c08009240 comp rx=0 tx=0).stop 2024-05-08T04:22:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.903+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3532982233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c2006ea40 msgr2=0x7f9c2014ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.903+0000 7f9c24fe7640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c2006ea40 0x7f9c2014ab00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000c3c0 tx=0x7f9c1000c880 comp rx=0 tx=0).stop 2024-05-08T04:22:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.903+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3532982233 shutdown_connections 2024-05-08T04:22:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.903+0000 7f9c24fe7640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c0006b6b0 0x7f9c0006db70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.903+0000 7f9c24fe7640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c200b3ff0 0x7f9c20147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.903+0000 7f9c24fe7640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c200ceee0 0x7f9c2006d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.903+0000 7f9c24fe7640 1 --2- 172.21.15.104:0/3532982233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c2006ea40 0x7f9c2014ab00 secure :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000c3c0 tx=0x7f9c1000c880 comp rx=0 tx=0).stop 2024-05-08T04:22:35.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.903+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3532982233 >> 172.21.15.104:0/3532982233 conn(0x7f9c200b13f0 msgr2=0x7f9c200afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:35.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.903+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3532982233 shutdown_connections 2024-05-08T04:22:35.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:35.904+0000 7f9c24fe7640 1 -- 172.21.15.104:0/3532982233 wait complete. 2024-05-08T04:22:35.917 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T04:22:36.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.022+0000 7f3f0064a640 1 Processor -- start 2024-05-08T04:22:36.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.022+0000 7f3f0064a640 1 -- start start 2024-05-08T04:22:36.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.023+0000 7f3f0064a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef815ee90 0x7f3ef80cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:36.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.023+0000 7f3f0064a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3ef80d0320 0x7f3ef80b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:36.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.023+0000 7f3f0064a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef80cc5d0 con 0x7f3ef815ba10 2024-05-08T04:22:36.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.023+0000 7f3f0064a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef80d0790 con 0x7f3ef80d0320 2024-05-08T04:22:36.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.023+0000 7f3f0064a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef809a340 con 0x7f3ef815ee90 2024-05-08T04:22:36.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.023+0000 7f3efebe7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3ef80d0320 0x7f3ef80b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:36.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.023+0000 7f3efebe7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3ef80d0320 0x7f3ef80b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37920/0 (socket says 172.21.15.104:37920) 2024-05-08T04:22:36.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.023+0000 7f3efebe7640 1 -- 172.21.15.104:0/629274059 learned_addr learned my addr 172.21.15.104:0/629274059 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:36.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.024+0000 7f3efdbe5640 1 --2- 172.21.15.104:0/629274059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef815ee90 0x7f3ef80cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:36.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.024+0000 7f3efebe7640 1 -- 172.21.15.104:0/629274059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef815ee90 msgr2=0x7f3ef80cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:36.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.024+0000 7f3efebe7640 1 --2- 172.21.15.104:0/629274059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef815ee90 0x7f3ef80cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:36.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.024+0000 7f3efebe7640 1 -- 172.21.15.104:0/629274059 >> v1:172.21.15.183:6789/0 conn(0x7f3ef815ba10 legacy=0x7f3ef8099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:36.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.024+0000 7f3efebe7640 1 -- 172.21.15.104:0/629274059 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef809a620 con 0x7f3ef80d0320 2024-05-08T04:22:36.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.024+0000 7f3efdbe5640 1 --2- 172.21.15.104:0/629274059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef815ee90 0x7f3ef80cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.024+0000 7f3efebe7640 1 --2- 172.21.15.104:0/629274059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef80d0320 0x7f3ef80b24c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009870 tx=0x7f3ef002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca32f8c1880a4c54 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.025+0000 7f3efd3e4640 1 -- 172.21.15.104:0/629274059 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0037070 con 0x7f3ef80d0320 2024-05-08T04:22:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.025+0000 7f3efd3e4640 1 -- 172.21.15.104:0/629274059 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef0032440 con 0x7f3ef80d0320 2024-05-08T04:22:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.025+0000 7f3efd3e4640 1 -- 172.21.15.104:0/629274059 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0032810 con 0x7f3ef80d0320 2024-05-08T04:22:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.025+0000 7f3f0064a640 1 -- 172.21.15.104:0/629274059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef80d0320 msgr2=0x7f3ef80b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.025+0000 7f3f0064a640 1 --2- 172.21.15.104:0/629274059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef80d0320 0x7f3ef80b24c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009870 tx=0x7f3ef002a270 comp rx=0 tx=0).stop 2024-05-08T04:22:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.025+0000 7f3f0064a640 1 -- 172.21.15.104:0/629274059 shutdown_connections 2024-05-08T04:22:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.025+0000 7f3f0064a640 1 --2- 172.21.15.104:0/629274059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef80d0320 0x7f3ef80b24c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.025+0000 7f3f0064a640 1 --2- 172.21.15.104:0/629274059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef815ee90 0x7f3ef80cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.025+0000 7f3f0064a640 1 -- 172.21.15.104:0/629274059 >> 172.21.15.104:0/629274059 conn(0x7f3ef80b3280 msgr2=0x7f3ef80b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.025+0000 7f3f0064a640 1 -- 172.21.15.104:0/629274059 shutdown_connections 2024-05-08T04:22:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.025+0000 7f3f0064a640 1 -- 172.21.15.104:0/629274059 wait complete. 2024-05-08T04:22:36.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.026+0000 7f3f0064a640 1 Processor -- start 2024-05-08T04:22:36.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.027+0000 7f3f0064a640 1 -- start start 2024-05-08T04:22:36.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.027+0000 7f3f0064a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef80d0320 0x7f3ef81545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:36.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.027+0000 7f3f0064a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef815ba10 0x7f3ef8159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:36.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.027+0000 7f3f0064a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef815ee90 0x7f3ef815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:36.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.027+0000 7f3f0064a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef806bc70 con 0x7f3ef815ba10 2024-05-08T04:22:36.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.027+0000 7f3f0064a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80cc870 con 0x7f3ef80d0320 2024-05-08T04:22:36.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.027+0000 7f3f0064a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef806bdf0 con 0x7f3ef815ee90 2024-05-08T04:22:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.027+0000 7f3efdbe5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef815ba10 0x7f3ef8159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.027+0000 7f3efdbe5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef815ba10 0x7f3ef8159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37934/0 (socket says 172.21.15.104:37934) 2024-05-08T04:22:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.027+0000 7f3efdbe5640 1 -- 172.21.15.104:0/1119261687 learned_addr learned my addr 172.21.15.104:0/1119261687 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.027+0000 7f3efe3e6640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef80d0320 0x7f3ef81545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.027+0000 7f3efebe7640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef815ee90 0x7f3ef815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.028+0000 7f3efdbe5640 1 -- 172.21.15.104:0/1119261687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef815ee90 msgr2=0x7f3ef815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.028+0000 7f3efdbe5640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef815ee90 0x7f3ef815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.028+0000 7f3efdbe5640 1 -- 172.21.15.104:0/1119261687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef80d0320 msgr2=0x7f3ef81545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.028+0000 7f3efdbe5640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef80d0320 0x7f3ef81545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.028+0000 7f3efdbe5640 1 -- 172.21.15.104:0/1119261687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80cce10 con 0x7f3ef815ba10 2024-05-08T04:22:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.028+0000 7f3efe3e6640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef80d0320 0x7f3ef81545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.028+0000 7f3efdbe5640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef815ba10 0x7f3ef8159f80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800c7f0 tx=0x7f3ee800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.028+0000 7f3eeeffd640 1 -- 172.21.15.104:0/1119261687 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8015070 con 0x7f3ef815ba10 2024-05-08T04:22:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.028+0000 7f3eeeffd640 1 -- 172.21.15.104:0/1119261687 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee8007a30 con 0x7f3ef815ba10 2024-05-08T04:22:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.028+0000 7f3f0064a640 1 -- 172.21.15.104:0/1119261687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef80cd0f0 con 0x7f3ef815ba10 2024-05-08T04:22:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.028+0000 7f3eeeffd640 1 -- 172.21.15.104:0/1119261687 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8007e00 con 0x7f3ef815ba10 2024-05-08T04:22:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.028+0000 7f3f0064a640 1 -- 172.21.15.104:0/1119261687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef80cd6b0 con 0x7f3ef815ba10 2024-05-08T04:22:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.029+0000 7f3f0064a640 1 -- 172.21.15.104:0/1119261687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef8075010 con 0x7f3ef815ba10 2024-05-08T04:22:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.029+0000 7f3eeeffd640 1 -- 172.21.15.104:0/1119261687 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f3ee8018070 con 0x7f3ef815ba10 2024-05-08T04:22:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.030+0000 7f3eeeffd640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3edc06b680 0x7f3edc06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.030+0000 7f3eeeffd640 1 -- 172.21.15.104:0/1119261687 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f3ee808a550 con 0x7f3ef815ba10 2024-05-08T04:22:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.030+0000 7f3efe3e6640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3edc06b680 0x7f3edc06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.030+0000 7f3efe3e6640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3edc06b680 0x7f3edc06db40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4001d90 tx=0x7f3ef4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:36.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.034+0000 7f3eeeffd640 1 -- 172.21.15.104:0/1119261687 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ee8059110 con 0x7f3ef815ba10 2024-05-08T04:22:36.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.209+0000 7f3f0064a640 1 -- 172.21.15.104:0/1119261687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3ef80b3d30 con 0x7f3ef815ba10 2024-05-08T04:22:36.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.904+0000 7f3eeeffd640 1 -- 172.21.15.104:0/1119261687 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3ee8058a10 con 0x7f3ef815ba10 2024-05-08T04:22:36.906 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-05-08T04:22:36.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.906+0000 7f3f0064a640 1 -- 172.21.15.104:0/1119261687 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3edc06b680 msgr2=0x7f3edc06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:36.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.906+0000 7f3f0064a640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3edc06b680 0x7f3edc06db40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4001d90 tx=0x7f3ef4009040 comp rx=0 tx=0).stop 2024-05-08T04:22:36.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.906+0000 7f3f0064a640 1 -- 172.21.15.104:0/1119261687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef815ba10 msgr2=0x7f3ef8159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:36.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.906+0000 7f3f0064a640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef815ba10 0x7f3ef8159f80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800c7f0 tx=0x7f3ee800cbf0 comp rx=0 tx=0).stop 2024-05-08T04:22:36.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.906+0000 7f3f0064a640 1 -- 172.21.15.104:0/1119261687 shutdown_connections 2024-05-08T04:22:36.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.906+0000 7f3f0064a640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3edc06b680 0x7f3edc06db40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:36.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.906+0000 7f3f0064a640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ef815ee90 0x7f3ef815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:36.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.906+0000 7f3f0064a640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ef815ba10 0x7f3ef8159f80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:36.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.906+0000 7f3f0064a640 1 --2- 172.21.15.104:0/1119261687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ef80d0320 0x7f3ef81545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:36.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.906+0000 7f3f0064a640 1 -- 172.21.15.104:0/1119261687 >> 172.21.15.104:0/1119261687 conn(0x7f3ef80b3280 msgr2=0x7f3ef8160260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:36.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.907+0000 7f3f0064a640 1 -- 172.21.15.104:0/1119261687 shutdown_connections 2024-05-08T04:22:36.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:36.907+0000 7f3f0064a640 1 -- 172.21.15.104:0/1119261687 wait complete. 2024-05-08T04:22:36.922 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-08T04:22:37.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.027+0000 7f10dadd5640 1 Processor -- start 2024-05-08T04:22:37.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.027+0000 7f10dadd5640 1 -- start start 2024-05-08T04:22:37.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10dadd5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d4070c70 0x7f10d4071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10dadd5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f10d4157ac0 0x7f10d4157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10dadd5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d4071590 con 0x7f10d415edf0 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10dadd5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d406bc70 con 0x7f10d4157ac0 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10dadd5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40d15c0 con 0x7f10d4070c70 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10d8b71640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d4070c70 0x7f10d4071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10d9372640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f10d4157ac0 0x7f10d4157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10d9372640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f10d4157ac0 0x7f10d4157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:58550/0 (socket says 172.21.15.104:58550) 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10d8b71640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d4070c70 0x7f10d4071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:40028/0 (socket says 172.21.15.104:40028) 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10d9372640 1 -- 172.21.15.104:0/2129708727 learned_addr learned my addr 172.21.15.104:0/2129708727 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10d8b71640 1 -- 172.21.15.104:0/2129708727 >> v2:172.21.15.183:3300/0 conn(0x7f10d4157ac0 msgr2=0x7f10d4157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10d8b71640 1 --2- 172.21.15.104:0/2129708727 >> v2:172.21.15.183:3300/0 conn(0x7f10d4157ac0 0x7f10d4157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10d8b71640 1 -- 172.21.15.104:0/2129708727 >> v1:172.21.15.183:6789/0 conn(0x7f10d415edf0 legacy=0x7f10d40b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10d8b71640 1 -- 172.21.15.104:0/2129708727 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d415f550 con 0x7f10d4070c70 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.028+0000 7f10d9372640 1 --2- 172.21.15.104:0/2129708727 >> v2:172.21.15.183:3300/0 conn(0x7f10d4157ac0 0x7f10d4157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.029+0000 7f10d8b71640 1 --2- 172.21.15.104:0/2129708727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d4070c70 0x7f10d4071050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f10d00097a0 tx=0x7f10d002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc77485f04875d90 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:37.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.029+0000 7f10cb7fe640 1 -- 172.21.15.104:0/2129708727 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0037070 con 0x7f10d4070c70 2024-05-08T04:22:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.029+0000 7f10cb7fe640 1 -- 172.21.15.104:0/2129708727 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0032440 con 0x7f10d4070c70 2024-05-08T04:22:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.029+0000 7f10cb7fe640 1 -- 172.21.15.104:0/2129708727 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0032810 con 0x7f10d4070c70 2024-05-08T04:22:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.030+0000 7f10dadd5640 1 -- 172.21.15.104:0/2129708727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d4070c70 msgr2=0x7f10d4071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.030+0000 7f10dadd5640 1 --2- 172.21.15.104:0/2129708727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d4070c70 0x7f10d4071050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f10d00097a0 tx=0x7f10d002a180 comp rx=0 tx=0).stop 2024-05-08T04:22:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.030+0000 7f10dadd5640 1 -- 172.21.15.104:0/2129708727 shutdown_connections 2024-05-08T04:22:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.030+0000 7f10dadd5640 1 --2- 172.21.15.104:0/2129708727 >> v2:172.21.15.183:3300/0 conn(0x7f10d4157ac0 0x7f10d4157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.030+0000 7f10dadd5640 1 --2- 172.21.15.104:0/2129708727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d4070c70 0x7f10d4071050 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.030+0000 7f10dadd5640 1 -- 172.21.15.104:0/2129708727 >> 172.21.15.104:0/2129708727 conn(0x7f10d40b3450 msgr2=0x7f10d40b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.030+0000 7f10dadd5640 1 -- 172.21.15.104:0/2129708727 shutdown_connections 2024-05-08T04:22:37.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.030+0000 7f10dadd5640 1 -- 172.21.15.104:0/2129708727 wait complete. 2024-05-08T04:22:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.031+0000 7f10dadd5640 1 Processor -- start 2024-05-08T04:22:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.031+0000 7f10dadd5640 1 -- start start 2024-05-08T04:22:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10dadd5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d4070c70 0x7f10d414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10dadd5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d4157ac0 0x7f10d40cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10dadd5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415edf0 0x7f10d4160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10dadd5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40b5b80 con 0x7f10d4157ac0 2024-05-08T04:22:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10dadd5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d415fb10 con 0x7f10d415edf0 2024-05-08T04:22:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10dadd5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d4158490 con 0x7f10d4070c70 2024-05-08T04:22:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d4157ac0 0x7f10d40cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:37.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10cbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d4157ac0 0x7f10d40cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37938/0 (socket says 172.21.15.104:37938) 2024-05-08T04:22:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10cbfff640 1 -- 172.21.15.104:0/1196517344 learned_addr learned my addr 172.21.15.104:0/1196517344 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10d8b71640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d4070c70 0x7f10d414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10d9372640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415edf0 0x7f10d4160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10cbfff640 1 -- 172.21.15.104:0/1196517344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d4070c70 msgr2=0x7f10d414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10cbfff640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d4070c70 0x7f10d414e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10cbfff640 1 -- 172.21.15.104:0/1196517344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415edf0 msgr2=0x7f10d4160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10cbfff640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415edf0 0x7f10d4160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10cbfff640 1 -- 172.21.15.104:0/1196517344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d40cf830 con 0x7f10d4157ac0 2024-05-08T04:22:37.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10d8b71640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d4070c70 0x7f10d414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.032+0000 7f10d9372640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415edf0 0x7f10d4160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.033+0000 7f10cbfff640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d4157ac0 0x7f10d40cf130 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c440 tx=0x7f10c4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.033+0000 7f10c97fa640 1 -- 172.21.15.104:0/1196517344 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40052d0 con 0x7f10d4157ac0 2024-05-08T04:22:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.033+0000 7f10c97fa640 1 -- 172.21.15.104:0/1196517344 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4005470 con 0x7f10d4157ac0 2024-05-08T04:22:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.033+0000 7f10c97fa640 1 -- 172.21.15.104:0/1196517344 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4007260 con 0x7f10d4157ac0 2024-05-08T04:22:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.033+0000 7f10dadd5640 1 -- 172.21.15.104:0/1196517344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d40cfb10 con 0x7f10d4157ac0 2024-05-08T04:22:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.033+0000 7f10dadd5640 1 -- 172.21.15.104:0/1196517344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d40d00d0 con 0x7f10d4157ac0 2024-05-08T04:22:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.034+0000 7f10dadd5640 1 -- 172.21.15.104:0/1196517344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d4075010 con 0x7f10d4157ac0 2024-05-08T04:22:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.034+0000 7f10c97fa640 1 -- 172.21.15.104:0/1196517344 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f10c4007400 con 0x7f10d4157ac0 2024-05-08T04:22:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.035+0000 7f10c97fa640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f10c006b680 0x7f10c006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.035+0000 7f10d8b71640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f10c006b680 0x7f10c006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.035+0000 7f10c97fa640 1 -- 172.21.15.104:0/1196517344 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f10c40897c0 con 0x7f10d4157ac0 2024-05-08T04:22:37.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.035+0000 7f10d8b71640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f10c006b680 0x7f10c006db40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f10d0034000 tx=0x7f10d002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:37.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.039+0000 7f10c97fa640 1 -- 172.21.15.104:0/1196517344 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10c4058620 con 0x7f10d4157ac0 2024-05-08T04:22:37.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.219+0000 7f10dadd5640 1 -- 172.21.15.104:0/1196517344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f10d4071a50 con 0x7f10d4157ac0 2024-05-08T04:22:37.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.222+0000 7f10c97fa640 1 -- 172.21.15.104:0/1196517344 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f10c4057f20 con 0x7f10d4157ac0 2024-05-08T04:22:37.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.224+0000 7f10dadd5640 1 -- 172.21.15.104:0/1196517344 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f10c006b680 msgr2=0x7f10c006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:37.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.224+0000 7f10dadd5640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f10c006b680 0x7f10c006db40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f10d0034000 tx=0x7f10d002e000 comp rx=0 tx=0).stop 2024-05-08T04:22:37.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.224+0000 7f10dadd5640 1 -- 172.21.15.104:0/1196517344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d4157ac0 msgr2=0x7f10d40cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:37.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.224+0000 7f10dadd5640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d4157ac0 0x7f10d40cf130 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c440 tx=0x7f10c4001e70 comp rx=0 tx=0).stop 2024-05-08T04:22:37.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.224+0000 7f10dadd5640 1 -- 172.21.15.104:0/1196517344 shutdown_connections 2024-05-08T04:22:37.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.224+0000 7f10dadd5640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f10c006b680 0x7f10c006db40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.224+0000 7f10dadd5640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415edf0 0x7f10d4160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.224+0000 7f10dadd5640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d4157ac0 0x7f10d40cf130 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.224+0000 7f10dadd5640 1 --2- 172.21.15.104:0/1196517344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d4070c70 0x7f10d414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.224+0000 7f10dadd5640 1 -- 172.21.15.104:0/1196517344 >> 172.21.15.104:0/1196517344 conn(0x7f10d40b3450 msgr2=0x7f10d41502b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:37.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.224+0000 7f10dadd5640 1 -- 172.21.15.104:0/1196517344 shutdown_connections 2024-05-08T04:22:37.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.224+0000 7f10dadd5640 1 -- 172.21.15.104:0/1196517344 wait complete. 2024-05-08T04:22:37.236 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-05-08T04:22:37.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.335+0000 7fdc446ac640 1 Processor -- start 2024-05-08T04:22:37.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.335+0000 7fdc446ac640 1 -- start start 2024-05-08T04:22:37.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc446ac640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc3c0b16c0 0x7fdc3c0b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc446ac640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3c0b1e30 con 0x7fdc3c15bac0 2024-05-08T04:22:37.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc446ac640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3c0b36c0 con 0x7fdc3c06b270 2024-05-08T04:22:37.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc446ac640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c0b3d10 con 0x7fdc3c0b16c0 2024-05-08T04:22:37.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc42448640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fdc3c15bac0 0x7fdc3c06ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:47046/0 (socket says 172.21.15.104:47046) 2024-05-08T04:22:37.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc42448640 1 -- 172.21.15.104:0/2193707544 learned_addr learned my addr 172.21.15.104:0/2193707544 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:37.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846937653 0 0) 0x7fdc3c0b1e30 con 0x7fdc3c15bac0 2024-05-08T04:22:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc28003520 con 0x7fdc3c15bac0 2024-05-08T04:22:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc42c49640 1 --2- 172.21.15.104:0/2193707544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc3c0b16c0 0x7fdc3c0b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2254346710 0 0) 0x7fdc28003520 con 0x7fdc3c15bac0 2024-05-08T04:22:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc3c0b16c0 msgr2=0x7fdc3c0b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 --2- 172.21.15.104:0/2193707544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc3c0b16c0 0x7fdc3c0b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 >> v1:172.21.15.183:6789/0 conn(0x7fdc3c06b270 legacy=0x7fdc3c0b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c0b39a0 con 0x7fdc3c15bac0 2024-05-08T04:22:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fdc38001670 con 0x7fdc3c15bac0 2024-05-08T04:22:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 >> v1:172.21.15.104:6789/0 conn(0x7fdc3c15bac0 legacy=0x7fdc3c06ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 --2- 172.21.15.104:0/2193707544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc280039e0 0x7fdc28003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 --2- 172.21.15.104:0/2193707544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc28004800 0x7fdc28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 --2- 172.21.15.104:0/2193707544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc3c0b16c0 0x7fdc28005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c0b3d10 con 0x7fdc280039e0 2024-05-08T04:22:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2800baf0 con 0x7fdc28004800 2024-05-08T04:22:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2800bcf0 con 0x7fdc3c0b16c0 2024-05-08T04:22:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc42448640 1 --2- 172.21.15.104:0/2193707544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc280039e0 0x7fdc28003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.336+0000 7fdc41c47640 1 --2- 172.21.15.104:0/2193707544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc28004800 0x7fdc28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.337+0000 7fdc42c49640 1 --2- 172.21.15.104:0/2193707544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc3c0b16c0 0x7fdc28005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.337+0000 7fdc42448640 1 -- 172.21.15.104:0/2193707544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc3c0b16c0 msgr2=0x7fdc28005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.337+0000 7fdc42448640 1 --2- 172.21.15.104:0/2193707544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc3c0b16c0 0x7fdc28005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.337+0000 7fdc42448640 1 -- 172.21.15.104:0/2193707544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc28004800 msgr2=0x7fdc28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.337+0000 7fdc42448640 1 --2- 172.21.15.104:0/2193707544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc28004800 0x7fdc28004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.337+0000 7fdc42448640 1 -- 172.21.15.104:0/2193707544 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc28003520 con 0x7fdc280039e0 2024-05-08T04:22:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.337+0000 7fdc42448640 1 --2- 172.21.15.104:0/2193707544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc280039e0 0x7fdc28003e00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800c240 tx=0x7fdc28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbd5f44007ebc68 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.337+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc38007d10 con 0x7fdc280039e0 2024-05-08T04:22:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.337+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc38005ad0 con 0x7fdc280039e0 2024-05-08T04:22:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.337+0000 7fdc41446640 1 -- 172.21.15.104:0/2193707544 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc38007070 con 0x7fdc280039e0 2024-05-08T04:22:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.338+0000 7fdc446ac640 1 -- 172.21.15.104:0/2193707544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc280039e0 msgr2=0x7fdc28003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.338+0000 7fdc446ac640 1 --2- 172.21.15.104:0/2193707544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc280039e0 0x7fdc28003e00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800c240 tx=0x7fdc28005830 comp rx=0 tx=0).stop 2024-05-08T04:22:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.338+0000 7fdc42c49640 1 -- 172.21.15.104:0/2193707544 reap_dead start 2024-05-08T04:22:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.338+0000 7fdc446ac640 1 -- 172.21.15.104:0/2193707544 shutdown_connections 2024-05-08T04:22:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.338+0000 7fdc446ac640 1 -- 172.21.15.104:0/2193707544 >> 172.21.15.104:0/2193707544 conn(0x7fdc3c0b2220 msgr2=0x7fdc3c0b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.338+0000 7fdc446ac640 1 -- 172.21.15.104:0/2193707544 shutdown_connections 2024-05-08T04:22:37.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.338+0000 7fdc446ac640 1 -- 172.21.15.104:0/2193707544 wait complete. 2024-05-08T04:22:37.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.339+0000 7fdc446ac640 1 Processor -- start 2024-05-08T04:22:37.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.339+0000 7fdc446ac640 1 -- start start 2024-05-08T04:22:37.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc446ac640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc280039e0 0x7fdc3c148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc446ac640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc3c0c59c0 0x7fdc3c0c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc446ac640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc3c158860 0x7fdc3c158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc446ac640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c15bea0 con 0x7fdc280039e0 2024-05-08T04:22:37.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc446ac640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c0c3f00 con 0x7fdc3c0c59c0 2024-05-08T04:22:37.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc446ac640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c15c020 con 0x7fdc3c158860 2024-05-08T04:22:37.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc42448640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc280039e0 0x7fdc3c148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:37.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc42448640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc280039e0 0x7fdc3c148b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37954/0 (socket says 172.21.15.104:37954) 2024-05-08T04:22:37.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc42448640 1 -- 172.21.15.104:0/2688037926 learned_addr learned my addr 172.21.15.104:0/2688037926 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:37.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc42448640 1 -- 172.21.15.104:0/2688037926 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc3c158860 msgr2=0x7fdc3c158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:37.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc42448640 1 --2- 172.21.15.104:0/2688037926 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc3c158860 0x7fdc3c158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc42448640 1 -- 172.21.15.104:0/2688037926 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc3c0c59c0 msgr2=0x7fdc3c0c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:37.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc42448640 1 --2- 172.21.15.104:0/2688037926 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc3c0c59c0 0x7fdc3c0c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.340+0000 7fdc42448640 1 -- 172.21.15.104:0/2688037926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c0c6480 con 0x7fdc280039e0 2024-05-08T04:22:37.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.341+0000 7fdc42448640 1 --2- 172.21.15.104:0/2688037926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc280039e0 0x7fdc3c148b40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800c240 tx=0x7fdc3c0b2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:37.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.341+0000 7fdc32ffd640 1 -- 172.21.15.104:0/2688037926 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc38007d10 con 0x7fdc280039e0 2024-05-08T04:22:37.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.341+0000 7fdc32ffd640 1 -- 172.21.15.104:0/2688037926 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc38004bf0 con 0x7fdc280039e0 2024-05-08T04:22:37.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.341+0000 7fdc446ac640 1 -- 172.21.15.104:0/2688037926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3c0c6760 con 0x7fdc280039e0 2024-05-08T04:22:37.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.341+0000 7fdc32ffd640 1 -- 172.21.15.104:0/2688037926 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc38007070 con 0x7fdc280039e0 2024-05-08T04:22:37.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.341+0000 7fdc446ac640 1 -- 172.21.15.104:0/2688037926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3c0c6d20 con 0x7fdc280039e0 2024-05-08T04:22:37.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.342+0000 7fdc446ac640 1 -- 172.21.15.104:0/2688037926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc3c075010 con 0x7fdc280039e0 2024-05-08T04:22:37.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.342+0000 7fdc32ffd640 1 -- 172.21.15.104:0/2688037926 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fdc38007210 con 0x7fdc280039e0 2024-05-08T04:22:37.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.343+0000 7fdc32ffd640 1 --2- 172.21.15.104:0/2688037926 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc2006b6b0 0x7fdc2006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:37.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.343+0000 7fdc32ffd640 1 -- 172.21.15.104:0/2688037926 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdc380aa740 con 0x7fdc280039e0 2024-05-08T04:22:37.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.343+0000 7fdc41c47640 1 --2- 172.21.15.104:0/2688037926 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc2006b6b0 0x7fdc2006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:37.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.343+0000 7fdc41c47640 1 --2- 172.21.15.104:0/2688037926 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc2006b6b0 0x7fdc2006db70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0016d0 tx=0x7fdc2c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:37.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.347+0000 7fdc32ffd640 1 -- 172.21.15.104:0/2688037926 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdc3804c020 con 0x7fdc280039e0 2024-05-08T04:22:37.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.585+0000 7fdc446ac640 1 -- 172.21.15.104:0/2688037926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7fdc3c0cacb0 con 0x7fdc280039e0 2024-05-08T04:22:37.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.906+0000 7fdc32ffd640 1 -- 172.21.15.104:0/2688037926 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v105) v1 ==== 158+0+0 (secure 0 0 0) 0x7fdc380313a0 con 0x7fdc280039e0 2024-05-08T04:22:37.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.908+0000 7fdc446ac640 1 -- 172.21.15.104:0/2688037926 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc2006b6b0 msgr2=0x7fdc2006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:37.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.908+0000 7fdc446ac640 1 --2- 172.21.15.104:0/2688037926 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc2006b6b0 0x7fdc2006db70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0016d0 tx=0x7fdc2c009040 comp rx=0 tx=0).stop 2024-05-08T04:22:37.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.908+0000 7fdc446ac640 1 -- 172.21.15.104:0/2688037926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc280039e0 msgr2=0x7fdc3c148b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:37.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.908+0000 7fdc446ac640 1 --2- 172.21.15.104:0/2688037926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc280039e0 0x7fdc3c148b40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800c240 tx=0x7fdc3c0b2000 comp rx=0 tx=0).stop 2024-05-08T04:22:37.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.908+0000 7fdc446ac640 1 -- 172.21.15.104:0/2688037926 shutdown_connections 2024-05-08T04:22:37.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.908+0000 7fdc446ac640 1 --2- 172.21.15.104:0/2688037926 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdc2006b6b0 0x7fdc2006db70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.908+0000 7fdc446ac640 1 --2- 172.21.15.104:0/2688037926 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc3c0c59c0 0x7fdc3c0c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.908+0000 7fdc446ac640 1 --2- 172.21.15.104:0/2688037926 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc3c158860 0x7fdc3c158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.908+0000 7fdc446ac640 1 --2- 172.21.15.104:0/2688037926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc280039e0 0x7fdc3c148b40 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:37.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.908+0000 7fdc446ac640 1 -- 172.21.15.104:0/2688037926 >> 172.21.15.104:0/2688037926 conn(0x7fdc3c0b2220 msgr2=0x7fdc3c0cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:37.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.908+0000 7fdc446ac640 1 -- 172.21.15.104:0/2688037926 shutdown_connections 2024-05-08T04:22:37.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:37.908+0000 7fdc446ac640 1 -- 172.21.15.104:0/2688037926 wait complete. 2024-05-08T04:22:37.921 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system ... ok 2024-05-08T04:22:37.921 INFO:tasks.cephfs_test_runner:Starting test: test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) 2024-05-08T04:22:37.922 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:38.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.021+0000 7f687649e640 1 Processor -- start 2024-05-08T04:22:38.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.021+0000 7f687649e640 1 -- start start 2024-05-08T04:22:38.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.022+0000 7f687649e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f68700ceee0 0x7f68700b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.022+0000 7f687649e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68700b4700 0x7f687006e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.022+0000 7f687649e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687015e780 con 0x7f687006e330 2024-05-08T04:22:38.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.022+0000 7f687649e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687015f390 con 0x7f68700ceee0 2024-05-08T04:22:38.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.022+0000 7f687649e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687015ea60 con 0x7f68700b4700 2024-05-08T04:22:38.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.022+0000 7f686ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f68700ceee0 0x7f68700b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.022+0000 7f686ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f68700ceee0 0x7f68700b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56308/0 (socket says 172.21.15.104:56308) 2024-05-08T04:22:38.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.022+0000 7f686ffff640 1 -- 172.21.15.104:0/4255788091 learned_addr learned my addr 172.21.15.104:0/4255788091 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:38.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.022+0000 7f6874a3b640 1 --2- 172.21.15.104:0/4255788091 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68700b4700 0x7f687006e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.022+0000 7f686ffff640 1 -- 172.21.15.104:0/4255788091 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68700b4700 msgr2=0x7f687006e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:38.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.022+0000 7f686ffff640 1 --2- 172.21.15.104:0/4255788091 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68700b4700 0x7f687006e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.023+0000 7f686ffff640 1 -- 172.21.15.104:0/4255788091 >> v1:172.21.15.183:6789/0 conn(0x7f687006e330 legacy=0x7f68700b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.023+0000 7f686ffff640 1 -- 172.21.15.104:0/4255788091 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687015ed40 con 0x7f68700ceee0 2024-05-08T04:22:38.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.023+0000 7f686ffff640 1 --2- 172.21.15.104:0/4255788091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68700ceee0 0x7f68700b26f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6860009870 tx=0x7f686002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f990d0d73ebe76ec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:38.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.023+0000 7f686effd640 1 -- 172.21.15.104:0/4255788091 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860037070 con 0x7f68700ceee0 2024-05-08T04:22:38.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.023+0000 7f686effd640 1 -- 172.21.15.104:0/4255788091 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6860032440 con 0x7f68700ceee0 2024-05-08T04:22:38.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.023+0000 7f686effd640 1 -- 172.21.15.104:0/4255788091 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860032810 con 0x7f68700ceee0 2024-05-08T04:22:38.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.024+0000 7f687649e640 1 -- 172.21.15.104:0/4255788091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68700ceee0 msgr2=0x7f68700b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.024+0000 7f687649e640 1 --2- 172.21.15.104:0/4255788091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68700ceee0 0x7f68700b26f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6860009870 tx=0x7f686002a270 comp rx=0 tx=0).stop 2024-05-08T04:22:38.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.024+0000 7f687649e640 1 -- 172.21.15.104:0/4255788091 shutdown_connections 2024-05-08T04:22:38.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.024+0000 7f687649e640 1 --2- 172.21.15.104:0/4255788091 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68700b4700 0x7f687006e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.024+0000 7f687649e640 1 --2- 172.21.15.104:0/4255788091 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68700ceee0 0x7f68700b26f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.024+0000 7f687649e640 1 -- 172.21.15.104:0/4255788091 >> 172.21.15.104:0/4255788091 conn(0x7f68700b13f0 msgr2=0x7f68700b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:38.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.024+0000 7f687649e640 1 -- 172.21.15.104:0/4255788091 shutdown_connections 2024-05-08T04:22:38.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.024+0000 7f687649e640 1 -- 172.21.15.104:0/4255788091 wait complete. 2024-05-08T04:22:38.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.025+0000 7f687649e640 1 Processor -- start 2024-05-08T04:22:38.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.025+0000 7f687649e640 1 -- start start 2024-05-08T04:22:38.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f687649e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f687006e330 0x7f6870152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f687649e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68700b4700 0x7f6870149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f687649e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68700ceee0 0x7f6870153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f687649e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68700cf440 con 0x7f68700b4700 2024-05-08T04:22:38.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f687649e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68700cf2c0 con 0x7f687006e330 2024-05-08T04:22:38.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f687649e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687015b210 con 0x7f68700ceee0 2024-05-08T04:22:38.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f686f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68700b4700 0x7f6870149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f686f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68700b4700 0x7f6870149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56320/0 (socket says 172.21.15.104:56320) 2024-05-08T04:22:38.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f686f7fe640 1 -- 172.21.15.104:0/3713866023 learned_addr learned my addr 172.21.15.104:0/3713866023 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:38.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f6874a3b640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68700ceee0 0x7f6870153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f686ffff640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f687006e330 0x7f6870152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f686f7fe640 1 -- 172.21.15.104:0/3713866023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68700ceee0 msgr2=0x7f6870153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f686f7fe640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68700ceee0 0x7f6870153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f686f7fe640 1 -- 172.21.15.104:0/3713866023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f687006e330 msgr2=0x7f6870152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f686f7fe640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f687006e330 0x7f6870152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f686f7fe640 1 -- 172.21.15.104:0/3713866023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68701558c0 con 0x7f68700b4700 2024-05-08T04:22:38.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.026+0000 7f6874a3b640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68700ceee0 0x7f6870153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:38.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.027+0000 7f686f7fe640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68700b4700 0x7f6870149200 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f686400c400 tx=0x7f686400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:38.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.027+0000 7f686cff9640 1 -- 172.21.15.104:0/3713866023 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68640052d0 con 0x7f68700b4700 2024-05-08T04:22:38.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.027+0000 7f686cff9640 1 -- 172.21.15.104:0/3713866023 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6864005490 con 0x7f68700b4700 2024-05-08T04:22:38.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.027+0000 7f687649e640 1 -- 172.21.15.104:0/3713866023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6870151990 con 0x7f68700b4700 2024-05-08T04:22:38.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.027+0000 7f686cff9640 1 -- 172.21.15.104:0/3713866023 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864007260 con 0x7f68700b4700 2024-05-08T04:22:38.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.027+0000 7f687649e640 1 -- 172.21.15.104:0/3713866023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6870155ba0 con 0x7f68700b4700 2024-05-08T04:22:38.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.028+0000 7f687649e640 1 -- 172.21.15.104:0/3713866023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6870075010 con 0x7f68700b4700 2024-05-08T04:22:38.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.028+0000 7f686cff9640 1 -- 172.21.15.104:0/3713866023 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f6864007400 con 0x7f68700b4700 2024-05-08T04:22:38.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.029+0000 7f686cff9640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f685c06b680 0x7f685c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.029+0000 7f686cff9640 1 -- 172.21.15.104:0/3713866023 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6864089760 con 0x7f68700b4700 2024-05-08T04:22:38.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.029+0000 7f686ffff640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f685c06b680 0x7f685c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.029+0000 7f686ffff640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f685c06b680 0x7f685c06db40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6860034000 tx=0x7f686002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:38.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.033+0000 7f686cff9640 1 -- 172.21.15.104:0/3713866023 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6864058660 con 0x7f68700b4700 2024-05-08T04:22:38.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.203+0000 7f687649e640 1 -- 172.21.15.104:0/3713866023 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f687006f3f0 con 0x7f68700b4700 2024-05-08T04:22:38.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.204+0000 7f686cff9640 1 -- 172.21.15.104:0/3713866023 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13082 (secure 0 0 0) 0x7f6864057f60 con 0x7f68700b4700 2024-05-08T04:22:38.205 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:38.205 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":36,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:36.900948+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6837/4038606624":"2024-05-09T04:22:33.890724+0000","172.21.15.104:6835/4038606624":"2024-05-09T04:22:33.890724+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:38.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.206+0000 7f687649e640 1 -- 172.21.15.104:0/3713866023 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f685c06b680 msgr2=0x7f685c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.206+0000 7f687649e640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f685c06b680 0x7f685c06db40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6860034000 tx=0x7f686002e000 comp rx=0 tx=0).stop 2024-05-08T04:22:38.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.206+0000 7f687649e640 1 -- 172.21.15.104:0/3713866023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68700b4700 msgr2=0x7f6870149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.206+0000 7f687649e640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68700b4700 0x7f6870149200 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f686400c400 tx=0x7f686400c8c0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.206+0000 7f687649e640 1 -- 172.21.15.104:0/3713866023 shutdown_connections 2024-05-08T04:22:38.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.206+0000 7f687649e640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f685c06b680 0x7f685c06db40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.206+0000 7f687649e640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68700ceee0 0x7f6870153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.206+0000 7f687649e640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68700b4700 0x7f6870149200 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.206+0000 7f687649e640 1 --2- 172.21.15.104:0/3713866023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f687006e330 0x7f6870152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.206+0000 7f687649e640 1 -- 172.21.15.104:0/3713866023 >> 172.21.15.104:0/3713866023 conn(0x7f68700b13f0 msgr2=0x7f68700711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:38.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.206+0000 7f687649e640 1 -- 172.21.15.104:0/3713866023 shutdown_connections 2024-05-08T04:22:38.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.206+0000 7f687649e640 1 -- 172.21.15.104:0/3713866023 wait complete. 2024-05-08T04:22:38.219 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:22:38.219 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:22:38.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.320+0000 7f9588b6a640 1 Processor -- start 2024-05-08T04:22:38.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.320+0000 7f9588b6a640 1 -- start start 2024-05-08T04:22:38.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.321+0000 7f9588b6a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f95840701a0 0x7f9584070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.321+0000 7f9588b6a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9584073030 con 0x7f9584158540 2024-05-08T04:22:38.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.321+0000 7f9588b6a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9584072210 con 0x7f95840cd120 2024-05-08T04:22:38.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.321+0000 7f9588b6a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95840cbf50 con 0x7f95840701a0 2024-05-08T04:22:38.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.321+0000 7f9581d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f95840701a0 0x7f9584070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.321+0000 7f958259c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9584158540 0x7f958415e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38216/0 (socket says 172.21.15.104:38216) 2024-05-08T04:22:38.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.321+0000 7f958259c640 1 -- 172.21.15.104:0/429402149 learned_addr learned my addr 172.21.15.104:0/429402149 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:38.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.321+0000 7f9581d9b640 1 -- 172.21.15.104:0/429402149 >> v1:172.21.15.183:6789/0 conn(0x7f95840cd120 legacy=0x7f95840cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:38.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.321+0000 7f9581d9b640 1 -- 172.21.15.104:0/429402149 >> v1:172.21.15.104:6789/0 conn(0x7f9584158540 legacy=0x7f958415e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.321+0000 7f958159a640 1 -- 172.21.15.104:0/429402149 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288520939 0 0) 0x7f9584073030 con 0x7f9584158540 2024-05-08T04:22:38.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.321+0000 7f9581d9b640 1 -- 172.21.15.104:0/429402149 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95840724b0 con 0x7f95840701a0 2024-05-08T04:22:38.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.322+0000 7f9581d9b640 1 --2- 172.21.15.104:0/429402149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95840701a0 0x7f9584070600 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f956c0097a0 tx=0x7f956c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7ffc1a8f017437 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:38.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.322+0000 7f958159a640 1 -- 172.21.15.104:0/429402149 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c037070 con 0x7f95840701a0 2024-05-08T04:22:38.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.322+0000 7f958159a640 1 -- 172.21.15.104:0/429402149 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956c032440 con 0x7f95840701a0 2024-05-08T04:22:38.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.322+0000 7f958159a640 1 -- 172.21.15.104:0/429402149 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c032810 con 0x7f95840701a0 2024-05-08T04:22:38.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.323+0000 7f9588b6a640 1 -- 172.21.15.104:0/429402149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95840701a0 msgr2=0x7f9584070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.323+0000 7f9588b6a640 1 --2- 172.21.15.104:0/429402149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95840701a0 0x7f9584070600 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f956c0097a0 tx=0x7f956c02a1e0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.323+0000 7f9588b6a640 1 -- 172.21.15.104:0/429402149 shutdown_connections 2024-05-08T04:22:38.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.323+0000 7f9588b6a640 1 --2- 172.21.15.104:0/429402149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95840701a0 0x7f9584070600 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.323+0000 7f9588b6a640 1 -- 172.21.15.104:0/429402149 >> 172.21.15.104:0/429402149 conn(0x7f95840b23e0 msgr2=0x7f95840b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:38.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.323+0000 7f9588b6a640 1 -- 172.21.15.104:0/429402149 shutdown_connections 2024-05-08T04:22:38.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.323+0000 7f9588b6a640 1 -- 172.21.15.104:0/429402149 wait complete. 2024-05-08T04:22:38.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.324+0000 7f9588b6a640 1 Processor -- start 2024-05-08T04:22:38.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.324+0000 7f9588b6a640 1 -- start start 2024-05-08T04:22:38.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f9588b6a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95840701a0 0x7f958415e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f9588b6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95840cd120 0x7f9584156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f9588b6a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9584158540 0x7f95841574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f9588b6a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9584072d50 con 0x7f95840701a0 2024-05-08T04:22:38.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f9588b6a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9584072a70 con 0x7f9584158540 2024-05-08T04:22:38.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f9588b6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95840cca90 con 0x7f95840cd120 2024-05-08T04:22:38.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f958259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95840701a0 0x7f958415e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f958259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95840701a0 0x7f958415e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56342/0 (socket says 172.21.15.104:56342) 2024-05-08T04:22:38.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f958259c640 1 -- 172.21.15.104:0/2842227849 learned_addr learned my addr 172.21.15.104:0/2842227849 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:38.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f958259c640 1 -- 172.21.15.104:0/2842227849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95840cd120 msgr2=0x7f9584156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f958259c640 1 --2- 172.21.15.104:0/2842227849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95840cd120 0x7f9584156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f958259c640 1 -- 172.21.15.104:0/2842227849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9584158540 msgr2=0x7f95841574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f958259c640 1 --2- 172.21.15.104:0/2842227849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9584158540 0x7f95841574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.325+0000 7f958259c640 1 -- 172.21.15.104:0/2842227849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9584141410 con 0x7f95840701a0 2024-05-08T04:22:38.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.326+0000 7f958259c640 1 --2- 172.21.15.104:0/2842227849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95840701a0 0x7f958415e590 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f957400c7c0 tx=0x7f957400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:38.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.326+0000 7f957affd640 1 -- 172.21.15.104:0/2842227849 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9574018070 con 0x7f95840701a0 2024-05-08T04:22:38.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.326+0000 7f957affd640 1 -- 172.21.15.104:0/2842227849 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957400a640 con 0x7f95840701a0 2024-05-08T04:22:38.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.326+0000 7f957affd640 1 -- 172.21.15.104:0/2842227849 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957400aa30 con 0x7f95840701a0 2024-05-08T04:22:38.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.326+0000 7f9588b6a640 1 -- 172.21.15.104:0/2842227849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95841416f0 con 0x7f95840701a0 2024-05-08T04:22:38.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.326+0000 7f9588b6a640 1 -- 172.21.15.104:0/2842227849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958415c4d0 con 0x7f95840701a0 2024-05-08T04:22:38.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.327+0000 7f9588b6a640 1 -- 172.21.15.104:0/2842227849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9584075010 con 0x7f95840701a0 2024-05-08T04:22:38.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.327+0000 7f957affd640 1 -- 172.21.15.104:0/2842227849 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f957401b070 con 0x7f95840701a0 2024-05-08T04:22:38.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.328+0000 7f957affd640 1 --2- 172.21.15.104:0/2842227849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f956406b680 0x7f956406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.328+0000 7f957affd640 1 -- 172.21.15.104:0/2842227849 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9574089840 con 0x7f95840701a0 2024-05-08T04:22:38.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.328+0000 7f9581d9b640 1 --2- 172.21.15.104:0/2842227849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f956406b680 0x7f956406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.328+0000 7f9581d9b640 1 --2- 172.21.15.104:0/2842227849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f956406b680 0x7f956406db40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f956c034000 tx=0x7f956c02c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:38.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.332+0000 7f957affd640 1 -- 172.21.15.104:0/2842227849 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9574058740 con 0x7f95840701a0 2024-05-08T04:22:38.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.502+0000 7f9588b6a640 1 -- 172.21.15.104:0/2842227849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f958415f1f0 con 0x7f95840701a0 2024-05-08T04:22:38.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.503+0000 7f957affd640 1 -- 172.21.15.104:0/2842227849 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9574058040 con 0x7f95840701a0 2024-05-08T04:22:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:22:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.505+0000 7f9588b6a640 1 -- 172.21.15.104:0/2842227849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f956406b680 msgr2=0x7f956406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.505+0000 7f9588b6a640 1 --2- 172.21.15.104:0/2842227849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f956406b680 0x7f956406db40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f956c034000 tx=0x7f956c02c000 comp rx=0 tx=0).stop 2024-05-08T04:22:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.505+0000 7f9588b6a640 1 -- 172.21.15.104:0/2842227849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95840701a0 msgr2=0x7f958415e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.505+0000 7f9588b6a640 1 --2- 172.21.15.104:0/2842227849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95840701a0 0x7f958415e590 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f957400c7c0 tx=0x7f957400cc80 comp rx=0 tx=0).stop 2024-05-08T04:22:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.505+0000 7f9588b6a640 1 -- 172.21.15.104:0/2842227849 shutdown_connections 2024-05-08T04:22:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.505+0000 7f9588b6a640 1 --2- 172.21.15.104:0/2842227849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f956406b680 0x7f956406db40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.505+0000 7f9588b6a640 1 --2- 172.21.15.104:0/2842227849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9584158540 0x7f95841574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.505+0000 7f9588b6a640 1 --2- 172.21.15.104:0/2842227849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95840cd120 0x7f9584156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.505+0000 7f9588b6a640 1 --2- 172.21.15.104:0/2842227849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95840701a0 0x7f958415e590 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.505+0000 7f9588b6a640 1 -- 172.21.15.104:0/2842227849 >> 172.21.15.104:0/2842227849 conn(0x7f95840b23e0 msgr2=0x7f95840af840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:38.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.505+0000 7f9588b6a640 1 -- 172.21.15.104:0/2842227849 shutdown_connections 2024-05-08T04:22:38.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.505+0000 7f9588b6a640 1 -- 172.21.15.104:0/2842227849 wait complete. 2024-05-08T04:22:38.517 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-05-08T04:22:38.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.615+0000 7f6aeb1f9640 1 Processor -- start 2024-05-08T04:22:38.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.615+0000 7f6aeb1f9640 1 -- start start 2024-05-08T04:22:38.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.616+0000 7f6aeb1f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae40b6c90 0x7f6ae40cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.616+0000 7f6aeb1f9640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae40d1610 con 0x7f6ae40d0d20 2024-05-08T04:22:38.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.616+0000 7f6aeb1f9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae40cfee0 con 0x7f6ae40ce920 2024-05-08T04:22:38.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.616+0000 7f6aeb1f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40d01c0 con 0x7f6ae40b6c90 2024-05-08T04:22:38.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.616+0000 7f6adbfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6ae40d0d20 0x7f6ae40ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38230/0 (socket says 172.21.15.104:38230) 2024-05-08T04:22:38.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.616+0000 7f6adbfff640 1 -- 172.21.15.104:0/625089187 learned_addr learned my addr 172.21.15.104:0/625089187 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:38.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6ae8f95640 1 --2- 172.21.15.104:0/625089187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae40b6c90 0x7f6ae40cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736377615 0 0) 0x7f6ae40d1610 con 0x7f6ae40d0d20 2024-05-08T04:22:38.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6acc003520 con 0x7f6ae40d0d20 2024-05-08T04:22:38.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193142958 0 0) 0x7f6ae40cfee0 con 0x7f6ae40ce920 2024-05-08T04:22:38.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ae40d1610 con 0x7f6ae40ce920 2024-05-08T04:22:38.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2860480356 0 0) 0x7f6acc003520 con 0x7f6ae40d0d20 2024-05-08T04:22:38.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae40b6c90 msgr2=0x7f6ae40cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:38.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 --2- 172.21.15.104:0/625089187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae40b6c90 0x7f6ae40cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 >> v1:172.21.15.183:6789/0 conn(0x7f6ae40ce920 legacy=0x7f6ae415e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae40d04a0 con 0x7f6ae40d0d20 2024-05-08T04:22:38.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f6ad4001670 con 0x7f6ae40d0d20 2024-05-08T04:22:38.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 >> v1:172.21.15.104:6789/0 conn(0x7f6ae40d0d20 legacy=0x7f6ae40ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 --2- 172.21.15.104:0/625089187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae40b6c90 0x7f6acc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 --2- 172.21.15.104:0/625089187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6acc0040d0 0x7f6acc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 --2- 172.21.15.104:0/625089187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6acc004d40 0x7f6acc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40d01c0 con 0x7f6acc004d40 2024-05-08T04:22:38.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc00baa0 con 0x7f6acc0040d0 2024-05-08T04:22:38.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc00bca0 con 0x7f6ae40b6c90 2024-05-08T04:22:38.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6ae9796640 1 --2- 172.21.15.104:0/625089187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6acc004d40 0x7f6acc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6adbfff640 1 --2- 172.21.15.104:0/625089187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6acc0040d0 0x7f6acc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6ae8f95640 1 --2- 172.21.15.104:0/625089187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae40b6c90 0x7f6acc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6ae9796640 1 -- 172.21.15.104:0/625089187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae40b6c90 msgr2=0x7f6acc003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6ae9796640 1 --2- 172.21.15.104:0/625089187 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae40b6c90 0x7f6acc003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6ae9796640 1 -- 172.21.15.104:0/625089187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6acc0040d0 msgr2=0x7f6acc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6ae9796640 1 --2- 172.21.15.104:0/625089187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6acc0040d0 0x7f6acc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.617+0000 7f6ae9796640 1 -- 172.21.15.104:0/625089187 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc003520 con 0x7f6acc004d40 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.618+0000 7f6ae9796640 1 --2- 172.21.15.104:0/625089187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6acc004d40 0x7f6acc0051c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6adc001fd0 tx=0x7f6acc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbf36ebd2630129 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.618+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc001bf0 con 0x7f6acc004d40 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.618+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc003b70 con 0x7f6acc004d40 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.618+0000 7f6adb7fe640 1 -- 172.21.15.104:0/625089187 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc0050d0 con 0x7f6acc004d40 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.619+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/625089187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6acc004d40 msgr2=0x7f6acc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.619+0000 7f6aeb1f9640 1 --2- 172.21.15.104:0/625089187 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6acc004d40 0x7f6acc0051c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6adc001fd0 tx=0x7f6acc005830 comp rx=0 tx=0).stop 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.619+0000 7f6ae9796640 1 -- 172.21.15.104:0/625089187 reap_dead start 2024-05-08T04:22:38.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.619+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/625089187 shutdown_connections 2024-05-08T04:22:38.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.619+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/625089187 >> 172.21.15.104:0/625089187 conn(0x7f6ae406f480 msgr2=0x7f6ae406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:38.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.619+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/625089187 shutdown_connections 2024-05-08T04:22:38.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.619+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/625089187 wait complete. 2024-05-08T04:22:38.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.620+0000 7f6aeb1f9640 1 Processor -- start 2024-05-08T04:22:38.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.620+0000 7f6aeb1f9640 1 -- start start 2024-05-08T04:22:38.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6aeb1f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6acc004d40 0x7f6ae40c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6aeb1f9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae41dba40 0x7f6ae41dbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6aeb1f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae41c9a30 0x7f6ae41c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6aeb1f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40b5de0 con 0x7f6acc004d40 2024-05-08T04:22:38.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6aeb1f9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40b4880 con 0x7f6ae41dba40 2024-05-08T04:22:38.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6aeb1f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40b5f60 con 0x7f6ae41c9a30 2024-05-08T04:22:38.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6ae8f95640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6acc004d40 0x7f6ae40c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6ae8f95640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6acc004d40 0x7f6ae40c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56364/0 (socket says 172.21.15.104:56364) 2024-05-08T04:22:38.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6ae8f95640 1 -- 172.21.15.104:0/1644413627 learned_addr learned my addr 172.21.15.104:0/1644413627 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:38.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6ae8f95640 1 -- 172.21.15.104:0/1644413627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae41c9a30 msgr2=0x7f6ae41c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6ae8f95640 1 --2- 172.21.15.104:0/1644413627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae41c9a30 0x7f6ae41c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6ae8f95640 1 -- 172.21.15.104:0/1644413627 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae41dba40 msgr2=0x7f6ae41dbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6ae8f95640 1 --2- 172.21.15.104:0/1644413627 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae41dba40 0x7f6ae41dbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6ae8f95640 1 -- 172.21.15.104:0/1644413627 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae40c6b90 con 0x7f6acc004d40 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.621+0000 7f6ae8f95640 1 --2- 172.21.15.104:0/1644413627 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6acc004d40 0x7f6ae40c64b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00119a0 tx=0x7f6ae0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.622+0000 7f6ad97fa640 1 -- 172.21.15.104:0/1644413627 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000fa10 con 0x7f6acc004d40 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.622+0000 7f6ad97fa640 1 -- 172.21.15.104:0/1644413627 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae000fbb0 con 0x7f6acc004d40 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.622+0000 7f6ad97fa640 1 -- 172.21.15.104:0/1644413627 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0014440 con 0x7f6acc004d40 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.622+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/1644413627 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae40c6e70 con 0x7f6acc004d40 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.622+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/1644413627 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae40c7430 con 0x7f6acc004d40 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.623+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/1644413627 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae4075010 con 0x7f6acc004d40 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.623+0000 7f6ad97fa640 1 -- 172.21.15.104:0/1644413627 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f6ae0012040 con 0x7f6acc004d40 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.624+0000 7f6ad97fa640 1 --2- 172.21.15.104:0/1644413627 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6ad006b680 0x7f6ad006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.624+0000 7f6ad97fa640 1 -- 172.21.15.104:0/1644413627 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6ae008a810 con 0x7f6acc004d40 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.624+0000 7f6adbfff640 1 --2- 172.21.15.104:0/1644413627 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6ad006b680 0x7f6ad006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:38.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.624+0000 7f6adbfff640 1 --2- 172.21.15.104:0/1644413627 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6ad006b680 0x7f6ad006db40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40011e0 tx=0x7f6ad4001150 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:38.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.628+0000 7f6ad97fa640 1 -- 172.21.15.104:0/1644413627 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6ae0019030 con 0x7f6acc004d40 2024-05-08T04:22:38.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.865+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/1644413627 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7f6ae4068090 con 0x7f6acc004d40 2024-05-08T04:22:38.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.910+0000 7f6ad97fa640 1 -- 172.21.15.104:0/1644413627 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v106) v1 ==== 143+0+0 (secure 0 0 0) 0x7f6ae0059710 con 0x7f6acc004d40 2024-05-08T04:22:38.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.912+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/1644413627 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6ad006b680 msgr2=0x7f6ad006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.912+0000 7f6aeb1f9640 1 --2- 172.21.15.104:0/1644413627 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6ad006b680 0x7f6ad006db40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40011e0 tx=0x7f6ad4001150 comp rx=0 tx=0).stop 2024-05-08T04:22:38.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.912+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/1644413627 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6acc004d40 msgr2=0x7f6ae40c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:38.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.912+0000 7f6aeb1f9640 1 --2- 172.21.15.104:0/1644413627 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6acc004d40 0x7f6ae40c64b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00119a0 tx=0x7f6ae0011e60 comp rx=0 tx=0).stop 2024-05-08T04:22:38.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.912+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/1644413627 shutdown_connections 2024-05-08T04:22:38.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.912+0000 7f6aeb1f9640 1 --2- 172.21.15.104:0/1644413627 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6ad006b680 0x7f6ad006db40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.912+0000 7f6aeb1f9640 1 --2- 172.21.15.104:0/1644413627 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae41dba40 0x7f6ae41dbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.912+0000 7f6aeb1f9640 1 --2- 172.21.15.104:0/1644413627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae41c9a30 0x7f6ae41c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.912+0000 7f6aeb1f9640 1 --2- 172.21.15.104:0/1644413627 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6acc004d40 0x7f6ae40c64b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:38.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.912+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/1644413627 >> 172.21.15.104:0/1644413627 conn(0x7f6ae406f480 msgr2=0x7f6ae41e2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:38.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.912+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/1644413627 shutdown_connections 2024-05-08T04:22:38.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:38.912+0000 7f6aeb1f9640 1 -- 172.21.15.104:0/1644413627 wait complete. 2024-05-08T04:22:38.925 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-08T04:22:39.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.026+0000 7f7286ad8640 1 Processor -- start 2024-05-08T04:22:39.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.026+0000 7f7286ad8640 1 -- start start 2024-05-08T04:22:39.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f7286ad8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f728015bca0 0x7f72800ada00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f7286ad8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7280072810 0x7f728015c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f7286ad8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728006f4f0 con 0x7f7280160010 2024-05-08T04:22:39.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f7286ad8640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728006f7b0 con 0x7f7280072810 2024-05-08T04:22:39.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f7286ad8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72800af570 con 0x7f728015bca0 2024-05-08T04:22:39.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f727ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7280072810 0x7f728015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f7285075640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f7280160010 0x7f72800acdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38240/0 (socket says 172.21.15.104:38240) 2024-05-08T04:22:39.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f7285075640 1 -- 172.21.15.104:0/1475350286 learned_addr learned my addr 172.21.15.104:0/1475350286 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:39.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f7284874640 1 --2- 172.21.15.104:0/1475350286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f728015bca0 0x7f72800ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f727ffff640 1 -- 172.21.15.104:0/1475350286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f728015bca0 msgr2=0x7f72800ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:39.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f727ffff640 1 --2- 172.21.15.104:0/1475350286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f728015bca0 0x7f72800ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f727ffff640 1 -- 172.21.15.104:0/1475350286 >> v1:172.21.15.104:6789/0 conn(0x7f7280160010 legacy=0x7f72800acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f727f7fe640 1 -- 172.21.15.104:0/1475350286 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661274050 0 0) 0x7f728006f4f0 con 0x7f7280160010 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.027+0000 7f727ffff640 1 -- 172.21.15.104:0/1475350286 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72800af240 con 0x7f7280072810 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.028+0000 7f727ffff640 1 --2- 172.21.15.104:0/1475350286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7280072810 0x7f728015c080 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f726c0097a0 tx=0x7f726c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd3441bf0ef7718 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.028+0000 7f727f7fe640 1 -- 172.21.15.104:0/1475350286 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c037070 con 0x7f7280072810 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.028+0000 7f727f7fe640 1 -- 172.21.15.104:0/1475350286 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c02ae50 con 0x7f7280072810 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.028+0000 7f727f7fe640 1 -- 172.21.15.104:0/1475350286 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c032660 con 0x7f7280072810 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.028+0000 7f7286ad8640 1 -- 172.21.15.104:0/1475350286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7280072810 msgr2=0x7f728015c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.028+0000 7f7286ad8640 1 --2- 172.21.15.104:0/1475350286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7280072810 0x7f728015c080 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f726c0097a0 tx=0x7f726c02a100 comp rx=0 tx=0).stop 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.029+0000 7f7286ad8640 1 -- 172.21.15.104:0/1475350286 shutdown_connections 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.029+0000 7f7286ad8640 1 --2- 172.21.15.104:0/1475350286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7280072810 0x7f728015c080 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.029+0000 7f7286ad8640 1 --2- 172.21.15.104:0/1475350286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f728015bca0 0x7f72800ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.029+0000 7f7286ad8640 1 -- 172.21.15.104:0/1475350286 >> 172.21.15.104:0/1475350286 conn(0x7f7280071a10 msgr2=0x7f7280071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.029+0000 7f7286ad8640 1 -- 172.21.15.104:0/1475350286 shutdown_connections 2024-05-08T04:22:39.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.029+0000 7f7286ad8640 1 -- 172.21.15.104:0/1475350286 wait complete. 2024-05-08T04:22:39.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.030+0000 7f7286ad8640 1 Processor -- start 2024-05-08T04:22:39.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.030+0000 7f7286ad8640 1 -- start start 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7286ad8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7280072810 0x7f728014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7286ad8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f728015bca0 0x7f72800b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7286ad8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7280160010 0x7f72800cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7286ad8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72800ad500 con 0x7f7280160010 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7286ad8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72800af850 con 0x7f728015bca0 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7286ad8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728006bb70 con 0x7f7280072810 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7285075640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7280160010 0x7f72800cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7285075640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7280160010 0x7f72800cd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56376/0 (socket says 172.21.15.104:56376) 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7285075640 1 -- 172.21.15.104:0/1915353296 learned_addr learned my addr 172.21.15.104:0/1915353296 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7284874640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7280072810 0x7f728014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7285075640 1 -- 172.21.15.104:0/1915353296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7280072810 msgr2=0x7f728014ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7285075640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7280072810 0x7f728014ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f727ffff640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f728015bca0 0x7f72800b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7285075640 1 -- 172.21.15.104:0/1915353296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f728015bca0 msgr2=0x7f72800b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7285075640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f728015bca0 0x7f72800b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7285075640 1 -- 172.21.15.104:0/1915353296 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72800b3a40 con 0x7f7280160010 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7285075640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7280160010 0x7f72800cd580 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f727800c700 tx=0x7f727800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f727d7fa640 1 -- 172.21.15.104:0/1915353296 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278018070 con 0x7f7280160010 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f727d7fa640 1 -- 172.21.15.104:0/1915353296 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727800ce10 con 0x7f7280160010 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7286ad8640 1 -- 172.21.15.104:0/1915353296 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72800b3d20 con 0x7f7280160010 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f727d7fa640 1 -- 172.21.15.104:0/1915353296 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727800a860 con 0x7f7280160010 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.031+0000 7f7286ad8640 1 -- 172.21.15.104:0/1915353296 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72800b4820 con 0x7f7280160010 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.032+0000 7f7286ad8640 1 -- 172.21.15.104:0/1915353296 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7280075010 con 0x7f7280160010 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.033+0000 7f727d7fa640 1 -- 172.21.15.104:0/1915353296 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f727801b070 con 0x7f7280160010 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.033+0000 7f727d7fa640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f726406b680 0x7f726406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.033+0000 7f727d7fa640 1 -- 172.21.15.104:0/1915353296 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7278089780 con 0x7f7280160010 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.033+0000 7f7284874640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f726406b680 0x7f726406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.034+0000 7f7284874640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f726406b680 0x7f726406db40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7274006fd0 tx=0x7f7274008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:39.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.037+0000 7f727d7fa640 1 -- 172.21.15.104:0/1915353296 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7278058710 con 0x7f7280160010 2024-05-08T04:22:39.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.207+0000 7f7286ad8640 1 -- 172.21.15.104:0/1915353296 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7280157130 con 0x7f7280160010 2024-05-08T04:22:39.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.210+0000 7f727d7fa640 1 -- 172.21.15.104:0/1915353296 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7278058010 con 0x7f7280160010 2024-05-08T04:22:39.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.212+0000 7f7286ad8640 1 -- 172.21.15.104:0/1915353296 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f726406b680 msgr2=0x7f726406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.212+0000 7f7286ad8640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f726406b680 0x7f726406db40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7274006fd0 tx=0x7f7274008040 comp rx=0 tx=0).stop 2024-05-08T04:22:39.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.212+0000 7f7286ad8640 1 -- 172.21.15.104:0/1915353296 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7280160010 msgr2=0x7f72800cd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.212+0000 7f7286ad8640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7280160010 0x7f72800cd580 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f727800c700 tx=0x7f727800cbc0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.212+0000 7f7286ad8640 1 -- 172.21.15.104:0/1915353296 shutdown_connections 2024-05-08T04:22:39.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.212+0000 7f7286ad8640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f726406b680 0x7f726406db40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.212+0000 7f7286ad8640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f728015bca0 0x7f72800b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.212+0000 7f7286ad8640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7280160010 0x7f72800cd580 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.212+0000 7f7286ad8640 1 --2- 172.21.15.104:0/1915353296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7280072810 0x7f728014ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.212+0000 7f7286ad8640 1 -- 172.21.15.104:0/1915353296 >> 172.21.15.104:0/1915353296 conn(0x7f7280071a10 msgr2=0x7f72800b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:39.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.212+0000 7f7286ad8640 1 -- 172.21.15.104:0/1915353296 shutdown_connections 2024-05-08T04:22:39.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.212+0000 7f7286ad8640 1 -- 172.21.15.104:0/1915353296 wait complete. 2024-05-08T04:22:39.225 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-08T04:22:39.225 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T04:22:39.262 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T04:22:39.316 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-08T04:22:39.316 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:22:39.316 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:22:39.332 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=587 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T04:22:39.332 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:22:39.332 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:22:39.351 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13681 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T04:22:39.351 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:22:39.351 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:22:39.387 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=587 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T04:22:39.388 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:22:39.388 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:22:39.408 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13681 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T04:22:39.408 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-08T04:22:39.409 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:22:39.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.525+0000 7f013bef5640 1 Processor -- start 2024-05-08T04:22:39.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.526+0000 7f013bef5640 1 -- start start 2024-05-08T04:22:39.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.526+0000 7f013bef5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0134070c70 0x7f0134071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.526+0000 7f013bef5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0134157ac0 0x7f0134157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.526+0000 7f013bef5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0134071590 con 0x7f013415edf0 2024-05-08T04:22:39.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.526+0000 7f013bef5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013406bc70 con 0x7f0134157ac0 2024-05-08T04:22:39.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.526+0000 7f013bef5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01340d15c0 con 0x7f0134070c70 2024-05-08T04:22:39.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.527+0000 7f0139c91640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0134070c70 0x7f0134071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.527+0000 7f013a492640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0134157ac0 0x7f0134157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.527+0000 7f0139c91640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0134070c70 0x7f0134071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:42172/0 (socket says 172.21.15.104:42172) 2024-05-08T04:22:39.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.527+0000 7f0139c91640 1 -- 172.21.15.104:0/3931658702 learned_addr learned my addr 172.21.15.104:0/3931658702 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:39.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.527+0000 7f013a492640 1 -- 172.21.15.104:0/3931658702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0134070c70 msgr2=0x7f0134071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:39.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.527+0000 7f013a492640 1 --2- 172.21.15.104:0/3931658702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0134070c70 0x7f0134071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.527+0000 7f013a492640 1 -- 172.21.15.104:0/3931658702 >> v1:172.21.15.183:6789/0 conn(0x7f013415edf0 legacy=0x7f01340b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.527+0000 7f013a492640 1 -- 172.21.15.104:0/3931658702 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013415f550 con 0x7f0134157ac0 2024-05-08T04:22:39.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.527+0000 7f0138c8f640 1 -- 172.21.15.104:0/3931658702 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110868605 0 0) 0x7f0134071590 con 0x7f013415edf0 2024-05-08T04:22:39.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.527+0000 7f0139c91640 1 --2- 172.21.15.104:0/3931658702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0134070c70 0x7f0134071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:22:39.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.528+0000 7f013a492640 1 --2- 172.21.15.104:0/3931658702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0134157ac0 0x7f0134157f50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f012c009d90 tx=0x7f012c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2f13200265138bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:39.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.528+0000 7f0138c8f640 1 -- 172.21.15.104:0/3931658702 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c007740 con 0x7f0134157ac0 2024-05-08T04:22:39.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.528+0000 7f0138c8f640 1 -- 172.21.15.104:0/3931658702 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c0078e0 con 0x7f0134157ac0 2024-05-08T04:22:39.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.528+0000 7f0138c8f640 1 -- 172.21.15.104:0/3931658702 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c007cb0 con 0x7f0134157ac0 2024-05-08T04:22:39.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.529+0000 7f013bef5640 1 -- 172.21.15.104:0/3931658702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0134157ac0 msgr2=0x7f0134157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.529+0000 7f013bef5640 1 --2- 172.21.15.104:0/3931658702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0134157ac0 0x7f0134157f50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f012c009d90 tx=0x7f012c02a660 comp rx=0 tx=0).stop 2024-05-08T04:22:39.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.529+0000 7f013bef5640 1 -- 172.21.15.104:0/3931658702 shutdown_connections 2024-05-08T04:22:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.529+0000 7f013bef5640 1 --2- 172.21.15.104:0/3931658702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0134157ac0 0x7f0134157f50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.529+0000 7f013bef5640 1 --2- 172.21.15.104:0/3931658702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0134070c70 0x7f0134071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.529+0000 7f013bef5640 1 -- 172.21.15.104:0/3931658702 >> 172.21.15.104:0/3931658702 conn(0x7f01340b3450 msgr2=0x7f01340b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.529+0000 7f013bef5640 1 -- 172.21.15.104:0/3931658702 shutdown_connections 2024-05-08T04:22:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.529+0000 7f013bef5640 1 -- 172.21.15.104:0/3931658702 wait complete. 2024-05-08T04:22:39.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.530+0000 7f013bef5640 1 Processor -- start 2024-05-08T04:22:39.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.530+0000 7f013bef5640 1 -- start start 2024-05-08T04:22:39.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f013bef5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0134070c70 0x7f0134149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f013bef5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0134157ac0 0x7f013415a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f013bef5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f013415edf0 0x7f0134158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f013bef5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01340b5b80 con 0x7f0134157ac0 2024-05-08T04:22:39.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f013bef5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013415fb10 con 0x7f013415edf0 2024-05-08T04:22:39.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f013bef5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0134158490 con 0x7f0134070c70 2024-05-08T04:22:39.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f0139490640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0134157ac0 0x7f013415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f0139490640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0134157ac0 0x7f013415a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56382/0 (socket says 172.21.15.104:56382) 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f0139490640 1 -- 172.21.15.104:0/2139707343 learned_addr learned my addr 172.21.15.104:0/2139707343 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f0139c91640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0134070c70 0x7f0134149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f013a492640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f013415edf0 0x7f0134158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f0139490640 1 -- 172.21.15.104:0/2139707343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0134070c70 msgr2=0x7f0134149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f0139490640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0134070c70 0x7f0134149220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f0139490640 1 -- 172.21.15.104:0/2139707343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f013415edf0 msgr2=0x7f0134158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f0139490640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f013415edf0 0x7f0134158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f0139490640 1 -- 172.21.15.104:0/2139707343 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01341451d0 con 0x7f0134157ac0 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f0139490640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0134157ac0 0x7f013415a740 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f013000c410 tx=0x7f013000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f01267fc640 1 -- 172.21.15.104:0/2139707343 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130017070 con 0x7f0134157ac0 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f01267fc640 1 -- 172.21.15.104:0/2139707343 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300035f0 con 0x7f0134157ac0 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f01267fc640 1 -- 172.21.15.104:0/2139707343 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130003a00 con 0x7f0134157ac0 2024-05-08T04:22:39.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.531+0000 7f013bef5640 1 -- 172.21.15.104:0/2139707343 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013415ae90 con 0x7f0134157ac0 2024-05-08T04:22:39.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.532+0000 7f013bef5640 1 -- 172.21.15.104:0/2139707343 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013415b450 con 0x7f0134157ac0 2024-05-08T04:22:39.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.532+0000 7f013bef5640 1 -- 172.21.15.104:0/2139707343 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0134075010 con 0x7f0134157ac0 2024-05-08T04:22:39.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.533+0000 7f01267fc640 1 -- 172.21.15.104:0/2139707343 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f013001a070 con 0x7f0134157ac0 2024-05-08T04:22:39.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.533+0000 7f01267fc640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f011806b6b0 0x7f011806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.534+0000 7f0139c91640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f011806b6b0 0x7f011806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.534+0000 7f01267fc640 1 -- 172.21.15.104:0/2139707343 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f01300894b0 con 0x7f0134157ac0 2024-05-08T04:22:39.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.534+0000 7f0139c91640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f011806b6b0 0x7f011806db70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0128006ca0 tx=0x7f0128009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:39.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.538+0000 7f01267fc640 1 -- 172.21.15.104:0/2139707343 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0130057e10 con 0x7f0134157ac0 2024-05-08T04:22:39.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.744+0000 7f013bef5640 1 -- 172.21.15.104:0/2139707343 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0134071a50 con 0x7f0134157ac0 2024-05-08T04:22:39.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.745+0000 7f01267fc640 1 -- 172.21.15.104:0/2139707343 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f013005beb0 con 0x7f0134157ac0 2024-05-08T04:22:39.746 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:39.746 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4933,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3121320604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3121320604},{"type":"v1","addr":"172.21.15.183:6834","nonce":3121320604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4936,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/207909171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":207909171},{"type":"v1","addr":"172.21.15.183:6835","nonce":207909171}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/4245686743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4245686743},{"type":"v1","addr":"172.21.15.104:6836","nonce":4245686743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/2963210746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":2963210746},{"type":"v1","addr":"172.21.15.104:6837","nonce":2963210746}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[]} 2024-05-08T04:22:39.747 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 17 2024-05-08T04:22:39.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.747+0000 7f013bef5640 1 -- 172.21.15.104:0/2139707343 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f011806b6b0 msgr2=0x7f011806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.747+0000 7f013bef5640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f011806b6b0 0x7f011806db70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0128006ca0 tx=0x7f0128009240 comp rx=0 tx=0).stop 2024-05-08T04:22:39.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.747+0000 7f013bef5640 1 -- 172.21.15.104:0/2139707343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0134157ac0 msgr2=0x7f013415a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.747+0000 7f013bef5640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0134157ac0 0x7f013415a740 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f013000c410 tx=0x7f013000c8d0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.747+0000 7f013bef5640 1 -- 172.21.15.104:0/2139707343 shutdown_connections 2024-05-08T04:22:39.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.747+0000 7f013bef5640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f011806b6b0 0x7f011806db70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.747+0000 7f013bef5640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f013415edf0 0x7f0134158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.747+0000 7f013bef5640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0134157ac0 0x7f013415a740 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.747+0000 7f013bef5640 1 --2- 172.21.15.104:0/2139707343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0134070c70 0x7f0134149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.747+0000 7f013bef5640 1 -- 172.21.15.104:0/2139707343 >> 172.21.15.104:0/2139707343 conn(0x7f01340b3450 msgr2=0x7f01340b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:39.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.747+0000 7f013bef5640 1 -- 172.21.15.104:0/2139707343 shutdown_connections 2024-05-08T04:22:39.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.747+0000 7f013bef5640 1 -- 172.21.15.104:0/2139707343 wait complete. 2024-05-08T04:22:39.759 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T04:22:39.759 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-08T04:22:39.760 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T04:22:39.760 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:22:39.760 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T04:22:39.760 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-08T04:22:39.760 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T04:22:39.760 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:22:39.761 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T04:22:39.761 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-08T04:22:39.761 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T04:22:39.761 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:22:39.761 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T04:22:39.761 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-08T04:22:39.761 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T04:22:39.762 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:22:39.769 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T04:22:39.770 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T04:22:39.770 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T04:22:39.771 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T04:22:39.773 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T04:22:39.773 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T04:22:39.774 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T04:22:39.774 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T04:22:39.812 INFO:tasks.ceph.mds.c:Started 2024-05-08T04:22:39.813 DEBUG:teuthology.parallel:result is None 2024-05-08T04:22:39.813 INFO:tasks.ceph.mds.a:Started 2024-05-08T04:22:39.814 DEBUG:teuthology.parallel:result is None 2024-05-08T04:22:39.817 INFO:tasks.ceph.mds.b:Started 2024-05-08T04:22:39.818 DEBUG:teuthology.parallel:result is None 2024-05-08T04:22:39.818 INFO:tasks.ceph.mds.d:Started 2024-05-08T04:22:39.818 DEBUG:teuthology.parallel:result is None 2024-05-08T04:22:39.819 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-08T04:22:39.887 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-05-08T04:22:39.888 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-05-08T04:22:39.901 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2024-05-08T04:22:39.901 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2024-05-08T04:22:39.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.923+0000 7fa820ffe640 1 Processor -- start 2024-05-08T04:22:39.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.923+0000 7fa820ffe640 1 -- start start 2024-05-08T04:22:39.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa820ffe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa81c06ab60 0x7fa81c070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa820ffe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81c15de30 0x7fa81c15e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa820ffe640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c0d0450 con 0x7fa81c0cff50 2024-05-08T04:22:39.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa820ffe640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c161630 con 0x7fa81c06ab60 2024-05-08T04:22:39.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa820ffe640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c072ab0 con 0x7fa81c15de30 2024-05-08T04:22:39.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa81a59c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa81c06ab60 0x7fa81c070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa81a59c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa81c06ab60 0x7fa81c070820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56444/0 (socket says 172.21.15.104:56444) 2024-05-08T04:22:39.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa81a59c640 1 -- 172.21.15.104:0/757686794 learned_addr learned my addr 172.21.15.104:0/757686794 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:39.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa81ad9d640 1 --2- 172.21.15.104:0/757686794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81c15de30 0x7fa81c15e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa81a59c640 1 -- 172.21.15.104:0/757686794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81c15de30 msgr2=0x7fa81c15e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:39.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa81a59c640 1 --2- 172.21.15.104:0/757686794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81c15de30 0x7fa81c15e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa81a59c640 1 -- 172.21.15.104:0/757686794 >> v1:172.21.15.183:6789/0 conn(0x7fa81c0cff50 legacy=0x7fa81c06af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa81a59c640 1 -- 172.21.15.104:0/757686794 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c072d90 con 0x7fa81c06ab60 2024-05-08T04:22:39.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.924+0000 7fa81ad9d640 1 --2- 172.21.15.104:0/757686794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81c15de30 0x7fa81c15e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:39.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.925+0000 7fa81a59c640 1 --2- 172.21.15.104:0/757686794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa81c06ab60 0x7fa81c070820 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009870 tx=0x7fa80c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969a4580fa2b8050 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:39.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.927+0000 7fa81959a640 1 -- 172.21.15.104:0/757686794 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c037070 con 0x7fa81c06ab60 2024-05-08T04:22:39.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.927+0000 7fa81959a640 1 -- 172.21.15.104:0/757686794 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c032440 con 0x7fa81c06ab60 2024-05-08T04:22:39.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.927+0000 7fa81959a640 1 -- 172.21.15.104:0/757686794 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c032810 con 0x7fa81c06ab60 2024-05-08T04:22:39.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.928+0000 7fa820ffe640 1 -- 172.21.15.104:0/757686794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa81c06ab60 msgr2=0x7fa81c070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.928+0000 7fa820ffe640 1 --2- 172.21.15.104:0/757686794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa81c06ab60 0x7fa81c070820 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009870 tx=0x7fa80c02a1c0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.928+0000 7fa820ffe640 1 -- 172.21.15.104:0/757686794 shutdown_connections 2024-05-08T04:22:39.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.928+0000 7fa820ffe640 1 --2- 172.21.15.104:0/757686794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81c15de30 0x7fa81c15e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.928+0000 7fa820ffe640 1 --2- 172.21.15.104:0/757686794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa81c06ab60 0x7fa81c070820 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.928+0000 7fa820ffe640 1 -- 172.21.15.104:0/757686794 >> 172.21.15.104:0/757686794 conn(0x7fa81c0b23e0 msgr2=0x7fa81c0b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:39.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.928+0000 7fa820ffe640 1 -- 172.21.15.104:0/757686794 shutdown_connections 2024-05-08T04:22:39.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.928+0000 7fa820ffe640 1 -- 172.21.15.104:0/757686794 wait complete. 2024-05-08T04:22:39.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.930+0000 7fa820ffe640 1 Processor -- start 2024-05-08T04:22:39.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.930+0000 7fa820ffe640 1 -- start start 2024-05-08T04:22:39.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.930+0000 7fa820ffe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa81c06ab60 0x7fa81c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.930+0000 7fa820ffe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81c0cff50 0x7fa81c0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.930+0000 7fa820ffe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa81c15de30 0x7fa81c0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.930+0000 7fa820ffe640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c161ac0 con 0x7fa81c15de30 2024-05-08T04:22:39.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.930+0000 7fa820ffe640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c070370 con 0x7fa81c06ab60 2024-05-08T04:22:39.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.930+0000 7fa820ffe640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c161c40 con 0x7fa81c0cff50 2024-05-08T04:22:39.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.930+0000 7fa81ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa81c15de30 0x7fa81c0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.930+0000 7fa81ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa81c15de30 0x7fa81c0b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56448/0 (socket says 172.21.15.104:56448) 2024-05-08T04:22:39.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.931+0000 7fa81ad9d640 1 -- 172.21.15.104:0/3895652405 learned_addr learned my addr 172.21.15.104:0/3895652405 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:39.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.931+0000 7fa81a59c640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa81c06ab60 0x7fa81c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.931+0000 7fa819d9b640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81c0cff50 0x7fa81c0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.931+0000 7fa81ad9d640 1 -- 172.21.15.104:0/3895652405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81c0cff50 msgr2=0x7fa81c0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.931+0000 7fa81ad9d640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81c0cff50 0x7fa81c0b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.931+0000 7fa81ad9d640 1 -- 172.21.15.104:0/3895652405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa81c06ab60 msgr2=0x7fa81c15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:39.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.931+0000 7fa81ad9d640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa81c06ab60 0x7fa81c15a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:39.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.931+0000 7fa81ad9d640 1 -- 172.21.15.104:0/3895652405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c0b4d40 con 0x7fa81c15de30 2024-05-08T04:22:39.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.931+0000 7fa81ad9d640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa81c15de30 0x7fa81c0b3e50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa814007ea0 tx=0x7fa814007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:39.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.936+0000 7fa80affd640 1 -- 172.21.15.104:0/3895652405 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81401a070 con 0x7fa81c15de30 2024-05-08T04:22:39.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.936+0000 7fa820ffe640 1 -- 172.21.15.104:0/3895652405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c15ac50 con 0x7fa81c15de30 2024-05-08T04:22:39.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.936+0000 7fa820ffe640 1 -- 172.21.15.104:0/3895652405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c0b3650 con 0x7fa81c15de30 2024-05-08T04:22:39.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.936+0000 7fa80affd640 1 -- 172.21.15.104:0/3895652405 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81400de70 con 0x7fa81c15de30 2024-05-08T04:22:39.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.936+0000 7fa80affd640 1 -- 172.21.15.104:0/3895652405 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814003d90 con 0x7fa81c15de30 2024-05-08T04:22:39.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.937+0000 7fa820ffe640 1 -- 172.21.15.104:0/3895652405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c075010 con 0x7fa81c15de30 2024-05-08T04:22:39.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.937+0000 7fa80affd640 1 -- 172.21.15.104:0/3895652405 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fa81401d070 con 0x7fa81c15de30 2024-05-08T04:22:39.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.937+0000 7fa80affd640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa7fc06b680 0x7fa7fc06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:39.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.938+0000 7fa81a59c640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa7fc06b680 0x7fa7fc06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:39.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.938+0000 7fa80affd640 1 -- 172.21.15.104:0/3895652405 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa81408a470 con 0x7fa81c15de30 2024-05-08T04:22:39.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.938+0000 7fa81a59c640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa7fc06b680 0x7fa7fc06db40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa80c034000 tx=0x7fa80c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:39.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:39.942+0000 7fa80affd640 1 -- 172.21.15.104:0/3895652405 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa814010070 con 0x7fa81c15de30 2024-05-08T04:22:40.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.127+0000 7fa820ffe640 1 -- 172.21.15.104:0/3895652405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa81c0722e0 con 0x7fa81c15de30 2024-05-08T04:22:40.628 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:22:40.631 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:22:40.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.945+0000 7fa80affd640 1 -- 172.21.15.104:0/3895652405 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa814058c40 con 0x7fa81c15de30 2024-05-08T04:22:40.947 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-05-08T04:22:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.948+0000 7fa820ffe640 1 -- 172.21.15.104:0/3895652405 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa7fc06b680 msgr2=0x7fa7fc06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.948+0000 7fa820ffe640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa7fc06b680 0x7fa7fc06db40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa80c034000 tx=0x7fa80c02e000 comp rx=0 tx=0).stop 2024-05-08T04:22:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.948+0000 7fa820ffe640 1 -- 172.21.15.104:0/3895652405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa81c15de30 msgr2=0x7fa81c0b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.948+0000 7fa820ffe640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa81c15de30 0x7fa81c0b3e50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa814007ea0 tx=0x7fa814007f90 comp rx=0 tx=0).stop 2024-05-08T04:22:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.948+0000 7fa820ffe640 1 -- 172.21.15.104:0/3895652405 shutdown_connections 2024-05-08T04:22:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.948+0000 7fa820ffe640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa7fc06b680 0x7fa7fc06db40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.948+0000 7fa820ffe640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa81c15de30 0x7fa81c0b3e50 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.948+0000 7fa820ffe640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81c0cff50 0x7fa81c0b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.948+0000 7fa820ffe640 1 --2- 172.21.15.104:0/3895652405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa81c06ab60 0x7fa81c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.948+0000 7fa820ffe640 1 -- 172.21.15.104:0/3895652405 >> 172.21.15.104:0/3895652405 conn(0x7fa81c0b23e0 msgr2=0x7fa81c0ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.948+0000 7fa820ffe640 1 -- 172.21.15.104:0/3895652405 shutdown_connections 2024-05-08T04:22:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:40.948+0000 7fa820ffe640 1 -- 172.21.15.104:0/3895652405 wait complete. 2024-05-08T04:22:40.963 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-08T04:22:41.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.067+0000 7f14249db640 1 Processor -- start 2024-05-08T04:22:41.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.067+0000 7f14249db640 1 -- start start 2024-05-08T04:22:41.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.068+0000 7f14249db640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f142015b7d0 0x7f142015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.068+0000 7f14249db640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f142015e6a0 0x7f14200b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.068+0000 7f14249db640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142015ed40 con 0x7f14200b3b80 2024-05-08T04:22:41.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.068+0000 7f14249db640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142006d6d0 con 0x7f142015b7d0 2024-05-08T04:22:41.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.068+0000 7f14249db640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142006d9b0 con 0x7f142015e6a0 2024-05-08T04:22:41.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.068+0000 7f141e59c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f142015b7d0 0x7f142015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.068+0000 7f141ed9d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f14200b3b80 0x7f1420161750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38266/0 (socket says 172.21.15.104:38266) 2024-05-08T04:22:41.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.068+0000 7f141ed9d640 1 -- 172.21.15.104:0/843035990 learned_addr learned my addr 172.21.15.104:0/843035990 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:41.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.068+0000 7f141dd9b640 1 --2- 172.21.15.104:0/843035990 >> v2:172.21.15.183:3300/0 conn(0x7f142015e6a0 0x7f14200b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.069+0000 7f141e59c640 1 -- 172.21.15.104:0/843035990 >> v2:172.21.15.183:3300/0 conn(0x7f142015e6a0 msgr2=0x7f14200b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:41.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.069+0000 7f141e59c640 1 --2- 172.21.15.104:0/843035990 >> v2:172.21.15.183:3300/0 conn(0x7f142015e6a0 0x7f14200b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.069+0000 7f141e59c640 1 -- 172.21.15.104:0/843035990 >> v1:172.21.15.104:6789/0 conn(0x7f14200b3b80 legacy=0x7f1420161750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.069+0000 7f141d59a640 1 -- 172.21.15.104:0/843035990 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118152602 0 0) 0x7f142015ed40 con 0x7f14200b3b80 2024-05-08T04:22:41.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.069+0000 7f141e59c640 1 -- 172.21.15.104:0/843035990 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142006dc90 con 0x7f142015b7d0 2024-05-08T04:22:41.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.069+0000 7f141e59c640 1 --2- 172.21.15.104:0/843035990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142015b7d0 0x7f142015e160 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1410009d90 tx=0x7f141002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789c4d0d589df25d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:41.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.069+0000 7f141d59a640 1 -- 172.21.15.104:0/843035990 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410007740 con 0x7f142015b7d0 2024-05-08T04:22:41.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.069+0000 7f141d59a640 1 -- 172.21.15.104:0/843035990 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14100078e0 con 0x7f142015b7d0 2024-05-08T04:22:41.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.069+0000 7f141d59a640 1 -- 172.21.15.104:0/843035990 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410007cb0 con 0x7f142015b7d0 2024-05-08T04:22:41.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.070+0000 7f14249db640 1 -- 172.21.15.104:0/843035990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142015b7d0 msgr2=0x7f142015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.070+0000 7f14249db640 1 --2- 172.21.15.104:0/843035990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142015b7d0 0x7f142015e160 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1410009d90 tx=0x7f141002a6a0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.070+0000 7f14249db640 1 -- 172.21.15.104:0/843035990 shutdown_connections 2024-05-08T04:22:41.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.070+0000 7f14249db640 1 --2- 172.21.15.104:0/843035990 >> v2:172.21.15.183:3300/0 conn(0x7f142015e6a0 0x7f14200b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.070+0000 7f14249db640 1 --2- 172.21.15.104:0/843035990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142015b7d0 0x7f142015e160 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.070+0000 7f14249db640 1 -- 172.21.15.104:0/843035990 >> 172.21.15.104:0/843035990 conn(0x7f14200cfa60 msgr2=0x7f14200cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:41.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.070+0000 7f14249db640 1 -- 172.21.15.104:0/843035990 shutdown_connections 2024-05-08T04:22:41.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.070+0000 7f14249db640 1 -- 172.21.15.104:0/843035990 wait complete. 2024-05-08T04:22:41.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.071+0000 7f14249db640 1 Processor -- start 2024-05-08T04:22:41.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.072+0000 7f14249db640 1 -- start start 2024-05-08T04:22:41.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.072+0000 7f14249db640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14200b3b80 0x7f14201f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.072+0000 7f14249db640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f142015b7d0 0x7f14200ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.072+0000 7f14249db640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142015e6a0 0x7f142006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.072+0000 7f14249db640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142015f020 con 0x7f142015e6a0 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.072+0000 7f14249db640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1420071890 con 0x7f142015b7d0 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.072+0000 7f14249db640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142006f1c0 con 0x7f14200b3b80 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.072+0000 7f141ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142015e6a0 0x7f142006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.072+0000 7f141ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142015e6a0 0x7f142006e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56476/0 (socket says 172.21.15.104:56476) 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.072+0000 7f141ed9d640 1 -- 172.21.15.104:0/1147401090 learned_addr learned my addr 172.21.15.104:0/1147401090 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f141e59c640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14200b3b80 0x7f14201f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f141dd9b640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f142015b7d0 0x7f14200ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f141ed9d640 1 -- 172.21.15.104:0/1147401090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14200b3b80 msgr2=0x7f14201f3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f141ed9d640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14200b3b80 0x7f14201f3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f141ed9d640 1 -- 172.21.15.104:0/1147401090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f142015b7d0 msgr2=0x7f14200ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f141ed9d640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f142015b7d0 0x7f14200ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f141ed9d640 1 -- 172.21.15.104:0/1147401090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420148bf0 con 0x7f142015e6a0 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f141dd9b640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f142015b7d0 0x7f14200ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f141ed9d640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142015e6a0 0x7f142006e0b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f141800c450 tx=0x7f141800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f1416ffd640 1 -- 172.21.15.104:0/1147401090 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418018070 con 0x7f142015e6a0 2024-05-08T04:22:41.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f1416ffd640 1 -- 172.21.15.104:0/1147401090 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1418007500 con 0x7f142015e6a0 2024-05-08T04:22:41.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f1416ffd640 1 -- 172.21.15.104:0/1147401090 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418004a20 con 0x7f142015e6a0 2024-05-08T04:22:41.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f14249db640 1 -- 172.21.15.104:0/1147401090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1420148070 con 0x7f142015e6a0 2024-05-08T04:22:41.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.073+0000 7f14249db640 1 -- 172.21.15.104:0/1147401090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1420148630 con 0x7f142015e6a0 2024-05-08T04:22:41.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.074+0000 7f14249db640 1 -- 172.21.15.104:0/1147401090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1420075010 con 0x7f142015e6a0 2024-05-08T04:22:41.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.074+0000 7f1416ffd640 1 -- 172.21.15.104:0/1147401090 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f141801b070 con 0x7f142015e6a0 2024-05-08T04:22:41.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.075+0000 7f1416ffd640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f140006b680 0x7f140006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.075+0000 7f1416ffd640 1 -- 172.21.15.104:0/1147401090 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f14180893d0 con 0x7f142015e6a0 2024-05-08T04:22:41.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.075+0000 7f141e59c640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f140006b680 0x7f140006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.075+0000 7f141e59c640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f140006b680 0x7f140006db40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1410034000 tx=0x7f141002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:41.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.079+0000 7f1416ffd640 1 -- 172.21.15.104:0/1147401090 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1418058320 con 0x7f142015e6a0 2024-05-08T04:22:41.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.316+0000 7f14249db640 1 -- 172.21.15.104:0/1147401090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f14200af4e0 con 0x7f142015e6a0 2024-05-08T04:22:41.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.316+0000 7f1416ffd640 1 -- 172.21.15.104:0/1147401090 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1418057c20 con 0x7f142015e6a0 2024-05-08T04:22:41.318 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:41.318 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:22:41.318 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-05-08T04:22:41.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.318 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-05-08T04:22:41.318 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmxdFrMRAAmzLHedytHXAGNpNucGZaCQ==", 2024-05-08T04:22:41.318 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.318 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:41.318 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:22:41.318 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:22:41.318 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.319 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.319 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-05-08T04:22:41.319 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmeApvARAAKgHwMIgcOw0WeJMA6B6Alw==", 2024-05-08T04:22:41.319 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.319 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:41.319 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:22:41.319 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:22:41.319 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.319 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmFB1nOBAAtAvmTbNBjWFX/1fOOdjN5g==", 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmvNx2CBAAiekQnEgL4wKKJK0cycdqmA==", 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:41.320 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCA/TpmI1TdKxAAmwA8+WnZMSYoYAZ9Jbq3PQ==", 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.321 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCD/TpmnHVwKhAA8eYNmL/xrJeFs5ZMoZEl7w==", 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCG/Tpmx++nKBAAn79a9YBVJXBBwVb3odRT+Q==", 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:41.322 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCJ/Tpm2c4qJxAAAvpc8VwahQ3eipDq4B0sLw==", 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-05-08T04:22:41.323 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCP/TpmTSzlKhAALgVYlmQcoxc95iy2wGzNTw==", 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCS/TpmT8O4KRAAtJalEzRoN4egUhKDGgWG2Q==", 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-05-08T04:22:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCV/Tpmr9wbKBAAjTGgFWKdCTJQeKFh+Qy8rQ==", 2024-05-08T04:22:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-05-08T04:22:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCY/Tpmj8sIJxAAURnOCmVXzgueWr9WWIi5sg==", 2024-05-08T04:22:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmmVCJDBAA7kFxGuTTRTJge+xrcPo3lw==", 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow r", 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-05-08T04:22:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmnZVEFRAAxxoeoXxT01K0NTE9OIDjEA==", 2024-05-08T04:22:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-05-08T04:22:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-05-08T04:22:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-05-08T04:22:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-05-08T04:22:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/Tpm8YYTEhAAv2yuipPFRLKgsYmLKsVvUw==", 2024-05-08T04:22:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmqiHcGhAAG6+jVhyfQkGUITvUBe7GxQ==", 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-05-08T04:22:41.328 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-05-08T04:22:41.329 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.329 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-05-08T04:22:41.329 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmVvyeFBAAHiDJbzlyvYLKJ86reB18sw==", 2024-05-08T04:22:41.329 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.329 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-05-08T04:22:41.329 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:22:41.329 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:22:41.329 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.329 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.330 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-05-08T04:22:41.330 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmpYwyLhAAaPUMPrzgHp1zZyeBWtqiNA==", 2024-05-08T04:22:41.330 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.330 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-05-08T04:22:41.330 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-05-08T04:22:41.330 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.330 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.330 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:41.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:41.330 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-05-08T04:22:41.330 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmC2JMKRAAuayaBslUW+T2xxUcFYJ2iQ==", 2024-05-08T04:22:41.330 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:22:41.330 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-05-08T04:22:41.331 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-05-08T04:22:41.331 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:22:41.331 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.331 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:41.331 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-05-08T04:22:41.331 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:22:41.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.318+0000 7f14249db640 1 -- 172.21.15.104:0/1147401090 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f140006b680 msgr2=0x7f140006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.318+0000 7f14249db640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f140006b680 0x7f140006db40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1410034000 tx=0x7f141002f000 comp rx=0 tx=0).stop 2024-05-08T04:22:41.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.318+0000 7f14249db640 1 -- 172.21.15.104:0/1147401090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142015e6a0 msgr2=0x7f142006e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.318+0000 7f14249db640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142015e6a0 0x7f142006e0b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f141800c450 tx=0x7f141800c910 comp rx=0 tx=0).stop 2024-05-08T04:22:41.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.318+0000 7f14249db640 1 -- 172.21.15.104:0/1147401090 shutdown_connections 2024-05-08T04:22:41.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.318+0000 7f14249db640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f140006b680 0x7f140006db40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.318+0000 7f14249db640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f142015b7d0 0x7f14200ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.318+0000 7f14249db640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f142015e6a0 0x7f142006e0b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.318+0000 7f14249db640 1 --2- 172.21.15.104:0/1147401090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14200b3b80 0x7f14201f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.318+0000 7f14249db640 1 -- 172.21.15.104:0/1147401090 >> 172.21.15.104:0/1147401090 conn(0x7f14200cfa60 msgr2=0x7f14200b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:41.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.318+0000 7f14249db640 1 -- 172.21.15.104:0/1147401090 shutdown_connections 2024-05-08T04:22:41.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.318+0000 7f14249db640 1 -- 172.21.15.104:0/1147401090 wait complete. 2024-05-08T04:22:41.334 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:41.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.431+0000 7f0a90a1b640 1 Processor -- start 2024-05-08T04:22:41.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.431+0000 7f0a90a1b640 1 -- start start 2024-05-08T04:22:41.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a90a1b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0a8c15bca0 0x7f0a8c0ada00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a90a1b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0a8c15c080 0x7f0a8c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a90a1b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c15c4f0 con 0x7f0a8c072810 2024-05-08T04:22:41.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a90a1b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c06f4f0 con 0x7f0a8c15c080 2024-05-08T04:22:41.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a90a1b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c06f7b0 con 0x7f0a8c15bca0 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a8ad9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0a8c15c080 0x7f0a8c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a83fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f0a8c072810 0x7f0a8c160010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38274/0 (socket says 172.21.15.104:38274) 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a83fff640 1 -- 172.21.15.104:0/224463952 learned_addr learned my addr 172.21.15.104:0/224463952 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a8a59c640 1 --2- 172.21.15.104:0/224463952 >> v2:172.21.15.183:3300/0 conn(0x7f0a8c15bca0 0x7f0a8c0ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a8ad9d640 1 -- 172.21.15.104:0/224463952 >> v2:172.21.15.183:3300/0 conn(0x7f0a8c15bca0 msgr2=0x7f0a8c0ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a8ad9d640 1 --2- 172.21.15.104:0/224463952 >> v2:172.21.15.183:3300/0 conn(0x7f0a8c15bca0 0x7f0a8c0ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a8ad9d640 1 -- 172.21.15.104:0/224463952 >> v1:172.21.15.104:6789/0 conn(0x7f0a8c072810 legacy=0x7f0a8c160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a8ad9d640 1 -- 172.21.15.104:0/224463952 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c0af570 con 0x7f0a8c15c080 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a89d9b640 1 -- 172.21.15.104:0/224463952 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150486024 0 0) 0x7f0a74001110 con 0x7f0a8c072810 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.432+0000 7f0a8a59c640 1 --2- 172.21.15.104:0/224463952 >> v2:172.21.15.183:3300/0 conn(0x7f0a8c15bca0 0x7f0a8c0ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.433+0000 7f0a8ad9d640 1 --2- 172.21.15.104:0/224463952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c15c080 0x7f0a8c0acdf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c06c9c0 tx=0x7f0a8402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be04e5596ed6794 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.433+0000 7f0a89d9b640 1 -- 172.21.15.104:0/224463952 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84007740 con 0x7f0a8c15c080 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.433+0000 7f0a89d9b640 1 -- 172.21.15.104:0/224463952 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a840078e0 con 0x7f0a8c15c080 2024-05-08T04:22:41.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.433+0000 7f0a89d9b640 1 -- 172.21.15.104:0/224463952 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84007cb0 con 0x7f0a8c15c080 2024-05-08T04:22:41.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.434+0000 7f0a90a1b640 1 -- 172.21.15.104:0/224463952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c15c080 msgr2=0x7f0a8c0acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.434+0000 7f0a90a1b640 1 --2- 172.21.15.104:0/224463952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c15c080 0x7f0a8c0acdf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c06c9c0 tx=0x7f0a8402a5f0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.434+0000 7f0a90a1b640 1 -- 172.21.15.104:0/224463952 shutdown_connections 2024-05-08T04:22:41.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.434+0000 7f0a90a1b640 1 --2- 172.21.15.104:0/224463952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c15c080 0x7f0a8c0acdf0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.434+0000 7f0a90a1b640 1 --2- 172.21.15.104:0/224463952 >> v2:172.21.15.183:3300/0 conn(0x7f0a8c15bca0 0x7f0a8c0ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.434+0000 7f0a90a1b640 1 -- 172.21.15.104:0/224463952 >> 172.21.15.104:0/224463952 conn(0x7f0a8c071a10 msgr2=0x7f0a8c071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:41.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.434+0000 7f0a90a1b640 1 -- 172.21.15.104:0/224463952 shutdown_connections 2024-05-08T04:22:41.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.434+0000 7f0a90a1b640 1 -- 172.21.15.104:0/224463952 wait complete. 2024-05-08T04:22:41.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.435+0000 7f0a90a1b640 1 Processor -- start 2024-05-08T04:22:41.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.435+0000 7f0a90a1b640 1 -- start start 2024-05-08T04:22:41.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a90a1b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c072810 0x7f0a8c141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a90a1b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a8c15bca0 0x7f0a8c141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a90a1b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c15c080 0x7f0a8c143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a90a1b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0ad330 con 0x7f0a8c072810 2024-05-08T04:22:41.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a90a1b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0af850 con 0x7f0a8c15bca0 2024-05-08T04:22:41.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a90a1b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0ad4b0 con 0x7f0a8c15c080 2024-05-08T04:22:41.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a8a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c072810 0x7f0a8c141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a8a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c072810 0x7f0a8c141260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56490/0 (socket says 172.21.15.104:56490) 2024-05-08T04:22:41.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a8a59c640 1 -- 172.21.15.104:0/878437503 learned_addr learned my addr 172.21.15.104:0/878437503 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:41.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a8ad9d640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c15c080 0x7f0a8c143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a8a59c640 1 -- 172.21.15.104:0/878437503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c15c080 msgr2=0x7f0a8c143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a83fff640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a8c15bca0 0x7f0a8c141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a8a59c640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c15c080 0x7f0a8c143b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a8a59c640 1 -- 172.21.15.104:0/878437503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a8c15bca0 msgr2=0x7f0a8c141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a8a59c640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a8c15bca0 0x7f0a8c141ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a8a59c640 1 -- 172.21.15.104:0/878437503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c1417a0 con 0x7f0a8c072810 2024-05-08T04:22:41.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a8ad9d640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c15c080 0x7f0a8c143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:41.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a83fff640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a8c15bca0 0x7f0a8c141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:41.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a8a59c640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c072810 0x7f0a8c141260 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00d800 tx=0x7f0a7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:41.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a82ffd640 1 -- 172.21.15.104:0/878437503 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c004030 con 0x7f0a8c072810 2024-05-08T04:22:41.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a82ffd640 1 -- 172.21.15.104:0/878437503 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c0041d0 con 0x7f0a8c072810 2024-05-08T04:22:41.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.436+0000 7f0a90a1b640 1 -- 172.21.15.104:0/878437503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c156470 con 0x7f0a8c072810 2024-05-08T04:22:41.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.437+0000 7f0a82ffd640 1 -- 172.21.15.104:0/878437503 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0096a0 con 0x7f0a8c072810 2024-05-08T04:22:41.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.437+0000 7f0a90a1b640 1 -- 172.21.15.104:0/878437503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c156a30 con 0x7f0a8c072810 2024-05-08T04:22:41.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.438+0000 7f0a90a1b640 1 -- 172.21.15.104:0/878437503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c075010 con 0x7f0a8c072810 2024-05-08T04:22:41.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.438+0000 7f0a82ffd640 1 -- 172.21.15.104:0/878437503 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f0a7c009840 con 0x7f0a8c072810 2024-05-08T04:22:41.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.439+0000 7f0a82ffd640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0a6c06b680 0x7f0a6c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.439+0000 7f0a83fff640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0a6c06b680 0x7f0a6c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.439+0000 7f0a82ffd640 1 -- 172.21.15.104:0/878437503 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0a7c08a470 con 0x7f0a8c072810 2024-05-08T04:22:41.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.439+0000 7f0a83fff640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0a6c06b680 0x7f0a6c06db40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c154910 tx=0x7f0a74009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:41.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.443+0000 7f0a82ffd640 1 -- 172.21.15.104:0/878437503 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0a7c0593c0 con 0x7f0a8c072810 2024-05-08T04:22:41.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.612+0000 7f0a90a1b640 1 -- 172.21.15.104:0/878437503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a8c0b5380 con 0x7f0a8c072810 2024-05-08T04:22:41.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.613+0000 7f0a82ffd640 1 -- 172.21.15.104:0/878437503 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+12951 (secure 0 0 0) 0x7f0a7c05f0c0 con 0x7f0a8c072810 2024-05-08T04:22:41.614 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:41.614 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":41,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:40.942605+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:41.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.615+0000 7f0a90a1b640 1 -- 172.21.15.104:0/878437503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0a6c06b680 msgr2=0x7f0a6c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.615+0000 7f0a90a1b640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0a6c06b680 0x7f0a6c06db40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c154910 tx=0x7f0a74009040 comp rx=0 tx=0).stop 2024-05-08T04:22:41.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.615+0000 7f0a90a1b640 1 -- 172.21.15.104:0/878437503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c072810 msgr2=0x7f0a8c141260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.615+0000 7f0a90a1b640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c072810 0x7f0a8c141260 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00d800 tx=0x7f0a7c00dcc0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.615+0000 7f0a90a1b640 1 -- 172.21.15.104:0/878437503 shutdown_connections 2024-05-08T04:22:41.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.615+0000 7f0a90a1b640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0a6c06b680 0x7f0a6c06db40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.615+0000 7f0a90a1b640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a8c15bca0 0x7f0a8c141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.615+0000 7f0a90a1b640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c15c080 0x7f0a8c143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.615+0000 7f0a90a1b640 1 --2- 172.21.15.104:0/878437503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c072810 0x7f0a8c141260 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.615+0000 7f0a90a1b640 1 -- 172.21.15.104:0/878437503 >> 172.21.15.104:0/878437503 conn(0x7f0a8c071a10 msgr2=0x7f0a8c0ad7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:41.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.615+0000 7f0a90a1b640 1 -- 172.21.15.104:0/878437503 shutdown_connections 2024-05-08T04:22:41.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.615+0000 7f0a90a1b640 1 -- 172.21.15.104:0/878437503 wait complete. 2024-05-08T04:22:41.628 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:22:41.628 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:22:41.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.729+0000 7fd8096cb640 1 Processor -- start 2024-05-08T04:22:41.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.729+0000 7fd8096cb640 1 -- start start 2024-05-08T04:22:41.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.730+0000 7fd8096cb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd80406ea40 0x7fd8040b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.730+0000 7fd8096cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8040b3ff0 0x7fd8040b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.730+0000 7fd8096cb640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8040b49c0 con 0x7fd8040ceee0 2024-05-08T04:22:41.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.730+0000 7fd8096cb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80415f390 con 0x7fd80406ea40 2024-05-08T04:22:41.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.730+0000 7fd8096cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80415e780 con 0x7fd8040b3ff0 2024-05-08T04:22:41.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.730+0000 7fd8027fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd80406ea40 0x7fd8040b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.730+0000 7fd802ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd8040ceee0 0x7fd80406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38284/0 (socket says 172.21.15.104:38284) 2024-05-08T04:22:41.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.730+0000 7fd802ffd640 1 -- 172.21.15.104:0/1100079230 learned_addr learned my addr 172.21.15.104:0/1100079230 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:41.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.731+0000 7fd8027fc640 1 -- 172.21.15.104:0/1100079230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8040b3ff0 msgr2=0x7fd8040b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:41.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.731+0000 7fd8027fc640 1 --2- 172.21.15.104:0/1100079230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8040b3ff0 0x7fd8040b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.731+0000 7fd8027fc640 1 -- 172.21.15.104:0/1100079230 >> v1:172.21.15.104:6789/0 conn(0x7fd8040ceee0 legacy=0x7fd80406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.731+0000 7fd8027fc640 1 -- 172.21.15.104:0/1100079230 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80415ea60 con 0x7fd80406ea40 2024-05-08T04:22:41.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.731+0000 7fd8027fc640 1 --2- 172.21.15.104:0/1100079230 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd80406ea40 0x7fd8040b26f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80097a0 tx=0x7fd7f802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9330213eaceefa16 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:41.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.732+0000 7fd801ffb640 1 -- 172.21.15.104:0/1100079230 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8037070 con 0x7fd80406ea40 2024-05-08T04:22:41.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.732+0000 7fd801ffb640 1 -- 172.21.15.104:0/1100079230 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f8032440 con 0x7fd80406ea40 2024-05-08T04:22:41.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.732+0000 7fd801ffb640 1 -- 172.21.15.104:0/1100079230 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8032810 con 0x7fd80406ea40 2024-05-08T04:22:41.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.732+0000 7fd8096cb640 1 -- 172.21.15.104:0/1100079230 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd80406ea40 msgr2=0x7fd8040b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.732+0000 7fd8096cb640 1 --2- 172.21.15.104:0/1100079230 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd80406ea40 0x7fd8040b26f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80097a0 tx=0x7fd7f802a180 comp rx=0 tx=0).stop 2024-05-08T04:22:41.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.732+0000 7fd8096cb640 1 -- 172.21.15.104:0/1100079230 shutdown_connections 2024-05-08T04:22:41.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.732+0000 7fd8096cb640 1 --2- 172.21.15.104:0/1100079230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8040b3ff0 0x7fd8040b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.732+0000 7fd8096cb640 1 --2- 172.21.15.104:0/1100079230 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd80406ea40 0x7fd8040b26f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.732+0000 7fd8096cb640 1 -- 172.21.15.104:0/1100079230 >> 172.21.15.104:0/1100079230 conn(0x7fd8040b13f0 msgr2=0x7fd8040b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:41.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.732+0000 7fd8096cb640 1 -- 172.21.15.104:0/1100079230 shutdown_connections 2024-05-08T04:22:41.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.732+0000 7fd8096cb640 1 -- 172.21.15.104:0/1100079230 wait complete. 2024-05-08T04:22:41.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.733+0000 7fd8096cb640 1 Processor -- start 2024-05-08T04:22:41.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.734+0000 7fd8096cb640 1 -- start start 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.734+0000 7fd8096cb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd80406ea40 0x7fd8040c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.734+0000 7fd8096cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8040b3ff0 0x7fd80406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.734+0000 7fd8096cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8040ceee0 0x7fd80414dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.734+0000 7fd8096cb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040cf2c0 con 0x7fd80406ea40 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.734+0000 7fd8096cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80415f020 con 0x7fd8040ceee0 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.734+0000 7fd8096cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040cf440 con 0x7fd8040b3ff0 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.734+0000 7fd802ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd80406ea40 0x7fd8040c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.734+0000 7fd802ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd80406ea40 0x7fd8040c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56514/0 (socket says 172.21.15.104:56514) 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.734+0000 7fd802ffd640 1 -- 172.21.15.104:0/1005367763 learned_addr learned my addr 172.21.15.104:0/1005367763 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.735+0000 7fd8037fe640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8040ceee0 0x7fd80414dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.735+0000 7fd8027fc640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8040b3ff0 0x7fd80406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.735+0000 7fd802ffd640 1 -- 172.21.15.104:0/1005367763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8040b3ff0 msgr2=0x7fd80406d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.735+0000 7fd802ffd640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8040b3ff0 0x7fd80406d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.735+0000 7fd802ffd640 1 -- 172.21.15.104:0/1005367763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8040ceee0 msgr2=0x7fd80414dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.735+0000 7fd802ffd640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8040ceee0 0x7fd80414dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.735+0000 7fd802ffd640 1 -- 172.21.15.104:0/1005367763 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8040aa4c0 con 0x7fd80406ea40 2024-05-08T04:22:41.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.735+0000 7fd802ffd640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd80406ea40 0x7fd8040c4660 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400caa0 tx=0x7fd7f400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:41.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.735+0000 7fd7eb7fe640 1 -- 172.21.15.104:0/1005367763 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4017070 con 0x7fd80406ea40 2024-05-08T04:22:41.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.735+0000 7fd7eb7fe640 1 -- 172.21.15.104:0/1005367763 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f400ac00 con 0x7fd80406ea40 2024-05-08T04:22:41.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.735+0000 7fd7eb7fe640 1 -- 172.21.15.104:0/1005367763 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4012400 con 0x7fd80406ea40 2024-05-08T04:22:41.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.735+0000 7fd8096cb640 1 -- 172.21.15.104:0/1005367763 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8040a9f40 con 0x7fd80406ea40 2024-05-08T04:22:41.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.735+0000 7fd8096cb640 1 -- 172.21.15.104:0/1005367763 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8040aa1e0 con 0x7fd80406ea40 2024-05-08T04:22:41.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.736+0000 7fd8096cb640 1 -- 172.21.15.104:0/1005367763 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd804075010 con 0x7fd80406ea40 2024-05-08T04:22:41.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.736+0000 7fd7eb7fe640 1 -- 172.21.15.104:0/1005367763 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fd7f401a070 con 0x7fd80406ea40 2024-05-08T04:22:41.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.737+0000 7fd7eb7fe640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd7f006b680 0x7fd7f006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:41.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.737+0000 7fd7eb7fe640 1 -- 172.21.15.104:0/1005367763 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd7f4089f00 con 0x7fd80406ea40 2024-05-08T04:22:41.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.737+0000 7fd8027fc640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd7f006b680 0x7fd7f006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:41.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.737+0000 7fd8027fc640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd7f006b680 0x7fd7f006db40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8034000 tx=0x7fd7f802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:41.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.741+0000 7fd7eb7fe640 1 -- 172.21.15.104:0/1005367763 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd7f4058e50 con 0x7fd80406ea40 2024-05-08T04:22:41.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.910+0000 7fd8096cb640 1 -- 172.21.15.104:0/1005367763 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd804072180 con 0x7fd80406ea40 2024-05-08T04:22:41.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.910+0000 7fd7eb7fe640 1 -- 172.21.15.104:0/1005367763 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7f4058750 con 0x7fd80406ea40 2024-05-08T04:22:41.911 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:22:41.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.912+0000 7fd8096cb640 1 -- 172.21.15.104:0/1005367763 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd7f006b680 msgr2=0x7fd7f006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.912+0000 7fd8096cb640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd7f006b680 0x7fd7f006db40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8034000 tx=0x7fd7f802e000 comp rx=0 tx=0).stop 2024-05-08T04:22:41.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.912+0000 7fd8096cb640 1 -- 172.21.15.104:0/1005367763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd80406ea40 msgr2=0x7fd8040c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:41.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.912+0000 7fd8096cb640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd80406ea40 0x7fd8040c4660 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400caa0 tx=0x7fd7f400cf60 comp rx=0 tx=0).stop 2024-05-08T04:22:41.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.912+0000 7fd8096cb640 1 -- 172.21.15.104:0/1005367763 shutdown_connections 2024-05-08T04:22:41.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.912+0000 7fd8096cb640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd7f006b680 0x7fd7f006db40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.912+0000 7fd8096cb640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8040ceee0 0x7fd80414dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.912+0000 7fd8096cb640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8040b3ff0 0x7fd80406d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.912+0000 7fd8096cb640 1 --2- 172.21.15.104:0/1005367763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd80406ea40 0x7fd8040c4660 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:41.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.912+0000 7fd8096cb640 1 -- 172.21.15.104:0/1005367763 >> 172.21.15.104:0/1005367763 conn(0x7fd8040b13f0 msgr2=0x7fd8040b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:41.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.912+0000 7fd8096cb640 1 -- 172.21.15.104:0/1005367763 shutdown_connections 2024-05-08T04:22:41.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:41.912+0000 7fd8096cb640 1 -- 172.21.15.104:0/1005367763 wait complete. 2024-05-08T04:22:41.925 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T04:22:42.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.023+0000 7f4200ce1640 1 Processor -- start 2024-05-08T04:22:42.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.023+0000 7f4200ce1640 1 -- start start 2024-05-08T04:22:42.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.023+0000 7f4200ce1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f41fc15a2a0 0x7f41fc06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:42.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.023+0000 7f4200ce1640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41fc15dce0 con 0x7f41fc159ec0 2024-05-08T04:22:42.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.023+0000 7f4200ce1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41fc06eb60 con 0x7f41fc072160 2024-05-08T04:22:42.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.023+0000 7f4200ce1640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41fc06ee40 con 0x7f41fc15a2a0 2024-05-08T04:22:42.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.024+0000 7f41fad9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f41fc15a2a0 0x7f41fc06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:42.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.024+0000 7f41fa59c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f41fc159ec0 0x7f41fc071a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38292/0 (socket says 172.21.15.104:38292) 2024-05-08T04:22:42.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.024+0000 7f41fa59c640 1 -- 172.21.15.104:0/2828550490 learned_addr learned my addr 172.21.15.104:0/2828550490 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:42.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.024+0000 7f41fad9d640 1 -- 172.21.15.104:0/2828550490 >> v1:172.21.15.183:6789/0 conn(0x7f41fc072160 legacy=0x7f41fc0b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:42.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.024+0000 7f41fad9d640 1 -- 172.21.15.104:0/2828550490 >> v1:172.21.15.104:6789/0 conn(0x7f41fc159ec0 legacy=0x7f41fc071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:42.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.024+0000 7f41f9d9b640 1 -- 172.21.15.104:0/2828550490 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104998538 0 0) 0x7f41fc15dce0 con 0x7f41fc159ec0 2024-05-08T04:22:42.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.024+0000 7f41fad9d640 1 -- 172.21.15.104:0/2828550490 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc15df80 con 0x7f41fc15a2a0 2024-05-08T04:22:42.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.025+0000 7f41fad9d640 1 --2- 172.21.15.104:0/2828550490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc15a2a0 0x7f41fc06e4d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f41f400aea0 tx=0x7f41f402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabbf9022ac6158d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:42.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.025+0000 7f41f9d9b640 1 -- 172.21.15.104:0/2828550490 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4037070 con 0x7f41fc15a2a0 2024-05-08T04:22:42.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.025+0000 7f41f9d9b640 1 -- 172.21.15.104:0/2828550490 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f4008640 con 0x7f41fc15a2a0 2024-05-08T04:22:42.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.025+0000 7f41f9d9b640 1 -- 172.21.15.104:0/2828550490 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4008a10 con 0x7f41fc15a2a0 2024-05-08T04:22:42.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.025+0000 7f4200ce1640 1 -- 172.21.15.104:0/2828550490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc15a2a0 msgr2=0x7f41fc06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:42.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.025+0000 7f4200ce1640 1 --2- 172.21.15.104:0/2828550490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc15a2a0 0x7f41fc06e4d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f41f400aea0 tx=0x7f41f402b7f0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.025+0000 7f4200ce1640 1 -- 172.21.15.104:0/2828550490 shutdown_connections 2024-05-08T04:22:42.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.025+0000 7f4200ce1640 1 --2- 172.21.15.104:0/2828550490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc15a2a0 0x7f41fc06e4d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.025+0000 7f4200ce1640 1 -- 172.21.15.104:0/2828550490 >> 172.21.15.104:0/2828550490 conn(0x7f41fc0b13f0 msgr2=0x7f41fc0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:42.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.025+0000 7f4200ce1640 1 -- 172.21.15.104:0/2828550490 shutdown_connections 2024-05-08T04:22:42.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.025+0000 7f4200ce1640 1 -- 172.21.15.104:0/2828550490 wait complete. 2024-05-08T04:22:42.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.027+0000 7f4200ce1640 1 Processor -- start 2024-05-08T04:22:42.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.027+0000 7f4200ce1640 1 -- start start 2024-05-08T04:22:42.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.027+0000 7f4200ce1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41fc072160 0x7f41fc06d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:42.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.027+0000 7f4200ce1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc159ec0 0x7f41fc0ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:42.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.027+0000 7f4200ce1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41fc15a2a0 0x7f41fc0ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:42.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.027+0000 7f4200ce1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc15b360 con 0x7f41fc159ec0 2024-05-08T04:22:42.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.027+0000 7f4200ce1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc15b1e0 con 0x7f41fc072160 2024-05-08T04:22:42.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.027+0000 7f4200ce1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41fc15b4e0 con 0x7f41fc15a2a0 2024-05-08T04:22:42.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41f1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc159ec0 0x7f41fc0ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:42.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41f1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc159ec0 0x7f41fc0ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56544/0 (socket says 172.21.15.104:56544) 2024-05-08T04:22:42.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41f1d9b640 1 -- 172.21.15.104:0/3882086034 learned_addr learned my addr 172.21.15.104:0/3882086034 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:42.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41fad9d640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41fc15a2a0 0x7f41fc0ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:42.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41fa59c640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41fc072160 0x7f41fc06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:42.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41f1d9b640 1 -- 172.21.15.104:0/3882086034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41fc15a2a0 msgr2=0x7f41fc0ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:42.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41f1d9b640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41fc15a2a0 0x7f41fc0ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41f1d9b640 1 -- 172.21.15.104:0/3882086034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41fc072160 msgr2=0x7f41fc06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:42.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41f1d9b640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41fc072160 0x7f41fc06d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41f1d9b640 1 -- 172.21.15.104:0/3882086034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc1f2350 con 0x7f41fc159ec0 2024-05-08T04:22:42.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41f1d9b640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc159ec0 0x7f41fc0ade40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f41e400c410 tx=0x7f41e400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:42.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41f37fe640 1 -- 172.21.15.104:0/3882086034 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4017070 con 0x7f41fc159ec0 2024-05-08T04:22:42.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41f37fe640 1 -- 172.21.15.104:0/3882086034 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e40035f0 con 0x7f41fc159ec0 2024-05-08T04:22:42.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f4200ce1640 1 -- 172.21.15.104:0/3882086034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41fc1f2610 con 0x7f41fc159ec0 2024-05-08T04:22:42.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f41f37fe640 1 -- 172.21.15.104:0/3882086034 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4003a20 con 0x7f41fc159ec0 2024-05-08T04:22:42.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.028+0000 7f4200ce1640 1 -- 172.21.15.104:0/3882086034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41fc1f28d0 con 0x7f41fc159ec0 2024-05-08T04:22:42.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.029+0000 7f4200ce1640 1 -- 172.21.15.104:0/3882086034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41fc075010 con 0x7f41fc159ec0 2024-05-08T04:22:42.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.030+0000 7f41f37fe640 1 -- 172.21.15.104:0/3882086034 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f41e401a070 con 0x7f41fc159ec0 2024-05-08T04:22:42.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.030+0000 7f41f37fe640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f41dc06b680 0x7f41dc06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:42.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.030+0000 7f41fa59c640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f41dc06b680 0x7f41dc06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:42.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.030+0000 7f41f37fe640 1 -- 172.21.15.104:0/3882086034 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f41e4089610 con 0x7f41fc159ec0 2024-05-08T04:22:42.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.030+0000 7f41fa59c640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f41dc06b680 0x7f41dc06db40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f41ec000f60 tx=0x7f41ec007b70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:42.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.034+0000 7f41f37fe640 1 -- 172.21.15.104:0/3882086034 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f41e40585f0 con 0x7f41fc159ec0 2024-05-08T04:22:42.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.206+0000 7f4200ce1640 1 -- 172.21.15.104:0/3882086034 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f41fc0b31d0 con 0x7f41fc159ec0 2024-05-08T04:22:42.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.206+0000 7f41f37fe640 1 -- 172.21.15.104:0/3882086034 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) v1 ==== 84+0+65 (secure 0 0 0) 0x7f41e4057ef0 con 0x7f41fc159ec0 2024-05-08T04:22:42.207 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:42.207 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-05-08T04:22:42.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:42.208 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-05-08T04:22:42.208 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-05-08T04:22:42.208 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:42.208 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-05-08T04:22:42.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.208+0000 7f4200ce1640 1 -- 172.21.15.104:0/3882086034 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f41dc06b680 msgr2=0x7f41dc06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:42.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.208+0000 7f4200ce1640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f41dc06b680 0x7f41dc06db40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f41ec000f60 tx=0x7f41ec007b70 comp rx=0 tx=0).stop 2024-05-08T04:22:42.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.208+0000 7f4200ce1640 1 -- 172.21.15.104:0/3882086034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc159ec0 msgr2=0x7f41fc0ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:42.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.208+0000 7f4200ce1640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc159ec0 0x7f41fc0ade40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f41e400c410 tx=0x7f41e400c8d0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.208+0000 7f4200ce1640 1 -- 172.21.15.104:0/3882086034 shutdown_connections 2024-05-08T04:22:42.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.208+0000 7f4200ce1640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f41dc06b680 0x7f41dc06db40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.208+0000 7f4200ce1640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f41fc15a2a0 0x7f41fc0ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.208+0000 7f4200ce1640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41fc159ec0 0x7f41fc0ade40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.208+0000 7f4200ce1640 1 --2- 172.21.15.104:0/3882086034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41fc072160 0x7f41fc06d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.208+0000 7f4200ce1640 1 -- 172.21.15.104:0/3882086034 >> 172.21.15.104:0/3882086034 conn(0x7f41fc0b13f0 msgr2=0x7f41fc14fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:42.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.208+0000 7f4200ce1640 1 -- 172.21.15.104:0/3882086034 shutdown_connections 2024-05-08T04:22:42.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.208+0000 7f4200ce1640 1 -- 172.21.15.104:0/3882086034 wait complete. 2024-05-08T04:22:42.220 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T04:22:42.220 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T04:22:42.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.323+0000 7f5dc972b640 1 Processor -- start 2024-05-08T04:22:42.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.323+0000 7f5dc972b640 1 -- start start 2024-05-08T04:22:42.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc972b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5dc415de10 0x7f5dc4161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:42.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc972b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5dc40ce5a0 0x7f5dc40d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:42.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc972b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc40d05f0 0x7f5dc40b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:42.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc972b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc40d0f50 con 0x7f5dc415de10 2024-05-08T04:22:42.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc972b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc4161e60 con 0x7f5dc40ce5a0 2024-05-08T04:22:42.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc972b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40d1a90 con 0x7f5dc40d05f0 2024-05-08T04:22:42.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc2ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5dc415de10 0x7f5dc4161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:42.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc2ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5dc415de10 0x7f5dc4161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56558/0 (socket says 172.21.15.104:56558) 2024-05-08T04:22:42.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc2ffd640 1 -- 172.21.15.104:0/3087527162 learned_addr learned my addr 172.21.15.104:0/3087527162 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:42.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc37fe640 1 --2- 172.21.15.104:0/3087527162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc40d05f0 0x7f5dc40b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:42.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc27fc640 1 --2- 172.21.15.104:0/3087527162 >> v2:172.21.15.183:3300/0 conn(0x7f5dc40ce5a0 0x7f5dc40d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:42.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc2ffd640 1 -- 172.21.15.104:0/3087527162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc40d05f0 msgr2=0x7f5dc40b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:42.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc2ffd640 1 --2- 172.21.15.104:0/3087527162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc40d05f0 0x7f5dc40b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc2ffd640 1 -- 172.21.15.104:0/3087527162 >> v2:172.21.15.183:3300/0 conn(0x7f5dc40ce5a0 msgr2=0x7f5dc40d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:42.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc2ffd640 1 --2- 172.21.15.104:0/3087527162 >> v2:172.21.15.183:3300/0 conn(0x7f5dc40ce5a0 0x7f5dc40d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.324+0000 7f5dc2ffd640 1 -- 172.21.15.104:0/3087527162 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc415e1f0 con 0x7f5dc415de10 2024-05-08T04:22:42.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.325+0000 7f5dc2ffd640 1 --2- 172.21.15.104:0/3087527162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc415de10 0x7f5dc4161920 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40c7520 tx=0x7f5dbc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed20c510505b5bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:42.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.325+0000 7f5dc1ffb640 1 -- 172.21.15.104:0/3087527162 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc036070 con 0x7f5dc415de10 2024-05-08T04:22:42.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.325+0000 7f5dc1ffb640 1 -- 172.21.15.104:0/3087527162 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc031600 con 0x7f5dc415de10 2024-05-08T04:22:42.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.325+0000 7f5dc1ffb640 1 -- 172.21.15.104:0/3087527162 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0319d0 con 0x7f5dc415de10 2024-05-08T04:22:42.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.325+0000 7f5dc972b640 1 -- 172.21.15.104:0/3087527162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc415de10 msgr2=0x7f5dc4161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:42.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.326+0000 7f5dc972b640 1 --2- 172.21.15.104:0/3087527162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc415de10 0x7f5dc4161920 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40c7520 tx=0x7f5dbc02a610 comp rx=0 tx=0).stop 2024-05-08T04:22:42.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.326+0000 7f5dc972b640 1 -- 172.21.15.104:0/3087527162 shutdown_connections 2024-05-08T04:22:42.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.326+0000 7f5dc972b640 1 --2- 172.21.15.104:0/3087527162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc40d05f0 0x7f5dc40b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.326+0000 7f5dc972b640 1 --2- 172.21.15.104:0/3087527162 >> v2:172.21.15.183:3300/0 conn(0x7f5dc40ce5a0 0x7f5dc40d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.326+0000 7f5dc972b640 1 --2- 172.21.15.104:0/3087527162 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc415de10 0x7f5dc4161920 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.326+0000 7f5dc972b640 1 -- 172.21.15.104:0/3087527162 >> 172.21.15.104:0/3087527162 conn(0x7f5dc4072290 msgr2=0x7f5dc4072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:42.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.326+0000 7f5dc972b640 1 -- 172.21.15.104:0/3087527162 shutdown_connections 2024-05-08T04:22:42.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.326+0000 7f5dc972b640 1 -- 172.21.15.104:0/3087527162 wait complete. 2024-05-08T04:22:42.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.327+0000 7f5dc972b640 1 Processor -- start 2024-05-08T04:22:42.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.327+0000 7f5dc972b640 1 -- start start 2024-05-08T04:22:42.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc972b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc40ce5a0 0x7f5dc41494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:42.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc972b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc40d05f0 0x7f5dc40c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:42.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc972b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc415de10 0x7f5dc4147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:42.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc972b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4162370 con 0x7f5dc40d05f0 2024-05-08T04:22:42.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc972b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4162090 con 0x7f5dc40ce5a0 2024-05-08T04:22:42.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc972b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4162650 con 0x7f5dc415de10 2024-05-08T04:22:42.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc40d05f0 0x7f5dc40c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:42.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc40d05f0 0x7f5dc40c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56564/0 (socket says 172.21.15.104:56564) 2024-05-08T04:22:42.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc27fc640 1 -- 172.21.15.104:0/1588470671 learned_addr learned my addr 172.21.15.104:0/1588470671 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:42.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc2ffd640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc40ce5a0 0x7f5dc41494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:42.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc37fe640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc415de10 0x7f5dc4147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:42.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc27fc640 1 -- 172.21.15.104:0/1588470671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc415de10 msgr2=0x7f5dc4147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:42.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc27fc640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc415de10 0x7f5dc4147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc27fc640 1 -- 172.21.15.104:0/1588470671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc40ce5a0 msgr2=0x7f5dc41494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc27fc640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc40ce5a0 0x7f5dc41494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc27fc640 1 -- 172.21.15.104:0/1588470671 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc4148430 con 0x7f5dc40d05f0 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc37fe640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc415de10 0x7f5dc4147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc27fc640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc40d05f0 0x7f5dc40c9270 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5db800d800 tx=0x7f5db800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dab7fe640 1 -- 172.21.15.104:0/1588470671 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8018020 con 0x7f5dc40d05f0 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dab7fe640 1 -- 172.21.15.104:0/1588470671 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db80096a0 con 0x7f5dc40d05f0 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc972b640 1 -- 172.21.15.104:0/1588470671 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc4148710 con 0x7f5dc40d05f0 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dab7fe640 1 -- 172.21.15.104:0/1588470671 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8009a70 con 0x7f5dc40d05f0 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.328+0000 7f5dc972b640 1 -- 172.21.15.104:0/1588470671 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc4148cd0 con 0x7f5dc40d05f0 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.329+0000 7f5dc972b640 1 -- 172.21.15.104:0/1588470671 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc4075010 con 0x7f5dc40d05f0 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.330+0000 7f5dab7fe640 1 -- 172.21.15.104:0/1588470671 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f5db801b020 con 0x7f5dc40d05f0 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.330+0000 7f5dab7fe640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5db006b680 0x7f5db006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.330+0000 7f5dab7fe640 1 -- 172.21.15.104:0/1588470671 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5db808a390 con 0x7f5dc40d05f0 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.330+0000 7f5dc2ffd640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5db006b680 0x7f5db006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:42.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.331+0000 7f5dc2ffd640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5db006b680 0x7f5db006db40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc033000 tx=0x7f5dbc009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:42.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.335+0000 7f5dab7fe640 1 -- 172.21.15.104:0/1588470671 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5db8022030 con 0x7f5dc40d05f0 2024-05-08T04:22:42.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.505+0000 7f5dc972b640 1 -- 172.21.15.104:0/1588470671 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5dc40ca6f0 con 0x7f5dc40d05f0 2024-05-08T04:22:42.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.952+0000 7f5dab7fe640 1 -- 172.21.15.104:0/1588470671 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5db80592e0 con 0x7f5dc40d05f0 2024-05-08T04:22:42.953 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-05-08T04:22:42.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.954+0000 7f5dc972b640 1 -- 172.21.15.104:0/1588470671 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5db006b680 msgr2=0x7f5db006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:42.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.954+0000 7f5dc972b640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5db006b680 0x7f5db006db40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc033000 tx=0x7f5dbc009000 comp rx=0 tx=0).stop 2024-05-08T04:22:42.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.954+0000 7f5dc972b640 1 -- 172.21.15.104:0/1588470671 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc40d05f0 msgr2=0x7f5dc40c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:42.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.954+0000 7f5dc972b640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc40d05f0 0x7f5dc40c9270 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5db800d800 tx=0x7f5db800dcc0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.954+0000 7f5dc972b640 1 -- 172.21.15.104:0/1588470671 shutdown_connections 2024-05-08T04:22:42.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.954+0000 7f5dc972b640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5db006b680 0x7f5db006db40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.954+0000 7f5dc972b640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5dc415de10 0x7f5dc4147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.954+0000 7f5dc972b640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5dc40d05f0 0x7f5dc40c9270 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.954+0000 7f5dc972b640 1 --2- 172.21.15.104:0/1588470671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5dc40ce5a0 0x7f5dc41494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:42.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.954+0000 7f5dc972b640 1 -- 172.21.15.104:0/1588470671 >> 172.21.15.104:0/1588470671 conn(0x7f5dc4072290 msgr2=0x7f5dc40cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:42.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.955+0000 7f5dc972b640 1 -- 172.21.15.104:0/1588470671 shutdown_connections 2024-05-08T04:22:42.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:42.955+0000 7f5dc972b640 1 -- 172.21.15.104:0/1588470671 wait complete. 2024-05-08T04:22:42.971 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T04:22:43.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.077+0000 7f3e924b3640 1 Processor -- start 2024-05-08T04:22:43.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.077+0000 7f3e924b3640 1 -- start start 2024-05-08T04:22:43.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e924b3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3e8c15af50 0x7f3e8c06d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e924b3640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8c143ab0 con 0x7f3e8c0b41c0 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e924b3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8c0cd650 con 0x7f3e8c06e450 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e924b3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8c15b5d0 con 0x7f3e8c15af50 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e90a50640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f3e8c0b41c0 0x7f3e8c0b4630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38294/0 (socket says 172.21.15.104:38294) 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e90a50640 1 -- 172.21.15.104:0/621749405 learned_addr learned my addr 172.21.15.104:0/621749405 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8b7fe640 1 --2- 172.21.15.104:0/621749405 >> v2:172.21.15.183:3300/0 conn(0x7f3e8c15af50 0x7f3e8c06d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772484862 0 0) 0x7f3e8c143ab0 con 0x7f3e8c0b41c0 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e74003520 con 0x7f3e8c0b41c0 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3265780474 0 0) 0x7f3e74003520 con 0x7f3e8c0b41c0 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 >> v2:172.21.15.183:3300/0 conn(0x7f3e8c15af50 msgr2=0x7f3e8c06d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 --2- 172.21.15.104:0/621749405 >> v2:172.21.15.183:3300/0 conn(0x7f3e8c15af50 0x7f3e8c06d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 >> v1:172.21.15.183:6789/0 conn(0x7f3e8c06e450 legacy=0x7f3e8c06efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c15b8b0 con 0x7f3e8c0b41c0 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f3e840019f0 con 0x7f3e8c0b41c0 2024-05-08T04:22:43.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 >> v1:172.21.15.104:6789/0 conn(0x7f3e8c0b41c0 legacy=0x7f3e8c0b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 --2- 172.21.15.104:0/621749405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e740039b0 0x7f3e74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 --2- 172.21.15.104:0/621749405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e74004800 0x7f3e74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 --2- 172.21.15.104:0/621749405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e740051c0 0x7f3e7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c15b5d0 con 0x7f3e740039b0 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7400c060 con 0x7f3e740051c0 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7400c260 con 0x7f3e74004800 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.078+0000 7f3e8bfff640 1 --2- 172.21.15.104:0/621749405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e740039b0 0x7f3e74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.079+0000 7f3e8b7fe640 1 --2- 172.21.15.104:0/621749405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e74004800 0x7f3e74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.079+0000 7f3e90a50640 1 --2- 172.21.15.104:0/621749405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e740051c0 0x7f3e7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.079+0000 7f3e8bfff640 1 -- 172.21.15.104:0/621749405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e74004800 msgr2=0x7f3e74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.079+0000 7f3e8bfff640 1 --2- 172.21.15.104:0/621749405 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e74004800 0x7f3e74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.079+0000 7f3e8bfff640 1 -- 172.21.15.104:0/621749405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e740051c0 msgr2=0x7f3e7400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.079+0000 7f3e8bfff640 1 --2- 172.21.15.104:0/621749405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e740051c0 0x7f3e7400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.079+0000 7f3e8bfff640 1 -- 172.21.15.104:0/621749405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e74003520 con 0x7f3e740039b0 2024-05-08T04:22:43.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.079+0000 7f3e90a50640 1 --2- 172.21.15.104:0/621749405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e740051c0 0x7f3e7400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:43.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.079+0000 7f3e90a50640 1 -- 172.21.15.104:0/621749405 reap_dead start 2024-05-08T04:22:43.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.079+0000 7f3e8bfff640 1 --2- 172.21.15.104:0/621749405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e740039b0 0x7f3e74003dd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c001750 tx=0x7f3e74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d5c3145c9ff5a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:43.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.079+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c001370 con 0x7f3e740039b0 2024-05-08T04:22:43.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.080+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c0052d0 con 0x7f3e740039b0 2024-05-08T04:22:43.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.080+0000 7f3e8affd640 1 -- 172.21.15.104:0/621749405 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c02abc0 con 0x7f3e740039b0 2024-05-08T04:22:43.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.080+0000 7f3e924b3640 1 -- 172.21.15.104:0/621749405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e740039b0 msgr2=0x7f3e74003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:43.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.080+0000 7f3e924b3640 1 --2- 172.21.15.104:0/621749405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e740039b0 0x7f3e74003dd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c001750 tx=0x7f3e74005830 comp rx=0 tx=0).stop 2024-05-08T04:22:43.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.080+0000 7f3e924b3640 1 -- 172.21.15.104:0/621749405 shutdown_connections 2024-05-08T04:22:43.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.080+0000 7f3e924b3640 1 --2- 172.21.15.104:0/621749405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e740039b0 0x7f3e74003dd0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:43.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.080+0000 7f3e924b3640 1 -- 172.21.15.104:0/621749405 >> 172.21.15.104:0/621749405 conn(0x7f3e8c06ab60 msgr2=0x7f3e8c06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:43.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.080+0000 7f3e924b3640 1 -- 172.21.15.104:0/621749405 shutdown_connections 2024-05-08T04:22:43.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.080+0000 7f3e924b3640 1 -- 172.21.15.104:0/621749405 wait complete. 2024-05-08T04:22:43.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.081+0000 7f3e924b3640 1 Processor -- start 2024-05-08T04:22:43.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.082+0000 7f3e924b3640 1 -- start start 2024-05-08T04:22:43.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.082+0000 7f3e924b3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e740039b0 0x7f3e8c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:43.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.082+0000 7f3e924b3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8c0adf30 0x7f3e8c13ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:43.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.082+0000 7f3e924b3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8c15c970 0x7f3e8c15cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:43.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.082+0000 7f3e924b3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c06efe0 con 0x7f3e740039b0 2024-05-08T04:22:43.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.082+0000 7f3e924b3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c15be70 con 0x7f3e8c15c970 2024-05-08T04:22:43.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.082+0000 7f3e924b3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c06f160 con 0x7f3e8c0adf30 2024-05-08T04:22:43.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.082+0000 7f3e8bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e740039b0 0x7f3e8c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:43.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.082+0000 7f3e8bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e740039b0 0x7f3e8c0ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56572/0 (socket says 172.21.15.104:56572) 2024-05-08T04:22:43.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.082+0000 7f3e8bfff640 1 -- 172.21.15.104:0/1431783219 learned_addr learned my addr 172.21.15.104:0/1431783219 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:43.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.083+0000 7f3e8b7fe640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8c0adf30 0x7f3e8c13ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:43.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.083+0000 7f3e90a50640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8c15c970 0x7f3e8c15cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:43.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.083+0000 7f3e8bfff640 1 -- 172.21.15.104:0/1431783219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8c0adf30 msgr2=0x7f3e8c13ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:43.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.083+0000 7f3e8bfff640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8c0adf30 0x7f3e8c13ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:43.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.083+0000 7f3e8bfff640 1 -- 172.21.15.104:0/1431783219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8c15c970 msgr2=0x7f3e8c15cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:43.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.083+0000 7f3e8bfff640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8c15c970 0x7f3e8c15cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:43.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.083+0000 7f3e8bfff640 1 -- 172.21.15.104:0/1431783219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c0ace90 con 0x7f3e740039b0 2024-05-08T04:22:43.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.083+0000 7f3e8bfff640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e740039b0 0x7f3e8c0ac8b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c005040 tx=0x7f3e7c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:43.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.083+0000 7f3e88ff9640 1 -- 172.21.15.104:0/1431783219 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c037040 con 0x7f3e740039b0 2024-05-08T04:22:43.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.083+0000 7f3e88ff9640 1 -- 172.21.15.104:0/1431783219 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c005480 con 0x7f3e740039b0 2024-05-08T04:22:43.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.083+0000 7f3e924b3640 1 -- 172.21.15.104:0/1431783219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8c0ad170 con 0x7f3e740039b0 2024-05-08T04:22:43.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.083+0000 7f3e88ff9640 1 -- 172.21.15.104:0/1431783219 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c007a30 con 0x7f3e740039b0 2024-05-08T04:22:43.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.083+0000 7f3e924b3640 1 -- 172.21.15.104:0/1431783219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8c0ad730 con 0x7f3e740039b0 2024-05-08T04:22:43.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.084+0000 7f3e924b3640 1 -- 172.21.15.104:0/1431783219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8c074830 con 0x7f3e740039b0 2024-05-08T04:22:43.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.084+0000 7f3e88ff9640 1 -- 172.21.15.104:0/1431783219 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f3e7c044020 con 0x7f3e740039b0 2024-05-08T04:22:43.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.085+0000 7f3e88ff9640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e7806b680 0x7f3e7806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:43.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.085+0000 7f3e88ff9640 1 -- 172.21.15.104:0/1431783219 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3e7c0aa030 con 0x7f3e740039b0 2024-05-08T04:22:43.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.085+0000 7f3e8b7fe640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e7806b680 0x7f3e7806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:43.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.085+0000 7f3e8b7fe640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e7806b680 0x7f3e7806db40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c15deb0 tx=0x7f3e80008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:43.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.089+0000 7f3e88ff9640 1 -- 172.21.15.104:0/1431783219 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e7c078d80 con 0x7f3e740039b0 2024-05-08T04:22:43.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.261+0000 7f3e924b3640 1 -- 172.21.15.104:0/1431783219 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3e8c0ceb80 con 0x7f3e740039b0 2024-05-08T04:22:43.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.954+0000 7f3e88ff9640 1 -- 172.21.15.104:0/1431783219 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3e7c078680 con 0x7f3e740039b0 2024-05-08T04:22:43.956 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-05-08T04:22:43.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.957+0000 7f3e924b3640 1 -- 172.21.15.104:0/1431783219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e7806b680 msgr2=0x7f3e7806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:43.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.957+0000 7f3e924b3640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e7806b680 0x7f3e7806db40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c15deb0 tx=0x7f3e80008040 comp rx=0 tx=0).stop 2024-05-08T04:22:43.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.957+0000 7f3e924b3640 1 -- 172.21.15.104:0/1431783219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e740039b0 msgr2=0x7f3e8c0ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:43.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.957+0000 7f3e924b3640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e740039b0 0x7f3e8c0ac8b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c005040 tx=0x7f3e7c001120 comp rx=0 tx=0).stop 2024-05-08T04:22:43.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.957+0000 7f3e924b3640 1 -- 172.21.15.104:0/1431783219 shutdown_connections 2024-05-08T04:22:43.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.957+0000 7f3e924b3640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e7806b680 0x7f3e7806db40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:43.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.957+0000 7f3e924b3640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8c15c970 0x7f3e8c15cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.957+0000 7f3e924b3640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8c0adf30 0x7f3e8c13ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.957+0000 7f3e924b3640 1 --2- 172.21.15.104:0/1431783219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e740039b0 0x7f3e8c0ac8b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.957+0000 7f3e924b3640 1 -- 172.21.15.104:0/1431783219 >> 172.21.15.104:0/1431783219 conn(0x7f3e8c06ab60 msgr2=0x7f3e8c0b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.957+0000 7f3e924b3640 1 -- 172.21.15.104:0/1431783219 shutdown_connections 2024-05-08T04:22:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:43.957+0000 7f3e924b3640 1 -- 172.21.15.104:0/1431783219 wait complete. 2024-05-08T04:22:43.981 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T04:22:44.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.085+0000 7f5c8ac07640 1 Processor -- start 2024-05-08T04:22:44.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.085+0000 7f5c8ac07640 1 -- start start 2024-05-08T04:22:44.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.086+0000 7f5c8ac07640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8406c280 0x7f5c840ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:44.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.086+0000 7f5c8ac07640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c84072c40 con 0x7f5c840acdf0 2024-05-08T04:22:44.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.086+0000 7f5c8ac07640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c8406de30 con 0x7f5c84161190 2024-05-08T04:22:44.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.086+0000 7f5c8ac07640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c840b4db0 con 0x7f5c8406c280 2024-05-08T04:22:44.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.086+0000 7f5c83fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f5c840acdf0 0x7f5c8406bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38296/0 (socket says 172.21.15.104:38296) 2024-05-08T04:22:44.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.086+0000 7f5c83fff640 1 -- 172.21.15.104:0/80747660 learned_addr learned my addr 172.21.15.104:0/80747660 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:44.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.086+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187194194 0 0) 0x7f5c84072c40 con 0x7f5c840acdf0 2024-05-08T04:22:44.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.086+0000 7f5c891a4640 1 --2- 172.21.15.104:0/80747660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8406c280 0x7f5c840ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:44.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.086+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c6c003520 con 0x7f5c840acdf0 2024-05-08T04:22:44.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2095765259 0 0) 0x7f5c6c003520 con 0x7f5c840acdf0 2024-05-08T04:22:44.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8406c280 msgr2=0x7f5c840ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:44.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c837fe640 1 --2- 172.21.15.104:0/80747660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8406c280 0x7f5c840ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:44.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 >> v1:172.21.15.183:6789/0 conn(0x7f5c84161190 legacy=0x7f5c84072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:44.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8406e110 con 0x7f5c840acdf0 2024-05-08T04:22:44.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f5c78001670 con 0x7f5c840acdf0 2024-05-08T04:22:44.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 >> v1:172.21.15.104:6789/0 conn(0x7f5c840acdf0 legacy=0x7f5c8406bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:44.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c837fe640 1 --2- 172.21.15.104:0/80747660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8406c280 0x7f5c6c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:44.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c837fe640 1 --2- 172.21.15.104:0/80747660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c6c003f60 0x7f5c6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:44.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c837fe640 1 --2- 172.21.15.104:0/80747660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c6c004d40 0x7f5c6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:44.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c00ba70 con 0x7f5c6c004d40 2024-05-08T04:22:44.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c00bc20 con 0x7f5c6c003f60 2024-05-08T04:22:44.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c00be20 con 0x7f5c8406c280 2024-05-08T04:22:44.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c891a4640 1 --2- 172.21.15.104:0/80747660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c6c004d40 0x7f5c6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:44.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c83fff640 1 --2- 172.21.15.104:0/80747660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c6c003f60 0x7f5c6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:44.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c889a3640 1 --2- 172.21.15.104:0/80747660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8406c280 0x7f5c6c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:44.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c891a4640 1 -- 172.21.15.104:0/80747660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8406c280 msgr2=0x7f5c6c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:44.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c891a4640 1 --2- 172.21.15.104:0/80747660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8406c280 0x7f5c6c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:44.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c891a4640 1 -- 172.21.15.104:0/80747660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c6c003f60 msgr2=0x7f5c6c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:44.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c891a4640 1 --2- 172.21.15.104:0/80747660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c6c003f60 0x7f5c6c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:44.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.087+0000 7f5c891a4640 1 -- 172.21.15.104:0/80747660 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c003520 con 0x7f5c6c004d40 2024-05-08T04:22:44.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.088+0000 7f5c891a4640 1 --2- 172.21.15.104:0/80747660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c6c004d40 0x7f5c6c0051c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5c84067420 tx=0x7f5c6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1698711689ef8cd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:44.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.088+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c037070 con 0x7f5c6c004d40 2024-05-08T04:22:44.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.088+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c032600 con 0x7f5c6c004d40 2024-05-08T04:22:44.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.088+0000 7f5c837fe640 1 -- 172.21.15.104:0/80747660 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c009c10 con 0x7f5c6c004d40 2024-05-08T04:22:44.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.088+0000 7f5c8ac07640 1 -- 172.21.15.104:0/80747660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c6c004d40 msgr2=0x7f5c6c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:44.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.088+0000 7f5c8ac07640 1 --2- 172.21.15.104:0/80747660 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c6c004d40 0x7f5c6c0051c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5c84067420 tx=0x7f5c6c005830 comp rx=0 tx=0).stop 2024-05-08T04:22:44.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.088+0000 7f5c891a4640 1 -- 172.21.15.104:0/80747660 reap_dead start 2024-05-08T04:22:44.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.089+0000 7f5c8ac07640 1 -- 172.21.15.104:0/80747660 shutdown_connections 2024-05-08T04:22:44.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.089+0000 7f5c8ac07640 1 -- 172.21.15.104:0/80747660 >> 172.21.15.104:0/80747660 conn(0x7f5c84071a10 msgr2=0x7f5c84071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:44.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.089+0000 7f5c8ac07640 1 -- 172.21.15.104:0/80747660 shutdown_connections 2024-05-08T04:22:44.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.089+0000 7f5c8ac07640 1 -- 172.21.15.104:0/80747660 wait complete. 2024-05-08T04:22:44.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.090+0000 7f5c8ac07640 1 Processor -- start 2024-05-08T04:22:44.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.090+0000 7f5c8ac07640 1 -- start start 2024-05-08T04:22:44.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c8ac07640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c6c004d40 0x7f5c84141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:44.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c8ac07640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c8414e500 0x7f5c8414b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:44.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c8ac07640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8414bed0 0x7f5c84151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:44.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c8ac07640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8406e9b0 con 0x7f5c6c004d40 2024-05-08T04:22:44.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c8ac07640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8406e6d0 con 0x7f5c8414e500 2024-05-08T04:22:44.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c8ac07640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8406da70 con 0x7f5c8414bed0 2024-05-08T04:22:44.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c889a3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c6c004d40 0x7f5c84141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:44.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c889a3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c6c004d40 0x7f5c84141a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56590/0 (socket says 172.21.15.104:56590) 2024-05-08T04:22:44.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c889a3640 1 -- 172.21.15.104:0/203456422 learned_addr learned my addr 172.21.15.104:0/203456422 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:44.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c891a4640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8414bed0 0x7f5c84151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:44.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c83fff640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c8414e500 0x7f5c8414b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c889a3640 1 -- 172.21.15.104:0/203456422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8414bed0 msgr2=0x7f5c84151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c889a3640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8414bed0 0x7f5c84151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c889a3640 1 -- 172.21.15.104:0/203456422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c8414e500 msgr2=0x7f5c8414b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c889a3640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c8414e500 0x7f5c8414b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c889a3640 1 -- 172.21.15.104:0/203456422 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8414fd90 con 0x7f5c6c004d40 2024-05-08T04:22:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c891a4640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8414bed0 0x7f5c84151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c83fff640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c8414e500 0x7f5c8414b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c889a3640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c6c004d40 0x7f5c84141a70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400f820 tx=0x7f5c7400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c817fa640 1 -- 172.21.15.104:0/203456422 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740050d0 con 0x7f5c6c004d40 2024-05-08T04:22:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c817fa640 1 -- 172.21.15.104:0/203456422 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c74018070 con 0x7f5c6c004d40 2024-05-08T04:22:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c8ac07640 1 -- 172.21.15.104:0/203456422 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8414fab0 con 0x7f5c6c004d40 2024-05-08T04:22:44.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c817fa640 1 -- 172.21.15.104:0/203456422 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c74005490 con 0x7f5c6c004d40 2024-05-08T04:22:44.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.091+0000 7f5c8ac07640 1 -- 172.21.15.104:0/203456422 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8414dd00 con 0x7f5c6c004d40 2024-05-08T04:22:44.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.092+0000 7f5c8ac07640 1 -- 172.21.15.104:0/203456422 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8414e8e0 con 0x7f5c6c004d40 2024-05-08T04:22:44.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.093+0000 7f5c817fa640 1 -- 172.21.15.104:0/203456422 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f5c7400d6d0 con 0x7f5c6c004d40 2024-05-08T04:22:44.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.093+0000 7f5c817fa640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5c7006b680 0x7f5c7006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:44.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.094+0000 7f5c83fff640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5c7006b680 0x7f5c7006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:44.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.094+0000 7f5c817fa640 1 -- 172.21.15.104:0/203456422 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5c7408a1d0 con 0x7f5c6c004d40 2024-05-08T04:22:44.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.094+0000 7f5c83fff640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5c7006b680 0x7f5c7006db40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c841518b0 tx=0x7f5c78009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:44.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.098+0000 7f5c817fa640 1 -- 172.21.15.104:0/203456422 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5c74058ec0 con 0x7f5c6c004d40 2024-05-08T04:22:44.308 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.307+0000 7f5c8ac07640 1 -- 172.21.15.104:0/203456422 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5c84075010 con 0x7f5c6c004d40 2024-05-08T04:22:44.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.976+0000 7f5c817fa640 1 -- 172.21.15.104:0/203456422 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v19) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5c740587c0 con 0x7f5c6c004d40 2024-05-08T04:22:44.978 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 6 and data pool 7 2024-05-08T04:22:44.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.985+0000 7f5c8ac07640 1 -- 172.21.15.104:0/203456422 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5c7006b680 msgr2=0x7f5c7006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:44.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.985+0000 7f5c8ac07640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5c7006b680 0x7f5c7006db40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5c841518b0 tx=0x7f5c78009040 comp rx=0 tx=0).stop 2024-05-08T04:22:44.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.985+0000 7f5c8ac07640 1 -- 172.21.15.104:0/203456422 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c6c004d40 msgr2=0x7f5c84141a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:44.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.985+0000 7f5c8ac07640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c6c004d40 0x7f5c84141a70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400f820 tx=0x7f5c7400fce0 comp rx=0 tx=0).stop 2024-05-08T04:22:44.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.986+0000 7f5c8ac07640 1 -- 172.21.15.104:0/203456422 shutdown_connections 2024-05-08T04:22:44.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.986+0000 7f5c8ac07640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5c7006b680 0x7f5c7006db40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:44.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.986+0000 7f5c8ac07640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c8414e500 0x7f5c8414b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:44.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.986+0000 7f5c8ac07640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c8414bed0 0x7f5c84151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:44.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.986+0000 7f5c8ac07640 1 --2- 172.21.15.104:0/203456422 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c6c004d40 0x7f5c84141a70 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:44.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.986+0000 7f5c8ac07640 1 -- 172.21.15.104:0/203456422 >> 172.21.15.104:0/203456422 conn(0x7f5c84071a10 msgr2=0x7f5c84155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:44.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.986+0000 7f5c8ac07640 1 -- 172.21.15.104:0/203456422 shutdown_connections 2024-05-08T04:22:44.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:44.986+0000 7f5c8ac07640 1 -- 172.21.15.104:0/203456422 wait complete. 2024-05-08T04:22:45.006 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:45.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.106+0000 7f0a92914640 1 Processor -- start 2024-05-08T04:22:45.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.106+0000 7f0a92914640 1 -- start start 2024-05-08T04:22:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.106+0000 7f0a92914640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0a8c15de10 0x7f0a8c161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.106+0000 7f0a92914640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0a8c0ce5a0 0x7f0a8c0d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.106+0000 7f0a92914640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c0d05f0 0x7f0a8c0b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.106+0000 7f0a92914640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c0d0f50 con 0x7f0a8c15de10 2024-05-08T04:22:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.106+0000 7f0a92914640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c161e60 con 0x7f0a8c0ce5a0 2024-05-08T04:22:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.106+0000 7f0a92914640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0d1a90 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.107+0000 7f0a8bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0a8c15de10 0x7f0a8c161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.107+0000 7f0a8bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0a8c15de10 0x7f0a8c161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56602/0 (socket says 172.21.15.104:56602) 2024-05-08T04:22:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.107+0000 7f0a8bfff640 1 -- 172.21.15.104:0/3079523134 learned_addr learned my addr 172.21.15.104:0/3079523134 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:45.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.107+0000 7f0a90eb1640 1 --2- 172.21.15.104:0/3079523134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c0d05f0 0x7f0a8c0b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.107+0000 7f0a8b7fe640 1 --2- 172.21.15.104:0/3079523134 >> v2:172.21.15.183:3300/0 conn(0x7f0a8c0ce5a0 0x7f0a8c0d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.107+0000 7f0a8bfff640 1 -- 172.21.15.104:0/3079523134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c0d05f0 msgr2=0x7f0a8c0b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.107+0000 7f0a8bfff640 1 --2- 172.21.15.104:0/3079523134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c0d05f0 0x7f0a8c0b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.107+0000 7f0a8bfff640 1 -- 172.21.15.104:0/3079523134 >> v2:172.21.15.183:3300/0 conn(0x7f0a8c0ce5a0 msgr2=0x7f0a8c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.107+0000 7f0a8bfff640 1 --2- 172.21.15.104:0/3079523134 >> v2:172.21.15.183:3300/0 conn(0x7f0a8c0ce5a0 0x7f0a8c0d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.107+0000 7f0a8bfff640 1 -- 172.21.15.104:0/3079523134 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c15e1f0 con 0x7f0a8c15de10 2024-05-08T04:22:45.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.108+0000 7f0a8bfff640 1 --2- 172.21.15.104:0/3079523134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c15de10 0x7f0a8c161920 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0c7520 tx=0x7f0a7c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99146acc328fed2e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.108+0000 7f0a8affd640 1 -- 172.21.15.104:0/3079523134 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c037070 con 0x7f0a8c15de10 2024-05-08T04:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.108+0000 7f0a8affd640 1 -- 172.21.15.104:0/3079523134 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c032440 con 0x7f0a8c15de10 2024-05-08T04:22:45.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.108+0000 7f0a8affd640 1 -- 172.21.15.104:0/3079523134 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c032810 con 0x7f0a8c15de10 2024-05-08T04:22:45.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.108+0000 7f0a92914640 1 -- 172.21.15.104:0/3079523134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c15de10 msgr2=0x7f0a8c161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.108+0000 7f0a92914640 1 --2- 172.21.15.104:0/3079523134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c15de10 0x7f0a8c161920 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0c7520 tx=0x7f0a7c02a140 comp rx=0 tx=0).stop 2024-05-08T04:22:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.108+0000 7f0a92914640 1 -- 172.21.15.104:0/3079523134 shutdown_connections 2024-05-08T04:22:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.108+0000 7f0a92914640 1 --2- 172.21.15.104:0/3079523134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c0d05f0 0x7f0a8c0b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.108+0000 7f0a92914640 1 --2- 172.21.15.104:0/3079523134 >> v2:172.21.15.183:3300/0 conn(0x7f0a8c0ce5a0 0x7f0a8c0d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.108+0000 7f0a92914640 1 --2- 172.21.15.104:0/3079523134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c15de10 0x7f0a8c161920 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.108+0000 7f0a92914640 1 -- 172.21.15.104:0/3079523134 >> 172.21.15.104:0/3079523134 conn(0x7f0a8c072290 msgr2=0x7f0a8c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.108+0000 7f0a92914640 1 -- 172.21.15.104:0/3079523134 shutdown_connections 2024-05-08T04:22:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.108+0000 7f0a92914640 1 -- 172.21.15.104:0/3079523134 wait complete. 2024-05-08T04:22:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.109+0000 7f0a92914640 1 Processor -- start 2024-05-08T04:22:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.110+0000 7f0a92914640 1 -- start start 2024-05-08T04:22:45.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.110+0000 7f0a92914640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a8c0ce5a0 0x7f0a8c14d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.110+0000 7f0a92914640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c0d05f0 0x7f0a8c15f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.110+0000 7f0a92914640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c15de10 0x7f0a8c160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.110+0000 7f0a92914640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c162370 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.110+0000 7f0a92914640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c162090 con 0x7f0a8c0ce5a0 2024-05-08T04:22:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.110+0000 7f0a92914640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c162650 con 0x7f0a8c15de10 2024-05-08T04:22:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.110+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c0d05f0 0x7f0a8c15f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c0d05f0 0x7f0a8c15f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56616/0 (socket says 172.21.15.104:56616) 2024-05-08T04:22:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a8b7fe640 1 -- 172.21.15.104:0/2828397600 learned_addr learned my addr 172.21.15.104:0/2828397600 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a90eb1640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c15de10 0x7f0a8c160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a8b7fe640 1 -- 172.21.15.104:0/2828397600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c15de10 msgr2=0x7f0a8c160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a8b7fe640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c15de10 0x7f0a8c160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a8b7fe640 1 -- 172.21.15.104:0/2828397600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a8c0ce5a0 msgr2=0x7f0a8c14d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a8b7fe640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a8c0ce5a0 0x7f0a8c14d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a8b7fe640 1 -- 172.21.15.104:0/2828397600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c1f3ab0 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a90eb1640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c15de10 0x7f0a8c160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a8b7fe640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c0d05f0 0x7f0a8c15f980 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000d800 tx=0x7f0a8000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a88ff9640 1 -- 172.21.15.104:0/2828397600 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80018030 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a88ff9640 1 -- 172.21.15.104:0/2828397600 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a800096a0 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a92914640 1 -- 172.21.15.104:0/2828397600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c1f3d90 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a88ff9640 1 -- 172.21.15.104:0/2828397600 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80009870 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.111+0000 7f0a92914640 1 -- 172.21.15.104:0/2828397600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c160440 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.112+0000 7f0a92914640 1 -- 172.21.15.104:0/2828397600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c075010 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.113+0000 7f0a88ff9640 1 -- 172.21.15.104:0/2828397600 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f0a8001b070 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.113+0000 7f0a88ff9640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0a7806b680 0x7f0a7806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.113+0000 7f0a88ff9640 1 -- 172.21.15.104:0/2828397600 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a8008a7a0 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.113+0000 7f0a8bfff640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0a7806b680 0x7f0a7806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.113+0000 7f0a8bfff640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0a7806b680 0x7f0a7806db40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c034000 tx=0x7f0a7c02c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:45.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.117+0000 7f0a88ff9640 1 -- 172.21.15.104:0/2828397600 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0a800593a0 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.290+0000 7f0a92914640 1 -- 172.21.15.104:0/2828397600 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a8c1f3f60 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.291+0000 7f0a88ff9640 1 -- 172.21.15.104:0/2828397600 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16682 (secure 0 0 0) 0x7f0a80058ca0 con 0x7f0a8c0d05f0 2024-05-08T04:22:45.293 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:45.293 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":44,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:44.308242+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:42.524824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:43.279621+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:45.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.293+0000 7f0a92914640 1 -- 172.21.15.104:0/2828397600 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0a7806b680 msgr2=0x7f0a7806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.293+0000 7f0a92914640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0a7806b680 0x7f0a7806db40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c034000 tx=0x7f0a7c02c000 comp rx=0 tx=0).stop 2024-05-08T04:22:45.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.293+0000 7f0a92914640 1 -- 172.21.15.104:0/2828397600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c0d05f0 msgr2=0x7f0a8c15f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.293+0000 7f0a92914640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c0d05f0 0x7f0a8c15f980 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000d800 tx=0x7f0a8000dcc0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.293+0000 7f0a92914640 1 -- 172.21.15.104:0/2828397600 shutdown_connections 2024-05-08T04:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.293+0000 7f0a92914640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0a7806b680 0x7f0a7806db40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.293+0000 7f0a92914640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a8c15de10 0x7f0a8c160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.293+0000 7f0a92914640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a8c0d05f0 0x7f0a8c15f980 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.293+0000 7f0a92914640 1 --2- 172.21.15.104:0/2828397600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a8c0ce5a0 0x7f0a8c14d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.293+0000 7f0a92914640 1 -- 172.21.15.104:0/2828397600 >> 172.21.15.104:0/2828397600 conn(0x7f0a8c072290 msgr2=0x7f0a8c0cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:45.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.293+0000 7f0a92914640 1 -- 172.21.15.104:0/2828397600 shutdown_connections 2024-05-08T04:22:45.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.293+0000 7f0a92914640 1 -- 172.21.15.104:0/2828397600 wait complete. 2024-05-08T04:22:45.305 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:45.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.404+0000 7f4914d90640 1 Processor -- start 2024-05-08T04:22:45.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.404+0000 7f4914d90640 1 -- start start 2024-05-08T04:22:45.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.405+0000 7f4914d90640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f491006c280 0x7f49100ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.405+0000 7f4914d90640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4910072c40 con 0x7f4910161190 2024-05-08T04:22:45.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.405+0000 7f4914d90640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491006de30 con 0x7f49100acdf0 2024-05-08T04:22:45.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.405+0000 7f4914d90640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49100b4db0 con 0x7f491006c280 2024-05-08T04:22:45.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.405+0000 7f490ed9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f491006c280 0x7f49100ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.405+0000 7f490e59c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f4910161190 0x7f4910072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38312/0 (socket says 172.21.15.104:38312) 2024-05-08T04:22:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.405+0000 7f490e59c640 1 -- 172.21.15.104:0/4049217957 learned_addr learned my addr 172.21.15.104:0/4049217957 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.405+0000 7f490ed9d640 1 -- 172.21.15.104:0/4049217957 >> v1:172.21.15.183:6789/0 conn(0x7f49100acdf0 legacy=0x7f491006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.405+0000 7f490ed9d640 1 -- 172.21.15.104:0/4049217957 >> v1:172.21.15.104:6789/0 conn(0x7f4910161190 legacy=0x7f4910072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.405+0000 7f490d59a640 1 -- 172.21.15.104:0/4049217957 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228529444 0 0) 0x7f4910072c40 con 0x7f4910161190 2024-05-08T04:22:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.406+0000 7f490ed9d640 1 -- 172.21.15.104:0/4049217957 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491006e110 con 0x7f491006c280 2024-05-08T04:22:45.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.406+0000 7f490ed9d640 1 --2- 172.21.15.104:0/4049217957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f491006c280 0x7f49100ad280 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f49000097a0 tx=0x7f490002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7515c503fc1dbf80 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.406+0000 7f490d59a640 1 -- 172.21.15.104:0/4049217957 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900037070 con 0x7f491006c280 2024-05-08T04:22:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.406+0000 7f490d59a640 1 -- 172.21.15.104:0/4049217957 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4900032440 con 0x7f491006c280 2024-05-08T04:22:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.406+0000 7f490d59a640 1 -- 172.21.15.104:0/4049217957 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900032810 con 0x7f491006c280 2024-05-08T04:22:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.407+0000 7f4914d90640 1 -- 172.21.15.104:0/4049217957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f491006c280 msgr2=0x7f49100ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.407+0000 7f4914d90640 1 --2- 172.21.15.104:0/4049217957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f491006c280 0x7f49100ad280 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f49000097a0 tx=0x7f490002a1e0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.407+0000 7f4914d90640 1 -- 172.21.15.104:0/4049217957 shutdown_connections 2024-05-08T04:22:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.407+0000 7f4914d90640 1 --2- 172.21.15.104:0/4049217957 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f491006c280 0x7f49100ad280 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.407+0000 7f4914d90640 1 -- 172.21.15.104:0/4049217957 >> 172.21.15.104:0/4049217957 conn(0x7f4910071a10 msgr2=0x7f4910071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:45.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.407+0000 7f4914d90640 1 -- 172.21.15.104:0/4049217957 shutdown_connections 2024-05-08T04:22:45.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.407+0000 7f4914d90640 1 -- 172.21.15.104:0/4049217957 wait complete. 2024-05-08T04:22:45.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.408+0000 7f4914d90640 1 Processor -- start 2024-05-08T04:22:45.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.408+0000 7f4914d90640 1 -- start start 2024-05-08T04:22:45.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f4914d90640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f491006c280 0x7f491014a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f4914d90640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49100acdf0 0x7f491013e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f4914d90640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4910161190 0x7f4910150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f4914d90640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491006e9b0 con 0x7f4910161190 2024-05-08T04:22:45.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f4914d90640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491006e6d0 con 0x7f49100acdf0 2024-05-08T04:22:45.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f4914d90640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491006da70 con 0x7f491006c280 2024-05-08T04:22:45.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f490ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4910161190 0x7f4910150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f490ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4910161190 0x7f4910150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56620/0 (socket says 172.21.15.104:56620) 2024-05-08T04:22:45.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f490ed9d640 1 -- 172.21.15.104:0/2130425379 learned_addr learned my addr 172.21.15.104:0/2130425379 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:45.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f490e59c640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f491006c280 0x7f491014a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f490dd9b640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49100acdf0 0x7f491013e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f490ed9d640 1 -- 172.21.15.104:0/2130425379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f491006c280 msgr2=0x7f491014a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f490ed9d640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f491006c280 0x7f491014a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f490ed9d640 1 -- 172.21.15.104:0/2130425379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49100acdf0 msgr2=0x7f491013e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f490ed9d640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49100acdf0 0x7f491013e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.409+0000 7f490ed9d640 1 -- 172.21.15.104:0/2130425379 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4910151aa0 con 0x7f4910161190 2024-05-08T04:22:45.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.410+0000 7f490ed9d640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4910161190 0x7f4910150f90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f49000098c0 tx=0x7f49000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:45.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.410+0000 7f4906ffd640 1 -- 172.21.15.104:0/2130425379 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900041070 con 0x7f4910161190 2024-05-08T04:22:45.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.410+0000 7f4906ffd640 1 -- 172.21.15.104:0/2130425379 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490003c870 con 0x7f4910161190 2024-05-08T04:22:45.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.410+0000 7f4914d90640 1 -- 172.21.15.104:0/2130425379 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49101517c0 con 0x7f4910161190 2024-05-08T04:22:45.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.410+0000 7f4906ffd640 1 -- 172.21.15.104:0/2130425379 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900037040 con 0x7f4910161190 2024-05-08T04:22:45.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.410+0000 7f4914d90640 1 -- 172.21.15.104:0/2130425379 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4910155ad0 con 0x7f4910161190 2024-05-08T04:22:45.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.411+0000 7f4914d90640 1 -- 172.21.15.104:0/2130425379 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4910075010 con 0x7f4910161190 2024-05-08T04:22:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.411+0000 7f4906ffd640 1 -- 172.21.15.104:0/2130425379 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f4900044070 con 0x7f4910161190 2024-05-08T04:22:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.412+0000 7f4906ffd640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f48f006b680 0x7f48f006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.412+0000 7f490e59c640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f48f006b680 0x7f48f006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.412+0000 7f4906ffd640 1 -- 172.21.15.104:0/2130425379 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49000aaf60 con 0x7f4910161190 2024-05-08T04:22:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.412+0000 7f490e59c640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f48f006b680 0x7f48f006db40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4908007ed0 tx=0x7f4908007e60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:45.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.416+0000 7f4906ffd640 1 -- 172.21.15.104:0/2130425379 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4900079bf0 con 0x7f4910161190 2024-05-08T04:22:45.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.588+0000 7f4914d90640 1 -- 172.21.15.104:0/2130425379 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4910066a30 con 0x7f4910161190 2024-05-08T04:22:45.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.589+0000 7f4906ffd640 1 -- 172.21.15.104:0/2130425379 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16682 (secure 0 0 0) 0x7f49000794f0 con 0x7f4910161190 2024-05-08T04:22:45.590 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:45.590 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":44,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:44.308242+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:42.524824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:43.279621+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:45.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.591+0000 7f4914d90640 1 -- 172.21.15.104:0/2130425379 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f48f006b680 msgr2=0x7f48f006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.591+0000 7f4914d90640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f48f006b680 0x7f48f006db40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4908007ed0 tx=0x7f4908007e60 comp rx=0 tx=0).stop 2024-05-08T04:22:45.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.591+0000 7f4914d90640 1 -- 172.21.15.104:0/2130425379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4910161190 msgr2=0x7f4910150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.591+0000 7f4914d90640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4910161190 0x7f4910150f90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f49000098c0 tx=0x7f49000046c0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.591+0000 7f4914d90640 1 -- 172.21.15.104:0/2130425379 shutdown_connections 2024-05-08T04:22:45.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.591+0000 7f4914d90640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f48f006b680 0x7f48f006db40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.591+0000 7f4914d90640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49100acdf0 0x7f491013e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.591+0000 7f4914d90640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4910161190 0x7f4910150f90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.591+0000 7f4914d90640 1 --2- 172.21.15.104:0/2130425379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f491006c280 0x7f491014a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.591+0000 7f4914d90640 1 -- 172.21.15.104:0/2130425379 >> 172.21.15.104:0/2130425379 conn(0x7f4910071a10 msgr2=0x7f4910161570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:45.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.591+0000 7f4914d90640 1 -- 172.21.15.104:0/2130425379 shutdown_connections 2024-05-08T04:22:45.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.591+0000 7f4914d90640 1 -- 172.21.15.104:0/2130425379 wait complete. 2024-05-08T04:22:45.603 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T04:22:45.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.705+0000 7f04237a5640 1 Processor -- start 2024-05-08T04:22:45.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.706+0000 7f04237a5640 1 -- start start 2024-05-08T04:22:45.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.706+0000 7f04237a5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f041c0ce920 0x7f041c0cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.706+0000 7f04237a5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f041c0d0d20 0x7f041c15e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.706+0000 7f04237a5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c0d1610 con 0x7f041c0b6c90 2024-05-08T04:22:45.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.706+0000 7f04237a5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c0cfee0 con 0x7f041c0ce920 2024-05-08T04:22:45.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.706+0000 7f04237a5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c0d01c0 con 0x7f041c0d0d20 2024-05-08T04:22:45.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.706+0000 7f0420d40640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f041c0ce920 0x7f041c0cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.707+0000 7f0421541640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f041c0b6c90 0x7f041c0ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38324/0 (socket says 172.21.15.104:38324) 2024-05-08T04:22:45.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.707+0000 7f0421541640 1 -- 172.21.15.104:0/550458202 learned_addr learned my addr 172.21.15.104:0/550458202 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:45.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.707+0000 7f0420d40640 1 -- 172.21.15.104:0/550458202 >> v2:172.21.15.183:3300/0 conn(0x7f041c0d0d20 msgr2=0x7f041c15e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:45.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.707+0000 7f0421d42640 1 --2- 172.21.15.104:0/550458202 >> v2:172.21.15.183:3300/0 conn(0x7f041c0d0d20 0x7f041c15e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.707+0000 7f041bfff640 1 -- 172.21.15.104:0/550458202 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773385445 0 0) 0x7f041c0d1610 con 0x7f041c0b6c90 2024-05-08T04:22:45.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.707+0000 7f0420d40640 1 --2- 172.21.15.104:0/550458202 >> v2:172.21.15.183:3300/0 conn(0x7f041c0d0d20 0x7f041c15e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.707+0000 7f0420d40640 1 -- 172.21.15.104:0/550458202 >> v1:172.21.15.104:6789/0 conn(0x7f041c0b6c90 legacy=0x7f041c0ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.707+0000 7f0420d40640 1 -- 172.21.15.104:0/550458202 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0d04a0 con 0x7f041c0ce920 2024-05-08T04:22:45.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.707+0000 7f0421d42640 1 --2- 172.21.15.104:0/550458202 >> v2:172.21.15.183:3300/0 conn(0x7f041c0d0d20 0x7f041c15e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:45.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.708+0000 7f0420d40640 1 --2- 172.21.15.104:0/550458202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f041c0ce920 0x7f041c0cf900 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f04100097a0 tx=0x7f041002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dcb2edf55e3c2c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:45.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.708+0000 7f041bfff640 1 -- 172.21.15.104:0/550458202 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410037070 con 0x7f041c0ce920 2024-05-08T04:22:45.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.708+0000 7f041bfff640 1 -- 172.21.15.104:0/550458202 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0410032440 con 0x7f041c0ce920 2024-05-08T04:22:45.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.708+0000 7f041bfff640 1 -- 172.21.15.104:0/550458202 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410032810 con 0x7f041c0ce920 2024-05-08T04:22:45.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.708+0000 7f04237a5640 1 -- 172.21.15.104:0/550458202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f041c0ce920 msgr2=0x7f041c0cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.708+0000 7f04237a5640 1 --2- 172.21.15.104:0/550458202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f041c0ce920 0x7f041c0cf900 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f04100097a0 tx=0x7f041002a270 comp rx=0 tx=0).stop 2024-05-08T04:22:45.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.708+0000 7f04237a5640 1 -- 172.21.15.104:0/550458202 shutdown_connections 2024-05-08T04:22:45.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.708+0000 7f04237a5640 1 --2- 172.21.15.104:0/550458202 >> v2:172.21.15.183:3300/0 conn(0x7f041c0d0d20 0x7f041c15e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.708+0000 7f04237a5640 1 --2- 172.21.15.104:0/550458202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f041c0ce920 0x7f041c0cf900 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.708+0000 7f04237a5640 1 -- 172.21.15.104:0/550458202 >> 172.21.15.104:0/550458202 conn(0x7f041c06f480 msgr2=0x7f041c06f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:45.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.708+0000 7f04237a5640 1 -- 172.21.15.104:0/550458202 shutdown_connections 2024-05-08T04:22:45.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.708+0000 7f04237a5640 1 -- 172.21.15.104:0/550458202 wait complete. 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.709+0000 7f04237a5640 1 Processor -- start 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.710+0000 7f04237a5640 1 -- start start 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.710+0000 7f04237a5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041c0b6c90 0x7f041c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.710+0000 7f04237a5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041c0ce920 0x7f041c0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.710+0000 7f04237a5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f041c0d0d20 0x7f041c14cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.710+0000 7f04237a5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c15eaf0 con 0x7f041c0d0d20 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.710+0000 7f04237a5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0b4880 con 0x7f041c0ce920 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.710+0000 7f04237a5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c15ec70 con 0x7f041c0b6c90 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.710+0000 7f0421d42640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f041c0d0d20 0x7f041c14cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.710+0000 7f0421d42640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f041c0d0d20 0x7f041c14cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56638/0 (socket says 172.21.15.104:56638) 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.710+0000 7f0421d42640 1 -- 172.21.15.104:0/564224332 learned_addr learned my addr 172.21.15.104:0/564224332 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.710+0000 7f0421541640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041c0b6c90 0x7f041c15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f0421d42640 1 -- 172.21.15.104:0/564224332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041c0b6c90 msgr2=0x7f041c15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f0420d40640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041c0ce920 0x7f041c0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f0421d42640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041c0b6c90 0x7f041c15aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f0421d42640 1 -- 172.21.15.104:0/564224332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041c0ce920 msgr2=0x7f041c0b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f0421d42640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041c0ce920 0x7f041c0b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f0421d42640 1 -- 172.21.15.104:0/564224332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0b1490 con 0x7f041c0d0d20 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f0420d40640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041c0ce920 0x7f041c0b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f0421541640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041c0b6c90 0x7f041c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f0421d42640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f041c0d0d20 0x7f041c14cd80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f041400c7c0 tx=0x7f041400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f0419ffb640 1 -- 172.21.15.104:0/564224332 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414015020 con 0x7f041c0d0d20 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f0419ffb640 1 -- 172.21.15.104:0/564224332 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414004230 con 0x7f041c0d0d20 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f04237a5640 1 -- 172.21.15.104:0/564224332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c0b1770 con 0x7f041c0d0d20 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f0419ffb640 1 -- 172.21.15.104:0/564224332 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414007620 con 0x7f041c0d0d20 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.711+0000 7f04237a5640 1 -- 172.21.15.104:0/564224332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c0b1d30 con 0x7f041c0d0d20 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.712+0000 7f04237a5640 1 -- 172.21.15.104:0/564224332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c075010 con 0x7f041c0d0d20 2024-05-08T04:22:45.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.712+0000 7f0419ffb640 1 -- 172.21.15.104:0/564224332 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f0414018020 con 0x7f041c0d0d20 2024-05-08T04:22:45.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.713+0000 7f0419ffb640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f040806b680 0x7f040806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:45.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.713+0000 7f0419ffb640 1 -- 172.21.15.104:0/564224332 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f041408a7a0 con 0x7f041c0d0d20 2024-05-08T04:22:45.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.713+0000 7f0421541640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f040806b680 0x7f040806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:45.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.713+0000 7f0421541640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f040806b680 0x7f040806db40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f040c0012e0 tx=0x7f040c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:45.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.717+0000 7f0419ffb640 1 -- 172.21.15.104:0/564224332 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f041401f020 con 0x7f041c0d0d20 2024-05-08T04:22:45.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.923+0000 7f04237a5640 1 -- 172.21.15.104:0/564224332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f041c068090 con 0x7f041c0d0d20 2024-05-08T04:22:45.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.985+0000 7f0419ffb640 1 -- 172.21.15.104:0/564224332 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 118+0+0 (secure 0 0 0) 0x7f04140592c0 con 0x7f041c0d0d20 2024-05-08T04:22:45.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.988+0000 7f04237a5640 1 -- 172.21.15.104:0/564224332 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f040806b680 msgr2=0x7f040806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.988+0000 7f04237a5640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f040806b680 0x7f040806db40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f040c0012e0 tx=0x7f040c009040 comp rx=0 tx=0).stop 2024-05-08T04:22:45.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.988+0000 7f04237a5640 1 -- 172.21.15.104:0/564224332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f041c0d0d20 msgr2=0x7f041c14cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.988+0000 7f04237a5640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f041c0d0d20 0x7f041c14cd80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f041400c7c0 tx=0x7f041400cc80 comp rx=0 tx=0).stop 2024-05-08T04:22:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.988+0000 7f04237a5640 1 -- 172.21.15.104:0/564224332 shutdown_connections 2024-05-08T04:22:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.988+0000 7f04237a5640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f040806b680 0x7f040806db40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.988+0000 7f04237a5640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f041c0ce920 0x7f041c0b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.988+0000 7f04237a5640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f041c0d0d20 0x7f041c14cd80 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.988+0000 7f04237a5640 1 --2- 172.21.15.104:0/564224332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f041c0b6c90 0x7f041c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.988+0000 7f04237a5640 1 -- 172.21.15.104:0/564224332 >> 172.21.15.104:0/564224332 conn(0x7f041c06f480 msgr2=0x7f041c15db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.988+0000 7f04237a5640 1 -- 172.21.15.104:0/564224332 shutdown_connections 2024-05-08T04:22:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:45.988+0000 7f04237a5640 1 -- 172.21.15.104:0/564224332 wait complete. 2024-05-08T04:22:46.001 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-08T04:22:46.001 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-08T04:22:46.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.102+0000 7fac258f5640 1 Processor -- start 2024-05-08T04:22:46.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.102+0000 7fac258f5640 1 -- start start 2024-05-08T04:22:46.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.103+0000 7fac258f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac20157ac0 0x7fac20157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:46.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.103+0000 7fac258f5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac200d15c0 con 0x7fac2015edf0 2024-05-08T04:22:46.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.103+0000 7fac258f5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2015f550 con 0x7fac20070c70 2024-05-08T04:22:46.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.103+0000 7fac258f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2006bc70 con 0x7fac20157ac0 2024-05-08T04:22:46.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.103+0000 7fac1e7fc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fac2015edf0 0x7fac200b52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38332/0 (socket says 172.21.15.104:38332) 2024-05-08T04:22:46.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.103+0000 7fac1e7fc640 1 -- 172.21.15.104:0/1408570350 learned_addr learned my addr 172.21.15.104:0/1408570350 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:46.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.103+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92023987 0 0) 0x7fac200d15c0 con 0x7fac2015edf0 2024-05-08T04:22:46.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.103+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac08003520 con 0x7fac2015edf0 2024-05-08T04:22:46.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1f7fe640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac20157ac0 0x7fac20157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:46.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2767103620 0 0) 0x7fac08003520 con 0x7fac2015edf0 2024-05-08T04:22:46.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac20157ac0 msgr2=0x7fac20157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:46.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1dffb640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac20157ac0 0x7fac20157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:46.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 >> v1:172.21.15.183:6789/0 conn(0x7fac20070c70 legacy=0x7fac20071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2015f830 con 0x7fac2015edf0 2024-05-08T04:22:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fac14001670 con 0x7fac2015edf0 2024-05-08T04:22:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 >> v1:172.21.15.104:6789/0 conn(0x7fac2015edf0 legacy=0x7fac200b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1dffb640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac080039e0 0x7fac08003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:46.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1dffb640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac08004800 0x7fac08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1dffb640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac20157ac0 0x7fac08005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0800bac0 con 0x7fac080039e0 2024-05-08T04:22:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0800bc70 con 0x7fac08004800 2024-05-08T04:22:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0800be70 con 0x7fac20157ac0 2024-05-08T04:22:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1effd640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac080039e0 0x7fac08003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1e7fc640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac08004800 0x7fac08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1f7fe640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac20157ac0 0x7fac08005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1effd640 1 -- 172.21.15.104:0/1408570350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac20157ac0 msgr2=0x7fac08005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1effd640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac20157ac0 0x7fac08005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:46.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1effd640 1 -- 172.21.15.104:0/1408570350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac08004800 msgr2=0x7fac08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:46.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1effd640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac08004800 0x7fac08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:46.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1effd640 1 -- 172.21.15.104:0/1408570350 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08003520 con 0x7fac080039e0 2024-05-08T04:22:46.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1e7fc640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac08004800 0x7fac08004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:46.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.104+0000 7fac1f7fe640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac20157ac0 0x7fac08005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:46.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.105+0000 7fac1effd640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac080039e0 0x7fac08003e00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fac10001e50 tx=0x7fac08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7786bcc2811228 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:46.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.105+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10001a70 con 0x7fac080039e0 2024-05-08T04:22:46.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.105+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac10003970 con 0x7fac080039e0 2024-05-08T04:22:46.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.105+0000 7fac1dffb640 1 -- 172.21.15.104:0/1408570350 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10003d60 con 0x7fac080039e0 2024-05-08T04:22:46.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.106+0000 7fac258f5640 1 -- 172.21.15.104:0/1408570350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac080039e0 msgr2=0x7fac08003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:46.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.106+0000 7fac258f5640 1 --2- 172.21.15.104:0/1408570350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac080039e0 0x7fac08003e00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fac10001e50 tx=0x7fac08005830 comp rx=0 tx=0).stop 2024-05-08T04:22:46.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.106+0000 7fac1f7fe640 1 -- 172.21.15.104:0/1408570350 reap_dead start 2024-05-08T04:22:46.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.106+0000 7fac258f5640 1 -- 172.21.15.104:0/1408570350 shutdown_connections 2024-05-08T04:22:46.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.106+0000 7fac258f5640 1 -- 172.21.15.104:0/1408570350 >> 172.21.15.104:0/1408570350 conn(0x7fac200b3450 msgr2=0x7fac200b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:46.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.106+0000 7fac258f5640 1 -- 172.21.15.104:0/1408570350 shutdown_connections 2024-05-08T04:22:46.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.106+0000 7fac258f5640 1 -- 172.21.15.104:0/1408570350 wait complete. 2024-05-08T04:22:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.107+0000 7fac258f5640 1 Processor -- start 2024-05-08T04:22:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.107+0000 7fac258f5640 1 -- start start 2024-05-08T04:22:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac258f5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac080039e0 0x7fac201f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac258f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac20158490 0x7fac201588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac258f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac20153050 0x7fac201f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac258f5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac20161320 con 0x7fac20158490 2024-05-08T04:22:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac258f5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac200b5b80 con 0x7fac080039e0 2024-05-08T04:22:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac258f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2015a580 con 0x7fac20153050 2024-05-08T04:22:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac1e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac20158490 0x7fac201588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac1e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac20158490 0x7fac201588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56658/0 (socket says 172.21.15.104:56658) 2024-05-08T04:22:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac1e7fc640 1 -- 172.21.15.104:0/3366494612 learned_addr learned my addr 172.21.15.104:0/3366494612 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac1e7fc640 1 -- 172.21.15.104:0/3366494612 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac20153050 msgr2=0x7fac201f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac1e7fc640 1 --2- 172.21.15.104:0/3366494612 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac20153050 0x7fac201f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac1e7fc640 1 -- 172.21.15.104:0/3366494612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac080039e0 msgr2=0x7fac201f8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac1e7fc640 1 --2- 172.21.15.104:0/3366494612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac080039e0 0x7fac201f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac1e7fc640 1 -- 172.21.15.104:0/3366494612 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac20158e20 con 0x7fac20158490 2024-05-08T04:22:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac1e7fc640 1 --2- 172.21.15.104:0/3366494612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac20158490 0x7fac201588e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fac1400e760 tx=0x7fac1400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac07fff640 1 -- 172.21.15.104:0/3366494612 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1400ee70 con 0x7fac20158490 2024-05-08T04:22:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac07fff640 1 -- 172.21.15.104:0/3366494612 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14018070 con 0x7fac20158490 2024-05-08T04:22:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac258f5640 1 -- 172.21.15.104:0/3366494612 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2015a7b0 con 0x7fac20158490 2024-05-08T04:22:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac07fff640 1 -- 172.21.15.104:0/3366494612 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1400ca50 con 0x7fac20158490 2024-05-08T04:22:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.108+0000 7fac258f5640 1 -- 172.21.15.104:0/3366494612 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac20157f70 con 0x7fac20158490 2024-05-08T04:22:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.109+0000 7fac258f5640 1 -- 172.21.15.104:0/3366494612 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2015a980 con 0x7fac20158490 2024-05-08T04:22:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.110+0000 7fac07fff640 1 -- 172.21.15.104:0/3366494612 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fac1400cbf0 con 0x7fac20158490 2024-05-08T04:22:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.110+0000 7fac07fff640 1 --2- 172.21.15.104:0/3366494612 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fac0c06b680 0x7fac0c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:46.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.110+0000 7fac1effd640 1 --2- 172.21.15.104:0/3366494612 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fac0c06b680 0x7fac0c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:46.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.110+0000 7fac07fff640 1 -- 172.21.15.104:0/3366494612 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac1408a3b0 con 0x7fac20158490 2024-05-08T04:22:46.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.111+0000 7fac1effd640 1 --2- 172.21.15.104:0/3366494612 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fac0c06b680 0x7fac0c06db40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fac10032000 tx=0x7fac1002c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:46.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.114+0000 7fac07fff640 1 -- 172.21.15.104:0/3366494612 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac20158e20 con 0x7fac20158490 2024-05-08T04:22:46.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.322+0000 7fac258f5640 1 -- 172.21.15.104:0/3366494612 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fac20158170 con 0x7fac20158490 2024-05-08T04:22:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.993+0000 7fac07fff640 1 -- 172.21.15.104:0/3366494612 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v21) v1 ==== 122+0+0 (secure 0 0 0) 0x7fac20158170 con 0x7fac20158490 2024-05-08T04:22:46.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.995+0000 7fac258f5640 1 -- 172.21.15.104:0/3366494612 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fac0c06b680 msgr2=0x7fac0c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:46.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.995+0000 7fac258f5640 1 --2- 172.21.15.104:0/3366494612 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fac0c06b680 0x7fac0c06db40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fac10032000 tx=0x7fac1002c000 comp rx=0 tx=0).stop 2024-05-08T04:22:46.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.995+0000 7fac258f5640 1 -- 172.21.15.104:0/3366494612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac20158490 msgr2=0x7fac201588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:46.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.995+0000 7fac258f5640 1 --2- 172.21.15.104:0/3366494612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac20158490 0x7fac201588e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fac1400e760 tx=0x7fac1400ec20 comp rx=0 tx=0).stop 2024-05-08T04:22:46.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.995+0000 7fac258f5640 1 -- 172.21.15.104:0/3366494612 shutdown_connections 2024-05-08T04:22:46.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.995+0000 7fac258f5640 1 --2- 172.21.15.104:0/3366494612 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fac0c06b680 0x7fac0c06db40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:46.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.995+0000 7fac258f5640 1 --2- 172.21.15.104:0/3366494612 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac20153050 0x7fac201f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:46.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.995+0000 7fac258f5640 1 --2- 172.21.15.104:0/3366494612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac20158490 0x7fac201588e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:46.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.995+0000 7fac258f5640 1 --2- 172.21.15.104:0/3366494612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac080039e0 0x7fac201f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:46.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.995+0000 7fac258f5640 1 -- 172.21.15.104:0/3366494612 >> 172.21.15.104:0/3366494612 conn(0x7fac200b3450 msgr2=0x7fac200b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:46.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.995+0000 7fac258f5640 1 -- 172.21.15.104:0/3366494612 shutdown_connections 2024-05-08T04:22:46.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:46.995+0000 7fac258f5640 1 -- 172.21.15.104:0/3366494612 wait complete. 2024-05-08T04:22:47.010 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-08T04:22:47.010 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:22:47.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.113+0000 7f06a3ef5640 1 Processor -- start 2024-05-08T04:22:47.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.113+0000 7f06a3ef5640 1 -- start start 2024-05-08T04:22:47.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.114+0000 7f06a3ef5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f069c0cd830 0x7f069c070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.114+0000 7f06a3ef5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c073030 con 0x7f069c158540 2024-05-08T04:22:47.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.114+0000 7f06a3ef5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c072210 con 0x7f069c0701a0 2024-05-08T04:22:47.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.114+0000 7f06a3ef5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c0cbf50 con 0x7f069c0cd830 2024-05-08T04:22:47.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.114+0000 7f06a2492640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f069c0cd830 0x7f069c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.114+0000 7f06a1c91640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f069c158540 0x7f069c15e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38336/0 (socket says 172.21.15.104:38336) 2024-05-08T04:22:47.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.114+0000 7f06a1c91640 1 -- 172.21.15.104:0/1430500715 learned_addr learned my addr 172.21.15.104:0/1430500715 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:47.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.115+0000 7f06a2492640 1 -- 172.21.15.104:0/1430500715 >> v1:172.21.15.183:6789/0 conn(0x7f069c0701a0 legacy=0x7f069c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:47.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.115+0000 7f06a2492640 1 -- 172.21.15.104:0/1430500715 >> v1:172.21.15.104:6789/0 conn(0x7f069c158540 legacy=0x7f069c15e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.115+0000 7f06a2492640 1 -- 172.21.15.104:0/1430500715 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c0724b0 con 0x7f069c0cd830 2024-05-08T04:22:47.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.115+0000 7f06a0c8f640 1 -- 172.21.15.104:0/1430500715 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753788773 0 0) 0x7f069c073030 con 0x7f069c158540 2024-05-08T04:22:47.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.115+0000 7f06a2492640 1 --2- 172.21.15.104:0/1430500715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f069c0cd830 0x7f069c070600 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f068c009d90 tx=0x7f068c02c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feab088e22d53c0e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:47.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.116+0000 7f06a0c8f640 1 -- 172.21.15.104:0/1430500715 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c032770 con 0x7f069c0cd830 2024-05-08T04:22:47.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.116+0000 7f06a0c8f640 1 -- 172.21.15.104:0/1430500715 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c038070 con 0x7f069c0cd830 2024-05-08T04:22:47.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.116+0000 7f06a0c8f640 1 -- 172.21.15.104:0/1430500715 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c032b30 con 0x7f069c0cd830 2024-05-08T04:22:47.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.116+0000 7f06a3ef5640 1 -- 172.21.15.104:0/1430500715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f069c0cd830 msgr2=0x7f069c070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.116+0000 7f06a3ef5640 1 --2- 172.21.15.104:0/1430500715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f069c0cd830 0x7f069c070600 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f068c009d90 tx=0x7f068c02c8b0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.116+0000 7f06a3ef5640 1 -- 172.21.15.104:0/1430500715 shutdown_connections 2024-05-08T04:22:47.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.116+0000 7f06a3ef5640 1 --2- 172.21.15.104:0/1430500715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f069c0cd830 0x7f069c070600 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.116+0000 7f06a3ef5640 1 -- 172.21.15.104:0/1430500715 >> 172.21.15.104:0/1430500715 conn(0x7f069c0b23e0 msgr2=0x7f069c0b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:47.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.116+0000 7f06a3ef5640 1 -- 172.21.15.104:0/1430500715 shutdown_connections 2024-05-08T04:22:47.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.116+0000 7f06a3ef5640 1 -- 172.21.15.104:0/1430500715 wait complete. 2024-05-08T04:22:47.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.117+0000 7f06a3ef5640 1 Processor -- start 2024-05-08T04:22:47.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.117+0000 7f06a3ef5640 1 -- start start 2024-05-08T04:22:47.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a3ef5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f069c0701a0 0x7f069c14c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a3ef5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f069c0cd830 0x7f069c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a3ef5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f069c158540 0x7f069c0b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a3ef5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c072d50 con 0x7f069c0cd830 2024-05-08T04:22:47.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a3ef5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c072a70 con 0x7f069c158540 2024-05-08T04:22:47.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a3ef5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0cc380 con 0x7f069c0701a0 2024-05-08T04:22:47.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a1490640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f069c0cd830 0x7f069c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a1490640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f069c0cd830 0x7f069c156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56664/0 (socket says 172.21.15.104:56664) 2024-05-08T04:22:47.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a1490640 1 -- 172.21.15.104:0/314799107 learned_addr learned my addr 172.21.15.104:0/314799107 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:47.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a1490640 1 -- 172.21.15.104:0/314799107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f069c0701a0 msgr2=0x7f069c14c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a1490640 1 --2- 172.21.15.104:0/314799107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f069c0701a0 0x7f069c14c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a1490640 1 -- 172.21.15.104:0/314799107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f069c158540 msgr2=0x7f069c0b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a1490640 1 --2- 172.21.15.104:0/314799107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f069c158540 0x7f069c0b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.118+0000 7f06a1490640 1 -- 172.21.15.104:0/314799107 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c157af0 con 0x7f069c0cd830 2024-05-08T04:22:47.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.119+0000 7f06a1490640 1 --2- 172.21.15.104:0/314799107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f069c0cd830 0x7f069c156150 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f069000c410 tx=0x7f069000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:47.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.119+0000 7f069a7fc640 1 -- 172.21.15.104:0/314799107 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690017070 con 0x7f069c0cd830 2024-05-08T04:22:47.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.119+0000 7f069a7fc640 1 -- 172.21.15.104:0/314799107 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06900035f0 con 0x7f069c0cd830 2024-05-08T04:22:47.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.119+0000 7f06a3ef5640 1 -- 172.21.15.104:0/314799107 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c156a50 con 0x7f069c0cd830 2024-05-08T04:22:47.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.119+0000 7f069a7fc640 1 -- 172.21.15.104:0/314799107 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690003a20 con 0x7f069c0cd830 2024-05-08T04:22:47.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.119+0000 7f06a3ef5640 1 -- 172.21.15.104:0/314799107 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c157010 con 0x7f069c0cd830 2024-05-08T04:22:47.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.120+0000 7f06a3ef5640 1 -- 172.21.15.104:0/314799107 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c075010 con 0x7f069c0cd830 2024-05-08T04:22:47.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.120+0000 7f069a7fc640 1 -- 172.21.15.104:0/314799107 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f069001a070 con 0x7f069c0cd830 2024-05-08T04:22:47.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.121+0000 7f069a7fc640 1 --2- 172.21.15.104:0/314799107 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f068806b680 0x7f068806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.121+0000 7f069a7fc640 1 -- 172.21.15.104:0/314799107 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0690089960 con 0x7f069c0cd830 2024-05-08T04:22:47.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.121+0000 7f06a1c91640 1 --2- 172.21.15.104:0/314799107 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f068806b680 0x7f068806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.121+0000 7f06a1c91640 1 --2- 172.21.15.104:0/314799107 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f068806b680 0x7f068806db40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0694007fd0 tx=0x7f0694007960 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:47.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.125+0000 7f069a7fc640 1 -- 172.21.15.104:0/314799107 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f06900585f0 con 0x7f069c0cd830 2024-05-08T04:22:47.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.334+0000 7f06a3ef5640 1 -- 172.21.15.104:0/314799107 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f069c15a930 con 0x7f069c0cd830 2024-05-08T04:22:47.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.334+0000 7f069a7fc640 1 -- 172.21.15.104:0/314799107 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f06900010c0 con 0x7f069c0cd830 2024-05-08T04:22:47.336 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:47.336 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:22:47.336 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 21 2024-05-08T04:22:47.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.336+0000 7f06a3ef5640 1 -- 172.21.15.104:0/314799107 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f068806b680 msgr2=0x7f068806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.336+0000 7f06a3ef5640 1 --2- 172.21.15.104:0/314799107 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f068806b680 0x7f068806db40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0694007fd0 tx=0x7f0694007960 comp rx=0 tx=0).stop 2024-05-08T04:22:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.336+0000 7f06a3ef5640 1 -- 172.21.15.104:0/314799107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f069c0cd830 msgr2=0x7f069c156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.336+0000 7f06a3ef5640 1 --2- 172.21.15.104:0/314799107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f069c0cd830 0x7f069c156150 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f069000c410 tx=0x7f069000c8d0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.336+0000 7f06a3ef5640 1 -- 172.21.15.104:0/314799107 shutdown_connections 2024-05-08T04:22:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.336+0000 7f06a3ef5640 1 --2- 172.21.15.104:0/314799107 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f068806b680 0x7f068806db40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.336+0000 7f06a3ef5640 1 --2- 172.21.15.104:0/314799107 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f069c158540 0x7f069c0b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.336+0000 7f06a3ef5640 1 --2- 172.21.15.104:0/314799107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f069c0cd830 0x7f069c156150 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.336+0000 7f06a3ef5640 1 --2- 172.21.15.104:0/314799107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f069c0701a0 0x7f069c14c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.336+0000 7f06a3ef5640 1 -- 172.21.15.104:0/314799107 >> 172.21.15.104:0/314799107 conn(0x7f069c0b23e0 msgr2=0x7f069c0ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.336+0000 7f06a3ef5640 1 -- 172.21.15.104:0/314799107 shutdown_connections 2024-05-08T04:22:47.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.336+0000 7f06a3ef5640 1 -- 172.21.15.104:0/314799107 wait complete. 2024-05-08T04:22:47.348 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:47.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.447+0000 7f2d9dd2b640 1 Processor -- start 2024-05-08T04:22:47.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.447+0000 7f2d9dd2b640 1 -- start start 2024-05-08T04:22:47.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.448+0000 7f2d9dd2b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d980d35c0 0x7f2d980b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.448+0000 7f2d9dd2b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2d980b59c0 0x7f2d980b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.448+0000 7f2d9dd2b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d980b9920 con 0x7f2d9815dad0 2024-05-08T04:22:47.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.448+0000 7f2d9dd2b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d980b5e10 con 0x7f2d980b59c0 2024-05-08T04:22:47.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.448+0000 7f2d9dd2b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980d2520 con 0x7f2d980d35c0 2024-05-08T04:22:47.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.448+0000 7f2d977fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f2d9815dad0 0x7f2d980d1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:38346/0 (socket says 172.21.15.104:38346) 2024-05-08T04:22:47.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.448+0000 7f2d977fe640 1 -- 172.21.15.104:0/2645865515 learned_addr learned my addr 172.21.15.104:0/2645865515 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:47.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d96ffd640 1 --2- 172.21.15.104:0/2645865515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d980d35c0 0x7f2d980b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861993393 0 0) 0x7f2d980b9920 con 0x7f2d9815dad0 2024-05-08T04:22:47.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d97fff640 1 --2- 172.21.15.104:0/2645865515 >> v2:172.21.15.183:3300/0 conn(0x7f2d980b59c0 0x7f2d980b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d80003520 con 0x7f2d9815dad0 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 432612353 0 0) 0x7f2d80003520 con 0x7f2d9815dad0 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d980d35c0 msgr2=0x7f2d980b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 --2- 172.21.15.104:0/2645865515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d980d35c0 0x7f2d980b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 >> v2:172.21.15.183:3300/0 conn(0x7f2d980b59c0 msgr2=0x7f2d980b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 --2- 172.21.15.104:0/2645865515 >> v2:172.21.15.183:3300/0 conn(0x7f2d980b59c0 0x7f2d980b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d980d2800 con 0x7f2d9815dad0 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f2d880019f0 con 0x7f2d9815dad0 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 >> v1:172.21.15.104:6789/0 conn(0x7f2d9815dad0 legacy=0x7f2d980d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 --2- 172.21.15.104:0/2645865515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d800039b0 0x7f2d80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 --2- 172.21.15.104:0/2645865515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d80004800 0x7f2d80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 --2- 172.21.15.104:0/2645865515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d980d35c0 0x7f2d800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980b5e10 con 0x7f2d80004800 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980d2520 con 0x7f2d800039b0 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8000b9f0 con 0x7f2d980d35c0 2024-05-08T04:22:47.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d96ffd640 1 --2- 172.21.15.104:0/2645865515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d80004800 0x7f2d80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d977fe640 1 --2- 172.21.15.104:0/2645865515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d800039b0 0x7f2d80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d97fff640 1 --2- 172.21.15.104:0/2645865515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d980d35c0 0x7f2d800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d96ffd640 1 -- 172.21.15.104:0/2645865515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d980d35c0 msgr2=0x7f2d800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d96ffd640 1 --2- 172.21.15.104:0/2645865515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d980d35c0 0x7f2d800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d96ffd640 1 -- 172.21.15.104:0/2645865515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d800039b0 msgr2=0x7f2d80003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d96ffd640 1 --2- 172.21.15.104:0/2645865515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d800039b0 0x7f2d80003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.449+0000 7f2d96ffd640 1 -- 172.21.15.104:0/2645865515 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d80003520 con 0x7f2d80004800 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.450+0000 7f2d96ffd640 1 --2- 172.21.15.104:0/2645865515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d80004800 0x7f2d80004c80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009ac0 tx=0x7f2d80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95ab8fcc0e65f93 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.450+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c036070 con 0x7f2d80004800 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.450+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c031400 con 0x7f2d80004800 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.450+0000 7f2d967fc640 1 -- 172.21.15.104:0/2645865515 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c009690 con 0x7f2d80004800 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.451+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/2645865515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d80004800 msgr2=0x7f2d80004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.451+0000 7f2d9dd2b640 1 --2- 172.21.15.104:0/2645865515 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d80004800 0x7f2d80004c80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c009ac0 tx=0x7f2d80005830 comp rx=0 tx=0).stop 2024-05-08T04:22:47.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.451+0000 7f2d97fff640 1 -- 172.21.15.104:0/2645865515 reap_dead start 2024-05-08T04:22:47.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.451+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/2645865515 shutdown_connections 2024-05-08T04:22:47.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.451+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/2645865515 >> 172.21.15.104:0/2645865515 conn(0x7f2d9806c650 msgr2=0x7f2d980d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:47.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.451+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/2645865515 shutdown_connections 2024-05-08T04:22:47.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.451+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/2645865515 wait complete. 2024-05-08T04:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.452+0000 7f2d9dd2b640 1 Processor -- start 2024-05-08T04:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.452+0000 7f2d9dd2b640 1 -- start start 2024-05-08T04:22:47.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d9dd2b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d80004800 0x7f2d98154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d9dd2b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d980b7390 0x7f2d980b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d9dd2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d981e2e40 0x7f2d981e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d9dd2b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980d30a0 con 0x7f2d981e2e40 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d9dd2b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980d2dc0 con 0x7f2d980b7390 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d9dd2b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980d2170 con 0x7f2d80004800 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d97fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d981e2e40 0x7f2d981e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d97fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d981e2e40 0x7f2d981e32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57332/0 (socket says 172.21.15.104:57332) 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d97fff640 1 -- 172.21.15.104:0/3558520572 learned_addr learned my addr 172.21.15.104:0/3558520572 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d96ffd640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d980b7390 0x7f2d980b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d977fe640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d80004800 0x7f2d98154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d97fff640 1 -- 172.21.15.104:0/3558520572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d80004800 msgr2=0x7f2d98154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d97fff640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d80004800 0x7f2d98154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d97fff640 1 -- 172.21.15.104:0/3558520572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d980b7390 msgr2=0x7f2d980b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d97fff640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d980b7390 0x7f2d980b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d97fff640 1 -- 172.21.15.104:0/3558520572 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d981e3bb0 con 0x7f2d981e2e40 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d977fe640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d80004800 0x7f2d98154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.453+0000 7f2d97fff640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d981e2e40 0x7f2d981e32c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2d90011490 tx=0x7f2d90009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.454+0000 7f2d7ffff640 1 -- 172.21.15.104:0/3558520572 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d90003610 con 0x7f2d981e2e40 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.454+0000 7f2d7ffff640 1 -- 172.21.15.104:0/3558520572 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9001b070 con 0x7f2d981e2e40 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.454+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/3558520572 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d981e3e90 con 0x7f2d981e2e40 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.454+0000 7f2d7ffff640 1 -- 172.21.15.104:0/3558520572 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d900039f0 con 0x7f2d981e2e40 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.454+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/3558520572 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d981f42f0 con 0x7f2d981e2e40 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.455+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/3558520572 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d98075010 con 0x7f2d981e2e40 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.455+0000 7f2d7ffff640 1 -- 172.21.15.104:0/3558520572 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f2d90003b90 con 0x7f2d981e2e40 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.455+0000 7f2d7ffff640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2d8406b680 0x7f2d8406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.456+0000 7f2d977fe640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2d8406b680 0x7f2d8406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.456+0000 7f2d7ffff640 1 -- 172.21.15.104:0/3558520572 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d9008a6e0 con 0x7f2d981e2e40 2024-05-08T04:22:47.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.456+0000 7f2d977fe640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2d8406b680 0x7f2d8406db40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2d88002230 tx=0x7f2d880012d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:47.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.460+0000 7f2d7ffff640 1 -- 172.21.15.104:0/3558520572 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2d90025020 con 0x7f2d981e2e40 2024-05-08T04:22:47.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.629+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/3558520572 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d981e4060 con 0x7f2d981e2e40 2024-05-08T04:22:47.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.630+0000 7f2d7ffff640 1 -- 172.21.15.104:0/3558520572 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16669 (secure 0 0 0) 0x7f2d900592e0 con 0x7f2d981e2e40 2024-05-08T04:22:47.631 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:47.632 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":45,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:45.976150+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:42.524824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:43.279621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.632+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/3558520572 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2d8406b680 msgr2=0x7f2d8406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.632+0000 7f2d9dd2b640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2d8406b680 0x7f2d8406db40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2d88002230 tx=0x7f2d880012d0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.632+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/3558520572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d981e2e40 msgr2=0x7f2d981e32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.632+0000 7f2d9dd2b640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d981e2e40 0x7f2d981e32c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2d90011490 tx=0x7f2d90009f90 comp rx=0 tx=0).stop 2024-05-08T04:22:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.632+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/3558520572 shutdown_connections 2024-05-08T04:22:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.632+0000 7f2d9dd2b640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2d8406b680 0x7f2d8406db40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.632+0000 7f2d9dd2b640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d980b7390 0x7f2d980b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.632+0000 7f2d9dd2b640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d981e2e40 0x7f2d981e32c0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.632+0000 7f2d9dd2b640 1 --2- 172.21.15.104:0/3558520572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d80004800 0x7f2d98154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.632+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/3558520572 >> 172.21.15.104:0/3558520572 conn(0x7f2d9806c650 msgr2=0x7f2d9815c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.632+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/3558520572 shutdown_connections 2024-05-08T04:22:47.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.632+0000 7f2d9dd2b640 1 -- 172.21.15.104:0/3558520572 wait complete. 2024-05-08T04:22:47.645 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-08T04:22:47.645 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:22:47.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.743+0000 7eff39b77640 1 Processor -- start 2024-05-08T04:22:47.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.743+0000 7eff39b77640 1 -- start start 2024-05-08T04:22:47.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.744+0000 7eff39b77640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff3415db30 0x7eff3406bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.744+0000 7eff39b77640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7eff340b5b40 0x7eff340d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.744+0000 7eff39b77640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff340b6b50 con 0x7eff340b93b0 2024-05-08T04:22:47.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.744+0000 7eff39b77640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3406c800 con 0x7eff340b5b40 2024-05-08T04:22:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.744+0000 7eff39b77640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3406cae0 con 0x7eff3415db30 2024-05-08T04:22:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.744+0000 7eff32ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7eff340b93b0 0x7eff340b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42358/0 (socket says 172.21.15.104:42358) 2024-05-08T04:22:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.744+0000 7eff32ffd640 1 -- 172.21.15.104:0/1223072264 learned_addr learned my addr 172.21.15.104:0/1223072264 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22068502 0 0) 0x7eff28001110 con 0x7eff340b93b0 2024-05-08T04:22:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff337fe640 1 --2- 172.21.15.104:0/1223072264 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff3415db30 0x7eff3406bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff1c003520 con 0x7eff340b93b0 2024-05-08T04:22:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff33fff640 1 --2- 172.21.15.104:0/1223072264 >> v2:172.21.15.183:3300/0 conn(0x7eff340b5b40 0x7eff340d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3572175382 0 0) 0x7eff1c003520 con 0x7eff340b93b0 2024-05-08T04:22:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff3415db30 msgr2=0x7eff3406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 --2- 172.21.15.104:0/1223072264 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff3415db30 0x7eff3406bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 >> v2:172.21.15.183:3300/0 conn(0x7eff340b5b40 msgr2=0x7eff340d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 --2- 172.21.15.104:0/1223072264 >> v2:172.21.15.183:3300/0 conn(0x7eff340b5b40 0x7eff340d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3406cdc0 con 0x7eff340b93b0 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7eff28001840 con 0x7eff340b93b0 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 >> v1:172.21.15.104:6789/0 conn(0x7eff340b93b0 legacy=0x7eff340b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 --2- 172.21.15.104:0/1223072264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff1c0039b0 0x7eff1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 --2- 172.21.15.104:0/1223072264 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff3415db30 0x7eff1c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 --2- 172.21.15.104:0/1223072264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff1c004d40 0x7eff1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3406c800 con 0x7eff1c0039b0 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3406cae0 con 0x7eff1c004d40 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c00ba70 con 0x7eff3415db30 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff337fe640 1 --2- 172.21.15.104:0/1223072264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff1c0039b0 0x7eff1c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff32ffd640 1 --2- 172.21.15.104:0/1223072264 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff3415db30 0x7eff1c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff33fff640 1 --2- 172.21.15.104:0/1223072264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff1c004d40 0x7eff1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff337fe640 1 -- 172.21.15.104:0/1223072264 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff3415db30 msgr2=0x7eff1c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff337fe640 1 --2- 172.21.15.104:0/1223072264 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff3415db30 0x7eff1c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff337fe640 1 -- 172.21.15.104:0/1223072264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff1c004d40 msgr2=0x7eff1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff337fe640 1 --2- 172.21.15.104:0/1223072264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff1c004d40 0x7eff1c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff337fe640 1 -- 172.21.15.104:0/1223072264 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c003520 con 0x7eff1c0039b0 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.745+0000 7eff33fff640 1 --2- 172.21.15.104:0/1223072264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff1c004d40 0x7eff1c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.746+0000 7eff337fe640 1 --2- 172.21.15.104:0/1223072264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff1c0039b0 0x7eff1c003dd0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7eff24007390 tx=0x7eff1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426a05c3f399ffbb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.746+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24009be0 con 0x7eff1c0039b0 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.746+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2402e620 con 0x7eff1c0039b0 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.746+0000 7eff327fc640 1 -- 172.21.15.104:0/1223072264 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2402e9f0 con 0x7eff1c0039b0 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.747+0000 7eff39b77640 1 -- 172.21.15.104:0/1223072264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff1c0039b0 msgr2=0x7eff1c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.747+0000 7eff39b77640 1 --2- 172.21.15.104:0/1223072264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff1c0039b0 0x7eff1c003dd0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7eff24007390 tx=0x7eff1c005830 comp rx=0 tx=0).stop 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.747+0000 7eff33fff640 1 -- 172.21.15.104:0/1223072264 reap_dead start 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.747+0000 7eff39b77640 1 -- 172.21.15.104:0/1223072264 shutdown_connections 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.747+0000 7eff39b77640 1 -- 172.21.15.104:0/1223072264 >> 172.21.15.104:0/1223072264 conn(0x7eff340d0430 msgr2=0x7eff340d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.747+0000 7eff39b77640 1 -- 172.21.15.104:0/1223072264 shutdown_connections 2024-05-08T04:22:47.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.747+0000 7eff39b77640 1 -- 172.21.15.104:0/1223072264 wait complete. 2024-05-08T04:22:47.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.748+0000 7eff39b77640 1 Processor -- start 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.748+0000 7eff39b77640 1 -- start start 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff39b77640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff1c0039b0 0x7eff340b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff39b77640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff340cc4e0 0x7eff340cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff39b77640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff340ac8e0 0x7eff340acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff39b77640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3415df10 con 0x7eff1c0039b0 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff39b77640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3406bfb0 con 0x7eff340ac8e0 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff39b77640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3414ce00 con 0x7eff340cc4e0 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff337fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff1c0039b0 0x7eff340b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff337fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff1c0039b0 0x7eff340b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57348/0 (socket says 172.21.15.104:57348) 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff337fe640 1 -- 172.21.15.104:0/2977030164 learned_addr learned my addr 172.21.15.104:0/2977030164 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff32ffd640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff340cc4e0 0x7eff340cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff33fff640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff340ac8e0 0x7eff340acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff337fe640 1 -- 172.21.15.104:0/2977030164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff340cc4e0 msgr2=0x7eff340cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff337fe640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff340cc4e0 0x7eff340cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff337fe640 1 -- 172.21.15.104:0/2977030164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff340ac8e0 msgr2=0x7eff340acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff337fe640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff340ac8e0 0x7eff340acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff337fe640 1 -- 172.21.15.104:0/2977030164 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3414cb00 con 0x7eff1c0039b0 2024-05-08T04:22:47.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff337fe640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff1c0039b0 0x7eff340b1d40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7eff2402b0a0 tx=0x7eff24004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:47.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff1bfff640 1 -- 172.21.15.104:0/2977030164 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24045070 con 0x7eff1c0039b0 2024-05-08T04:22:47.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff1bfff640 1 -- 172.21.15.104:0/2977030164 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff24003990 con 0x7eff1c0039b0 2024-05-08T04:22:47.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff1bfff640 1 -- 172.21.15.104:0/2977030164 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24009be0 con 0x7eff1c0039b0 2024-05-08T04:22:47.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.749+0000 7eff39b77640 1 -- 172.21.15.104:0/2977030164 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff340ccf60 con 0x7eff1c0039b0 2024-05-08T04:22:47.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.750+0000 7eff39b77640 1 -- 172.21.15.104:0/2977030164 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff340b2280 con 0x7eff1c0039b0 2024-05-08T04:22:47.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.750+0000 7eff39b77640 1 -- 172.21.15.104:0/2977030164 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff34075010 con 0x7eff1c0039b0 2024-05-08T04:22:47.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.751+0000 7eff1bfff640 1 -- 172.21.15.104:0/2977030164 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7eff24048070 con 0x7eff1c0039b0 2024-05-08T04:22:47.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.751+0000 7eff1bfff640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff2006b680 0x7eff2006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:47.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.752+0000 7eff1bfff640 1 -- 172.21.15.104:0/2977030164 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff240aadc0 con 0x7eff1c0039b0 2024-05-08T04:22:47.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.752+0000 7eff32ffd640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff2006b680 0x7eff2006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:47.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.752+0000 7eff32ffd640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff2006b680 0x7eff2006db40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff280012f0 tx=0x7eff28009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:47.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.755+0000 7eff1bfff640 1 -- 172.21.15.104:0/2977030164 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7eff2403d070 con 0x7eff1c0039b0 2024-05-08T04:22:47.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.922+0000 7eff39b77640 1 -- 172.21.15.104:0/2977030164 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff340b4d00 con 0x7eff2006b680 2024-05-08T04:22:47.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.927+0000 7eff1bfff640 1 -- 172.21.15.104:0/2977030164 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237149 (secure 0 0 0) 0x7eff340b4d00 con 0x7eff2006b680 2024-05-08T04:22:47.931 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:47.932 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:22:47.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.930+0000 7eff39b77640 1 -- 172.21.15.104:0/2977030164 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff2006b680 msgr2=0x7eff2006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.930+0000 7eff39b77640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff2006b680 0x7eff2006db40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7eff280012f0 tx=0x7eff28009040 comp rx=0 tx=0).stop 2024-05-08T04:22:47.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.930+0000 7eff39b77640 1 -- 172.21.15.104:0/2977030164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff1c0039b0 msgr2=0x7eff340b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:47.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.930+0000 7eff39b77640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff1c0039b0 0x7eff340b1d40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7eff2402b0a0 tx=0x7eff24004ab0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.930+0000 7eff39b77640 1 -- 172.21.15.104:0/2977030164 shutdown_connections 2024-05-08T04:22:47.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.930+0000 7eff39b77640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff2006b680 0x7eff2006db40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.930+0000 7eff39b77640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff340ac8e0 0x7eff340acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.930+0000 7eff39b77640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff340cc4e0 0x7eff340cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.930+0000 7eff39b77640 1 --2- 172.21.15.104:0/2977030164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff1c0039b0 0x7eff340b1d40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:47.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.930+0000 7eff39b77640 1 -- 172.21.15.104:0/2977030164 >> 172.21.15.104:0/2977030164 conn(0x7eff340d0430 msgr2=0x7eff340d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:47.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.930+0000 7eff39b77640 1 -- 172.21.15.104:0/2977030164 shutdown_connections 2024-05-08T04:22:47.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:47.930+0000 7eff39b77640 1 -- 172.21.15.104:0/2977030164 wait complete. 2024-05-08T04:22:47.942 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-05-08T04:22:46.654895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221088,"kb_used_data":4904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753632,"statfs":{"total":773094113280,"available":772867719168,"internally_reserved":0,"allocated":5021696,"data_stored":2696496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000675"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-08T04:22:41.222856+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:22:41.222856+0000","last_peered":"2024-05-08T04:22:41.222856+0000","last_clean":"2024-05-08T04:22:41.222856+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:22:41.222856+0000","last_undegraded":"2024-05-08T04:22:41.222856+0000","last_fullsized":"2024-05-08T04:22:41.222856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":779838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":779838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:22:47.947 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:22:48.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.082+0000 7f2bab58b640 1 Processor -- start 2024-05-08T04:22:48.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.082+0000 7f2bab58b640 1 -- start start 2024-05-08T04:22:48.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2bab58b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2ba4070c70 0x7f2ba4071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2bab58b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415edf0 0x7f2ba40b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2bab58b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2ba4157ac0 0x7f2ba4157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2bab58b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba406bc70 con 0x7f2ba4070c70 2024-05-08T04:22:48.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2bab58b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba4071590 con 0x7f2ba4157ac0 2024-05-08T04:22:48.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2bab58b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40d15c0 con 0x7f2ba415edf0 2024-05-08T04:22:48.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2ba9327640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2ba4070c70 0x7f2ba4071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2ba9327640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f2ba4070c70 0x7f2ba4071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57350/0 (socket says 172.21.15.104:57350) 2024-05-08T04:22:48.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2ba9327640 1 -- 172.21.15.104:0/12011295 learned_addr learned my addr 172.21.15.104:0/12011295 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:48.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2ba8b26640 1 --2- 172.21.15.104:0/12011295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415edf0 0x7f2ba40b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2ba9b28640 1 --2- 172.21.15.104:0/12011295 >> v2:172.21.15.183:3300/0 conn(0x7f2ba4157ac0 0x7f2ba4157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2ba9327640 1 -- 172.21.15.104:0/12011295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415edf0 msgr2=0x7f2ba40b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:48.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2ba9327640 1 --2- 172.21.15.104:0/12011295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415edf0 0x7f2ba40b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2ba9327640 1 -- 172.21.15.104:0/12011295 >> v2:172.21.15.183:3300/0 conn(0x7f2ba4157ac0 msgr2=0x7f2ba4157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:48.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2ba9327640 1 --2- 172.21.15.104:0/12011295 >> v2:172.21.15.183:3300/0 conn(0x7f2ba4157ac0 0x7f2ba4157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2ba9327640 1 -- 172.21.15.104:0/12011295 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba415f550 con 0x7f2ba4070c70 2024-05-08T04:22:48.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2ba8b26640 1 --2- 172.21.15.104:0/12011295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415edf0 0x7f2ba40b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:48.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.083+0000 7f2ba9b28640 1 --2- 172.21.15.104:0/12011295 >> v2:172.21.15.183:3300/0 conn(0x7f2ba4157ac0 0x7f2ba4157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:48.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.084+0000 7f2ba9327640 1 --2- 172.21.15.104:0/12011295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ba4070c70 0x7f2ba4071050 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40b6c00 tx=0x7f2b9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a672b6bcd2480c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:48.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.084+0000 7f2ba3fff640 1 -- 172.21.15.104:0/12011295 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94037070 con 0x7f2ba4070c70 2024-05-08T04:22:48.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.084+0000 7f2ba3fff640 1 -- 172.21.15.104:0/12011295 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b94032440 con 0x7f2ba4070c70 2024-05-08T04:22:48.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.084+0000 7f2ba3fff640 1 -- 172.21.15.104:0/12011295 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94032810 con 0x7f2ba4070c70 2024-05-08T04:22:48.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.085+0000 7f2bab58b640 1 -- 172.21.15.104:0/12011295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ba4070c70 msgr2=0x7f2ba4071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.085+0000 7f2bab58b640 1 --2- 172.21.15.104:0/12011295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ba4070c70 0x7f2ba4071050 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40b6c00 tx=0x7f2b9402a1e0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.085+0000 7f2bab58b640 1 -- 172.21.15.104:0/12011295 shutdown_connections 2024-05-08T04:22:48.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.085+0000 7f2bab58b640 1 --2- 172.21.15.104:0/12011295 >> v2:172.21.15.183:3300/0 conn(0x7f2ba4157ac0 0x7f2ba4157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.085+0000 7f2bab58b640 1 --2- 172.21.15.104:0/12011295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba415edf0 0x7f2ba40b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.085+0000 7f2bab58b640 1 --2- 172.21.15.104:0/12011295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ba4070c70 0x7f2ba4071050 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.085+0000 7f2bab58b640 1 -- 172.21.15.104:0/12011295 >> 172.21.15.104:0/12011295 conn(0x7f2ba40b3450 msgr2=0x7f2ba40b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:48.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.085+0000 7f2bab58b640 1 -- 172.21.15.104:0/12011295 shutdown_connections 2024-05-08T04:22:48.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.085+0000 7f2bab58b640 1 -- 172.21.15.104:0/12011295 wait complete. 2024-05-08T04:22:48.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.086+0000 7f2bab58b640 1 Processor -- start 2024-05-08T04:22:48.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.086+0000 7f2bab58b640 1 -- start start 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2bab58b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba4070c70 0x7f2ba40cf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2bab58b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ba4157ac0 0x7f2ba415a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2bab58b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ba415edf0 0x7f2ba415ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2bab58b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40b5b80 con 0x7f2ba415edf0 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2bab58b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba415fb10 con 0x7f2ba4157ac0 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2bab58b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40b57e0 con 0x7f2ba4070c70 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2ba9b28640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ba415edf0 0x7f2ba415ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2ba9b28640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ba415edf0 0x7f2ba415ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57366/0 (socket says 172.21.15.104:57366) 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2ba9b28640 1 -- 172.21.15.104:0/3544267103 learned_addr learned my addr 172.21.15.104:0/3544267103 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2ba8b26640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ba4157ac0 0x7f2ba415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2ba9327640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba4070c70 0x7f2ba40cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2ba9b28640 1 -- 172.21.15.104:0/3544267103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba4070c70 msgr2=0x7f2ba40cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2ba9b28640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba4070c70 0x7f2ba40cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2ba9b28640 1 -- 172.21.15.104:0/3544267103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ba4157ac0 msgr2=0x7f2ba415a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2ba9b28640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ba4157ac0 0x7f2ba415a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2ba9b28640 1 -- 172.21.15.104:0/3544267103 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba40cab70 con 0x7f2ba415edf0 2024-05-08T04:22:48.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.087+0000 7f2ba8b26640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ba4157ac0 0x7f2ba415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:48.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.088+0000 7f2ba9b28640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ba415edf0 0x7f2ba415ada0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00cef0 tx=0x7f2b9c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:48.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.088+0000 7f2ba1ffb640 1 -- 172.21.15.104:0/3544267103 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c01a070 con 0x7f2ba415edf0 2024-05-08T04:22:48.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.088+0000 7f2ba1ffb640 1 -- 172.21.15.104:0/3544267103 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c00d840 con 0x7f2ba415edf0 2024-05-08T04:22:48.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.088+0000 7f2bab58b640 1 -- 172.21.15.104:0/3544267103 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba40cae50 con 0x7f2ba415edf0 2024-05-08T04:22:48.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.088+0000 7f2ba1ffb640 1 -- 172.21.15.104:0/3544267103 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c00dc30 con 0x7f2ba415edf0 2024-05-08T04:22:48.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.088+0000 7f2bab58b640 1 -- 172.21.15.104:0/3544267103 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba40cb410 con 0x7f2ba415edf0 2024-05-08T04:22:48.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.089+0000 7f2bab58b640 1 -- 172.21.15.104:0/3544267103 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba40cb610 con 0x7f2ba415edf0 2024-05-08T04:22:48.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.089+0000 7f2ba1ffb640 1 -- 172.21.15.104:0/3544267103 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f2b9c01d070 con 0x7f2ba415edf0 2024-05-08T04:22:48.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.090+0000 7f2ba1ffb640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2b9006b680 0x7f2b9006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.090+0000 7f2ba1ffb640 1 -- 172.21.15.104:0/3544267103 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b9c08ac90 con 0x7f2ba415edf0 2024-05-08T04:22:48.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.090+0000 7f2ba9327640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2b9006b680 0x7f2b9006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.090+0000 7f2ba9327640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2b9006b680 0x7f2b9006db40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2b94034000 tx=0x7f2b9402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:48.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.094+0000 7f2ba1ffb640 1 -- 172.21.15.104:0/3544267103 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2ba40cb610 con 0x7f2ba415edf0 2024-05-08T04:22:48.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.259+0000 7f2bab58b640 1 -- 172.21.15.104:0/3544267103 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ba40683d0 con 0x7f2b9006b680 2024-05-08T04:22:48.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.264+0000 7f2ba1ffb640 1 -- 172.21.15.104:0/3544267103 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237149 (secure 0 0 0) 0x7f2b9407be70 con 0x7f2b9006b680 2024-05-08T04:22:48.268 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:48.269 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:22:48.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.267+0000 7f2bab58b640 1 -- 172.21.15.104:0/3544267103 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2b9006b680 msgr2=0x7f2b9006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.267+0000 7f2bab58b640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2b9006b680 0x7f2b9006db40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2b94034000 tx=0x7f2b9402e000 comp rx=0 tx=0).stop 2024-05-08T04:22:48.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.267+0000 7f2bab58b640 1 -- 172.21.15.104:0/3544267103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ba415edf0 msgr2=0x7f2ba415ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.267+0000 7f2bab58b640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ba415edf0 0x7f2ba415ada0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00cef0 tx=0x7f2b9c00a710 comp rx=0 tx=0).stop 2024-05-08T04:22:48.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.267+0000 7f2bab58b640 1 -- 172.21.15.104:0/3544267103 shutdown_connections 2024-05-08T04:22:48.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.267+0000 7f2bab58b640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2b9006b680 0x7f2b9006db40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.267+0000 7f2bab58b640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ba4157ac0 0x7f2ba415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.267+0000 7f2bab58b640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ba415edf0 0x7f2ba415ada0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.267+0000 7f2bab58b640 1 --2- 172.21.15.104:0/3544267103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ba4070c70 0x7f2ba40cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.267+0000 7f2bab58b640 1 -- 172.21.15.104:0/3544267103 >> 172.21.15.104:0/3544267103 conn(0x7f2ba40b3450 msgr2=0x7f2ba415cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:48.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.267+0000 7f2bab58b640 1 -- 172.21.15.104:0/3544267103 shutdown_connections 2024-05-08T04:22:48.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.267+0000 7f2bab58b640 1 -- 172.21.15.104:0/3544267103 wait complete. 2024-05-08T04:22:48.280 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-05-08T04:22:46.654895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221088,"kb_used_data":4904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753632,"statfs":{"total":773094113280,"available":772867719168,"internally_reserved":0,"allocated":5021696,"data_stored":2696496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000675"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-08T04:22:41.222856+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:22:41.222856+0000","last_peered":"2024-05-08T04:22:41.222856+0000","last_clean":"2024-05-08T04:22:41.222856+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:22:41.222856+0000","last_undegraded":"2024-05-08T04:22:41.222856+0000","last_fullsized":"2024-05-08T04:22:41.222856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":779838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":779838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:22:48.283 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:22:48.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.418+0000 7f46c8ebd640 1 Processor -- start 2024-05-08T04:22:48.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.418+0000 7f46c8ebd640 1 -- start start 2024-05-08T04:22:48.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46c8ebd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f46c4070c70 0x7f46c4071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46c8ebd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f46c415edf0 0x7f46c40b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46c8ebd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c4157ac0 0x7f46c4157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46c8ebd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c406bc70 con 0x7f46c415edf0 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46c8ebd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c4071590 con 0x7f46c4070c70 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46c8ebd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40d15c0 con 0x7f46c4157ac0 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46b9d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f46c415edf0 0x7f46c40b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46b9d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f46c415edf0 0x7f46c40b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57378/0 (socket says 172.21.15.104:57378) 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46b9d9b640 1 -- 172.21.15.104:0/2677525754 learned_addr learned my addr 172.21.15.104:0/2677525754 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46c2d9d640 1 --2- 172.21.15.104:0/2677525754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c4157ac0 0x7f46c4157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46c259c640 1 --2- 172.21.15.104:0/2677525754 >> v2:172.21.15.183:3300/0 conn(0x7f46c4070c70 0x7f46c4071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46b9d9b640 1 -- 172.21.15.104:0/2677525754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c4157ac0 msgr2=0x7f46c4157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46b9d9b640 1 --2- 172.21.15.104:0/2677525754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c4157ac0 0x7f46c4157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46b9d9b640 1 -- 172.21.15.104:0/2677525754 >> v2:172.21.15.183:3300/0 conn(0x7f46c4070c70 msgr2=0x7f46c4071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:48.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46b9d9b640 1 --2- 172.21.15.104:0/2677525754 >> v2:172.21.15.183:3300/0 conn(0x7f46c4070c70 0x7f46c4071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46b9d9b640 1 -- 172.21.15.104:0/2677525754 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c415f550 con 0x7f46c415edf0 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46c2d9d640 1 --2- 172.21.15.104:0/2677525754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c4157ac0 0x7f46c4157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.419+0000 7f46c259c640 1 --2- 172.21.15.104:0/2677525754 >> v2:172.21.15.183:3300/0 conn(0x7f46c4070c70 0x7f46c4071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.420+0000 7f46b9d9b640 1 --2- 172.21.15.104:0/2677525754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c415edf0 0x7f46c40b52a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f46c4071f80 tx=0x7f46ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275674ac9cdcfc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.420+0000 7f46c1d9b640 1 -- 172.21.15.104:0/2677525754 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac037070 con 0x7f46c415edf0 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.420+0000 7f46c1d9b640 1 -- 172.21.15.104:0/2677525754 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac032440 con 0x7f46c415edf0 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.420+0000 7f46c1d9b640 1 -- 172.21.15.104:0/2677525754 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac032810 con 0x7f46c415edf0 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.421+0000 7f46c8ebd640 1 -- 172.21.15.104:0/2677525754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c415edf0 msgr2=0x7f46c40b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.421+0000 7f46c8ebd640 1 --2- 172.21.15.104:0/2677525754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c415edf0 0x7f46c40b52a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f46c4071f80 tx=0x7f46ac02a1e0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.421+0000 7f46c8ebd640 1 -- 172.21.15.104:0/2677525754 shutdown_connections 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.421+0000 7f46c8ebd640 1 --2- 172.21.15.104:0/2677525754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c4157ac0 0x7f46c4157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.421+0000 7f46c8ebd640 1 --2- 172.21.15.104:0/2677525754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c415edf0 0x7f46c40b52a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.421+0000 7f46c8ebd640 1 --2- 172.21.15.104:0/2677525754 >> v2:172.21.15.183:3300/0 conn(0x7f46c4070c70 0x7f46c4071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.421+0000 7f46c8ebd640 1 -- 172.21.15.104:0/2677525754 >> 172.21.15.104:0/2677525754 conn(0x7f46c40b3450 msgr2=0x7f46c40b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:48.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.421+0000 7f46c8ebd640 1 -- 172.21.15.104:0/2677525754 shutdown_connections 2024-05-08T04:22:48.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.421+0000 7f46c8ebd640 1 -- 172.21.15.104:0/2677525754 wait complete. 2024-05-08T04:22:48.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.422+0000 7f46c8ebd640 1 Processor -- start 2024-05-08T04:22:48.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.422+0000 7f46c8ebd640 1 -- start start 2024-05-08T04:22:48.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.423+0000 7f46c8ebd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c4070c70 0x7f46c4161530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.423+0000 7f46c8ebd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c4157ac0 0x7f46c41597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.423+0000 7f46c8ebd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c415edf0 0x7f46c4159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.423+0000 7f46c8ebd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40b5b80 con 0x7f46c415edf0 2024-05-08T04:22:48.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.423+0000 7f46c8ebd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c415fb10 con 0x7f46c4070c70 2024-05-08T04:22:48.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.423+0000 7f46c8ebd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40b57e0 con 0x7f46c4157ac0 2024-05-08T04:22:48.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.423+0000 7f46c2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c415edf0 0x7f46c4159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.423+0000 7f46c2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c415edf0 0x7f46c4159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57390/0 (socket says 172.21.15.104:57390) 2024-05-08T04:22:48.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.423+0000 7f46c2d9d640 1 -- 172.21.15.104:0/3435488672 learned_addr learned my addr 172.21.15.104:0/3435488672 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:48.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.423+0000 7f46c259c640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c4070c70 0x7f46c4161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.423+0000 7f46b9d9b640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c4157ac0 0x7f46c41597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.424+0000 7f46c2d9d640 1 -- 172.21.15.104:0/3435488672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c4157ac0 msgr2=0x7f46c41597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.424+0000 7f46c2d9d640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c4157ac0 0x7f46c41597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.424+0000 7f46c2d9d640 1 -- 172.21.15.104:0/3435488672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c4070c70 msgr2=0x7f46c4161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.424+0000 7f46c2d9d640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c4070c70 0x7f46c4161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.424+0000 7f46c2d9d640 1 -- 172.21.15.104:0/3435488672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c415a380 con 0x7f46c415edf0 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.424+0000 7f46c2d9d640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c415edf0 0x7f46c4159ce0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00cf20 tx=0x7f46bc00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.424+0000 7f46bb7fe640 1 -- 172.21.15.104:0/3435488672 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc01a070 con 0x7f46c415edf0 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.424+0000 7f46bb7fe640 1 -- 172.21.15.104:0/3435488672 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc00d840 con 0x7f46c415edf0 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.424+0000 7f46c8ebd640 1 -- 172.21.15.104:0/3435488672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c415a660 con 0x7f46c415edf0 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.424+0000 7f46bb7fe640 1 -- 172.21.15.104:0/3435488672 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc00dc30 con 0x7f46c415edf0 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.424+0000 7f46c8ebd640 1 -- 172.21.15.104:0/3435488672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c4161a70 con 0x7f46c415edf0 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.425+0000 7f46c8ebd640 1 -- 172.21.15.104:0/3435488672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c4075010 con 0x7f46c415edf0 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.425+0000 7f46bb7fe640 1 -- 172.21.15.104:0/3435488672 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f46bc01d070 con 0x7f46c415edf0 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.426+0000 7f46bb7fe640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f46a406b680 0x7f46a406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.426+0000 7f46bb7fe640 1 -- 172.21.15.104:0/3435488672 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46bc08add0 con 0x7f46c415edf0 2024-05-08T04:22:48.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.426+0000 7f46c259c640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f46a406b680 0x7f46a406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.426+0000 7f46c259c640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f46a406b680 0x7f46a406db40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f46b4006b10 tx=0x7f46b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:48.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.430+0000 7f46bb7fe640 1 -- 172.21.15.104:0/3435488672 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f46bc0599d0 con 0x7f46c415edf0 2024-05-08T04:22:48.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.600+0000 7f46c8ebd640 1 -- 172.21.15.104:0/3435488672 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46c415ab80 con 0x7f46a406b680 2024-05-08T04:22:48.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.605+0000 7f46bb7fe640 1 -- 172.21.15.104:0/3435488672 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237149 (secure 0 0 0) 0x7f46c415ab80 con 0x7f46a406b680 2024-05-08T04:22:48.609 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:48.610 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:22:48.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.608+0000 7f46c8ebd640 1 -- 172.21.15.104:0/3435488672 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f46a406b680 msgr2=0x7f46a406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.608+0000 7f46c8ebd640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f46a406b680 0x7f46a406db40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f46b4006b10 tx=0x7f46b4008040 comp rx=0 tx=0).stop 2024-05-08T04:22:48.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.608+0000 7f46c8ebd640 1 -- 172.21.15.104:0/3435488672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c415edf0 msgr2=0x7f46c4159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.608+0000 7f46c8ebd640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c415edf0 0x7f46c4159ce0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00cf20 tx=0x7f46bc00a7d0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.608+0000 7f46c8ebd640 1 -- 172.21.15.104:0/3435488672 shutdown_connections 2024-05-08T04:22:48.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.608+0000 7f46c8ebd640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f46a406b680 0x7f46a406db40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.608+0000 7f46c8ebd640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46c415edf0 0x7f46c4159ce0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.608+0000 7f46c8ebd640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c4157ac0 0x7f46c41597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.608+0000 7f46c8ebd640 1 --2- 172.21.15.104:0/3435488672 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c4070c70 0x7f46c4161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.608+0000 7f46c8ebd640 1 -- 172.21.15.104:0/3435488672 >> 172.21.15.104:0/3435488672 conn(0x7f46c40b3450 msgr2=0x7f46c415cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:48.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.609+0000 7f46c8ebd640 1 -- 172.21.15.104:0/3435488672 shutdown_connections 2024-05-08T04:22:48.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.609+0000 7f46c8ebd640 1 -- 172.21.15.104:0/3435488672 wait complete. 2024-05-08T04:22:48.621 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-05-08T04:22:46.654895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221088,"kb_used_data":4904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753632,"statfs":{"total":773094113280,"available":772867719168,"internally_reserved":0,"allocated":5021696,"data_stored":2696496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000675"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:43.952761+0000","last_change":"2024-05-08T04:22:43.952761+0000","last_active":"2024-05-08T04:22:43.952761+0000","last_peered":"2024-05-08T04:22:43.952761+0000","last_clean":"2024-05-08T04:22:43.952761+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:43.952761+0000","last_undegraded":"2024-05-08T04:22:43.952761+0000","last_fullsized":"2024-05-08T04:22:43.952761+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:22:42.948041+0000","last_change":"2024-05-08T04:22:42.948041+0000","last_active":"2024-05-08T04:22:42.948041+0000","last_peered":"2024-05-08T04:22:42.948041+0000","last_clean":"2024-05-08T04:22:42.948041+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:22:42.948041+0000","last_undegraded":"2024-05-08T04:22:42.948041+0000","last_fullsized":"2024-05-08T04:22:42.948041+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-05-08T04:22:41.222856+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:22:41.222856+0000","last_peered":"2024-05-08T04:22:41.222856+0000","last_clean":"2024-05-08T04:22:41.222856+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:22:41.222856+0000","last_undegraded":"2024-05-08T04:22:41.222856+0000","last_fullsized":"2024-05-08T04:22:41.222856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27504,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":779838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":779838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":189470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:22:48.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2024-05-08T04:22:48.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2024-05-08T04:22:48.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2024-05-08T04:22:48.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2024-05-08T04:22:48.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2024-05-08T04:22:48.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2024-05-08T04:22:48.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2024-05-08T04:22:48.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2024-05-08T04:22:48.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2024-05-08T04:22:48.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2024-05-08T04:22:48.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2024-05-08T04:22:48.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2024-05-08T04:22:48.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2024-05-08T04:22:48.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2024-05-08T04:22:48.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2024-05-08T04:22:48.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2024-05-08T04:22:48.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2024-05-08T04:22:48.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2024-05-08T04:22:48.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2024-05-08T04:22:48.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2024-05-08T04:22:48.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2024-05-08T04:22:48.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2024-05-08T04:22:48.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2024-05-08T04:22:48.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2024-05-08T04:22:48.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2024-05-08T04:22:48.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2024-05-08T04:22:48.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2024-05-08T04:22:48.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2024-05-08T04:22:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2024-05-08T04:22:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2024-05-08T04:22:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2024-05-08T04:22:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2024-05-08T04:22:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-05-08T04:22:48.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-05-08T04:22:48.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-05-08T04:22:48.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-05-08T04:22:48.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-05-08T04:22:48.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-05-08T04:22:48.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-05-08T04:22:48.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-05-08T04:22:48.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-05-08T04:22:48.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-05-08T04:22:48.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-05-08T04:22:48.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-05-08T04:22:48.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-05-08T04:22:48.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-05-08T04:22:48.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-05-08T04:22:48.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-05-08T04:22:48.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-05-08T04:22:48.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-05-08T04:22:48.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-05-08T04:22:48.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-05-08T04:22:48.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-05-08T04:22:48.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-05-08T04:22:48.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-05-08T04:22:48.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-05-08T04:22:48.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-05-08T04:22:48.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-05-08T04:22:48.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-05-08T04:22:48.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-05-08T04:22:48.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-05-08T04:22:48.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-05-08T04:22:48.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-05-08T04:22:48.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-05-08T04:22:48.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-05-08T04:22:48.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-05-08T04:22:48.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-05-08T04:22:48.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-05-08T04:22:48.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-05-08T04:22:48.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-05-08T04:22:48.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-05-08T04:22:48.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-05-08T04:22:48.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-05-08T04:22:48.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-05-08T04:22:48.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-05-08T04:22:48.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-05-08T04:22:48.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-05-08T04:22:48.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-05-08T04:22:48.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-05-08T04:22:48.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-05-08T04:22:48.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-05-08T04:22:48.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-05-08T04:22:48.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-05-08T04:22:48.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-05-08T04:22:48.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-05-08T04:22:48.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-05-08T04:22:48.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-05-08T04:22:48.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-05-08T04:22:48.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-05-08T04:22:48.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-05-08T04:22:48.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-05-08T04:22:48.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-05-08T04:22:48.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-05-08T04:22:48.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-05-08T04:22:48.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-05-08T04:22:48.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:43.952761+0000', 'last_change': '2024-05-08T04:22:43.952761+0000', 'last_active': '2024-05-08T04:22:43.952761+0000', 'last_peered': '2024-05-08T04:22:43.952761+0000', 'last_clean': '2024-05-08T04:22:43.952761+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:43.952761+0000', 'last_undegraded': '2024-05-08T04:22:43.952761+0000', 'last_fullsized': '2024-05-08T04:22:43.952761+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:43.952761+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-05-08T04:22:48.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:22:42.948041+0000', 'last_change': '2024-05-08T04:22:42.948041+0000', 'last_active': '2024-05-08T04:22:42.948041+0000', 'last_peered': '2024-05-08T04:22:42.948041+0000', 'last_clean': '2024-05-08T04:22:42.948041+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:22:42.948041+0000', 'last_undegraded': '2024-05-08T04:22:42.948041+0000', 'last_fullsized': '2024-05-08T04:22:42.948041+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'last_clean_scrub_stamp': '2024-05-08T04:22:42.948041+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:22:48.644 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-08T04:22:48.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.757+0000 7fe28beb3640 1 Processor -- start 2024-05-08T04:22:48.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.757+0000 7fe28beb3640 1 -- start start 2024-05-08T04:22:48.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.758+0000 7fe28beb3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe28406b270 0x7fe2840b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.758+0000 7fe28beb3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe2840b41a0 0x7fe2840b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.758+0000 7fe28beb3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2840b1e30 con 0x7fe28415bac0 2024-05-08T04:22:48.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.758+0000 7fe28beb3640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2840b1c00 con 0x7fe28406b270 2024-05-08T04:22:48.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.758+0000 7fe28beb3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2840b3d10 con 0x7fe2840b41a0 2024-05-08T04:22:48.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.758+0000 7fe28944e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe28406b270 0x7fe2840b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.758+0000 7fe28944e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe28406b270 0x7fe2840b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57406/0 (socket says 172.21.15.104:57406) 2024-05-08T04:22:48.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.758+0000 7fe28944e640 1 -- 172.21.15.104:0/1619582718 learned_addr learned my addr 172.21.15.104:0/1619582718 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:48.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.758+0000 7fe28a450640 1 --2- 172.21.15.104:0/1619582718 >> v2:172.21.15.183:3300/0 conn(0x7fe2840b41a0 0x7fe2840b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.758+0000 7fe28944e640 1 -- 172.21.15.104:0/1619582718 >> v2:172.21.15.183:3300/0 conn(0x7fe2840b41a0 msgr2=0x7fe2840b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:48.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.758+0000 7fe28944e640 1 --2- 172.21.15.104:0/1619582718 >> v2:172.21.15.183:3300/0 conn(0x7fe2840b41a0 0x7fe2840b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.758+0000 7fe28944e640 1 -- 172.21.15.104:0/1619582718 >> v1:172.21.15.183:6789/0 conn(0x7fe28415bac0 legacy=0x7fe28406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.759+0000 7fe28944e640 1 -- 172.21.15.104:0/1619582718 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2840b36c0 con 0x7fe28406b270 2024-05-08T04:22:48.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.759+0000 7fe28944e640 1 --2- 172.21.15.104:0/1619582718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28406b270 0x7fe2840b16c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe284073040 tx=0x7fe27402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7378e8d8404fa3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:48.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.759+0000 7fe288c4d640 1 -- 172.21.15.104:0/1619582718 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274037070 con 0x7fe28406b270 2024-05-08T04:22:48.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.759+0000 7fe288c4d640 1 -- 172.21.15.104:0/1619582718 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe274032440 con 0x7fe28406b270 2024-05-08T04:22:48.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.759+0000 7fe288c4d640 1 -- 172.21.15.104:0/1619582718 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274032810 con 0x7fe28406b270 2024-05-08T04:22:48.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.760+0000 7fe28beb3640 1 -- 172.21.15.104:0/1619582718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28406b270 msgr2=0x7fe2840b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.760+0000 7fe28beb3640 1 --2- 172.21.15.104:0/1619582718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28406b270 0x7fe2840b16c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe284073040 tx=0x7fe27402a1e0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.760+0000 7fe28beb3640 1 -- 172.21.15.104:0/1619582718 shutdown_connections 2024-05-08T04:22:48.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.760+0000 7fe28beb3640 1 --2- 172.21.15.104:0/1619582718 >> v2:172.21.15.183:3300/0 conn(0x7fe2840b41a0 0x7fe2840b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.760+0000 7fe28beb3640 1 --2- 172.21.15.104:0/1619582718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28406b270 0x7fe2840b16c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.760+0000 7fe28beb3640 1 -- 172.21.15.104:0/1619582718 >> 172.21.15.104:0/1619582718 conn(0x7fe2840b2220 msgr2=0x7fe2840b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:48.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.760+0000 7fe28beb3640 1 -- 172.21.15.104:0/1619582718 shutdown_connections 2024-05-08T04:22:48.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.760+0000 7fe28beb3640 1 -- 172.21.15.104:0/1619582718 wait complete. 2024-05-08T04:22:48.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.761+0000 7fe28beb3640 1 Processor -- start 2024-05-08T04:22:48.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.761+0000 7fe28beb3640 1 -- start start 2024-05-08T04:22:48.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe28beb3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28406b270 0x7fe2840c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe28beb3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2840b41a0 0x7fe2841479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe28beb3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe28415bac0 0x7fe2841f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe28beb3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28415bea0 con 0x7fe28406b270 2024-05-08T04:22:48.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe28beb3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840c3f00 con 0x7fe2840b41a0 2024-05-08T04:22:48.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe28beb3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28415c020 con 0x7fe28415bac0 2024-05-08T04:22:48.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe289c4f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28406b270 0x7fe2840c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe289c4f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28406b270 0x7fe2840c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57422/0 (socket says 172.21.15.104:57422) 2024-05-08T04:22:48.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe289c4f640 1 -- 172.21.15.104:0/1503199157 learned_addr learned my addr 172.21.15.104:0/1503199157 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:48.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe289c4f640 1 -- 172.21.15.104:0/1503199157 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe28415bac0 msgr2=0x7fe2841f0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe289c4f640 1 --2- 172.21.15.104:0/1503199157 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe28415bac0 0x7fe2841f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe289c4f640 1 -- 172.21.15.104:0/1503199157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2840b41a0 msgr2=0x7fe2841479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:48.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe289c4f640 1 --2- 172.21.15.104:0/1503199157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2840b41a0 0x7fe2841479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:48.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe289c4f640 1 -- 172.21.15.104:0/1503199157 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe284147f10 con 0x7fe28406b270 2024-05-08T04:22:48.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.762+0000 7fe289c4f640 1 --2- 172.21.15.104:0/1503199157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28406b270 0x7fe2840c87b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c3f0 tx=0x7fe28000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:48.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.763+0000 7fe27a7fc640 1 -- 172.21.15.104:0/1503199157 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2800052d0 con 0x7fe28406b270 2024-05-08T04:22:48.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.763+0000 7fe27a7fc640 1 -- 172.21.15.104:0/1503199157 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe280005490 con 0x7fe28406b270 2024-05-08T04:22:48.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.763+0000 7fe27a7fc640 1 -- 172.21.15.104:0/1503199157 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280007260 con 0x7fe28406b270 2024-05-08T04:22:48.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.763+0000 7fe28beb3640 1 -- 172.21.15.104:0/1503199157 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2840c8d90 con 0x7fe28406b270 2024-05-08T04:22:48.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.763+0000 7fe28beb3640 1 -- 172.21.15.104:0/1503199157 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2840c9350 con 0x7fe28406b270 2024-05-08T04:22:48.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.764+0000 7fe28beb3640 1 -- 172.21.15.104:0/1503199157 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe284075010 con 0x7fe28406b270 2024-05-08T04:22:48.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.764+0000 7fe27a7fc640 1 -- 172.21.15.104:0/1503199157 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fe280007400 con 0x7fe28406b270 2024-05-08T04:22:48.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.764+0000 7fe27a7fc640 1 --2- 172.21.15.104:0/1503199157 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe26806b680 0x7fe26806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:48.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.765+0000 7fe27a7fc640 1 -- 172.21.15.104:0/1503199157 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe280089a70 con 0x7fe28406b270 2024-05-08T04:22:48.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.765+0000 7fe28944e640 1 --2- 172.21.15.104:0/1503199157 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe26806b680 0x7fe26806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:48.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.765+0000 7fe28944e640 1 --2- 172.21.15.104:0/1503199157 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe26806b680 0x7fe26806db40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe274034000 tx=0x7fe27402c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:48.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:48.769+0000 7fe27a7fc640 1 -- 172.21.15.104:0/1503199157 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe2800585f0 con 0x7fe28406b270 2024-05-08T04:22:49.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.005+0000 7fe28beb3640 1 -- 172.21.15.104:0/1503199157 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe28406d240 con 0x7fe28406b270 2024-05-08T04:22:49.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.005+0000 7fe27a7fc640 1 -- 172.21.15.104:0/1503199157 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1432 (secure 0 0 0) 0x7fe280057ef0 con 0x7fe28406b270 2024-05-08T04:22:49.007 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:49.007 INFO:teuthology.orchestra.run.smithi104.stdout:{"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":122,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1715142057,"num_in_osds":8,"osd_in_since":1715142048,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":226795520,"bytes_avail":772867317760,"bytes_total":773094113280,"write_bytes_sec":2514,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":21,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5742}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-05-08T04:22:34.652840+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-08T04:22:49.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.007+0000 7fe28beb3640 1 -- 172.21.15.104:0/1503199157 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe26806b680 msgr2=0x7fe26806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:49.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.007+0000 7fe28beb3640 1 --2- 172.21.15.104:0/1503199157 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe26806b680 0x7fe26806db40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe274034000 tx=0x7fe27402c000 comp rx=0 tx=0).stop 2024-05-08T04:22:49.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.007+0000 7fe28beb3640 1 -- 172.21.15.104:0/1503199157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28406b270 msgr2=0x7fe2840c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:49.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.007+0000 7fe28beb3640 1 --2- 172.21.15.104:0/1503199157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28406b270 0x7fe2840c87b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c3f0 tx=0x7fe28000c8b0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.007+0000 7fe28beb3640 1 -- 172.21.15.104:0/1503199157 shutdown_connections 2024-05-08T04:22:49.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.007+0000 7fe28beb3640 1 --2- 172.21.15.104:0/1503199157 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe26806b680 0x7fe26806db40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.007+0000 7fe28beb3640 1 --2- 172.21.15.104:0/1503199157 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2840b41a0 0x7fe2841479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.007+0000 7fe28beb3640 1 --2- 172.21.15.104:0/1503199157 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe28415bac0 0x7fe2841f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.007+0000 7fe28beb3640 1 --2- 172.21.15.104:0/1503199157 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28406b270 0x7fe2840c87b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.007+0000 7fe28beb3640 1 -- 172.21.15.104:0/1503199157 >> 172.21.15.104:0/1503199157 conn(0x7fe2840b2220 msgr2=0x7fe2841597a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:49.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.007+0000 7fe28beb3640 1 -- 172.21.15.104:0/1503199157 shutdown_connections 2024-05-08T04:22:49.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.007+0000 7fe28beb3640 1 -- 172.21.15.104:0/1503199157 wait complete. 2024-05-08T04:22:49.019 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-08T04:22:49.019 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:22:49.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.118+0000 7fc9cd0dd640 1 Processor -- start 2024-05-08T04:22:49.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.118+0000 7fc9cd0dd640 1 -- start start 2024-05-08T04:22:49.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.119+0000 7fc9cd0dd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc9c80b2b80 0x7fc9c809a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:49.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.119+0000 7fc9cd0dd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9c8099ea0 0x7fc9c815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:49.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.119+0000 7fc9cd0dd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c80cd940 con 0x7fc9c8099a40 2024-05-08T04:22:49.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.119+0000 7fc9cd0dd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c80cc8a0 con 0x7fc9c80b2b80 2024-05-08T04:22:49.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.119+0000 7fc9cd0dd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80ccb80 con 0x7fc9c8099ea0 2024-05-08T04:22:49.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.119+0000 7fc9c6d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc9c80b2b80 0x7fc9c809a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:49.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.119+0000 7fc9c6d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc9c80b2b80 0x7fc9c809a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57426/0 (socket says 172.21.15.104:57426) 2024-05-08T04:22:49.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.119+0000 7fc9c6d9d640 1 -- 172.21.15.104:0/317157429 learned_addr learned my addr 172.21.15.104:0/317157429 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:49.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.119+0000 7fc9c6d9d640 1 -- 172.21.15.104:0/317157429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9c8099ea0 msgr2=0x7fc9c815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:49.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.119+0000 7fc9c6d9d640 1 --2- 172.21.15.104:0/317157429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9c8099ea0 0x7fc9c815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.119+0000 7fc9c6d9d640 1 -- 172.21.15.104:0/317157429 >> v1:172.21.15.183:6789/0 conn(0x7fc9c8099a40 legacy=0x7fc9c815d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:49.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.119+0000 7fc9c6d9d640 1 -- 172.21.15.104:0/317157429 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c80cce60 con 0x7fc9c80b2b80 2024-05-08T04:22:49.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.120+0000 7fc9c6d9d640 1 --2- 172.21.15.104:0/317157429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c80b2b80 0x7fc9c809a9b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009870 tx=0x7fc9b802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c916fb00e33b49b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:49.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.120+0000 7fc9c5d9b640 1 -- 172.21.15.104:0/317157429 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8037070 con 0x7fc9c80b2b80 2024-05-08T04:22:49.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.120+0000 7fc9c5d9b640 1 -- 172.21.15.104:0/317157429 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8032440 con 0x7fc9c80b2b80 2024-05-08T04:22:49.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.120+0000 7fc9c5d9b640 1 -- 172.21.15.104:0/317157429 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8032810 con 0x7fc9c80b2b80 2024-05-08T04:22:49.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.121+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/317157429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c80b2b80 msgr2=0x7fc9c809a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:49.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.121+0000 7fc9cd0dd640 1 --2- 172.21.15.104:0/317157429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c80b2b80 0x7fc9c809a9b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009870 tx=0x7fc9b802a2a0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.121+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/317157429 shutdown_connections 2024-05-08T04:22:49.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.121+0000 7fc9cd0dd640 1 --2- 172.21.15.104:0/317157429 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9c8099ea0 0x7fc9c815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.121+0000 7fc9cd0dd640 1 --2- 172.21.15.104:0/317157429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c80b2b80 0x7fc9c809a9b0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.121+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/317157429 >> 172.21.15.104:0/317157429 conn(0x7fc9c80b3310 msgr2=0x7fc9c80b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:49.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.121+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/317157429 shutdown_connections 2024-05-08T04:22:49.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.121+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/317157429 wait complete. 2024-05-08T04:22:49.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.122+0000 7fc9cd0dd640 1 Processor -- start 2024-05-08T04:22:49.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.122+0000 7fc9cd0dd640 1 -- start start 2024-05-08T04:22:49.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.123+0000 7fc9cd0dd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9c8099a40 0x7fc9c814ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:49.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.123+0000 7fc9cd0dd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9c8099ea0 0x7fc9c80c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:49.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.123+0000 7fc9cd0dd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c80b2b80 0x7fc9c8161a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:49.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.123+0000 7fc9cd0dd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c809aef0 con 0x7fc9c80b2b80 2024-05-08T04:22:49.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.123+0000 7fc9cd0dd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c809a330 con 0x7fc9c8099ea0 2024-05-08T04:22:49.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.123+0000 7fc9cd0dd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c815e0e0 con 0x7fc9c8099a40 2024-05-08T04:22:49.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.123+0000 7fc9c759e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c80b2b80 0x7fc9c8161a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:49.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.123+0000 7fc9c759e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c80b2b80 0x7fc9c8161a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57442/0 (socket says 172.21.15.104:57442) 2024-05-08T04:22:49.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.123+0000 7fc9c759e640 1 -- 172.21.15.104:0/1749947348 learned_addr learned my addr 172.21.15.104:0/1749947348 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:49.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.123+0000 7fc9c6d9d640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9c8099a40 0x7fc9c814ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:49.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.123+0000 7fc9c659c640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9c8099ea0 0x7fc9c80c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:49.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.124+0000 7fc9c759e640 1 -- 172.21.15.104:0/1749947348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9c8099a40 msgr2=0x7fc9c814ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:49.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.124+0000 7fc9c759e640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9c8099a40 0x7fc9c814ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.124+0000 7fc9c759e640 1 -- 172.21.15.104:0/1749947348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9c8099ea0 msgr2=0x7fc9c80c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:49.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.124+0000 7fc9c759e640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9c8099ea0 0x7fc9c80c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.124+0000 7fc9c759e640 1 -- 172.21.15.104:0/1749947348 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c814bf70 con 0x7fc9c80b2b80 2024-05-08T04:22:49.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.124+0000 7fc9c759e640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c80b2b80 0x7fc9c8161a70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000b970 tx=0x7fc9c000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:49.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.124+0000 7fc9af7fe640 1 -- 172.21.15.104:0/1749947348 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0019070 con 0x7fc9c80b2b80 2024-05-08T04:22:49.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.124+0000 7fc9af7fe640 1 -- 172.21.15.104:0/1749947348 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c000cb60 con 0x7fc9c80b2b80 2024-05-08T04:22:49.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.124+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/1749947348 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c81f3eb0 con 0x7fc9c80b2b80 2024-05-08T04:22:49.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.124+0000 7fc9af7fe640 1 -- 172.21.15.104:0/1749947348 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0014440 con 0x7fc9c80b2b80 2024-05-08T04:22:49.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.124+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/1749947348 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c81495a0 con 0x7fc9c80b2b80 2024-05-08T04:22:49.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.125+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/1749947348 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c80b79a0 con 0x7fc9c80b2b80 2024-05-08T04:22:49.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.125+0000 7fc9af7fe640 1 -- 172.21.15.104:0/1749947348 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fc9c001c070 con 0x7fc9c80b2b80 2024-05-08T04:22:49.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.126+0000 7fc9af7fe640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc9b406b680 0x7fc9b406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:49.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.126+0000 7fc9c6d9d640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc9b406b680 0x7fc9b406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:49.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.126+0000 7fc9af7fe640 1 -- 172.21.15.104:0/1749947348 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9c008a0f0 con 0x7fc9c80b2b80 2024-05-08T04:22:49.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.126+0000 7fc9c6d9d640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc9b406b680 0x7fc9b406db40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8034000 tx=0x7fc9b802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:49.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.130+0000 7fc9af7fe640 1 -- 172.21.15.104:0/1749947348 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc9c80b79a0 con 0x7fc9c80b2b80 2024-05-08T04:22:49.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.297+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/1749947348 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9c8075010 con 0x7fc9b406b680 2024-05-08T04:22:49.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.303+0000 7fc9af7fe640 1 -- 172.21.15.104:0/1749947348 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251958 (secure 0 0 0) 0x7fc9c8075010 con 0x7fc9b406b680 2024-05-08T04:22:49.307 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:49.308 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:22:49.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.306+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/1749947348 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc9b406b680 msgr2=0x7fc9b406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:49.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.306+0000 7fc9cd0dd640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc9b406b680 0x7fc9b406db40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8034000 tx=0x7fc9b802e000 comp rx=0 tx=0).stop 2024-05-08T04:22:49.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.306+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/1749947348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c80b2b80 msgr2=0x7fc9c8161a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:49.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.306+0000 7fc9cd0dd640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c80b2b80 0x7fc9c8161a70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000b970 tx=0x7fc9c000be30 comp rx=0 tx=0).stop 2024-05-08T04:22:49.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.307+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/1749947348 shutdown_connections 2024-05-08T04:22:49.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.307+0000 7fc9cd0dd640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc9b406b680 0x7fc9b406db40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.307+0000 7fc9cd0dd640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9c8099ea0 0x7fc9c80c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.307+0000 7fc9cd0dd640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9c80b2b80 0x7fc9c8161a70 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.307+0000 7fc9cd0dd640 1 --2- 172.21.15.104:0/1749947348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9c8099a40 0x7fc9c814ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:49.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.307+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/1749947348 >> 172.21.15.104:0/1749947348 conn(0x7fc9c80b3310 msgr2=0x7fc9c80b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:49.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.307+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/1749947348 shutdown_connections 2024-05-08T04:22:49.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:49.307+0000 7fc9cd0dd640 1 -- 172.21.15.104:0/1749947348 wait complete. 2024-05-08T04:22:49.319 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-05-08T04:22:48.655243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221480,"kb_used_data":5304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753240,"statfs":{"total":773094113280,"available":772867317760,"internally_reserved":0,"allocated":5431296,"data_stored":2877452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.702067"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196811+0000","last_change":"2024-05-08T04:22:44.987361+0000","last_active":"2024-05-08T04:22:47.196811+0000","last_peered":"2024-05-08T04:22:47.196811+0000","last_clean":"2024-05-08T04:22:47.196811+0000","last_became_active":"2024-05-08T04:22:44.986955+0000","last_became_peered":"2024-05-08T04:22:44.986955+0000","last_unstale":"2024-05-08T04:22:47.196811+0000","last_undegraded":"2024-05-08T04:22:47.196811+0000","last_fullsized":"2024-05-08T04:22:47.196811+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:38:17.919167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001816+0000","last_change":"2024-05-08T04:22:44.995452+0000","last_active":"2024-05-08T04:22:47.001816+0000","last_peered":"2024-05-08T04:22:47.001816+0000","last_clean":"2024-05-08T04:22:47.001816+0000","last_became_active":"2024-05-08T04:22:44.995186+0000","last_became_peered":"2024-05-08T04:22:44.995186+0000","last_unstale":"2024-05-08T04:22:47.001816+0000","last_undegraded":"2024-05-08T04:22:47.001816+0000","last_fullsized":"2024-05-08T04:22:47.001816+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:10.304193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573304+0000","last_change":"2024-05-08T04:22:44.994674+0000","last_active":"2024-05-08T04:22:46.573304+0000","last_peered":"2024-05-08T04:22:46.573304+0000","last_clean":"2024-05-08T04:22:46.573304+0000","last_became_active":"2024-05-08T04:22:44.994262+0000","last_became_peered":"2024-05-08T04:22:44.994262+0000","last_unstale":"2024-05-08T04:22:46.573304+0000","last_undegraded":"2024-05-08T04:22:46.573304+0000","last_fullsized":"2024-05-08T04:22:46.573304+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:14:34.562109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.985019+0000","last_change":"2024-05-08T04:22:44.990852+0000","last_active":"2024-05-08T04:22:45.985019+0000","last_peered":"2024-05-08T04:22:45.985019+0000","last_clean":"2024-05-08T04:22:45.985019+0000","last_became_active":"2024-05-08T04:22:44.990378+0000","last_became_peered":"2024-05-08T04:22:44.990378+0000","last_unstale":"2024-05-08T04:22:45.985019+0000","last_undegraded":"2024-05-08T04:22:45.985019+0000","last_fullsized":"2024-05-08T04:22:45.985019+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:08.775682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196558+0000","last_change":"2024-05-08T04:22:44.985609+0000","last_active":"2024-05-08T04:22:47.196558+0000","last_peered":"2024-05-08T04:22:47.196558+0000","last_clean":"2024-05-08T04:22:47.196558+0000","last_became_active":"2024-05-08T04:22:44.985353+0000","last_became_peered":"2024-05-08T04:22:44.985353+0000","last_unstale":"2024-05-08T04:22:47.196558+0000","last_undegraded":"2024-05-08T04:22:47.196558+0000","last_fullsized":"2024-05-08T04:22:47.196558+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:10.304193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984333+0000","last_change":"2024-05-08T04:22:44.988873+0000","last_active":"2024-05-08T04:22:45.984333+0000","last_peered":"2024-05-08T04:22:45.984333+0000","last_clean":"2024-05-08T04:22:45.984333+0000","last_became_active":"2024-05-08T04:22:44.988553+0000","last_became_peered":"2024-05-08T04:22:44.988553+0000","last_unstale":"2024-05-08T04:22:45.984333+0000","last_undegraded":"2024-05-08T04:22:45.984333+0000","last_fullsized":"2024-05-08T04:22:45.984333+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:24:05.528494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.990890+0000","last_change":"2024-05-08T04:22:44.990877+0000","last_active":"2024-05-08T04:22:45.990890+0000","last_peered":"2024-05-08T04:22:45.990890+0000","last_clean":"2024-05-08T04:22:45.990890+0000","last_became_active":"2024-05-08T04:22:44.990592+0000","last_became_peered":"2024-05-08T04:22:44.990592+0000","last_unstale":"2024-05-08T04:22:45.990890+0000","last_undegraded":"2024-05-08T04:22:45.990890+0000","last_fullsized":"2024-05-08T04:22:45.990890+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:13:39.163441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984499+0000","last_change":"2024-05-08T04:22:44.991975+0000","last_active":"2024-05-08T04:22:45.984499+0000","last_peered":"2024-05-08T04:22:45.984499+0000","last_clean":"2024-05-08T04:22:45.984499+0000","last_became_active":"2024-05-08T04:22:44.990605+0000","last_became_peered":"2024-05-08T04:22:44.990605+0000","last_unstale":"2024-05-08T04:22:45.984499+0000","last_undegraded":"2024-05-08T04:22:45.984499+0000","last_fullsized":"2024-05-08T04:22:45.984499+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:40.446741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984917+0000","last_change":"2024-05-08T04:22:44.998040+0000","last_active":"2024-05-08T04:22:45.984917+0000","last_peered":"2024-05-08T04:22:45.984917+0000","last_clean":"2024-05-08T04:22:45.984917+0000","last_became_active":"2024-05-08T04:22:44.997744+0000","last_became_peered":"2024-05-08T04:22:44.997744+0000","last_unstale":"2024-05-08T04:22:45.984917+0000","last_undegraded":"2024-05-08T04:22:45.984917+0000","last_fullsized":"2024-05-08T04:22:45.984917+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:36.325431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940976+0000","last_change":"2024-05-08T04:22:44.986856+0000","last_active":"2024-05-08T04:22:46.940976+0000","last_peered":"2024-05-08T04:22:46.940976+0000","last_clean":"2024-05-08T04:22:46.940976+0000","last_became_active":"2024-05-08T04:22:44.986519+0000","last_became_peered":"2024-05-08T04:22:44.986519+0000","last_unstale":"2024-05-08T04:22:46.940976+0000","last_undegraded":"2024-05-08T04:22:46.940976+0000","last_fullsized":"2024-05-08T04:22:46.940976+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:40:54.030238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984657+0000","last_change":"2024-05-08T04:22:44.988580+0000","last_active":"2024-05-08T04:22:45.984657+0000","last_peered":"2024-05-08T04:22:45.984657+0000","last_clean":"2024-05-08T04:22:45.984657+0000","last_became_active":"2024-05-08T04:22:44.988302+0000","last_became_peered":"2024-05-08T04:22:44.988302+0000","last_unstale":"2024-05-08T04:22:45.984657+0000","last_undegraded":"2024-05-08T04:22:45.984657+0000","last_fullsized":"2024-05-08T04:22:45.984657+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:49:30.952952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001885+0000","last_change":"2024-05-08T04:22:44.986511+0000","last_active":"2024-05-08T04:22:47.001885+0000","last_peered":"2024-05-08T04:22:47.001885+0000","last_clean":"2024-05-08T04:22:47.001885+0000","last_became_active":"2024-05-08T04:22:44.986244+0000","last_became_peered":"2024-05-08T04:22:44.986244+0000","last_unstale":"2024-05-08T04:22:47.001885+0000","last_undegraded":"2024-05-08T04:22:47.001885+0000","last_fullsized":"2024-05-08T04:22:47.001885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:40.446741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984523+0000","last_change":"2024-05-08T04:22:44.996047+0000","last_active":"2024-05-08T04:22:45.984523+0000","last_peered":"2024-05-08T04:22:45.984523+0000","last_clean":"2024-05-08T04:22:45.984523+0000","last_became_active":"2024-05-08T04:22:44.995781+0000","last_became_peered":"2024-05-08T04:22:44.995781+0000","last_unstale":"2024-05-08T04:22:45.984523+0000","last_undegraded":"2024-05-08T04:22:45.984523+0000","last_fullsized":"2024-05-08T04:22:45.984523+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:28:44.823621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984618+0000","last_change":"2024-05-08T04:22:44.995283+0000","last_active":"2024-05-08T04:22:45.984618+0000","last_peered":"2024-05-08T04:22:45.984618+0000","last_clean":"2024-05-08T04:22:45.984618+0000","last_became_active":"2024-05-08T04:22:44.994953+0000","last_became_peered":"2024-05-08T04:22:44.994953+0000","last_unstale":"2024-05-08T04:22:45.984618+0000","last_undegraded":"2024-05-08T04:22:45.984618+0000","last_fullsized":"2024-05-08T04:22:45.984618+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:09:01.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984577+0000","last_change":"2024-05-08T04:22:44.996382+0000","last_active":"2024-05-08T04:22:45.984577+0000","last_peered":"2024-05-08T04:22:45.984577+0000","last_clean":"2024-05-08T04:22:45.984577+0000","last_became_active":"2024-05-08T04:22:44.996142+0000","last_became_peered":"2024-05-08T04:22:44.996142+0000","last_unstale":"2024-05-08T04:22:45.984577+0000","last_undegraded":"2024-05-08T04:22:45.984577+0000","last_fullsized":"2024-05-08T04:22:45.984577+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:38:17.919167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196416+0000","last_change":"2024-05-08T04:22:44.993651+0000","last_active":"2024-05-08T04:22:47.196416+0000","last_peered":"2024-05-08T04:22:47.196416+0000","last_clean":"2024-05-08T04:22:47.196416+0000","last_became_active":"2024-05-08T04:22:44.993373+0000","last_became_peered":"2024-05-08T04:22:44.993373+0000","last_unstale":"2024-05-08T04:22:47.196416+0000","last_undegraded":"2024-05-08T04:22:47.196416+0000","last_fullsized":"2024-05-08T04:22:47.196416+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:31:36.813477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001931+0000","last_change":"2024-05-08T04:22:44.983395+0000","last_active":"2024-05-08T04:22:47.001931+0000","last_peered":"2024-05-08T04:22:47.001931+0000","last_clean":"2024-05-08T04:22:47.001931+0000","last_became_active":"2024-05-08T04:22:44.983133+0000","last_became_peered":"2024-05-08T04:22:44.983133+0000","last_unstale":"2024-05-08T04:22:47.001931+0000","last_undegraded":"2024-05-08T04:22:47.001931+0000","last_fullsized":"2024-05-08T04:22:47.001931+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:53.095389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573425+0000","last_change":"2024-05-08T04:22:44.991580+0000","last_active":"2024-05-08T04:22:46.573425+0000","last_peered":"2024-05-08T04:22:46.573425+0000","last_clean":"2024-05-08T04:22:46.573425+0000","last_became_active":"2024-05-08T04:22:44.991257+0000","last_became_peered":"2024-05-08T04:22:44.991257+0000","last_unstale":"2024-05-08T04:22:46.573425+0000","last_undegraded":"2024-05-08T04:22:46.573425+0000","last_fullsized":"2024-05-08T04:22:46.573425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:21:12.231732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196702+0000","last_change":"2024-05-08T04:22:44.984923+0000","last_active":"2024-05-08T04:22:47.196702+0000","last_peered":"2024-05-08T04:22:47.196702+0000","last_clean":"2024-05-08T04:22:47.196702+0000","last_became_active":"2024-05-08T04:22:44.984655+0000","last_became_peered":"2024-05-08T04:22:44.984655+0000","last_unstale":"2024-05-08T04:22:47.196702+0000","last_undegraded":"2024-05-08T04:22:47.196702+0000","last_fullsized":"2024-05-08T04:22:47.196702+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:53.095389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940973+0000","last_change":"2024-05-08T04:22:44.992204+0000","last_active":"2024-05-08T04:22:46.940973+0000","last_peered":"2024-05-08T04:22:46.940973+0000","last_clean":"2024-05-08T04:22:46.940973+0000","last_became_active":"2024-05-08T04:22:44.991626+0000","last_became_peered":"2024-05-08T04:22:44.991626+0000","last_unstale":"2024-05-08T04:22:46.940973+0000","last_undegraded":"2024-05-08T04:22:46.940973+0000","last_fullsized":"2024-05-08T04:22:46.940973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:07:24.316437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984516+0000","last_change":"2024-05-08T04:22:44.990836+0000","last_active":"2024-05-08T04:22:45.984516+0000","last_peered":"2024-05-08T04:22:45.984516+0000","last_clean":"2024-05-08T04:22:45.984516+0000","last_became_active":"2024-05-08T04:22:44.990534+0000","last_became_peered":"2024-05-08T04:22:44.990534+0000","last_unstale":"2024-05-08T04:22:45.984516+0000","last_undegraded":"2024-05-08T04:22:45.984516+0000","last_fullsized":"2024-05-08T04:22:45.984516+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:53.095389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196843+0000","last_change":"2024-05-08T04:22:44.978867+0000","last_active":"2024-05-08T04:22:47.196843+0000","last_peered":"2024-05-08T04:22:47.196843+0000","last_clean":"2024-05-08T04:22:47.196843+0000","last_became_active":"2024-05-08T04:22:44.978538+0000","last_became_peered":"2024-05-08T04:22:44.978538+0000","last_unstale":"2024-05-08T04:22:47.196843+0000","last_undegraded":"2024-05-08T04:22:47.196843+0000","last_fullsized":"2024-05-08T04:22:47.196843+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:59:23.614912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991112+0000","last_change":"2024-05-08T04:22:44.981470+0000","last_active":"2024-05-08T04:22:45.991112+0000","last_peered":"2024-05-08T04:22:45.991112+0000","last_clean":"2024-05-08T04:22:45.991112+0000","last_became_active":"2024-05-08T04:22:44.981217+0000","last_became_peered":"2024-05-08T04:22:44.981217+0000","last_unstale":"2024-05-08T04:22:45.991112+0000","last_undegraded":"2024-05-08T04:22:45.991112+0000","last_fullsized":"2024-05-08T04:22:45.991112+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:05:14.503516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001468+0000","last_change":"2024-05-08T04:22:44.996013+0000","last_active":"2024-05-08T04:22:47.001468+0000","last_peered":"2024-05-08T04:22:47.001468+0000","last_clean":"2024-05-08T04:22:47.001468+0000","last_became_active":"2024-05-08T04:22:44.995732+0000","last_became_peered":"2024-05-08T04:22:44.995732+0000","last_unstale":"2024-05-08T04:22:47.001468+0000","last_undegraded":"2024-05-08T04:22:47.001468+0000","last_fullsized":"2024-05-08T04:22:47.001468+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:52:57.841064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196820+0000","last_change":"2024-05-08T04:22:44.986329+0000","last_active":"2024-05-08T04:22:47.196820+0000","last_peered":"2024-05-08T04:22:47.196820+0000","last_clean":"2024-05-08T04:22:47.196820+0000","last_became_active":"2024-05-08T04:22:44.986079+0000","last_became_peered":"2024-05-08T04:22:44.986079+0000","last_unstale":"2024-05-08T04:22:47.196820+0000","last_undegraded":"2024-05-08T04:22:47.196820+0000","last_fullsized":"2024-05-08T04:22:47.196820+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:09:01.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.985265+0000","last_change":"2024-05-08T04:22:44.986867+0000","last_active":"2024-05-08T04:22:45.985265+0000","last_peered":"2024-05-08T04:22:45.985265+0000","last_clean":"2024-05-08T04:22:45.985265+0000","last_became_active":"2024-05-08T04:22:44.986608+0000","last_became_peered":"2024-05-08T04:22:44.986608+0000","last_unstale":"2024-05-08T04:22:45.985265+0000","last_undegraded":"2024-05-08T04:22:45.985265+0000","last_fullsized":"2024-05-08T04:22:45.985265+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:52:49.182169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991488+0000","last_change":"2024-05-08T04:22:44.981198+0000","last_active":"2024-05-08T04:22:45.991488+0000","last_peered":"2024-05-08T04:22:45.991488+0000","last_clean":"2024-05-08T04:22:45.991488+0000","last_became_active":"2024-05-08T04:22:44.980756+0000","last_became_peered":"2024-05-08T04:22:44.980756+0000","last_unstale":"2024-05-08T04:22:45.991488+0000","last_undegraded":"2024-05-08T04:22:45.991488+0000","last_fullsized":"2024-05-08T04:22:45.991488+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:39:03.370126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991465+0000","last_change":"2024-05-08T04:22:44.982728+0000","last_active":"2024-05-08T04:22:45.991465+0000","last_peered":"2024-05-08T04:22:45.991465+0000","last_clean":"2024-05-08T04:22:45.991465+0000","last_became_active":"2024-05-08T04:22:44.982470+0000","last_became_peered":"2024-05-08T04:22:44.982470+0000","last_unstale":"2024-05-08T04:22:45.991465+0000","last_undegraded":"2024-05-08T04:22:45.991465+0000","last_fullsized":"2024-05-08T04:22:45.991465+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:25.082385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196638+0000","last_change":"2024-05-08T04:22:44.998725+0000","last_active":"2024-05-08T04:22:47.196638+0000","last_peered":"2024-05-08T04:22:47.196638+0000","last_clean":"2024-05-08T04:22:47.196638+0000","last_became_active":"2024-05-08T04:22:44.998462+0000","last_became_peered":"2024-05-08T04:22:44.998462+0000","last_unstale":"2024-05-08T04:22:47.196638+0000","last_undegraded":"2024-05-08T04:22:47.196638+0000","last_fullsized":"2024-05-08T04:22:47.196638+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:40.446741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001505+0000","last_change":"2024-05-08T04:22:44.980340+0000","last_active":"2024-05-08T04:22:47.001505+0000","last_peered":"2024-05-08T04:22:47.001505+0000","last_clean":"2024-05-08T04:22:47.001505+0000","last_became_active":"2024-05-08T04:22:44.980132+0000","last_became_peered":"2024-05-08T04:22:44.980132+0000","last_unstale":"2024-05-08T04:22:47.001505+0000","last_undegraded":"2024-05-08T04:22:47.001505+0000","last_fullsized":"2024-05-08T04:22:47.001505+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:53:33.659528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984574+0000","last_change":"2024-05-08T04:22:44.982252+0000","last_active":"2024-05-08T04:22:45.984574+0000","last_peered":"2024-05-08T04:22:45.984574+0000","last_clean":"2024-05-08T04:22:45.984574+0000","last_became_active":"2024-05-08T04:22:44.981974+0000","last_became_peered":"2024-05-08T04:22:44.981974+0000","last_unstale":"2024-05-08T04:22:45.984574+0000","last_undegraded":"2024-05-08T04:22:45.984574+0000","last_fullsized":"2024-05-08T04:22:45.984574+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:52:57.841064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984761+0000","last_change":"2024-05-08T04:22:44.987803+0000","last_active":"2024-05-08T04:22:45.984761+0000","last_peered":"2024-05-08T04:22:45.984761+0000","last_clean":"2024-05-08T04:22:45.984761+0000","last_became_active":"2024-05-08T04:22:44.987517+0000","last_became_peered":"2024-05-08T04:22:44.987517+0000","last_unstale":"2024-05-08T04:22:45.984761+0000","last_undegraded":"2024-05-08T04:22:45.984761+0000","last_fullsized":"2024-05-08T04:22:45.984761+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:38:40.496711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.197018+0000","last_change":"2024-05-08T04:22:44.988707+0000","last_active":"2024-05-08T04:22:47.197018+0000","last_peered":"2024-05-08T04:22:47.197018+0000","last_clean":"2024-05-08T04:22:47.197018+0000","last_became_active":"2024-05-08T04:22:44.988466+0000","last_became_peered":"2024-05-08T04:22:44.988466+0000","last_unstale":"2024-05-08T04:22:47.197018+0000","last_undegraded":"2024-05-08T04:22:47.197018+0000","last_fullsized":"2024-05-08T04:22:47.197018+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:14:34.562109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984971+0000","last_change":"2024-05-08T04:22:43.974798+0000","last_active":"2024-05-08T04:22:45.984971+0000","last_peered":"2024-05-08T04:22:45.984971+0000","last_clean":"2024-05-08T04:22:45.984971+0000","last_became_active":"2024-05-08T04:22:43.974422+0000","last_became_peered":"2024-05-08T04:22:43.974422+0000","last_unstale":"2024-05-08T04:22:45.984971+0000","last_undegraded":"2024-05-08T04:22:45.984971+0000","last_fullsized":"2024-05-08T04:22:45.984971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:38:11.143153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196897+0000","last_change":"2024-05-08T04:22:44.984208+0000","last_active":"2024-05-08T04:22:47.196897+0000","last_peered":"2024-05-08T04:22:47.196897+0000","last_clean":"2024-05-08T04:22:47.196897+0000","last_became_active":"2024-05-08T04:22:44.983949+0000","last_became_peered":"2024-05-08T04:22:44.983949+0000","last_unstale":"2024-05-08T04:22:47.196897+0000","last_undegraded":"2024-05-08T04:22:47.196897+0000","last_fullsized":"2024-05-08T04:22:47.196897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:49:30.952952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991041+0000","last_change":"2024-05-08T04:22:43.974074+0000","last_active":"2024-05-08T04:22:45.991041+0000","last_peered":"2024-05-08T04:22:45.991041+0000","last_clean":"2024-05-08T04:22:45.991041+0000","last_became_active":"2024-05-08T04:22:43.973807+0000","last_became_peered":"2024-05-08T04:22:43.973807+0000","last_unstale":"2024-05-08T04:22:45.991041+0000","last_undegraded":"2024-05-08T04:22:45.991041+0000","last_fullsized":"2024-05-08T04:22:45.991041+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:52:48.177449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001959+0000","last_change":"2024-05-08T04:22:44.996706+0000","last_active":"2024-05-08T04:22:47.001959+0000","last_peered":"2024-05-08T04:22:47.001959+0000","last_clean":"2024-05-08T04:22:47.001959+0000","last_became_active":"2024-05-08T04:22:44.995860+0000","last_became_peered":"2024-05-08T04:22:44.995860+0000","last_unstale":"2024-05-08T04:22:47.001959+0000","last_undegraded":"2024-05-08T04:22:47.001959+0000","last_fullsized":"2024-05-08T04:22:47.001959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:38:17.919167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984825+0000","last_change":"2024-05-08T04:22:43.974142+0000","last_active":"2024-05-08T04:22:45.984825+0000","last_peered":"2024-05-08T04:22:45.984825+0000","last_clean":"2024-05-08T04:22:45.984825+0000","last_became_active":"2024-05-08T04:22:43.973844+0000","last_became_peered":"2024-05-08T04:22:43.973844+0000","last_unstale":"2024-05-08T04:22:45.984825+0000","last_undegraded":"2024-05-08T04:22:45.984825+0000","last_fullsized":"2024-05-08T04:22:45.984825+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:09:40.728019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984839+0000","last_change":"2024-05-08T04:22:44.991302+0000","last_active":"2024-05-08T04:22:45.984839+0000","last_peered":"2024-05-08T04:22:45.984839+0000","last_clean":"2024-05-08T04:22:45.984839+0000","last_became_active":"2024-05-08T04:22:44.990927+0000","last_became_peered":"2024-05-08T04:22:44.990927+0000","last_unstale":"2024-05-08T04:22:45.984839+0000","last_undegraded":"2024-05-08T04:22:45.984839+0000","last_fullsized":"2024-05-08T04:22:45.984839+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:45:41.156316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991352+0000","last_change":"2024-05-08T04:22:43.974792+0000","last_active":"2024-05-08T04:22:45.991352+0000","last_peered":"2024-05-08T04:22:45.991352+0000","last_clean":"2024-05-08T04:22:45.991352+0000","last_became_active":"2024-05-08T04:22:43.974520+0000","last_became_peered":"2024-05-08T04:22:43.974520+0000","last_unstale":"2024-05-08T04:22:45.991352+0000","last_undegraded":"2024-05-08T04:22:45.991352+0000","last_fullsized":"2024-05-08T04:22:45.991352+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:21:16.372426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991156+0000","last_change":"2024-05-08T04:22:44.980190+0000","last_active":"2024-05-08T04:22:45.991156+0000","last_peered":"2024-05-08T04:22:45.991156+0000","last_clean":"2024-05-08T04:22:45.991156+0000","last_became_active":"2024-05-08T04:22:44.979716+0000","last_became_peered":"2024-05-08T04:22:44.979716+0000","last_unstale":"2024-05-08T04:22:45.991156+0000","last_undegraded":"2024-05-08T04:22:45.991156+0000","last_fullsized":"2024-05-08T04:22:45.991156+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:41:58.730953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984778+0000","last_change":"2024-05-08T04:22:43.970137+0000","last_active":"2024-05-08T04:22:45.984778+0000","last_peered":"2024-05-08T04:22:45.984778+0000","last_clean":"2024-05-08T04:22:45.984778+0000","last_became_active":"2024-05-08T04:22:43.969385+0000","last_became_peered":"2024-05-08T04:22:43.969385+0000","last_unstale":"2024-05-08T04:22:45.984778+0000","last_undegraded":"2024-05-08T04:22:45.984778+0000","last_fullsized":"2024-05-08T04:22:45.984778+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:04:31.898222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940698+0000","last_change":"2024-05-08T04:22:44.994499+0000","last_active":"2024-05-08T04:22:46.940698+0000","last_peered":"2024-05-08T04:22:46.940698+0000","last_clean":"2024-05-08T04:22:46.940698+0000","last_became_active":"2024-05-08T04:22:44.994207+0000","last_became_peered":"2024-05-08T04:22:44.994207+0000","last_unstale":"2024-05-08T04:22:46.940698+0000","last_undegraded":"2024-05-08T04:22:46.940698+0000","last_fullsized":"2024-05-08T04:22:46.940698+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:52:49.182169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.990940+0000","last_change":"2024-05-08T04:22:43.971542+0000","last_active":"2024-05-08T04:22:45.990940+0000","last_peered":"2024-05-08T04:22:45.990940+0000","last_clean":"2024-05-08T04:22:45.990940+0000","last_became_active":"2024-05-08T04:22:43.971257+0000","last_became_peered":"2024-05-08T04:22:43.971257+0000","last_unstale":"2024-05-08T04:22:45.990940+0000","last_undegraded":"2024-05-08T04:22:45.990940+0000","last_fullsized":"2024-05-08T04:22:45.990940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:58:31.155457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940911+0000","last_change":"2024-05-08T04:22:44.991884+0000","last_active":"2024-05-08T04:22:46.940911+0000","last_peered":"2024-05-08T04:22:46.940911+0000","last_clean":"2024-05-08T04:22:46.940911+0000","last_became_active":"2024-05-08T04:22:44.991555+0000","last_became_peered":"2024-05-08T04:22:44.991555+0000","last_unstale":"2024-05-08T04:22:46.940911+0000","last_undegraded":"2024-05-08T04:22:46.940911+0000","last_fullsized":"2024-05-08T04:22:46.940911+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:25:25.835126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196442+0000","last_change":"2024-05-08T04:22:43.967471+0000","last_active":"2024-05-08T04:22:47.196442+0000","last_peered":"2024-05-08T04:22:47.196442+0000","last_clean":"2024-05-08T04:22:47.196442+0000","last_became_active":"2024-05-08T04:22:43.966802+0000","last_became_peered":"2024-05-08T04:22:43.966802+0000","last_unstale":"2024-05-08T04:22:47.196442+0000","last_undegraded":"2024-05-08T04:22:47.196442+0000","last_fullsized":"2024-05-08T04:22:47.196442+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:18:00.134055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991113+0000","last_change":"2024-05-08T04:22:44.984949+0000","last_active":"2024-05-08T04:22:45.991113+0000","last_peered":"2024-05-08T04:22:45.991113+0000","last_clean":"2024-05-08T04:22:45.991113+0000","last_became_active":"2024-05-08T04:22:44.984214+0000","last_became_peered":"2024-05-08T04:22:44.984214+0000","last_unstale":"2024-05-08T04:22:45.991113+0000","last_undegraded":"2024-05-08T04:22:45.991113+0000","last_fullsized":"2024-05-08T04:22:45.991113+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:11:09.024186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940781+0000","last_change":"2024-05-08T04:22:43.973607+0000","last_active":"2024-05-08T04:22:46.940781+0000","last_peered":"2024-05-08T04:22:46.940781+0000","last_clean":"2024-05-08T04:22:46.940781+0000","last_became_active":"2024-05-08T04:22:43.973308+0000","last_became_peered":"2024-05-08T04:22:43.973308+0000","last_unstale":"2024-05-08T04:22:46.940781+0000","last_undegraded":"2024-05-08T04:22:46.940781+0000","last_fullsized":"2024-05-08T04:22:46.940781+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:52.090669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573461+0000","last_change":"2024-05-08T04:22:44.976925+0000","last_active":"2024-05-08T04:22:46.573461+0000","last_peered":"2024-05-08T04:22:46.573461+0000","last_clean":"2024-05-08T04:22:46.573461+0000","last_became_active":"2024-05-08T04:22:44.976657+0000","last_became_peered":"2024-05-08T04:22:44.976657+0000","last_unstale":"2024-05-08T04:22:46.573461+0000","last_undegraded":"2024-05-08T04:22:46.573461+0000","last_fullsized":"2024-05-08T04:22:46.573461+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:35:34.956623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573414+0000","last_change":"2024-05-08T04:22:43.973699+0000","last_active":"2024-05-08T04:22:46.573414+0000","last_peered":"2024-05-08T04:22:46.573414+0000","last_clean":"2024-05-08T04:22:46.573414+0000","last_became_active":"2024-05-08T04:22:43.973370+0000","last_became_peered":"2024-05-08T04:22:43.973370+0000","last_unstale":"2024-05-08T04:22:46.573414+0000","last_undegraded":"2024-05-08T04:22:46.573414+0000","last_fullsized":"2024-05-08T04:22:46.573414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:05.212660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573462+0000","last_change":"2024-05-08T04:22:44.984023+0000","last_active":"2024-05-08T04:22:46.573462+0000","last_peered":"2024-05-08T04:22:46.573462+0000","last_clean":"2024-05-08T04:22:46.573462+0000","last_became_active":"2024-05-08T04:22:44.983751+0000","last_became_peered":"2024-05-08T04:22:44.983751+0000","last_unstale":"2024-05-08T04:22:46.573462+0000","last_undegraded":"2024-05-08T04:22:46.573462+0000","last_fullsized":"2024-05-08T04:22:46.573462+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:06:01.713558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940957+0000","last_change":"2024-05-08T04:22:43.974858+0000","last_active":"2024-05-08T04:22:46.940957+0000","last_peered":"2024-05-08T04:22:46.940957+0000","last_clean":"2024-05-08T04:22:46.940957+0000","last_became_active":"2024-05-08T04:22:43.974550+0000","last_became_peered":"2024-05-08T04:22:43.974550+0000","last_unstale":"2024-05-08T04:22:46.940957+0000","last_undegraded":"2024-05-08T04:22:46.940957+0000","last_fullsized":"2024-05-08T04:22:46.940957+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:35.320711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.985184+0000","last_change":"2024-05-08T04:22:44.993785+0000","last_active":"2024-05-08T04:22:45.985184+0000","last_peered":"2024-05-08T04:22:45.985184+0000","last_clean":"2024-05-08T04:22:45.985184+0000","last_became_active":"2024-05-08T04:22:44.993516+0000","last_became_peered":"2024-05-08T04:22:44.993516+0000","last_unstale":"2024-05-08T04:22:45.985184+0000","last_undegraded":"2024-05-08T04:22:45.985184+0000","last_fullsized":"2024-05-08T04:22:45.985184+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:58:32.160177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001670+0000","last_change":"2024-05-08T04:22:43.972987+0000","last_active":"2024-05-08T04:22:47.001670+0000","last_peered":"2024-05-08T04:22:47.001670+0000","last_clean":"2024-05-08T04:22:47.001670+0000","last_became_active":"2024-05-08T04:22:43.972696+0000","last_became_peered":"2024-05-08T04:22:43.972696+0000","last_unstale":"2024-05-08T04:22:47.001670+0000","last_undegraded":"2024-05-08T04:22:47.001670+0000","last_fullsized":"2024-05-08T04:22:47.001670+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:38:11.143153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991240+0000","last_change":"2024-05-08T04:22:44.993901+0000","last_active":"2024-05-08T04:22:45.991240+0000","last_peered":"2024-05-08T04:22:45.991240+0000","last_clean":"2024-05-08T04:22:45.991240+0000","last_became_active":"2024-05-08T04:22:44.993351+0000","last_became_peered":"2024-05-08T04:22:44.993351+0000","last_unstale":"2024-05-08T04:22:45.991240+0000","last_undegraded":"2024-05-08T04:22:45.991240+0000","last_fullsized":"2024-05-08T04:22:45.991240+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:06.876165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.941109+0000","last_change":"2024-05-08T04:22:43.972873+0000","last_active":"2024-05-08T04:22:46.941109+0000","last_peered":"2024-05-08T04:22:46.941109+0000","last_clean":"2024-05-08T04:22:46.941109+0000","last_became_active":"2024-05-08T04:22:43.972581+0000","last_became_peered":"2024-05-08T04:22:43.972581+0000","last_unstale":"2024-05-08T04:22:46.941109+0000","last_undegraded":"2024-05-08T04:22:46.941109+0000","last_fullsized":"2024-05-08T04:22:46.941109+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:09.299473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573251+0000","last_change":"2024-05-08T04:22:44.991457+0000","last_active":"2024-05-08T04:22:46.573251+0000","last_peered":"2024-05-08T04:22:46.573251+0000","last_clean":"2024-05-08T04:22:46.573251+0000","last_became_active":"2024-05-08T04:22:44.991196+0000","last_became_peered":"2024-05-08T04:22:44.991196+0000","last_unstale":"2024-05-08T04:22:46.573251+0000","last_undegraded":"2024-05-08T04:22:46.573251+0000","last_fullsized":"2024-05-08T04:22:46.573251+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:59:23.614912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196849+0000","last_change":"2024-05-08T04:22:43.968981+0000","last_active":"2024-05-08T04:22:47.196849+0000","last_peered":"2024-05-08T04:22:47.196849+0000","last_clean":"2024-05-08T04:22:47.196849+0000","last_became_active":"2024-05-08T04:22:43.968698+0000","last_became_peered":"2024-05-08T04:22:43.968698+0000","last_unstale":"2024-05-08T04:22:47.196849+0000","last_undegraded":"2024-05-08T04:22:47.196849+0000","last_fullsized":"2024-05-08T04:22:47.196849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:52:11.079075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196790+0000","last_change":"2024-05-08T04:22:44.981723+0000","last_active":"2024-05-08T04:22:47.196790+0000","last_peered":"2024-05-08T04:22:47.196790+0000","last_clean":"2024-05-08T04:22:47.196790+0000","last_became_active":"2024-05-08T04:22:44.981466+0000","last_became_peered":"2024-05-08T04:22:44.981466+0000","last_unstale":"2024-05-08T04:22:47.196790+0000","last_undegraded":"2024-05-08T04:22:47.196790+0000","last_fullsized":"2024-05-08T04:22:47.196790+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:23:06.530306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196420+0000","last_change":"2024-05-08T04:22:43.969461+0000","last_active":"2024-05-08T04:22:47.196420+0000","last_peered":"2024-05-08T04:22:47.196420+0000","last_clean":"2024-05-08T04:22:47.196420+0000","last_became_active":"2024-05-08T04:22:43.969199+0000","last_became_peered":"2024-05-08T04:22:43.969199+0000","last_unstale":"2024-05-08T04:22:47.196420+0000","last_undegraded":"2024-05-08T04:22:47.196420+0000","last_fullsized":"2024-05-08T04:22:47.196420+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:04:31.898222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196772+0000","last_change":"2024-05-08T04:22:44.998151+0000","last_active":"2024-05-08T04:22:47.196772+0000","last_peered":"2024-05-08T04:22:47.196772+0000","last_clean":"2024-05-08T04:22:47.196772+0000","last_became_active":"2024-05-08T04:22:44.997851+0000","last_became_peered":"2024-05-08T04:22:44.997851+0000","last_unstale":"2024-05-08T04:22:47.196772+0000","last_undegraded":"2024-05-08T04:22:47.196772+0000","last_fullsized":"2024-05-08T04:22:47.196772+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:41:21.810324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984115+0000","last_change":"2024-05-08T04:22:43.968133+0000","last_active":"2024-05-08T04:22:45.984115+0000","last_peered":"2024-05-08T04:22:45.984115+0000","last_clean":"2024-05-08T04:22:45.984115+0000","last_became_active":"2024-05-08T04:22:43.967676+0000","last_became_peered":"2024-05-08T04:22:43.967676+0000","last_unstale":"2024-05-08T04:22:45.984115+0000","last_undegraded":"2024-05-08T04:22:45.984115+0000","last_fullsized":"2024-05-08T04:22:45.984115+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:49:36.623010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001517+0000","last_change":"2024-05-08T04:22:44.983914+0000","last_active":"2024-05-08T04:22:47.001517+0000","last_peered":"2024-05-08T04:22:47.001517+0000","last_clean":"2024-05-08T04:22:47.001517+0000","last_became_active":"2024-05-08T04:22:44.983651+0000","last_became_peered":"2024-05-08T04:22:44.983651+0000","last_unstale":"2024-05-08T04:22:47.001517+0000","last_undegraded":"2024-05-08T04:22:47.001517+0000","last_fullsized":"2024-05-08T04:22:47.001517+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:36.325431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940947+0000","last_change":"2024-05-08T04:22:43.974590+0000","last_active":"2024-05-08T04:22:46.940947+0000","last_peered":"2024-05-08T04:22:46.940947+0000","last_clean":"2024-05-08T04:22:46.940947+0000","last_became_active":"2024-05-08T04:22:43.974047+0000","last_became_peered":"2024-05-08T04:22:43.974047+0000","last_unstale":"2024-05-08T04:22:46.940947+0000","last_undegraded":"2024-05-08T04:22:46.940947+0000","last_fullsized":"2024-05-08T04:22:46.940947+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:39.442021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.197021+0000","last_change":"2024-05-08T04:22:44.979517+0000","last_active":"2024-05-08T04:22:47.197021+0000","last_peered":"2024-05-08T04:22:47.197021+0000","last_clean":"2024-05-08T04:22:47.197021+0000","last_became_active":"2024-05-08T04:22:44.979236+0000","last_became_peered":"2024-05-08T04:22:44.979236+0000","last_unstale":"2024-05-08T04:22:47.197021+0000","last_undegraded":"2024-05-08T04:22:47.197021+0000","last_fullsized":"2024-05-08T04:22:47.197021+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:21:12.231732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.985299+0000","last_change":"2024-05-08T04:22:43.969497+0000","last_active":"2024-05-08T04:22:45.985299+0000","last_peered":"2024-05-08T04:22:45.985299+0000","last_clean":"2024-05-08T04:22:45.985299+0000","last_became_active":"2024-05-08T04:22:43.969213+0000","last_became_peered":"2024-05-08T04:22:43.969213+0000","last_unstale":"2024-05-08T04:22:45.985299+0000","last_undegraded":"2024-05-08T04:22:45.985299+0000","last_fullsized":"2024-05-08T04:22:45.985299+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:11.143038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.197078+0000","last_change":"2024-05-08T04:22:44.988091+0000","last_active":"2024-05-08T04:22:47.197078+0000","last_peered":"2024-05-08T04:22:47.197078+0000","last_clean":"2024-05-08T04:22:47.197078+0000","last_became_active":"2024-05-08T04:22:44.987826+0000","last_became_peered":"2024-05-08T04:22:44.987826+0000","last_unstale":"2024-05-08T04:22:47.197078+0000","last_undegraded":"2024-05-08T04:22:47.197078+0000","last_fullsized":"2024-05-08T04:22:47.197078+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:35:34.956623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573524+0000","last_change":"2024-05-08T04:22:43.967333+0000","last_active":"2024-05-08T04:22:46.573524+0000","last_peered":"2024-05-08T04:22:46.573524+0000","last_clean":"2024-05-08T04:22:46.573524+0000","last_became_active":"2024-05-08T04:22:43.967048+0000","last_became_peered":"2024-05-08T04:22:43.967048+0000","last_unstale":"2024-05-08T04:22:46.573524+0000","last_undegraded":"2024-05-08T04:22:46.573524+0000","last_fullsized":"2024-05-08T04:22:46.573524+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:44:54.653856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.002012+0000","last_change":"2024-05-08T04:22:44.995178+0000","last_active":"2024-05-08T04:22:47.002012+0000","last_peered":"2024-05-08T04:22:47.002012+0000","last_clean":"2024-05-08T04:22:47.002012+0000","last_became_active":"2024-05-08T04:22:44.994926+0000","last_became_peered":"2024-05-08T04:22:44.994926+0000","last_unstale":"2024-05-08T04:22:47.002012+0000","last_undegraded":"2024-05-08T04:22:47.002012+0000","last_fullsized":"2024-05-08T04:22:47.002012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:09:01.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573445+0000","last_change":"2024-05-08T04:22:43.970143+0000","last_active":"2024-05-08T04:22:46.573445+0000","last_peered":"2024-05-08T04:22:46.573445+0000","last_clean":"2024-05-08T04:22:46.573445+0000","last_became_active":"2024-05-08T04:22:43.969851+0000","last_became_peered":"2024-05-08T04:22:43.969851+0000","last_unstale":"2024-05-08T04:22:46.573445+0000","last_undegraded":"2024-05-08T04:22:46.573445+0000","last_fullsized":"2024-05-08T04:22:46.573445+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:52:11.079075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573458+0000","last_change":"2024-05-08T04:22:44.994700+0000","last_active":"2024-05-08T04:22:46.573458+0000","last_peered":"2024-05-08T04:22:46.573458+0000","last_clean":"2024-05-08T04:22:46.573458+0000","last_became_active":"2024-05-08T04:22:44.994235+0000","last_became_peered":"2024-05-08T04:22:44.994235+0000","last_unstale":"2024-05-08T04:22:46.573458+0000","last_undegraded":"2024-05-08T04:22:46.573458+0000","last_fullsized":"2024-05-08T04:22:46.573458+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:34:11.572630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984456+0000","last_change":"2024-05-08T04:22:43.970499+0000","last_active":"2024-05-08T04:22:45.984456+0000","last_peered":"2024-05-08T04:22:45.984456+0000","last_clean":"2024-05-08T04:22:45.984456+0000","last_became_active":"2024-05-08T04:22:43.970159+0000","last_became_peered":"2024-05-08T04:22:43.970159+0000","last_unstale":"2024-05-08T04:22:45.984456+0000","last_undegraded":"2024-05-08T04:22:45.984456+0000","last_fullsized":"2024-05-08T04:22:45.984456+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:25:38.426542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940954+0000","last_change":"2024-05-08T04:22:44.989057+0000","last_active":"2024-05-08T04:22:46.940954+0000","last_peered":"2024-05-08T04:22:46.940954+0000","last_clean":"2024-05-08T04:22:46.940954+0000","last_became_active":"2024-05-08T04:22:44.987461+0000","last_became_peered":"2024-05-08T04:22:44.987461+0000","last_unstale":"2024-05-08T04:22:46.940954+0000","last_undegraded":"2024-05-08T04:22:46.940954+0000","last_fullsized":"2024-05-08T04:22:46.940954+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:21:17.377146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940709+0000","last_change":"2024-05-08T04:22:43.974854+0000","last_active":"2024-05-08T04:22:46.940709+0000","last_peered":"2024-05-08T04:22:46.940709+0000","last_clean":"2024-05-08T04:22:46.940709+0000","last_became_active":"2024-05-08T04:22:43.974525+0000","last_became_peered":"2024-05-08T04:22:43.974525+0000","last_unstale":"2024-05-08T04:22:46.940709+0000","last_undegraded":"2024-05-08T04:22:46.940709+0000","last_fullsized":"2024-05-08T04:22:46.940709+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:31:35.808757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984674+0000","last_change":"2024-05-08T04:22:44.984641+0000","last_active":"2024-05-08T04:22:45.984674+0000","last_peered":"2024-05-08T04:22:45.984674+0000","last_clean":"2024-05-08T04:22:45.984674+0000","last_became_active":"2024-05-08T04:22:44.984345+0000","last_became_peered":"2024-05-08T04:22:44.984345+0000","last_unstale":"2024-05-08T04:22:45.984674+0000","last_undegraded":"2024-05-08T04:22:45.984674+0000","last_fullsized":"2024-05-08T04:22:45.984674+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:53:33.659528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196520+0000","last_change":"2024-05-08T04:22:43.973387+0000","last_active":"2024-05-08T04:22:47.196520+0000","last_peered":"2024-05-08T04:22:47.196520+0000","last_clean":"2024-05-08T04:22:47.196520+0000","last_became_active":"2024-05-08T04:22:43.973140+0000","last_became_peered":"2024-05-08T04:22:43.973140+0000","last_unstale":"2024-05-08T04:22:47.196520+0000","last_undegraded":"2024-05-08T04:22:47.196520+0000","last_fullsized":"2024-05-08T04:22:47.196520+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:25:38.426542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984909+0000","last_change":"2024-05-08T04:22:44.992912+0000","last_active":"2024-05-08T04:22:45.984909+0000","last_peered":"2024-05-08T04:22:45.984909+0000","last_clean":"2024-05-08T04:22:45.984909+0000","last_became_active":"2024-05-08T04:22:44.992642+0000","last_became_peered":"2024-05-08T04:22:44.992642+0000","last_unstale":"2024-05-08T04:22:45.984909+0000","last_undegraded":"2024-05-08T04:22:45.984909+0000","last_fullsized":"2024-05-08T04:22:45.984909+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:41:21.562300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940493+0000","last_change":"2024-05-08T04:22:43.973316+0000","last_active":"2024-05-08T04:22:46.940493+0000","last_peered":"2024-05-08T04:22:46.940493+0000","last_clean":"2024-05-08T04:22:46.940493+0000","last_became_active":"2024-05-08T04:22:43.972974+0000","last_became_peered":"2024-05-08T04:22:43.972974+0000","last_unstale":"2024-05-08T04:22:46.940493+0000","last_undegraded":"2024-05-08T04:22:46.940493+0000","last_fullsized":"2024-05-08T04:22:46.940493+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:53:32.654808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984280+0000","last_change":"2024-05-08T04:22:44.994561+0000","last_active":"2024-05-08T04:22:45.984280+0000","last_peered":"2024-05-08T04:22:45.984280+0000","last_clean":"2024-05-08T04:22:45.984280+0000","last_became_active":"2024-05-08T04:22:44.993963+0000","last_became_peered":"2024-05-08T04:22:44.993963+0000","last_unstale":"2024-05-08T04:22:45.984280+0000","last_undegraded":"2024-05-08T04:22:45.984280+0000","last_fullsized":"2024-05-08T04:22:45.984280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:31:36.813477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.990821+0000","last_change":"2024-05-08T04:22:43.972082+0000","last_active":"2024-05-08T04:22:45.990821+0000","last_peered":"2024-05-08T04:22:45.990821+0000","last_clean":"2024-05-08T04:22:45.990821+0000","last_became_active":"2024-05-08T04:22:43.971827+0000","last_became_peered":"2024-05-08T04:22:43.971827+0000","last_unstale":"2024-05-08T04:22:45.990821+0000","last_undegraded":"2024-05-08T04:22:45.990821+0000","last_fullsized":"2024-05-08T04:22:45.990821+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:07.770962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991114+0000","last_change":"2024-05-08T04:22:44.985704+0000","last_active":"2024-05-08T04:22:45.991114+0000","last_peered":"2024-05-08T04:22:45.991114+0000","last_clean":"2024-05-08T04:22:45.991114+0000","last_became_active":"2024-05-08T04:22:44.985437+0000","last_became_peered":"2024-05-08T04:22:44.985437+0000","last_unstale":"2024-05-08T04:22:45.991114+0000","last_undegraded":"2024-05-08T04:22:45.991114+0000","last_fullsized":"2024-05-08T04:22:45.991114+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:43:53.051724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.990292+0000","last_change":"2024-05-08T04:22:43.966768+0000","last_active":"2024-05-08T04:22:45.990292+0000","last_peered":"2024-05-08T04:22:45.990292+0000","last_clean":"2024-05-08T04:22:45.990292+0000","last_became_active":"2024-05-08T04:22:43.966226+0000","last_became_peered":"2024-05-08T04:22:43.966226+0000","last_unstale":"2024-05-08T04:22:45.990292+0000","last_undegraded":"2024-05-08T04:22:45.990292+0000","last_fullsized":"2024-05-08T04:22:45.990292+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:09:40.728019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.941057+0000","last_change":"2024-05-08T04:22:44.991982+0000","last_active":"2024-05-08T04:22:46.941057+0000","last_peered":"2024-05-08T04:22:46.941057+0000","last_clean":"2024-05-08T04:22:46.941057+0000","last_became_active":"2024-05-08T04:22:44.991318+0000","last_became_peered":"2024-05-08T04:22:44.991318+0000","last_unstale":"2024-05-08T04:22:46.941057+0000","last_undegraded":"2024-05-08T04:22:46.941057+0000","last_fullsized":"2024-05-08T04:22:46.941057+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:03:06.327347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196655+0000","last_change":"2024-05-08T04:22:43.973250+0000","last_active":"2024-05-08T04:22:47.196655+0000","last_peered":"2024-05-08T04:22:47.196655+0000","last_clean":"2024-05-08T04:22:47.196655+0000","last_became_active":"2024-05-08T04:22:43.972990+0000","last_became_peered":"2024-05-08T04:22:43.972990+0000","last_unstale":"2024-05-08T04:22:47.196655+0000","last_undegraded":"2024-05-08T04:22:47.196655+0000","last_fullsized":"2024-05-08T04:22:47.196655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:11.647149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991394+0000","last_change":"2024-05-08T04:22:44.993667+0000","last_active":"2024-05-08T04:22:45.991394+0000","last_peered":"2024-05-08T04:22:45.991394+0000","last_clean":"2024-05-08T04:22:45.991394+0000","last_became_active":"2024-05-08T04:22:44.993271+0000","last_became_peered":"2024-05-08T04:22:44.993271+0000","last_unstale":"2024-05-08T04:22:45.991394+0000","last_undegraded":"2024-05-08T04:22:45.991394+0000","last_fullsized":"2024-05-08T04:22:45.991394+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:52:45.912439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196918+0000","last_change":"2024-05-08T04:22:43.975942+0000","last_active":"2024-05-08T04:22:47.196918+0000","last_peered":"2024-05-08T04:22:47.196918+0000","last_clean":"2024-05-08T04:22:47.196918+0000","last_became_active":"2024-05-08T04:22:43.975656+0000","last_became_peered":"2024-05-08T04:22:43.975656+0000","last_unstale":"2024-05-08T04:22:47.196918+0000","last_undegraded":"2024-05-08T04:22:47.196918+0000","last_fullsized":"2024-05-08T04:22:47.196918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:44:54.653856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940764+0000","last_change":"2024-05-08T04:22:44.987182+0000","last_active":"2024-05-08T04:22:46.940764+0000","last_peered":"2024-05-08T04:22:46.940764+0000","last_clean":"2024-05-08T04:22:46.940764+0000","last_became_active":"2024-05-08T04:22:44.986452+0000","last_became_peered":"2024-05-08T04:22:44.986452+0000","last_unstale":"2024-05-08T04:22:46.940764+0000","last_undegraded":"2024-05-08T04:22:46.940764+0000","last_fullsized":"2024-05-08T04:22:46.940764+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:20:26.536479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196655+0000","last_change":"2024-05-08T04:22:43.972376+0000","last_active":"2024-05-08T04:22:47.196655+0000","last_peered":"2024-05-08T04:22:47.196655+0000","last_clean":"2024-05-08T04:22:47.196655+0000","last_became_active":"2024-05-08T04:22:43.966772+0000","last_became_peered":"2024-05-08T04:22:43.966772+0000","last_unstale":"2024-05-08T04:22:47.196655+0000","last_undegraded":"2024-05-08T04:22:47.196655+0000","last_fullsized":"2024-05-08T04:22:47.196655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:11:08.497799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984308+0000","last_change":"2024-05-08T04:22:44.991448+0000","last_active":"2024-05-08T04:22:45.984308+0000","last_peered":"2024-05-08T04:22:45.984308+0000","last_clean":"2024-05-08T04:22:45.984308+0000","last_became_active":"2024-05-08T04:22:44.991012+0000","last_became_peered":"2024-05-08T04:22:44.991012+0000","last_unstale":"2024-05-08T04:22:45.984308+0000","last_undegraded":"2024-05-08T04:22:45.984308+0000","last_fullsized":"2024-05-08T04:22:45.984308+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:10.304193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991032+0000","last_change":"2024-05-08T04:22:43.974773+0000","last_active":"2024-05-08T04:22:45.991032+0000","last_peered":"2024-05-08T04:22:45.991032+0000","last_clean":"2024-05-08T04:22:45.991032+0000","last_became_active":"2024-05-08T04:22:43.974487+0000","last_became_peered":"2024-05-08T04:22:43.974487+0000","last_unstale":"2024-05-08T04:22:45.991032+0000","last_undegraded":"2024-05-08T04:22:45.991032+0000","last_fullsized":"2024-05-08T04:22:45.991032+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:20:25.531759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573135+0000","last_change":"2024-05-08T04:22:44.994207+0000","last_active":"2024-05-08T04:22:46.573135+0000","last_peered":"2024-05-08T04:22:46.573135+0000","last_clean":"2024-05-08T04:22:46.573135+0000","last_became_active":"2024-05-08T04:22:44.993975+0000","last_became_peered":"2024-05-08T04:22:44.993975+0000","last_unstale":"2024-05-08T04:22:46.573135+0000","last_undegraded":"2024-05-08T04:22:46.573135+0000","last_fullsized":"2024-05-08T04:22:46.573135+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:23:06.530306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984205+0000","last_change":"2024-05-08T04:22:43.974034+0000","last_active":"2024-05-08T04:22:45.984205+0000","last_peered":"2024-05-08T04:22:45.984205+0000","last_clean":"2024-05-08T04:22:45.984205+0000","last_became_active":"2024-05-08T04:22:43.973741+0000","last_became_peered":"2024-05-08T04:22:43.973741+0000","last_unstale":"2024-05-08T04:22:45.984205+0000","last_undegraded":"2024-05-08T04:22:45.984205+0000","last_fullsized":"2024-05-08T04:22:45.984205+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:11.143038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001700+0000","last_change":"2024-05-08T04:22:44.982846+0000","last_active":"2024-05-08T04:22:47.001700+0000","last_peered":"2024-05-08T04:22:47.001700+0000","last_clean":"2024-05-08T04:22:47.001700+0000","last_became_active":"2024-05-08T04:22:44.982571+0000","last_became_peered":"2024-05-08T04:22:44.982571+0000","last_unstale":"2024-05-08T04:22:47.001700+0000","last_undegraded":"2024-05-08T04:22:47.001700+0000","last_fullsized":"2024-05-08T04:22:47.001700+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:31:36.813477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196751+0000","last_change":"2024-05-08T04:22:43.973680+0000","last_active":"2024-05-08T04:22:47.196751+0000","last_peered":"2024-05-08T04:22:47.196751+0000","last_clean":"2024-05-08T04:22:47.196751+0000","last_became_active":"2024-05-08T04:22:43.973353+0000","last_became_peered":"2024-05-08T04:22:43.973353+0000","last_unstale":"2024-05-08T04:22:47.196751+0000","last_undegraded":"2024-05-08T04:22:47.196751+0000","last_fullsized":"2024-05-08T04:22:47.196751+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:05.212660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.985270+0000","last_change":"2024-05-08T04:22:44.988776+0000","last_active":"2024-05-08T04:22:45.985270+0000","last_peered":"2024-05-08T04:22:45.985270+0000","last_clean":"2024-05-08T04:22:45.985270+0000","last_became_active":"2024-05-08T04:22:44.988397+0000","last_became_peered":"2024-05-08T04:22:44.988397+0000","last_unstale":"2024-05-08T04:22:45.985270+0000","last_undegraded":"2024-05-08T04:22:45.985270+0000","last_fullsized":"2024-05-08T04:22:45.985270+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:20:26.536479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991149+0000","last_change":"2024-05-08T04:22:43.968863+0000","last_active":"2024-05-08T04:22:45.991149+0000","last_peered":"2024-05-08T04:22:45.991149+0000","last_clean":"2024-05-08T04:22:45.991149+0000","last_became_active":"2024-05-08T04:22:43.967786+0000","last_became_peered":"2024-05-08T04:22:43.967786+0000","last_unstale":"2024-05-08T04:22:45.991149+0000","last_undegraded":"2024-05-08T04:22:45.991149+0000","last_fullsized":"2024-05-08T04:22:45.991149+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:25:24.830406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573108+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:22:46.573108+0000","last_peered":"2024-05-08T04:22:46.573108+0000","last_clean":"2024-05-08T04:22:46.573108+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:22:46.573108+0000","last_undegraded":"2024-05-08T04:22:46.573108+0000","last_fullsized":"2024-05-08T04:22:46.573108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":208371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":536576,"data_stored":215253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1126400,"data_stored":805027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":536576,"data_stored":210041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":216249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":208427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":805075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":209009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:22:50.223 INFO:tasks.ceph.mds.c.smithi104.stderr:2024-05-08T04:22:50.218+0000 7f82890d7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T04:22:52.324 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:22:52.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.434+0000 7fa8dcb22640 1 Processor -- start 2024-05-08T04:22:52.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.434+0000 7fa8dcb22640 1 -- start start 2024-05-08T04:22:52.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.435+0000 7fa8dcb22640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d80711c0 0x7fa8d806d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:52.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.435+0000 7fa8dcb22640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa8d8144c80 0x7fa8d806dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:52.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.435+0000 7fa8dcb22640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d8071fb0 con 0x7fa8d80cc930 2024-05-08T04:22:52.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.435+0000 7fa8dcb22640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d8071710 con 0x7fa8d8144c80 2024-05-08T04:22:52.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.435+0000 7fa8dcb22640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d80719f0 con 0x7fa8d80711c0 2024-05-08T04:22:52.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.435+0000 7fa8cdd9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d80711c0 0x7fa8d806d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:52.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.435+0000 7fa8d6d9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa8d8144c80 0x7fa8d806dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:52.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.435+0000 7fa8d6d9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa8d8144c80 0x7fa8d806dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:50610/0 (socket says 172.21.15.104:50610) 2024-05-08T04:22:52.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.435+0000 7fa8d659c640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fa8d80cc930 0x7fa8d80ccd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:58506/0 (socket says 172.21.15.104:58506) 2024-05-08T04:22:52.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.435+0000 7fa8cdd9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d80711c0 0x7fa8d806d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:50012/0 (socket says 172.21.15.104:50012) 2024-05-08T04:22:52.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.435+0000 7fa8d6d9d640 1 -- 172.21.15.104:0/3400555632 learned_addr learned my addr 172.21.15.104:0/3400555632 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:52.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.436+0000 7fa8cdd9b640 1 -- 172.21.15.104:0/3400555632 >> v2:172.21.15.183:3300/0 conn(0x7fa8d8144c80 msgr2=0x7fa8d806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:52.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.436+0000 7fa8cdd9b640 1 --2- 172.21.15.104:0/3400555632 >> v2:172.21.15.183:3300/0 conn(0x7fa8d8144c80 0x7fa8d806dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.436+0000 7fa8cdd9b640 1 -- 172.21.15.104:0/3400555632 >> v1:172.21.15.183:6789/0 conn(0x7fa8d80cc930 legacy=0x7fa8d80ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:52.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.436+0000 7fa8cdd9b640 1 -- 172.21.15.104:0/3400555632 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d8071cd0 con 0x7fa8d80711c0 2024-05-08T04:22:52.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.436+0000 7fa8d6d9d640 1 --2- 172.21.15.104:0/3400555632 >> v2:172.21.15.183:3300/0 conn(0x7fa8d8144c80 0x7fa8d806dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:22:52.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.437+0000 7fa8cdd9b640 1 --2- 172.21.15.104:0/3400555632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d80711c0 0x7fa8d806d850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00097a0 tx=0x7fa8c002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fcc4ead3d52ef84 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:52.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.437+0000 7fa8d5d9b640 1 -- 172.21.15.104:0/3400555632 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0037070 con 0x7fa8d80711c0 2024-05-08T04:22:52.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.437+0000 7fa8d5d9b640 1 -- 172.21.15.104:0/3400555632 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c002ae50 con 0x7fa8d80711c0 2024-05-08T04:22:52.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.437+0000 7fa8d5d9b640 1 -- 172.21.15.104:0/3400555632 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0032660 con 0x7fa8d80711c0 2024-05-08T04:22:52.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.437+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3400555632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d80711c0 msgr2=0x7fa8d806d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:52.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.437+0000 7fa8dcb22640 1 --2- 172.21.15.104:0/3400555632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d80711c0 0x7fa8d806d850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00097a0 tx=0x7fa8c002a100 comp rx=0 tx=0).stop 2024-05-08T04:22:52.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.437+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3400555632 shutdown_connections 2024-05-08T04:22:52.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.437+0000 7fa8dcb22640 1 --2- 172.21.15.104:0/3400555632 >> v2:172.21.15.183:3300/0 conn(0x7fa8d8144c80 0x7fa8d806dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.437+0000 7fa8dcb22640 1 --2- 172.21.15.104:0/3400555632 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d80711c0 0x7fa8d806d850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.437+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3400555632 >> 172.21.15.104:0/3400555632 conn(0x7fa8d80b13f0 msgr2=0x7fa8d80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:52.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.437+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3400555632 shutdown_connections 2024-05-08T04:22:52.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.437+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3400555632 wait complete. 2024-05-08T04:22:52.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.439+0000 7fa8dcb22640 1 Processor -- start 2024-05-08T04:22:52.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.439+0000 7fa8dcb22640 1 -- start start 2024-05-08T04:22:52.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8dcb22640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8d80711c0 0x7fa8d815d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:52.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8dcb22640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d80cc930 0x7fa8d815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:52.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8dcb22640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8d8144c80 0x7fa8d815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:52.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8dcb22640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d81453f0 con 0x7fa8d80711c0 2024-05-08T04:22:52.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8dcb22640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d80cf3b0 con 0x7fa8d8144c80 2024-05-08T04:22:52.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8dcb22640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d806e2d0 con 0x7fa8d80cc930 2024-05-08T04:22:52.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8d659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8d80711c0 0x7fa8d815d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:52.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8d659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8d80711c0 0x7fa8d815d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57452/0 (socket says 172.21.15.104:57452) 2024-05-08T04:22:52.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8d659c640 1 -- 172.21.15.104:0/3062017298 learned_addr learned my addr 172.21.15.104:0/3062017298 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:52.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8d659c640 1 -- 172.21.15.104:0/3062017298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d80cc930 msgr2=0x7fa8d815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:52.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8cdd9b640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d80cc930 0x7fa8d815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:52.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8d659c640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d80cc930 0x7fa8d815a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8d6d9d640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8d8144c80 0x7fa8d815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:52.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8d659c640 1 -- 172.21.15.104:0/3062017298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8d8144c80 msgr2=0x7fa8d815ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8d659c640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8d8144c80 0x7fa8d815ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8d659c640 1 -- 172.21.15.104:0/3062017298 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d812ec30 con 0x7fa8d80711c0 2024-05-08T04:22:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.440+0000 7fa8d659c640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8d80711c0 0x7fa8d815d980 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c430 tx=0x7fa8c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.441+0000 7fa8cf7fe640 1 -- 172.21.15.104:0/3062017298 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80074e0 con 0x7fa8d80711c0 2024-05-08T04:22:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.441+0000 7fa8cf7fe640 1 -- 172.21.15.104:0/3062017298 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c8007680 con 0x7fa8d80711c0 2024-05-08T04:22:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.441+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3062017298 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d812ef10 con 0x7fa8d80711c0 2024-05-08T04:22:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.441+0000 7fa8cf7fe640 1 -- 172.21.15.104:0/3062017298 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8004a00 con 0x7fa8d80711c0 2024-05-08T04:22:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.441+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3062017298 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d812f4d0 con 0x7fa8d80711c0 2024-05-08T04:22:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.442+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3062017298 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d806eaf0 con 0x7fa8d80711c0 2024-05-08T04:22:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.442+0000 7fa8cf7fe640 1 -- 172.21.15.104:0/3062017298 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fa8c801a020 con 0x7fa8d80711c0 2024-05-08T04:22:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.443+0000 7fa8cf7fe640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa8b806b680 0x7fa8b806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.443+0000 7fa8cf7fe640 1 -- 172.21.15.104:0/3062017298 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fa8c8089db0 con 0x7fa8d80711c0 2024-05-08T04:22:52.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.443+0000 7fa8cdd9b640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa8b806b680 0x7fa8b806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:52.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.443+0000 7fa8cdd9b640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa8b806b680 0x7fa8b806db40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0034000 tx=0x7fa8c002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:52.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.447+0000 7fa8cf7fe640 1 -- 172.21.15.104:0/3062017298 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8d806eaf0 con 0x7fa8d80711c0 2024-05-08T04:22:52.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.613+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3062017298 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8d8075010 con 0x7fa8b806b680 2024-05-08T04:22:52.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.619+0000 7fa8cf7fe640 1 -- 172.21.15.104:0/3062017298 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251958 (secure 0 0 0) 0x7fa8d8075010 con 0x7fa8b806b680 2024-05-08T04:22:52.623 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:52.624 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:22:52.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.622+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3062017298 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa8b806b680 msgr2=0x7fa8b806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:52.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.622+0000 7fa8dcb22640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa8b806b680 0x7fa8b806db40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0034000 tx=0x7fa8c002e000 comp rx=0 tx=0).stop 2024-05-08T04:22:52.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.622+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3062017298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8d80711c0 msgr2=0x7fa8d815d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:52.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.622+0000 7fa8dcb22640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8d80711c0 0x7fa8d815d980 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c430 tx=0x7fa8c800c8f0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.622+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3062017298 shutdown_connections 2024-05-08T04:22:52.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.622+0000 7fa8dcb22640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa8b806b680 0x7fa8b806db40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.622+0000 7fa8dcb22640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8d8144c80 0x7fa8d815ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.622+0000 7fa8dcb22640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d80cc930 0x7fa8d815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.622+0000 7fa8dcb22640 1 --2- 172.21.15.104:0/3062017298 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8d80711c0 0x7fa8d815d980 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.622+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3062017298 >> 172.21.15.104:0/3062017298 conn(0x7fa8d80b13f0 msgr2=0x7fa8d80ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:52.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.622+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3062017298 shutdown_connections 2024-05-08T04:22:52.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.622+0000 7fa8dcb22640 1 -- 172.21.15.104:0/3062017298 wait complete. 2024-05-08T04:22:52.634 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-05-08T04:22:52.011155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221480,"kb_used_data":5304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753240,"statfs":{"total":773094113280,"available":772867317760,"internally_reserved":0,"allocated":5431296,"data_stored":2877452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.041938"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196811+0000","last_change":"2024-05-08T04:22:44.987361+0000","last_active":"2024-05-08T04:22:47.196811+0000","last_peered":"2024-05-08T04:22:47.196811+0000","last_clean":"2024-05-08T04:22:47.196811+0000","last_became_active":"2024-05-08T04:22:44.986955+0000","last_became_peered":"2024-05-08T04:22:44.986955+0000","last_unstale":"2024-05-08T04:22:47.196811+0000","last_undegraded":"2024-05-08T04:22:47.196811+0000","last_fullsized":"2024-05-08T04:22:47.196811+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:38:17.919167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001816+0000","last_change":"2024-05-08T04:22:44.995452+0000","last_active":"2024-05-08T04:22:47.001816+0000","last_peered":"2024-05-08T04:22:47.001816+0000","last_clean":"2024-05-08T04:22:47.001816+0000","last_became_active":"2024-05-08T04:22:44.995186+0000","last_became_peered":"2024-05-08T04:22:44.995186+0000","last_unstale":"2024-05-08T04:22:47.001816+0000","last_undegraded":"2024-05-08T04:22:47.001816+0000","last_fullsized":"2024-05-08T04:22:47.001816+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:10.304193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573304+0000","last_change":"2024-05-08T04:22:44.994674+0000","last_active":"2024-05-08T04:22:46.573304+0000","last_peered":"2024-05-08T04:22:46.573304+0000","last_clean":"2024-05-08T04:22:46.573304+0000","last_became_active":"2024-05-08T04:22:44.994262+0000","last_became_peered":"2024-05-08T04:22:44.994262+0000","last_unstale":"2024-05-08T04:22:46.573304+0000","last_undegraded":"2024-05-08T04:22:46.573304+0000","last_fullsized":"2024-05-08T04:22:46.573304+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:14:34.562109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.985019+0000","last_change":"2024-05-08T04:22:44.990852+0000","last_active":"2024-05-08T04:22:45.985019+0000","last_peered":"2024-05-08T04:22:45.985019+0000","last_clean":"2024-05-08T04:22:45.985019+0000","last_became_active":"2024-05-08T04:22:44.990378+0000","last_became_peered":"2024-05-08T04:22:44.990378+0000","last_unstale":"2024-05-08T04:22:45.985019+0000","last_undegraded":"2024-05-08T04:22:45.985019+0000","last_fullsized":"2024-05-08T04:22:45.985019+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:08.775682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196558+0000","last_change":"2024-05-08T04:22:44.985609+0000","last_active":"2024-05-08T04:22:47.196558+0000","last_peered":"2024-05-08T04:22:47.196558+0000","last_clean":"2024-05-08T04:22:47.196558+0000","last_became_active":"2024-05-08T04:22:44.985353+0000","last_became_peered":"2024-05-08T04:22:44.985353+0000","last_unstale":"2024-05-08T04:22:47.196558+0000","last_undegraded":"2024-05-08T04:22:47.196558+0000","last_fullsized":"2024-05-08T04:22:47.196558+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:10.304193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984333+0000","last_change":"2024-05-08T04:22:44.988873+0000","last_active":"2024-05-08T04:22:45.984333+0000","last_peered":"2024-05-08T04:22:45.984333+0000","last_clean":"2024-05-08T04:22:45.984333+0000","last_became_active":"2024-05-08T04:22:44.988553+0000","last_became_peered":"2024-05-08T04:22:44.988553+0000","last_unstale":"2024-05-08T04:22:45.984333+0000","last_undegraded":"2024-05-08T04:22:45.984333+0000","last_fullsized":"2024-05-08T04:22:45.984333+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:24:05.528494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.990890+0000","last_change":"2024-05-08T04:22:44.990877+0000","last_active":"2024-05-08T04:22:45.990890+0000","last_peered":"2024-05-08T04:22:45.990890+0000","last_clean":"2024-05-08T04:22:45.990890+0000","last_became_active":"2024-05-08T04:22:44.990592+0000","last_became_peered":"2024-05-08T04:22:44.990592+0000","last_unstale":"2024-05-08T04:22:45.990890+0000","last_undegraded":"2024-05-08T04:22:45.990890+0000","last_fullsized":"2024-05-08T04:22:45.990890+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:13:39.163441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984499+0000","last_change":"2024-05-08T04:22:44.991975+0000","last_active":"2024-05-08T04:22:45.984499+0000","last_peered":"2024-05-08T04:22:45.984499+0000","last_clean":"2024-05-08T04:22:45.984499+0000","last_became_active":"2024-05-08T04:22:44.990605+0000","last_became_peered":"2024-05-08T04:22:44.990605+0000","last_unstale":"2024-05-08T04:22:45.984499+0000","last_undegraded":"2024-05-08T04:22:45.984499+0000","last_fullsized":"2024-05-08T04:22:45.984499+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:40.446741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984917+0000","last_change":"2024-05-08T04:22:44.998040+0000","last_active":"2024-05-08T04:22:45.984917+0000","last_peered":"2024-05-08T04:22:45.984917+0000","last_clean":"2024-05-08T04:22:45.984917+0000","last_became_active":"2024-05-08T04:22:44.997744+0000","last_became_peered":"2024-05-08T04:22:44.997744+0000","last_unstale":"2024-05-08T04:22:45.984917+0000","last_undegraded":"2024-05-08T04:22:45.984917+0000","last_fullsized":"2024-05-08T04:22:45.984917+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:36.325431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940976+0000","last_change":"2024-05-08T04:22:44.986856+0000","last_active":"2024-05-08T04:22:46.940976+0000","last_peered":"2024-05-08T04:22:46.940976+0000","last_clean":"2024-05-08T04:22:46.940976+0000","last_became_active":"2024-05-08T04:22:44.986519+0000","last_became_peered":"2024-05-08T04:22:44.986519+0000","last_unstale":"2024-05-08T04:22:46.940976+0000","last_undegraded":"2024-05-08T04:22:46.940976+0000","last_fullsized":"2024-05-08T04:22:46.940976+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:40:54.030238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984657+0000","last_change":"2024-05-08T04:22:44.988580+0000","last_active":"2024-05-08T04:22:45.984657+0000","last_peered":"2024-05-08T04:22:45.984657+0000","last_clean":"2024-05-08T04:22:45.984657+0000","last_became_active":"2024-05-08T04:22:44.988302+0000","last_became_peered":"2024-05-08T04:22:44.988302+0000","last_unstale":"2024-05-08T04:22:45.984657+0000","last_undegraded":"2024-05-08T04:22:45.984657+0000","last_fullsized":"2024-05-08T04:22:45.984657+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:49:30.952952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001885+0000","last_change":"2024-05-08T04:22:44.986511+0000","last_active":"2024-05-08T04:22:47.001885+0000","last_peered":"2024-05-08T04:22:47.001885+0000","last_clean":"2024-05-08T04:22:47.001885+0000","last_became_active":"2024-05-08T04:22:44.986244+0000","last_became_peered":"2024-05-08T04:22:44.986244+0000","last_unstale":"2024-05-08T04:22:47.001885+0000","last_undegraded":"2024-05-08T04:22:47.001885+0000","last_fullsized":"2024-05-08T04:22:47.001885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:40.446741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984523+0000","last_change":"2024-05-08T04:22:44.996047+0000","last_active":"2024-05-08T04:22:45.984523+0000","last_peered":"2024-05-08T04:22:45.984523+0000","last_clean":"2024-05-08T04:22:45.984523+0000","last_became_active":"2024-05-08T04:22:44.995781+0000","last_became_peered":"2024-05-08T04:22:44.995781+0000","last_unstale":"2024-05-08T04:22:45.984523+0000","last_undegraded":"2024-05-08T04:22:45.984523+0000","last_fullsized":"2024-05-08T04:22:45.984523+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:28:44.823621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984618+0000","last_change":"2024-05-08T04:22:44.995283+0000","last_active":"2024-05-08T04:22:45.984618+0000","last_peered":"2024-05-08T04:22:45.984618+0000","last_clean":"2024-05-08T04:22:45.984618+0000","last_became_active":"2024-05-08T04:22:44.994953+0000","last_became_peered":"2024-05-08T04:22:44.994953+0000","last_unstale":"2024-05-08T04:22:45.984618+0000","last_undegraded":"2024-05-08T04:22:45.984618+0000","last_fullsized":"2024-05-08T04:22:45.984618+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:09:01.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984577+0000","last_change":"2024-05-08T04:22:44.996382+0000","last_active":"2024-05-08T04:22:45.984577+0000","last_peered":"2024-05-08T04:22:45.984577+0000","last_clean":"2024-05-08T04:22:45.984577+0000","last_became_active":"2024-05-08T04:22:44.996142+0000","last_became_peered":"2024-05-08T04:22:44.996142+0000","last_unstale":"2024-05-08T04:22:45.984577+0000","last_undegraded":"2024-05-08T04:22:45.984577+0000","last_fullsized":"2024-05-08T04:22:45.984577+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:38:17.919167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196416+0000","last_change":"2024-05-08T04:22:44.993651+0000","last_active":"2024-05-08T04:22:47.196416+0000","last_peered":"2024-05-08T04:22:47.196416+0000","last_clean":"2024-05-08T04:22:47.196416+0000","last_became_active":"2024-05-08T04:22:44.993373+0000","last_became_peered":"2024-05-08T04:22:44.993373+0000","last_unstale":"2024-05-08T04:22:47.196416+0000","last_undegraded":"2024-05-08T04:22:47.196416+0000","last_fullsized":"2024-05-08T04:22:47.196416+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:31:36.813477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001931+0000","last_change":"2024-05-08T04:22:44.983395+0000","last_active":"2024-05-08T04:22:47.001931+0000","last_peered":"2024-05-08T04:22:47.001931+0000","last_clean":"2024-05-08T04:22:47.001931+0000","last_became_active":"2024-05-08T04:22:44.983133+0000","last_became_peered":"2024-05-08T04:22:44.983133+0000","last_unstale":"2024-05-08T04:22:47.001931+0000","last_undegraded":"2024-05-08T04:22:47.001931+0000","last_fullsized":"2024-05-08T04:22:47.001931+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:53.095389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573425+0000","last_change":"2024-05-08T04:22:44.991580+0000","last_active":"2024-05-08T04:22:46.573425+0000","last_peered":"2024-05-08T04:22:46.573425+0000","last_clean":"2024-05-08T04:22:46.573425+0000","last_became_active":"2024-05-08T04:22:44.991257+0000","last_became_peered":"2024-05-08T04:22:44.991257+0000","last_unstale":"2024-05-08T04:22:46.573425+0000","last_undegraded":"2024-05-08T04:22:46.573425+0000","last_fullsized":"2024-05-08T04:22:46.573425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:21:12.231732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196702+0000","last_change":"2024-05-08T04:22:44.984923+0000","last_active":"2024-05-08T04:22:47.196702+0000","last_peered":"2024-05-08T04:22:47.196702+0000","last_clean":"2024-05-08T04:22:47.196702+0000","last_became_active":"2024-05-08T04:22:44.984655+0000","last_became_peered":"2024-05-08T04:22:44.984655+0000","last_unstale":"2024-05-08T04:22:47.196702+0000","last_undegraded":"2024-05-08T04:22:47.196702+0000","last_fullsized":"2024-05-08T04:22:47.196702+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:53.095389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940973+0000","last_change":"2024-05-08T04:22:44.992204+0000","last_active":"2024-05-08T04:22:46.940973+0000","last_peered":"2024-05-08T04:22:46.940973+0000","last_clean":"2024-05-08T04:22:46.940973+0000","last_became_active":"2024-05-08T04:22:44.991626+0000","last_became_peered":"2024-05-08T04:22:44.991626+0000","last_unstale":"2024-05-08T04:22:46.940973+0000","last_undegraded":"2024-05-08T04:22:46.940973+0000","last_fullsized":"2024-05-08T04:22:46.940973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:07:24.316437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984516+0000","last_change":"2024-05-08T04:22:44.990836+0000","last_active":"2024-05-08T04:22:45.984516+0000","last_peered":"2024-05-08T04:22:45.984516+0000","last_clean":"2024-05-08T04:22:45.984516+0000","last_became_active":"2024-05-08T04:22:44.990534+0000","last_became_peered":"2024-05-08T04:22:44.990534+0000","last_unstale":"2024-05-08T04:22:45.984516+0000","last_undegraded":"2024-05-08T04:22:45.984516+0000","last_fullsized":"2024-05-08T04:22:45.984516+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:53.095389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196843+0000","last_change":"2024-05-08T04:22:44.978867+0000","last_active":"2024-05-08T04:22:47.196843+0000","last_peered":"2024-05-08T04:22:47.196843+0000","last_clean":"2024-05-08T04:22:47.196843+0000","last_became_active":"2024-05-08T04:22:44.978538+0000","last_became_peered":"2024-05-08T04:22:44.978538+0000","last_unstale":"2024-05-08T04:22:47.196843+0000","last_undegraded":"2024-05-08T04:22:47.196843+0000","last_fullsized":"2024-05-08T04:22:47.196843+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:59:23.614912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991112+0000","last_change":"2024-05-08T04:22:44.981470+0000","last_active":"2024-05-08T04:22:45.991112+0000","last_peered":"2024-05-08T04:22:45.991112+0000","last_clean":"2024-05-08T04:22:45.991112+0000","last_became_active":"2024-05-08T04:22:44.981217+0000","last_became_peered":"2024-05-08T04:22:44.981217+0000","last_unstale":"2024-05-08T04:22:45.991112+0000","last_undegraded":"2024-05-08T04:22:45.991112+0000","last_fullsized":"2024-05-08T04:22:45.991112+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:05:14.503516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001468+0000","last_change":"2024-05-08T04:22:44.996013+0000","last_active":"2024-05-08T04:22:47.001468+0000","last_peered":"2024-05-08T04:22:47.001468+0000","last_clean":"2024-05-08T04:22:47.001468+0000","last_became_active":"2024-05-08T04:22:44.995732+0000","last_became_peered":"2024-05-08T04:22:44.995732+0000","last_unstale":"2024-05-08T04:22:47.001468+0000","last_undegraded":"2024-05-08T04:22:47.001468+0000","last_fullsized":"2024-05-08T04:22:47.001468+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:52:57.841064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196820+0000","last_change":"2024-05-08T04:22:44.986329+0000","last_active":"2024-05-08T04:22:47.196820+0000","last_peered":"2024-05-08T04:22:47.196820+0000","last_clean":"2024-05-08T04:22:47.196820+0000","last_became_active":"2024-05-08T04:22:44.986079+0000","last_became_peered":"2024-05-08T04:22:44.986079+0000","last_unstale":"2024-05-08T04:22:47.196820+0000","last_undegraded":"2024-05-08T04:22:47.196820+0000","last_fullsized":"2024-05-08T04:22:47.196820+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:09:01.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.985265+0000","last_change":"2024-05-08T04:22:44.986867+0000","last_active":"2024-05-08T04:22:45.985265+0000","last_peered":"2024-05-08T04:22:45.985265+0000","last_clean":"2024-05-08T04:22:45.985265+0000","last_became_active":"2024-05-08T04:22:44.986608+0000","last_became_peered":"2024-05-08T04:22:44.986608+0000","last_unstale":"2024-05-08T04:22:45.985265+0000","last_undegraded":"2024-05-08T04:22:45.985265+0000","last_fullsized":"2024-05-08T04:22:45.985265+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:52:49.182169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991488+0000","last_change":"2024-05-08T04:22:44.981198+0000","last_active":"2024-05-08T04:22:45.991488+0000","last_peered":"2024-05-08T04:22:45.991488+0000","last_clean":"2024-05-08T04:22:45.991488+0000","last_became_active":"2024-05-08T04:22:44.980756+0000","last_became_peered":"2024-05-08T04:22:44.980756+0000","last_unstale":"2024-05-08T04:22:45.991488+0000","last_undegraded":"2024-05-08T04:22:45.991488+0000","last_fullsized":"2024-05-08T04:22:45.991488+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:39:03.370126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991465+0000","last_change":"2024-05-08T04:22:44.982728+0000","last_active":"2024-05-08T04:22:45.991465+0000","last_peered":"2024-05-08T04:22:45.991465+0000","last_clean":"2024-05-08T04:22:45.991465+0000","last_became_active":"2024-05-08T04:22:44.982470+0000","last_became_peered":"2024-05-08T04:22:44.982470+0000","last_unstale":"2024-05-08T04:22:45.991465+0000","last_undegraded":"2024-05-08T04:22:45.991465+0000","last_fullsized":"2024-05-08T04:22:45.991465+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:25.082385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196638+0000","last_change":"2024-05-08T04:22:44.998725+0000","last_active":"2024-05-08T04:22:47.196638+0000","last_peered":"2024-05-08T04:22:47.196638+0000","last_clean":"2024-05-08T04:22:47.196638+0000","last_became_active":"2024-05-08T04:22:44.998462+0000","last_became_peered":"2024-05-08T04:22:44.998462+0000","last_unstale":"2024-05-08T04:22:47.196638+0000","last_undegraded":"2024-05-08T04:22:47.196638+0000","last_fullsized":"2024-05-08T04:22:47.196638+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:40.446741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001505+0000","last_change":"2024-05-08T04:22:44.980340+0000","last_active":"2024-05-08T04:22:47.001505+0000","last_peered":"2024-05-08T04:22:47.001505+0000","last_clean":"2024-05-08T04:22:47.001505+0000","last_became_active":"2024-05-08T04:22:44.980132+0000","last_became_peered":"2024-05-08T04:22:44.980132+0000","last_unstale":"2024-05-08T04:22:47.001505+0000","last_undegraded":"2024-05-08T04:22:47.001505+0000","last_fullsized":"2024-05-08T04:22:47.001505+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:53:33.659528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984574+0000","last_change":"2024-05-08T04:22:44.982252+0000","last_active":"2024-05-08T04:22:45.984574+0000","last_peered":"2024-05-08T04:22:45.984574+0000","last_clean":"2024-05-08T04:22:45.984574+0000","last_became_active":"2024-05-08T04:22:44.981974+0000","last_became_peered":"2024-05-08T04:22:44.981974+0000","last_unstale":"2024-05-08T04:22:45.984574+0000","last_undegraded":"2024-05-08T04:22:45.984574+0000","last_fullsized":"2024-05-08T04:22:45.984574+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:52:57.841064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984761+0000","last_change":"2024-05-08T04:22:44.987803+0000","last_active":"2024-05-08T04:22:45.984761+0000","last_peered":"2024-05-08T04:22:45.984761+0000","last_clean":"2024-05-08T04:22:45.984761+0000","last_became_active":"2024-05-08T04:22:44.987517+0000","last_became_peered":"2024-05-08T04:22:44.987517+0000","last_unstale":"2024-05-08T04:22:45.984761+0000","last_undegraded":"2024-05-08T04:22:45.984761+0000","last_fullsized":"2024-05-08T04:22:45.984761+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:38:40.496711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.197018+0000","last_change":"2024-05-08T04:22:44.988707+0000","last_active":"2024-05-08T04:22:47.197018+0000","last_peered":"2024-05-08T04:22:47.197018+0000","last_clean":"2024-05-08T04:22:47.197018+0000","last_became_active":"2024-05-08T04:22:44.988466+0000","last_became_peered":"2024-05-08T04:22:44.988466+0000","last_unstale":"2024-05-08T04:22:47.197018+0000","last_undegraded":"2024-05-08T04:22:47.197018+0000","last_fullsized":"2024-05-08T04:22:47.197018+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:14:34.562109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984971+0000","last_change":"2024-05-08T04:22:43.974798+0000","last_active":"2024-05-08T04:22:45.984971+0000","last_peered":"2024-05-08T04:22:45.984971+0000","last_clean":"2024-05-08T04:22:45.984971+0000","last_became_active":"2024-05-08T04:22:43.974422+0000","last_became_peered":"2024-05-08T04:22:43.974422+0000","last_unstale":"2024-05-08T04:22:45.984971+0000","last_undegraded":"2024-05-08T04:22:45.984971+0000","last_fullsized":"2024-05-08T04:22:45.984971+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:38:11.143153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196897+0000","last_change":"2024-05-08T04:22:44.984208+0000","last_active":"2024-05-08T04:22:47.196897+0000","last_peered":"2024-05-08T04:22:47.196897+0000","last_clean":"2024-05-08T04:22:47.196897+0000","last_became_active":"2024-05-08T04:22:44.983949+0000","last_became_peered":"2024-05-08T04:22:44.983949+0000","last_unstale":"2024-05-08T04:22:47.196897+0000","last_undegraded":"2024-05-08T04:22:47.196897+0000","last_fullsized":"2024-05-08T04:22:47.196897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:49:30.952952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991041+0000","last_change":"2024-05-08T04:22:43.974074+0000","last_active":"2024-05-08T04:22:45.991041+0000","last_peered":"2024-05-08T04:22:45.991041+0000","last_clean":"2024-05-08T04:22:45.991041+0000","last_became_active":"2024-05-08T04:22:43.973807+0000","last_became_peered":"2024-05-08T04:22:43.973807+0000","last_unstale":"2024-05-08T04:22:45.991041+0000","last_undegraded":"2024-05-08T04:22:45.991041+0000","last_fullsized":"2024-05-08T04:22:45.991041+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:52:48.177449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001959+0000","last_change":"2024-05-08T04:22:44.996706+0000","last_active":"2024-05-08T04:22:47.001959+0000","last_peered":"2024-05-08T04:22:47.001959+0000","last_clean":"2024-05-08T04:22:47.001959+0000","last_became_active":"2024-05-08T04:22:44.995860+0000","last_became_peered":"2024-05-08T04:22:44.995860+0000","last_unstale":"2024-05-08T04:22:47.001959+0000","last_undegraded":"2024-05-08T04:22:47.001959+0000","last_fullsized":"2024-05-08T04:22:47.001959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:38:17.919167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984825+0000","last_change":"2024-05-08T04:22:43.974142+0000","last_active":"2024-05-08T04:22:45.984825+0000","last_peered":"2024-05-08T04:22:45.984825+0000","last_clean":"2024-05-08T04:22:45.984825+0000","last_became_active":"2024-05-08T04:22:43.973844+0000","last_became_peered":"2024-05-08T04:22:43.973844+0000","last_unstale":"2024-05-08T04:22:45.984825+0000","last_undegraded":"2024-05-08T04:22:45.984825+0000","last_fullsized":"2024-05-08T04:22:45.984825+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:09:40.728019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984839+0000","last_change":"2024-05-08T04:22:44.991302+0000","last_active":"2024-05-08T04:22:45.984839+0000","last_peered":"2024-05-08T04:22:45.984839+0000","last_clean":"2024-05-08T04:22:45.984839+0000","last_became_active":"2024-05-08T04:22:44.990927+0000","last_became_peered":"2024-05-08T04:22:44.990927+0000","last_unstale":"2024-05-08T04:22:45.984839+0000","last_undegraded":"2024-05-08T04:22:45.984839+0000","last_fullsized":"2024-05-08T04:22:45.984839+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:45:41.156316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991352+0000","last_change":"2024-05-08T04:22:43.974792+0000","last_active":"2024-05-08T04:22:45.991352+0000","last_peered":"2024-05-08T04:22:45.991352+0000","last_clean":"2024-05-08T04:22:45.991352+0000","last_became_active":"2024-05-08T04:22:43.974520+0000","last_became_peered":"2024-05-08T04:22:43.974520+0000","last_unstale":"2024-05-08T04:22:45.991352+0000","last_undegraded":"2024-05-08T04:22:45.991352+0000","last_fullsized":"2024-05-08T04:22:45.991352+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:21:16.372426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991156+0000","last_change":"2024-05-08T04:22:44.980190+0000","last_active":"2024-05-08T04:22:45.991156+0000","last_peered":"2024-05-08T04:22:45.991156+0000","last_clean":"2024-05-08T04:22:45.991156+0000","last_became_active":"2024-05-08T04:22:44.979716+0000","last_became_peered":"2024-05-08T04:22:44.979716+0000","last_unstale":"2024-05-08T04:22:45.991156+0000","last_undegraded":"2024-05-08T04:22:45.991156+0000","last_fullsized":"2024-05-08T04:22:45.991156+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:41:58.730953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984778+0000","last_change":"2024-05-08T04:22:43.970137+0000","last_active":"2024-05-08T04:22:45.984778+0000","last_peered":"2024-05-08T04:22:45.984778+0000","last_clean":"2024-05-08T04:22:45.984778+0000","last_became_active":"2024-05-08T04:22:43.969385+0000","last_became_peered":"2024-05-08T04:22:43.969385+0000","last_unstale":"2024-05-08T04:22:45.984778+0000","last_undegraded":"2024-05-08T04:22:45.984778+0000","last_fullsized":"2024-05-08T04:22:45.984778+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:04:31.898222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940698+0000","last_change":"2024-05-08T04:22:44.994499+0000","last_active":"2024-05-08T04:22:46.940698+0000","last_peered":"2024-05-08T04:22:46.940698+0000","last_clean":"2024-05-08T04:22:46.940698+0000","last_became_active":"2024-05-08T04:22:44.994207+0000","last_became_peered":"2024-05-08T04:22:44.994207+0000","last_unstale":"2024-05-08T04:22:46.940698+0000","last_undegraded":"2024-05-08T04:22:46.940698+0000","last_fullsized":"2024-05-08T04:22:46.940698+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:52:49.182169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.990940+0000","last_change":"2024-05-08T04:22:43.971542+0000","last_active":"2024-05-08T04:22:45.990940+0000","last_peered":"2024-05-08T04:22:45.990940+0000","last_clean":"2024-05-08T04:22:45.990940+0000","last_became_active":"2024-05-08T04:22:43.971257+0000","last_became_peered":"2024-05-08T04:22:43.971257+0000","last_unstale":"2024-05-08T04:22:45.990940+0000","last_undegraded":"2024-05-08T04:22:45.990940+0000","last_fullsized":"2024-05-08T04:22:45.990940+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:58:31.155457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940911+0000","last_change":"2024-05-08T04:22:44.991884+0000","last_active":"2024-05-08T04:22:46.940911+0000","last_peered":"2024-05-08T04:22:46.940911+0000","last_clean":"2024-05-08T04:22:46.940911+0000","last_became_active":"2024-05-08T04:22:44.991555+0000","last_became_peered":"2024-05-08T04:22:44.991555+0000","last_unstale":"2024-05-08T04:22:46.940911+0000","last_undegraded":"2024-05-08T04:22:46.940911+0000","last_fullsized":"2024-05-08T04:22:46.940911+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:25:25.835126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196442+0000","last_change":"2024-05-08T04:22:43.967471+0000","last_active":"2024-05-08T04:22:47.196442+0000","last_peered":"2024-05-08T04:22:47.196442+0000","last_clean":"2024-05-08T04:22:47.196442+0000","last_became_active":"2024-05-08T04:22:43.966802+0000","last_became_peered":"2024-05-08T04:22:43.966802+0000","last_unstale":"2024-05-08T04:22:47.196442+0000","last_undegraded":"2024-05-08T04:22:47.196442+0000","last_fullsized":"2024-05-08T04:22:47.196442+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:18:00.134055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991113+0000","last_change":"2024-05-08T04:22:44.984949+0000","last_active":"2024-05-08T04:22:45.991113+0000","last_peered":"2024-05-08T04:22:45.991113+0000","last_clean":"2024-05-08T04:22:45.991113+0000","last_became_active":"2024-05-08T04:22:44.984214+0000","last_became_peered":"2024-05-08T04:22:44.984214+0000","last_unstale":"2024-05-08T04:22:45.991113+0000","last_undegraded":"2024-05-08T04:22:45.991113+0000","last_fullsized":"2024-05-08T04:22:45.991113+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:11:09.024186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940781+0000","last_change":"2024-05-08T04:22:43.973607+0000","last_active":"2024-05-08T04:22:46.940781+0000","last_peered":"2024-05-08T04:22:46.940781+0000","last_clean":"2024-05-08T04:22:46.940781+0000","last_became_active":"2024-05-08T04:22:43.973308+0000","last_became_peered":"2024-05-08T04:22:43.973308+0000","last_unstale":"2024-05-08T04:22:46.940781+0000","last_undegraded":"2024-05-08T04:22:46.940781+0000","last_fullsized":"2024-05-08T04:22:46.940781+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:52.090669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573461+0000","last_change":"2024-05-08T04:22:44.976925+0000","last_active":"2024-05-08T04:22:46.573461+0000","last_peered":"2024-05-08T04:22:46.573461+0000","last_clean":"2024-05-08T04:22:46.573461+0000","last_became_active":"2024-05-08T04:22:44.976657+0000","last_became_peered":"2024-05-08T04:22:44.976657+0000","last_unstale":"2024-05-08T04:22:46.573461+0000","last_undegraded":"2024-05-08T04:22:46.573461+0000","last_fullsized":"2024-05-08T04:22:46.573461+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:35:34.956623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573414+0000","last_change":"2024-05-08T04:22:43.973699+0000","last_active":"2024-05-08T04:22:46.573414+0000","last_peered":"2024-05-08T04:22:46.573414+0000","last_clean":"2024-05-08T04:22:46.573414+0000","last_became_active":"2024-05-08T04:22:43.973370+0000","last_became_peered":"2024-05-08T04:22:43.973370+0000","last_unstale":"2024-05-08T04:22:46.573414+0000","last_undegraded":"2024-05-08T04:22:46.573414+0000","last_fullsized":"2024-05-08T04:22:46.573414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:05.212660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573462+0000","last_change":"2024-05-08T04:22:44.984023+0000","last_active":"2024-05-08T04:22:46.573462+0000","last_peered":"2024-05-08T04:22:46.573462+0000","last_clean":"2024-05-08T04:22:46.573462+0000","last_became_active":"2024-05-08T04:22:44.983751+0000","last_became_peered":"2024-05-08T04:22:44.983751+0000","last_unstale":"2024-05-08T04:22:46.573462+0000","last_undegraded":"2024-05-08T04:22:46.573462+0000","last_fullsized":"2024-05-08T04:22:46.573462+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:06:01.713558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940957+0000","last_change":"2024-05-08T04:22:43.974858+0000","last_active":"2024-05-08T04:22:46.940957+0000","last_peered":"2024-05-08T04:22:46.940957+0000","last_clean":"2024-05-08T04:22:46.940957+0000","last_became_active":"2024-05-08T04:22:43.974550+0000","last_became_peered":"2024-05-08T04:22:43.974550+0000","last_unstale":"2024-05-08T04:22:46.940957+0000","last_undegraded":"2024-05-08T04:22:46.940957+0000","last_fullsized":"2024-05-08T04:22:46.940957+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:35.320711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.985184+0000","last_change":"2024-05-08T04:22:44.993785+0000","last_active":"2024-05-08T04:22:45.985184+0000","last_peered":"2024-05-08T04:22:45.985184+0000","last_clean":"2024-05-08T04:22:45.985184+0000","last_became_active":"2024-05-08T04:22:44.993516+0000","last_became_peered":"2024-05-08T04:22:44.993516+0000","last_unstale":"2024-05-08T04:22:45.985184+0000","last_undegraded":"2024-05-08T04:22:45.985184+0000","last_fullsized":"2024-05-08T04:22:45.985184+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:58:32.160177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001670+0000","last_change":"2024-05-08T04:22:43.972987+0000","last_active":"2024-05-08T04:22:47.001670+0000","last_peered":"2024-05-08T04:22:47.001670+0000","last_clean":"2024-05-08T04:22:47.001670+0000","last_became_active":"2024-05-08T04:22:43.972696+0000","last_became_peered":"2024-05-08T04:22:43.972696+0000","last_unstale":"2024-05-08T04:22:47.001670+0000","last_undegraded":"2024-05-08T04:22:47.001670+0000","last_fullsized":"2024-05-08T04:22:47.001670+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:38:11.143153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991240+0000","last_change":"2024-05-08T04:22:44.993901+0000","last_active":"2024-05-08T04:22:45.991240+0000","last_peered":"2024-05-08T04:22:45.991240+0000","last_clean":"2024-05-08T04:22:45.991240+0000","last_became_active":"2024-05-08T04:22:44.993351+0000","last_became_peered":"2024-05-08T04:22:44.993351+0000","last_unstale":"2024-05-08T04:22:45.991240+0000","last_undegraded":"2024-05-08T04:22:45.991240+0000","last_fullsized":"2024-05-08T04:22:45.991240+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:06.876165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.941109+0000","last_change":"2024-05-08T04:22:43.972873+0000","last_active":"2024-05-08T04:22:46.941109+0000","last_peered":"2024-05-08T04:22:46.941109+0000","last_clean":"2024-05-08T04:22:46.941109+0000","last_became_active":"2024-05-08T04:22:43.972581+0000","last_became_peered":"2024-05-08T04:22:43.972581+0000","last_unstale":"2024-05-08T04:22:46.941109+0000","last_undegraded":"2024-05-08T04:22:46.941109+0000","last_fullsized":"2024-05-08T04:22:46.941109+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:09.299473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573251+0000","last_change":"2024-05-08T04:22:44.991457+0000","last_active":"2024-05-08T04:22:46.573251+0000","last_peered":"2024-05-08T04:22:46.573251+0000","last_clean":"2024-05-08T04:22:46.573251+0000","last_became_active":"2024-05-08T04:22:44.991196+0000","last_became_peered":"2024-05-08T04:22:44.991196+0000","last_unstale":"2024-05-08T04:22:46.573251+0000","last_undegraded":"2024-05-08T04:22:46.573251+0000","last_fullsized":"2024-05-08T04:22:46.573251+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:59:23.614912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196849+0000","last_change":"2024-05-08T04:22:43.968981+0000","last_active":"2024-05-08T04:22:47.196849+0000","last_peered":"2024-05-08T04:22:47.196849+0000","last_clean":"2024-05-08T04:22:47.196849+0000","last_became_active":"2024-05-08T04:22:43.968698+0000","last_became_peered":"2024-05-08T04:22:43.968698+0000","last_unstale":"2024-05-08T04:22:47.196849+0000","last_undegraded":"2024-05-08T04:22:47.196849+0000","last_fullsized":"2024-05-08T04:22:47.196849+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:52:11.079075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196790+0000","last_change":"2024-05-08T04:22:44.981723+0000","last_active":"2024-05-08T04:22:47.196790+0000","last_peered":"2024-05-08T04:22:47.196790+0000","last_clean":"2024-05-08T04:22:47.196790+0000","last_became_active":"2024-05-08T04:22:44.981466+0000","last_became_peered":"2024-05-08T04:22:44.981466+0000","last_unstale":"2024-05-08T04:22:47.196790+0000","last_undegraded":"2024-05-08T04:22:47.196790+0000","last_fullsized":"2024-05-08T04:22:47.196790+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:23:06.530306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196420+0000","last_change":"2024-05-08T04:22:43.969461+0000","last_active":"2024-05-08T04:22:47.196420+0000","last_peered":"2024-05-08T04:22:47.196420+0000","last_clean":"2024-05-08T04:22:47.196420+0000","last_became_active":"2024-05-08T04:22:43.969199+0000","last_became_peered":"2024-05-08T04:22:43.969199+0000","last_unstale":"2024-05-08T04:22:47.196420+0000","last_undegraded":"2024-05-08T04:22:47.196420+0000","last_fullsized":"2024-05-08T04:22:47.196420+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:04:31.898222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196772+0000","last_change":"2024-05-08T04:22:44.998151+0000","last_active":"2024-05-08T04:22:47.196772+0000","last_peered":"2024-05-08T04:22:47.196772+0000","last_clean":"2024-05-08T04:22:47.196772+0000","last_became_active":"2024-05-08T04:22:44.997851+0000","last_became_peered":"2024-05-08T04:22:44.997851+0000","last_unstale":"2024-05-08T04:22:47.196772+0000","last_undegraded":"2024-05-08T04:22:47.196772+0000","last_fullsized":"2024-05-08T04:22:47.196772+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:41:21.810324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984115+0000","last_change":"2024-05-08T04:22:43.968133+0000","last_active":"2024-05-08T04:22:45.984115+0000","last_peered":"2024-05-08T04:22:45.984115+0000","last_clean":"2024-05-08T04:22:45.984115+0000","last_became_active":"2024-05-08T04:22:43.967676+0000","last_became_peered":"2024-05-08T04:22:43.967676+0000","last_unstale":"2024-05-08T04:22:45.984115+0000","last_undegraded":"2024-05-08T04:22:45.984115+0000","last_fullsized":"2024-05-08T04:22:45.984115+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:49:36.623010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001517+0000","last_change":"2024-05-08T04:22:44.983914+0000","last_active":"2024-05-08T04:22:47.001517+0000","last_peered":"2024-05-08T04:22:47.001517+0000","last_clean":"2024-05-08T04:22:47.001517+0000","last_became_active":"2024-05-08T04:22:44.983651+0000","last_became_peered":"2024-05-08T04:22:44.983651+0000","last_unstale":"2024-05-08T04:22:47.001517+0000","last_undegraded":"2024-05-08T04:22:47.001517+0000","last_fullsized":"2024-05-08T04:22:47.001517+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:36.325431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940947+0000","last_change":"2024-05-08T04:22:43.974590+0000","last_active":"2024-05-08T04:22:46.940947+0000","last_peered":"2024-05-08T04:22:46.940947+0000","last_clean":"2024-05-08T04:22:46.940947+0000","last_became_active":"2024-05-08T04:22:43.974047+0000","last_became_peered":"2024-05-08T04:22:43.974047+0000","last_unstale":"2024-05-08T04:22:46.940947+0000","last_undegraded":"2024-05-08T04:22:46.940947+0000","last_fullsized":"2024-05-08T04:22:46.940947+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:58:39.442021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.197021+0000","last_change":"2024-05-08T04:22:44.979517+0000","last_active":"2024-05-08T04:22:47.197021+0000","last_peered":"2024-05-08T04:22:47.197021+0000","last_clean":"2024-05-08T04:22:47.197021+0000","last_became_active":"2024-05-08T04:22:44.979236+0000","last_became_peered":"2024-05-08T04:22:44.979236+0000","last_unstale":"2024-05-08T04:22:47.197021+0000","last_undegraded":"2024-05-08T04:22:47.197021+0000","last_fullsized":"2024-05-08T04:22:47.197021+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:21:12.231732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.985299+0000","last_change":"2024-05-08T04:22:43.969497+0000","last_active":"2024-05-08T04:22:45.985299+0000","last_peered":"2024-05-08T04:22:45.985299+0000","last_clean":"2024-05-08T04:22:45.985299+0000","last_became_active":"2024-05-08T04:22:43.969213+0000","last_became_peered":"2024-05-08T04:22:43.969213+0000","last_unstale":"2024-05-08T04:22:45.985299+0000","last_undegraded":"2024-05-08T04:22:45.985299+0000","last_fullsized":"2024-05-08T04:22:45.985299+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:11.143038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.197078+0000","last_change":"2024-05-08T04:22:44.988091+0000","last_active":"2024-05-08T04:22:47.197078+0000","last_peered":"2024-05-08T04:22:47.197078+0000","last_clean":"2024-05-08T04:22:47.197078+0000","last_became_active":"2024-05-08T04:22:44.987826+0000","last_became_peered":"2024-05-08T04:22:44.987826+0000","last_unstale":"2024-05-08T04:22:47.197078+0000","last_undegraded":"2024-05-08T04:22:47.197078+0000","last_fullsized":"2024-05-08T04:22:47.197078+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:35:34.956623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573524+0000","last_change":"2024-05-08T04:22:43.967333+0000","last_active":"2024-05-08T04:22:46.573524+0000","last_peered":"2024-05-08T04:22:46.573524+0000","last_clean":"2024-05-08T04:22:46.573524+0000","last_became_active":"2024-05-08T04:22:43.967048+0000","last_became_peered":"2024-05-08T04:22:43.967048+0000","last_unstale":"2024-05-08T04:22:46.573524+0000","last_undegraded":"2024-05-08T04:22:46.573524+0000","last_fullsized":"2024-05-08T04:22:46.573524+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:44:54.653856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.002012+0000","last_change":"2024-05-08T04:22:44.995178+0000","last_active":"2024-05-08T04:22:47.002012+0000","last_peered":"2024-05-08T04:22:47.002012+0000","last_clean":"2024-05-08T04:22:47.002012+0000","last_became_active":"2024-05-08T04:22:44.994926+0000","last_became_peered":"2024-05-08T04:22:44.994926+0000","last_unstale":"2024-05-08T04:22:47.002012+0000","last_undegraded":"2024-05-08T04:22:47.002012+0000","last_fullsized":"2024-05-08T04:22:47.002012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:09:01.494184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573445+0000","last_change":"2024-05-08T04:22:43.970143+0000","last_active":"2024-05-08T04:22:46.573445+0000","last_peered":"2024-05-08T04:22:46.573445+0000","last_clean":"2024-05-08T04:22:46.573445+0000","last_became_active":"2024-05-08T04:22:43.969851+0000","last_became_peered":"2024-05-08T04:22:43.969851+0000","last_unstale":"2024-05-08T04:22:46.573445+0000","last_undegraded":"2024-05-08T04:22:46.573445+0000","last_fullsized":"2024-05-08T04:22:46.573445+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:52:11.079075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573458+0000","last_change":"2024-05-08T04:22:44.994700+0000","last_active":"2024-05-08T04:22:46.573458+0000","last_peered":"2024-05-08T04:22:46.573458+0000","last_clean":"2024-05-08T04:22:46.573458+0000","last_became_active":"2024-05-08T04:22:44.994235+0000","last_became_peered":"2024-05-08T04:22:44.994235+0000","last_unstale":"2024-05-08T04:22:46.573458+0000","last_undegraded":"2024-05-08T04:22:46.573458+0000","last_fullsized":"2024-05-08T04:22:46.573458+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:34:11.572630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984456+0000","last_change":"2024-05-08T04:22:43.970499+0000","last_active":"2024-05-08T04:22:45.984456+0000","last_peered":"2024-05-08T04:22:45.984456+0000","last_clean":"2024-05-08T04:22:45.984456+0000","last_became_active":"2024-05-08T04:22:43.970159+0000","last_became_peered":"2024-05-08T04:22:43.970159+0000","last_unstale":"2024-05-08T04:22:45.984456+0000","last_undegraded":"2024-05-08T04:22:45.984456+0000","last_fullsized":"2024-05-08T04:22:45.984456+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:25:38.426542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940954+0000","last_change":"2024-05-08T04:22:44.989057+0000","last_active":"2024-05-08T04:22:46.940954+0000","last_peered":"2024-05-08T04:22:46.940954+0000","last_clean":"2024-05-08T04:22:46.940954+0000","last_became_active":"2024-05-08T04:22:44.987461+0000","last_became_peered":"2024-05-08T04:22:44.987461+0000","last_unstale":"2024-05-08T04:22:46.940954+0000","last_undegraded":"2024-05-08T04:22:46.940954+0000","last_fullsized":"2024-05-08T04:22:46.940954+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:21:17.377146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940709+0000","last_change":"2024-05-08T04:22:43.974854+0000","last_active":"2024-05-08T04:22:46.940709+0000","last_peered":"2024-05-08T04:22:46.940709+0000","last_clean":"2024-05-08T04:22:46.940709+0000","last_became_active":"2024-05-08T04:22:43.974525+0000","last_became_peered":"2024-05-08T04:22:43.974525+0000","last_unstale":"2024-05-08T04:22:46.940709+0000","last_undegraded":"2024-05-08T04:22:46.940709+0000","last_fullsized":"2024-05-08T04:22:46.940709+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:31:35.808757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984674+0000","last_change":"2024-05-08T04:22:44.984641+0000","last_active":"2024-05-08T04:22:45.984674+0000","last_peered":"2024-05-08T04:22:45.984674+0000","last_clean":"2024-05-08T04:22:45.984674+0000","last_became_active":"2024-05-08T04:22:44.984345+0000","last_became_peered":"2024-05-08T04:22:44.984345+0000","last_unstale":"2024-05-08T04:22:45.984674+0000","last_undegraded":"2024-05-08T04:22:45.984674+0000","last_fullsized":"2024-05-08T04:22:45.984674+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:53:33.659528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196520+0000","last_change":"2024-05-08T04:22:43.973387+0000","last_active":"2024-05-08T04:22:47.196520+0000","last_peered":"2024-05-08T04:22:47.196520+0000","last_clean":"2024-05-08T04:22:47.196520+0000","last_became_active":"2024-05-08T04:22:43.973140+0000","last_became_peered":"2024-05-08T04:22:43.973140+0000","last_unstale":"2024-05-08T04:22:47.196520+0000","last_undegraded":"2024-05-08T04:22:47.196520+0000","last_fullsized":"2024-05-08T04:22:47.196520+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:25:38.426542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984909+0000","last_change":"2024-05-08T04:22:44.992912+0000","last_active":"2024-05-08T04:22:45.984909+0000","last_peered":"2024-05-08T04:22:45.984909+0000","last_clean":"2024-05-08T04:22:45.984909+0000","last_became_active":"2024-05-08T04:22:44.992642+0000","last_became_peered":"2024-05-08T04:22:44.992642+0000","last_unstale":"2024-05-08T04:22:45.984909+0000","last_undegraded":"2024-05-08T04:22:45.984909+0000","last_fullsized":"2024-05-08T04:22:45.984909+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:41:21.562300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940493+0000","last_change":"2024-05-08T04:22:43.973316+0000","last_active":"2024-05-08T04:22:46.940493+0000","last_peered":"2024-05-08T04:22:46.940493+0000","last_clean":"2024-05-08T04:22:46.940493+0000","last_became_active":"2024-05-08T04:22:43.972974+0000","last_became_peered":"2024-05-08T04:22:43.972974+0000","last_unstale":"2024-05-08T04:22:46.940493+0000","last_undegraded":"2024-05-08T04:22:46.940493+0000","last_fullsized":"2024-05-08T04:22:46.940493+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:53:32.654808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984280+0000","last_change":"2024-05-08T04:22:44.994561+0000","last_active":"2024-05-08T04:22:45.984280+0000","last_peered":"2024-05-08T04:22:45.984280+0000","last_clean":"2024-05-08T04:22:45.984280+0000","last_became_active":"2024-05-08T04:22:44.993963+0000","last_became_peered":"2024-05-08T04:22:44.993963+0000","last_unstale":"2024-05-08T04:22:45.984280+0000","last_undegraded":"2024-05-08T04:22:45.984280+0000","last_fullsized":"2024-05-08T04:22:45.984280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:31:36.813477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.990821+0000","last_change":"2024-05-08T04:22:43.972082+0000","last_active":"2024-05-08T04:22:45.990821+0000","last_peered":"2024-05-08T04:22:45.990821+0000","last_clean":"2024-05-08T04:22:45.990821+0000","last_became_active":"2024-05-08T04:22:43.971827+0000","last_became_peered":"2024-05-08T04:22:43.971827+0000","last_unstale":"2024-05-08T04:22:45.990821+0000","last_undegraded":"2024-05-08T04:22:45.990821+0000","last_fullsized":"2024-05-08T04:22:45.990821+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:07.770962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991114+0000","last_change":"2024-05-08T04:22:44.985704+0000","last_active":"2024-05-08T04:22:45.991114+0000","last_peered":"2024-05-08T04:22:45.991114+0000","last_clean":"2024-05-08T04:22:45.991114+0000","last_became_active":"2024-05-08T04:22:44.985437+0000","last_became_peered":"2024-05-08T04:22:44.985437+0000","last_unstale":"2024-05-08T04:22:45.991114+0000","last_undegraded":"2024-05-08T04:22:45.991114+0000","last_fullsized":"2024-05-08T04:22:45.991114+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:43:53.051724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.990292+0000","last_change":"2024-05-08T04:22:43.966768+0000","last_active":"2024-05-08T04:22:45.990292+0000","last_peered":"2024-05-08T04:22:45.990292+0000","last_clean":"2024-05-08T04:22:45.990292+0000","last_became_active":"2024-05-08T04:22:43.966226+0000","last_became_peered":"2024-05-08T04:22:43.966226+0000","last_unstale":"2024-05-08T04:22:45.990292+0000","last_undegraded":"2024-05-08T04:22:45.990292+0000","last_fullsized":"2024-05-08T04:22:45.990292+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:09:40.728019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.941057+0000","last_change":"2024-05-08T04:22:44.991982+0000","last_active":"2024-05-08T04:22:46.941057+0000","last_peered":"2024-05-08T04:22:46.941057+0000","last_clean":"2024-05-08T04:22:46.941057+0000","last_became_active":"2024-05-08T04:22:44.991318+0000","last_became_peered":"2024-05-08T04:22:44.991318+0000","last_unstale":"2024-05-08T04:22:46.941057+0000","last_undegraded":"2024-05-08T04:22:46.941057+0000","last_fullsized":"2024-05-08T04:22:46.941057+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:03:06.327347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196655+0000","last_change":"2024-05-08T04:22:43.973250+0000","last_active":"2024-05-08T04:22:47.196655+0000","last_peered":"2024-05-08T04:22:47.196655+0000","last_clean":"2024-05-08T04:22:47.196655+0000","last_became_active":"2024-05-08T04:22:43.972990+0000","last_became_peered":"2024-05-08T04:22:43.972990+0000","last_unstale":"2024-05-08T04:22:47.196655+0000","last_undegraded":"2024-05-08T04:22:47.196655+0000","last_fullsized":"2024-05-08T04:22:47.196655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:11.647149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991394+0000","last_change":"2024-05-08T04:22:44.993667+0000","last_active":"2024-05-08T04:22:45.991394+0000","last_peered":"2024-05-08T04:22:45.991394+0000","last_clean":"2024-05-08T04:22:45.991394+0000","last_became_active":"2024-05-08T04:22:44.993271+0000","last_became_peered":"2024-05-08T04:22:44.993271+0000","last_unstale":"2024-05-08T04:22:45.991394+0000","last_undegraded":"2024-05-08T04:22:45.991394+0000","last_fullsized":"2024-05-08T04:22:45.991394+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:52:45.912439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196918+0000","last_change":"2024-05-08T04:22:43.975942+0000","last_active":"2024-05-08T04:22:47.196918+0000","last_peered":"2024-05-08T04:22:47.196918+0000","last_clean":"2024-05-08T04:22:47.196918+0000","last_became_active":"2024-05-08T04:22:43.975656+0000","last_became_peered":"2024-05-08T04:22:43.975656+0000","last_unstale":"2024-05-08T04:22:47.196918+0000","last_undegraded":"2024-05-08T04:22:47.196918+0000","last_fullsized":"2024-05-08T04:22:47.196918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:44:54.653856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.940764+0000","last_change":"2024-05-08T04:22:44.987182+0000","last_active":"2024-05-08T04:22:46.940764+0000","last_peered":"2024-05-08T04:22:46.940764+0000","last_clean":"2024-05-08T04:22:46.940764+0000","last_became_active":"2024-05-08T04:22:44.986452+0000","last_became_peered":"2024-05-08T04:22:44.986452+0000","last_unstale":"2024-05-08T04:22:46.940764+0000","last_undegraded":"2024-05-08T04:22:46.940764+0000","last_fullsized":"2024-05-08T04:22:46.940764+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:20:26.536479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196655+0000","last_change":"2024-05-08T04:22:43.972376+0000","last_active":"2024-05-08T04:22:47.196655+0000","last_peered":"2024-05-08T04:22:47.196655+0000","last_clean":"2024-05-08T04:22:47.196655+0000","last_became_active":"2024-05-08T04:22:43.966772+0000","last_became_peered":"2024-05-08T04:22:43.966772+0000","last_unstale":"2024-05-08T04:22:47.196655+0000","last_undegraded":"2024-05-08T04:22:47.196655+0000","last_fullsized":"2024-05-08T04:22:47.196655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:11:08.497799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984308+0000","last_change":"2024-05-08T04:22:44.991448+0000","last_active":"2024-05-08T04:22:45.984308+0000","last_peered":"2024-05-08T04:22:45.984308+0000","last_clean":"2024-05-08T04:22:45.984308+0000","last_became_active":"2024-05-08T04:22:44.991012+0000","last_became_peered":"2024-05-08T04:22:44.991012+0000","last_unstale":"2024-05-08T04:22:45.984308+0000","last_undegraded":"2024-05-08T04:22:45.984308+0000","last_fullsized":"2024-05-08T04:22:45.984308+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:10.304193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991032+0000","last_change":"2024-05-08T04:22:43.974773+0000","last_active":"2024-05-08T04:22:45.991032+0000","last_peered":"2024-05-08T04:22:45.991032+0000","last_clean":"2024-05-08T04:22:45.991032+0000","last_became_active":"2024-05-08T04:22:43.974487+0000","last_became_peered":"2024-05-08T04:22:43.974487+0000","last_unstale":"2024-05-08T04:22:45.991032+0000","last_undegraded":"2024-05-08T04:22:45.991032+0000","last_fullsized":"2024-05-08T04:22:45.991032+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:20:25.531759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573135+0000","last_change":"2024-05-08T04:22:44.994207+0000","last_active":"2024-05-08T04:22:46.573135+0000","last_peered":"2024-05-08T04:22:46.573135+0000","last_clean":"2024-05-08T04:22:46.573135+0000","last_became_active":"2024-05-08T04:22:44.993975+0000","last_became_peered":"2024-05-08T04:22:44.993975+0000","last_unstale":"2024-05-08T04:22:46.573135+0000","last_undegraded":"2024-05-08T04:22:46.573135+0000","last_fullsized":"2024-05-08T04:22:46.573135+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:23:06.530306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.984205+0000","last_change":"2024-05-08T04:22:43.974034+0000","last_active":"2024-05-08T04:22:45.984205+0000","last_peered":"2024-05-08T04:22:45.984205+0000","last_clean":"2024-05-08T04:22:45.984205+0000","last_became_active":"2024-05-08T04:22:43.973741+0000","last_became_peered":"2024-05-08T04:22:43.973741+0000","last_unstale":"2024-05-08T04:22:45.984205+0000","last_undegraded":"2024-05-08T04:22:45.984205+0000","last_fullsized":"2024-05-08T04:22:45.984205+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:11.143038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.001700+0000","last_change":"2024-05-08T04:22:44.982846+0000","last_active":"2024-05-08T04:22:47.001700+0000","last_peered":"2024-05-08T04:22:47.001700+0000","last_clean":"2024-05-08T04:22:47.001700+0000","last_became_active":"2024-05-08T04:22:44.982571+0000","last_became_peered":"2024-05-08T04:22:44.982571+0000","last_unstale":"2024-05-08T04:22:47.001700+0000","last_undegraded":"2024-05-08T04:22:47.001700+0000","last_fullsized":"2024-05-08T04:22:47.001700+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:31:36.813477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:47.196751+0000","last_change":"2024-05-08T04:22:43.973680+0000","last_active":"2024-05-08T04:22:47.196751+0000","last_peered":"2024-05-08T04:22:47.196751+0000","last_clean":"2024-05-08T04:22:47.196751+0000","last_became_active":"2024-05-08T04:22:43.973353+0000","last_became_peered":"2024-05-08T04:22:43.973353+0000","last_unstale":"2024-05-08T04:22:47.196751+0000","last_undegraded":"2024-05-08T04:22:47.196751+0000","last_fullsized":"2024-05-08T04:22:47.196751+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:05.212660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.985270+0000","last_change":"2024-05-08T04:22:44.988776+0000","last_active":"2024-05-08T04:22:45.985270+0000","last_peered":"2024-05-08T04:22:45.985270+0000","last_clean":"2024-05-08T04:22:45.985270+0000","last_became_active":"2024-05-08T04:22:44.988397+0000","last_became_peered":"2024-05-08T04:22:44.988397+0000","last_unstale":"2024-05-08T04:22:45.985270+0000","last_undegraded":"2024-05-08T04:22:45.985270+0000","last_fullsized":"2024-05-08T04:22:45.985270+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:43.952761+0000","last_clean_scrub_stamp":"2024-05-08T04:22:43.952761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:20:26.536479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:45.991149+0000","last_change":"2024-05-08T04:22:43.968863+0000","last_active":"2024-05-08T04:22:45.991149+0000","last_peered":"2024-05-08T04:22:45.991149+0000","last_clean":"2024-05-08T04:22:45.991149+0000","last_became_active":"2024-05-08T04:22:43.967786+0000","last_became_peered":"2024-05-08T04:22:43.967786+0000","last_unstale":"2024-05-08T04:22:45.991149+0000","last_undegraded":"2024-05-08T04:22:45.991149+0000","last_fullsized":"2024-05-08T04:22:45.991149+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:22:42.948041+0000","last_clean_scrub_stamp":"2024-05-08T04:22:42.948041+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:25:24.830406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-05-08T04:22:46.573108+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:22:46.573108+0000","last_peered":"2024-05-08T04:22:46.573108+0000","last_clean":"2024-05-08T04:22:46.573108+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:22:46.573108+0000","last_undegraded":"2024-05-08T04:22:46.573108+0000","last_fullsized":"2024-05-08T04:22:46.573108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":208371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":536576,"data_stored":215253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1126400,"data_stored":805027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":536576,"data_stored":210041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":216249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":208427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":805075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":209009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:22:52.641 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-08T04:22:52.641 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-08T04:22:52.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.782+0000 7f92cace1640 1 Processor -- start 2024-05-08T04:22:52.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.782+0000 7f92cace1640 1 -- start start 2024-05-08T04:22:52.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92cace1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c415db50 0x7f92c40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:52.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92cace1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f92c40b5990 0x7f92c41617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:52.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92cace1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c4162180 con 0x7f92c4161cf0 2024-05-08T04:22:52.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92cace1640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c41626e0 con 0x7f92c40b5990 2024-05-08T04:22:52.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92cace1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4162400 con 0x7f92c415db50 2024-05-08T04:22:52.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92c3fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f92c40b5990 0x7f92c41617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:52.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92c3fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f92c40b5990 0x7f92c41617b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57458/0 (socket says 172.21.15.104:57458) 2024-05-08T04:22:52.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92c3fff640 1 -- 172.21.15.104:0/2136204662 learned_addr learned my addr 172.21.15.104:0/2136204662 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:52.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92c8a7d640 1 --2- 172.21.15.104:0/2136204662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c415db50 0x7f92c40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:52.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92c3fff640 1 -- 172.21.15.104:0/2136204662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c415db50 msgr2=0x7f92c40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:52.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92c3fff640 1 --2- 172.21.15.104:0/2136204662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c415db50 0x7f92c40b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92c3fff640 1 -- 172.21.15.104:0/2136204662 >> v1:172.21.15.183:6789/0 conn(0x7f92c4161cf0 legacy=0x7f92c406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:52.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92c3fff640 1 -- 172.21.15.104:0/2136204662 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c40d1b80 con 0x7f92c40b5990 2024-05-08T04:22:52.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.783+0000 7f92c8a7d640 1 --2- 172.21.15.104:0/2136204662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c415db50 0x7f92c40b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:52.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.784+0000 7f92c3fff640 1 --2- 172.21.15.104:0/2136204662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92c40b5990 0x7f92c41617b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009870 tx=0x7f92b002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40075e9247c0c5c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:52.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.784+0000 7f92c37fe640 1 -- 172.21.15.104:0/2136204662 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0037070 con 0x7f92c40b5990 2024-05-08T04:22:52.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.784+0000 7f92c37fe640 1 -- 172.21.15.104:0/2136204662 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b0032440 con 0x7f92c40b5990 2024-05-08T04:22:52.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.784+0000 7f92c37fe640 1 -- 172.21.15.104:0/2136204662 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0032810 con 0x7f92c40b5990 2024-05-08T04:22:52.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.784+0000 7f92cace1640 1 -- 172.21.15.104:0/2136204662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92c40b5990 msgr2=0x7f92c41617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:52.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.784+0000 7f92cace1640 1 --2- 172.21.15.104:0/2136204662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92c40b5990 0x7f92c41617b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009870 tx=0x7f92b002a1c0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.784+0000 7f92cace1640 1 -- 172.21.15.104:0/2136204662 shutdown_connections 2024-05-08T04:22:52.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.784+0000 7f92cace1640 1 --2- 172.21.15.104:0/2136204662 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92c40b5990 0x7f92c41617b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.784+0000 7f92cace1640 1 --2- 172.21.15.104:0/2136204662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c415db50 0x7f92c40b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.784+0000 7f92cace1640 1 -- 172.21.15.104:0/2136204662 >> 172.21.15.104:0/2136204662 conn(0x7f92c40d0450 msgr2=0x7f92c40d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:52.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.785+0000 7f92cace1640 1 -- 172.21.15.104:0/2136204662 shutdown_connections 2024-05-08T04:22:52.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.785+0000 7f92cace1640 1 -- 172.21.15.104:0/2136204662 wait complete. 2024-05-08T04:22:52.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.786+0000 7f92cace1640 1 Processor -- start 2024-05-08T04:22:52.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.786+0000 7f92cace1640 1 -- start start 2024-05-08T04:22:52.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92cace1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92c40b5990 0x7f92c41f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:52.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92cace1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c415db50 0x7f92c4158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:52.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92cace1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c4161cf0 0x7f92c4159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:52.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92cace1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40d3670 con 0x7f92c40b5990 2024-05-08T04:22:52.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92cace1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40d2140 con 0x7f92c415db50 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92cace1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40b6b00 con 0x7f92c4161cf0 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c8a7d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92c40b5990 0x7f92c41f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c8a7d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92c40b5990 0x7f92c41f6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57462/0 (socket says 172.21.15.104:57462) 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c8a7d640 1 -- 172.21.15.104:0/2873874739 learned_addr learned my addr 172.21.15.104:0/2873874739 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c927e640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c4161cf0 0x7f92c4159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c3fff640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c415db50 0x7f92c4158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c8a7d640 1 -- 172.21.15.104:0/2873874739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c4161cf0 msgr2=0x7f92c4159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c8a7d640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c4161cf0 0x7f92c4159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c8a7d640 1 -- 172.21.15.104:0/2873874739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c415db50 msgr2=0x7f92c4158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c8a7d640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c415db50 0x7f92c4158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c8a7d640 1 -- 172.21.15.104:0/2873874739 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4160150 con 0x7f92c40b5990 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c8a7d640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92c40b5990 0x7f92c41f6810 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f92b800e810 tx=0x7f92b800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c17fa640 1 -- 172.21.15.104:0/2873874739 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800f040 con 0x7f92c40b5990 2024-05-08T04:22:52.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c17fa640 1 -- 172.21.15.104:0/2873874739 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8004030 con 0x7f92c40b5990 2024-05-08T04:22:52.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92c17fa640 1 -- 172.21.15.104:0/2873874739 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8004400 con 0x7f92c40b5990 2024-05-08T04:22:52.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92cace1640 1 -- 172.21.15.104:0/2873874739 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c41f74a0 con 0x7f92c40b5990 2024-05-08T04:22:52.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.787+0000 7f92cace1640 1 -- 172.21.15.104:0/2873874739 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c41f7a60 con 0x7f92c40b5990 2024-05-08T04:22:52.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.788+0000 7f92cace1640 1 -- 172.21.15.104:0/2873874739 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c4074830 con 0x7f92c40b5990 2024-05-08T04:22:52.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.789+0000 7f92c17fa640 1 -- 172.21.15.104:0/2873874739 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f92b800c6d0 con 0x7f92c40b5990 2024-05-08T04:22:52.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.789+0000 7f92c17fa640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f92a806b680 0x7f92a806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:52.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.789+0000 7f92c3fff640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f92a806b680 0x7f92a806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:52.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.789+0000 7f92c17fa640 1 -- 172.21.15.104:0/2873874739 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f92b808a400 con 0x7f92c40b5990 2024-05-08T04:22:52.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.790+0000 7f92c3fff640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f92a806b680 0x7f92a806db40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f92b0034000 tx=0x7f92b002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:52.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:52.793+0000 7f92c17fa640 1 -- 172.21.15.104:0/2873874739 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f92c4160150 con 0x7f92c40b5990 2024-05-08T04:22:53.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.034+0000 7f92cace1640 1 -- 172.21.15.104:0/2873874739 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f92c40d1600 con 0x7f92c40b5990 2024-05-08T04:22:53.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.036+0000 7f92c17fa640 1 -- 172.21.15.104:0/2873874739 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+147 (secure 0 0 0) 0x7f92b8017020 con 0x7f92c40b5990 2024-05-08T04:22:53.037 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-05-08T04:22:53.037 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQB9/TpmmVCJDBAA7kFxGuTTRTJge+xrcPo3lw== 2024-05-08T04:22:53.037 INFO:teuthology.orchestra.run.smithi104.stdout: caps mds = "allow" 2024-05-08T04:22:53.037 INFO:teuthology.orchestra.run.smithi104.stdout: caps mon = "allow r" 2024-05-08T04:22:53.037 INFO:teuthology.orchestra.run.smithi104.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-08T04:22:53.037 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-05-08T04:22:53.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.038+0000 7f92cace1640 1 -- 172.21.15.104:0/2873874739 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f92a806b680 msgr2=0x7f92a806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.038+0000 7f92cace1640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f92a806b680 0x7f92a806db40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f92b0034000 tx=0x7f92b002e000 comp rx=0 tx=0).stop 2024-05-08T04:22:53.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.038+0000 7f92cace1640 1 -- 172.21.15.104:0/2873874739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92c40b5990 msgr2=0x7f92c41f6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.038+0000 7f92cace1640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92c40b5990 0x7f92c41f6810 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f92b800e810 tx=0x7f92b800ecd0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.038+0000 7f92cace1640 1 -- 172.21.15.104:0/2873874739 shutdown_connections 2024-05-08T04:22:53.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.038+0000 7f92cace1640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f92a806b680 0x7f92a806db40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.038+0000 7f92cace1640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c415db50 0x7f92c4158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.038+0000 7f92cace1640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c4161cf0 0x7f92c4159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.038+0000 7f92cace1640 1 --2- 172.21.15.104:0/2873874739 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92c40b5990 0x7f92c41f6810 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.038+0000 7f92cace1640 1 -- 172.21.15.104:0/2873874739 >> 172.21.15.104:0/2873874739 conn(0x7f92c40d0450 msgr2=0x7f92c40d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:53.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.038+0000 7f92cace1640 1 -- 172.21.15.104:0/2873874739 shutdown_connections 2024-05-08T04:22:53.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.038+0000 7f92cace1640 1 -- 172.21.15.104:0/2873874739 wait complete. 2024-05-08T04:22:53.050 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:22:53.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.147+0000 7fc5b7e9e640 1 Processor -- start 2024-05-08T04:22:53.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.148+0000 7fc5b7e9e640 1 -- start start 2024-05-08T04:22:53.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.148+0000 7fc5b7e9e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc5b00ceee0 0x7fc5b00b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.148+0000 7fc5b7e9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5b00b4700 0x7fc5b006e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.149+0000 7fc5b7e9e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b015e780 con 0x7fc5b006e330 2024-05-08T04:22:53.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.149+0000 7fc5b7e9e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b015f390 con 0x7fc5b00ceee0 2024-05-08T04:22:53.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.149+0000 7fc5b7e9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b015ea60 con 0x7fc5b00b4700 2024-05-08T04:22:53.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.149+0000 7fc5b5c3a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc5b00ceee0 0x7fc5b00b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.149+0000 7fc5b5c3a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc5b00ceee0 0x7fc5b00b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57476/0 (socket says 172.21.15.104:57476) 2024-05-08T04:22:53.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.149+0000 7fc5b5c3a640 1 -- 172.21.15.104:0/992446979 learned_addr learned my addr 172.21.15.104:0/992446979 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:53.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.149+0000 7fc5b643b640 1 --2- 172.21.15.104:0/992446979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5b00b4700 0x7fc5b006e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.149+0000 7fc5b5c3a640 1 -- 172.21.15.104:0/992446979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5b00b4700 msgr2=0x7fc5b006e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:53.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.149+0000 7fc5b5c3a640 1 --2- 172.21.15.104:0/992446979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5b00b4700 0x7fc5b006e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.149+0000 7fc5b5c3a640 1 -- 172.21.15.104:0/992446979 >> v1:172.21.15.183:6789/0 conn(0x7fc5b006e330 legacy=0x7fc5b00b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:53.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.149+0000 7fc5b5c3a640 1 -- 172.21.15.104:0/992446979 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b015ed40 con 0x7fc5b00ceee0 2024-05-08T04:22:53.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.149+0000 7fc5b643b640 1 --2- 172.21.15.104:0/992446979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5b00b4700 0x7fc5b006e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:53.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.150+0000 7fc5b5c3a640 1 --2- 172.21.15.104:0/992446979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5b00ceee0 0x7fc5b00b26f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009870 tx=0x7fc5a402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a7bdc35a9a5766 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:53.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.150+0000 7fc5b4c38640 1 -- 172.21.15.104:0/992446979 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4037070 con 0x7fc5b00ceee0 2024-05-08T04:22:53.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.150+0000 7fc5b4c38640 1 -- 172.21.15.104:0/992446979 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a4032440 con 0x7fc5b00ceee0 2024-05-08T04:22:53.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.150+0000 7fc5b4c38640 1 -- 172.21.15.104:0/992446979 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4032810 con 0x7fc5b00ceee0 2024-05-08T04:22:53.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.150+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/992446979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5b00ceee0 msgr2=0x7fc5b00b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.150+0000 7fc5b7e9e640 1 --2- 172.21.15.104:0/992446979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5b00ceee0 0x7fc5b00b26f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009870 tx=0x7fc5a402a210 comp rx=0 tx=0).stop 2024-05-08T04:22:53.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.150+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/992446979 shutdown_connections 2024-05-08T04:22:53.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.150+0000 7fc5b7e9e640 1 --2- 172.21.15.104:0/992446979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5b00b4700 0x7fc5b006e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.150+0000 7fc5b7e9e640 1 --2- 172.21.15.104:0/992446979 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5b00ceee0 0x7fc5b00b26f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.150+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/992446979 >> 172.21.15.104:0/992446979 conn(0x7fc5b00b13f0 msgr2=0x7fc5b00b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:53.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.151+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/992446979 shutdown_connections 2024-05-08T04:22:53.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.151+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/992446979 wait complete. 2024-05-08T04:22:53.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.152+0000 7fc5b7e9e640 1 Processor -- start 2024-05-08T04:22:53.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.152+0000 7fc5b7e9e640 1 -- start start 2024-05-08T04:22:53.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.152+0000 7fc5b7e9e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5b006e330 0x7fc5b01f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.152+0000 7fc5b7e9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5b00b4700 0x7fc5b01f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.152+0000 7fc5b7e9e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5b00ceee0 0x7fc5b0155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.152+0000 7fc5b7e9e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00cf440 con 0x7fc5b006e330 2024-05-08T04:22:53.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.152+0000 7fc5b7e9e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00cf2c0 con 0x7fc5b00ceee0 2024-05-08T04:22:53.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.152+0000 7fc5b7e9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b015b210 con 0x7fc5b00b4700 2024-05-08T04:22:53.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.152+0000 7fc5b5c3a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5b006e330 0x7fc5b01f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b5c3a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5b006e330 0x7fc5b01f4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57492/0 (socket says 172.21.15.104:57492) 2024-05-08T04:22:53.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b5c3a640 1 -- 172.21.15.104:0/3806906878 learned_addr learned my addr 172.21.15.104:0/3806906878 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b5439640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5b00b4700 0x7fc5b01f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b643b640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5b00ceee0 0x7fc5b0155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b5c3a640 1 -- 172.21.15.104:0/3806906878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5b00b4700 msgr2=0x7fc5b01f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b5c3a640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5b00b4700 0x7fc5b01f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b5c3a640 1 -- 172.21.15.104:0/3806906878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5b00ceee0 msgr2=0x7fc5b0155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b5c3a640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5b00ceee0 0x7fc5b0155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b5c3a640 1 -- 172.21.15.104:0/3806906878 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b01f48a0 con 0x7fc5b006e330 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b5439640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5b00b4700 0x7fc5b01f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b643b640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5b00ceee0 0x7fc5b0155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b5c3a640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5b006e330 0x7fc5b01f4aa0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4000c00 tx=0x7fc5a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5a27fc640 1 -- 172.21.15.104:0/3806906878 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4037040 con 0x7fc5b006e330 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5a27fc640 1 -- 172.21.15.104:0/3806906878 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a4042070 con 0x7fc5b006e330 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5a27fc640 1 -- 172.21.15.104:0/3806906878 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4030bd0 con 0x7fc5b006e330 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/3806906878 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b00ca960 con 0x7fc5b006e330 2024-05-08T04:22:53.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.153+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/3806906878 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b015b7a0 con 0x7fc5b006e330 2024-05-08T04:22:53.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.154+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/3806906878 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b0075010 con 0x7fc5b006e330 2024-05-08T04:22:53.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.155+0000 7fc5a27fc640 1 -- 172.21.15.104:0/3806906878 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fc5a4047460 con 0x7fc5b006e330 2024-05-08T04:22:53.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.155+0000 7fc5a27fc640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc59406b680 0x7fc59406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.155+0000 7fc5a27fc640 1 -- 172.21.15.104:0/3806906878 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fc5a40ab1b0 con 0x7fc5b006e330 2024-05-08T04:22:53.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.155+0000 7fc5b5439640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc59406b680 0x7fc59406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.155+0000 7fc5b5439640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc59406b680 0x7fc59406db40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00c9aa0 tx=0x7fc5ac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:53.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.159+0000 7fc5a27fc640 1 -- 172.21.15.104:0/3806906878 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc5b01f48a0 con 0x7fc5b006e330 2024-05-08T04:22:53.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.364+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/3806906878 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5b006f3f0 con 0x7fc5b006e330 2024-05-08T04:22:53.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.364+0000 7fc5a27fc640 1 -- 172.21.15.104:0/3806906878 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fc5a4045360 con 0x7fc5b006e330 2024-05-08T04:22:53.365 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:53.365 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":21,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:22:53.366 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 21 2024-05-08T04:22:53.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.366+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/3806906878 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc59406b680 msgr2=0x7fc59406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.366+0000 7fc5b7e9e640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc59406b680 0x7fc59406db40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00c9aa0 tx=0x7fc5ac009040 comp rx=0 tx=0).stop 2024-05-08T04:22:53.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.366+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/3806906878 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5b006e330 msgr2=0x7fc5b01f4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.366+0000 7fc5b7e9e640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5b006e330 0x7fc5b01f4aa0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4000c00 tx=0x7fc5a40046c0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.366+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/3806906878 shutdown_connections 2024-05-08T04:22:53.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.366+0000 7fc5b7e9e640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc59406b680 0x7fc59406db40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.366+0000 7fc5b7e9e640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5b00ceee0 0x7fc5b0155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.366+0000 7fc5b7e9e640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5b00b4700 0x7fc5b01f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.366+0000 7fc5b7e9e640 1 --2- 172.21.15.104:0/3806906878 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5b006e330 0x7fc5b01f4aa0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.366+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/3806906878 >> 172.21.15.104:0/3806906878 conn(0x7fc5b00b13f0 msgr2=0x7fc5b01579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:53.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.366+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/3806906878 shutdown_connections 2024-05-08T04:22:53.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.366+0000 7fc5b7e9e640 1 -- 172.21.15.104:0/3806906878 wait complete. 2024-05-08T04:22:53.781 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T04:22:44.308604+0000', 'modified': '2024-05-08T04:22:46.323648+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5742}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5742': {'gid': 5742, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6837/3100292449', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6835', 'nonce': 3100292449}, {'type': 'v1', 'addr': '172.21.15.104:6837', 'nonce': 3100292449}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T04:22:53.781 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T04:22:53.781 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-08T04:22:53.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.884+0000 7f951d7ee640 1 Processor -- start 2024-05-08T04:22:53.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.884+0000 7f951d7ee640 1 -- start start 2024-05-08T04:22:53.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.885+0000 7f951d7ee640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f95180ce5a0 0x7f9518161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.885+0000 7f951d7ee640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f951815e1f0 con 0x7f95180d07c0 2024-05-08T04:22:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.885+0000 7f951d7ee640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9518162090 con 0x7f951815de10 2024-05-08T04:22:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.885+0000 7f951d7ee640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95180d0f50 con 0x7f95180ce5a0 2024-05-08T04:22:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.885+0000 7f950ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f95180ce5a0 0x7f9518161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.885+0000 7f95177fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f95180d07c0 0x7f95180d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42370/0 (socket says 172.21.15.104:42370) 2024-05-08T04:22:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.885+0000 7f95177fe640 1 -- 172.21.15.104:0/2626137005 learned_addr learned my addr 172.21.15.104:0/2626137005 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.885+0000 7f950ffff640 1 -- 172.21.15.104:0/2626137005 >> v1:172.21.15.183:6789/0 conn(0x7f951815de10 legacy=0x7f95180d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.885+0000 7f950ffff640 1 -- 172.21.15.104:0/2626137005 >> v1:172.21.15.104:6789/0 conn(0x7f95180d07c0 legacy=0x7f95180d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.885+0000 7f950ffff640 1 -- 172.21.15.104:0/2626137005 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518162370 con 0x7f95180ce5a0 2024-05-08T04:22:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.885+0000 7f95167fc640 1 -- 172.21.15.104:0/2626137005 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637930782 0 0) 0x7f951815e1f0 con 0x7f95180d07c0 2024-05-08T04:22:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.886+0000 7f950ffff640 1 --2- 172.21.15.104:0/2626137005 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95180ce5a0 0x7f9518161920 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f95000097a0 tx=0x7f950002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f814eca9eb2b37bf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.886+0000 7f95167fc640 1 -- 172.21.15.104:0/2626137005 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500037070 con 0x7f95180ce5a0 2024-05-08T04:22:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.886+0000 7f95167fc640 1 -- 172.21.15.104:0/2626137005 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9500032440 con 0x7f95180ce5a0 2024-05-08T04:22:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.886+0000 7f95167fc640 1 -- 172.21.15.104:0/2626137005 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500032810 con 0x7f95180ce5a0 2024-05-08T04:22:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.887+0000 7f951d7ee640 1 -- 172.21.15.104:0/2626137005 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95180ce5a0 msgr2=0x7f9518161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.887+0000 7f951d7ee640 1 --2- 172.21.15.104:0/2626137005 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95180ce5a0 0x7f9518161920 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f95000097a0 tx=0x7f950002a1a0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.887+0000 7f951d7ee640 1 -- 172.21.15.104:0/2626137005 shutdown_connections 2024-05-08T04:22:53.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.887+0000 7f951d7ee640 1 --2- 172.21.15.104:0/2626137005 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95180ce5a0 0x7f9518161920 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.887+0000 7f951d7ee640 1 -- 172.21.15.104:0/2626137005 >> 172.21.15.104:0/2626137005 conn(0x7f9518072290 msgr2=0x7f9518072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:53.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.887+0000 7f951d7ee640 1 -- 172.21.15.104:0/2626137005 shutdown_connections 2024-05-08T04:22:53.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.887+0000 7f951d7ee640 1 -- 172.21.15.104:0/2626137005 wait complete. 2024-05-08T04:22:53.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.888+0000 7f951d7ee640 1 Processor -- start 2024-05-08T04:22:53.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.888+0000 7f951d7ee640 1 -- start start 2024-05-08T04:22:53.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f951d7ee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95180ce5a0 0x7f95180cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f951d7ee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95180d07c0 0x7f951815f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f951d7ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f951815de10 0x7f95180b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f951d7ee640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95180d1a90 con 0x7f951815de10 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f951d7ee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95180d1ce0 con 0x7f95180d07c0 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f951d7ee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95180b6dc0 con 0x7f95180ce5a0 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f95177fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f951815de10 0x7f95180b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f95177fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f951815de10 0x7f95180b8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57508/0 (socket says 172.21.15.104:57508) 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f95177fe640 1 -- 172.21.15.104:0/1053012951 learned_addr learned my addr 172.21.15.104:0/1053012951 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f9516ffd640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95180ce5a0 0x7f95180cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f950ffff640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95180d07c0 0x7f951815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f95177fe640 1 -- 172.21.15.104:0/1053012951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95180ce5a0 msgr2=0x7f95180cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f95177fe640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95180ce5a0 0x7f95180cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f95177fe640 1 -- 172.21.15.104:0/1053012951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95180d07c0 msgr2=0x7f951815f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f95177fe640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95180d07c0 0x7f951815f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f95177fe640 1 -- 172.21.15.104:0/1053012951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951815fcb0 con 0x7f951815de10 2024-05-08T04:22:53.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f95177fe640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f951815de10 0x7f95180b8410 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f951000c7a0 tx=0x7f951000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f950f7fe640 1 -- 172.21.15.104:0/1053012951 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510018070 con 0x7f951815de10 2024-05-08T04:22:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f950f7fe640 1 -- 172.21.15.104:0/1053012951 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951000a640 con 0x7f951815de10 2024-05-08T04:22:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f951d7ee640 1 -- 172.21.15.104:0/1053012951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95180cac20 con 0x7f951815de10 2024-05-08T04:22:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.889+0000 7f950f7fe640 1 -- 172.21.15.104:0/1053012951 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951000aa70 con 0x7f951815de10 2024-05-08T04:22:53.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.890+0000 7f951d7ee640 1 -- 172.21.15.104:0/1053012951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951815f9a0 con 0x7f951815de10 2024-05-08T04:22:53.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.891+0000 7f950f7fe640 1 -- 172.21.15.104:0/1053012951 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f951001b070 con 0x7f951815de10 2024-05-08T04:22:53.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.891+0000 7f950f7fe640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f94f806b680 0x7f94f806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.892+0000 7f950f7fe640 1 -- 172.21.15.104:0/1053012951 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9510089b50 con 0x7f951815de10 2024-05-08T04:22:53.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.892+0000 7f9516ffd640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f94f806b680 0x7f94f806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.892+0000 7f9516ffd640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f94f806b680 0x7f94f806db40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9508000f60 tx=0x7f9508009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:53.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.892+0000 7f95205cd740 1 Processor -- start 2024-05-08T04:22:53.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.893+0000 7f95205cd740 1 -- start start 2024-05-08T04:22:53.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.893+0000 7f95205cd740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 0x556f92ea7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.893+0000 7f95205cd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92ec5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.893+0000 7f95205cd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92e7cf10 0x556f92ec3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.893+0000 7f95205cd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f92ddfa10 con 0x556f92ec4ad0 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.893+0000 7f95205cd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f92d88b30 con 0x556f92e7cf10 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.893+0000 7f95205cd740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f92ddbc50 con 0x556f92ea7230 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.893+0000 7f950ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92ec5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.893+0000 7f950ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92ec5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57518/0 (socket says 172.21.15.104:57518) 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.893+0000 7f950ffff640 1 -- 172.21.15.104:0/2975204735 learned_addr learned my addr 172.21.15.104:0/2975204735 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.894+0000 7f9516ffd640 1 --2- 172.21.15.104:0/2975204735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 0x556f92ea7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.894+0000 7f95177fe640 1 --2- 172.21.15.104:0/2975204735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92e7cf10 0x556f92ec3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.894+0000 7f950ffff640 1 -- 172.21.15.104:0/2975204735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 msgr2=0x556f92ea7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.894+0000 7f950ffff640 1 --2- 172.21.15.104:0/2975204735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 0x556f92ea7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.894+0000 7f950ffff640 1 -- 172.21.15.104:0/2975204735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92e7cf10 msgr2=0x556f92ec3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.894+0000 7f950ffff640 1 --2- 172.21.15.104:0/2975204735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92e7cf10 0x556f92ec3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.894+0000 7f950ffff640 1 -- 172.21.15.104:0/2975204735 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f92d9de10 con 0x556f92ec4ad0 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.894+0000 7f950ffff640 1 --2- 172.21.15.104:0/2975204735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92ec5020 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9500000c00 tx=0x7f950002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecd45f8d225fc68 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.894+0000 7f950cff9640 1 -- 172.21.15.104:0/2975204735 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500037040 con 0x556f92ec4ad0 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.894+0000 7f950cff9640 1 -- 172.21.15.104:0/2975204735 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9500032740 con 0x556f92ec4ad0 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.894+0000 7f950cff9640 1 -- 172.21.15.104:0/2975204735 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500032af0 con 0x556f92ec4ad0 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.895+0000 7f95205cd740 1 -- 172.21.15.104:0/2975204735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 msgr2=0x556f92ec5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.895+0000 7f95205cd740 1 --2- 172.21.15.104:0/2975204735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92ec5020 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9500000c00 tx=0x7f950002c000 comp rx=0 tx=0).stop 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.895+0000 7f95205cd740 1 -- 172.21.15.104:0/2975204735 shutdown_connections 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.895+0000 7f95205cd740 1 --2- 172.21.15.104:0/2975204735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92e7cf10 0x556f92ec3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.895+0000 7f95205cd740 1 --2- 172.21.15.104:0/2975204735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92ec5020 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.895+0000 7f95205cd740 1 --2- 172.21.15.104:0/2975204735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 0x556f92ea7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.895+0000 7f95205cd740 1 -- 172.21.15.104:0/2975204735 >> 172.21.15.104:0/2975204735 conn(0x556f92e79840 msgr2=0x556f92ec2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.895+0000 7f95205cd740 1 -- 172.21.15.104:0/2975204735 shutdown_connections 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.895+0000 7f95205cd740 1 -- 172.21.15.104:0/2975204735 wait complete. 2024-05-08T04:22:53.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.895+0000 7f95205cd740 1 -- start start 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.895+0000 7f95205cd740 1 Processor -- start 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f95205cd740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 0x556f92eb94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f95205cd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92ea4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f95205cd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea4850 0x556f92e8ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f95205cd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f92e7dcb0 con 0x556f92ec4ad0 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f95205cd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f92d9c0c0 con 0x556f92ea4850 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f95205cd740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f92e77770 con 0x556f92ea7230 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f950ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92ea4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f95205cd740 10 client.0 _ll_register_callbacks cb 0x556f92d8fec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f950ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92ea4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57526/0 (socket says 172.21.15.104:57526) 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f950ffff640 1 -- 172.21.15.104:0/1830153250 learned_addr learned my addr 172.21.15.104:0/1830153250 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f95177fe640 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea4850 0x556f92e8ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f9516ffd640 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 0x556f92eb94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f950ffff640 1 -- 172.21.15.104:0/1830153250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 msgr2=0x556f92eb94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f950ffff640 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 0x556f92eb94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f950ffff640 1 -- 172.21.15.104:0/1830153250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea4850 msgr2=0x556f92e8ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f950ffff640 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea4850 0x556f92e8ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f950ffff640 1 -- 172.21.15.104:0/1830153250 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f92af42d0 con 0x556f92ec4ad0 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.896+0000 7f9516ffd640 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 0x556f92eb94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f950ffff640 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92ea4310 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f950002a790 tx=0x7f950002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88272e7068195539 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f94f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f94f5ffb640 1 -- 172.21.15.104:0/1830153250 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950004a070 con 0x556f92ec4ad0 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f95205cd740 1 -- 172.21.15.104:0/1830153250 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9500032740 con 0x556f92ec4ad0 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f94f5ffb640 1 -- 172.21.15.104:0/1830153250 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9500032af0 con 0x556f92ec4ad0 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f94f5ffb640 1 -- 172.21.15.104:0/1830153250 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9500052050 con 0x556f92ec4ad0 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f95205cd740 10 client.5919 fetch_fsmap learned FSMap version 21 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f95205cd740 1 -- 172.21.15.104:0/1830153250 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x556f92bbe6b0 con 0x556f92ec4ad0 2024-05-08T04:22:53.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f94f5ffb640 1 -- 172.21.15.104:0/1830153250 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9500032740 con 0x556f92ec4ad0 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f94f5ffb640 1 -- 172.21.15.104:0/1830153250 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9500055020 con 0x556f92ec4ad0 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f95205cd740 10 client.5919 fetch_fsmap finished waiting for FSMap version 21 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f95205cd740 10 client.5919 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f95205cd740 20 client.5919 populate_metadata read hostname 'smithi104' 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f95205cd740 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.104:6835/3100292449,v1:172.21.15.104:6837/3100292449] conn(0x556f92ed5a60 0x556f92ed5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f95205cd740 4 client.5919 mds_command: new command op to 5742 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f95205cd740 1 -- 172.21.15.104:0/1830153250 --> [v2:172.21.15.104:6835/3100292449,v1:172.21.15.104:6837/3100292449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f92e3e920 con 0x556f92ed5a60 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.897+0000 7f9516ffd640 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.104:6835/3100292449,v1:172.21.15.104:6837/3100292449] conn(0x556f92ed5a60 0x556f92ed5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f94f5ffb640 10 client.5919 ms_handle_connect on v2:172.21.15.104:6835/3100292449 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f9516ffd640 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.104:6835/3100292449,v1:172.21.15.104:6837/3100292449] conn(0x556f92ed5a60 0x556f92ed5e40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cbe2dbc40622421 server_cookie=3567dfa3977809d7 in_seq=0 out_seq=0 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f94f5ffb640 1 -- 172.21.15.104:0/1830153250 <== mds.0 v2:172.21.15.104:6835/3100292449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556f92e3e920 con 0x556f92ed5a60 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f94f5ffb640 10 client.5919 handle_command_reply: tid=0 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f95205cd740 1 client.5919 shutdown 2024-05-08T04:22:53.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f95205cd740 1 -- 172.21.15.104:0/1830153250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 msgr2=0x556f92ea4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f95205cd740 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92ea4310 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f950002a790 tx=0x7f950002c070 comp rx=0 tx=0).stop 2024-05-08T04:22:53.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f95205cd740 1 -- 172.21.15.104:0/1830153250 shutdown_connections 2024-05-08T04:22:53.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f95205cd740 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.104:6835/3100292449,v1:172.21.15.104:6837/3100292449] conn(0x556f92ed5a60 0x556f92ed5e40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f95205cd740 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea4850 0x556f92e8ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f95205cd740 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92ea4310 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f94f5ffb640 0 client.5919 ms_handle_reset on v2:172.21.15.104:6835/3100292449 2024-05-08T04:22:53.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f95205cd740 1 --2- 172.21.15.104:0/1830153250 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 0x556f92eb94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f95205cd740 1 -- 172.21.15.104:0/1830153250 >> 172.21.15.104:0/1830153250 conn(0x556f92e7cf10 msgr2=0x556f92ec17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:53.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f95205cd740 1 -- 172.21.15.104:0/1830153250 shutdown_connections 2024-05-08T04:22:53.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f95205cd740 1 -- 172.21.15.104:0/1830153250 wait complete. 2024-05-08T04:22:53.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.898+0000 7f95205cd740 20 client.5919 trim_cache size 0 max 16384 2024-05-08T04:22:53.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.914+0000 7f95205cd740 1 Processor -- start 2024-05-08T04:22:53.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.914+0000 7f95205cd740 1 -- start start 2024-05-08T04:22:53.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95205cd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea4850 0x556f92e7c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95205cd740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 0x556f92e932d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95205cd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92e93810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95205cd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95181f7e20 con 0x556f92ec4ad0 2024-05-08T04:22:53.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95205cd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951815eea0 con 0x556f92ea4850 2024-05-08T04:22:53.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95205cd740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95181f7820 con 0x556f92ea7230 2024-05-08T04:22:53.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95177fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92e93810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95177fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92e93810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57542/0 (socket says 172.21.15.104:57542) 2024-05-08T04:22:53.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95177fe640 1 -- 172.21.15.104:0/2099956868 learned_addr learned my addr 172.21.15.104:0/2099956868 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:53.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f950ffff640 1 --2- 172.21.15.104:0/2099956868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 0x556f92e932d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95177fe640 1 -- 172.21.15.104:0/2099956868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 msgr2=0x556f92e932d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95177fe640 1 --2- 172.21.15.104:0/2099956868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 0x556f92e932d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95177fe640 1 -- 172.21.15.104:0/2099956868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea4850 msgr2=0x556f92e7c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f9516ffd640 1 --2- 172.21.15.104:0/2099956868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea4850 0x556f92e7c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95177fe640 1 --2- 172.21.15.104:0/2099956868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea4850 0x556f92e7c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95177fe640 1 -- 172.21.15.104:0/2099956868 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f92eb8f20 con 0x556f92ec4ad0 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f9516ffd640 1 --2- 172.21.15.104:0/2099956868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea4850 0x556f92e7c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.915+0000 7f95177fe640 1 --2- 172.21.15.104:0/2099956868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92e93810 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9510060230 tx=0x7f9510057a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a90b9b8bd0a8ab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.916+0000 7f94f7fff640 1 -- 172.21.15.104:0/2099956868 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510060760 con 0x556f92ec4ad0 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.916+0000 7f94f7fff640 1 -- 172.21.15.104:0/2099956868 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95100546c0 con 0x556f92ec4ad0 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.916+0000 7f94f7fff640 1 -- 172.21.15.104:0/2099956868 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95100584b0 con 0x556f92ec4ad0 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.916+0000 7f95205cd740 1 -- 172.21.15.104:0/2099956868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 msgr2=0x556f92e93810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.916+0000 7f95205cd740 1 --2- 172.21.15.104:0/2099956868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92e93810 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9510060230 tx=0x7f9510057a70 comp rx=0 tx=0).stop 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.916+0000 7f95205cd740 1 -- 172.21.15.104:0/2099956868 shutdown_connections 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.916+0000 7f95205cd740 1 --2- 172.21.15.104:0/2099956868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92e93810 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.916+0000 7f95205cd740 1 --2- 172.21.15.104:0/2099956868 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea7230 0x556f92e932d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.916+0000 7f95205cd740 1 --2- 172.21.15.104:0/2099956868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea4850 0x556f92e7c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.916+0000 7f95205cd740 1 -- 172.21.15.104:0/2099956868 >> 172.21.15.104:0/2099956868 conn(0x556f92e7cf10 msgr2=0x556f92eab000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:53.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.916+0000 7f95205cd740 1 -- 172.21.15.104:0/2099956868 shutdown_connections 2024-05-08T04:22:53.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.916+0000 7f95205cd740 1 -- 172.21.15.104:0/2099956868 wait complete. 2024-05-08T04:22:53.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.917+0000 7f95205cd740 1 -- start start 2024-05-08T04:22:53.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.917+0000 7f95205cd740 1 Processor -- start 2024-05-08T04:22:53.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.917+0000 7f95205cd740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea4850 0x556f92e932b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.917+0000 7f95205cd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea7230 0x556f92e937f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.917+0000 7f95205cd740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92f2ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.917+0000 7f95205cd740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f92eb9b20 con 0x556f92ec4ad0 2024-05-08T04:22:53.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.917+0000 7f95205cd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f92ea58e0 con 0x556f92ea7230 2024-05-08T04:22:53.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.917+0000 7f95205cd740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f92e92930 con 0x556f92ea4850 2024-05-08T04:22:53.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.917+0000 7f95205cd740 10 client.0 _ll_register_callbacks cb 0x556f92e77c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T04:22:53.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95177fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92f2ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95177fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92f2ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57558/0 (socket says 172.21.15.104:57558) 2024-05-08T04:22:53.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95177fe640 1 -- 172.21.15.104:0/1136350249 learned_addr learned my addr 172.21.15.104:0/1136350249 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:53.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f9516ffd640 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea4850 0x556f92e932b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f950ffff640 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea7230 0x556f92e937f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95177fe640 1 -- 172.21.15.104:0/1136350249 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea4850 msgr2=0x556f92e932b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:53.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95177fe640 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea4850 0x556f92e932b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95177fe640 1 -- 172.21.15.104:0/1136350249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea7230 msgr2=0x556f92e937f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95177fe640 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea7230 0x556f92e937f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95177fe640 1 -- 172.21.15.104:0/1136350249 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f92ed50f0 con 0x556f92ec4ad0 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f950ffff640 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea7230 0x556f92e937f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95177fe640 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92f2ca60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9510060230 tx=0x7f951005c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd9f809e0f243eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f94f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f94f5ffb640 1 -- 172.21.15.104:0/1136350249 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510074060 con 0x556f92ec4ad0 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f94f5ffb640 1 -- 172.21.15.104:0/1136350249 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f95100574a0 con 0x556f92ec4ad0 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95205cd740 1 -- 172.21.15.104:0/1136350249 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f95100546c0 con 0x556f92ec4ad0 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f94f5ffb640 1 -- 172.21.15.104:0/1136350249 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9510060760 con 0x556f92ec4ad0 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95205cd740 10 client.5925 fetch_fsmap learned FSMap version 21 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95205cd740 1 -- 172.21.15.104:0/1136350249 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x556f92f2d900 con 0x556f92ec4ad0 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f94f5ffb640 1 -- 172.21.15.104:0/1136350249 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95100546c0 con 0x556f92ec4ad0 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f94f5ffb640 1 -- 172.21.15.104:0/1136350249 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f951005e130 con 0x556f92ec4ad0 2024-05-08T04:22:53.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95205cd740 10 client.5925 fetch_fsmap finished waiting for FSMap version 21 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95205cd740 10 client.5925 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95205cd740 20 client.5925 populate_metadata read hostname 'smithi104' 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95205cd740 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.104:6835/3100292449,v1:172.21.15.104:6837/3100292449] conn(0x556f92f2cfa0 0x556f92e764a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95205cd740 4 client.5925 mds_command: new command op to 5742 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.918+0000 7f95205cd740 1 -- 172.21.15.104:0/1136350249 --> [v2:172.21.15.104:6835/3100292449,v1:172.21.15.104:6837/3100292449] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556f92ebabb0 con 0x556f92f2cfa0 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f9516ffd640 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.104:6835/3100292449,v1:172.21.15.104:6837/3100292449] conn(0x556f92f2cfa0 0x556f92e764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f9516ffd640 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.104:6835/3100292449,v1:172.21.15.104:6837/3100292449] conn(0x556f92f2cfa0 0x556f92e764a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27ce629c9e1f42de server_cookie=464122c9a3a27968 in_seq=0 out_seq=0 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f94f5ffb640 10 client.5925 ms_handle_connect on v2:172.21.15.104:6835/3100292449 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f94f5ffb640 1 -- 172.21.15.104:0/1136350249 <== mds.0 v2:172.21.15.104:6835/3100292449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x556f92ebabb0 con 0x556f92f2cfa0 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f94f5ffb640 10 client.5925 handle_command_reply: tid=0 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f95205cd740 1 client.5925 shutdown 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f95205cd740 1 -- 172.21.15.104:0/1136350249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 msgr2=0x556f92f2ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f95205cd740 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92f2ca60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9510060230 tx=0x7f951005c040 comp rx=0 tx=0).stop 2024-05-08T04:22:53.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f95205cd740 1 -- 172.21.15.104:0/1136350249 shutdown_connections 2024-05-08T04:22:53.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f95205cd740 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.104:6835/3100292449,v1:172.21.15.104:6837/3100292449] conn(0x556f92f2cfa0 0x556f92e764a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f95205cd740 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556f92ea7230 0x556f92e937f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f95205cd740 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x556f92ec4ad0 0x556f92f2ca60 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f94f5ffb640 0 client.5925 ms_handle_reset on v2:172.21.15.104:6835/3100292449 2024-05-08T04:22:53.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f95205cd740 1 --2- 172.21.15.104:0/1136350249 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556f92ea4850 0x556f92e932b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f95205cd740 1 -- 172.21.15.104:0/1136350249 >> 172.21.15.104:0/1136350249 conn(0x556f92e7cf10 msgr2=0x556f92ec37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:53.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f95205cd740 1 -- 172.21.15.104:0/1136350249 shutdown_connections 2024-05-08T04:22:53.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f95205cd740 1 -- 172.21.15.104:0/1136350249 wait complete. 2024-05-08T04:22:53.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.919+0000 7f95205cd740 20 client.5925 trim_cache size 0 max 16384 2024-05-08T04:22:53.927 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:22:53.927 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "c8b1f73b-90d2-40b8-ad3c-a036617abfed", 2024-05-08T04:22:53.928 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-05-08T04:22:53.928 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 5742, 2024-05-08T04:22:53.928 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-05-08T04:22:53.928 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-05-08T04:22:53.928 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-05-08T04:22:53.928 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 8.9426469770000008, 2024-05-08T04:22:53.928 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 21, 2024-05-08T04:22:53.928 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 47, 2024-05-08T04:22:53.928 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 45, 2024-05-08T04:22:53.928 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 14.031162583 2024-05-08T04:22:53.928 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:22:53.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.920+0000 7f951d7ee640 1 -- 172.21.15.104:0/1053012951 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f94f806b680 msgr2=0x7f94f806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.920+0000 7f951d7ee640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f94f806b680 0x7f94f806db40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9508000f60 tx=0x7f9508009040 comp rx=0 tx=0).stop 2024-05-08T04:22:53.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.920+0000 7f951d7ee640 1 -- 172.21.15.104:0/1053012951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f951815de10 msgr2=0x7f95180b8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:53.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.920+0000 7f951d7ee640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f951815de10 0x7f95180b8410 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f951000c7a0 tx=0x7f951000cc60 comp rx=0 tx=0).stop 2024-05-08T04:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.920+0000 7f951d7ee640 1 -- 172.21.15.104:0/1053012951 shutdown_connections 2024-05-08T04:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.920+0000 7f951d7ee640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f94f806b680 0x7f94f806db40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.920+0000 7f951d7ee640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95180d07c0 0x7f951815f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.920+0000 7f951d7ee640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f951815de10 0x7f95180b8410 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.920+0000 7f951d7ee640 1 --2- 172.21.15.104:0/1053012951 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95180ce5a0 0x7f95180cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.920+0000 7f951d7ee640 1 -- 172.21.15.104:0/1053012951 >> 172.21.15.104:0/1053012951 conn(0x7f9518072290 msgr2=0x7f95180d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.920+0000 7f951d7ee640 1 -- 172.21.15.104:0/1053012951 shutdown_connections 2024-05-08T04:22:53.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:53.920+0000 7f951d7ee640 1 -- 172.21.15.104:0/1053012951 wait complete. 2024-05-08T04:22:53.932 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T04:22:54.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.031+0000 7f365eb7e640 1 Processor -- start 2024-05-08T04:22:54.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.031+0000 7f365eb7e640 1 -- start start 2024-05-08T04:22:54.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.032+0000 7f365eb7e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f36580ce5a0 0x7f3658161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:54.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.032+0000 7f365eb7e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f36580d07c0 0x7f36580d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:54.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.032+0000 7f365eb7e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365815e1f0 con 0x7f365815de10 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.032+0000 7f365eb7e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36580d0f50 con 0x7f36580d07c0 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.032+0000 7f365eb7e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3658161e60 con 0x7f36580ce5a0 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.032+0000 7f365d11b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f36580d07c0 0x7f36580d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.032+0000 7f365d11b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f36580d07c0 0x7f36580d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57570/0 (socket says 172.21.15.104:57570) 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.032+0000 7f365d11b640 1 -- 172.21.15.104:0/884217353 learned_addr learned my addr 172.21.15.104:0/884217353 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.032+0000 7f3657fff640 1 --2- 172.21.15.104:0/884217353 >> v2:172.21.15.183:3300/0 conn(0x7f36580ce5a0 0x7f3658161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.033+0000 7f365d11b640 1 -- 172.21.15.104:0/884217353 >> v2:172.21.15.183:3300/0 conn(0x7f36580ce5a0 msgr2=0x7f3658161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.033+0000 7f365d11b640 1 --2- 172.21.15.104:0/884217353 >> v2:172.21.15.183:3300/0 conn(0x7f36580ce5a0 0x7f3658161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.033+0000 7f365d11b640 1 -- 172.21.15.104:0/884217353 >> v1:172.21.15.183:6789/0 conn(0x7f365815de10 legacy=0x7f36580d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.033+0000 7f365d11b640 1 -- 172.21.15.104:0/884217353 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3658162090 con 0x7f36580d07c0 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.033+0000 7f3657fff640 1 --2- 172.21.15.104:0/884217353 >> v2:172.21.15.183:3300/0 conn(0x7f36580ce5a0 0x7f3658161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.033+0000 7f365d11b640 1 --2- 172.21.15.104:0/884217353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36580d07c0 0x7f36580d2200 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f36580c7520 tx=0x7f365002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629887328d47997a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.033+0000 7f36577fe640 1 -- 172.21.15.104:0/884217353 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650036070 con 0x7f36580d07c0 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.033+0000 7f36577fe640 1 -- 172.21.15.104:0/884217353 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3650031600 con 0x7f36580d07c0 2024-05-08T04:22:54.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.033+0000 7f36577fe640 1 -- 172.21.15.104:0/884217353 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36500319d0 con 0x7f36580d07c0 2024-05-08T04:22:54.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.034+0000 7f365eb7e640 1 -- 172.21.15.104:0/884217353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36580d07c0 msgr2=0x7f36580d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:54.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.034+0000 7f365eb7e640 1 --2- 172.21.15.104:0/884217353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36580d07c0 0x7f36580d2200 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f36580c7520 tx=0x7f365002a660 comp rx=0 tx=0).stop 2024-05-08T04:22:54.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.034+0000 7f365eb7e640 1 -- 172.21.15.104:0/884217353 shutdown_connections 2024-05-08T04:22:54.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.034+0000 7f365eb7e640 1 --2- 172.21.15.104:0/884217353 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36580d07c0 0x7f36580d2200 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:54.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.034+0000 7f365eb7e640 1 --2- 172.21.15.104:0/884217353 >> v2:172.21.15.183:3300/0 conn(0x7f36580ce5a0 0x7f3658161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:54.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.034+0000 7f365eb7e640 1 -- 172.21.15.104:0/884217353 >> 172.21.15.104:0/884217353 conn(0x7f3658072290 msgr2=0x7f3658072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:54.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.034+0000 7f365eb7e640 1 -- 172.21.15.104:0/884217353 shutdown_connections 2024-05-08T04:22:54.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.034+0000 7f365eb7e640 1 -- 172.21.15.104:0/884217353 wait complete. 2024-05-08T04:22:54.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.035+0000 7f365eb7e640 1 Processor -- start 2024-05-08T04:22:54.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.035+0000 7f365eb7e640 1 -- start start 2024-05-08T04:22:54.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f365eb7e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36580ce5a0 0x7f3658153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:54.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f365eb7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36580d07c0 0x7f36580cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:54.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f365eb7e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f365815de10 0x7f365815e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:54.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f365eb7e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3658162650 con 0x7f36580d07c0 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f365eb7e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36580d1a90 con 0x7f365815de10 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f365eb7e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36580d1ce0 con 0x7f36580ce5a0 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f3657fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36580d07c0 0x7f36580cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f3657fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36580d07c0 0x7f36580cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57582/0 (socket says 172.21.15.104:57582) 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f3657fff640 1 -- 172.21.15.104:0/222385965 learned_addr learned my addr 172.21.15.104:0/222385965 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f365c91a640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36580ce5a0 0x7f3658153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f365d11b640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f365815de10 0x7f365815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f3657fff640 1 -- 172.21.15.104:0/222385965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36580ce5a0 msgr2=0x7f3658153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f3657fff640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36580ce5a0 0x7f3658153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f3657fff640 1 -- 172.21.15.104:0/222385965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f365815de10 msgr2=0x7f365815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f3657fff640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f365815de10 0x7f365815e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f3657fff640 1 -- 172.21.15.104:0/222385965 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36580cb870 con 0x7f36580d07c0 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f365c91a640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36580ce5a0 0x7f3658153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.036+0000 7f365d11b640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f365815de10 0x7f365815e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.037+0000 7f3657fff640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36580d07c0 0x7f36580cd130 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c7f0 tx=0x7f364c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:54.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.037+0000 7f36557fa640 1 -- 172.21.15.104:0/222385965 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c015070 con 0x7f36580d07c0 2024-05-08T04:22:54.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.037+0000 7f36557fa640 1 -- 172.21.15.104:0/222385965 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364c007a30 con 0x7f36580d07c0 2024-05-08T04:22:54.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.037+0000 7f36557fa640 1 -- 172.21.15.104:0/222385965 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c007e00 con 0x7f36580d07c0 2024-05-08T04:22:54.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.037+0000 7f365eb7e640 1 -- 172.21.15.104:0/222385965 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36580cbb50 con 0x7f36580d07c0 2024-05-08T04:22:54.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.037+0000 7f365eb7e640 1 -- 172.21.15.104:0/222385965 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36580cc110 con 0x7f36580d07c0 2024-05-08T04:22:54.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.038+0000 7f365eb7e640 1 -- 172.21.15.104:0/222385965 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3658075010 con 0x7f36580d07c0 2024-05-08T04:22:54.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.038+0000 7f36557fa640 1 -- 172.21.15.104:0/222385965 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f364c018070 con 0x7f36580d07c0 2024-05-08T04:22:54.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.039+0000 7f36557fa640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f364406b6b0 0x7f364406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:54.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.039+0000 7f365c91a640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f364406b6b0 0x7f364406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:54.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.039+0000 7f36557fa640 1 -- 172.21.15.104:0/222385965 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f364c08a660 con 0x7f36580d07c0 2024-05-08T04:22:54.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.039+0000 7f365c91a640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f364406b6b0 0x7f364406db70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f36580cd0c0 tx=0x7f3648008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:54.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.043+0000 7f36557fa640 1 -- 172.21.15.104:0/222385965 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f364c0590c0 con 0x7f36580d07c0 2024-05-08T04:22:54.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.250+0000 7f365eb7e640 1 -- 172.21.15.104:0/222385965 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f36580d1870 con 0x7f36580d07c0 2024-05-08T04:22:54.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.251+0000 7f36557fa640 1 -- 172.21.15.104:0/222385965 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+73 (secure 0 0 0) 0x7f364c0589c0 con 0x7f36580d07c0 2024-05-08T04:22:54.252 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T04:22:54.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.252+0000 7f365eb7e640 1 -- 172.21.15.104:0/222385965 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f364406b6b0 msgr2=0x7f364406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:54.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.252+0000 7f365eb7e640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f364406b6b0 0x7f364406db70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f36580cd0c0 tx=0x7f3648008040 comp rx=0 tx=0).stop 2024-05-08T04:22:54.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.252+0000 7f365eb7e640 1 -- 172.21.15.104:0/222385965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36580d07c0 msgr2=0x7f36580cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:54.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.252+0000 7f365eb7e640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36580d07c0 0x7f36580cd130 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f364c00c7f0 tx=0x7f364c00cbf0 comp rx=0 tx=0).stop 2024-05-08T04:22:54.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.253+0000 7f365eb7e640 1 -- 172.21.15.104:0/222385965 shutdown_connections 2024-05-08T04:22:54.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.253+0000 7f365eb7e640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f364406b6b0 0x7f364406db70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:54.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.253+0000 7f365eb7e640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f365815de10 0x7f365815e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:54.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.253+0000 7f365eb7e640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36580d07c0 0x7f36580cd130 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:54.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.253+0000 7f365eb7e640 1 --2- 172.21.15.104:0/222385965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36580ce5a0 0x7f3658153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:54.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.253+0000 7f365eb7e640 1 -- 172.21.15.104:0/222385965 >> 172.21.15.104:0/222385965 conn(0x7f3658072290 msgr2=0x7f36580d2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:54.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.253+0000 7f365eb7e640 1 -- 172.21.15.104:0/222385965 shutdown_connections 2024-05-08T04:22:54.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:54.253+0000 7f365eb7e640 1 -- 172.21.15.104:0/222385965 wait complete. 2024-05-08T04:22:54.265 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T04:22:54.265 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T04:22:54.265 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-05-08T04:22:54.265 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T04:22:54.265 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T04:22:54.265 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T04:22:54.265 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T04:22:54.265 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T04:22:54.265 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T04:22:54.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:54.266 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-05-08T04:22:54.281 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:22:54.281 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:22:54.282 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:22:54.282 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:54.282 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-05-08T04:22:54.282 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:54.282 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:22:54.282 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:54.282 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-05-08T04:22:54.282 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:22:54.282 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:54.282 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-05-08T04:22:54.282 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:22:54.282 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42603sec preferred_lft 42603sec 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether c6:d6:f9:07:c5:21 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::fc58:88ff:fed3:93d7/64 scope link 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:22:54.283 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether ca:ef:a4:8b:34:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:22:54.284 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::c8ef:a4ff:fe8b:34e2/64 scope link 2024-05-08T04:22:54.284 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:54.284 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:22:54.284 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether c6:d6:f9:07:c5:21 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:22:54.284 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::c4d6:f9ff:fe07:c521/64 scope link 2024-05-08T04:22:54.284 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:54.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:54.284 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T04:22:54.345 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-05-08T04:22:54.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:54.347 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-05-08T04:22:54.403 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-05-08T04:22:54.403 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T04:22:54.403 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T04:22:54.403 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T04:22:54.403 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T04:22:54.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:54.404 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-05-08T04:22:54.404 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-08T04:22:54.404 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T04:22:54.404 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T04:22:54.404 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T04:22:54.404 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-08T04:22:54.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:54.490 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-05-08T04:22:54.505 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-08T04:22:54.506 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T04:22:54.506 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T04:22:54.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:54.506 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-05-08T04:22:54.570 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-08T04:22:54.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:22:54.571 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T04:22:54.626 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T04:22:54.627 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:22:54.627 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T04:22:54.683 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-05-08T04:22:54.748 DEBUG:teuthology.orchestra.run.smithi104:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:22:54.805 INFO:teuthology.orchestra.run.smithi104.stdout:/proc 2024-05-08T04:22:54.805 INFO:teuthology.orchestra.run.smithi104.stdout:/sys 2024-05-08T04:22:54.805 INFO:teuthology.orchestra.run.smithi104.stdout:/dev 2024-05-08T04:22:54.805 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/security 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/shm 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/pts 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/run 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/cgroup 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/pstore 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/bpf 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/ 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/selinux 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/mqueue 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/hugepages 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/debug 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/tracing 2024-05-08T04:22:54.806 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/fuse/connections 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/config 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/run/user/1000 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-0 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-1 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-2 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-3 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:22:54.807 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:22:54.808 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:22:54.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:54.808 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-05-08T04:22:54.861 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T04:22:54.861 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-08T04:22:54.903 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-05-08T04:22:54.927 DEBUG:teuthology.orchestra.run.smithi104:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:22:54.983 INFO:teuthology.orchestra.run.smithi104.stdout:/proc 2024-05-08T04:22:54.983 INFO:teuthology.orchestra.run.smithi104.stdout:/sys 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/dev 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/security 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/shm 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/pts 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/run 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/cgroup 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/pstore 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/bpf 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/ 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/selinux 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/mqueue 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/hugepages 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/debug 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/tracing 2024-05-08T04:22:54.984 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/fuse/connections 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/config 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/run/user/1000 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-0 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-1 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-2 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-3 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:22:54.985 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:22:54.986 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:22:54.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:54.986 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-05-08T04:22:54.987 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:2024-05-08T04:22:54.984+0000 7f3938c0c480 -1 init, newargv = 0x5570a4c28760 newargc=15 2024-05-08T04:22:54.987 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[53781]: starting ceph client 2024-05-08T04:22:54.989 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[53781]: starting fuse 2024-05-08T04:22:55.001 INFO:teuthology.orchestra.run.smithi104.stdout:41 2024-05-08T04:22:55.001 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-05-08T04:22:55.002 DEBUG:teuthology.orchestra.run.smithi104:> sudo stdin-killer -- python3 -c ' 2024-05-08T04:22:55.002 DEBUG:teuthology.orchestra.run.smithi104:> import glob 2024-05-08T04:22:55.002 DEBUG:teuthology.orchestra.run.smithi104:> import re 2024-05-08T04:22:55.002 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-05-08T04:22:55.002 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2024-05-08T04:22:55.002 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:22:55.002 DEBUG:teuthology.orchestra.run.smithi104:> def _find_admin_socket(client_name): 2024-05-08T04:22:55.002 DEBUG:teuthology.orchestra.run.smithi104:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-08T04:22:55.002 DEBUG:teuthology.orchestra.run.smithi104:> files = glob.glob(asok_path) 2024-05-08T04:22:55.002 DEBUG:teuthology.orchestra.run.smithi104:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-08T04:22:55.002 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:22:55.002 DEBUG:teuthology.orchestra.run.smithi104:> # Given a non-glob path, it better be there 2024-05-08T04:22:55.003 DEBUG:teuthology.orchestra.run.smithi104:> if "*" not in asok_path: 2024-05-08T04:22:55.003 DEBUG:teuthology.orchestra.run.smithi104:> assert(len(files) == 1) 2024-05-08T04:22:55.003 DEBUG:teuthology.orchestra.run.smithi104:> return files[0] 2024-05-08T04:22:55.003 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:22:55.003 DEBUG:teuthology.orchestra.run.smithi104:> for f in files: 2024-05-08T04:22:55.003 DEBUG:teuthology.orchestra.run.smithi104:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T04:22:55.003 DEBUG:teuthology.orchestra.run.smithi104:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T04:22:55.003 DEBUG:teuthology.orchestra.run.smithi104:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T04:22:55.003 DEBUG:teuthology.orchestra.run.smithi104:> contents = proc_f.read() 2024-05-08T04:22:55.003 DEBUG:teuthology.orchestra.run.smithi104:> if mountpoint in contents: 2024-05-08T04:22:55.003 DEBUG:teuthology.orchestra.run.smithi104:> return f 2024-05-08T04:22:55.003 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T04:22:55.003 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:22:55.004 DEBUG:teuthology.orchestra.run.smithi104:> print(_find_admin_socket("client.0")) 2024-05-08T04:22:55.004 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-05-08T04:22:55.121 INFO:teuthology.orchestra.run.smithi104.stdout:/var/run/ceph/ceph-client.0.53781.asok 2024-05-08T04:22:55.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T04:22:55.131 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.53781.asok 2024-05-08T04:22:55.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:55.131 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.53781.asok status 2024-05-08T04:22:55.266 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:22:55.266 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": { 2024-05-08T04:22:55.266 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", 2024-05-08T04:22:55.266 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", 2024-05-08T04:22:55.266 INFO:teuthology.orchestra.run.smithi104.stdout: "entity_id": "0", 2024-05-08T04:22:55.266 INFO:teuthology.orchestra.run.smithi104.stdout: "hostname": "smithi104", 2024-05-08T04:22:55.266 INFO:teuthology.orchestra.run.smithi104.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-08T04:22:55.266 INFO:teuthology.orchestra.run.smithi104.stdout: "pid": "53781", 2024-05-08T04:22:55.266 INFO:teuthology.orchestra.run.smithi104.stdout: "root": "/" 2024-05-08T04:22:55.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:55.266 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_count": 0, 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_pinned_count": 0, 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 5940, 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: "inst": { 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: "name": { 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "client", 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: "num": 5940 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 846498134 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:55.267 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-05-08T04:22:55.268 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-05-08T04:22:55.268 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:22:55.268 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 846498134 2024-05-08T04:22:55.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:22:55.268 INFO:teuthology.orchestra.run.smithi104.stdout: "inst_str": "client.5940 192.168.0.1:0/846498134", 2024-05-08T04:22:55.268 INFO:teuthology.orchestra.run.smithi104.stdout: "addr_str": "192.168.0.1:0/846498134", 2024-05-08T04:22:55.268 INFO:teuthology.orchestra.run.smithi104.stdout: "inode_count": 1, 2024-05-08T04:22:55.268 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_epoch": 21, 2024-05-08T04:22:55.268 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch": 47, 2024-05-08T04:22:55.268 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch_barrier": 0, 2024-05-08T04:22:55.268 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklisted": false, 2024-05-08T04:22:55.268 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs" 2024-05-08T04:22:55.268 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:22:55.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:55.274 DEBUG:teuthology.orchestra.run.smithi104:> stat --file-system '--printf=%T 2024-05-08T04:22:55.274 DEBUG:teuthology.orchestra.run.smithi104:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-08T04:22:55.290 INFO:teuthology.orchestra.run.smithi104.stdout:fuseblk 2024-05-08T04:22:55.290 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-08T04:22:55.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:55.291 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T04:22:55.357 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T04:22:55.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.496+0000 7f8669da5640 1 Processor -- start 2024-05-08T04:22:55.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.496+0000 7f8669da5640 1 -- start start 2024-05-08T04:22:55.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.496+0000 7f8669da5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f866415de10 0x7f8664161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:55.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.496+0000 7f8669da5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f86640ce5a0 0x7f86640d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:55.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.496+0000 7f8669da5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86640d3210 con 0x7f86640d05f0 2024-05-08T04:22:55.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.496+0000 7f8669da5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86640d0f50 con 0x7f86640ce5a0 2024-05-08T04:22:55.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.496+0000 7f8669da5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8664161e60 con 0x7f866415de10 2024-05-08T04:22:55.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.497+0000 7f8662ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f86640ce5a0 0x7f86640d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:55.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.497+0000 7f86637fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f866415de10 0x7f8664161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:55.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.497+0000 7f8662ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f86640ce5a0 0x7f86640d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:50720/0 (socket says 172.21.15.104:50720) 2024-05-08T04:22:55.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.497+0000 7f8663fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f86640d05f0 0x7f86640b54a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:58562/0 (socket says 172.21.15.104:58562) 2024-05-08T04:22:55.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.497+0000 7f8662ffd640 1 -- 172.21.15.104:0/1418684707 learned_addr learned my addr 172.21.15.104:0/1418684707 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:55.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.497+0000 7f86637fe640 1 -- 172.21.15.104:0/1418684707 >> v2:172.21.15.183:3300/0 conn(0x7f86640ce5a0 msgr2=0x7f86640d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:55.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.497+0000 7f86637fe640 1 --2- 172.21.15.104:0/1418684707 >> v2:172.21.15.183:3300/0 conn(0x7f86640ce5a0 0x7f86640d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:55.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.497+0000 7f86637fe640 1 -- 172.21.15.104:0/1418684707 >> v1:172.21.15.183:6789/0 conn(0x7f86640d05f0 legacy=0x7f86640b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:55.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.497+0000 7f86637fe640 1 -- 172.21.15.104:0/1418684707 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866415e1f0 con 0x7f866415de10 2024-05-08T04:22:55.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.497+0000 7f8662ffd640 1 --2- 172.21.15.104:0/1418684707 >> v2:172.21.15.183:3300/0 conn(0x7f86640ce5a0 0x7f86640d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:22:55.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.498+0000 7f86637fe640 1 --2- 172.21.15.104:0/1418684707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f866415de10 0x7f8664161920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8654009d90 tx=0x7f865402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18f97328de09a01f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:55.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.498+0000 7f86627fc640 1 -- 172.21.15.104:0/1418684707 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654031600 con 0x7f866415de10 2024-05-08T04:22:55.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.498+0000 7f86627fc640 1 -- 172.21.15.104:0/1418684707 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86540317a0 con 0x7f866415de10 2024-05-08T04:22:55.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.498+0000 7f86627fc640 1 -- 172.21.15.104:0/1418684707 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654031b70 con 0x7f866415de10 2024-05-08T04:22:55.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.499+0000 7f8669da5640 1 -- 172.21.15.104:0/1418684707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f866415de10 msgr2=0x7f8664161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:55.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.499+0000 7f8669da5640 1 --2- 172.21.15.104:0/1418684707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f866415de10 0x7f8664161920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8654009d90 tx=0x7f865402a5d0 comp rx=0 tx=0).stop 2024-05-08T04:22:55.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.499+0000 7f8669da5640 1 -- 172.21.15.104:0/1418684707 shutdown_connections 2024-05-08T04:22:55.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.499+0000 7f8669da5640 1 --2- 172.21.15.104:0/1418684707 >> v2:172.21.15.183:3300/0 conn(0x7f86640ce5a0 0x7f86640d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:55.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.499+0000 7f8669da5640 1 --2- 172.21.15.104:0/1418684707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f866415de10 0x7f8664161920 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:55.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.499+0000 7f8669da5640 1 -- 172.21.15.104:0/1418684707 >> 172.21.15.104:0/1418684707 conn(0x7f8664072290 msgr2=0x7f8664072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:55.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.499+0000 7f8669da5640 1 -- 172.21.15.104:0/1418684707 shutdown_connections 2024-05-08T04:22:55.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.499+0000 7f8669da5640 1 -- 172.21.15.104:0/1418684707 wait complete. 2024-05-08T04:22:55.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.500+0000 7f8669da5640 1 Processor -- start 2024-05-08T04:22:55.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.500+0000 7f8669da5640 1 -- start start 2024-05-08T04:22:55.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8669da5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86640ce5a0 0x7f866414e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:55.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8669da5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86640d05f0 0x7f866414f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:55.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8669da5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f866415de10 0x7f86640c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8669da5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664162090 con 0x7f866415de10 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8669da5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86640d1a90 con 0x7f86640d05f0 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8669da5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8664162370 con 0x7f86640ce5a0 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8663fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f866415de10 0x7f86640c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8663fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f866415de10 0x7f86640c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57588/0 (socket says 172.21.15.104:57588) 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8663fff640 1 -- 172.21.15.104:0/3323073754 learned_addr learned my addr 172.21.15.104:0/3323073754 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f86637fe640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86640ce5a0 0x7f866414e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8662ffd640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86640d05f0 0x7f866414f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8663fff640 1 -- 172.21.15.104:0/3323073754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86640ce5a0 msgr2=0x7f866414e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8663fff640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86640ce5a0 0x7f866414e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8663fff640 1 -- 172.21.15.104:0/3323073754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86640d05f0 msgr2=0x7f866414f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8663fff640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86640d05f0 0x7f866414f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.501+0000 7f8663fff640 1 -- 172.21.15.104:0/3323073754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86640b3f30 con 0x7f866415de10 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.502+0000 7f8663fff640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f866415de10 0x7f86640c9610 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c430 tx=0x7f865c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:55.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.502+0000 7f864bfff640 1 -- 172.21.15.104:0/3323073754 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0074e0 con 0x7f866415de10 2024-05-08T04:22:55.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.502+0000 7f864bfff640 1 -- 172.21.15.104:0/3323073754 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c007680 con 0x7f866415de10 2024-05-08T04:22:55.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.502+0000 7f8669da5640 1 -- 172.21.15.104:0/3323073754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86640b4210 con 0x7f866415de10 2024-05-08T04:22:55.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.502+0000 7f864bfff640 1 -- 172.21.15.104:0/3323073754 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0049e0 con 0x7f866415de10 2024-05-08T04:22:55.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.502+0000 7f8669da5640 1 -- 172.21.15.104:0/3323073754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86640b47d0 con 0x7f866415de10 2024-05-08T04:22:55.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.503+0000 7f8669da5640 1 -- 172.21.15.104:0/3323073754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8664075010 con 0x7f866415de10 2024-05-08T04:22:55.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.503+0000 7f864bfff640 1 -- 172.21.15.104:0/3323073754 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f865c01a020 con 0x7f866415de10 2024-05-08T04:22:55.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.504+0000 7f864bfff640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f865006b680 0x7f865006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:55.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.504+0000 7f864bfff640 1 -- 172.21.15.104:0/3323073754 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f865c089d80 con 0x7f866415de10 2024-05-08T04:22:55.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.504+0000 7f86637fe640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f865006b680 0x7f865006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:55.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.504+0000 7f86637fe640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f865006b680 0x7f865006db40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8654034000 tx=0x7f865402f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:55.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.508+0000 7f864bfff640 1 -- 172.21.15.104:0/3323073754 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f865c0588f0 con 0x7f866415de10 2024-05-08T04:22:55.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.716+0000 7f8669da5640 1 -- 172.21.15.104:0/3323073754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f86640ca410 con 0x7f866415de10 2024-05-08T04:22:55.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.716+0000 7f864bfff640 1 -- 172.21.15.104:0/3323073754 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+73 (secure 0 0 0) 0x7f865c0581f0 con 0x7f866415de10 2024-05-08T04:22:55.718 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T04:22:55.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.718+0000 7f8669da5640 1 -- 172.21.15.104:0/3323073754 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f865006b680 msgr2=0x7f865006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:55.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.718+0000 7f8669da5640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f865006b680 0x7f865006db40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8654034000 tx=0x7f865402f000 comp rx=0 tx=0).stop 2024-05-08T04:22:55.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.718+0000 7f8669da5640 1 -- 172.21.15.104:0/3323073754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f866415de10 msgr2=0x7f86640c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:55.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.719+0000 7f8669da5640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f866415de10 0x7f86640c9610 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c430 tx=0x7f865c00c8f0 comp rx=0 tx=0).stop 2024-05-08T04:22:55.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.719+0000 7f8669da5640 1 -- 172.21.15.104:0/3323073754 shutdown_connections 2024-05-08T04:22:55.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.719+0000 7f8669da5640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f865006b680 0x7f865006db40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:55.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.719+0000 7f8669da5640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86640d05f0 0x7f866414f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:55.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.719+0000 7f8669da5640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f866415de10 0x7f86640c9610 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:55.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.719+0000 7f8669da5640 1 --2- 172.21.15.104:0/3323073754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86640ce5a0 0x7f866414e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:55.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.719+0000 7f8669da5640 1 -- 172.21.15.104:0/3323073754 >> 172.21.15.104:0/3323073754 conn(0x7f8664072290 msgr2=0x7f86640d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:55.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.719+0000 7f8669da5640 1 -- 172.21.15.104:0/3323073754 shutdown_connections 2024-05-08T04:22:55.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:55.719+0000 7f8669da5640 1 -- 172.21.15.104:0/3323073754 wait complete. 2024-05-08T04:22:55.730 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T04:22:55.731 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T04:22:55.731 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2024-05-08T04:22:55.731 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-08T04:22:55.731 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T04:22:55.731 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T04:22:55.731 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T04:22:55.731 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T04:22:55.731 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-08T04:22:55.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:55.731 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2024-05-08T04:22:55.751 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:22:55.751 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:22:55.751 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:22:55.751 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:55.751 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2024-05-08T04:22:55.751 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:55.751 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42649sec preferred_lft 42649sec 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T04:22:55.752 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 8a:51:89:24:45:ec brd ff:ff:ff:ff:ff:ff 2024-05-08T04:22:55.753 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T04:22:55.753 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:55.753 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::b018:2eff:fef9:2486/64 scope link 2024-05-08T04:22:55.753 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:55.753 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:22:55.753 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 8a:51:89:24:45:ec brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:22:55.753 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::8851:89ff:fe24:45ec/64 scope link 2024-05-08T04:22:55.753 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:55.753 INFO:teuthology.orchestra.run.smithi183.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:22:55.753 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether f6:96:c9:db:32:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:22:55.753 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::f496:c9ff:fedb:327c/64 scope link 2024-05-08T04:22:55.753 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:22:55.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:55.754 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T04:22:55.820 INFO:teuthology.orchestra.run.smithi183.stdout:1 2024-05-08T04:22:55.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:55.822 DEBUG:teuthology.orchestra.run.smithi183:> route 2024-05-08T04:22:55.881 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2024-05-08T04:22:55.881 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T04:22:55.881 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T04:22:55.882 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T04:22:55.882 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T04:22:55.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:55.882 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-05-08T04:22:55.882 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-05-08T04:22:55.882 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T04:22:55.882 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T04:22:55.882 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T04:22:55.882 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-05-08T04:22:55.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:55.975 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2024-05-08T04:22:55.991 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-08T04:22:55.991 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-08T04:22:55.991 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-08T04:22:55.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:55.991 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2024-05-08T04:22:56.058 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-05-08T04:22:56.059 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:22:56.059 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-08T04:22:56.115 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-08T04:22:56.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:22:56.115 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-08T04:22:56.172 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2024-05-08T04:22:56.238 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:22:56.295 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/bpf 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2024-05-08T04:22:56.296 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2024-05-08T04:22:56.297 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2024-05-08T04:22:56.298 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:22:56.298 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:22:56.298 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:22:56.298 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:22:56.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:56.298 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2024-05-08T04:22:56.351 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T04:22:56.351 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-05-08T04:22:56.394 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2024-05-08T04:22:56.419 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:22:56.475 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2024-05-08T04:22:56.476 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2024-05-08T04:22:56.476 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2024-05-08T04:22:56.476 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2024-05-08T04:22:56.476 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2024-05-08T04:22:56.476 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2024-05-08T04:22:56.476 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2024-05-08T04:22:56.476 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2024-05-08T04:22:56.476 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2024-05-08T04:22:56.476 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/bpf 2024-05-08T04:22:56.476 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2024-05-08T04:22:56.476 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2024-05-08T04:22:56.476 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:22:56.476 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2024-05-08T04:22:56.477 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2024-05-08T04:22:56.478 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2024-05-08T04:22:56.478 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2024-05-08T04:22:56.478 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:22:56.478 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:22:56.478 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:22:56.478 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:22:56.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:56.478 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2024-05-08T04:22:56.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:2024-05-08T04:22:56.475+0000 7f89d7d29480 -1 init, newargv = 0x561fcaa05510 newargc=15 2024-05-08T04:22:56.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[43493]: starting ceph client 2024-05-08T04:22:56.481 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[43493]: starting fuse 2024-05-08T04:22:56.494 INFO:teuthology.orchestra.run.smithi183.stdout:42 2024-05-08T04:22:56.494 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-08T04:22:56.494 DEBUG:teuthology.orchestra.run.smithi183:> sudo stdin-killer -- python3 -c ' 2024-05-08T04:22:56.494 DEBUG:teuthology.orchestra.run.smithi183:> import glob 2024-05-08T04:22:56.494 DEBUG:teuthology.orchestra.run.smithi183:> import re 2024-05-08T04:22:56.494 DEBUG:teuthology.orchestra.run.smithi183:> import os 2024-05-08T04:22:56.494 DEBUG:teuthology.orchestra.run.smithi183:> import subprocess 2024-05-08T04:22:56.494 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:22:56.494 DEBUG:teuthology.orchestra.run.smithi183:> def _find_admin_socket(client_name): 2024-05-08T04:22:56.494 DEBUG:teuthology.orchestra.run.smithi183:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-08T04:22:56.494 DEBUG:teuthology.orchestra.run.smithi183:> files = glob.glob(asok_path) 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> # Given a non-glob path, it better be there 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> if "*" not in asok_path: 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> assert(len(files) == 1) 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> return files[0] 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> for f in files: 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> contents = proc_f.read() 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> if mountpoint in contents: 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> return f 2024-05-08T04:22:56.495 DEBUG:teuthology.orchestra.run.smithi183:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T04:22:56.496 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:22:56.496 DEBUG:teuthology.orchestra.run.smithi183:> print(_find_admin_socket("client.1")) 2024-05-08T04:22:56.496 DEBUG:teuthology.orchestra.run.smithi183:> ' 2024-05-08T04:22:56.610 INFO:teuthology.orchestra.run.smithi183.stdout:/var/run/ceph/ceph-client.1.43493.asok 2024-05-08T04:22:56.613 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:22:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T04:22:56.620 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43493.asok 2024-05-08T04:22:56.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:56.620 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43493.asok status 2024-05-08T04:22:56.754 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-05-08T04:22:56.755 INFO:teuthology.orchestra.run.smithi183.stdout: "metadata": { 2024-05-08T04:22:56.755 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", 2024-05-08T04:22:56.755 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", 2024-05-08T04:22:56.755 INFO:teuthology.orchestra.run.smithi183.stdout: "entity_id": "1", 2024-05-08T04:22:56.755 INFO:teuthology.orchestra.run.smithi183.stdout: "hostname": "smithi183", 2024-05-08T04:22:56.755 INFO:teuthology.orchestra.run.smithi183.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-08T04:22:56.755 INFO:teuthology.orchestra.run.smithi183.stdout: "pid": "43493", 2024-05-08T04:22:56.755 INFO:teuthology.orchestra.run.smithi183.stdout: "root": "/" 2024-05-08T04:22:56.755 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:22:56.755 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_count": 0, 2024-05-08T04:22:56.755 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_pinned_count": 0, 2024-05-08T04:22:56.755 INFO:teuthology.orchestra.run.smithi183.stdout: "id": 5398, 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: "inst": { 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: "name": { 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "client", 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: "num": 5398 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 51114357 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-05-08T04:22:56.756 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:22:56.757 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 51114357 2024-05-08T04:22:56.757 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:22:56.757 INFO:teuthology.orchestra.run.smithi183.stdout: "inst_str": "client.5398 192.168.0.1:0/51114357", 2024-05-08T04:22:56.757 INFO:teuthology.orchestra.run.smithi183.stdout: "addr_str": "192.168.0.1:0/51114357", 2024-05-08T04:22:56.757 INFO:teuthology.orchestra.run.smithi183.stdout: "inode_count": 1, 2024-05-08T04:22:56.757 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_epoch": 21, 2024-05-08T04:22:56.757 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch": 47, 2024-05-08T04:22:56.757 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch_barrier": 0, 2024-05-08T04:22:56.757 INFO:teuthology.orchestra.run.smithi183.stdout: "blocklisted": false, 2024-05-08T04:22:56.757 INFO:teuthology.orchestra.run.smithi183.stdout: "fs_name": "cephfs" 2024-05-08T04:22:56.757 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-05-08T04:22:56.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:56.763 DEBUG:teuthology.orchestra.run.smithi183:> stat --file-system '--printf=%T 2024-05-08T04:22:56.763 DEBUG:teuthology.orchestra.run.smithi183:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-08T04:22:56.779 INFO:teuthology.orchestra.run.smithi183.stdout:fuseblk 2024-05-08T04:22:56.779 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-08T04:22:56.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:22:56.780 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-08T04:22:56.845 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-08T04:22:56.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.958+0000 7fa3bc04d640 1 Processor -- start 2024-05-08T04:22:56.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.958+0000 7fa3bc04d640 1 -- start start 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.959+0000 7fa3bc04d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa3b40c5a20 0x7fa3b4165540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.959+0000 7fa3bc04d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b40c4280 con 0x7fa3b40b2d40 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.959+0000 7fa3bc04d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b40cf530 con 0x7fa3b415ab60 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.959+0000 7fa3bc04d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b40cbc40 con 0x7fa3b40c5a20 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.959+0000 7fa3b95e8640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fa3b40b2d40 0x7fa3b40cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42376/0 (socket says 172.21.15.104:42376) 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.959+0000 7fa3b95e8640 1 -- 172.21.15.104:0/3258756818 learned_addr learned my addr 172.21.15.104:0/3258756818 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.959+0000 7fa3ba5ea640 1 --2- 172.21.15.104:0/3258756818 >> v2:172.21.15.183:3300/0 conn(0x7fa3b40c5a20 0x7fa3b4165540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.959+0000 7fa3b8de7640 1 -- 172.21.15.104:0/3258756818 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197647732 0 0) 0x7fa3b40c4280 con 0x7fa3b40b2d40 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.959+0000 7fa3b8de7640 1 -- 172.21.15.104:0/3258756818 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3a0003520 con 0x7fa3b40b2d40 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.959+0000 7fa3b8de7640 1 -- 172.21.15.104:0/3258756818 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528083064 0 0) 0x7fa3b40cf530 con 0x7fa3b415ab60 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.959+0000 7fa3b8de7640 1 -- 172.21.15.104:0/3258756818 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3b40c4280 con 0x7fa3b415ab60 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.960+0000 7fa3b8de7640 1 -- 172.21.15.104:0/3258756818 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1678513907 0 0) 0x7fa3a0003520 con 0x7fa3b40b2d40 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.960+0000 7fa3ba5ea640 1 -- 172.21.15.104:0/3258756818 >> v1:172.21.15.183:6789/0 conn(0x7fa3b415ab60 legacy=0x7fa3b40ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.960+0000 7fa3ba5ea640 1 -- 172.21.15.104:0/3258756818 >> v1:172.21.15.104:6789/0 conn(0x7fa3b40b2d40 legacy=0x7fa3b40cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:56.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.960+0000 7fa3ba5ea640 1 -- 172.21.15.104:0/3258756818 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b40cbe90 con 0x7fa3b40c5a20 2024-05-08T04:22:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.960+0000 7fa3ba5ea640 1 --2- 172.21.15.104:0/3258756818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b40c5a20 0x7fa3b4165540 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009d90 tx=0x7fa3ac02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e80963b560c0731d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.960+0000 7fa3b8de7640 1 -- 172.21.15.104:0/3258756818 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0001670 con 0x7fa3b40c5a20 2024-05-08T04:22:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.961+0000 7fa3b8de7640 1 -- 172.21.15.104:0/3258756818 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac007540 con 0x7fa3b40c5a20 2024-05-08T04:22:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.961+0000 7fa3b8de7640 1 -- 172.21.15.104:0/3258756818 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac0078f0 con 0x7fa3b40c5a20 2024-05-08T04:22:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.961+0000 7fa3bc04d640 1 -- 172.21.15.104:0/3258756818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b40c5a20 msgr2=0x7fa3b4165540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.961+0000 7fa3bc04d640 1 --2- 172.21.15.104:0/3258756818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b40c5a20 0x7fa3b4165540 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009d90 tx=0x7fa3ac02a5f0 comp rx=0 tx=0).stop 2024-05-08T04:22:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.961+0000 7fa3bc04d640 1 -- 172.21.15.104:0/3258756818 shutdown_connections 2024-05-08T04:22:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.961+0000 7fa3bc04d640 1 --2- 172.21.15.104:0/3258756818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b40c5a20 0x7fa3b4165540 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.961+0000 7fa3bc04d640 1 -- 172.21.15.104:0/3258756818 >> 172.21.15.104:0/3258756818 conn(0x7fa3b40b2220 msgr2=0x7fa3b40b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.961+0000 7fa3bc04d640 1 -- 172.21.15.104:0/3258756818 shutdown_connections 2024-05-08T04:22:56.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.961+0000 7fa3bc04d640 1 -- 172.21.15.104:0/3258756818 wait complete. 2024-05-08T04:22:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.962+0000 7fa3bc04d640 1 Processor -- start 2024-05-08T04:22:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.963+0000 7fa3bc04d640 1 -- start start 2024-05-08T04:22:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.963+0000 7fa3bc04d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3b40b2d40 0x7fa3b4154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.963+0000 7fa3bc04d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b40c5a20 0x7fa3b40c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.963+0000 7fa3bc04d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b415ab60 0x7fa3b40cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.963+0000 7fa3bc04d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b40cc450 con 0x7fa3b40c5a20 2024-05-08T04:22:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.963+0000 7fa3bc04d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b40c44f0 con 0x7fa3b415ab60 2024-05-08T04:22:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.963+0000 7fa3bc04d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b4165a80 con 0x7fa3b40b2d40 2024-05-08T04:22:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.963+0000 7fa3b95e8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b40c5a20 0x7fa3b40c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.963+0000 7fa3b95e8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b40c5a20 0x7fa3b40c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57596/0 (socket says 172.21.15.104:57596) 2024-05-08T04:22:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.963+0000 7fa3b95e8640 1 -- 172.21.15.104:0/709670555 learned_addr learned my addr 172.21.15.104:0/709670555 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.963+0000 7fa3ba5ea640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b415ab60 0x7fa3b40cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.963+0000 7fa3b9de9640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3b40b2d40 0x7fa3b4154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.964+0000 7fa3b95e8640 1 -- 172.21.15.104:0/709670555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3b40b2d40 msgr2=0x7fa3b4154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.964+0000 7fa3b95e8640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3b40b2d40 0x7fa3b4154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.964+0000 7fa3b95e8640 1 -- 172.21.15.104:0/709670555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b415ab60 msgr2=0x7fa3b40cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.964+0000 7fa3b95e8640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b415ab60 0x7fa3b40cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.964+0000 7fa3b95e8640 1 -- 172.21.15.104:0/709670555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b40ad500 con 0x7fa3b40c5a20 2024-05-08T04:22:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.964+0000 7fa3b95e8640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b40c5a20 0x7fa3b40c8100 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000c520 tx=0x7fa3b000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.964+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/709670555 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0017070 con 0x7fa3b40c5a20 2024-05-08T04:22:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.964+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/709670555 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b0005ce0 con 0x7fa3b40c5a20 2024-05-08T04:22:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.964+0000 7fa3bc04d640 1 -- 172.21.15.104:0/709670555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b40b34b0 con 0x7fa3b40c5a20 2024-05-08T04:22:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.964+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/709670555 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00072b0 con 0x7fa3b40c5a20 2024-05-08T04:22:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.964+0000 7fa3bc04d640 1 -- 172.21.15.104:0/709670555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b40b3a70 con 0x7fa3b40c5a20 2024-05-08T04:22:56.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.965+0000 7fa3bc04d640 1 -- 172.21.15.104:0/709670555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b4075010 con 0x7fa3b40c5a20 2024-05-08T04:22:56.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.965+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/709670555 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fa3b001a070 con 0x7fa3b40c5a20 2024-05-08T04:22:56.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.966+0000 7fa3aa7fc640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa39806b680 0x7fa39806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:56.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.966+0000 7fa3b9de9640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa39806b680 0x7fa39806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:56.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.966+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/709670555 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fa3b0089840 con 0x7fa3b40c5a20 2024-05-08T04:22:56.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.966+0000 7fa3b9de9640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa39806b680 0x7fa39806db40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40011e0 tx=0x7fa3a4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:56.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:56.970+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/709670555 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa3b0057ea0 con 0x7fa3b40c5a20 2024-05-08T04:22:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:57.177+0000 7fa3bc04d640 1 -- 172.21.15.104:0/709670555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa3b40c3c80 con 0x7fa3b40c5a20 2024-05-08T04:22:58.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.036+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/709670555 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 136+0+0 (secure 0 0 0) 0x7fa3b005bf40 con 0x7fa3b40c5a20 2024-05-08T04:22:58.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.038+0000 7fa3bc04d640 1 -- 172.21.15.104:0/709670555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa39806b680 msgr2=0x7fa39806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.038+0000 7fa3bc04d640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa39806b680 0x7fa39806db40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40011e0 tx=0x7fa3a4009040 comp rx=0 tx=0).stop 2024-05-08T04:22:58.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.038+0000 7fa3bc04d640 1 -- 172.21.15.104:0/709670555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b40c5a20 msgr2=0x7fa3b40c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.038+0000 7fa3bc04d640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b40c5a20 0x7fa3b40c8100 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000c520 tx=0x7fa3b000c9e0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.038+0000 7fa3bc04d640 1 -- 172.21.15.104:0/709670555 shutdown_connections 2024-05-08T04:22:58.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.038+0000 7fa3bc04d640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa39806b680 0x7fa39806db40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.038+0000 7fa3bc04d640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b415ab60 0x7fa3b40cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.038+0000 7fa3bc04d640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b40c5a20 0x7fa3b40c8100 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.039+0000 7fa3bc04d640 1 --2- 172.21.15.104:0/709670555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3b40b2d40 0x7fa3b4154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.039+0000 7fa3bc04d640 1 -- 172.21.15.104:0/709670555 >> 172.21.15.104:0/709670555 conn(0x7fa3b40b2220 msgr2=0x7fa3b40b5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:58.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.039+0000 7fa3bc04d640 1 -- 172.21.15.104:0/709670555 shutdown_connections 2024-05-08T04:22:58.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.039+0000 7fa3bc04d640 1 -- 172.21.15.104:0/709670555 wait complete. 2024-05-08T04:22:58.053 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-08T04:22:58.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.158+0000 7ff2c889e640 1 Processor -- start 2024-05-08T04:22:58.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.158+0000 7ff2c889e640 1 -- start start 2024-05-08T04:22:58.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.159+0000 7ff2c889e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff2c40ceee0 0x7ff2c40b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.159+0000 7ff2c889e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c415e780 con 0x7ff2c406e330 2024-05-08T04:22:58.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.159+0000 7ff2c889e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c415ea60 con 0x7ff2c40b4700 2024-05-08T04:22:58.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.159+0000 7ff2c889e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c415f390 con 0x7ff2c40ceee0 2024-05-08T04:22:58.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.159+0000 7ff2c259c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff2c40ceee0 0x7ff2c40b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.159+0000 7ff2bbfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff2c406e330 0x7ff2c40b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39042/0 (socket says 172.21.15.104:39042) 2024-05-08T04:22:58.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.159+0000 7ff2c259c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff2c40ceee0 0x7ff2c40b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44340/0 (socket says 172.21.15.104:44340) 2024-05-08T04:22:58.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.159+0000 7ff2bbfff640 1 -- 172.21.15.104:0/1986115666 learned_addr learned my addr 172.21.15.104:0/1986115666 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:58.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.159+0000 7ff2c259c640 1 -- 172.21.15.104:0/1986115666 >> v1:172.21.15.183:6789/0 conn(0x7ff2c40b4700 legacy=0x7ff2c415b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.159+0000 7ff2c259c640 1 -- 172.21.15.104:0/1986115666 >> v1:172.21.15.104:6789/0 conn(0x7ff2c406e330 legacy=0x7ff2c40b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.159+0000 7ff2c259c640 1 -- 172.21.15.104:0/1986115666 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c415ed40 con 0x7ff2c40ceee0 2024-05-08T04:22:58.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.160+0000 7ff2c259c640 1 --2- 172.21.15.104:0/1986115666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2c40ceee0 0x7ff2c40b26f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40097a0 tx=0x7ff2b402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff308bb29b88d2a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:58.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.160+0000 7ff2c1d9b640 1 -- 172.21.15.104:0/1986115666 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4037070 con 0x7ff2c40ceee0 2024-05-08T04:22:58.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.160+0000 7ff2c1d9b640 1 -- 172.21.15.104:0/1986115666 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b4032440 con 0x7ff2c40ceee0 2024-05-08T04:22:58.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.160+0000 7ff2c1d9b640 1 -- 172.21.15.104:0/1986115666 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4032810 con 0x7ff2c40ceee0 2024-05-08T04:22:58.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.160+0000 7ff2c889e640 1 -- 172.21.15.104:0/1986115666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2c40ceee0 msgr2=0x7ff2c40b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.160+0000 7ff2c889e640 1 --2- 172.21.15.104:0/1986115666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2c40ceee0 0x7ff2c40b26f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40097a0 tx=0x7ff2b402a230 comp rx=0 tx=0).stop 2024-05-08T04:22:58.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.160+0000 7ff2c889e640 1 -- 172.21.15.104:0/1986115666 shutdown_connections 2024-05-08T04:22:58.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.160+0000 7ff2c889e640 1 --2- 172.21.15.104:0/1986115666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2c40ceee0 0x7ff2c40b26f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.160+0000 7ff2c889e640 1 -- 172.21.15.104:0/1986115666 >> 172.21.15.104:0/1986115666 conn(0x7ff2c40b13f0 msgr2=0x7ff2c40b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:58.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.160+0000 7ff2c889e640 1 -- 172.21.15.104:0/1986115666 shutdown_connections 2024-05-08T04:22:58.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.160+0000 7ff2c889e640 1 -- 172.21.15.104:0/1986115666 wait complete. 2024-05-08T04:22:58.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.162+0000 7ff2c889e640 1 Processor -- start 2024-05-08T04:22:58.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.162+0000 7ff2c889e640 1 -- start start 2024-05-08T04:22:58.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.162+0000 7ff2c889e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2c406e330 0x7ff2c40c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.162+0000 7ff2c889e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2c40b4700 0x7ff2c4146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.162+0000 7ff2c889e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2c40ceee0 0x7ff2c415ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.162+0000 7ff2c889e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40cf440 con 0x7ff2c40ceee0 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.162+0000 7ff2c889e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40cf2c0 con 0x7ff2c40b4700 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.162+0000 7ff2c889e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c406e7e0 con 0x7ff2c406e330 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2c2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2c40ceee0 0x7ff2c415ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2c2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2c40ceee0 0x7ff2c415ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44350/0 (socket says 172.21.15.104:44350) 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2c2d9d640 1 -- 172.21.15.104:0/208540567 learned_addr learned my addr 172.21.15.104:0/208540567 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2c259c640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2c406e330 0x7ff2c40c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2bbfff640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2c40b4700 0x7ff2c4146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2c2d9d640 1 -- 172.21.15.104:0/208540567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2c406e330 msgr2=0x7ff2c40c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2c2d9d640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2c406e330 0x7ff2c40c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2c2d9d640 1 -- 172.21.15.104:0/208540567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2c40b4700 msgr2=0x7ff2c4146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2c2d9d640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2c40b4700 0x7ff2c4146160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2c2d9d640 1 -- 172.21.15.104:0/208540567 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c415d230 con 0x7ff2c40ceee0 2024-05-08T04:22:58.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2bbfff640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2c40b4700 0x7ff2c4146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:58.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2c2d9d640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2c40ceee0 0x7ff2c415ccf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c7d0 tx=0x7ff2bc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:58.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2baffd640 1 -- 172.21.15.104:0/208540567 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc003b70 con 0x7ff2c40ceee0 2024-05-08T04:22:58.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2baffd640 1 -- 172.21.15.104:0/208540567 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc003d30 con 0x7ff2c40ceee0 2024-05-08T04:22:58.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2c889e640 1 -- 172.21.15.104:0/208540567 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c40c9050 con 0x7ff2c40ceee0 2024-05-08T04:22:58.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2baffd640 1 -- 172.21.15.104:0/208540567 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00aa90 con 0x7ff2c40ceee0 2024-05-08T04:22:58.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.163+0000 7ff2c889e640 1 -- 172.21.15.104:0/208540567 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c40c9610 con 0x7ff2c40ceee0 2024-05-08T04:22:58.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.164+0000 7ff2c889e640 1 -- 172.21.15.104:0/208540567 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c4075010 con 0x7ff2c40ceee0 2024-05-08T04:22:58.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.165+0000 7ff2baffd640 1 -- 172.21.15.104:0/208540567 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7ff2bc00ac30 con 0x7ff2c40ceee0 2024-05-08T04:22:58.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.165+0000 7ff2baffd640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff2a406b680 0x7ff2a406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.165+0000 7ff2baffd640 1 -- 172.21.15.104:0/208540567 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff2bc08a4b0 con 0x7ff2c40ceee0 2024-05-08T04:22:58.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.165+0000 7ff2c259c640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff2a406b680 0x7ff2a406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.166+0000 7ff2c259c640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff2a406b680 0x7ff2a406db40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4034000 tx=0x7ff2b402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:58.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.169+0000 7ff2baffd640 1 -- 172.21.15.104:0/208540567 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff2bc058f90 con 0x7ff2c40ceee0 2024-05-08T04:22:58.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.358+0000 7ff2c889e640 1 -- 172.21.15.104:0/208540567 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2c406f3f0 con 0x7ff2a406b680 2024-05-08T04:22:58.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.360+0000 7ff2baffd640 1 -- 172.21.15.104:0/208540567 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff2c406f3f0 con 0x7ff2a406b680 2024-05-08T04:22:58.361 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-05-08T04:22:58.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:22:58.361 INFO:teuthology.orchestra.run.smithi104.stdout: "name": "cephfs" 2024-05-08T04:22:58.361 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:22:58.361 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-05-08T04:22:58.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.361+0000 7ff2c889e640 1 -- 172.21.15.104:0/208540567 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff2a406b680 msgr2=0x7ff2a406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.361+0000 7ff2c889e640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff2a406b680 0x7ff2a406db40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4034000 tx=0x7ff2b402e000 comp rx=0 tx=0).stop 2024-05-08T04:22:58.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.361+0000 7ff2c889e640 1 -- 172.21.15.104:0/208540567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2c40ceee0 msgr2=0x7ff2c415ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.361+0000 7ff2c889e640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2c40ceee0 0x7ff2c415ccf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c7d0 tx=0x7ff2bc00cc90 comp rx=0 tx=0).stop 2024-05-08T04:22:58.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.362+0000 7ff2c889e640 1 -- 172.21.15.104:0/208540567 shutdown_connections 2024-05-08T04:22:58.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.362+0000 7ff2c889e640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff2a406b680 0x7ff2a406db40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.362+0000 7ff2c889e640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2c40b4700 0x7ff2c4146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.362+0000 7ff2c889e640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2c40ceee0 0x7ff2c415ccf0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.362+0000 7ff2c889e640 1 --2- 172.21.15.104:0/208540567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2c406e330 0x7ff2c40c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.362+0000 7ff2c889e640 1 -- 172.21.15.104:0/208540567 >> 172.21.15.104:0/208540567 conn(0x7ff2c40b13f0 msgr2=0x7ff2c40cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:58.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.362+0000 7ff2c889e640 1 -- 172.21.15.104:0/208540567 shutdown_connections 2024-05-08T04:22:58.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.362+0000 7ff2c889e640 1 -- 172.21.15.104:0/208540567 wait complete. 2024-05-08T04:22:58.375 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-08T04:22:58.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.476+0000 7f0e357b0640 1 Processor -- start 2024-05-08T04:22:58.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.476+0000 7f0e357b0640 1 -- start start 2024-05-08T04:22:58.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e357b0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0e3015de10 0x7f0e30161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e357b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e300ce5a0 0x7f0e300d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e357b0640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e300d3210 con 0x7f0e300d05f0 2024-05-08T04:22:58.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e357b0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e300d0f50 con 0x7f0e3015de10 2024-05-08T04:22:58.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e357b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e30161e60 con 0x7f0e300ce5a0 2024-05-08T04:22:58.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e2f7fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f0e300d05f0 0x7f0e300b54a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39058/0 (socket says 172.21.15.104:39058) 2024-05-08T04:22:58.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e2f7fe640 1 -- 172.21.15.104:0/10351705 learned_addr learned my addr 172.21.15.104:0/10351705 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:58.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e2effd640 1 --2- 172.21.15.104:0/10351705 >> v2:172.21.15.183:3300/0 conn(0x7f0e3015de10 0x7f0e30161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e267fc640 1 --2- 172.21.15.104:0/10351705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e300ce5a0 0x7f0e300d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e2e7fc640 1 -- 172.21.15.104:0/10351705 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673625462 0 0) 0x7f0e300d3210 con 0x7f0e300d05f0 2024-05-08T04:22:58.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e2e7fc640 1 -- 172.21.15.104:0/10351705 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e1c003520 con 0x7f0e300d05f0 2024-05-08T04:22:58.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e2effd640 1 -- 172.21.15.104:0/10351705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e300ce5a0 msgr2=0x7f0e300d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:58.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e2effd640 1 --2- 172.21.15.104:0/10351705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e300ce5a0 0x7f0e300d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e2effd640 1 -- 172.21.15.104:0/10351705 >> v1:172.21.15.104:6789/0 conn(0x7f0e300d05f0 legacy=0x7f0e300b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e2effd640 1 -- 172.21.15.104:0/10351705 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3015e1f0 con 0x7f0e3015de10 2024-05-08T04:22:58.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.477+0000 7f0e267fc640 1 --2- 172.21.15.104:0/10351705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e300ce5a0 0x7f0e300d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:22:58.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.478+0000 7f0e2effd640 1 --2- 172.21.15.104:0/10351705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e3015de10 0x7f0e30161920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e200097a0 tx=0x7f0e2002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92911a3f9e6276bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:58.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.479+0000 7f0e2e7fc640 1 -- 172.21.15.104:0/10351705 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20037070 con 0x7f0e3015de10 2024-05-08T04:22:58.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.479+0000 7f0e2e7fc640 1 -- 172.21.15.104:0/10351705 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2002ae50 con 0x7f0e3015de10 2024-05-08T04:22:58.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.479+0000 7f0e2e7fc640 1 -- 172.21.15.104:0/10351705 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20032640 con 0x7f0e3015de10 2024-05-08T04:22:58.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.479+0000 7f0e357b0640 1 -- 172.21.15.104:0/10351705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e3015de10 msgr2=0x7f0e30161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.479+0000 7f0e357b0640 1 --2- 172.21.15.104:0/10351705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e3015de10 0x7f0e30161920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e200097a0 tx=0x7f0e2002a100 comp rx=0 tx=0).stop 2024-05-08T04:22:58.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.479+0000 7f0e357b0640 1 -- 172.21.15.104:0/10351705 shutdown_connections 2024-05-08T04:22:58.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.479+0000 7f0e357b0640 1 --2- 172.21.15.104:0/10351705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e300ce5a0 0x7f0e300d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.479+0000 7f0e357b0640 1 --2- 172.21.15.104:0/10351705 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e3015de10 0x7f0e30161920 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.479+0000 7f0e357b0640 1 -- 172.21.15.104:0/10351705 >> 172.21.15.104:0/10351705 conn(0x7f0e30072290 msgr2=0x7f0e30072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:58.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.479+0000 7f0e357b0640 1 -- 172.21.15.104:0/10351705 shutdown_connections 2024-05-08T04:22:58.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.479+0000 7f0e357b0640 1 -- 172.21.15.104:0/10351705 wait complete. 2024-05-08T04:22:58.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.480+0000 7f0e357b0640 1 Processor -- start 2024-05-08T04:22:58.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.480+0000 7f0e357b0640 1 -- start start 2024-05-08T04:22:58.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.481+0000 7f0e357b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e300ce5a0 0x7f0e300c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.481+0000 7f0e357b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e300d05f0 0x7f0e3013da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.481+0000 7f0e357b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3015de10 0x7f0e3015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.481+0000 7f0e357b0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e30162090 con 0x7f0e300ce5a0 2024-05-08T04:22:58.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.481+0000 7f0e357b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300d1a90 con 0x7f0e300d05f0 2024-05-08T04:22:58.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.481+0000 7f0e357b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e30162370 con 0x7f0e3015de10 2024-05-08T04:22:58.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.481+0000 7f0e2effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e300ce5a0 0x7f0e300c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.481+0000 7f0e2effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e300ce5a0 0x7f0e300c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44358/0 (socket says 172.21.15.104:44358) 2024-05-08T04:22:58.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.481+0000 7f0e2effd640 1 -- 172.21.15.104:0/1366202500 learned_addr learned my addr 172.21.15.104:0/1366202500 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:58.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.481+0000 7f0e267fc640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e300d05f0 0x7f0e3013da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.481+0000 7f0e2f7fe640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3015de10 0x7f0e3015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.482+0000 7f0e2effd640 1 -- 172.21.15.104:0/1366202500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3015de10 msgr2=0x7f0e3015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.482+0000 7f0e2effd640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3015de10 0x7f0e3015a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.482+0000 7f0e2effd640 1 -- 172.21.15.104:0/1366202500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e300d05f0 msgr2=0x7f0e3013da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.482+0000 7f0e2effd640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e300d05f0 0x7f0e3013da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.482+0000 7f0e2effd640 1 -- 172.21.15.104:0/1366202500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3015f610 con 0x7f0e300ce5a0 2024-05-08T04:22:58.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.482+0000 7f0e2effd640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e300ce5a0 0x7f0e300c98c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0e2002a140 tx=0x7f0e200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:58.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.482+0000 7f0e27fff640 1 -- 172.21.15.104:0/1366202500 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20041070 con 0x7f0e300ce5a0 2024-05-08T04:22:58.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.482+0000 7f0e27fff640 1 -- 172.21.15.104:0/1366202500 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2003c460 con 0x7f0e300ce5a0 2024-05-08T04:22:58.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.482+0000 7f0e357b0640 1 -- 172.21.15.104:0/1366202500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3015f8f0 con 0x7f0e300ce5a0 2024-05-08T04:22:58.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.482+0000 7f0e27fff640 1 -- 172.21.15.104:0/1366202500 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20037040 con 0x7f0e300ce5a0 2024-05-08T04:22:58.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.482+0000 7f0e357b0640 1 -- 172.21.15.104:0/1366202500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3015feb0 con 0x7f0e300ce5a0 2024-05-08T04:22:58.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.483+0000 7f0e357b0640 1 -- 172.21.15.104:0/1366202500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e30075010 con 0x7f0e300ce5a0 2024-05-08T04:22:58.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.483+0000 7f0e27fff640 1 -- 172.21.15.104:0/1366202500 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f0e20044070 con 0x7f0e300ce5a0 2024-05-08T04:22:58.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.484+0000 7f0e27fff640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0e1006b680 0x7f0e1006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.484+0000 7f0e267fc640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0e1006b680 0x7f0e1006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.484+0000 7f0e27fff640 1 -- 172.21.15.104:0/1366202500 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0e200aab90 con 0x7f0e300ce5a0 2024-05-08T04:22:58.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.484+0000 7f0e267fc640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0e1006b680 0x7f0e1006db40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0e300b3780 tx=0x7f0e18008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:58.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.488+0000 7f0e27fff640 1 -- 172.21.15.104:0/1366202500 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0e20079700 con 0x7f0e300ce5a0 2024-05-08T04:22:58.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.659+0000 7f0e357b0640 1 -- 172.21.15.104:0/1366202500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0e300d1870 con 0x7f0e300ce5a0 2024-05-08T04:22:58.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.659+0000 7f0e27fff640 1 -- 172.21.15.104:0/1366202500 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0e20079000 con 0x7f0e300ce5a0 2024-05-08T04:22:58.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.661+0000 7f0e357b0640 1 -- 172.21.15.104:0/1366202500 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0e1006b680 msgr2=0x7f0e1006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.661+0000 7f0e357b0640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0e1006b680 0x7f0e1006db40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0e300b3780 tx=0x7f0e18008040 comp rx=0 tx=0).stop 2024-05-08T04:22:58.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.661+0000 7f0e357b0640 1 -- 172.21.15.104:0/1366202500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e300ce5a0 msgr2=0x7f0e300c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.661+0000 7f0e357b0640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e300ce5a0 0x7f0e300c98c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0e2002a140 tx=0x7f0e200046c0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.661+0000 7f0e357b0640 1 -- 172.21.15.104:0/1366202500 shutdown_connections 2024-05-08T04:22:58.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.661+0000 7f0e357b0640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0e1006b680 0x7f0e1006db40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.661+0000 7f0e357b0640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e300d05f0 0x7f0e3013da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.661+0000 7f0e357b0640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3015de10 0x7f0e3015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.661+0000 7f0e357b0640 1 --2- 172.21.15.104:0/1366202500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0e300ce5a0 0x7f0e300c98c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.661+0000 7f0e357b0640 1 -- 172.21.15.104:0/1366202500 >> 172.21.15.104:0/1366202500 conn(0x7f0e30072290 msgr2=0x7f0e300cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:58.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.662+0000 7f0e357b0640 1 -- 172.21.15.104:0/1366202500 shutdown_connections 2024-05-08T04:22:58.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.662+0000 7f0e357b0640 1 -- 172.21.15.104:0/1366202500 wait complete. 2024-05-08T04:22:58.674 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:22:58.674 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:22:58.690 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:22:58.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.828+0000 7f85eb25d640 1 Processor -- start 2024-05-08T04:22:58.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.828+0000 7f85eb25d640 1 -- start start 2024-05-08T04:22:58.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.829+0000 7f85eb25d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85e40d07c0 0x7f85e4161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.829+0000 7f85eb25d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e415e1f0 con 0x7f85e40ce5a0 2024-05-08T04:22:58.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.829+0000 7f85eb25d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e4162090 con 0x7f85e415de10 2024-05-08T04:22:58.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.829+0000 7f85eb25d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e40d0f50 con 0x7f85e40d07c0 2024-05-08T04:22:58.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.829+0000 7f85dbfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f85e40ce5a0 0x7f85e40d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39074/0 (socket says 172.21.15.104:39074) 2024-05-08T04:22:58.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.829+0000 7f85dbfff640 1 -- 172.21.15.104:0/2390010746 learned_addr learned my addr 172.21.15.104:0/2390010746 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:58.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.830+0000 7f85e97fa640 1 --2- 172.21.15.104:0/2390010746 >> v2:172.21.15.183:3300/0 conn(0x7f85e40d07c0 0x7f85e4161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.830+0000 7f85db7fe640 1 -- 172.21.15.104:0/2390010746 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893118322 0 0) 0x7f85e415e1f0 con 0x7f85e40ce5a0 2024-05-08T04:22:58.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.830+0000 7f85db7fe640 1 -- 172.21.15.104:0/2390010746 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85cc003520 con 0x7f85e40ce5a0 2024-05-08T04:22:58.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.830+0000 7f85db7fe640 1 -- 172.21.15.104:0/2390010746 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2823504976 0 0) 0x7f85cc003520 con 0x7f85e40ce5a0 2024-05-08T04:22:58.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.830+0000 7f85e97fa640 1 -- 172.21.15.104:0/2390010746 >> v1:172.21.15.183:6789/0 conn(0x7f85e415de10 legacy=0x7f85e40d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.830+0000 7f85e97fa640 1 -- 172.21.15.104:0/2390010746 >> v1:172.21.15.104:6789/0 conn(0x7f85e40ce5a0 legacy=0x7f85e40d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.830+0000 7f85e97fa640 1 -- 172.21.15.104:0/2390010746 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e4162370 con 0x7f85e40d07c0 2024-05-08T04:22:58.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.831+0000 7f85e97fa640 1 --2- 172.21.15.104:0/2390010746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e40d07c0 0x7f85e4161920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009d90 tx=0x7f85dc02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44ad28d275f2d164 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:58.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.831+0000 7f85db7fe640 1 -- 172.21.15.104:0/2390010746 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4001670 con 0x7f85e40d07c0 2024-05-08T04:22:58.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.831+0000 7f85db7fe640 1 -- 172.21.15.104:0/2390010746 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc007540 con 0x7f85e40d07c0 2024-05-08T04:22:58.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.831+0000 7f85db7fe640 1 -- 172.21.15.104:0/2390010746 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0078f0 con 0x7f85e40d07c0 2024-05-08T04:22:58.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.831+0000 7f85eb25d640 1 -- 172.21.15.104:0/2390010746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e40d07c0 msgr2=0x7f85e4161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.831+0000 7f85eb25d640 1 --2- 172.21.15.104:0/2390010746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e40d07c0 0x7f85e4161920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009d90 tx=0x7f85dc02a5f0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.831+0000 7f85eb25d640 1 -- 172.21.15.104:0/2390010746 shutdown_connections 2024-05-08T04:22:58.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.831+0000 7f85eb25d640 1 --2- 172.21.15.104:0/2390010746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e40d07c0 0x7f85e4161920 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.831+0000 7f85eb25d640 1 -- 172.21.15.104:0/2390010746 >> 172.21.15.104:0/2390010746 conn(0x7f85e4072290 msgr2=0x7f85e4072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:58.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.831+0000 7f85eb25d640 1 -- 172.21.15.104:0/2390010746 shutdown_connections 2024-05-08T04:22:58.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.831+0000 7f85eb25d640 1 -- 172.21.15.104:0/2390010746 wait complete. 2024-05-08T04:22:58.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.833+0000 7f85eb25d640 1 Processor -- start 2024-05-08T04:22:58.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.833+0000 7f85eb25d640 1 -- start start 2024-05-08T04:22:58.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.833+0000 7f85eb25d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e40ce5a0 0x7f85e40c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.833+0000 7f85eb25d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85e40d07c0 0x7f85e40c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.833+0000 7f85eb25d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e415de10 0x7f85e414d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.833+0000 7f85eb25d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40d1a90 con 0x7f85e40d07c0 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.833+0000 7f85eb25d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40d1ce0 con 0x7f85e415de10 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.833+0000 7f85eb25d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40b6dc0 con 0x7f85e40ce5a0 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85dbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85e40d07c0 0x7f85e40c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85dbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85e40d07c0 0x7f85e40c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44362/0 (socket says 172.21.15.104:44362) 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85dbfff640 1 -- 172.21.15.104:0/1104033713 learned_addr learned my addr 172.21.15.104:0/1104033713 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85e97fa640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e415de10 0x7f85e414d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85e8ff9640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e40ce5a0 0x7f85e40c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85dbfff640 1 -- 172.21.15.104:0/1104033713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e40ce5a0 msgr2=0x7f85e40c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85dbfff640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e40ce5a0 0x7f85e40c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85dbfff640 1 -- 172.21.15.104:0/1104033713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e415de10 msgr2=0x7f85e414d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:58.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85dbfff640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e415de10 0x7f85e414d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:58.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85dbfff640 1 -- 172.21.15.104:0/1104033713 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40cb8d0 con 0x7f85e40d07c0 2024-05-08T04:22:58.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85dbfff640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85e40d07c0 0x7f85e40c9c10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f85d400c750 tx=0x7f85d400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:58.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85d97fa640 1 -- 172.21.15.104:0/1104033713 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4017070 con 0x7f85e40d07c0 2024-05-08T04:22:58.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85d97fa640 1 -- 172.21.15.104:0/1104033713 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d4005ad0 con 0x7f85e40d07c0 2024-05-08T04:22:58.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85d97fa640 1 -- 172.21.15.104:0/1104033713 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4007070 con 0x7f85e40d07c0 2024-05-08T04:22:58.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85eb25d640 1 -- 172.21.15.104:0/1104033713 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e40cbe40 con 0x7f85e40d07c0 2024-05-08T04:22:58.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.834+0000 7f85eb25d640 1 -- 172.21.15.104:0/1104033713 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e40cc6e0 con 0x7f85e40d07c0 2024-05-08T04:22:58.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.835+0000 7f85eb25d640 1 -- 172.21.15.104:0/1104033713 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e40cc010 con 0x7f85e40d07c0 2024-05-08T04:22:58.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.836+0000 7f85d97fa640 1 -- 172.21.15.104:0/1104033713 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f85d401a070 con 0x7f85e40d07c0 2024-05-08T04:22:58.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.836+0000 7f85d97fa640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f85d006b6b0 0x7f85d006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:58.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.836+0000 7f85e8ff9640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f85d006b6b0 0x7f85d006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:58.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.836+0000 7f85d97fa640 1 -- 172.21.15.104:0/1104033713 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f85d4089a80 con 0x7f85e40d07c0 2024-05-08T04:22:58.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.836+0000 7f85e8ff9640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f85d006b6b0 0x7f85d006db70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f85e0000f60 tx=0x7f85e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:58.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:58.840+0000 7f85d97fa640 1 -- 172.21.15.104:0/1104033713 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f85d40585f0 con 0x7f85e40d07c0 2024-05-08T04:22:59.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.012+0000 7f85eb25d640 1 -- 172.21.15.104:0/1104033713 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85e40cc8e0 con 0x7f85e40d07c0 2024-05-08T04:22:59.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.013+0000 7f85d97fa640 1 -- 172.21.15.104:0/1104033713 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16961 (secure 0 0 0) 0x7f85e40cc8e0 con 0x7f85e40d07c0 2024-05-08T04:22:59.014 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:22:59.014 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":47,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:52.009332+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:42.524824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:43.279621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.39","mappings":[{"from":5,"to":7}]},{"pgid":"7.3c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:22:59.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.015+0000 7f85eb25d640 1 -- 172.21.15.104:0/1104033713 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f85d006b6b0 msgr2=0x7f85d006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.015+0000 7f85eb25d640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f85d006b6b0 0x7f85d006db70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f85e0000f60 tx=0x7f85e0009040 comp rx=0 tx=0).stop 2024-05-08T04:22:59.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.015+0000 7f85eb25d640 1 -- 172.21.15.104:0/1104033713 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85e40d07c0 msgr2=0x7f85e40c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.015+0000 7f85eb25d640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85e40d07c0 0x7f85e40c9c10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f85d400c750 tx=0x7f85d400cc10 comp rx=0 tx=0).stop 2024-05-08T04:22:59.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.015+0000 7f85eb25d640 1 -- 172.21.15.104:0/1104033713 shutdown_connections 2024-05-08T04:22:59.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.015+0000 7f85eb25d640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f85d006b6b0 0x7f85d006db70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.015+0000 7f85eb25d640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e415de10 0x7f85e414d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.015+0000 7f85eb25d640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85e40d07c0 0x7f85e40c9c10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.015+0000 7f85eb25d640 1 --2- 172.21.15.104:0/1104033713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e40ce5a0 0x7f85e40c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.015+0000 7f85eb25d640 1 -- 172.21.15.104:0/1104033713 >> 172.21.15.104:0/1104033713 conn(0x7f85e4072290 msgr2=0x7f85e4073fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:59.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.015+0000 7f85eb25d640 1 -- 172.21.15.104:0/1104033713 shutdown_connections 2024-05-08T04:22:59.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.015+0000 7f85eb25d640 1 -- 172.21.15.104:0/1104033713 wait complete. 2024-05-08T04:22:59.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:22:42.524824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:22:43.279621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:22:59.028 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:22:59.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.130+0000 7f429c1e2640 1 Processor -- start 2024-05-08T04:22:59.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.130+0000 7f429c1e2640 1 -- start start 2024-05-08T04:22:59.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f429c1e2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4294099a40 0x7f4294099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f429c1e2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f429415d490 0x7f429415d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f429c1e2640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42940cd940 con 0x7f42940b2b80 2024-05-08T04:22:59.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f429c1e2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429409a3e0 con 0x7f4294099a40 2024-05-08T04:22:59.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f429c1e2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42940cc8a0 con 0x7f429415d490 2024-05-08T04:22:59.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f4299f7e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f42940b2b80 0x7f429409a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39078/0 (socket says 172.21.15.104:39078) 2024-05-08T04:22:59.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f4299f7e640 1 -- 172.21.15.104:0/3547771686 learned_addr learned my addr 172.21.15.104:0/3547771686 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:22:59.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353414269 0 0) 0x7f42940cd940 con 0x7f42940b2b80 2024-05-08T04:22:59.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4280003520 con 0x7f42940b2b80 2024-05-08T04:22:59.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f429977d640 1 --2- 172.21.15.104:0/3547771686 >> v2:172.21.15.183:3300/0 conn(0x7f4294099a40 0x7f4294099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f429a77f640 1 --2- 172.21.15.104:0/3547771686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f429415d490 0x7f429415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 722925169 0 0) 0x7f4280003520 con 0x7f42940b2b80 2024-05-08T04:22:59.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f429415d490 msgr2=0x7f429415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f4298f7c640 1 --2- 172.21.15.104:0/3547771686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f429415d490 0x7f429415d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 >> v2:172.21.15.183:3300/0 conn(0x7f4294099a40 msgr2=0x7f4294099ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f4298f7c640 1 --2- 172.21.15.104:0/3547771686 >> v2:172.21.15.183:3300/0 conn(0x7f4294099a40 0x7f4294099ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42940ccb80 con 0x7f42940b2b80 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.131+0000 7f429a77f640 1 --2- 172.21.15.104:0/3547771686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f429415d490 0x7f429415d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f4290001670 con 0x7f42940b2b80 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 >> v1:172.21.15.104:6789/0 conn(0x7f42940b2b80 legacy=0x7f429409a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f4298f7c640 1 --2- 172.21.15.104:0/3547771686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42800039b0 0x7f4280003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f4298f7c640 1 --2- 172.21.15.104:0/3547771686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f429415d490 0x7f4280004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f4298f7c640 1 --2- 172.21.15.104:0/3547771686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4280004d40 0x7f42800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42940cc8a0 con 0x7f4280004d40 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428000b9c0 con 0x7f42800039b0 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428000bbc0 con 0x7f429415d490 2024-05-08T04:22:59.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f429a77f640 1 --2- 172.21.15.104:0/3547771686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4280004d40 0x7f42800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f4299f7e640 1 --2- 172.21.15.104:0/3547771686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42800039b0 0x7f4280003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f429977d640 1 --2- 172.21.15.104:0/3547771686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f429415d490 0x7f4280004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f429a77f640 1 -- 172.21.15.104:0/3547771686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f429415d490 msgr2=0x7f4280004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f429a77f640 1 --2- 172.21.15.104:0/3547771686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f429415d490 0x7f4280004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f429a77f640 1 -- 172.21.15.104:0/3547771686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42800039b0 msgr2=0x7f4280003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f429a77f640 1 --2- 172.21.15.104:0/3547771686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42800039b0 0x7f4280003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.132+0000 7f429a77f640 1 -- 172.21.15.104:0/3547771686 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280003520 con 0x7f4280004d40 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.133+0000 7f429a77f640 1 --2- 172.21.15.104:0/3547771686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4280004d40 0x7f42800051c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f428c0073e0 tx=0x7f4280005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a599e9d7a295fd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.133+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c009c80 con 0x7f4280004d40 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.133+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c02e660 con 0x7f4280004d40 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.133+0000 7f4298f7c640 1 -- 172.21.15.104:0/3547771686 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c02ea10 con 0x7f4280004d40 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.133+0000 7f429c1e2640 1 -- 172.21.15.104:0/3547771686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4280004d40 msgr2=0x7f42800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.133+0000 7f429c1e2640 1 --2- 172.21.15.104:0/3547771686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4280004d40 0x7f42800051c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f428c0073e0 tx=0x7f4280005830 comp rx=0 tx=0).stop 2024-05-08T04:22:59.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.133+0000 7f429a77f640 1 -- 172.21.15.104:0/3547771686 reap_dead start 2024-05-08T04:22:59.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.133+0000 7f429c1e2640 1 -- 172.21.15.104:0/3547771686 shutdown_connections 2024-05-08T04:22:59.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.133+0000 7f429c1e2640 1 -- 172.21.15.104:0/3547771686 >> 172.21.15.104:0/3547771686 conn(0x7f42940b3310 msgr2=0x7f42940b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:59.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.134+0000 7f429c1e2640 1 -- 172.21.15.104:0/3547771686 shutdown_connections 2024-05-08T04:22:59.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.134+0000 7f429c1e2640 1 -- 172.21.15.104:0/3547771686 wait complete. 2024-05-08T04:22:59.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.135+0000 7f429c1e2640 1 Processor -- start 2024-05-08T04:22:59.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.135+0000 7f429c1e2640 1 -- start start 2024-05-08T04:22:59.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.135+0000 7f429c1e2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4280004d40 0x7f429414ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.135+0000 7f429c1e2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940c53c0 0x7f42940c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.135+0000 7f429c1e2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42940c73a0 0x7f42940c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.135+0000 7f429c1e2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42940cf830 con 0x7f4280004d40 2024-05-08T04:22:59.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.135+0000 7f429c1e2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42940cd140 con 0x7f42940c73a0 2024-05-08T04:22:59.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.135+0000 7f429c1e2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42940cc550 con 0x7f42940c53c0 2024-05-08T04:22:59.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f4299f7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4280004d40 0x7f429414ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f4299f7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4280004d40 0x7f429414ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44376/0 (socket says 172.21.15.104:44376) 2024-05-08T04:22:59.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f4299f7e640 1 -- 172.21.15.104:0/1208577404 learned_addr learned my addr 172.21.15.104:0/1208577404 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:59.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f429977d640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940c53c0 0x7f42940c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f429a77f640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42940c73a0 0x7f42940c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f4299f7e640 1 -- 172.21.15.104:0/1208577404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940c53c0 msgr2=0x7f42940c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f4299f7e640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940c53c0 0x7f42940c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f4299f7e640 1 -- 172.21.15.104:0/1208577404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42940c73a0 msgr2=0x7f42940c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f4299f7e640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42940c73a0 0x7f42940c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f4299f7e640 1 -- 172.21.15.104:0/1208577404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42940c6bc0 con 0x7f4280004d40 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f429977d640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940c53c0 0x7f42940c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f4299f7e640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4280004d40 0x7f429414ef40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f42900073c0 tx=0x7f4290007880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f42867fc640 1 -- 172.21.15.104:0/1208577404 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429001a070 con 0x7f4280004d40 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f42867fc640 1 -- 172.21.15.104:0/1208577404 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429000f9c0 con 0x7f4280004d40 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f429c1e2640 1 -- 172.21.15.104:0/1208577404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42940c8b00 con 0x7f4280004d40 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f42867fc640 1 -- 172.21.15.104:0/1208577404 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429000fd90 con 0x7f4280004d40 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.136+0000 7f429c1e2640 1 -- 172.21.15.104:0/1208577404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42940c6760 con 0x7f4280004d40 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.137+0000 7f429c1e2640 1 -- 172.21.15.104:0/1208577404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4294075010 con 0x7f4280004d40 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.138+0000 7f42867fc640 1 -- 172.21.15.104:0/1208577404 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f429001d070 con 0x7f4280004d40 2024-05-08T04:22:59.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.138+0000 7f42867fc640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f427806b6b0 0x7f427806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.138+0000 7f42867fc640 1 -- 172.21.15.104:0/1208577404 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f4290089f90 con 0x7f4280004d40 2024-05-08T04:22:59.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.138+0000 7f429977d640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f427806b6b0 0x7f427806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.138+0000 7f429977d640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f427806b6b0 0x7f427806db70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f42940c57e0 tx=0x7f4288008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:59.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.142+0000 7f42867fc640 1 -- 172.21.15.104:0/1208577404 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4290058b90 con 0x7f4280004d40 2024-05-08T04:22:59.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.310+0000 7f429c1e2640 1 -- 172.21.15.104:0/1208577404 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f429409ab20 con 0x7f4280004d40 2024-05-08T04:22:59.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.310+0000 7f42867fc640 1 -- 172.21.15.104:0/1208577404 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4290058490 con 0x7f4280004d40 2024-05-08T04:22:59.311 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:22:59.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.312+0000 7f429c1e2640 1 -- 172.21.15.104:0/1208577404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f427806b6b0 msgr2=0x7f427806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.312+0000 7f429c1e2640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f427806b6b0 0x7f427806db70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f42940c57e0 tx=0x7f4288008040 comp rx=0 tx=0).stop 2024-05-08T04:22:59.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.312+0000 7f429c1e2640 1 -- 172.21.15.104:0/1208577404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4280004d40 msgr2=0x7f429414ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.312+0000 7f429c1e2640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4280004d40 0x7f429414ef40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f42900073c0 tx=0x7f4290007880 comp rx=0 tx=0).stop 2024-05-08T04:22:59.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.312+0000 7f429c1e2640 1 -- 172.21.15.104:0/1208577404 shutdown_connections 2024-05-08T04:22:59.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.312+0000 7f429c1e2640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f427806b6b0 0x7f427806db70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.312+0000 7f429c1e2640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42940c73a0 0x7f42940c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.312+0000 7f429c1e2640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940c53c0 0x7f42940c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.312+0000 7f429c1e2640 1 --2- 172.21.15.104:0/1208577404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4280004d40 0x7f429414ef40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.312+0000 7f429c1e2640 1 -- 172.21.15.104:0/1208577404 >> 172.21.15.104:0/1208577404 conn(0x7f42940b3310 msgr2=0x7f429406fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:59.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.312+0000 7f429c1e2640 1 -- 172.21.15.104:0/1208577404 shutdown_connections 2024-05-08T04:22:59.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.312+0000 7f429c1e2640 1 -- 172.21.15.104:0/1208577404 wait complete. 2024-05-08T04:22:59.324 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:22:59.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.424+0000 7fad37d1d640 1 Processor -- start 2024-05-08T04:22:59.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.424+0000 7fad37d1d640 1 -- start start 2024-05-08T04:22:59.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad37d1d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fad30070c70 0x7fad30071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad37d1d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad3015edf0 0x7fad300b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad37d1d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fad30157ac0 0x7fad30157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad37d1d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3006bc70 con 0x7fad30157ac0 2024-05-08T04:22:59.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad37d1d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad30071590 con 0x7fad30070c70 2024-05-08T04:22:59.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad37d1d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad300d15c0 con 0x7fad3015edf0 2024-05-08T04:22:59.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad362ba640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fad30157ac0 0x7fad30157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad362ba640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fad30157ac0 0x7fad30157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44386/0 (socket says 172.21.15.104:44386) 2024-05-08T04:22:59.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad362ba640 1 -- 172.21.15.104:0/2885909027 learned_addr learned my addr 172.21.15.104:0/2885909027 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:59.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad352b8640 1 --2- 172.21.15.104:0/2885909027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad3015edf0 0x7fad300b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad35ab9640 1 --2- 172.21.15.104:0/2885909027 >> v2:172.21.15.183:3300/0 conn(0x7fad30070c70 0x7fad30071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad362ba640 1 -- 172.21.15.104:0/2885909027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad3015edf0 msgr2=0x7fad300b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:59.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad362ba640 1 --2- 172.21.15.104:0/2885909027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad3015edf0 0x7fad300b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad362ba640 1 -- 172.21.15.104:0/2885909027 >> v2:172.21.15.183:3300/0 conn(0x7fad30070c70 msgr2=0x7fad30071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:59.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad362ba640 1 --2- 172.21.15.104:0/2885909027 >> v2:172.21.15.183:3300/0 conn(0x7fad30070c70 0x7fad30071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad362ba640 1 -- 172.21.15.104:0/2885909027 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3015f550 con 0x7fad30157ac0 2024-05-08T04:22:59.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad35ab9640 1 --2- 172.21.15.104:0/2885909027 >> v2:172.21.15.183:3300/0 conn(0x7fad30070c70 0x7fad30071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:59.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.425+0000 7fad352b8640 1 --2- 172.21.15.104:0/2885909027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad3015edf0 0x7fad300b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:22:59.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.426+0000 7fad362ba640 1 --2- 172.21.15.104:0/2885909027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad30157ac0 0x7fad30157f50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fad30071f80 tx=0x7fad2802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337ad8173e173566 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:59.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.426+0000 7fad34ab7640 1 -- 172.21.15.104:0/2885909027 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad28036070 con 0x7fad30157ac0 2024-05-08T04:22:59.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.426+0000 7fad34ab7640 1 -- 172.21.15.104:0/2885909027 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad28031600 con 0x7fad30157ac0 2024-05-08T04:22:59.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.426+0000 7fad34ab7640 1 -- 172.21.15.104:0/2885909027 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad280319d0 con 0x7fad30157ac0 2024-05-08T04:22:59.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.427+0000 7fad37d1d640 1 -- 172.21.15.104:0/2885909027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad30157ac0 msgr2=0x7fad30157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.427+0000 7fad37d1d640 1 --2- 172.21.15.104:0/2885909027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad30157ac0 0x7fad30157f50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fad30071f80 tx=0x7fad2802a6a0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.427+0000 7fad37d1d640 1 -- 172.21.15.104:0/2885909027 shutdown_connections 2024-05-08T04:22:59.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.427+0000 7fad37d1d640 1 --2- 172.21.15.104:0/2885909027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad30157ac0 0x7fad30157f50 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.427+0000 7fad37d1d640 1 --2- 172.21.15.104:0/2885909027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad3015edf0 0x7fad300b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.427+0000 7fad37d1d640 1 --2- 172.21.15.104:0/2885909027 >> v2:172.21.15.183:3300/0 conn(0x7fad30070c70 0x7fad30071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.427+0000 7fad37d1d640 1 -- 172.21.15.104:0/2885909027 >> 172.21.15.104:0/2885909027 conn(0x7fad300b3450 msgr2=0x7fad300b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.427+0000 7fad37d1d640 1 -- 172.21.15.104:0/2885909027 shutdown_connections 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.427+0000 7fad37d1d640 1 -- 172.21.15.104:0/2885909027 wait complete. 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.428+0000 7fad37d1d640 1 Processor -- start 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.428+0000 7fad37d1d640 1 -- start start 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad37d1d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad30070c70 0x7fad30156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad37d1d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad30157ac0 0x7fad30159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad37d1d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad3015edf0 0x7fad301f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad37d1d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad300b5b80 con 0x7fad30157ac0 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad37d1d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3015fb10 con 0x7fad30070c70 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad37d1d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad300b57e0 con 0x7fad3015edf0 2024-05-08T04:22:59.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad352b8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad30157ac0 0x7fad30159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad352b8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad30157ac0 0x7fad30159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44396/0 (socket says 172.21.15.104:44396) 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad352b8640 1 -- 172.21.15.104:0/1799183302 learned_addr learned my addr 172.21.15.104:0/1799183302 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad352b8640 1 -- 172.21.15.104:0/1799183302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad3015edf0 msgr2=0x7fad301f7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad362ba640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad3015edf0 0x7fad301f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad35ab9640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad30070c70 0x7fad30156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad352b8640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad3015edf0 0x7fad301f7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad352b8640 1 -- 172.21.15.104:0/1799183302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad30070c70 msgr2=0x7fad30156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad352b8640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad30070c70 0x7fad30156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad352b8640 1 -- 172.21.15.104:0/1799183302 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad301f8ae0 con 0x7fad30157ac0 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad352b8640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad30157ac0 0x7fad30159120 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fad2000c7f0 tx=0x7fad2000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad267fc640 1 -- 172.21.15.104:0/1799183302 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20015070 con 0x7fad30157ac0 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.429+0000 7fad267fc640 1 -- 172.21.15.104:0/1799183302 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad20007820 con 0x7fad30157ac0 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.430+0000 7fad37d1d640 1 -- 172.21.15.104:0/1799183302 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad300cac70 con 0x7fad30157ac0 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.430+0000 7fad267fc640 1 -- 172.21.15.104:0/1799183302 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad20007bf0 con 0x7fad30157ac0 2024-05-08T04:22:59.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.430+0000 7fad37d1d640 1 -- 172.21.15.104:0/1799183302 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad301569d0 con 0x7fad30157ac0 2024-05-08T04:22:59.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.430+0000 7fad37d1d640 1 -- 172.21.15.104:0/1799183302 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad30075010 con 0x7fad30157ac0 2024-05-08T04:22:59.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.431+0000 7fad267fc640 1 -- 172.21.15.104:0/1799183302 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fad20018070 con 0x7fad30157ac0 2024-05-08T04:22:59.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.431+0000 7fad267fc640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fad1406b680 0x7fad1406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.432+0000 7fad35ab9640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fad1406b680 0x7fad1406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.432+0000 7fad267fc640 1 -- 172.21.15.104:0/1799183302 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fad2008a520 con 0x7fad30157ac0 2024-05-08T04:22:59.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.432+0000 7fad35ab9640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fad1406b680 0x7fad1406db40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fad2c006fd0 tx=0x7fad2c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:59.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.435+0000 7fad267fc640 1 -- 172.21.15.104:0/1799183302 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fad20059010 con 0x7fad30157ac0 2024-05-08T04:22:59.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.604+0000 7fad37d1d640 1 -- 172.21.15.104:0/1799183302 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad300ce260 con 0x7fad30157ac0 2024-05-08T04:22:59.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.604+0000 7fad267fc640 1 -- 172.21.15.104:0/1799183302 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad20058910 con 0x7fad30157ac0 2024-05-08T04:22:59.606 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:22:59.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.606+0000 7fad37d1d640 1 -- 172.21.15.104:0/1799183302 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fad1406b680 msgr2=0x7fad1406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.606+0000 7fad37d1d640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fad1406b680 0x7fad1406db40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fad2c006fd0 tx=0x7fad2c008040 comp rx=0 tx=0).stop 2024-05-08T04:22:59.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.606+0000 7fad37d1d640 1 -- 172.21.15.104:0/1799183302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad30157ac0 msgr2=0x7fad30159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.606+0000 7fad37d1d640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad30157ac0 0x7fad30159120 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fad2000c7f0 tx=0x7fad2000ccb0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.606+0000 7fad37d1d640 1 -- 172.21.15.104:0/1799183302 shutdown_connections 2024-05-08T04:22:59.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.606+0000 7fad37d1d640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fad1406b680 0x7fad1406db40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.606+0000 7fad37d1d640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad3015edf0 0x7fad301f7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.606+0000 7fad37d1d640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad30157ac0 0x7fad30159120 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.606+0000 7fad37d1d640 1 --2- 172.21.15.104:0/1799183302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad30070c70 0x7fad30156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.606+0000 7fad37d1d640 1 -- 172.21.15.104:0/1799183302 >> 172.21.15.104:0/1799183302 conn(0x7fad300b3450 msgr2=0x7fad3006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:59.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.606+0000 7fad37d1d640 1 -- 172.21.15.104:0/1799183302 shutdown_connections 2024-05-08T04:22:59.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.606+0000 7fad37d1d640 1 -- 172.21.15.104:0/1799183302 wait complete. 2024-05-08T04:22:59.618 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:22:59.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.720+0000 7f0f42177640 1 Processor -- start 2024-05-08T04:22:59.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.720+0000 7f0f42177640 1 -- start start 2024-05-08T04:22:59.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.721+0000 7f0f42177640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0f3c0cc930 0x7f0f3c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.721+0000 7f0f42177640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0f3c06e860 0x7f0f3c15fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.721+0000 7f0f42177640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c071fb0 con 0x7f0f3c0711c0 2024-05-08T04:22:59.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.721+0000 7f0f42177640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c0cd250 con 0x7f0f3c06e860 2024-05-08T04:22:59.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.721+0000 7f0f42177640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c071710 con 0x7f0f3c0cc930 2024-05-08T04:22:59.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.721+0000 7f0f3bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0f3c06e860 0x7f0f3c15fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.721+0000 7f0f3bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0f3c06e860 0x7f0f3c15fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44408/0 (socket says 172.21.15.104:44408) 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.721+0000 7f0f3bfff640 1 -- 172.21.15.104:0/1222571105 learned_addr learned my addr 172.21.15.104:0/1222571105 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.721+0000 7f0f3b7fe640 1 --2- 172.21.15.104:0/1222571105 >> v2:172.21.15.183:3300/0 conn(0x7f0f3c0cc930 0x7f0f3c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.721+0000 7f0f3bfff640 1 -- 172.21.15.104:0/1222571105 >> v2:172.21.15.183:3300/0 conn(0x7f0f3c0cc930 msgr2=0x7f0f3c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.721+0000 7f0f3bfff640 1 --2- 172.21.15.104:0/1222571105 >> v2:172.21.15.183:3300/0 conn(0x7f0f3c0cc930 0x7f0f3c0ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.721+0000 7f0f3bfff640 1 -- 172.21.15.104:0/1222571105 >> v1:172.21.15.183:6789/0 conn(0x7f0f3c0711c0 legacy=0x7f0f3c15f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.721+0000 7f0f3bfff640 1 -- 172.21.15.104:0/1222571105 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c0719f0 con 0x7f0f3c06e860 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.722+0000 7f0f3bfff640 1 --2- 172.21.15.104:0/1222571105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c06e860 0x7f0f3c15fcb0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0685c0 tx=0x7f0f3402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfd1697adbabd8a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.722+0000 7f0f3a7fc640 1 -- 172.21.15.104:0/1222571105 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34036070 con 0x7f0f3c06e860 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.722+0000 7f0f3a7fc640 1 -- 172.21.15.104:0/1222571105 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f34031600 con 0x7f0f3c06e860 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.722+0000 7f0f3a7fc640 1 -- 172.21.15.104:0/1222571105 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f340319d0 con 0x7f0f3c06e860 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.723+0000 7f0f42177640 1 -- 172.21.15.104:0/1222571105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c06e860 msgr2=0x7f0f3c15fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.723+0000 7f0f42177640 1 --2- 172.21.15.104:0/1222571105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c06e860 0x7f0f3c15fcb0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0685c0 tx=0x7f0f3402a660 comp rx=0 tx=0).stop 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.723+0000 7f0f42177640 1 -- 172.21.15.104:0/1222571105 shutdown_connections 2024-05-08T04:22:59.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.723+0000 7f0f42177640 1 --2- 172.21.15.104:0/1222571105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c06e860 0x7f0f3c15fcb0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.723+0000 7f0f42177640 1 --2- 172.21.15.104:0/1222571105 >> v2:172.21.15.183:3300/0 conn(0x7f0f3c0cc930 0x7f0f3c0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.723+0000 7f0f42177640 1 -- 172.21.15.104:0/1222571105 >> 172.21.15.104:0/1222571105 conn(0x7f0f3c0b13f0 msgr2=0x7f0f3c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:59.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.723+0000 7f0f42177640 1 -- 172.21.15.104:0/1222571105 shutdown_connections 2024-05-08T04:22:59.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.723+0000 7f0f42177640 1 -- 172.21.15.104:0/1222571105 wait complete. 2024-05-08T04:22:59.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.724+0000 7f0f42177640 1 Processor -- start 2024-05-08T04:22:59.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.724+0000 7f0f42177640 1 -- start start 2024-05-08T04:22:59.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f42177640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f3c06e860 0x7f0f3c15d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f42177640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c0711c0 0x7f0f3c1f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f42177640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f3c0cc930 0x7f0f3c0ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f42177640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0cf3b0 con 0x7f0f3c0711c0 2024-05-08T04:22:59.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f42177640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c06d330 con 0x7f0f3c0cc930 2024-05-08T04:22:59.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f42177640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c1453f0 con 0x7f0f3c06e860 2024-05-08T04:22:59.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f3affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c0711c0 0x7f0f3c1f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f3affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c0711c0 0x7f0f3c1f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44420/0 (socket says 172.21.15.104:44420) 2024-05-08T04:22:59.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f3affd640 1 -- 172.21.15.104:0/2981145940 learned_addr learned my addr 172.21.15.104:0/2981145940 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:22:59.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f3b7fe640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f3c06e860 0x7f0f3c15d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f3bfff640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f3c0cc930 0x7f0f3c0ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f3affd640 1 -- 172.21.15.104:0/2981145940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f3c06e860 msgr2=0x7f0f3c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f3affd640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f3c06e860 0x7f0f3c15d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f3affd640 1 -- 172.21.15.104:0/2981145940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f3c0cc930 msgr2=0x7f0f3c0ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f3affd640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f3c0cc930 0x7f0f3c0ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f3affd640 1 -- 172.21.15.104:0/2981145940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c0aa240 con 0x7f0f3c0711c0 2024-05-08T04:22:59.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.725+0000 7f0f3affd640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c0711c0 0x7f0f3c1f21e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000c430 tx=0x7f0f3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:59.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.726+0000 7f0f23fff640 1 -- 172.21.15.104:0/2981145940 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30011790 con 0x7f0f3c0711c0 2024-05-08T04:22:59.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.726+0000 7f0f23fff640 1 -- 172.21.15.104:0/2981145940 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f30017070 con 0x7f0f3c0711c0 2024-05-08T04:22:59.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.726+0000 7f0f42177640 1 -- 172.21.15.104:0/2981145940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c0aa520 con 0x7f0f3c0711c0 2024-05-08T04:22:59.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.726+0000 7f0f23fff640 1 -- 172.21.15.104:0/2981145940 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30011bb0 con 0x7f0f3c0711c0 2024-05-08T04:22:59.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.726+0000 7f0f42177640 1 -- 172.21.15.104:0/2981145940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c0aaae0 con 0x7f0f3c0711c0 2024-05-08T04:22:59.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.727+0000 7f0f42177640 1 -- 172.21.15.104:0/2981145940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c075010 con 0x7f0f3c0711c0 2024-05-08T04:22:59.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.727+0000 7f0f23fff640 1 -- 172.21.15.104:0/2981145940 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f0f3001c460 con 0x7f0f3c0711c0 2024-05-08T04:22:59.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.728+0000 7f0f23fff640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0f2806b680 0x7f0f2806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:22:59.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.728+0000 7f0f23fff640 1 -- 172.21.15.104:0/2981145940 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0f3008a360 con 0x7f0f3c0711c0 2024-05-08T04:22:59.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.728+0000 7f0f3b7fe640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0f2806b680 0x7f0f2806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:22:59.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.728+0000 7f0f3b7fe640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0f2806b680 0x7f0f2806db40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00aac0 tx=0x7f0f2c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:22:59.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.732+0000 7f0f23fff640 1 -- 172.21.15.104:0/2981145940 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0f30058800 con 0x7f0f3c0711c0 2024-05-08T04:22:59.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.903+0000 7f0f42177640 1 -- 172.21.15.104:0/2981145940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f3c0cd880 con 0x7f0f3c0711c0 2024-05-08T04:22:59.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.903+0000 7f0f23fff640 1 -- 172.21.15.104:0/2981145940 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f3005c8a0 con 0x7f0f3c0711c0 2024-05-08T04:22:59.905 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:22:59.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.905+0000 7f0f42177640 1 -- 172.21.15.104:0/2981145940 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0f2806b680 msgr2=0x7f0f2806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.905+0000 7f0f42177640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0f2806b680 0x7f0f2806db40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00aac0 tx=0x7f0f2c008040 comp rx=0 tx=0).stop 2024-05-08T04:22:59.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.905+0000 7f0f42177640 1 -- 172.21.15.104:0/2981145940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c0711c0 msgr2=0x7f0f3c1f21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:22:59.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.905+0000 7f0f42177640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c0711c0 0x7f0f3c1f21e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000c430 tx=0x7f0f3000c8f0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.905+0000 7f0f42177640 1 -- 172.21.15.104:0/2981145940 shutdown_connections 2024-05-08T04:22:59.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.905+0000 7f0f42177640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0f2806b680 0x7f0f2806db40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.905+0000 7f0f42177640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f3c0cc930 0x7f0f3c0ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.905+0000 7f0f42177640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f3c0711c0 0x7f0f3c1f21e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.905+0000 7f0f42177640 1 --2- 172.21.15.104:0/2981145940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f3c06e860 0x7f0f3c15d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:22:59.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.905+0000 7f0f42177640 1 -- 172.21.15.104:0/2981145940 >> 172.21.15.104:0/2981145940 conn(0x7f0f3c0b13f0 msgr2=0x7f0f3c0a84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:22:59.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.906+0000 7f0f42177640 1 -- 172.21.15.104:0/2981145940 shutdown_connections 2024-05-08T04:22:59.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:22:59.906+0000 7f0f42177640 1 -- 172.21.15.104:0/2981145940 wait complete. 2024-05-08T04:22:59.918 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:23:00.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.019+0000 7fc2a181f640 1 Processor -- start 2024-05-08T04:23:00.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.019+0000 7fc2a181f640 1 -- start start 2024-05-08T04:23:00.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.020+0000 7fc2a181f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc29c159ec0 0x7fc29c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.020+0000 7fc2a181f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc29c072160 0x7fc29c15b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.020+0000 7fc2a181f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c15dce0 con 0x7fc29c15a2a0 2024-05-08T04:23:00.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.020+0000 7fc2a181f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c06eb60 con 0x7fc29c159ec0 2024-05-08T04:23:00.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.020+0000 7fc2a181f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c06ee40 con 0x7fc29c072160 2024-05-08T04:23:00.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.020+0000 7fc29a7fc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc29c15a2a0 0x7fc29c071a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39088/0 (socket says 172.21.15.104:39088) 2024-05-08T04:23:00.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.020+0000 7fc29a7fc640 1 -- 172.21.15.104:0/1406491367 learned_addr learned my addr 172.21.15.104:0/1406491367 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:00.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.020+0000 7fc29affd640 1 --2- 172.21.15.104:0/1406491367 >> v2:172.21.15.183:3300/0 conn(0x7fc29c159ec0 0x7fc29c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.020+0000 7fc29b7fe640 1 --2- 172.21.15.104:0/1406491367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc29c072160 0x7fc29c15b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.020+0000 7fc299ffb640 1 -- 172.21.15.104:0/1406491367 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104115953 0 0) 0x7fc29c15dce0 con 0x7fc29c15a2a0 2024-05-08T04:23:00.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.020+0000 7fc299ffb640 1 -- 172.21.15.104:0/1406491367 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc284003520 con 0x7fc29c15a2a0 2024-05-08T04:23:00.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.021+0000 7fc29affd640 1 -- 172.21.15.104:0/1406491367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc29c072160 msgr2=0x7fc29c15b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:00.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.021+0000 7fc29affd640 1 --2- 172.21.15.104:0/1406491367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc29c072160 0x7fc29c15b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.021+0000 7fc29affd640 1 -- 172.21.15.104:0/1406491367 >> v1:172.21.15.104:6789/0 conn(0x7fc29c15a2a0 legacy=0x7fc29c071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.021+0000 7fc29affd640 1 -- 172.21.15.104:0/1406491367 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c15df80 con 0x7fc29c159ec0 2024-05-08T04:23:00.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.021+0000 7fc29affd640 1 --2- 172.21.15.104:0/1406491367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc29c159ec0 0x7fc29c06e4d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009d90 tx=0x7fc28c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a88a96a1a326e941 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:00.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.022+0000 7fc299ffb640 1 -- 172.21.15.104:0/1406491367 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c007740 con 0x7fc29c159ec0 2024-05-08T04:23:00.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.022+0000 7fc299ffb640 1 -- 172.21.15.104:0/1406491367 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c0078e0 con 0x7fc29c159ec0 2024-05-08T04:23:00.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.022+0000 7fc299ffb640 1 -- 172.21.15.104:0/1406491367 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c007cb0 con 0x7fc29c159ec0 2024-05-08T04:23:00.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.022+0000 7fc2a181f640 1 -- 172.21.15.104:0/1406491367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc29c159ec0 msgr2=0x7fc29c06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.022+0000 7fc2a181f640 1 --2- 172.21.15.104:0/1406491367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc29c159ec0 0x7fc29c06e4d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009d90 tx=0x7fc28c02a660 comp rx=0 tx=0).stop 2024-05-08T04:23:00.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.022+0000 7fc2a181f640 1 -- 172.21.15.104:0/1406491367 shutdown_connections 2024-05-08T04:23:00.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.022+0000 7fc2a181f640 1 --2- 172.21.15.104:0/1406491367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc29c072160 0x7fc29c15b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.022+0000 7fc2a181f640 1 --2- 172.21.15.104:0/1406491367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc29c159ec0 0x7fc29c06e4d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.022+0000 7fc2a181f640 1 -- 172.21.15.104:0/1406491367 >> 172.21.15.104:0/1406491367 conn(0x7fc29c0b13f0 msgr2=0x7fc29c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:00.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.022+0000 7fc2a181f640 1 -- 172.21.15.104:0/1406491367 shutdown_connections 2024-05-08T04:23:00.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.022+0000 7fc2a181f640 1 -- 172.21.15.104:0/1406491367 wait complete. 2024-05-08T04:23:00.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.023+0000 7fc2a181f640 1 Processor -- start 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.024+0000 7fc2a181f640 1 -- start start 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.024+0000 7fc2a181f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc29c072160 0x7fc29c144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.024+0000 7fc2a181f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc29c159ec0 0x7fc29c0cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.024+0000 7fc2a181f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc29c15a2a0 0x7fc29c0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.024+0000 7fc2a181f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c15e900 con 0x7fc29c159ec0 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.024+0000 7fc2a181f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c15e780 con 0x7fc29c072160 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.024+0000 7fc2a181f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c15ea80 con 0x7fc29c15a2a0 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.024+0000 7fc29a7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc29c159ec0 0x7fc29c0cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.024+0000 7fc29a7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc29c159ec0 0x7fc29c0cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44426/0 (socket says 172.21.15.104:44426) 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.024+0000 7fc29a7fc640 1 -- 172.21.15.104:0/2705296306 learned_addr learned my addr 172.21.15.104:0/2705296306 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc29affd640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc29c072160 0x7fc29c144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc29b7fe640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc29c15a2a0 0x7fc29c0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc29a7fc640 1 -- 172.21.15.104:0/2705296306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc29c15a2a0 msgr2=0x7fc29c0ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc29a7fc640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc29c15a2a0 0x7fc29c0ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc29a7fc640 1 -- 172.21.15.104:0/2705296306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc29c072160 msgr2=0x7fc29c144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc29a7fc640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc29c072160 0x7fc29c144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc29a7fc640 1 -- 172.21.15.104:0/2705296306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0cd000 con 0x7fc29c159ec0 2024-05-08T04:23:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc29b7fe640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc29c15a2a0 0x7fc29c0ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc29a7fc640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc29c159ec0 0x7fc29c0cf7f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc29000c400 tx=0x7fc29000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc283fff640 1 -- 172.21.15.104:0/2705296306 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290017070 con 0x7fc29c159ec0 2024-05-08T04:23:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc283fff640 1 -- 172.21.15.104:0/2705296306 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc290005ce0 con 0x7fc29c159ec0 2024-05-08T04:23:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc2a181f640 1 -- 172.21.15.104:0/2705296306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c0cd2e0 con 0x7fc29c159ec0 2024-05-08T04:23:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc283fff640 1 -- 172.21.15.104:0/2705296306 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2900072d0 con 0x7fc29c159ec0 2024-05-08T04:23:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.025+0000 7fc2a181f640 1 -- 172.21.15.104:0/2705296306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c0cd8a0 con 0x7fc29c159ec0 2024-05-08T04:23:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.026+0000 7fc2a181f640 1 -- 172.21.15.104:0/2705296306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c075010 con 0x7fc29c159ec0 2024-05-08T04:23:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.026+0000 7fc283fff640 1 -- 172.21.15.104:0/2705296306 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fc29001a070 con 0x7fc29c159ec0 2024-05-08T04:23:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.027+0000 7fc283fff640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc28806b680 0x7fc28806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.027+0000 7fc283fff640 1 -- 172.21.15.104:0/2705296306 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fc290089860 con 0x7fc29c159ec0 2024-05-08T04:23:00.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.027+0000 7fc29affd640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc28806b680 0x7fc28806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.027+0000 7fc29affd640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc28806b680 0x7fc28806db40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc28c034000 tx=0x7fc28c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:00.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.031+0000 7fc283fff640 1 -- 172.21.15.104:0/2705296306 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc290057d80 con 0x7fc29c159ec0 2024-05-08T04:23:00.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.212+0000 7fc2a181f640 1 -- 172.21.15.104:0/2705296306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc29c0af680 con 0x7fc29c159ec0 2024-05-08T04:23:00.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.212+0000 7fc283fff640 1 -- 172.21.15.104:0/2705296306 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc29005be20 con 0x7fc29c159ec0 2024-05-08T04:23:00.213 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:23:00.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.214+0000 7fc2a181f640 1 -- 172.21.15.104:0/2705296306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc28806b680 msgr2=0x7fc28806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.214+0000 7fc2a181f640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc28806b680 0x7fc28806db40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc28c034000 tx=0x7fc28c02f000 comp rx=0 tx=0).stop 2024-05-08T04:23:00.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.214+0000 7fc2a181f640 1 -- 172.21.15.104:0/2705296306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc29c159ec0 msgr2=0x7fc29c0cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.214+0000 7fc2a181f640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc29c159ec0 0x7fc29c0cf7f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc29000c400 tx=0x7fc29000c8c0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.214+0000 7fc2a181f640 1 -- 172.21.15.104:0/2705296306 shutdown_connections 2024-05-08T04:23:00.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.214+0000 7fc2a181f640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc28806b680 0x7fc28806db40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.214+0000 7fc2a181f640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc29c15a2a0 0x7fc29c0ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.214+0000 7fc2a181f640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc29c159ec0 0x7fc29c0cf7f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.214+0000 7fc2a181f640 1 --2- 172.21.15.104:0/2705296306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc29c072160 0x7fc29c144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.214+0000 7fc2a181f640 1 -- 172.21.15.104:0/2705296306 >> 172.21.15.104:0/2705296306 conn(0x7fc29c0b13f0 msgr2=0x7fc29c0b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:00.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.214+0000 7fc2a181f640 1 -- 172.21.15.104:0/2705296306 shutdown_connections 2024-05-08T04:23:00.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.214+0000 7fc2a181f640 1 -- 172.21.15.104:0/2705296306 wait complete. 2024-05-08T04:23:00.226 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:23:00.226 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:23:00.242 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:23:00.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.380+0000 7f1cc8aac640 1 Processor -- start 2024-05-08T04:23:00.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.380+0000 7f1cc8aac640 1 -- start start 2024-05-08T04:23:00.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.381+0000 7f1cc8aac640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1cc415de10 0x7f1cc4161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.381+0000 7f1cc8aac640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cc40d07c0 0x7f1cc40d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.381+0000 7f1cc8aac640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc415e1f0 con 0x7f1cc40ce5a0 2024-05-08T04:23:00.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.381+0000 7f1cc8aac640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc40d0f50 con 0x7f1cc415de10 2024-05-08T04:23:00.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.381+0000 7f1cc8aac640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc4161e60 con 0x7f1cc40d07c0 2024-05-08T04:23:00.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.381+0000 7f1cc259c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1cc415de10 0x7f1cc4161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.381+0000 7f1cc259c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1cc415de10 0x7f1cc4161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44432/0 (socket says 172.21.15.104:44432) 2024-05-08T04:23:00.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.381+0000 7f1cc259c640 1 -- 172.21.15.104:0/2825055763 learned_addr learned my addr 172.21.15.104:0/2825055763 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:00.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.381+0000 7f1cc259c640 1 -- 172.21.15.104:0/2825055763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cc40d07c0 msgr2=0x7f1cc40d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:00.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.381+0000 7f1cc259c640 1 --2- 172.21.15.104:0/2825055763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cc40d07c0 0x7f1cc40d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.381+0000 7f1cc259c640 1 -- 172.21.15.104:0/2825055763 >> v1:172.21.15.183:6789/0 conn(0x7f1cc40ce5a0 legacy=0x7f1cc40d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:00.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.381+0000 7f1cc259c640 1 -- 172.21.15.104:0/2825055763 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc4162090 con 0x7f1cc415de10 2024-05-08T04:23:00.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.382+0000 7f1cc259c640 1 --2- 172.21.15.104:0/2825055763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc415de10 0x7f1cc4161920 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009870 tx=0x7f1cb402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6174189297ccc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:00.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.382+0000 7f1cc1d9b640 1 -- 172.21.15.104:0/2825055763 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4037070 con 0x7f1cc415de10 2024-05-08T04:23:00.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.382+0000 7f1cc1d9b640 1 -- 172.21.15.104:0/2825055763 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb4032440 con 0x7f1cc415de10 2024-05-08T04:23:00.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.382+0000 7f1cc1d9b640 1 -- 172.21.15.104:0/2825055763 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4032810 con 0x7f1cc415de10 2024-05-08T04:23:00.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.383+0000 7f1cc8aac640 1 -- 172.21.15.104:0/2825055763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc415de10 msgr2=0x7f1cc4161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.383+0000 7f1cc8aac640 1 --2- 172.21.15.104:0/2825055763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc415de10 0x7f1cc4161920 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009870 tx=0x7f1cb402a180 comp rx=0 tx=0).stop 2024-05-08T04:23:00.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.383+0000 7f1cc8aac640 1 -- 172.21.15.104:0/2825055763 shutdown_connections 2024-05-08T04:23:00.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.383+0000 7f1cc8aac640 1 --2- 172.21.15.104:0/2825055763 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cc40d07c0 0x7f1cc40d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.383+0000 7f1cc8aac640 1 --2- 172.21.15.104:0/2825055763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc415de10 0x7f1cc4161920 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.383+0000 7f1cc8aac640 1 -- 172.21.15.104:0/2825055763 >> 172.21.15.104:0/2825055763 conn(0x7f1cc4072290 msgr2=0x7f1cc4072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:00.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.383+0000 7f1cc8aac640 1 -- 172.21.15.104:0/2825055763 shutdown_connections 2024-05-08T04:23:00.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.383+0000 7f1cc8aac640 1 -- 172.21.15.104:0/2825055763 wait complete. 2024-05-08T04:23:00.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.384+0000 7f1cc8aac640 1 Processor -- start 2024-05-08T04:23:00.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.384+0000 7f1cc8aac640 1 -- start start 2024-05-08T04:23:00.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc8aac640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cc40ce5a0 0x7f1cc415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc8aac640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cc40d07c0 0x7f1cc41f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc8aac640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc415de10 0x7f1cc4142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc8aac640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc4162650 con 0x7f1cc415de10 2024-05-08T04:23:00.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc8aac640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40d1a90 con 0x7f1cc40ce5a0 2024-05-08T04:23:00.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc8aac640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40d1ce0 con 0x7f1cc40d07c0 2024-05-08T04:23:00.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc415de10 0x7f1cc4142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc415de10 0x7f1cc4142b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44436/0 (socket says 172.21.15.104:44436) 2024-05-08T04:23:00.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc2d9d640 1 -- 172.21.15.104:0/3669817386 learned_addr learned my addr 172.21.15.104:0/3669817386 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:00.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc259c640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cc40ce5a0 0x7f1cc415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cbbfff640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cc40d07c0 0x7f1cc41f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc2d9d640 1 -- 172.21.15.104:0/3669817386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cc40d07c0 msgr2=0x7f1cc41f34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc2d9d640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cc40d07c0 0x7f1cc41f34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc2d9d640 1 -- 172.21.15.104:0/3669817386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cc40ce5a0 msgr2=0x7f1cc415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc2d9d640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cc40ce5a0 0x7f1cc415a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc2d9d640 1 -- 172.21.15.104:0/3669817386 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc40b4f80 con 0x7f1cc415de10 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc259c640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cc40ce5a0 0x7f1cc415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc2d9d640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc415de10 0x7f1cc4142b20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00b970 tx=0x7f1cbc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cbaffd640 1 -- 172.21.15.104:0/3669817386 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc019070 con 0x7f1cc415de10 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cbaffd640 1 -- 172.21.15.104:0/3669817386 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc00cb60 con 0x7f1cc415de10 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cc8aac640 1 -- 172.21.15.104:0/3669817386 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc415a7a0 con 0x7f1cc415de10 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.385+0000 7f1cbaffd640 1 -- 172.21.15.104:0/3669817386 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc014440 con 0x7f1cc415de10 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.386+0000 7f1cc8aac640 1 -- 172.21.15.104:0/3669817386 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc40b54d0 con 0x7f1cc415de10 2024-05-08T04:23:00.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.386+0000 7f1cc8aac640 1 -- 172.21.15.104:0/3669817386 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc4075010 con 0x7f1cc415de10 2024-05-08T04:23:00.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.387+0000 7f1cbaffd640 1 -- 172.21.15.104:0/3669817386 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f1cbc01c070 con 0x7f1cc415de10 2024-05-08T04:23:00.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.387+0000 7f1cbaffd640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1ca406b680 0x7f1ca406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.387+0000 7f1cbaffd640 1 -- 172.21.15.104:0/3669817386 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f1cbc08a370 con 0x7f1cc415de10 2024-05-08T04:23:00.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.387+0000 7f1cc259c640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1ca406b680 0x7f1ca406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.388+0000 7f1cc259c640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1ca406b680 0x7f1ca406db40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4034000 tx=0x7f1cb402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:00.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.391+0000 7f1cbaffd640 1 -- 172.21.15.104:0/3669817386 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1cbc058e50 con 0x7f1cc415de10 2024-05-08T04:23:00.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.564+0000 7f1cc8aac640 1 -- 172.21.15.104:0/3669817386 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cc40b5960 con 0x7f1cc415de10 2024-05-08T04:23:00.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.565+0000 7f1cbaffd640 1 -- 172.21.15.104:0/3669817386 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16961 (secure 0 0 0) 0x7f1cbc058750 con 0x7f1cc415de10 2024-05-08T04:23:00.566 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:00.566 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":47,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:52.009332+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:42.524824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:43.279621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.39","mappings":[{"from":5,"to":7}]},{"pgid":"7.3c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:23:00.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.567+0000 7f1cc8aac640 1 -- 172.21.15.104:0/3669817386 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1ca406b680 msgr2=0x7f1ca406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.567+0000 7f1cc8aac640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1ca406b680 0x7f1ca406db40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4034000 tx=0x7f1cb402e000 comp rx=0 tx=0).stop 2024-05-08T04:23:00.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.567+0000 7f1cc8aac640 1 -- 172.21.15.104:0/3669817386 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc415de10 msgr2=0x7f1cc4142b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.567+0000 7f1cc8aac640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc415de10 0x7f1cc4142b20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00b970 tx=0x7f1cbc00be30 comp rx=0 tx=0).stop 2024-05-08T04:23:00.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.567+0000 7f1cc8aac640 1 -- 172.21.15.104:0/3669817386 shutdown_connections 2024-05-08T04:23:00.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.567+0000 7f1cc8aac640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1ca406b680 0x7f1ca406db40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.567+0000 7f1cc8aac640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1cc415de10 0x7f1cc4142b20 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.567+0000 7f1cc8aac640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1cc40d07c0 0x7f1cc41f34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.567+0000 7f1cc8aac640 1 --2- 172.21.15.104:0/3669817386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1cc40ce5a0 0x7f1cc415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.567+0000 7f1cc8aac640 1 -- 172.21.15.104:0/3669817386 >> 172.21.15.104:0/3669817386 conn(0x7f1cc4072290 msgr2=0x7f1cc40cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:00.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.567+0000 7f1cc8aac640 1 -- 172.21.15.104:0/3669817386 shutdown_connections 2024-05-08T04:23:00.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.567+0000 7f1cc8aac640 1 -- 172.21.15.104:0/3669817386 wait complete. 2024-05-08T04:23:00.580 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:22:42.524824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:22:43.279621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:23:00.581 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:23:00.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.683+0000 7fb0e5f5c640 1 Processor -- start 2024-05-08T04:23:00.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.683+0000 7fb0e5f5c640 1 -- start start 2024-05-08T04:23:00.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.684+0000 7fb0e5f5c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e0099ea0 0x7fb0e015dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.684+0000 7fb0e5f5c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e00cd940 con 0x7fb0e0099a40 2024-05-08T04:23:00.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.684+0000 7fb0e5f5c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e00cc8a0 con 0x7fb0e00b2b80 2024-05-08T04:23:00.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.684+0000 7fb0e5f5c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e00ccb80 con 0x7fb0e0099ea0 2024-05-08T04:23:00.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.684+0000 7fb0deffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb0e0099a40 0x7fb0e015d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39092/0 (socket says 172.21.15.104:39092) 2024-05-08T04:23:00.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.684+0000 7fb0deffd640 1 -- 172.21.15.104:0/2604149458 learned_addr learned my addr 172.21.15.104:0/2604149458 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.684+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653431574 0 0) 0x7fb0e00cd940 con 0x7fb0e0099a40 2024-05-08T04:23:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.684+0000 7fb0dffff640 1 --2- 172.21.15.104:0/2604149458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e0099ea0 0x7fb0e015dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0c8003520 con 0x7fb0e0099a40 2024-05-08T04:23:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3342826371 0 0) 0x7fb0c8003520 con 0x7fb0e0099a40 2024-05-08T04:23:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e0099ea0 msgr2=0x7fb0e015dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 --2- 172.21.15.104:0/2604149458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e0099ea0 0x7fb0e015dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 >> v1:172.21.15.183:6789/0 conn(0x7fb0e00b2b80 legacy=0x7fb0e009a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e00cce60 con 0x7fb0e0099a40 2024-05-08T04:23:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fb0d4001670 con 0x7fb0e0099a40 2024-05-08T04:23:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 >> v1:172.21.15.104:6789/0 conn(0x7fb0e0099a40 legacy=0x7fb0e015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 --2- 172.21.15.104:0/2604149458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e0099ea0 0x7fb0c80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 --2- 172.21.15.104:0/2604149458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0c8003f60 0x7fb0c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 --2- 172.21.15.104:0/2604149458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c8004d40 0x7fb0c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e00ccb80 con 0x7fb0c8004d40 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c800bb30 con 0x7fb0c8003f60 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c800bd30 con 0x7fb0e0099ea0 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0dffff640 1 --2- 172.21.15.104:0/2604149458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c8004d40 0x7fb0c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0df7fe640 1 --2- 172.21.15.104:0/2604149458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e0099ea0 0x7fb0c80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0deffd640 1 --2- 172.21.15.104:0/2604149458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0c8003f60 0x7fb0c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0dffff640 1 -- 172.21.15.104:0/2604149458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e0099ea0 msgr2=0x7fb0c80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0dffff640 1 --2- 172.21.15.104:0/2604149458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e0099ea0 0x7fb0c80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0dffff640 1 -- 172.21.15.104:0/2604149458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0c8003f60 msgr2=0x7fb0c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0dffff640 1 --2- 172.21.15.104:0/2604149458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0c8003f60 0x7fb0c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.685+0000 7fb0dffff640 1 -- 172.21.15.104:0/2604149458 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c8003520 con 0x7fb0c8004d40 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.686+0000 7fb0dffff640 1 --2- 172.21.15.104:0/2604149458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c8004d40 0x7fb0c80051c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009fc0 tx=0x7fb0c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5b81acc5d1d168 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.686+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8009c10 con 0x7fb0c8004d40 2024-05-08T04:23:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.686+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d8036070 con 0x7fb0c8004d40 2024-05-08T04:23:00.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.686+0000 7fb0de7fc640 1 -- 172.21.15.104:0/2604149458 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8031880 con 0x7fb0c8004d40 2024-05-08T04:23:00.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.686+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/2604149458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c8004d40 msgr2=0x7fb0c80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.686+0000 7fb0e5f5c640 1 --2- 172.21.15.104:0/2604149458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c8004d40 0x7fb0c80051c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009fc0 tx=0x7fb0c8005830 comp rx=0 tx=0).stop 2024-05-08T04:23:00.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.686+0000 7fb0dffff640 1 -- 172.21.15.104:0/2604149458 reap_dead start 2024-05-08T04:23:00.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.687+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/2604149458 shutdown_connections 2024-05-08T04:23:00.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.687+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/2604149458 >> 172.21.15.104:0/2604149458 conn(0x7fb0e00b3310 msgr2=0x7fb0e00b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:00.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.687+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/2604149458 shutdown_connections 2024-05-08T04:23:00.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.687+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/2604149458 wait complete. 2024-05-08T04:23:00.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.688+0000 7fb0e5f5c640 1 Processor -- start 2024-05-08T04:23:00.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.688+0000 7fb0e5f5c640 1 -- start start 2024-05-08T04:23:00.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0e5f5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c8004d40 0x7fb0e015f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0e5f5c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e00b57f0 0x7fb0e01f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0e5f5c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e00b5c70 0x7fb0e01f6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0e5f5c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e006cc80 con 0x7fb0c8004d40 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0e5f5c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e009a330 con 0x7fb0e00b5c70 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0e5f5c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e00cf830 con 0x7fb0e00b57f0 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0df7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c8004d40 0x7fb0e015f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0df7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c8004d40 0x7fb0e015f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44456/0 (socket says 172.21.15.104:44456) 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0df7fe640 1 -- 172.21.15.104:0/3295323025 learned_addr learned my addr 172.21.15.104:0/3295323025 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0df7fe640 1 -- 172.21.15.104:0/3295323025 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e00b57f0 msgr2=0x7fb0e01f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0df7fe640 1 --2- 172.21.15.104:0/3295323025 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e00b57f0 0x7fb0e01f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0df7fe640 1 -- 172.21.15.104:0/3295323025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e00b5c70 msgr2=0x7fb0e01f6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0df7fe640 1 --2- 172.21.15.104:0/3295323025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e00b5c70 0x7fb0e01f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0df7fe640 1 -- 172.21.15.104:0/3295323025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e00b61d0 con 0x7fb0c8004d40 2024-05-08T04:23:00.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0df7fe640 1 --2- 172.21.15.104:0/3295323025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c8004d40 0x7fb0e015f740 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000f880 tx=0x7fb0d000fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:00.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0c7fff640 1 -- 172.21.15.104:0/3295323025 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0001d20 con 0x7fb0c8004d40 2024-05-08T04:23:00.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0c7fff640 1 -- 172.21.15.104:0/3295323025 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d0018070 con 0x7fb0c8004d40 2024-05-08T04:23:00.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/3295323025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e00b64b0 con 0x7fb0c8004d40 2024-05-08T04:23:00.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0c7fff640 1 -- 172.21.15.104:0/3295323025 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d000d650 con 0x7fb0c8004d40 2024-05-08T04:23:00.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.689+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/3295323025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e00b6a70 con 0x7fb0c8004d40 2024-05-08T04:23:00.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.690+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/3295323025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e0075010 con 0x7fb0c8004d40 2024-05-08T04:23:00.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.691+0000 7fb0c7fff640 1 -- 172.21.15.104:0/3295323025 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fb0d000d7f0 con 0x7fb0c8004d40 2024-05-08T04:23:00.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.691+0000 7fb0c7fff640 1 --2- 172.21.15.104:0/3295323025 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb0cc06b680 0x7fb0cc06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.691+0000 7fb0c7fff640 1 -- 172.21.15.104:0/3295323025 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fb0d008a330 con 0x7fb0c8004d40 2024-05-08T04:23:00.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.691+0000 7fb0deffd640 1 --2- 172.21.15.104:0/3295323025 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb0cc06b680 0x7fb0cc06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.691+0000 7fb0deffd640 1 --2- 172.21.15.104:0/3295323025 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb0cc06b680 0x7fb0cc06db40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4001050 tx=0x7fb0d4001d80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:00.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.695+0000 7fb0c7fff640 1 -- 172.21.15.104:0/3295323025 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb0d0058ea0 con 0x7fb0c8004d40 2024-05-08T04:23:00.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.864+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/3295323025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0e00cf120 con 0x7fb0c8004d40 2024-05-08T04:23:00.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.865+0000 7fb0c7fff640 1 -- 172.21.15.104:0/3295323025 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0d00587a0 con 0x7fb0c8004d40 2024-05-08T04:23:00.866 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:23:00.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.867+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/3295323025 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb0cc06b680 msgr2=0x7fb0cc06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.867+0000 7fb0e5f5c640 1 --2- 172.21.15.104:0/3295323025 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb0cc06b680 0x7fb0cc06db40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4001050 tx=0x7fb0d4001d80 comp rx=0 tx=0).stop 2024-05-08T04:23:00.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.867+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/3295323025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c8004d40 msgr2=0x7fb0e015f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.867+0000 7fb0e5f5c640 1 --2- 172.21.15.104:0/3295323025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c8004d40 0x7fb0e015f740 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000f880 tx=0x7fb0d000fd40 comp rx=0 tx=0).stop 2024-05-08T04:23:00.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.867+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/3295323025 shutdown_connections 2024-05-08T04:23:00.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.867+0000 7fb0e5f5c640 1 --2- 172.21.15.104:0/3295323025 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb0cc06b680 0x7fb0cc06db40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.867+0000 7fb0e5f5c640 1 --2- 172.21.15.104:0/3295323025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e00b5c70 0x7fb0e01f6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.867+0000 7fb0e5f5c640 1 --2- 172.21.15.104:0/3295323025 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e00b57f0 0x7fb0e01f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.867+0000 7fb0e5f5c640 1 --2- 172.21.15.104:0/3295323025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c8004d40 0x7fb0e015f740 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.867+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/3295323025 >> 172.21.15.104:0/3295323025 conn(0x7fb0e00b3310 msgr2=0x7fb0e01608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:00.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.867+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/3295323025 shutdown_connections 2024-05-08T04:23:00.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.867+0000 7fb0e5f5c640 1 -- 172.21.15.104:0/3295323025 wait complete. 2024-05-08T04:23:00.879 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:23:00.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.980+0000 7f2150c1f640 1 Processor -- start 2024-05-08T04:23:00.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.981+0000 7f2150c1f640 1 -- start start 2024-05-08T04:23:00.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.981+0000 7f2150c1f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f214c0ce5a0 0x7f214c161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.981+0000 7f2150c1f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f214c0d07c0 0x7f214c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.981+0000 7f2150c1f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c15e1f0 con 0x7f214c15de10 2024-05-08T04:23:00.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.981+0000 7f2150c1f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c0d0f50 con 0x7f214c0ce5a0 2024-05-08T04:23:00.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.982+0000 7f2150c1f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c161e60 con 0x7f214c0d07c0 2024-05-08T04:23:00.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.982+0000 7f2149d9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f214c0ce5a0 0x7f214c161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.982+0000 7f2149d9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f214c0ce5a0 0x7f214c161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:40630/0 (socket says 172.21.15.104:40630) 2024-05-08T04:23:00.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.982+0000 7f2149d9b640 1 -- 172.21.15.104:0/1616328064 learned_addr learned my addr 172.21.15.104:0/1616328064 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:00.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.982+0000 7f214ad9d640 1 --2- 172.21.15.104:0/1616328064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f214c0d07c0 0x7f214c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.982+0000 7f2149d9b640 1 -- 172.21.15.104:0/1616328064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f214c0d07c0 msgr2=0x7f214c0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:00.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.982+0000 7f2149d9b640 1 --2- 172.21.15.104:0/1616328064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f214c0d07c0 0x7f214c0d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.982+0000 7f2149d9b640 1 -- 172.21.15.104:0/1616328064 >> v1:172.21.15.183:6789/0 conn(0x7f214c15de10 legacy=0x7f214c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.982+0000 7f2149d9b640 1 -- 172.21.15.104:0/1616328064 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c162090 con 0x7f214c0ce5a0 2024-05-08T04:23:00.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.982+0000 7f214ad9d640 1 --2- 172.21.15.104:0/1616328064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f214c0d07c0 0x7f214c0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:00.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.983+0000 7f2149d9b640 1 --2- 172.21.15.104:0/1616328064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f214c0ce5a0 0x7f214c161920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2140009870 tx=0x7f214002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34380f53480ce180 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:00.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.983+0000 7f214959a640 1 -- 172.21.15.104:0/1616328064 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140037070 con 0x7f214c0ce5a0 2024-05-08T04:23:00.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.983+0000 7f214959a640 1 -- 172.21.15.104:0/1616328064 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2140032440 con 0x7f214c0ce5a0 2024-05-08T04:23:00.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.983+0000 7f214959a640 1 -- 172.21.15.104:0/1616328064 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140032810 con 0x7f214c0ce5a0 2024-05-08T04:23:00.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.984+0000 7f2150c1f640 1 -- 172.21.15.104:0/1616328064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f214c0ce5a0 msgr2=0x7f214c161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.984+0000 7f2150c1f640 1 --2- 172.21.15.104:0/1616328064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f214c0ce5a0 0x7f214c161920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2140009870 tx=0x7f214002a1c0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.984+0000 7f2150c1f640 1 -- 172.21.15.104:0/1616328064 shutdown_connections 2024-05-08T04:23:00.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.984+0000 7f2150c1f640 1 --2- 172.21.15.104:0/1616328064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f214c0d07c0 0x7f214c0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.984+0000 7f2150c1f640 1 --2- 172.21.15.104:0/1616328064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f214c0ce5a0 0x7f214c161920 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.984+0000 7f2150c1f640 1 -- 172.21.15.104:0/1616328064 >> 172.21.15.104:0/1616328064 conn(0x7f214c072290 msgr2=0x7f214c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:00.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.984+0000 7f2150c1f640 1 -- 172.21.15.104:0/1616328064 shutdown_connections 2024-05-08T04:23:00.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.984+0000 7f2150c1f640 1 -- 172.21.15.104:0/1616328064 wait complete. 2024-05-08T04:23:00.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.986+0000 7f2150c1f640 1 Processor -- start 2024-05-08T04:23:00.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.986+0000 7f2150c1f640 1 -- start start 2024-05-08T04:23:00.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.986+0000 7f2150c1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f214c0ce5a0 0x7f214c15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.986+0000 7f2150c1f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f214c0d07c0 0x7f214c0b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.986+0000 7f2150c1f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f214c15de10 0x7f214c0b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.986+0000 7f2150c1f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c162650 con 0x7f214c0ce5a0 2024-05-08T04:23:00.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.986+0000 7f2150c1f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0d1a90 con 0x7f214c15de10 2024-05-08T04:23:00.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.986+0000 7f2150c1f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0d1ce0 con 0x7f214c0d07c0 2024-05-08T04:23:00.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f214a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f214c0ce5a0 0x7f214c15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f214a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f214c0ce5a0 0x7f214c15c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44462/0 (socket says 172.21.15.104:44462) 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f214a59c640 1 -- 172.21.15.104:0/3466327895 learned_addr learned my addr 172.21.15.104:0/3466327895 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f2149d9b640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f214c0d07c0 0x7f214c0b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f214ad9d640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f214c15de10 0x7f214c0b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f214a59c640 1 -- 172.21.15.104:0/3466327895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f214c0d07c0 msgr2=0x7f214c0b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f214a59c640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f214c0d07c0 0x7f214c0b85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f214a59c640 1 -- 172.21.15.104:0/3466327895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f214c15de10 msgr2=0x7f214c0b8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f214a59c640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f214c15de10 0x7f214c0b8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f214a59c640 1 -- 172.21.15.104:0/3466327895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0b5440 con 0x7f214c0ce5a0 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f214a59c640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f214c0ce5a0 0x7f214c15c670 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c3f0 tx=0x7f213c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f213affd640 1 -- 172.21.15.104:0/3466327895 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c0052d0 con 0x7f214c0ce5a0 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f213affd640 1 -- 172.21.15.104:0/3466327895 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c005490 con 0x7f214c0ce5a0 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f2150c1f640 1 -- 172.21.15.104:0/3466327895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c0b5720 con 0x7f214c0ce5a0 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f213affd640 1 -- 172.21.15.104:0/3466327895 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c007260 con 0x7f214c0ce5a0 2024-05-08T04:23:00.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.987+0000 7f2150c1f640 1 -- 172.21.15.104:0/3466327895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c0b5ce0 con 0x7f214c0ce5a0 2024-05-08T04:23:00.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.988+0000 7f2150c1f640 1 -- 172.21.15.104:0/3466327895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214c0b6640 con 0x7f214c0ce5a0 2024-05-08T04:23:00.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.989+0000 7f213affd640 1 -- 172.21.15.104:0/3466327895 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f213c007400 con 0x7f214c0ce5a0 2024-05-08T04:23:00.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.989+0000 7f213affd640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f212c06b680 0x7f212c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:00.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.989+0000 7f213affd640 1 -- 172.21.15.104:0/3466327895 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f213c0899a0 con 0x7f214c0ce5a0 2024-05-08T04:23:00.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.989+0000 7f2149d9b640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f212c06b680 0x7f212c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:00.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.990+0000 7f2149d9b640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f212c06b680 0x7f212c06db40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2140034000 tx=0x7f214002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:00.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:00.994+0000 7f213affd640 1 -- 172.21.15.104:0/3466327895 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f214c0b6640 con 0x7f214c0ce5a0 2024-05-08T04:23:01.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.164+0000 7f2150c1f640 1 -- 172.21.15.104:0/3466327895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f214c075010 con 0x7f214c0ce5a0 2024-05-08T04:23:01.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.164+0000 7f213affd640 1 -- 172.21.15.104:0/3466327895 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f213c057ef0 con 0x7f214c0ce5a0 2024-05-08T04:23:01.166 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:23:01.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.166+0000 7f2150c1f640 1 -- 172.21.15.104:0/3466327895 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f212c06b680 msgr2=0x7f212c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:01.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.166+0000 7f2150c1f640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f212c06b680 0x7f212c06db40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2140034000 tx=0x7f214002e000 comp rx=0 tx=0).stop 2024-05-08T04:23:01.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.166+0000 7f2150c1f640 1 -- 172.21.15.104:0/3466327895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f214c0ce5a0 msgr2=0x7f214c15c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:01.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.166+0000 7f2150c1f640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f214c0ce5a0 0x7f214c15c670 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c3f0 tx=0x7f213c00c8b0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.166+0000 7f2150c1f640 1 -- 172.21.15.104:0/3466327895 shutdown_connections 2024-05-08T04:23:01.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.166+0000 7f2150c1f640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f212c06b680 0x7f212c06db40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.166+0000 7f2150c1f640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f214c15de10 0x7f214c0b8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.166+0000 7f2150c1f640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f214c0d07c0 0x7f214c0b85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.166+0000 7f2150c1f640 1 --2- 172.21.15.104:0/3466327895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f214c0ce5a0 0x7f214c15c670 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.166+0000 7f2150c1f640 1 -- 172.21.15.104:0/3466327895 >> 172.21.15.104:0/3466327895 conn(0x7f214c072290 msgr2=0x7f214c0cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:01.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.166+0000 7f2150c1f640 1 -- 172.21.15.104:0/3466327895 shutdown_connections 2024-05-08T04:23:01.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.166+0000 7f2150c1f640 1 -- 172.21.15.104:0/3466327895 wait complete. 2024-05-08T04:23:01.178 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:23:01.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.280+0000 7f9a6abe0640 1 Processor -- start 2024-05-08T04:23:01.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.280+0000 7f9a6abe0640 1 -- start start 2024-05-08T04:23:01.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.281+0000 7f9a6abe0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9a64099a40 0x7f9a64099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.281+0000 7f9a6abe0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6415d490 0x7f9a6415d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.281+0000 7f9a6abe0640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a640cd940 con 0x7f9a640b2b80 2024-05-08T04:23:01.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.281+0000 7f9a6abe0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6409a3e0 con 0x7f9a64099a40 2024-05-08T04:23:01.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.281+0000 7f9a6abe0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a640cc8a0 con 0x7f9a6415d490 2024-05-08T04:23:01.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.281+0000 7f9a6897c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9a640b2b80 0x7f9a6409a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:39106/0 (socket says 172.21.15.104:39106) 2024-05-08T04:23:01.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.281+0000 7f9a6897c640 1 -- 172.21.15.104:0/1085487031 learned_addr learned my addr 172.21.15.104:0/1085487031 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:01.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a63fff640 1 --2- 172.21.15.104:0/1085487031 >> v2:172.21.15.183:3300/0 conn(0x7f9a64099a40 0x7f9a64099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:01.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a6917d640 1 --2- 172.21.15.104:0/1085487031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6415d490 0x7f9a6415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:01.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479272933 0 0) 0x7f9a640cd940 con 0x7f9a640b2b80 2024-05-08T04:23:01.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a50003520 con 0x7f9a640b2b80 2024-05-08T04:23:01.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1495612345 0 0) 0x7f9a50003520 con 0x7f9a640b2b80 2024-05-08T04:23:01.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6415d490 msgr2=0x7f9a6415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:01.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 --2- 172.21.15.104:0/1085487031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6415d490 0x7f9a6415d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 >> v2:172.21.15.183:3300/0 conn(0x7f9a64099a40 msgr2=0x7f9a64099ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:01.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 --2- 172.21.15.104:0/1085487031 >> v2:172.21.15.183:3300/0 conn(0x7f9a64099a40 0x7f9a64099ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a640ccb80 con 0x7f9a640b2b80 2024-05-08T04:23:01.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f9a540019f0 con 0x7f9a640b2b80 2024-05-08T04:23:01.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a63fff640 1 --2- 172.21.15.104:0/1085487031 >> v2:172.21.15.183:3300/0 conn(0x7f9a64099a40 0x7f9a64099ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:23:01.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 >> v1:172.21.15.104:6789/0 conn(0x7f9a640b2b80 legacy=0x7f9a6409a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:01.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 --2- 172.21.15.104:0/1085487031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a500039b0 0x7f9a50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 --2- 172.21.15.104:0/1085487031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6415d490 0x7f9a50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 --2- 172.21.15.104:0/1085487031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a50004d40 0x7f9a500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a640cc8a0 con 0x7f9a50004d40 2024-05-08T04:23:01.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5000ba50 con 0x7f9a500039b0 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5000bc00 con 0x7f9a6415d490 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a6917d640 1 --2- 172.21.15.104:0/1085487031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a50004d40 0x7f9a500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a6897c640 1 --2- 172.21.15.104:0/1085487031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a500039b0 0x7f9a50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a63fff640 1 --2- 172.21.15.104:0/1085487031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6415d490 0x7f9a50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a6917d640 1 -- 172.21.15.104:0/1085487031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6415d490 msgr2=0x7f9a50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a6917d640 1 --2- 172.21.15.104:0/1085487031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6415d490 0x7f9a50004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a6917d640 1 -- 172.21.15.104:0/1085487031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a500039b0 msgr2=0x7f9a50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a6917d640 1 --2- 172.21.15.104:0/1085487031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a500039b0 0x7f9a50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.282+0000 7f9a6917d640 1 -- 172.21.15.104:0/1085487031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a50003520 con 0x7f9a50004d40 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.283+0000 7f9a6917d640 1 --2- 172.21.15.104:0/1085487031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a50004d40 0x7f9a500051c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00ba30 tx=0x7f9a50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f37d66bf91be11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.283+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c030070 con 0x7f9a50004d40 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.283+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c02ade0 con 0x7f9a50004d40 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.283+0000 7f9a637fe640 1 -- 172.21.15.104:0/1085487031 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c00b600 con 0x7f9a50004d40 2024-05-08T04:23:01.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.284+0000 7f9a6abe0640 1 -- 172.21.15.104:0/1085487031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a50004d40 msgr2=0x7f9a500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:01.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.284+0000 7f9a6abe0640 1 --2- 172.21.15.104:0/1085487031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a50004d40 0x7f9a500051c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00ba30 tx=0x7f9a50005830 comp rx=0 tx=0).stop 2024-05-08T04:23:01.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.284+0000 7f9a6917d640 1 -- 172.21.15.104:0/1085487031 reap_dead start 2024-05-08T04:23:01.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.284+0000 7f9a6abe0640 1 -- 172.21.15.104:0/1085487031 shutdown_connections 2024-05-08T04:23:01.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.284+0000 7f9a6abe0640 1 -- 172.21.15.104:0/1085487031 >> 172.21.15.104:0/1085487031 conn(0x7f9a640b3310 msgr2=0x7f9a640b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:01.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.284+0000 7f9a6abe0640 1 -- 172.21.15.104:0/1085487031 shutdown_connections 2024-05-08T04:23:01.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.284+0000 7f9a6abe0640 1 -- 172.21.15.104:0/1085487031 wait complete. 2024-05-08T04:23:01.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.285+0000 7f9a6abe0640 1 Processor -- start 2024-05-08T04:23:01.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.285+0000 7f9a6abe0640 1 -- start start 2024-05-08T04:23:01.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a6abe0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a50004d40 0x7f9a64151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a6abe0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a641518b0 0x7f9a641539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a6abe0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a640ca390 0x7f9a64153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a6abe0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a640cf830 con 0x7f9a641518b0 2024-05-08T04:23:01.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a6abe0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a640cd140 con 0x7f9a50004d40 2024-05-08T04:23:01.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a6abe0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a640cc550 con 0x7f9a640ca390 2024-05-08T04:23:01.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a63fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a641518b0 0x7f9a641539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:01.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a63fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a641518b0 0x7f9a641539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44492/0 (socket says 172.21.15.104:44492) 2024-05-08T04:23:01.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a63fff640 1 -- 172.21.15.104:0/2236990129 learned_addr learned my addr 172.21.15.104:0/2236990129 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:01.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a63fff640 1 -- 172.21.15.104:0/2236990129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a640ca390 msgr2=0x7f9a64153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a63fff640 1 --2- 172.21.15.104:0/2236990129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a640ca390 0x7f9a64153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a63fff640 1 -- 172.21.15.104:0/2236990129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a50004d40 msgr2=0x7f9a64151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a63fff640 1 --2- 172.21.15.104:0/2236990129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a50004d40 0x7f9a64151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.286+0000 7f9a63fff640 1 -- 172.21.15.104:0/2236990129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a640ca930 con 0x7f9a641518b0 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.287+0000 7f9a63fff640 1 --2- 172.21.15.104:0/2236990129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a641518b0 0x7f9a641539b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c011cd0 tx=0x7f9a4c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.287+0000 7f9a617fa640 1 -- 172.21.15.104:0/2236990129 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c00fca0 con 0x7f9a641518b0 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.287+0000 7f9a617fa640 1 -- 172.21.15.104:0/2236990129 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c00fe60 con 0x7f9a641518b0 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.287+0000 7f9a6abe0640 1 -- 172.21.15.104:0/2236990129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a640cac10 con 0x7f9a641518b0 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.287+0000 7f9a617fa640 1 -- 172.21.15.104:0/2236990129 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c004260 con 0x7f9a641518b0 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.287+0000 7f9a6abe0640 1 -- 172.21.15.104:0/2236990129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a640c5330 con 0x7f9a641518b0 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.288+0000 7f9a6abe0640 1 -- 172.21.15.104:0/2236990129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a640cd380 con 0x7f9a641518b0 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.288+0000 7f9a617fa640 1 -- 172.21.15.104:0/2236990129 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f9a4c012040 con 0x7f9a641518b0 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.289+0000 7f9a617fa640 1 --2- 172.21.15.104:0/2236990129 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9a4406b6b0 0x7f9a4406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.289+0000 7f9a6897c640 1 --2- 172.21.15.104:0/2236990129 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9a4406b6b0 0x7f9a4406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:01.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.289+0000 7f9a617fa640 1 -- 172.21.15.104:0/2236990129 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9a4c08a9f0 con 0x7f9a641518b0 2024-05-08T04:23:01.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.289+0000 7f9a6897c640 1 --2- 172.21.15.104:0/2236990129 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9a4406b6b0 0x7f9a4406db70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9a54004c20 tx=0x7f9a54001390 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:01.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.293+0000 7f9a617fa640 1 -- 172.21.15.104:0/2236990129 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9a640cd380 con 0x7f9a641518b0 2024-05-08T04:23:01.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.460+0000 7f9a6abe0640 1 -- 172.21.15.104:0/2236990129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a64075010 con 0x7f9a641518b0 2024-05-08T04:23:01.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.461+0000 7f9a617fa640 1 -- 172.21.15.104:0/2236990129 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a4c019030 con 0x7f9a641518b0 2024-05-08T04:23:01.462 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:23:01.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.463+0000 7f9a6abe0640 1 -- 172.21.15.104:0/2236990129 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9a4406b6b0 msgr2=0x7f9a4406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:01.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.463+0000 7f9a6abe0640 1 --2- 172.21.15.104:0/2236990129 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9a4406b6b0 0x7f9a4406db70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9a54004c20 tx=0x7f9a54001390 comp rx=0 tx=0).stop 2024-05-08T04:23:01.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.463+0000 7f9a6abe0640 1 -- 172.21.15.104:0/2236990129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a641518b0 msgr2=0x7f9a641539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:01.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.463+0000 7f9a6abe0640 1 --2- 172.21.15.104:0/2236990129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a641518b0 0x7f9a641539b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c011cd0 tx=0x7f9a4c00f610 comp rx=0 tx=0).stop 2024-05-08T04:23:01.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.463+0000 7f9a6abe0640 1 -- 172.21.15.104:0/2236990129 shutdown_connections 2024-05-08T04:23:01.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.463+0000 7f9a6abe0640 1 --2- 172.21.15.104:0/2236990129 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9a4406b6b0 0x7f9a4406db70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.463+0000 7f9a6abe0640 1 --2- 172.21.15.104:0/2236990129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a640ca390 0x7f9a64153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.463+0000 7f9a6abe0640 1 --2- 172.21.15.104:0/2236990129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a641518b0 0x7f9a641539b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.463+0000 7f9a6abe0640 1 --2- 172.21.15.104:0/2236990129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a50004d40 0x7f9a64151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.463+0000 7f9a6abe0640 1 -- 172.21.15.104:0/2236990129 >> 172.21.15.104:0/2236990129 conn(0x7f9a640b3310 msgr2=0x7f9a6406fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:01.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.463+0000 7f9a6abe0640 1 -- 172.21.15.104:0/2236990129 shutdown_connections 2024-05-08T04:23:01.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.463+0000 7f9a6abe0640 1 -- 172.21.15.104:0/2236990129 wait complete. 2024-05-08T04:23:01.475 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:23:01.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.574+0000 7f2563716640 1 Processor -- start 2024-05-08T04:23:01.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.574+0000 7f2563716640 1 -- start start 2024-05-08T04:23:01.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2563716640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f255c099a40 0x7f255c099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2563716640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c15d490 0x7f255c15d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2563716640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c0cd940 con 0x7f255c0b2b80 2024-05-08T04:23:01.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2563716640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255c09a3e0 con 0x7f255c099a40 2024-05-08T04:23:01.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2563716640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0cc8a0 con 0x7f255c15d490 2024-05-08T04:23:01.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2560cb1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f255c099a40 0x7f255c099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:01.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2560cb1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f255c099a40 0x7f255c099ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44506/0 (socket says 172.21.15.104:44506) 2024-05-08T04:23:01.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2560cb1640 1 -- 172.21.15.104:0/1586209789 learned_addr learned my addr 172.21.15.104:0/1586209789 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:01.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2560cb1640 1 -- 172.21.15.104:0/1586209789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c15d490 msgr2=0x7f255c15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:01.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2561cb3640 1 --2- 172.21.15.104:0/1586209789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c15d490 0x7f255c15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:01.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2560cb1640 1 --2- 172.21.15.104:0/1586209789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c15d490 0x7f255c15d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2560cb1640 1 -- 172.21.15.104:0/1586209789 >> v1:172.21.15.183:6789/0 conn(0x7f255c0b2b80 legacy=0x7f255c09a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:01.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2560cb1640 1 -- 172.21.15.104:0/1586209789 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c0ccb80 con 0x7f255c099a40 2024-05-08T04:23:01.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.575+0000 7f2561cb3640 1 --2- 172.21.15.104:0/1586209789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c15d490 0x7f255c15d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:01.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.576+0000 7f2560cb1640 1 --2- 172.21.15.104:0/1586209789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f255c099a40 0x7f255c099ea0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f254c009870 tx=0x7f254c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2e96d41ca9d9ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:01.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.576+0000 7f2553fff640 1 -- 172.21.15.104:0/1586209789 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c037070 con 0x7f255c099a40 2024-05-08T04:23:01.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.576+0000 7f2553fff640 1 -- 172.21.15.104:0/1586209789 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c032440 con 0x7f255c099a40 2024-05-08T04:23:01.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.576+0000 7f2553fff640 1 -- 172.21.15.104:0/1586209789 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c032810 con 0x7f255c099a40 2024-05-08T04:23:01.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.577+0000 7f2563716640 1 -- 172.21.15.104:0/1586209789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f255c099a40 msgr2=0x7f255c099ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:01.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.577+0000 7f2563716640 1 --2- 172.21.15.104:0/1586209789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f255c099a40 0x7f255c099ea0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f254c009870 tx=0x7f254c02a2a0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.577+0000 7f2563716640 1 -- 172.21.15.104:0/1586209789 shutdown_connections 2024-05-08T04:23:01.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.577+0000 7f2563716640 1 --2- 172.21.15.104:0/1586209789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c15d490 0x7f255c15d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.577+0000 7f2563716640 1 --2- 172.21.15.104:0/1586209789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f255c099a40 0x7f255c099ea0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.577+0000 7f2563716640 1 -- 172.21.15.104:0/1586209789 >> 172.21.15.104:0/1586209789 conn(0x7f255c0b3310 msgr2=0x7f255c0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:01.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.577+0000 7f2563716640 1 -- 172.21.15.104:0/1586209789 shutdown_connections 2024-05-08T04:23:01.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.577+0000 7f2563716640 1 -- 172.21.15.104:0/1586209789 wait complete. 2024-05-08T04:23:01.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.578+0000 7f2563716640 1 Processor -- start 2024-05-08T04:23:01.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.578+0000 7f2563716640 1 -- start start 2024-05-08T04:23:01.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f2563716640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f255c099a40 0x7f255c0ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f2563716640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c0b2b80 0x7f255c1580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f2563716640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255c15d490 0x7f255c1f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f2563716640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0cf830 con 0x7f255c099a40 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f2563716640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0cd140 con 0x7f255c15d490 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f2563716640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0cc550 con 0x7f255c0b2b80 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f25614b2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f255c099a40 0x7f255c0ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f25614b2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f255c099a40 0x7f255c0ca050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44512/0 (socket says 172.21.15.104:44512) 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f25614b2640 1 -- 172.21.15.104:0/2427102021 learned_addr learned my addr 172.21.15.104:0/2427102021 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f25614b2640 1 -- 172.21.15.104:0/2427102021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c0b2b80 msgr2=0x7f255c1580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f25614b2640 1 --2- 172.21.15.104:0/2427102021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c0b2b80 0x7f255c1580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f25614b2640 1 -- 172.21.15.104:0/2427102021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255c15d490 msgr2=0x7f255c1f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f25614b2640 1 --2- 172.21.15.104:0/2427102021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255c15d490 0x7f255c1f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f25614b2640 1 -- 172.21.15.104:0/2427102021 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c0c55a0 con 0x7f255c099a40 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f25614b2640 1 --2- 172.21.15.104:0/2427102021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f255c099a40 0x7f255c0ca050 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f255800c430 tx=0x7f255800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f2551ffb640 1 -- 172.21.15.104:0/2427102021 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558011790 con 0x7f255c099a40 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f2551ffb640 1 -- 172.21.15.104:0/2427102021 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558017070 con 0x7f255c099a40 2024-05-08T04:23:01.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f2551ffb640 1 -- 172.21.15.104:0/2427102021 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558011bb0 con 0x7f255c099a40 2024-05-08T04:23:01.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.579+0000 7f2563716640 1 -- 172.21.15.104:0/2427102021 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255c0c5880 con 0x7f255c099a40 2024-05-08T04:23:01.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.580+0000 7f2563716640 1 -- 172.21.15.104:0/2427102021 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c0c5e40 con 0x7f255c099a40 2024-05-08T04:23:01.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.580+0000 7f2563716640 1 -- 172.21.15.104:0/2427102021 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c075010 con 0x7f255c099a40 2024-05-08T04:23:01.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.581+0000 7f2551ffb640 1 -- 172.21.15.104:0/2427102021 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f255801c460 con 0x7f255c099a40 2024-05-08T04:23:01.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.581+0000 7f2551ffb640 1 --2- 172.21.15.104:0/2427102021 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f254006b680 0x7f254006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:01.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.581+0000 7f2551ffb640 1 -- 172.21.15.104:0/2427102021 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f255808a510 con 0x7f255c099a40 2024-05-08T04:23:01.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.581+0000 7f2560cb1640 1 --2- 172.21.15.104:0/2427102021 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f254006b680 0x7f254006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:01.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.582+0000 7f2560cb1640 1 --2- 172.21.15.104:0/2427102021 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f254006b680 0x7f254006db40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f254c034000 tx=0x7f254c02c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:01.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.585+0000 7f2551ffb640 1 -- 172.21.15.104:0/2427102021 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2558058ff0 con 0x7f255c099a40 2024-05-08T04:23:01.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.767+0000 7f2563716640 1 -- 172.21.15.104:0/2427102021 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f255c06c640 con 0x7f255c099a40 2024-05-08T04:23:01.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.767+0000 7f2551ffb640 1 -- 172.21.15.104:0/2427102021 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f25580588f0 con 0x7f255c099a40 2024-05-08T04:23:01.768 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:23:01.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.769+0000 7f2563716640 1 -- 172.21.15.104:0/2427102021 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f254006b680 msgr2=0x7f254006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:01.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.769+0000 7f2563716640 1 --2- 172.21.15.104:0/2427102021 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f254006b680 0x7f254006db40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f254c034000 tx=0x7f254c02c000 comp rx=0 tx=0).stop 2024-05-08T04:23:01.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.769+0000 7f2563716640 1 -- 172.21.15.104:0/2427102021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f255c099a40 msgr2=0x7f255c0ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:01.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.769+0000 7f2563716640 1 --2- 172.21.15.104:0/2427102021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f255c099a40 0x7f255c0ca050 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f255800c430 tx=0x7f255800c8f0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.769+0000 7f2563716640 1 -- 172.21.15.104:0/2427102021 shutdown_connections 2024-05-08T04:23:01.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.769+0000 7f2563716640 1 --2- 172.21.15.104:0/2427102021 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f254006b680 0x7f254006db40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.769+0000 7f2563716640 1 --2- 172.21.15.104:0/2427102021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255c15d490 0x7f255c1f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.769+0000 7f2563716640 1 --2- 172.21.15.104:0/2427102021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c0b2b80 0x7f255c1580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.769+0000 7f2563716640 1 --2- 172.21.15.104:0/2427102021 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f255c099a40 0x7f255c0ca050 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:01.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.769+0000 7f2563716640 1 -- 172.21.15.104:0/2427102021 >> 172.21.15.104:0/2427102021 conn(0x7f255c0b3310 msgr2=0x7f255c15ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:01.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.769+0000 7f2563716640 1 -- 172.21.15.104:0/2427102021 shutdown_connections 2024-05-08T04:23:01.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:01.769+0000 7f2563716640 1 -- 172.21.15.104:0/2427102021 wait complete. 2024-05-08T04:23:01.781 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi104.front.sepia.ceph.com... 2024-05-08T04:23:01.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:23:01.782 DEBUG:teuthology.orchestra.run.smithi104:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-08T04:23:01.804 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[53781]: fuse finished with error 0 and tester_r 0 2024-05-08T04:23:01.806 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:23:07.908 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:23:07.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:23:07.908 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T04:23:07.928 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:23:07.928 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:23:07.948 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:23:08.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.078+0000 7f3f51012640 1 Processor -- start 2024-05-08T04:23:08.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.078+0000 7f3f51012640 1 -- start start 2024-05-08T04:23:08.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.079+0000 7f3f51012640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3f4c0ce5a0 0x7f3f4c161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.079+0000 7f3f51012640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3f4c0d07c0 0x7f3f4c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.079+0000 7f3f51012640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4c15e1f0 con 0x7f3f4c15de10 2024-05-08T04:23:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.079+0000 7f3f51012640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4c0d0f50 con 0x7f3f4c0ce5a0 2024-05-08T04:23:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.079+0000 7f3f51012640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4c161e60 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.079+0000 7f3f4259c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3f4c0ce5a0 0x7f3f4c161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.079+0000 7f3f4259c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3f4c0ce5a0 0x7f3f4c161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37674/0 (socket says 172.21.15.104:37674) 2024-05-08T04:23:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.079+0000 7f3f4259c640 1 -- 172.21.15.104:0/3878123997 learned_addr learned my addr 172.21.15.104:0/3878123997 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.080+0000 7f3f4b59e640 1 --2- 172.21.15.104:0/3878123997 >> v2:172.21.15.183:3300/0 conn(0x7f3f4c0d07c0 0x7f3f4c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.080+0000 7f3f4259c640 1 -- 172.21.15.104:0/3878123997 >> v2:172.21.15.183:3300/0 conn(0x7f3f4c0d07c0 msgr2=0x7f3f4c0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.080+0000 7f3f4259c640 1 --2- 172.21.15.104:0/3878123997 >> v2:172.21.15.183:3300/0 conn(0x7f3f4c0d07c0 0x7f3f4c0d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.080+0000 7f3f4259c640 1 -- 172.21.15.104:0/3878123997 >> v1:172.21.15.183:6789/0 conn(0x7f3f4c15de10 legacy=0x7f3f4c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:08.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.080+0000 7f3f4259c640 1 -- 172.21.15.104:0/3878123997 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c162090 con 0x7f3f4c0ce5a0 2024-05-08T04:23:08.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.080+0000 7f3f4259c640 1 --2- 172.21.15.104:0/3878123997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f4c0ce5a0 0x7f3f4c161920 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0b3420 tx=0x7f3f3402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21565adf537706f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:08.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.081+0000 7f3f4a59c640 1 -- 172.21.15.104:0/3878123997 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34037070 con 0x7f3f4c0ce5a0 2024-05-08T04:23:08.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.081+0000 7f3f4a59c640 1 -- 172.21.15.104:0/3878123997 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f34032440 con 0x7f3f4c0ce5a0 2024-05-08T04:23:08.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.081+0000 7f3f4a59c640 1 -- 172.21.15.104:0/3878123997 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34032810 con 0x7f3f4c0ce5a0 2024-05-08T04:23:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.081+0000 7f3f51012640 1 -- 172.21.15.104:0/3878123997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f4c0ce5a0 msgr2=0x7f3f4c161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.081+0000 7f3f51012640 1 --2- 172.21.15.104:0/3878123997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f4c0ce5a0 0x7f3f4c161920 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0b3420 tx=0x7f3f3402a1a0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.081+0000 7f3f51012640 1 -- 172.21.15.104:0/3878123997 shutdown_connections 2024-05-08T04:23:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.081+0000 7f3f51012640 1 --2- 172.21.15.104:0/3878123997 >> v2:172.21.15.183:3300/0 conn(0x7f3f4c0d07c0 0x7f3f4c0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.081+0000 7f3f51012640 1 --2- 172.21.15.104:0/3878123997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f4c0ce5a0 0x7f3f4c161920 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.081+0000 7f3f51012640 1 -- 172.21.15.104:0/3878123997 >> 172.21.15.104:0/3878123997 conn(0x7f3f4c072290 msgr2=0x7f3f4c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.081+0000 7f3f51012640 1 -- 172.21.15.104:0/3878123997 shutdown_connections 2024-05-08T04:23:08.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.081+0000 7f3f51012640 1 -- 172.21.15.104:0/3878123997 wait complete. 2024-05-08T04:23:08.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.083+0000 7f3f51012640 1 Processor -- start 2024-05-08T04:23:08.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.083+0000 7f3f51012640 1 -- start start 2024-05-08T04:23:08.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f51012640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f4c0ce5a0 0x7f3f4c0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f51012640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f4c0d07c0 0x7f3f4c0c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f51012640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f4c15de10 0x7f3f4c0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f51012640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c162650 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f51012640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c0d1a90 con 0x7f3f4c0ce5a0 2024-05-08T04:23:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f51012640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c0d1ce0 con 0x7f3f4c15de10 2024-05-08T04:23:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f4259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f4c0d07c0 0x7f3f4c0c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f4259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f4c0d07c0 0x7f3f4c0c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37686/0 (socket says 172.21.15.104:37686) 2024-05-08T04:23:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f4259c640 1 -- 172.21.15.104:0/2669437680 learned_addr learned my addr 172.21.15.104:0/2669437680 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f4ad9d640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f4c0ce5a0 0x7f3f4c0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f4b59e640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f4c15de10 0x7f3f4c0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f4259c640 1 -- 172.21.15.104:0/2669437680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f4c15de10 msgr2=0x7f3f4c0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f4259c640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f4c15de10 0x7f3f4c0cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f4259c640 1 -- 172.21.15.104:0/2669437680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f4c0ce5a0 msgr2=0x7f3f4c0cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f4259c640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f4c0ce5a0 0x7f3f4c0cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f4259c640 1 -- 172.21.15.104:0/2669437680 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c0c9ae0 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f4259c640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f4c0d07c0 0x7f3f4c0c95a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3f3402a1e0 tx=0x7f3f340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f43fff640 1 -- 172.21.15.104:0/2669437680 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34041020 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f43fff640 1 -- 172.21.15.104:0/2669437680 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f340306c0 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f43fff640 1 -- 172.21.15.104:0/2669437680 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34037040 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f51012640 1 -- 172.21.15.104:0/2669437680 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4c0cc5a0 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.084+0000 7f3f51012640 1 -- 172.21.15.104:0/2669437680 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4c0cc840 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.085+0000 7f3f51012640 1 -- 172.21.15.104:0/2669437680 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4c075010 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.086+0000 7f3f43fff640 1 -- 172.21.15.104:0/2669437680 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f3f34044020 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.086+0000 7f3f43fff640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3f2c06b680 0x7f3f2c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.086+0000 7f3f43fff640 1 -- 172.21.15.104:0/2669437680 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f3f340aae20 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.086+0000 7f3f4ad9d640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3f2c06b680 0x7f3f2c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.087+0000 7f3f4ad9d640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3f2c06b680 0x7f3f2c06db40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c006fd0 tx=0x7f3f3c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:08.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.091+0000 7f3f43fff640 1 -- 172.21.15.104:0/2669437680 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3f3404b030 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.262+0000 7f3f51012640 1 -- 172.21.15.104:0/2669437680 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f4c0d1870 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.264+0000 7f3f43fff640 1 -- 172.21.15.104:0/2669437680 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16961 (secure 0 0 0) 0x7f3f4c0c9ae0 con 0x7f3f4c0d07c0 2024-05-08T04:23:08.265 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:08.265 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":47,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:52.009332+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:42.524824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:43.279621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.39","mappings":[{"from":5,"to":7}]},{"pgid":"7.3c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:23:08.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.266+0000 7f3f51012640 1 -- 172.21.15.104:0/2669437680 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3f2c06b680 msgr2=0x7f3f2c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.266+0000 7f3f51012640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3f2c06b680 0x7f3f2c06db40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c006fd0 tx=0x7f3f3c008040 comp rx=0 tx=0).stop 2024-05-08T04:23:08.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.266+0000 7f3f51012640 1 -- 172.21.15.104:0/2669437680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f4c0d07c0 msgr2=0x7f3f4c0c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.266+0000 7f3f51012640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f4c0d07c0 0x7f3f4c0c95a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3f3402a1e0 tx=0x7f3f340046c0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.266+0000 7f3f51012640 1 -- 172.21.15.104:0/2669437680 shutdown_connections 2024-05-08T04:23:08.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.266+0000 7f3f51012640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3f2c06b680 0x7f3f2c06db40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.266+0000 7f3f51012640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f4c15de10 0x7f3f4c0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.266+0000 7f3f51012640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f4c0d07c0 0x7f3f4c0c95a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.266+0000 7f3f51012640 1 --2- 172.21.15.104:0/2669437680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f4c0ce5a0 0x7f3f4c0cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.266+0000 7f3f51012640 1 -- 172.21.15.104:0/2669437680 >> 172.21.15.104:0/2669437680 conn(0x7f3f4c072290 msgr2=0x7f3f4c0b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:08.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.266+0000 7f3f51012640 1 -- 172.21.15.104:0/2669437680 shutdown_connections 2024-05-08T04:23:08.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.266+0000 7f3f51012640 1 -- 172.21.15.104:0/2669437680 wait complete. 2024-05-08T04:23:08.278 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:22:42.524824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:22:43.279621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:23:08.278 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:23:08.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.379+0000 7fcf94fcf640 1 Processor -- start 2024-05-08T04:23:08.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.379+0000 7fcf94fcf640 1 -- start start 2024-05-08T04:23:08.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.380+0000 7fcf94fcf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf90159ec0 0x7fcf9006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.380+0000 7fcf94fcf640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcf9015a2a0 0x7fcf9015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.380+0000 7fcf94fcf640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcf9015e780 0x7fcf90071a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.380+0000 7fcf94fcf640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9015dce0 con 0x7fcf9015a2a0 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.380+0000 7fcf94fcf640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9006eb60 con 0x7fcf9015e780 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.380+0000 7fcf94fcf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9006ee40 con 0x7fcf90159ec0 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.380+0000 7fcf8dd9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcf9015a2a0 0x7fcf9015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.380+0000 7fcf8dd9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fcf9015a2a0 0x7fcf9015b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37688/0 (socket says 172.21.15.104:37688) 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.380+0000 7fcf8dd9b640 1 -- 172.21.15.104:0/3141108434 learned_addr learned my addr 172.21.15.104:0/3141108434 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.381+0000 7fcf8e59c640 1 --2- 172.21.15.104:0/3141108434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf90159ec0 0x7fcf9006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.381+0000 7fcf8dd9b640 1 -- 172.21.15.104:0/3141108434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf90159ec0 msgr2=0x7fcf9006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.381+0000 7fcf8ed9d640 1 --2- 172.21.15.104:0/3141108434 >> v2:172.21.15.183:3300/0 conn(0x7fcf9015e780 0x7fcf90071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.381+0000 7fcf8dd9b640 1 --2- 172.21.15.104:0/3141108434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf90159ec0 0x7fcf9006e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.381+0000 7fcf8dd9b640 1 -- 172.21.15.104:0/3141108434 >> v2:172.21.15.183:3300/0 conn(0x7fcf9015e780 msgr2=0x7fcf90071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.381+0000 7fcf8dd9b640 1 --2- 172.21.15.104:0/3141108434 >> v2:172.21.15.183:3300/0 conn(0x7fcf9015e780 0x7fcf90071a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.381+0000 7fcf8dd9b640 1 -- 172.21.15.104:0/3141108434 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9015df80 con 0x7fcf9015a2a0 2024-05-08T04:23:08.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.381+0000 7fcf8dd9b640 1 --2- 172.21.15.104:0/3141108434 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf9015a2a0 0x7fcf9015b1e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fcf9006f120 tx=0x7fcf8402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8ab08e3870539f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:08.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.381+0000 7fcf8d59a640 1 -- 172.21.15.104:0/3141108434 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84037070 con 0x7fcf9015a2a0 2024-05-08T04:23:08.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.381+0000 7fcf8d59a640 1 -- 172.21.15.104:0/3141108434 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf84032440 con 0x7fcf9015a2a0 2024-05-08T04:23:08.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.382+0000 7fcf8d59a640 1 -- 172.21.15.104:0/3141108434 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84032810 con 0x7fcf9015a2a0 2024-05-08T04:23:08.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.382+0000 7fcf94fcf640 1 -- 172.21.15.104:0/3141108434 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf9015a2a0 msgr2=0x7fcf9015b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.382+0000 7fcf94fcf640 1 --2- 172.21.15.104:0/3141108434 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf9015a2a0 0x7fcf9015b1e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fcf9006f120 tx=0x7fcf8402a1e0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.382+0000 7fcf94fcf640 1 -- 172.21.15.104:0/3141108434 shutdown_connections 2024-05-08T04:23:08.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.382+0000 7fcf94fcf640 1 --2- 172.21.15.104:0/3141108434 >> v2:172.21.15.183:3300/0 conn(0x7fcf9015e780 0x7fcf90071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.382+0000 7fcf94fcf640 1 --2- 172.21.15.104:0/3141108434 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf9015a2a0 0x7fcf9015b1e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.382+0000 7fcf94fcf640 1 --2- 172.21.15.104:0/3141108434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf90159ec0 0x7fcf9006e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.382+0000 7fcf94fcf640 1 -- 172.21.15.104:0/3141108434 >> 172.21.15.104:0/3141108434 conn(0x7fcf900b13f0 msgr2=0x7fcf900b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.382+0000 7fcf94fcf640 1 -- 172.21.15.104:0/3141108434 shutdown_connections 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.382+0000 7fcf94fcf640 1 -- 172.21.15.104:0/3141108434 wait complete. 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.383+0000 7fcf94fcf640 1 Processor -- start 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.383+0000 7fcf94fcf640 1 -- start start 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.384+0000 7fcf94fcf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf90159ec0 0x7fcf9014c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.384+0000 7fcf94fcf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf9015a2a0 0x7fcf900af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.384+0000 7fcf94fcf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf9015e780 0x7fcf900afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.384+0000 7fcf94fcf640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf90071f90 con 0x7fcf9015e780 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.384+0000 7fcf94fcf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9015ec10 con 0x7fcf9015a2a0 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.384+0000 7fcf94fcf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf90072110 con 0x7fcf90159ec0 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.384+0000 7fcf8ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf9015e780 0x7fcf900afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.384+0000 7fcf8ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf9015e780 0x7fcf900afc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37700/0 (socket says 172.21.15.104:37700) 2024-05-08T04:23:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.384+0000 7fcf8ed9d640 1 -- 172.21.15.104:0/579754617 learned_addr learned my addr 172.21.15.104:0/579754617 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.384+0000 7fcf8e59c640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf90159ec0 0x7fcf9014c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.384+0000 7fcf8dd9b640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf9015a2a0 0x7fcf900af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.385+0000 7fcf8ed9d640 1 -- 172.21.15.104:0/579754617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf90159ec0 msgr2=0x7fcf9014c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.385+0000 7fcf8ed9d640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf90159ec0 0x7fcf9014c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.385+0000 7fcf8ed9d640 1 -- 172.21.15.104:0/579754617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf9015a2a0 msgr2=0x7fcf900af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.385+0000 7fcf8ed9d640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf9015a2a0 0x7fcf900af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.385+0000 7fcf8ed9d640 1 -- 172.21.15.104:0/579754617 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf901f2d50 con 0x7fcf9015e780 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.385+0000 7fcf8ed9d640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf9015e780 0x7fcf900afc70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800c580 tx=0x7fcf8800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.385+0000 7fcf7effd640 1 -- 172.21.15.104:0/579754617 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88015070 con 0x7fcf9015e780 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.385+0000 7fcf7effd640 1 -- 172.21.15.104:0/579754617 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf88004220 con 0x7fcf9015e780 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.385+0000 7fcf94fcf640 1 -- 172.21.15.104:0/579754617 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf901e5e40 con 0x7fcf9015e780 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.385+0000 7fcf7effd640 1 -- 172.21.15.104:0/579754617 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88003610 con 0x7fcf9015e780 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.385+0000 7fcf94fcf640 1 -- 172.21.15.104:0/579754617 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf901f32a0 con 0x7fcf9015e780 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.386+0000 7fcf94fcf640 1 -- 172.21.15.104:0/579754617 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9006f340 con 0x7fcf9015e780 2024-05-08T04:23:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.386+0000 7fcf7effd640 1 -- 172.21.15.104:0/579754617 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fcf880037b0 con 0x7fcf9015e780 2024-05-08T04:23:08.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.387+0000 7fcf7effd640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcf7006b680 0x7fcf7006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.387+0000 7fcf7effd640 1 -- 172.21.15.104:0/579754617 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fcf8808a410 con 0x7fcf9015e780 2024-05-08T04:23:08.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.387+0000 7fcf8e59c640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcf7006b680 0x7fcf7006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.387+0000 7fcf8e59c640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcf7006b680 0x7fcf7006db40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcf901e4e90 tx=0x7fcf80007580 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:08.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.391+0000 7fcf7effd640 1 -- 172.21.15.104:0/579754617 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf9006f340 con 0x7fcf9015e780 2024-05-08T04:23:08.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.561+0000 7fcf94fcf640 1 -- 172.21.15.104:0/579754617 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf900cc6d0 con 0x7fcf9015e780 2024-05-08T04:23:08.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.561+0000 7fcf7effd640 1 -- 172.21.15.104:0/579754617 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf88058e80 con 0x7fcf9015e780 2024-05-08T04:23:08.562 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:23:08.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.563+0000 7fcf94fcf640 1 -- 172.21.15.104:0/579754617 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcf7006b680 msgr2=0x7fcf7006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.563+0000 7fcf94fcf640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcf7006b680 0x7fcf7006db40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcf901e4e90 tx=0x7fcf80007580 comp rx=0 tx=0).stop 2024-05-08T04:23:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.563+0000 7fcf94fcf640 1 -- 172.21.15.104:0/579754617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf9015e780 msgr2=0x7fcf900afc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.563+0000 7fcf94fcf640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf9015e780 0x7fcf900afc70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800c580 tx=0x7fcf8800ca40 comp rx=0 tx=0).stop 2024-05-08T04:23:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.563+0000 7fcf94fcf640 1 -- 172.21.15.104:0/579754617 shutdown_connections 2024-05-08T04:23:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.563+0000 7fcf94fcf640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcf7006b680 0x7fcf7006db40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.563+0000 7fcf94fcf640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf9015a2a0 0x7fcf900af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.563+0000 7fcf94fcf640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf9015e780 0x7fcf900afc70 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.563+0000 7fcf94fcf640 1 --2- 172.21.15.104:0/579754617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf90159ec0 0x7fcf9014c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.563+0000 7fcf94fcf640 1 -- 172.21.15.104:0/579754617 >> 172.21.15.104:0/579754617 conn(0x7fcf900b13f0 msgr2=0x7fcf90152700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.563+0000 7fcf94fcf640 1 -- 172.21.15.104:0/579754617 shutdown_connections 2024-05-08T04:23:08.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.563+0000 7fcf94fcf640 1 -- 172.21.15.104:0/579754617 wait complete. 2024-05-08T04:23:08.575 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:23:08.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.676+0000 7fbaf2c58640 1 Processor -- start 2024-05-08T04:23:08.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.676+0000 7fbaf2c58640 1 -- start start 2024-05-08T04:23:08.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.677+0000 7fbaf2c58640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaec157ac0 0x7fbaec157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.677+0000 7fbaf2c58640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaec0d15c0 con 0x7fbaec15edf0 2024-05-08T04:23:08.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.677+0000 7fbaf2c58640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaec15f550 con 0x7fbaec070c70 2024-05-08T04:23:08.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.677+0000 7fbaf2c58640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec06bc70 con 0x7fbaec157ac0 2024-05-08T04:23:08.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.677+0000 7fbae3fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fbaec15edf0 0x7fbaec0b52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:57308/0 (socket says 172.21.15.104:57308) 2024-05-08T04:23:08.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.677+0000 7fbae3fff640 1 -- 172.21.15.104:0/3804000895 learned_addr learned my addr 172.21.15.104:0/3804000895 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:08.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.677+0000 7fbaf11f5640 1 --2- 172.21.15.104:0/3804000895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaec157ac0 0x7fbaec157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.677+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543475388 0 0) 0x7fbaec0d15c0 con 0x7fbaec15edf0 2024-05-08T04:23:08.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.677+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbad4003520 con 0x7fbaec15edf0 2024-05-08T04:23:08.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2552466556 0 0) 0x7fbad4003520 con 0x7fbaec15edf0 2024-05-08T04:23:08.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaec157ac0 msgr2=0x7fbaec157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:08.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae37fe640 1 --2- 172.21.15.104:0/3804000895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaec157ac0 0x7fbaec157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 >> v1:172.21.15.183:6789/0 conn(0x7fbaec070c70 legacy=0x7fbaec071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec15f830 con 0x7fbaec15edf0 2024-05-08T04:23:08.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fbadc001670 con 0x7fbaec15edf0 2024-05-08T04:23:08.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 >> v1:172.21.15.104:6789/0 conn(0x7fbaec15edf0 legacy=0x7fbaec0b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae37fe640 1 --2- 172.21.15.104:0/3804000895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaec157ac0 0x7fbad40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae37fe640 1 --2- 172.21.15.104:0/3804000895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbad4003f60 0x7fbad4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae37fe640 1 --2- 172.21.15.104:0/3804000895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbad4004d40 0x7fbad40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad400ba70 con 0x7fbad4003f60 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad400bc20 con 0x7fbad4004d40 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad400be20 con 0x7fbaec157ac0 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae3fff640 1 --2- 172.21.15.104:0/3804000895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbad4003f60 0x7fbad4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbaf09f4640 1 --2- 172.21.15.104:0/3804000895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaec157ac0 0x7fbad40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbaf11f5640 1 --2- 172.21.15.104:0/3804000895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbad4004d40 0x7fbad40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae3fff640 1 -- 172.21.15.104:0/3804000895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaec157ac0 msgr2=0x7fbad40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae3fff640 1 --2- 172.21.15.104:0/3804000895 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaec157ac0 0x7fbad40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae3fff640 1 -- 172.21.15.104:0/3804000895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbad4004d40 msgr2=0x7fbad40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae3fff640 1 --2- 172.21.15.104:0/3804000895 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbad4004d40 0x7fbad40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.678+0000 7fbae3fff640 1 -- 172.21.15.104:0/3804000895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad4003520 con 0x7fbad4003f60 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.679+0000 7fbae3fff640 1 --2- 172.21.15.104:0/3804000895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbad4003f60 0x7fbad4004800 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fbaec15f250 tx=0x7fbad4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6413fc1127c53ed0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.679+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc007d30 con 0x7fbad4003f60 2024-05-08T04:23:08.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.679+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc0058d0 con 0x7fbad4003f60 2024-05-08T04:23:08.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.679+0000 7fbae37fe640 1 -- 172.21.15.104:0/3804000895 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc005d20 con 0x7fbad4003f60 2024-05-08T04:23:08.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.679+0000 7fbaf2c58640 1 -- 172.21.15.104:0/3804000895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbad4003f60 msgr2=0x7fbad4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.679+0000 7fbaf2c58640 1 --2- 172.21.15.104:0/3804000895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbad4003f60 0x7fbad4004800 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fbaec15f250 tx=0x7fbad4005830 comp rx=0 tx=0).stop 2024-05-08T04:23:08.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.679+0000 7fbaf11f5640 1 -- 172.21.15.104:0/3804000895 reap_dead start 2024-05-08T04:23:08.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.679+0000 7fbaf2c58640 1 -- 172.21.15.104:0/3804000895 shutdown_connections 2024-05-08T04:23:08.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.679+0000 7fbaf2c58640 1 -- 172.21.15.104:0/3804000895 >> 172.21.15.104:0/3804000895 conn(0x7fbaec0b3450 msgr2=0x7fbaec0b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:08.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.680+0000 7fbaf2c58640 1 -- 172.21.15.104:0/3804000895 shutdown_connections 2024-05-08T04:23:08.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.680+0000 7fbaf2c58640 1 -- 172.21.15.104:0/3804000895 wait complete. 2024-05-08T04:23:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.681+0000 7fbaf2c58640 1 Processor -- start 2024-05-08T04:23:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.681+0000 7fbaf2c58640 1 -- start start 2024-05-08T04:23:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.681+0000 7fbaf2c58640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbad4003f60 0x7fbaec06bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf2c58640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaec06d3f0 0x7fbaec15a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf2c58640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaec0d03f0 0x7fbaec1f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf2c58640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec161320 con 0x7fbaec0d03f0 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf2c58640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec0b5b80 con 0x7fbad4003f60 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf2c58640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec15af20 con 0x7fbaec06d3f0 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf11f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaec0d03f0 0x7fbaec1f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf11f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaec0d03f0 0x7fbaec1f3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37730/0 (socket says 172.21.15.104:37730) 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf11f5640 1 -- 172.21.15.104:0/1304451383 learned_addr learned my addr 172.21.15.104:0/1304451383 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbae3fff640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaec06d3f0 0x7fbaec15a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf09f4640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbad4003f60 0x7fbaec06bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf11f5640 1 -- 172.21.15.104:0/1304451383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaec06d3f0 msgr2=0x7fbaec15a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf11f5640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaec06d3f0 0x7fbaec15a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf11f5640 1 -- 172.21.15.104:0/1304451383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbad4003f60 msgr2=0x7fbaec06bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf11f5640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbad4003f60 0x7fbaec06bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf11f5640 1 -- 172.21.15.104:0/1304451383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec06c350 con 0x7fbaec0d03f0 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf11f5640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaec0d03f0 0x7fbaec1f3f70 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0687d0 tx=0x7fbae40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:08.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbae17fa640 1 -- 172.21.15.104:0/1304451383 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4011e40 con 0x7fbaec0d03f0 2024-05-08T04:23:08.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbae17fa640 1 -- 172.21.15.104:0/1304451383 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae401b070 con 0x7fbaec0d03f0 2024-05-08T04:23:08.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf2c58640 1 -- 172.21.15.104:0/1304451383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaec06c630 con 0x7fbaec0d03f0 2024-05-08T04:23:08.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbae17fa640 1 -- 172.21.15.104:0/1304451383 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4003990 con 0x7fbaec0d03f0 2024-05-08T04:23:08.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.682+0000 7fbaf2c58640 1 -- 172.21.15.104:0/1304451383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaec06cbf0 con 0x7fbaec0d03f0 2024-05-08T04:23:08.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.683+0000 7fbaf2c58640 1 -- 172.21.15.104:0/1304451383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaec075010 con 0x7fbaec0d03f0 2024-05-08T04:23:08.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.684+0000 7fbae17fa640 1 -- 172.21.15.104:0/1304451383 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fbae4005d10 con 0x7fbaec0d03f0 2024-05-08T04:23:08.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.684+0000 7fbae17fa640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbad806b6b0 0x7fbad806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.684+0000 7fbaf09f4640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbad806b6b0 0x7fbad806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.684+0000 7fbae17fa640 1 -- 172.21.15.104:0/1304451383 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fbae408ac60 con 0x7fbaec0d03f0 2024-05-08T04:23:08.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.685+0000 7fbaf09f4640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbad806b6b0 0x7fbad806db70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbae80035f0 tx=0x7fbae8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:08.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.688+0000 7fbae17fa640 1 -- 172.21.15.104:0/1304451383 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbae4025020 con 0x7fbaec0d03f0 2024-05-08T04:23:08.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.858+0000 7fbaf2c58640 1 -- 172.21.15.104:0/1304451383 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbaec0b10a0 con 0x7fbaec0d03f0 2024-05-08T04:23:08.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.859+0000 7fbae17fa640 1 -- 172.21.15.104:0/1304451383 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbae4014350 con 0x7fbaec0d03f0 2024-05-08T04:23:08.860 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:23:08.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.861+0000 7fbaf2c58640 1 -- 172.21.15.104:0/1304451383 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbad806b6b0 msgr2=0x7fbad806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.861+0000 7fbaf2c58640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbad806b6b0 0x7fbad806db70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbae80035f0 tx=0x7fbae8009040 comp rx=0 tx=0).stop 2024-05-08T04:23:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.861+0000 7fbaf2c58640 1 -- 172.21.15.104:0/1304451383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaec0d03f0 msgr2=0x7fbaec1f3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.861+0000 7fbaf2c58640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaec0d03f0 0x7fbaec1f3f70 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0687d0 tx=0x7fbae40115a0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.861+0000 7fbaf2c58640 1 -- 172.21.15.104:0/1304451383 shutdown_connections 2024-05-08T04:23:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.861+0000 7fbaf2c58640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbad806b6b0 0x7fbad806db70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.861+0000 7fbaf2c58640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbaec0d03f0 0x7fbaec1f3f70 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.861+0000 7fbaf2c58640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbaec06d3f0 0x7fbaec15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.861+0000 7fbaf2c58640 1 --2- 172.21.15.104:0/1304451383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbad4003f60 0x7fbaec06bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.861+0000 7fbaf2c58640 1 -- 172.21.15.104:0/1304451383 >> 172.21.15.104:0/1304451383 conn(0x7fbaec0b3450 msgr2=0x7fbaec161fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.861+0000 7fbaf2c58640 1 -- 172.21.15.104:0/1304451383 shutdown_connections 2024-05-08T04:23:08.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.861+0000 7fbaf2c58640 1 -- 172.21.15.104:0/1304451383 wait complete. 2024-05-08T04:23:08.873 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:23:08.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.975+0000 7f69b997e640 1 Processor -- start 2024-05-08T04:23:08.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.975+0000 7f69b997e640 1 -- start start 2024-05-08T04:23:08.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b997e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f69b415de10 0x7f69b4161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b997e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f69b40ce5a0 0x7f69b40d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b997e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b40d05f0 0x7f69b40b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b997e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b40d0f50 con 0x7f69b415de10 2024-05-08T04:23:08.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b997e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b4161e60 con 0x7f69b40ce5a0 2024-05-08T04:23:08.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b997e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b40d1a90 con 0x7f69b40d05f0 2024-05-08T04:23:08.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b2ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f69b415de10 0x7f69b4161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b2ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f69b415de10 0x7f69b4161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37748/0 (socket says 172.21.15.104:37748) 2024-05-08T04:23:08.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b2ffd640 1 -- 172.21.15.104:0/3032286470 learned_addr learned my addr 172.21.15.104:0/3032286470 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:08.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b2ffd640 1 -- 172.21.15.104:0/3032286470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b40d05f0 msgr2=0x7f69b40b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:08.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b37fe640 1 --2- 172.21.15.104:0/3032286470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b40d05f0 0x7f69b40b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69aa7fc640 1 --2- 172.21.15.104:0/3032286470 >> v2:172.21.15.183:3300/0 conn(0x7f69b40ce5a0 0x7f69b40d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b2ffd640 1 --2- 172.21.15.104:0/3032286470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b40d05f0 0x7f69b40b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b2ffd640 1 -- 172.21.15.104:0/3032286470 >> v2:172.21.15.183:3300/0 conn(0x7f69b40ce5a0 msgr2=0x7f69b40d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:08.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b2ffd640 1 --2- 172.21.15.104:0/3032286470 >> v2:172.21.15.183:3300/0 conn(0x7f69b40ce5a0 0x7f69b40d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.976+0000 7f69b2ffd640 1 -- 172.21.15.104:0/3032286470 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b415e1f0 con 0x7f69b415de10 2024-05-08T04:23:08.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.977+0000 7f69b2ffd640 1 --2- 172.21.15.104:0/3032286470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69b415de10 0x7f69b4161920 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f69b40c7520 tx=0x7f69a402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61760b2193fd16c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:08.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.977+0000 7f69b27fc640 1 -- 172.21.15.104:0/3032286470 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a4037070 con 0x7f69b415de10 2024-05-08T04:23:08.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.977+0000 7f69b27fc640 1 -- 172.21.15.104:0/3032286470 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a4032440 con 0x7f69b415de10 2024-05-08T04:23:08.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.977+0000 7f69b27fc640 1 -- 172.21.15.104:0/3032286470 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a4032810 con 0x7f69b415de10 2024-05-08T04:23:08.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.978+0000 7f69b997e640 1 -- 172.21.15.104:0/3032286470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69b415de10 msgr2=0x7f69b4161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.978+0000 7f69b997e640 1 --2- 172.21.15.104:0/3032286470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69b415de10 0x7f69b4161920 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f69b40c7520 tx=0x7f69a402a140 comp rx=0 tx=0).stop 2024-05-08T04:23:08.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.978+0000 7f69b997e640 1 -- 172.21.15.104:0/3032286470 shutdown_connections 2024-05-08T04:23:08.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.978+0000 7f69b997e640 1 --2- 172.21.15.104:0/3032286470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b40d05f0 0x7f69b40b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.978+0000 7f69b997e640 1 --2- 172.21.15.104:0/3032286470 >> v2:172.21.15.183:3300/0 conn(0x7f69b40ce5a0 0x7f69b40d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.978+0000 7f69b997e640 1 --2- 172.21.15.104:0/3032286470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69b415de10 0x7f69b4161920 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.978+0000 7f69b997e640 1 -- 172.21.15.104:0/3032286470 >> 172.21.15.104:0/3032286470 conn(0x7f69b4072290 msgr2=0x7f69b4072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:08.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.978+0000 7f69b997e640 1 -- 172.21.15.104:0/3032286470 shutdown_connections 2024-05-08T04:23:08.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.978+0000 7f69b997e640 1 -- 172.21.15.104:0/3032286470 wait complete. 2024-05-08T04:23:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.979+0000 7f69b997e640 1 Processor -- start 2024-05-08T04:23:08.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.979+0000 7f69b997e640 1 -- start start 2024-05-08T04:23:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b997e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69b40ce5a0 0x7f69b40c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b997e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b40d05f0 0x7f69b40b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b997e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69b415de10 0x7f69b40b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b997e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b4162370 con 0x7f69b415de10 2024-05-08T04:23:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b997e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b4162090 con 0x7f69b40ce5a0 2024-05-08T04:23:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b997e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b4162650 con 0x7f69b40d05f0 2024-05-08T04:23:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69b415de10 0x7f69b40b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69b415de10 0x7f69b40b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37762/0 (socket says 172.21.15.104:37762) 2024-05-08T04:23:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b37fe640 1 -- 172.21.15.104:0/1444590736 learned_addr learned my addr 172.21.15.104:0/1444590736 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b2ffd640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69b40ce5a0 0x7f69b40c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69aa7fc640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b40d05f0 0x7f69b40b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b37fe640 1 -- 172.21.15.104:0/1444590736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b40d05f0 msgr2=0x7f69b40b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b37fe640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b40d05f0 0x7f69b40b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b37fe640 1 -- 172.21.15.104:0/1444590736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69b40ce5a0 msgr2=0x7f69b40c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:08.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b37fe640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69b40ce5a0 0x7f69b40c9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:08.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b37fe640 1 -- 172.21.15.104:0/1444590736 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b40c9690 con 0x7f69b415de10 2024-05-08T04:23:08.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.980+0000 7f69b37fe640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69b415de10 0x7f69b40b4ff0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00cda0 tx=0x7f69ac00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:08.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.981+0000 7f69b0ff9640 1 -- 172.21.15.104:0/1444590736 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac003b90 con 0x7f69b415de10 2024-05-08T04:23:08.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.981+0000 7f69b0ff9640 1 -- 172.21.15.104:0/1444590736 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac003d30 con 0x7f69b415de10 2024-05-08T04:23:08.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.981+0000 7f69b997e640 1 -- 172.21.15.104:0/1444590736 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b4144940 con 0x7f69b415de10 2024-05-08T04:23:08.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.981+0000 7f69b0ff9640 1 -- 172.21.15.104:0/1444590736 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac004240 con 0x7f69b415de10 2024-05-08T04:23:08.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.981+0000 7f69b997e640 1 -- 172.21.15.104:0/1444590736 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b4144f00 con 0x7f69b415de10 2024-05-08T04:23:08.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.982+0000 7f69b997e640 1 -- 172.21.15.104:0/1444590736 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b4075010 con 0x7f69b415de10 2024-05-08T04:23:08.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.982+0000 7f69b0ff9640 1 -- 172.21.15.104:0/1444590736 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f69ac0043e0 con 0x7f69b415de10 2024-05-08T04:23:08.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.983+0000 7f69b0ff9640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f699406b6b0 0x7f699406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:08.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.983+0000 7f69b0ff9640 1 -- 172.21.15.104:0/1444590736 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f69ac08b0d0 con 0x7f69b415de10 2024-05-08T04:23:08.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.983+0000 7f69b2ffd640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f699406b6b0 0x7f699406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:08.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.983+0000 7f69b2ffd640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f699406b6b0 0x7f699406db70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f69a4034000 tx=0x7f69a402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:08.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:08.987+0000 7f69b0ff9640 1 -- 172.21.15.104:0/1444590736 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f69b40c9690 con 0x7f69b415de10 2024-05-08T04:23:09.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.159+0000 7f69b997e640 1 -- 172.21.15.104:0/1444590736 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69b40d1870 con 0x7f69b415de10 2024-05-08T04:23:09.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.160+0000 7f69b0ff9640 1 -- 172.21.15.104:0/1444590736 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69ac059450 con 0x7f69b415de10 2024-05-08T04:23:09.161 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:23:09.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.162+0000 7f69b997e640 1 -- 172.21.15.104:0/1444590736 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f699406b6b0 msgr2=0x7f699406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.162+0000 7f69b997e640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f699406b6b0 0x7f699406db70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f69a4034000 tx=0x7f69a402e000 comp rx=0 tx=0).stop 2024-05-08T04:23:09.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.162+0000 7f69b997e640 1 -- 172.21.15.104:0/1444590736 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69b415de10 msgr2=0x7f69b40b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.162+0000 7f69b997e640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69b415de10 0x7f69b40b4ff0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00cda0 tx=0x7f69ac00a660 comp rx=0 tx=0).stop 2024-05-08T04:23:09.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.162+0000 7f69b997e640 1 -- 172.21.15.104:0/1444590736 shutdown_connections 2024-05-08T04:23:09.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.162+0000 7f69b997e640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f699406b6b0 0x7f699406db70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.162+0000 7f69b997e640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69b415de10 0x7f69b40b4ff0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.162+0000 7f69b997e640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69b40d05f0 0x7f69b40b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.162+0000 7f69b997e640 1 --2- 172.21.15.104:0/1444590736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69b40ce5a0 0x7f69b40c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.162+0000 7f69b997e640 1 -- 172.21.15.104:0/1444590736 >> 172.21.15.104:0/1444590736 conn(0x7f69b4072290 msgr2=0x7f69b40d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:09.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.162+0000 7f69b997e640 1 -- 172.21.15.104:0/1444590736 shutdown_connections 2024-05-08T04:23:09.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.162+0000 7f69b997e640 1 -- 172.21.15.104:0/1444590736 wait complete. 2024-05-08T04:23:09.174 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:23:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.272+0000 7f438e08f640 1 Processor -- start 2024-05-08T04:23:09.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.272+0000 7f438e08f640 1 -- start start 2024-05-08T04:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f438e08f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4388159ec0 0x7f438806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f438e08f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f438815a2a0 0x7f438815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f438e08f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438815dce0 con 0x7f438815e780 2024-05-08T04:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f438e08f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438806eb60 con 0x7f438815a2a0 2024-05-08T04:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f438e08f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438806ee40 con 0x7f4388159ec0 2024-05-08T04:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f4386ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f438815a2a0 0x7f438815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f4386ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f438815a2a0 0x7f438815b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37766/0 (socket says 172.21.15.104:37766) 2024-05-08T04:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f4386ffd640 1 -- 172.21.15.104:0/522231022 learned_addr learned my addr 172.21.15.104:0/522231022 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f4386ffd640 1 -- 172.21.15.104:0/522231022 >> v2:172.21.15.183:3300/0 conn(0x7f4388159ec0 msgr2=0x7f438806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:09.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f43877fe640 1 --2- 172.21.15.104:0/522231022 >> v2:172.21.15.183:3300/0 conn(0x7f4388159ec0 0x7f438806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f4386ffd640 1 --2- 172.21.15.104:0/522231022 >> v2:172.21.15.183:3300/0 conn(0x7f4388159ec0 0x7f438806e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f4386ffd640 1 -- 172.21.15.104:0/522231022 >> v1:172.21.15.183:6789/0 conn(0x7f438815e780 legacy=0x7f4388071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f4386ffd640 1 -- 172.21.15.104:0/522231022 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438815df80 con 0x7f438815a2a0 2024-05-08T04:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.273+0000 7f43877fe640 1 --2- 172.21.15.104:0/522231022 >> v2:172.21.15.183:3300/0 conn(0x7f4388159ec0 0x7f438806e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.274+0000 7f4386ffd640 1 --2- 172.21.15.104:0/522231022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f438815a2a0 0x7f438815b1e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f438806c130 tx=0x7f437c02c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e241ce8893b9472d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.274+0000 7f43867fc640 1 -- 172.21.15.104:0/522231022 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c0325a0 con 0x7f438815a2a0 2024-05-08T04:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.274+0000 7f43867fc640 1 -- 172.21.15.104:0/522231022 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c038070 con 0x7f438815a2a0 2024-05-08T04:23:09.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.274+0000 7f43867fc640 1 -- 172.21.15.104:0/522231022 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c032960 con 0x7f438815a2a0 2024-05-08T04:23:09.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.274+0000 7f438e08f640 1 -- 172.21.15.104:0/522231022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f438815a2a0 msgr2=0x7f438815b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.274+0000 7f438e08f640 1 --2- 172.21.15.104:0/522231022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f438815a2a0 0x7f438815b1e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f438806c130 tx=0x7f437c02c8e0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.275+0000 7f438e08f640 1 -- 172.21.15.104:0/522231022 shutdown_connections 2024-05-08T04:23:09.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.275+0000 7f438e08f640 1 --2- 172.21.15.104:0/522231022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f438815a2a0 0x7f438815b1e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.275+0000 7f438e08f640 1 --2- 172.21.15.104:0/522231022 >> v2:172.21.15.183:3300/0 conn(0x7f4388159ec0 0x7f438806e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.275+0000 7f438e08f640 1 -- 172.21.15.104:0/522231022 >> 172.21.15.104:0/522231022 conn(0x7f43880b13f0 msgr2=0x7f43880b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.275+0000 7f438e08f640 1 -- 172.21.15.104:0/522231022 shutdown_connections 2024-05-08T04:23:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.275+0000 7f438e08f640 1 -- 172.21.15.104:0/522231022 wait complete. 2024-05-08T04:23:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.276+0000 7f438e08f640 1 Processor -- start 2024-05-08T04:23:09.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.276+0000 7f438e08f640 1 -- start start 2024-05-08T04:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f438e08f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4388159ec0 0x7f4388153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f438e08f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f438815a2a0 0x7f43881ef290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f438e08f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438815e780 0x7f4388158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f438e08f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4388072160 con 0x7f438815a2a0 2024-05-08T04:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f438e08f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438815ebf0 con 0x7f4388159ec0 2024-05-08T04:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f438e08f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43880722e0 con 0x7f438815e780 2024-05-08T04:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f4386ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f438815a2a0 0x7f43881ef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f4386ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f438815a2a0 0x7f43881ef290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37776/0 (socket says 172.21.15.104:37776) 2024-05-08T04:23:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f4386ffd640 1 -- 172.21.15.104:0/2891939427 learned_addr learned my addr 172.21.15.104:0/2891939427 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f43877fe640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4388159ec0 0x7f4388153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f4386ffd640 1 -- 172.21.15.104:0/2891939427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438815e780 msgr2=0x7f4388158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f4387fff640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438815e780 0x7f4388158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f4386ffd640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438815e780 0x7f4388158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f4386ffd640 1 -- 172.21.15.104:0/2891939427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4388159ec0 msgr2=0x7f4388153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f4386ffd640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4388159ec0 0x7f4388153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f4386ffd640 1 -- 172.21.15.104:0/2891939427 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4388155890 con 0x7f438815a2a0 2024-05-08T04:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f43877fe640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4388159ec0 0x7f4388153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f4386ffd640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f438815a2a0 0x7f43881ef290 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f437c00b2c0 tx=0x7f437c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.277+0000 7f436ffff640 1 -- 172.21.15.104:0/2891939427 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c033840 con 0x7f438815a2a0 2024-05-08T04:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.278+0000 7f436ffff640 1 -- 172.21.15.104:0/2891939427 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c033a00 con 0x7f438815a2a0 2024-05-08T04:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.278+0000 7f438e08f640 1 -- 172.21.15.104:0/2891939427 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4388158e40 con 0x7f438815a2a0 2024-05-08T04:23:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.278+0000 7f436ffff640 1 -- 172.21.15.104:0/2891939427 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c033df0 con 0x7f438815a2a0 2024-05-08T04:23:09.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.278+0000 7f438e08f640 1 -- 172.21.15.104:0/2891939427 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4388155b30 con 0x7f438815a2a0 2024-05-08T04:23:09.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.278+0000 7f438e08f640 1 -- 172.21.15.104:0/2891939427 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4388075010 con 0x7f438815a2a0 2024-05-08T04:23:09.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.279+0000 7f436ffff640 1 -- 172.21.15.104:0/2891939427 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f437c04d020 con 0x7f438815a2a0 2024-05-08T04:23:09.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.279+0000 7f436ffff640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f437406b6b0 0x7f437406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.280+0000 7f436ffff640 1 -- 172.21.15.104:0/2891939427 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f437c030020 con 0x7f438815a2a0 2024-05-08T04:23:09.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.280+0000 7f43877fe640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f437406b6b0 0x7f437406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.280+0000 7f43877fe640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f437406b6b0 0x7f437406db70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4378006fd0 tx=0x7f4378008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:09.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.284+0000 7f436ffff640 1 -- 172.21.15.104:0/2891939427 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f437c041070 con 0x7f438815a2a0 2024-05-08T04:23:09.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.465+0000 7f438e08f640 1 -- 172.21.15.104:0/2891939427 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4388159360 con 0x7f438815a2a0 2024-05-08T04:23:09.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.466+0000 7f436ffff640 1 -- 172.21.15.104:0/2891939427 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f437c07c0d0 con 0x7f438815a2a0 2024-05-08T04:23:09.468 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:23:09.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.468+0000 7f438e08f640 1 -- 172.21.15.104:0/2891939427 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f437406b6b0 msgr2=0x7f437406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.468+0000 7f438e08f640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f437406b6b0 0x7f437406db70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4378006fd0 tx=0x7f4378008040 comp rx=0 tx=0).stop 2024-05-08T04:23:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.468+0000 7f438e08f640 1 -- 172.21.15.104:0/2891939427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f438815a2a0 msgr2=0x7f43881ef290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.468+0000 7f438e08f640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f438815a2a0 0x7f43881ef290 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f437c00b2c0 tx=0x7f437c0046c0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.468+0000 7f438e08f640 1 -- 172.21.15.104:0/2891939427 shutdown_connections 2024-05-08T04:23:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.468+0000 7f438e08f640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f437406b6b0 0x7f437406db70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.468+0000 7f438e08f640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f438815e780 0x7f4388158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.468+0000 7f438e08f640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f438815a2a0 0x7f43881ef290 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.468+0000 7f438e08f640 1 --2- 172.21.15.104:0/2891939427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4388159ec0 0x7f4388153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.468+0000 7f438e08f640 1 -- 172.21.15.104:0/2891939427 >> 172.21.15.104:0/2891939427 conn(0x7f43880b13f0 msgr2=0x7f438814ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.468+0000 7f438e08f640 1 -- 172.21.15.104:0/2891939427 shutdown_connections 2024-05-08T04:23:09.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.468+0000 7f438e08f640 1 -- 172.21.15.104:0/2891939427 wait complete. 2024-05-08T04:23:09.481 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:23:09.481 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:23:09.501 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:23:09.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.597+0000 7fdf65df5640 1 Processor -- start 2024-05-08T04:23:09.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.597+0000 7fdf65df5640 1 -- start start 2024-05-08T04:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.598+0000 7fdf65df5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdf6015de50 0x7fdf600cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.598+0000 7fdf65df5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdf600b4810 0x7fdf600cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.598+0000 7fdf65df5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf600af890 con 0x7fdf600b4d60 2024-05-08T04:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.598+0000 7fdf65df5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6015e230 con 0x7fdf6015de50 2024-05-08T04:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.598+0000 7fdf65df5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6006e9a0 con 0x7fdf600b4810 2024-05-08T04:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.598+0000 7fdf5f7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdf6015de50 0x7fdf600cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.598+0000 7fdf5f7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdf6015de50 0x7fdf600cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37788/0 (socket says 172.21.15.104:37788) 2024-05-08T04:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.598+0000 7fdf5f7fe640 1 -- 172.21.15.104:0/2853462494 learned_addr learned my addr 172.21.15.104:0/2853462494 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.598+0000 7fdf5effd640 1 --2- 172.21.15.104:0/2853462494 >> v2:172.21.15.183:3300/0 conn(0x7fdf600b4810 0x7fdf600cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.598+0000 7fdf5f7fe640 1 -- 172.21.15.104:0/2853462494 >> v2:172.21.15.183:3300/0 conn(0x7fdf600b4810 msgr2=0x7fdf600cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:09.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.598+0000 7fdf5f7fe640 1 --2- 172.21.15.104:0/2853462494 >> v2:172.21.15.183:3300/0 conn(0x7fdf600b4810 0x7fdf600cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.598+0000 7fdf5f7fe640 1 -- 172.21.15.104:0/2853462494 >> v1:172.21.15.183:6789/0 conn(0x7fdf600b4d60 legacy=0x7fdf600cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:09.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.598+0000 7fdf5f7fe640 1 -- 172.21.15.104:0/2853462494 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6006ec40 con 0x7fdf6015de50 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.599+0000 7fdf5f7fe640 1 --2- 172.21.15.104:0/2853462494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf6015de50 0x7fdf600cef80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdf60071900 tx=0x7fdf5002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499227928e80b9e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.599+0000 7fdf5e7fc640 1 -- 172.21.15.104:0/2853462494 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50037070 con 0x7fdf6015de50 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.599+0000 7fdf5e7fc640 1 -- 172.21.15.104:0/2853462494 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf50032440 con 0x7fdf6015de50 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.599+0000 7fdf5e7fc640 1 -- 172.21.15.104:0/2853462494 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50032810 con 0x7fdf6015de50 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.600+0000 7fdf65df5640 1 -- 172.21.15.104:0/2853462494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf6015de50 msgr2=0x7fdf600cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.600+0000 7fdf65df5640 1 --2- 172.21.15.104:0/2853462494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf6015de50 0x7fdf600cef80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdf60071900 tx=0x7fdf5002a1a0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.600+0000 7fdf65df5640 1 -- 172.21.15.104:0/2853462494 shutdown_connections 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.600+0000 7fdf65df5640 1 --2- 172.21.15.104:0/2853462494 >> v2:172.21.15.183:3300/0 conn(0x7fdf600b4810 0x7fdf600cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.600+0000 7fdf65df5640 1 --2- 172.21.15.104:0/2853462494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf6015de50 0x7fdf600cef80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.600+0000 7fdf65df5640 1 -- 172.21.15.104:0/2853462494 >> 172.21.15.104:0/2853462494 conn(0x7fdf600cc8e0 msgr2=0x7fdf600cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.600+0000 7fdf65df5640 1 -- 172.21.15.104:0/2853462494 shutdown_connections 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.600+0000 7fdf65df5640 1 -- 172.21.15.104:0/2853462494 wait complete. 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.601+0000 7fdf65df5640 1 Processor -- start 2024-05-08T04:23:09.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.602+0000 7fdf65df5640 1 -- start start 2024-05-08T04:23:09.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.602+0000 7fdf65df5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf600b4810 0x7fdf600ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.602+0000 7fdf65df5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf600b4d60 0x7fdf6014b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.602+0000 7fdf65df5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf6015de50 0x7fdf6014b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.602+0000 7fdf65df5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6006f4e0 con 0x7fdf6015de50 2024-05-08T04:23:09.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.602+0000 7fdf65df5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6006f200 con 0x7fdf600b4810 2024-05-08T04:23:09.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.602+0000 7fdf65df5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf600b4100 con 0x7fdf600b4d60 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.602+0000 7fdf5ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf6015de50 0x7fdf6014b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.602+0000 7fdf5ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf6015de50 0x7fdf6014b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37790/0 (socket says 172.21.15.104:37790) 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.602+0000 7fdf5ffff640 1 -- 172.21.15.104:0/4044779234 learned_addr learned my addr 172.21.15.104:0/4044779234 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf5f7fe640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf600b4810 0x7fdf600ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf5effd640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf600b4d60 0x7fdf6014b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf5ffff640 1 -- 172.21.15.104:0/4044779234 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf600b4d60 msgr2=0x7fdf6014b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf5ffff640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf600b4d60 0x7fdf6014b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf5ffff640 1 -- 172.21.15.104:0/4044779234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf600b4810 msgr2=0x7fdf600ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf5ffff640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf600b4810 0x7fdf600ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf5ffff640 1 -- 172.21.15.104:0/4044779234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf60155920 con 0x7fdf6015de50 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf5effd640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf600b4d60 0x7fdf6014b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf5ffff640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf6015de50 0x7fdf6014b9d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800c410 tx=0x7fdf5800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf47fff640 1 -- 172.21.15.104:0/4044779234 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58011790 con 0x7fdf6015de50 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf47fff640 1 -- 172.21.15.104:0/4044779234 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf58017070 con 0x7fdf6015de50 2024-05-08T04:23:09.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf65df5640 1 -- 172.21.15.104:0/4044779234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf60155360 con 0x7fdf6015de50 2024-05-08T04:23:09.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf47fff640 1 -- 172.21.15.104:0/4044779234 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58011bb0 con 0x7fdf6015de50 2024-05-08T04:23:09.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.603+0000 7fdf65df5640 1 -- 172.21.15.104:0/4044779234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf600b1360 con 0x7fdf6015de50 2024-05-08T04:23:09.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.604+0000 7fdf65df5640 1 -- 172.21.15.104:0/4044779234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf60075010 con 0x7fdf6015de50 2024-05-08T04:23:09.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.604+0000 7fdf47fff640 1 -- 172.21.15.104:0/4044779234 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fdf5801c460 con 0x7fdf6015de50 2024-05-08T04:23:09.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.605+0000 7fdf47fff640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdf4c06b680 0x7fdf4c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.605+0000 7fdf47fff640 1 -- 172.21.15.104:0/4044779234 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fdf5808a060 con 0x7fdf6015de50 2024-05-08T04:23:09.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.605+0000 7fdf5f7fe640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdf4c06b680 0x7fdf4c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.605+0000 7fdf5f7fe640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdf4c06b680 0x7fdf4c06db40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdf50034000 tx=0x7fdf5002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:09.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.609+0000 7fdf47fff640 1 -- 172.21.15.104:0/4044779234 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdf58021020 con 0x7fdf6015de50 2024-05-08T04:23:09.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.780+0000 7fdf65df5640 1 -- 172.21.15.104:0/4044779234 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf600af1d0 con 0x7fdf6015de50 2024-05-08T04:23:09.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.781+0000 7fdf47fff640 1 -- 172.21.15.104:0/4044779234 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16961 (secure 0 0 0) 0x7fdf58058c60 con 0x7fdf6015de50 2024-05-08T04:23:09.784 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:09.784 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":47,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:52.009332+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:42.524824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:43.279621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.39","mappings":[{"from":5,"to":7}]},{"pgid":"7.3c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:23:09.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.783+0000 7fdf65df5640 1 -- 172.21.15.104:0/4044779234 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdf4c06b680 msgr2=0x7fdf4c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.783+0000 7fdf65df5640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdf4c06b680 0x7fdf4c06db40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdf50034000 tx=0x7fdf5002e000 comp rx=0 tx=0).stop 2024-05-08T04:23:09.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.783+0000 7fdf65df5640 1 -- 172.21.15.104:0/4044779234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf6015de50 msgr2=0x7fdf6014b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.783+0000 7fdf65df5640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf6015de50 0x7fdf6014b9d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800c410 tx=0x7fdf5800c8d0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.783+0000 7fdf65df5640 1 -- 172.21.15.104:0/4044779234 shutdown_connections 2024-05-08T04:23:09.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.783+0000 7fdf65df5640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdf4c06b680 0x7fdf4c06db40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.783+0000 7fdf65df5640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf6015de50 0x7fdf6014b9d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.783+0000 7fdf65df5640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf600b4d60 0x7fdf6014b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.783+0000 7fdf65df5640 1 --2- 172.21.15.104:0/4044779234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf600b4810 0x7fdf600ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.783+0000 7fdf65df5640 1 -- 172.21.15.104:0/4044779234 >> 172.21.15.104:0/4044779234 conn(0x7fdf600cc8e0 msgr2=0x7fdf600afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.784+0000 7fdf65df5640 1 -- 172.21.15.104:0/4044779234 shutdown_connections 2024-05-08T04:23:09.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.784+0000 7fdf65df5640 1 -- 172.21.15.104:0/4044779234 wait complete. 2024-05-08T04:23:09.797 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:22:42.524824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:22:43.279621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:23:09.797 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:23:09.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.897+0000 7f100935c640 1 Processor -- start 2024-05-08T04:23:09.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.897+0000 7f100935c640 1 -- start start 2024-05-08T04:23:09.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.898+0000 7f100935c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f10040cfa40 0x7f10040cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.898+0000 7f100935c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10040cd7a0 con 0x7f10040cb3e0 2024-05-08T04:23:09.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.898+0000 7f100935c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10040cda80 con 0x7f100415de20 2024-05-08T04:23:09.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.898+0000 7f100935c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10040caf50 con 0x7f10040cfa40 2024-05-08T04:23:09.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.898+0000 7f10037fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f10040cb3e0 0x7f10040cb7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:57314/0 (socket says 172.21.15.104:57314) 2024-05-08T04:23:09.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.898+0000 7f10037fe640 1 -- 172.21.15.104:0/2826219819 learned_addr learned my addr 172.21.15.104:0/2826219819 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:09.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.898+0000 7f10027fc640 1 --2- 172.21.15.104:0/2826219819 >> v2:172.21.15.183:3300/0 conn(0x7f10040cfa40 0x7f10040cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.898+0000 7f1001ffb640 1 -- 172.21.15.104:0/2826219819 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029946270 0 0) 0x7f10040cd7a0 con 0x7f10040cb3e0 2024-05-08T04:23:09.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.899+0000 7f1001ffb640 1 -- 172.21.15.104:0/2826219819 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fec003520 con 0x7f10040cb3e0 2024-05-08T04:23:09.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.899+0000 7f10027fc640 1 -- 172.21.15.104:0/2826219819 >> v1:172.21.15.183:6789/0 conn(0x7f100415de20 legacy=0x7f10040b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.899+0000 7f10027fc640 1 -- 172.21.15.104:0/2826219819 >> v1:172.21.15.104:6789/0 conn(0x7f10040cb3e0 legacy=0x7f10040cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.899+0000 7f10027fc640 1 -- 172.21.15.104:0/2826219819 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10040cdd60 con 0x7f10040cfa40 2024-05-08T04:23:09.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.899+0000 7f10027fc640 1 --2- 172.21.15.104:0/2826219819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10040cfa40 0x7f10040cfed0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80097a0 tx=0x7f0ff802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b624c8f9797dd4f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:09.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.900+0000 7f1001ffb640 1 -- 172.21.15.104:0/2826219819 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8037070 con 0x7f10040cfa40 2024-05-08T04:23:09.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.900+0000 7f1001ffb640 1 -- 172.21.15.104:0/2826219819 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff8032440 con 0x7f10040cfa40 2024-05-08T04:23:09.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.900+0000 7f1001ffb640 1 -- 172.21.15.104:0/2826219819 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80327f0 con 0x7f10040cfa40 2024-05-08T04:23:09.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.900+0000 7f100935c640 1 -- 172.21.15.104:0/2826219819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10040cfa40 msgr2=0x7f10040cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.900+0000 7f100935c640 1 --2- 172.21.15.104:0/2826219819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10040cfa40 0x7f10040cfed0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80097a0 tx=0x7f0ff802a230 comp rx=0 tx=0).stop 2024-05-08T04:23:09.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.900+0000 7f100935c640 1 -- 172.21.15.104:0/2826219819 shutdown_connections 2024-05-08T04:23:09.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.900+0000 7f100935c640 1 --2- 172.21.15.104:0/2826219819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10040cfa40 0x7f10040cfed0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.900+0000 7f100935c640 1 -- 172.21.15.104:0/2826219819 >> 172.21.15.104:0/2826219819 conn(0x7f10040b2220 msgr2=0x7f10040b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:09.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.900+0000 7f100935c640 1 -- 172.21.15.104:0/2826219819 shutdown_connections 2024-05-08T04:23:09.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.900+0000 7f100935c640 1 -- 172.21.15.104:0/2826219819 wait complete. 2024-05-08T04:23:09.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.901+0000 7f100935c640 1 Processor -- start 2024-05-08T04:23:09.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.902+0000 7f100935c640 1 -- start start 2024-05-08T04:23:09.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.902+0000 7f100935c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10040cb3e0 0x7f10040c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.902+0000 7f100935c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10040cfa40 0x7f10040ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.902+0000 7f100935c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f100415de20 0x7f10041519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.902+0000 7f100935c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040b1f20 con 0x7f100415de20 2024-05-08T04:23:09.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.902+0000 7f100935c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040cd450 con 0x7f10040cb3e0 2024-05-08T04:23:09.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.902+0000 7f100935c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100415e200 con 0x7f10040cfa40 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.902+0000 7f10037fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f100415de20 0x7f10041519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.902+0000 7f10037fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f100415de20 0x7f10041519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37800/0 (socket says 172.21.15.104:37800) 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.902+0000 7f10037fe640 1 -- 172.21.15.104:0/4095384902 learned_addr learned my addr 172.21.15.104:0/4095384902 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f10027fc640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10040cfa40 0x7f10040ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f1002ffd640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10040cb3e0 0x7f10040c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f10037fe640 1 -- 172.21.15.104:0/4095384902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10040cfa40 msgr2=0x7f10040ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f10037fe640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10040cfa40 0x7f10040ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f10037fe640 1 -- 172.21.15.104:0/4095384902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10040cb3e0 msgr2=0x7f10040c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f10037fe640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10040cb3e0 0x7f10040c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f10037fe640 1 -- 172.21.15.104:0/4095384902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10040afd20 con 0x7f100415de20 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f10027fc640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10040cfa40 0x7f10040ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f1002ffd640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10040cb3e0 0x7f10040c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f10037fe640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f100415de20 0x7f10041519a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00cb40 tx=0x7f0ffc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f0feb7fe640 1 -- 172.21.15.104:0/4095384902 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc017070 con 0x7f100415de20 2024-05-08T04:23:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f0feb7fe640 1 -- 172.21.15.104:0/4095384902 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc00aca0 con 0x7f100415de20 2024-05-08T04:23:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f100935c640 1 -- 172.21.15.104:0/4095384902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10040b0000 con 0x7f100415de20 2024-05-08T04:23:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f0feb7fe640 1 -- 172.21.15.104:0/4095384902 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc012620 con 0x7f100415de20 2024-05-08T04:23:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.903+0000 7f100935c640 1 -- 172.21.15.104:0/4095384902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10040adc30 con 0x7f100415de20 2024-05-08T04:23:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.904+0000 7f100935c640 1 -- 172.21.15.104:0/4095384902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1004075010 con 0x7f100415de20 2024-05-08T04:23:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.905+0000 7f0feb7fe640 1 -- 172.21.15.104:0/4095384902 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f0ffc01a070 con 0x7f100415de20 2024-05-08T04:23:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.905+0000 7f0feb7fe640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0ff006b680 0x7f0ff006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.905+0000 7f0feb7fe640 1 -- 172.21.15.104:0/4095384902 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0ffc08a380 con 0x7f100415de20 2024-05-08T04:23:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.905+0000 7f1002ffd640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0ff006b680 0x7f0ff006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.905+0000 7f1002ffd640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0ff006b680 0x7f0ff006db40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40015e0 tx=0x7f0ff4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:09.909+0000 7f0feb7fe640 1 -- 172.21.15.104:0/4095384902 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ffc058f80 con 0x7f100415de20 2024-05-08T04:23:10.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.083+0000 7f100935c640 1 -- 172.21.15.104:0/4095384902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f100415e500 con 0x7f100415de20 2024-05-08T04:23:10.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.083+0000 7f0feb7fe640 1 -- 172.21.15.104:0/4095384902 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ffc058880 con 0x7f100415de20 2024-05-08T04:23:10.085 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:23:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.085+0000 7f100935c640 1 -- 172.21.15.104:0/4095384902 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0ff006b680 msgr2=0x7f0ff006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.085+0000 7f100935c640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0ff006b680 0x7f0ff006db40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40015e0 tx=0x7f0ff4009040 comp rx=0 tx=0).stop 2024-05-08T04:23:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.085+0000 7f100935c640 1 -- 172.21.15.104:0/4095384902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f100415de20 msgr2=0x7f10041519a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.085+0000 7f100935c640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f100415de20 0x7f10041519a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00cb40 tx=0x7f0ffc00a060 comp rx=0 tx=0).stop 2024-05-08T04:23:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.085+0000 7f100935c640 1 -- 172.21.15.104:0/4095384902 shutdown_connections 2024-05-08T04:23:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.085+0000 7f100935c640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0ff006b680 0x7f0ff006db40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.085+0000 7f100935c640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f100415de20 0x7f10041519a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.085+0000 7f100935c640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10040cfa40 0x7f10040ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.085+0000 7f100935c640 1 --2- 172.21.15.104:0/4095384902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10040cb3e0 0x7f10040c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.085+0000 7f100935c640 1 -- 172.21.15.104:0/4095384902 >> 172.21.15.104:0/4095384902 conn(0x7f10040b2220 msgr2=0x7f100406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.085+0000 7f100935c640 1 -- 172.21.15.104:0/4095384902 shutdown_connections 2024-05-08T04:23:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.085+0000 7f100935c640 1 -- 172.21.15.104:0/4095384902 wait complete. 2024-05-08T04:23:10.099 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:23:10.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.198+0000 7f2f96638640 1 Processor -- start 2024-05-08T04:23:10.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.198+0000 7f2f96638640 1 -- start start 2024-05-08T04:23:10.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f96638640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2f9015edf0 0x7f2f900b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f96638640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f90157ac0 0x7f2f90157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f96638640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f900d15c0 con 0x7f2f90070c70 2024-05-08T04:23:10.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f96638640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9006bc70 con 0x7f2f9015edf0 2024-05-08T04:23:10.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f96638640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9015f550 con 0x7f2f90157ac0 2024-05-08T04:23:10.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f8ffff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f2f90070c70 0x7f2f90071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:57320/0 (socket says 172.21.15.104:57320) 2024-05-08T04:23:10.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f8ffff640 1 -- 172.21.15.104:0/1589294814 learned_addr learned my addr 172.21.15.104:0/1589294814 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:10.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f94bd5640 1 --2- 172.21.15.104:0/1589294814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f90157ac0 0x7f2f90157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f8f7fe640 1 --2- 172.21.15.104:0/1589294814 >> v2:172.21.15.183:3300/0 conn(0x7f2f9015edf0 0x7f2f900b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045679693 0 0) 0x7f2f900d15c0 con 0x7f2f90070c70 2024-05-08T04:23:10.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f78003520 con 0x7f2f90070c70 2024-05-08T04:23:10.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3911953053 0 0) 0x7f2f78003520 con 0x7f2f90070c70 2024-05-08T04:23:10.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f90157ac0 msgr2=0x7f2f90157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:10.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f8effd640 1 --2- 172.21.15.104:0/1589294814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f90157ac0 0x7f2f90157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 >> v2:172.21.15.183:3300/0 conn(0x7f2f9015edf0 msgr2=0x7f2f900b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:10.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f8effd640 1 --2- 172.21.15.104:0/1589294814 >> v2:172.21.15.183:3300/0 conn(0x7f2f9015edf0 0x7f2f900b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9015f830 con 0x7f2f90070c70 2024-05-08T04:23:10.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f2f80001670 con 0x7f2f90070c70 2024-05-08T04:23:10.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.199+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 >> v1:172.21.15.104:6789/0 conn(0x7f2f90070c70 legacy=0x7f2f90071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f8effd640 1 --2- 172.21.15.104:0/1589294814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f780039b0 0x7f2f78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f8effd640 1 --2- 172.21.15.104:0/1589294814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f90157ac0 0x7f2f78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f8effd640 1 --2- 172.21.15.104:0/1589294814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f78004d40 0x7f2f780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9015f550 con 0x7f2f780039b0 2024-05-08T04:23:10.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7800b9c0 con 0x7f2f78004d40 2024-05-08T04:23:10.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7800bb40 con 0x7f2f90157ac0 2024-05-08T04:23:10.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f8ffff640 1 --2- 172.21.15.104:0/1589294814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f780039b0 0x7f2f78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f8f7fe640 1 --2- 172.21.15.104:0/1589294814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f90157ac0 0x7f2f78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f94bd5640 1 --2- 172.21.15.104:0/1589294814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f78004d40 0x7f2f780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f8ffff640 1 -- 172.21.15.104:0/1589294814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f90157ac0 msgr2=0x7f2f78004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f8ffff640 1 --2- 172.21.15.104:0/1589294814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f90157ac0 0x7f2f78004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f8ffff640 1 -- 172.21.15.104:0/1589294814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f78004d40 msgr2=0x7f2f780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f8ffff640 1 --2- 172.21.15.104:0/1589294814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f78004d40 0x7f2f780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.200+0000 7f2f8ffff640 1 -- 172.21.15.104:0/1589294814 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f78003520 con 0x7f2f780039b0 2024-05-08T04:23:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.201+0000 7f2f8ffff640 1 --2- 172.21.15.104:0/1589294814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f780039b0 0x7f2f78003dd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2f80001050 tx=0x7f2f78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8673e7142cc29ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.201+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8002e070 con 0x7f2f780039b0 2024-05-08T04:23:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.201+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f80005af0 con 0x7f2f780039b0 2024-05-08T04:23:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.201+0000 7f2f8effd640 1 -- 172.21.15.104:0/1589294814 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80007d70 con 0x7f2f780039b0 2024-05-08T04:23:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.201+0000 7f2f96638640 1 -- 172.21.15.104:0/1589294814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f780039b0 msgr2=0x7f2f78003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.201+0000 7f2f96638640 1 --2- 172.21.15.104:0/1589294814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f780039b0 0x7f2f78003dd0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2f80001050 tx=0x7f2f78005830 comp rx=0 tx=0).stop 2024-05-08T04:23:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.201+0000 7f2f94bd5640 1 -- 172.21.15.104:0/1589294814 reap_dead start 2024-05-08T04:23:10.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.201+0000 7f2f96638640 1 -- 172.21.15.104:0/1589294814 shutdown_connections 2024-05-08T04:23:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.201+0000 7f2f96638640 1 -- 172.21.15.104:0/1589294814 >> 172.21.15.104:0/1589294814 conn(0x7f2f900b3450 msgr2=0x7f2f900b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.201+0000 7f2f96638640 1 -- 172.21.15.104:0/1589294814 shutdown_connections 2024-05-08T04:23:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.201+0000 7f2f96638640 1 -- 172.21.15.104:0/1589294814 wait complete. 2024-05-08T04:23:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.203+0000 7f2f96638640 1 Processor -- start 2024-05-08T04:23:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.203+0000 7f2f96638640 1 -- start start 2024-05-08T04:23:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.203+0000 7f2f96638640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f780039b0 0x7f2f90156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.203+0000 7f2f96638640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f900cc5a0 0x7f2f90161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.203+0000 7f2f96638640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f901618a0 0x7f2f9015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.203+0000 7f2f96638640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900b57e0 con 0x7f2f780039b0 2024-05-08T04:23:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.203+0000 7f2f96638640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900b5b80 con 0x7f2f900cc5a0 2024-05-08T04:23:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.203+0000 7f2f96638640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900b5960 con 0x7f2f901618a0 2024-05-08T04:23:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.203+0000 7f2f8ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f780039b0 0x7f2f90156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f8ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f780039b0 0x7f2f90156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37824/0 (socket says 172.21.15.104:37824) 2024-05-08T04:23:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f8ffff640 1 -- 172.21.15.104:0/3042750028 learned_addr learned my addr 172.21.15.104:0/3042750028 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f8ffff640 1 -- 172.21.15.104:0/3042750028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f901618a0 msgr2=0x7f2f9015aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f8f7fe640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f900cc5a0 0x7f2f90161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f94bd5640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f901618a0 0x7f2f9015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f8ffff640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f901618a0 0x7f2f9015aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f8ffff640 1 -- 172.21.15.104:0/3042750028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f900cc5a0 msgr2=0x7f2f90161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f8ffff640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f900cc5a0 0x7f2f90161360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f8ffff640 1 -- 172.21.15.104:0/3042750028 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f90159630 con 0x7f2f780039b0 2024-05-08T04:23:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f8f7fe640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f900cc5a0 0x7f2f90161360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f8ffff640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f780039b0 0x7f2f90156d20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2f80000c00 tx=0x7f2f80000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f8cff9640 1 -- 172.21.15.104:0/3042750028 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80042070 con 0x7f2f780039b0 2024-05-08T04:23:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f8cff9640 1 -- 172.21.15.104:0/3042750028 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f800074a0 con 0x7f2f780039b0 2024-05-08T04:23:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f96638640 1 -- 172.21.15.104:0/3042750028 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f900cc170 con 0x7f2f780039b0 2024-05-08T04:23:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f8cff9640 1 -- 172.21.15.104:0/3042750028 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80007d50 con 0x7f2f780039b0 2024-05-08T04:23:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.204+0000 7f2f96638640 1 -- 172.21.15.104:0/3042750028 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f90158fe0 con 0x7f2f780039b0 2024-05-08T04:23:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.205+0000 7f2f96638640 1 -- 172.21.15.104:0/3042750028 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f90075010 con 0x7f2f780039b0 2024-05-08T04:23:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.206+0000 7f2f8cff9640 1 -- 172.21.15.104:0/3042750028 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f2f80045070 con 0x7f2f780039b0 2024-05-08T04:23:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.206+0000 7f2f8cff9640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2f7c06b6b0 0x7f2f7c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.206+0000 7f2f8cff9640 1 -- 172.21.15.104:0/3042750028 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f2f800aac70 con 0x7f2f780039b0 2024-05-08T04:23:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.206+0000 7f2f8f7fe640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2f7c06b6b0 0x7f2f7c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.206+0000 7f2f8f7fe640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2f7c06b6b0 0x7f2f7c06db70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2f900b3390 tx=0x7f2f84008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.210+0000 7f2f8cff9640 1 -- 172.21.15.104:0/3042750028 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f900cc170 con 0x7f2f780039b0 2024-05-08T04:23:10.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.378+0000 7f2f96638640 1 -- 172.21.15.104:0/3042750028 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f900d15c0 con 0x7f2f780039b0 2024-05-08T04:23:10.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.379+0000 7f2f8cff9640 1 -- 172.21.15.104:0/3042750028 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f90159630 con 0x7f2f780039b0 2024-05-08T04:23:10.381 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:23:10.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.381+0000 7f2f96638640 1 -- 172.21.15.104:0/3042750028 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2f7c06b6b0 msgr2=0x7f2f7c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.381+0000 7f2f96638640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2f7c06b6b0 0x7f2f7c06db70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2f900b3390 tx=0x7f2f84008040 comp rx=0 tx=0).stop 2024-05-08T04:23:10.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.381+0000 7f2f96638640 1 -- 172.21.15.104:0/3042750028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f780039b0 msgr2=0x7f2f90156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.381+0000 7f2f96638640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f780039b0 0x7f2f90156d20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2f80000c00 tx=0x7f2f80000fe0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.381+0000 7f2f96638640 1 -- 172.21.15.104:0/3042750028 shutdown_connections 2024-05-08T04:23:10.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.381+0000 7f2f96638640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2f7c06b6b0 0x7f2f7c06db70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.381+0000 7f2f96638640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f900cc5a0 0x7f2f90161360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.381+0000 7f2f96638640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f901618a0 0x7f2f9015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.381+0000 7f2f96638640 1 --2- 172.21.15.104:0/3042750028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f780039b0 0x7f2f90156d20 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.381+0000 7f2f96638640 1 -- 172.21.15.104:0/3042750028 >> 172.21.15.104:0/3042750028 conn(0x7f2f900b3450 msgr2=0x7f2f9015c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:10.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.381+0000 7f2f96638640 1 -- 172.21.15.104:0/3042750028 shutdown_connections 2024-05-08T04:23:10.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.381+0000 7f2f96638640 1 -- 172.21.15.104:0/3042750028 wait complete. 2024-05-08T04:23:10.394 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:23:10.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.494+0000 7f7bbcc4a640 1 Processor -- start 2024-05-08T04:23:10.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.495+0000 7f7bbcc4a640 1 -- start start 2024-05-08T04:23:10.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.495+0000 7f7bbcc4a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb80b93b0 0x7f7bb80b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.495+0000 7f7bbcc4a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7bb80b5970 0x7f7bb80d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.495+0000 7f7bbcc4a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb80b6b50 con 0x7f7bb815db30 2024-05-08T04:23:10.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.495+0000 7f7bbcc4a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb806c800 con 0x7f7bb80b5970 2024-05-08T04:23:10.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.495+0000 7f7bbcc4a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb806cae0 con 0x7f7bb80b93b0 2024-05-08T04:23:10.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.495+0000 7f7bb6d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7bb80b5970 0x7f7bb80d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.496+0000 7f7bb6d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7bb80b5970 0x7f7bb80d24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37834/0 (socket says 172.21.15.104:37834) 2024-05-08T04:23:10.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.496+0000 7f7bb6d9d640 1 -- 172.21.15.104:0/1839122107 learned_addr learned my addr 172.21.15.104:0/1839122107 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:10.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.496+0000 7f7badd9b640 1 --2- 172.21.15.104:0/1839122107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb80b93b0 0x7f7bb80b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.496+0000 7f7bb6d9d640 1 -- 172.21.15.104:0/1839122107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb80b93b0 msgr2=0x7f7bb80b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:10.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.496+0000 7f7bb6d9d640 1 --2- 172.21.15.104:0/1839122107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb80b93b0 0x7f7bb80b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.496+0000 7f7bb6d9d640 1 -- 172.21.15.104:0/1839122107 >> v1:172.21.15.183:6789/0 conn(0x7f7bb815db30 legacy=0x7f7bb806bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:10.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.496+0000 7f7bb6d9d640 1 -- 172.21.15.104:0/1839122107 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb806cdc0 con 0x7f7bb80b5970 2024-05-08T04:23:10.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.496+0000 7f7badd9b640 1 --2- 172.21.15.104:0/1839122107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb80b93b0 0x7f7bb80b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:10.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.497+0000 7f7bb6d9d640 1 --2- 172.21.15.104:0/1839122107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb80b5970 0x7f7bb80d24b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009e50 tx=0x7f7bb002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c296add95a93f2f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:10.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.497+0000 7f7bb5d9b640 1 -- 172.21.15.104:0/1839122107 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0036070 con 0x7f7bb80b5970 2024-05-08T04:23:10.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.497+0000 7f7bb5d9b640 1 -- 172.21.15.104:0/1839122107 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb0031600 con 0x7f7bb80b5970 2024-05-08T04:23:10.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.497+0000 7f7bb5d9b640 1 -- 172.21.15.104:0/1839122107 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00319d0 con 0x7f7bb80b5970 2024-05-08T04:23:10.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.497+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/1839122107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb80b5970 msgr2=0x7f7bb80d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.497+0000 7f7bbcc4a640 1 --2- 172.21.15.104:0/1839122107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb80b5970 0x7f7bb80d24b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009e50 tx=0x7f7bb002a6c0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.497+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/1839122107 shutdown_connections 2024-05-08T04:23:10.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.497+0000 7f7bbcc4a640 1 --2- 172.21.15.104:0/1839122107 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb80b5970 0x7f7bb80d24b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.497+0000 7f7bbcc4a640 1 --2- 172.21.15.104:0/1839122107 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb80b93b0 0x7f7bb80b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.497+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/1839122107 >> 172.21.15.104:0/1839122107 conn(0x7f7bb80d0430 msgr2=0x7f7bb80d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:10.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.497+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/1839122107 shutdown_connections 2024-05-08T04:23:10.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.497+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/1839122107 wait complete. 2024-05-08T04:23:10.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.499+0000 7f7bbcc4a640 1 Processor -- start 2024-05-08T04:23:10.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.499+0000 7f7bbcc4a640 1 -- start start 2024-05-08T04:23:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.499+0000 7f7bbcc4a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bb80b5970 0x7f7bb80c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7bbcc4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb80b93b0 0x7f7bb8156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7bbcc4a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb815db30 0x7f7bb8156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7bbcc4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb815df10 con 0x7f7bb80b93b0 2024-05-08T04:23:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7bbcc4a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb80d29f0 con 0x7f7bb80b5970 2024-05-08T04:23:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7bbcc4a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb81f77e0 con 0x7f7bb815db30 2024-05-08T04:23:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7badd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb80b93b0 0x7f7bb8156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7badd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb80b93b0 0x7f7bb8156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37838/0 (socket says 172.21.15.104:37838) 2024-05-08T04:23:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7badd9b640 1 -- 172.21.15.104:0/3612306826 learned_addr learned my addr 172.21.15.104:0/3612306826 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7bb6d9d640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb815db30 0x7f7bb8156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7bb659c640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bb80b5970 0x7f7bb80c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7badd9b640 1 -- 172.21.15.104:0/3612306826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb815db30 msgr2=0x7f7bb8156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7badd9b640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb815db30 0x7f7bb8156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7badd9b640 1 -- 172.21.15.104:0/3612306826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bb80b5970 msgr2=0x7f7bb80c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7badd9b640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bb80b5970 0x7f7bb80c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7badd9b640 1 -- 172.21.15.104:0/3612306826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb8157500 con 0x7f7bb80b93b0 2024-05-08T04:23:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7badd9b640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb80b93b0 0x7f7bb8156990 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c7f0 tx=0x7f7ba000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7baf7fe640 1 -- 172.21.15.104:0/3612306826 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0015070 con 0x7f7bb80b93b0 2024-05-08T04:23:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7baf7fe640 1 -- 172.21.15.104:0/3612306826 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba0007a30 con 0x7f7bb80b93b0 2024-05-08T04:23:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7baf7fe640 1 -- 172.21.15.104:0/3612306826 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0007e00 con 0x7f7bb80b93b0 2024-05-08T04:23:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/3612306826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb81577e0 con 0x7f7bb80b93b0 2024-05-08T04:23:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.500+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/3612306826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb8157da0 con 0x7f7bb80b93b0 2024-05-08T04:23:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.501+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/3612306826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb8075010 con 0x7f7bb80b93b0 2024-05-08T04:23:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.502+0000 7f7baf7fe640 1 -- 172.21.15.104:0/3612306826 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f7ba0018070 con 0x7f7bb80b93b0 2024-05-08T04:23:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.502+0000 7f7baf7fe640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7b9806b680 0x7f7b9806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.502+0000 7f7baf7fe640 1 -- 172.21.15.104:0/3612306826 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7ba008a660 con 0x7f7bb80b93b0 2024-05-08T04:23:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.502+0000 7f7bb659c640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7b9806b680 0x7f7b9806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.503+0000 7f7bb659c640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7b9806b680 0x7f7b9806db40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8006fd0 tx=0x7f7ba8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:10.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.506+0000 7f7baf7fe640 1 -- 172.21.15.104:0/3612306826 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7ba00590c0 con 0x7f7bb80b93b0 2024-05-08T04:23:10.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.676+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/3612306826 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7bb80d17b0 con 0x7f7bb80b93b0 2024-05-08T04:23:10.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.676+0000 7f7baf7fe640 1 -- 172.21.15.104:0/3612306826 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7ba00589c0 con 0x7f7bb80b93b0 2024-05-08T04:23:10.679 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:23:10.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.678+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/3612306826 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7b9806b680 msgr2=0x7f7b9806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.678+0000 7f7bbcc4a640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7b9806b680 0x7f7b9806db40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8006fd0 tx=0x7f7ba8008040 comp rx=0 tx=0).stop 2024-05-08T04:23:10.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.678+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/3612306826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb80b93b0 msgr2=0x7f7bb8156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.678+0000 7f7bbcc4a640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb80b93b0 0x7f7bb8156990 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c7f0 tx=0x7f7ba000cbf0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.678+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/3612306826 shutdown_connections 2024-05-08T04:23:10.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.678+0000 7f7bbcc4a640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7b9806b680 0x7f7b9806db40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.678+0000 7f7bbcc4a640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7bb815db30 0x7f7bb8156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.678+0000 7f7bbcc4a640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bb80b93b0 0x7f7bb8156990 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.678+0000 7f7bbcc4a640 1 --2- 172.21.15.104:0/3612306826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bb80b5970 0x7f7bb80c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.678+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/3612306826 >> 172.21.15.104:0/3612306826 conn(0x7f7bb80d0430 msgr2=0x7f7bb815c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:10.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.679+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/3612306826 shutdown_connections 2024-05-08T04:23:10.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.679+0000 7f7bbcc4a640 1 -- 172.21.15.104:0/3612306826 wait complete. 2024-05-08T04:23:10.685 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:23:10.687 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:23:10.692 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:23:10.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.830+0000 7f4d877d5640 1 Processor -- start 2024-05-08T04:23:10.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.830+0000 7f4d877d5640 1 -- start start 2024-05-08T04:23:10.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.831+0000 7f4d877d5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4d800715d0 0x7f4d800719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.831+0000 7f4d877d5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d80071ef0 con 0x7f4d8015cd20 2024-05-08T04:23:10.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.831+0000 7f4d877d5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d800cf680 con 0x7f4d800725b0 2024-05-08T04:23:10.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.831+0000 7f4d877d5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8015c240 con 0x7f4d800715d0 2024-05-08T04:23:10.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.831+0000 7f4d85571640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4d800715d0 0x7f4d800719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.831+0000 7f4d85d72640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f4d8015cd20 0x7f4d8006d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:57336/0 (socket says 172.21.15.104:57336) 2024-05-08T04:23:10.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.831+0000 7f4d85d72640 1 -- 172.21.15.104:0/4083011991 learned_addr learned my addr 172.21.15.104:0/4083011991 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:10.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.831+0000 7f4d85571640 1 -- 172.21.15.104:0/4083011991 >> v1:172.21.15.183:6789/0 conn(0x7f4d800725b0 legacy=0x7f4d800cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:10.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.831+0000 7f4d85571640 1 -- 172.21.15.104:0/4083011991 >> v1:172.21.15.104:6789/0 conn(0x7f4d8015cd20 legacy=0x7f4d8006d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.832+0000 7f4d85571640 1 -- 172.21.15.104:0/4083011991 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8015c520 con 0x7f4d800715d0 2024-05-08T04:23:10.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.831+0000 7f4d77fff640 1 -- 172.21.15.104:0/4083011991 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100846715 0 0) 0x7f4d80071ef0 con 0x7f4d8015cd20 2024-05-08T04:23:10.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.832+0000 7f4d85571640 1 --2- 172.21.15.104:0/4083011991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d800715d0 0x7f4d800719b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0097a0 tx=0x7f4d7c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc986c8303993582 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:10.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.832+0000 7f4d77fff640 1 -- 172.21.15.104:0/4083011991 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c037070 con 0x7f4d800715d0 2024-05-08T04:23:10.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.832+0000 7f4d77fff640 1 -- 172.21.15.104:0/4083011991 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c02adc0 con 0x7f4d800715d0 2024-05-08T04:23:10.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.832+0000 7f4d77fff640 1 -- 172.21.15.104:0/4083011991 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c032660 con 0x7f4d800715d0 2024-05-08T04:23:10.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.833+0000 7f4d877d5640 1 -- 172.21.15.104:0/4083011991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d800715d0 msgr2=0x7f4d800719b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.833+0000 7f4d877d5640 1 --2- 172.21.15.104:0/4083011991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d800715d0 0x7f4d800719b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0097a0 tx=0x7f4d7c02a0b0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.833+0000 7f4d877d5640 1 -- 172.21.15.104:0/4083011991 shutdown_connections 2024-05-08T04:23:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.833+0000 7f4d877d5640 1 --2- 172.21.15.104:0/4083011991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d800715d0 0x7f4d800719b0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.833+0000 7f4d877d5640 1 -- 172.21.15.104:0/4083011991 >> 172.21.15.104:0/4083011991 conn(0x7f4d800cfa60 msgr2=0x7f4d800cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.833+0000 7f4d877d5640 1 -- 172.21.15.104:0/4083011991 shutdown_connections 2024-05-08T04:23:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.833+0000 7f4d877d5640 1 -- 172.21.15.104:0/4083011991 wait complete. 2024-05-08T04:23:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.834+0000 7f4d877d5640 1 Processor -- start 2024-05-08T04:23:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.834+0000 7f4d877d5640 1 -- start start 2024-05-08T04:23:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d877d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d800715d0 0x7f4d801344d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d877d5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d800725b0 0x7f4d801e1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d877d5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d8015cd20 0x7f4d801f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d877d5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8006dd40 con 0x7f4d800725b0 2024-05-08T04:23:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d877d5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800cf360 con 0x7f4d8015cd20 2024-05-08T04:23:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d877d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8006dec0 con 0x7f4d800715d0 2024-05-08T04:23:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d84d70640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d800725b0 0x7f4d801e1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d84d70640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d800725b0 0x7f4d801e1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37858/0 (socket says 172.21.15.104:37858) 2024-05-08T04:23:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d84d70640 1 -- 172.21.15.104:0/1972410573 learned_addr learned my addr 172.21.15.104:0/1972410573 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d84d70640 1 -- 172.21.15.104:0/1972410573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d800715d0 msgr2=0x7f4d801344d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d85571640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d800715d0 0x7f4d801344d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d85d72640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d8015cd20 0x7f4d801f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d84d70640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d800715d0 0x7f4d801344d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d84d70640 1 -- 172.21.15.104:0/1972410573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d8015cd20 msgr2=0x7f4d801f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:10.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d84d70640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d8015cd20 0x7f4d801f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:10.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d84d70640 1 -- 172.21.15.104:0/1972410573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d801e2400 con 0x7f4d800725b0 2024-05-08T04:23:10.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.835+0000 7f4d85d72640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d8015cd20 0x7f4d801f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:10.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.836+0000 7f4d84d70640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d800725b0 0x7f4d801e1ec0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000c400 tx=0x7f4d7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:10.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.836+0000 7f4d75ffb640 1 -- 172.21.15.104:0/1972410573 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70011790 con 0x7f4d800725b0 2024-05-08T04:23:10.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.836+0000 7f4d75ffb640 1 -- 172.21.15.104:0/1972410573 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d70017070 con 0x7f4d800725b0 2024-05-08T04:23:10.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.836+0000 7f4d877d5640 1 -- 172.21.15.104:0/1972410573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d80143090 con 0x7f4d800725b0 2024-05-08T04:23:10.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.836+0000 7f4d75ffb640 1 -- 172.21.15.104:0/1972410573 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70011bb0 con 0x7f4d800725b0 2024-05-08T04:23:10.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.836+0000 7f4d877d5640 1 -- 172.21.15.104:0/1972410573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d80143650 con 0x7f4d800725b0 2024-05-08T04:23:10.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.837+0000 7f4d877d5640 1 -- 172.21.15.104:0/1972410573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d80075010 con 0x7f4d800725b0 2024-05-08T04:23:10.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.837+0000 7f4d75ffb640 1 -- 172.21.15.104:0/1972410573 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f4d7001c460 con 0x7f4d800725b0 2024-05-08T04:23:10.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.838+0000 7f4d75ffb640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d6406b680 0x7f4d6406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:10.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.838+0000 7f4d75ffb640 1 -- 172.21.15.104:0/1972410573 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f4d7008a3f0 con 0x7f4d800725b0 2024-05-08T04:23:10.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.838+0000 7f4d85571640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d6406b680 0x7f4d6406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:10.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.838+0000 7f4d85571640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d6406b680 0x7f4d6406db40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c034000 tx=0x7f4d7c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:10.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:10.842+0000 7f4d75ffb640 1 -- 172.21.15.104:0/1972410573 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4d70058f60 con 0x7f4d800725b0 2024-05-08T04:23:11.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.023+0000 7f4d877d5640 1 -- 172.21.15.104:0/1972410573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4d800cca30 con 0x7f4d800725b0 2024-05-08T04:23:11.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.024+0000 7f4d75ffb640 1 -- 172.21.15.104:0/1972410573 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4d70058860 con 0x7f4d800725b0 2024-05-08T04:23:11.026 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:23:11.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.025+0000 7f4d877d5640 1 -- 172.21.15.104:0/1972410573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d6406b680 msgr2=0x7f4d6406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.025+0000 7f4d877d5640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d6406b680 0x7f4d6406db40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c034000 tx=0x7f4d7c02e000 comp rx=0 tx=0).stop 2024-05-08T04:23:11.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.025+0000 7f4d877d5640 1 -- 172.21.15.104:0/1972410573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d800725b0 msgr2=0x7f4d801e1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.026+0000 7f4d877d5640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d800725b0 0x7f4d801e1ec0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4d7000c400 tx=0x7f4d7000c8c0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.026+0000 7f4d877d5640 1 -- 172.21.15.104:0/1972410573 shutdown_connections 2024-05-08T04:23:11.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.026+0000 7f4d877d5640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d6406b680 0x7f4d6406db40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.026+0000 7f4d877d5640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d8015cd20 0x7f4d801f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.026+0000 7f4d877d5640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d800725b0 0x7f4d801e1ec0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.026+0000 7f4d877d5640 1 --2- 172.21.15.104:0/1972410573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d800715d0 0x7f4d801344d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.026+0000 7f4d877d5640 1 -- 172.21.15.104:0/1972410573 >> 172.21.15.104:0/1972410573 conn(0x7f4d800cfa60 msgr2=0x7f4d800b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.026+0000 7f4d877d5640 1 -- 172.21.15.104:0/1972410573 shutdown_connections 2024-05-08T04:23:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.026+0000 7f4d877d5640 1 -- 172.21.15.104:0/1972410573 wait complete. 2024-05-08T04:23:11.039 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi183.front.sepia.ceph.com... 2024-05-08T04:23:11.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:23:11.039 DEBUG:teuthology.orchestra.run.smithi183:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-08T04:23:11.070 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[43493]: fuse finished with error 0 and tester_r 0 2024-05-08T04:23:11.070 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:23:11.085 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:23:11.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:23:11.085 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-08T04:23:11.143 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:23:11.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.241+0000 7f7c64709640 1 Processor -- start 2024-05-08T04:23:11.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.241+0000 7f7c64709640 1 -- start start 2024-05-08T04:23:11.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.242+0000 7f7c64709640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7c5c161190 0x7f7c5c072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.242+0000 7f7c64709640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5c06de30 con 0x7f7c5c072a70 2024-05-08T04:23:11.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.242+0000 7f7c64709640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5c06e110 con 0x7f7c5c06bb70 2024-05-08T04:23:11.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.242+0000 7f7c64709640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5c0b4db0 con 0x7f7c5c161190 2024-05-08T04:23:11.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.242+0000 7f7c61ca4640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f7c5c072a70 0x7f7c5c0acdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:57342/0 (socket says 172.21.15.104:57342) 2024-05-08T04:23:11.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.242+0000 7f7c61ca4640 1 -- 172.21.15.104:0/2301248697 learned_addr learned my addr 172.21.15.104:0/2301248697 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:11.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.242+0000 7f7c624a5640 1 --2- 172.21.15.104:0/2301248697 >> v2:172.21.15.183:3300/0 conn(0x7f7c5c161190 0x7f7c5c072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.242+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955123933 0 0) 0x7f7c5c06de30 con 0x7f7c5c072a70 2024-05-08T04:23:11.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.242+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c48003520 con 0x7f7c5c072a70 2024-05-08T04:23:11.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1089932001 0 0) 0x7f7c48003520 con 0x7f7c5c072a70 2024-05-08T04:23:11.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 >> v2:172.21.15.183:3300/0 conn(0x7f7c5c161190 msgr2=0x7f7c5c072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:11.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c614a3640 1 --2- 172.21.15.104:0/2301248697 >> v2:172.21.15.183:3300/0 conn(0x7f7c5c161190 0x7f7c5c072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 >> v1:172.21.15.183:6789/0 conn(0x7f7c5c06bb70 legacy=0x7f7c5c06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c06e3f0 con 0x7f7c5c072a70 2024-05-08T04:23:11.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f7c4c001670 con 0x7f7c5c072a70 2024-05-08T04:23:11.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c624a5640 1 --2- 172.21.15.104:0/2301248697 >> v2:172.21.15.183:3300/0 conn(0x7f7c5c161190 0x7f7c5c072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:23:11.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 >> v1:172.21.15.104:6789/0 conn(0x7f7c5c072a70 legacy=0x7f7c5c0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c614a3640 1 --2- 172.21.15.104:0/2301248697 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c480039b0 0x7f7c48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c614a3640 1 --2- 172.21.15.104:0/2301248697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c48004800 0x7f7c48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c614a3640 1 --2- 172.21.15.104:0/2301248697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c480051c0 0x7f7c4800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4800c030 con 0x7f7c48004800 2024-05-08T04:23:11.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4800c1e0 con 0x7f7c480051c0 2024-05-08T04:23:11.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4800c3e0 con 0x7f7c480039b0 2024-05-08T04:23:11.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c61ca4640 1 --2- 172.21.15.104:0/2301248697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c48004800 0x7f7c48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c61ca4640 1 -- 172.21.15.104:0/2301248697 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c480039b0 msgr2=0x7f7c48003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:11.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c61ca4640 1 --2- 172.21.15.104:0/2301248697 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c480039b0 0x7f7c48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c61ca4640 1 -- 172.21.15.104:0/2301248697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c480051c0 msgr2=0x7f7c4800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:11.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c61ca4640 1 --2- 172.21.15.104:0/2301248697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c480051c0 0x7f7c4800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c61ca4640 1 -- 172.21.15.104:0/2301248697 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c48003520 con 0x7f7c48004800 2024-05-08T04:23:11.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.243+0000 7f7c62ca6640 1 -- 172.21.15.104:0/2301248697 reap_dead start 2024-05-08T04:23:11.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.244+0000 7f7c61ca4640 1 --2- 172.21.15.104:0/2301248697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c48004800 0x7f7c48004c80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00c240 tx=0x7f7c48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76bc3638a22857de server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:11.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.244+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c007cf0 con 0x7f7c48004800 2024-05-08T04:23:11.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.244+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c0058d0 con 0x7f7c48004800 2024-05-08T04:23:11.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.244+0000 7f7c614a3640 1 -- 172.21.15.104:0/2301248697 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c005d20 con 0x7f7c48004800 2024-05-08T04:23:11.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.244+0000 7f7c64709640 1 -- 172.21.15.104:0/2301248697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c48004800 msgr2=0x7f7c48004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.244+0000 7f7c64709640 1 --2- 172.21.15.104:0/2301248697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c48004800 0x7f7c48004c80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00c240 tx=0x7f7c48005830 comp rx=0 tx=0).stop 2024-05-08T04:23:11.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.245+0000 7f7c64709640 1 -- 172.21.15.104:0/2301248697 shutdown_connections 2024-05-08T04:23:11.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.245+0000 7f7c64709640 1 --2- 172.21.15.104:0/2301248697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c48004800 0x7f7c48004c80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.245+0000 7f7c64709640 1 -- 172.21.15.104:0/2301248697 >> 172.21.15.104:0/2301248697 conn(0x7f7c5c071a10 msgr2=0x7f7c5c071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:11.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.245+0000 7f7c64709640 1 -- 172.21.15.104:0/2301248697 shutdown_connections 2024-05-08T04:23:11.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.245+0000 7f7c64709640 1 -- 172.21.15.104:0/2301248697 wait complete. 2024-05-08T04:23:11.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.246+0000 7f7c64709640 1 Processor -- start 2024-05-08T04:23:11.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.246+0000 7f7c64709640 1 -- start start 2024-05-08T04:23:11.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.246+0000 7f7c64709640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c48004800 0x7f7c5c15f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.246+0000 7f7c64709640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c5c142630 0x7f7c5c1f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c64709640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c5c15d3c0 0x7f7c5c1f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c64709640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c06da70 con 0x7f7c5c15d3c0 2024-05-08T04:23:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c64709640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c06e9b0 con 0x7f7c48004800 2024-05-08T04:23:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c64709640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c06dbf0 con 0x7f7c5c142630 2024-05-08T04:23:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c62ca6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c5c15d3c0 0x7f7c5c1f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c62ca6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c5c15d3c0 0x7f7c5c1f78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37872/0 (socket says 172.21.15.104:37872) 2024-05-08T04:23:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c62ca6640 1 -- 172.21.15.104:0/4038921592 learned_addr learned my addr 172.21.15.104:0/4038921592 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c624a5640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c48004800 0x7f7c5c15f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c61ca4640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c5c142630 0x7f7c5c1f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c62ca6640 1 -- 172.21.15.104:0/4038921592 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c5c142630 msgr2=0x7f7c5c1f7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c62ca6640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c5c142630 0x7f7c5c1f7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c62ca6640 1 -- 172.21.15.104:0/4038921592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c48004800 msgr2=0x7f7c5c15f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c62ca6640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c48004800 0x7f7c5c15f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c62ca6640 1 -- 172.21.15.104:0/4038921592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c160530 con 0x7f7c5c15d3c0 2024-05-08T04:23:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c624a5640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c48004800 0x7f7c5c15f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c61ca4640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c5c142630 0x7f7c5c1f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c62ca6640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c5c15d3c0 0x7f7c5c1f78b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0716e0 tx=0x7f7c5400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c52ffd640 1 -- 172.21.15.104:0/4038921592 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54007070 con 0x7f7c5c15d3c0 2024-05-08T04:23:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c52ffd640 1 -- 172.21.15.104:0/4038921592 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c54007210 con 0x7f7c5c15d3c0 2024-05-08T04:23:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c64709640 1 -- 172.21.15.104:0/4038921592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5c15ff70 con 0x7f7c5c15d3c0 2024-05-08T04:23:11.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c52ffd640 1 -- 172.21.15.104:0/4038921592 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c540075e0 con 0x7f7c5c15d3c0 2024-05-08T04:23:11.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.247+0000 7f7c64709640 1 -- 172.21.15.104:0/4038921592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5c15a3f0 con 0x7f7c5c15d3c0 2024-05-08T04:23:11.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.248+0000 7f7c64709640 1 -- 172.21.15.104:0/4038921592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5c075010 con 0x7f7c5c15d3c0 2024-05-08T04:23:11.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.249+0000 7f7c52ffd640 1 -- 172.21.15.104:0/4038921592 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f7c54011070 con 0x7f7c5c15d3c0 2024-05-08T04:23:11.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.249+0000 7f7c52ffd640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c4006b6b0 0x7f7c4006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.249+0000 7f7c624a5640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c4006b6b0 0x7f7c4006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.249+0000 7f7c52ffd640 1 -- 172.21.15.104:0/4038921592 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7c540898a0 con 0x7f7c5c15d3c0 2024-05-08T04:23:11.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.250+0000 7f7c624a5640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c4006b6b0 0x7f7c4006db70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7c58004790 tx=0x7f7c58008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:11.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.253+0000 7f7c52ffd640 1 -- 172.21.15.104:0/4038921592 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c54019060 con 0x7f7c5c15d3c0 2024-05-08T04:23:11.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.456+0000 7f7c64709640 1 -- 172.21.15.104:0/4038921592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c5c066a30 con 0x7f7c5c15d3c0 2024-05-08T04:23:11.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.457+0000 7f7c52ffd640 1 -- 172.21.15.104:0/4038921592 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f7c540584a0 con 0x7f7c5c15d3c0 2024-05-08T04:23:11.459 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:11.459 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:23:11.460 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:23:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.459+0000 7f7c64709640 1 -- 172.21.15.104:0/4038921592 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c4006b6b0 msgr2=0x7f7c4006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.459+0000 7f7c64709640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c4006b6b0 0x7f7c4006db70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7c58004790 tx=0x7f7c58008040 comp rx=0 tx=0).stop 2024-05-08T04:23:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.459+0000 7f7c64709640 1 -- 172.21.15.104:0/4038921592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c5c15d3c0 msgr2=0x7f7c5c1f78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.459+0000 7f7c64709640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c5c15d3c0 0x7f7c5c1f78b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0716e0 tx=0x7f7c5400c8f0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.459+0000 7f7c64709640 1 -- 172.21.15.104:0/4038921592 shutdown_connections 2024-05-08T04:23:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.459+0000 7f7c64709640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c4006b6b0 0x7f7c4006db70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.459+0000 7f7c64709640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c5c15d3c0 0x7f7c5c1f78b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.459+0000 7f7c64709640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c5c142630 0x7f7c5c1f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.459+0000 7f7c64709640 1 --2- 172.21.15.104:0/4038921592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c48004800 0x7f7c5c15f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.459+0000 7f7c64709640 1 -- 172.21.15.104:0/4038921592 >> 172.21.15.104:0/4038921592 conn(0x7f7c5c071a10 msgr2=0x7f7c5c0b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.459+0000 7f7c64709640 1 -- 172.21.15.104:0/4038921592 shutdown_connections 2024-05-08T04:23:11.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.459+0000 7f7c64709640 1 -- 172.21.15.104:0/4038921592 wait complete. 2024-05-08T04:23:11.472 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:23:11.589 INFO:teuthology.orchestra.run.smithi104.stdout:[] 2024-05-08T04:23:11.590 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-05-08T04:23:11.590 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol88510 2024-05-08T04:23:11.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.690+0000 7f384815c640 1 Processor -- start 2024-05-08T04:23:11.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.691+0000 7f384815c640 1 -- start start 2024-05-08T04:23:11.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.691+0000 7f384815c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3840144c80 0x7f384006df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.691+0000 7f384815c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3840071fb0 con 0x7f38400711c0 2024-05-08T04:23:11.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.691+0000 7f384815c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3840071710 con 0x7f38400cc930 2024-05-08T04:23:11.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.691+0000 7f384815c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38400719f0 con 0x7f3840144c80 2024-05-08T04:23:11.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f38456f7640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f38400711c0 0x7f384006d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:57356/0 (socket says 172.21.15.104:57356) 2024-05-08T04:23:11.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f38456f7640 1 -- 172.21.15.104:0/2262956472 learned_addr learned my addr 172.21.15.104:0/2262956472 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:11.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f38466f9640 1 --2- 172.21.15.104:0/2262956472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3840144c80 0x7f384006df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508691203 0 0) 0x7f3840071fb0 con 0x7f38400711c0 2024-05-08T04:23:11.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f382c003520 con 0x7f38400711c0 2024-05-08T04:23:11.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2019742461 0 0) 0x7f382c003520 con 0x7f38400711c0 2024-05-08T04:23:11.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3840144c80 msgr2=0x7f384006df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:11.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 --2- 172.21.15.104:0/2262956472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3840144c80 0x7f384006df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 >> v1:172.21.15.183:6789/0 conn(0x7f38400cc930 legacy=0x7f38400ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3840071cd0 con 0x7f38400711c0 2024-05-08T04:23:11.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f3830001670 con 0x7f38400711c0 2024-05-08T04:23:11.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 >> v1:172.21.15.104:6789/0 conn(0x7f38400711c0 legacy=0x7f384006d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 --2- 172.21.15.104:0/2262956472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f382c0039e0 0x7f382c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 --2- 172.21.15.104:0/2262956472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f382c004800 0x7f382c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 --2- 172.21.15.104:0/2262956472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3840144c80 0x7f382c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38400719f0 con 0x7f382c004800 2024-05-08T04:23:11.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c005520 con 0x7f382c0039e0 2024-05-08T04:23:11.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c00bf00 con 0x7f3840144c80 2024-05-08T04:23:11.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f38456f7640 1 --2- 172.21.15.104:0/2262956472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f382c004800 0x7f382c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f3845ef8640 1 --2- 172.21.15.104:0/2262956472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f382c0039e0 0x7f382c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f38466f9640 1 --2- 172.21.15.104:0/2262956472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3840144c80 0x7f382c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f38456f7640 1 -- 172.21.15.104:0/2262956472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3840144c80 msgr2=0x7f382c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f38456f7640 1 --2- 172.21.15.104:0/2262956472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3840144c80 0x7f382c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f38456f7640 1 -- 172.21.15.104:0/2262956472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f382c0039e0 msgr2=0x7f382c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f38456f7640 1 --2- 172.21.15.104:0/2262956472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f382c0039e0 0x7f382c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.692+0000 7f38456f7640 1 -- 172.21.15.104:0/2262956472 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c003520 con 0x7f382c004800 2024-05-08T04:23:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.693+0000 7f3845ef8640 1 --2- 172.21.15.104:0/2262956472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f382c0039e0 0x7f382c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:23:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.693+0000 7f38456f7640 1 --2- 172.21.15.104:0/2262956472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f382c004800 0x7f382c004c80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f383000c210 tx=0x7f382c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c325dd24c93f00d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.693+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830007d30 con 0x7f382c004800 2024-05-08T04:23:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.693+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3830005ad0 con 0x7f382c004800 2024-05-08T04:23:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.693+0000 7f3844ef6640 1 -- 172.21.15.104:0/2262956472 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830007070 con 0x7f382c004800 2024-05-08T04:23:11.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.694+0000 7f384815c640 1 -- 172.21.15.104:0/2262956472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f382c004800 msgr2=0x7f382c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.694+0000 7f384815c640 1 --2- 172.21.15.104:0/2262956472 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f382c004800 0x7f382c004c80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f383000c210 tx=0x7f382c005830 comp rx=0 tx=0).stop 2024-05-08T04:23:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.694+0000 7f38466f9640 1 -- 172.21.15.104:0/2262956472 reap_dead start 2024-05-08T04:23:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.694+0000 7f384815c640 1 -- 172.21.15.104:0/2262956472 shutdown_connections 2024-05-08T04:23:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.694+0000 7f384815c640 1 -- 172.21.15.104:0/2262956472 >> 172.21.15.104:0/2262956472 conn(0x7f38400b13f0 msgr2=0x7f38400b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.694+0000 7f384815c640 1 -- 172.21.15.104:0/2262956472 shutdown_connections 2024-05-08T04:23:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.694+0000 7f384815c640 1 -- 172.21.15.104:0/2262956472 wait complete. 2024-05-08T04:23:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.695+0000 7f384815c640 1 Processor -- start 2024-05-08T04:23:11.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.695+0000 7f384815c640 1 -- start start 2024-05-08T04:23:11.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f384815c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f382c004800 0x7f384015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f384815c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f384015a850 0x7f384015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f384815c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f384013fcd0 0x7f3840140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f384815c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38401453f0 con 0x7f384013fcd0 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f384815c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38400cf3b0 con 0x7f382c004800 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f384815c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384006df60 con 0x7f384015a850 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38466f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f384013fcd0 0x7f3840140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38466f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f384013fcd0 0x7f3840140150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37900/0 (socket says 172.21.15.104:37900) 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38466f9640 1 -- 172.21.15.104:0/1251644667 learned_addr learned my addr 172.21.15.104:0/1251644667 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f3845ef8640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f382c004800 0x7f384015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38456f7640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f384015a850 0x7f384015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38466f9640 1 -- 172.21.15.104:0/1251644667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f384015a850 msgr2=0x7f384015ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38466f9640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f384015a850 0x7f384015ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38466f9640 1 -- 172.21.15.104:0/1251644667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f382c004800 msgr2=0x7f384015c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38466f9640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f382c004800 0x7f384015c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38466f9640 1 -- 172.21.15.104:0/1251644667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384015acd0 con 0x7f384013fcd0 2024-05-08T04:23:11.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f3845ef8640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f382c004800 0x7f384015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:11.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38456f7640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f384015a850 0x7f384015ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:11.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38466f9640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f384013fcd0 0x7f3840140150 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3840160640 tx=0x7f3838009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:11.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38367fc640 1 -- 172.21.15.104:0/1251644667 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838007cf0 con 0x7f384013fcd0 2024-05-08T04:23:11.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38367fc640 1 -- 172.21.15.104:0/1251644667 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3838019070 con 0x7f384013fcd0 2024-05-08T04:23:11.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f384815c640 1 -- 172.21.15.104:0/1251644667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384015b540 con 0x7f384013fcd0 2024-05-08T04:23:11.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.696+0000 7f38367fc640 1 -- 172.21.15.104:0/1251644667 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838014650 con 0x7f384013fcd0 2024-05-08T04:23:11.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.697+0000 7f384815c640 1 -- 172.21.15.104:0/1251644667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384015b260 con 0x7f384013fcd0 2024-05-08T04:23:11.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.697+0000 7f384815c640 1 -- 172.21.15.104:0/1251644667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3840073180 con 0x7f384013fcd0 2024-05-08T04:23:11.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.698+0000 7f38367fc640 1 -- 172.21.15.104:0/1251644667 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f38380147f0 con 0x7f384013fcd0 2024-05-08T04:23:11.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.698+0000 7f38367fc640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f382406b6b0 0x7f382406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:11.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.698+0000 7f38367fc640 1 -- 172.21.15.104:0/1251644667 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f383808ab30 con 0x7f384013fcd0 2024-05-08T04:23:11.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.698+0000 7f3845ef8640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f382406b6b0 0x7f382406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:11.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.699+0000 7f3845ef8640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f382406b6b0 0x7f382406db70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f383c000c00 tx=0x7f383c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:11.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.703+0000 7f38367fc640 1 -- 172.21.15.104:0/1251644667 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3840073180 con 0x7f384013fcd0 2024-05-08T04:23:11.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.899+0000 7f384815c640 1 -- 172.21.15.104:0/1251644667 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol88510", "target": ["mon-mgr", ""]}) v1 -- 0x7f3840075010 con 0x7f382406b6b0 2024-05-08T04:23:11.906 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:23:11.904+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:23:11.906 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:23:11.904+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:23:11.906 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:23:11.904+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:23:11.906 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:23:11.904+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:23:11.906 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:23:11.904+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:23:11.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.937+0000 7f38367fc640 1 -- 172.21.15.104:0/1251644667 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3840075010 con 0x7f382406b6b0 2024-05-08T04:23:11.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.939+0000 7f384815c640 1 -- 172.21.15.104:0/1251644667 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f382406b6b0 msgr2=0x7f382406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.939+0000 7f384815c640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f382406b6b0 0x7f382406db70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f383c000c00 tx=0x7f383c009040 comp rx=0 tx=0).stop 2024-05-08T04:23:11.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.939+0000 7f384815c640 1 -- 172.21.15.104:0/1251644667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f384013fcd0 msgr2=0x7f3840140150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:11.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.939+0000 7f384815c640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f384013fcd0 0x7f3840140150 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3840160640 tx=0x7f3838009d20 comp rx=0 tx=0).stop 2024-05-08T04:23:11.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.939+0000 7f384815c640 1 -- 172.21.15.104:0/1251644667 shutdown_connections 2024-05-08T04:23:11.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.939+0000 7f384815c640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f382406b6b0 0x7f382406db70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.939+0000 7f384815c640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f384013fcd0 0x7f3840140150 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.939+0000 7f384815c640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f384015a850 0x7f384015ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.939+0000 7f384815c640 1 --2- 172.21.15.104:0/1251644667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f382c004800 0x7f384015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:11.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.939+0000 7f384815c640 1 -- 172.21.15.104:0/1251644667 >> 172.21.15.104:0/1251644667 conn(0x7f38400b13f0 msgr2=0x7f38400af260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:11.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.939+0000 7f384815c640 1 -- 172.21.15.104:0/1251644667 shutdown_connections 2024-05-08T04:23:11.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:11.939+0000 7f384815c640 1 -- 172.21.15.104:0/1251644667 wait complete. 2024-05-08T04:23:11.952 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:23:12.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.050+0000 7f5d7be4a640 1 Processor -- start 2024-05-08T04:23:12.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.050+0000 7f5d7be4a640 1 -- start start 2024-05-08T04:23:12.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d7be4a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d740ceee0 0x7f5d740b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d7be4a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5d7406e330 0x7f5d7406e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d7be4a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5d740b3ff0 0x7f5d740b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d7be4a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7415f390 con 0x7f5d7406e330 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d7be4a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d740b49c0 con 0x7f5d740b3ff0 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d7be4a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7415e780 con 0x7f5d740ceee0 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d793e5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5d7406e330 0x7f5d7406e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d793e5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5d7406e330 0x7f5d7406e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37926/0 (socket says 172.21.15.104:37926) 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d793e5640 1 -- 172.21.15.104:0/3301935631 learned_addr learned my addr 172.21.15.104:0/3301935631 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d79be6640 1 --2- 172.21.15.104:0/3301935631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d740ceee0 0x7f5d740b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d793e5640 1 -- 172.21.15.104:0/3301935631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d740ceee0 msgr2=0x7f5d740b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d793e5640 1 --2- 172.21.15.104:0/3301935631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d740ceee0 0x7f5d740b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d793e5640 1 -- 172.21.15.104:0/3301935631 >> v2:172.21.15.183:3300/0 conn(0x7f5d740b3ff0 msgr2=0x7f5d740b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.051+0000 7f5d7a3e7640 1 --2- 172.21.15.104:0/3301935631 >> v2:172.21.15.183:3300/0 conn(0x7f5d740b3ff0 0x7f5d740b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.052+0000 7f5d793e5640 1 --2- 172.21.15.104:0/3301935631 >> v2:172.21.15.183:3300/0 conn(0x7f5d740b3ff0 0x7f5d740b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.052+0000 7f5d793e5640 1 -- 172.21.15.104:0/3301935631 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7415ea60 con 0x7f5d7406e330 2024-05-08T04:23:12.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.052+0000 7f5d7a3e7640 1 --2- 172.21.15.104:0/3301935631 >> v2:172.21.15.183:3300/0 conn(0x7f5d740b3ff0 0x7f5d740b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:12.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.052+0000 7f5d793e5640 1 --2- 172.21.15.104:0/3301935631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d7406e330 0x7f5d7406e7b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009870 tx=0x7f5d6802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2cf1043e530e862 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:12.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.052+0000 7f5d78be4640 1 -- 172.21.15.104:0/3301935631 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68037070 con 0x7f5d7406e330 2024-05-08T04:23:12.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.052+0000 7f5d78be4640 1 -- 172.21.15.104:0/3301935631 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d68032440 con 0x7f5d7406e330 2024-05-08T04:23:12.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.052+0000 7f5d78be4640 1 -- 172.21.15.104:0/3301935631 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68032810 con 0x7f5d7406e330 2024-05-08T04:23:12.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.053+0000 7f5d7be4a640 1 -- 172.21.15.104:0/3301935631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d7406e330 msgr2=0x7f5d7406e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.053+0000 7f5d7be4a640 1 --2- 172.21.15.104:0/3301935631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d7406e330 0x7f5d7406e7b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009870 tx=0x7f5d6802a210 comp rx=0 tx=0).stop 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.053+0000 7f5d7be4a640 1 -- 172.21.15.104:0/3301935631 shutdown_connections 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.053+0000 7f5d7be4a640 1 --2- 172.21.15.104:0/3301935631 >> v2:172.21.15.183:3300/0 conn(0x7f5d740b3ff0 0x7f5d740b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.053+0000 7f5d7be4a640 1 --2- 172.21.15.104:0/3301935631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d7406e330 0x7f5d7406e7b0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.053+0000 7f5d7be4a640 1 --2- 172.21.15.104:0/3301935631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d740ceee0 0x7f5d740b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.053+0000 7f5d7be4a640 1 -- 172.21.15.104:0/3301935631 >> 172.21.15.104:0/3301935631 conn(0x7f5d740b13f0 msgr2=0x7f5d740b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.053+0000 7f5d7be4a640 1 -- 172.21.15.104:0/3301935631 shutdown_connections 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.053+0000 7f5d7be4a640 1 -- 172.21.15.104:0/3301935631 wait complete. 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.054+0000 7f5d7be4a640 1 Processor -- start 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.054+0000 7f5d7be4a640 1 -- start start 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d7be4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d7406e330 0x7f5d74156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d7be4a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d740b3ff0 0x7f5d7406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d7be4a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d740ceee0 0x7f5d7406d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d7be4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d740cf2c0 con 0x7f5d7406e330 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d7be4a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7415f020 con 0x7f5d740b3ff0 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d7be4a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d740cf440 con 0x7f5d740ceee0 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d79be6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d7406e330 0x7f5d74156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d79be6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d7406e330 0x7f5d74156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37940/0 (socket says 172.21.15.104:37940) 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d79be6640 1 -- 172.21.15.104:0/133572147 learned_addr learned my addr 172.21.15.104:0/133572147 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d79be6640 1 -- 172.21.15.104:0/133572147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d740ceee0 msgr2=0x7f5d7406d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d79be6640 1 --2- 172.21.15.104:0/133572147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d740ceee0 0x7f5d7406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d79be6640 1 -- 172.21.15.104:0/133572147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d740b3ff0 msgr2=0x7f5d7406d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d79be6640 1 --2- 172.21.15.104:0/133572147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d740b3ff0 0x7f5d7406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d79be6640 1 -- 172.21.15.104:0/133572147 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d74157750 con 0x7f5d7406e330 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.055+0000 7f5d79be6640 1 --2- 172.21.15.104:0/133572147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d7406e330 0x7f5d74156d00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400d5f0 tx=0x7f5d6400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.056+0000 7f5d727fc640 1 -- 172.21.15.104:0/133572147 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d640125f0 con 0x7f5d7406e330 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.056+0000 7f5d727fc640 1 -- 172.21.15.104:0/133572147 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d64019070 con 0x7f5d7406e330 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.056+0000 7f5d7be4a640 1 -- 172.21.15.104:0/133572147 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d74157a30 con 0x7f5d7406e330 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.056+0000 7f5d727fc640 1 -- 172.21.15.104:0/133572147 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d640129b0 con 0x7f5d7406e330 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.056+0000 7f5d7be4a640 1 -- 172.21.15.104:0/133572147 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d740718f0 con 0x7f5d7406e330 2024-05-08T04:23:12.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.057+0000 7f5d7be4a640 1 -- 172.21.15.104:0/133572147 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d74075010 con 0x7f5d7406e330 2024-05-08T04:23:12.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.057+0000 7f5d727fc640 1 -- 172.21.15.104:0/133572147 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f5d64012b50 con 0x7f5d7406e330 2024-05-08T04:23:12.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.058+0000 7f5d727fc640 1 --2- 172.21.15.104:0/133572147 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5d6006b680 0x7f5d6006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.058+0000 7f5d727fc640 1 -- 172.21.15.104:0/133572147 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f5d6408a950 con 0x7f5d7406e330 2024-05-08T04:23:12.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.058+0000 7f5d793e5640 1 --2- 172.21.15.104:0/133572147 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5d6006b680 0x7f5d6006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:12.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.058+0000 7f5d793e5640 1 --2- 172.21.15.104:0/133572147 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5d6006b680 0x7f5d6006db40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5d68034000 tx=0x7f5d6802c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:12.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.062+0000 7f5d727fc640 1 -- 172.21.15.104:0/133572147 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d64059550 con 0x7f5d7406e330 2024-05-08T04:23:12.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.270+0000 7f5d7be4a640 1 -- 172.21.15.104:0/133572147 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d740cb4b0 con 0x7f5d7406e330 2024-05-08T04:23:12.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.270+0000 7f5d727fc640 1 -- 172.21.15.104:0/133572147 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f5d64058e50 con 0x7f5d7406e330 2024-05-08T04:23:12.273 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:12.273 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:23:12.273 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:23:12.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.272+0000 7f5d7be4a640 1 -- 172.21.15.104:0/133572147 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5d6006b680 msgr2=0x7f5d6006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:12.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.272+0000 7f5d7be4a640 1 --2- 172.21.15.104:0/133572147 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5d6006b680 0x7f5d6006db40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5d68034000 tx=0x7f5d6802c000 comp rx=0 tx=0).stop 2024-05-08T04:23:12.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.272+0000 7f5d7be4a640 1 -- 172.21.15.104:0/133572147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d7406e330 msgr2=0x7f5d74156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:12.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.272+0000 7f5d7be4a640 1 --2- 172.21.15.104:0/133572147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d7406e330 0x7f5d74156d00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400d5f0 tx=0x7f5d6400dab0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.272+0000 7f5d7be4a640 1 -- 172.21.15.104:0/133572147 shutdown_connections 2024-05-08T04:23:12.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.272+0000 7f5d7be4a640 1 --2- 172.21.15.104:0/133572147 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5d6006b680 0x7f5d6006db40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.272+0000 7f5d7be4a640 1 --2- 172.21.15.104:0/133572147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d740b3ff0 0x7f5d7406d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.272+0000 7f5d7be4a640 1 --2- 172.21.15.104:0/133572147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d740ceee0 0x7f5d7406d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.272+0000 7f5d7be4a640 1 --2- 172.21.15.104:0/133572147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d7406e330 0x7f5d74156d00 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.272+0000 7f5d7be4a640 1 -- 172.21.15.104:0/133572147 >> 172.21.15.104:0/133572147 conn(0x7f5d740b13f0 msgr2=0x7f5d740cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:12.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.272+0000 7f5d7be4a640 1 -- 172.21.15.104:0/133572147 shutdown_connections 2024-05-08T04:23:12.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.272+0000 7f5d7be4a640 1 -- 172.21.15.104:0/133572147 wait complete. 2024-05-08T04:23:12.285 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:23:12.400 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.482994543,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.976009678280761,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:23:12.401 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.97600967828076 }, "state": "open", "uptime": 0.482994543 } ] 2024-05-08T04:23:12.401 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:23:12.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.498+0000 7f437ad16640 1 Processor -- start 2024-05-08T04:23:12.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.498+0000 7f437ad16640 1 -- start start 2024-05-08T04:23:12.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.499+0000 7f437ad16640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f437415ebf0 0x7f4374166830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.499+0000 7f437ad16640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437415d420 con 0x7f43740d0970 2024-05-08T04:23:12.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.499+0000 7f437ad16640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43740d0e20 con 0x7f4374070c70 2024-05-08T04:23:12.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.499+0000 7f437ad16640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43740d16a0 con 0x7f437415ebf0 2024-05-08T04:23:12.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.499+0000 7f4373fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f43740d0970 0x7f437415c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:57368/0 (socket says 172.21.15.104:57368) 2024-05-08T04:23:12.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.499+0000 7f4373fff640 1 -- 172.21.15.104:0/3176737633 learned_addr learned my addr 172.21.15.104:0/3176737633 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:12.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.499+0000 7f43792b3640 1 --2- 172.21.15.104:0/3176737633 >> v2:172.21.15.183:3300/0 conn(0x7f437415ebf0 0x7f4374166830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559474904 0 0) 0x7f437415d420 con 0x7f43740d0970 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f435c003520 con 0x7f43740d0970 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3640168409 0 0) 0x7f435c003520 con 0x7f43740d0970 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 >> v2:172.21.15.183:3300/0 conn(0x7f437415ebf0 msgr2=0x7f4374166830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 --2- 172.21.15.104:0/3176737633 >> v2:172.21.15.183:3300/0 conn(0x7f437415ebf0 0x7f4374166830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 >> v1:172.21.15.183:6789/0 conn(0x7f4374070c70 legacy=0x7f4374071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43740d10e0 con 0x7f43740d0970 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f4368001690 con 0x7f43740d0970 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 >> v1:172.21.15.104:6789/0 conn(0x7f43740d0970 legacy=0x7f437415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 --2- 172.21.15.104:0/3176737633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c0039b0 0x7f435c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 --2- 172.21.15.104:0/3176737633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f435c004800 0x7f435c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 --2- 172.21.15.104:0/3176737633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f435c0051c0 0x7f435c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43740d16a0 con 0x7f435c004800 2024-05-08T04:23:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c00c160 con 0x7f435c0039b0 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c00c360 con 0x7f435c0051c0 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43792b3640 1 --2- 172.21.15.104:0/3176737633 >> v2:172.21.15.183:3300/0 conn(0x7f437415ebf0 0x7f4374166830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f4373fff640 1 --2- 172.21.15.104:0/3176737633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f435c004800 0x7f435c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f4378ab2640 1 --2- 172.21.15.104:0/3176737633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c0039b0 0x7f435c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43792b3640 1 --2- 172.21.15.104:0/3176737633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f435c0051c0 0x7f435c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f4373fff640 1 -- 172.21.15.104:0/3176737633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f435c0051c0 msgr2=0x7f435c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f4373fff640 1 --2- 172.21.15.104:0/3176737633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f435c0051c0 0x7f435c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f4373fff640 1 -- 172.21.15.104:0/3176737633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c0039b0 msgr2=0x7f435c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f4373fff640 1 --2- 172.21.15.104:0/3176737633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c0039b0 0x7f435c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f4373fff640 1 -- 172.21.15.104:0/3176737633 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c003520 con 0x7f435c004800 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43792b3640 1 --2- 172.21.15.104:0/3176737633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f435c0051c0 0x7f435c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f4378ab2640 1 --2- 172.21.15.104:0/3176737633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c0039b0 0x7f435c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.500+0000 7f43792b3640 1 -- 172.21.15.104:0/3176737633 reap_dead start 2024-05-08T04:23:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.501+0000 7f4373fff640 1 --2- 172.21.15.104:0/3176737633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f435c004800 0x7f435c004c80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f436800c210 tx=0x7f435c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec27b916173586bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.501+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368007d10 con 0x7f435c004800 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.501+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4368005af0 con 0x7f435c004800 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.501+0000 7f43737fe640 1 -- 172.21.15.104:0/3176737633 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368007070 con 0x7f435c004800 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.502+0000 7f437ad16640 1 -- 172.21.15.104:0/3176737633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f435c004800 msgr2=0x7f435c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.502+0000 7f437ad16640 1 --2- 172.21.15.104:0/3176737633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f435c004800 0x7f435c004c80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f436800c210 tx=0x7f435c005830 comp rx=0 tx=0).stop 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.502+0000 7f437ad16640 1 -- 172.21.15.104:0/3176737633 shutdown_connections 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.502+0000 7f437ad16640 1 --2- 172.21.15.104:0/3176737633 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f435c004800 0x7f435c004c80 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.502+0000 7f437ad16640 1 -- 172.21.15.104:0/3176737633 >> 172.21.15.104:0/3176737633 conn(0x7f43740b3450 msgr2=0x7f43740b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.502+0000 7f437ad16640 1 -- 172.21.15.104:0/3176737633 shutdown_connections 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.502+0000 7f437ad16640 1 -- 172.21.15.104:0/3176737633 wait complete. 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.503+0000 7f437ad16640 1 Processor -- start 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.503+0000 7f437ad16640 1 -- start start 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f437ad16640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c004800 0x7f437413f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f437ad16640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f437414ced0 0x7f437414d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f437ad16640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f437414dc90 0x7f437414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f437ad16640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4374071050 con 0x7f437414ced0 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f437ad16640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437415d6c0 con 0x7f435c004800 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f437ad16640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43740711d0 con 0x7f437414dc90 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f4373fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f437414ced0 0x7f437414d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f4373fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f437414ced0 0x7f437414d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37962/0 (socket says 172.21.15.104:37962) 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f4373fff640 1 -- 172.21.15.104:0/3484006749 learned_addr learned my addr 172.21.15.104:0/3484006749 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f43792b3640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f437414dc90 0x7f437414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f4378ab2640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c004800 0x7f437413f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f4373fff640 1 -- 172.21.15.104:0/3484006749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f437414dc90 msgr2=0x7f437414f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f4373fff640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f437414dc90 0x7f437414f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f4373fff640 1 -- 172.21.15.104:0/3484006749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c004800 msgr2=0x7f437413f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f4373fff640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c004800 0x7f437413f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f4373fff640 1 -- 172.21.15.104:0/3484006749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4374154bf0 con 0x7f437414ced0 2024-05-08T04:23:12.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f4378ab2640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c004800 0x7f437413f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f4373fff640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f437414ced0 0x7f437414d750 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4368001990 tx=0x7f43740b0a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f43717fa640 1 -- 172.21.15.104:0/3484006749 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368037040 con 0x7f437414ced0 2024-05-08T04:23:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f43717fa640 1 -- 172.21.15.104:0/3484006749 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4368041070 con 0x7f437414ced0 2024-05-08T04:23:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f43717fa640 1 -- 172.21.15.104:0/3484006749 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368001690 con 0x7f437414ced0 2024-05-08T04:23:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f437ad16640 1 -- 172.21.15.104:0/3484006749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4374154ed0 con 0x7f437414ced0 2024-05-08T04:23:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.504+0000 7f437ad16640 1 -- 172.21.15.104:0/3484006749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4374155490 con 0x7f437414ced0 2024-05-08T04:23:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.505+0000 7f437ad16640 1 -- 172.21.15.104:0/3484006749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4374075010 con 0x7f437414ced0 2024-05-08T04:23:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.506+0000 7f43717fa640 1 -- 172.21.15.104:0/3484006749 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 7) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f43680049e0 con 0x7f437414ced0 2024-05-08T04:23:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.506+0000 7f43717fa640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f436006b680 0x7f436006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.507+0000 7f4378ab2640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f436006b680 0x7f436006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.507+0000 7f43717fa640 1 -- 172.21.15.104:0/3484006749 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f43680aa260 con 0x7f437414ced0 2024-05-08T04:23:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.507+0000 7f4378ab2640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f436006b680 0x7f436006db40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4364000f80 tx=0x7f4364009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:12.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.511+0000 7f43717fa640 1 -- 172.21.15.104:0/3484006749 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4368078dd0 con 0x7f437414ced0 2024-05-08T04:23:12.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.714+0000 7f437ad16640 1 -- 172.21.15.104:0/3484006749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43741528c0 con 0x7f437414ced0 2024-05-08T04:23:12.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.715+0000 7f43717fa640 1 -- 172.21.15.104:0/3484006749 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f43680786d0 con 0x7f437414ced0 2024-05-08T04:23:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:12.717 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:23:12.718 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:23:12.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.717+0000 7f437ad16640 1 -- 172.21.15.104:0/3484006749 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f436006b680 msgr2=0x7f436006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:12.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.717+0000 7f437ad16640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f436006b680 0x7f436006db40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4364000f80 tx=0x7f4364009040 comp rx=0 tx=0).stop 2024-05-08T04:23:12.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.717+0000 7f437ad16640 1 -- 172.21.15.104:0/3484006749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f437414ced0 msgr2=0x7f437414d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:12.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.717+0000 7f437ad16640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f437414ced0 0x7f437414d750 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4368001990 tx=0x7f43740b0a00 comp rx=0 tx=0).stop 2024-05-08T04:23:12.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.717+0000 7f437ad16640 1 -- 172.21.15.104:0/3484006749 shutdown_connections 2024-05-08T04:23:12.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.717+0000 7f437ad16640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f436006b680 0x7f436006db40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.717+0000 7f437ad16640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f437414dc90 0x7f437414f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.717+0000 7f437ad16640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f437414ced0 0x7f437414d750 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.717+0000 7f437ad16640 1 --2- 172.21.15.104:0/3484006749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f435c004800 0x7f437413f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:12.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.717+0000 7f437ad16640 1 -- 172.21.15.104:0/3484006749 >> 172.21.15.104:0/3484006749 conn(0x7f43740b3450 msgr2=0x7f43740b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:12.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.717+0000 7f437ad16640 1 -- 172.21.15.104:0/3484006749 shutdown_connections 2024-05-08T04:23:12.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:12.717+0000 7f437ad16640 1 -- 172.21.15.104:0/3484006749 wait complete. 2024-05-08T04:23:12.730 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:23:12.846 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.92898950400000002,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.953375785614899,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:23:12.846 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.9533757856149 }, "state": "open", "uptime": 0.928989504 } ] 2024-05-08T04:23:12.846 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-05-08T04:23:17.847 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:23:17.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.956+0000 7fab70c4a640 1 Processor -- start 2024-05-08T04:23:17.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.956+0000 7fab70c4a640 1 -- start start 2024-05-08T04:23:17.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab70c4a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fab6c0ceee0 0x7fab6c0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:17.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab70c4a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab6c0b4700 0x7fab6c06e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:17.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab70c4a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c15e780 con 0x7fab6c06e330 2024-05-08T04:23:17.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab70c4a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c15f390 con 0x7fab6c0ceee0 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab70c4a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c15ea60 con 0x7fab6c0b4700 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab6a59c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fab6c0ceee0 0x7fab6c0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab61d9b640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fab6c06e330 0x7fab6c0b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:34574/0 (socket says 172.21.15.104:34574) 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab61d9b640 1 -- 172.21.15.104:0/1093095359 learned_addr learned my addr 172.21.15.104:0/1093095359 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab6a59c640 1 -- 172.21.15.104:0/1093095359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab6c0b4700 msgr2=0x7fab6c06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab6ad9d640 1 --2- 172.21.15.104:0/1093095359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab6c0b4700 0x7fab6c06e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab6a59c640 1 --2- 172.21.15.104:0/1093095359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab6c0b4700 0x7fab6c06e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab6a59c640 1 -- 172.21.15.104:0/1093095359 >> v1:172.21.15.104:6789/0 conn(0x7fab6c06e330 legacy=0x7fab6c0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab69d9b640 1 -- 172.21.15.104:0/1093095359 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983488278 0 0) 0x7fab6c15e780 con 0x7fab6c06e330 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab6a59c640 1 -- 172.21.15.104:0/1093095359 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c15ed40 con 0x7fab6c0ceee0 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.957+0000 7fab6ad9d640 1 --2- 172.21.15.104:0/1093095359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab6c0b4700 0x7fab6c06e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.958+0000 7fab6a59c640 1 --2- 172.21.15.104:0/1093095359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0ceee0 0x7fab6c0b26f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0097a0 tx=0x7fab5c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761f37eb9ea56dfb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.958+0000 7fab69d9b640 1 -- 172.21.15.104:0/1093095359 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c037070 con 0x7fab6c0ceee0 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.958+0000 7fab69d9b640 1 -- 172.21.15.104:0/1093095359 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c032440 con 0x7fab6c0ceee0 2024-05-08T04:23:17.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.958+0000 7fab69d9b640 1 -- 172.21.15.104:0/1093095359 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c032810 con 0x7fab6c0ceee0 2024-05-08T04:23:17.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.959+0000 7fab70c4a640 1 -- 172.21.15.104:0/1093095359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0ceee0 msgr2=0x7fab6c0b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:17.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.959+0000 7fab70c4a640 1 --2- 172.21.15.104:0/1093095359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0ceee0 0x7fab6c0b26f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0097a0 tx=0x7fab5c02a180 comp rx=0 tx=0).stop 2024-05-08T04:23:17.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.959+0000 7fab70c4a640 1 -- 172.21.15.104:0/1093095359 shutdown_connections 2024-05-08T04:23:17.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.959+0000 7fab70c4a640 1 --2- 172.21.15.104:0/1093095359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab6c0b4700 0x7fab6c06e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:17.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.959+0000 7fab70c4a640 1 --2- 172.21.15.104:0/1093095359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0ceee0 0x7fab6c0b26f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:17.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.959+0000 7fab70c4a640 1 -- 172.21.15.104:0/1093095359 >> 172.21.15.104:0/1093095359 conn(0x7fab6c0b13f0 msgr2=0x7fab6c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:17.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.959+0000 7fab70c4a640 1 -- 172.21.15.104:0/1093095359 shutdown_connections 2024-05-08T04:23:17.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.959+0000 7fab70c4a640 1 -- 172.21.15.104:0/1093095359 wait complete. 2024-05-08T04:23:17.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.960+0000 7fab70c4a640 1 Processor -- start 2024-05-08T04:23:17.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.960+0000 7fab70c4a640 1 -- start start 2024-05-08T04:23:17.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.961+0000 7fab70c4a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab6c06e330 0x7fab6c14fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:17.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.961+0000 7fab70c4a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab6c0b4700 0x7fab6c14b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:17.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.961+0000 7fab70c4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0ceee0 0x7fab6c14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:17.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.961+0000 7fab70c4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0cf440 con 0x7fab6c0ceee0 2024-05-08T04:23:17.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.961+0000 7fab70c4a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c0cf2c0 con 0x7fab6c06e330 2024-05-08T04:23:17.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.961+0000 7fab70c4a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c15b210 con 0x7fab6c0b4700 2024-05-08T04:23:17.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.961+0000 7fab6ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0ceee0 0x7fab6c14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:17.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.961+0000 7fab6ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0ceee0 0x7fab6c14f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51172/0 (socket says 172.21.15.104:51172) 2024-05-08T04:23:17.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.961+0000 7fab6ad9d640 1 -- 172.21.15.104:0/94900810 learned_addr learned my addr 172.21.15.104:0/94900810 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:17.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab6a59c640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab6c06e330 0x7fab6c14fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:17.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab61d9b640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab6c0b4700 0x7fab6c14b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:17.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab6ad9d640 1 -- 172.21.15.104:0/94900810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab6c0b4700 msgr2=0x7fab6c14b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:17.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab6ad9d640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab6c0b4700 0x7fab6c14b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:17.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab6ad9d640 1 -- 172.21.15.104:0/94900810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab6c06e330 msgr2=0x7fab6c14fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:17.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab6ad9d640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab6c06e330 0x7fab6c14fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:17.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab6ad9d640 1 -- 172.21.15.104:0/94900810 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c14fcc0 con 0x7fab6c0ceee0 2024-05-08T04:23:17.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab6a59c640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab6c06e330 0x7fab6c14fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:17.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab6ad9d640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0ceee0 0x7fab6c14f4c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fab6400cf20 tx=0x7fab6400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:17.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab637fe640 1 -- 172.21.15.104:0/94900810 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6401a070 con 0x7fab6c0ceee0 2024-05-08T04:23:17.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab637fe640 1 -- 172.21.15.104:0/94900810 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6400d840 con 0x7fab6c0ceee0 2024-05-08T04:23:17.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab70c4a640 1 -- 172.21.15.104:0/94900810 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c14fa00 con 0x7fab6c0ceee0 2024-05-08T04:23:17.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab637fe640 1 -- 172.21.15.104:0/94900810 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400dc30 con 0x7fab6c0ceee0 2024-05-08T04:23:17.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.962+0000 7fab70c4a640 1 -- 172.21.15.104:0/94900810 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c15cc20 con 0x7fab6c0ceee0 2024-05-08T04:23:17.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.963+0000 7fab70c4a640 1 -- 172.21.15.104:0/94900810 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c075010 con 0x7fab6c0ceee0 2024-05-08T04:23:17.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.964+0000 7fab637fe640 1 -- 172.21.15.104:0/94900810 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 8) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fab6401d070 con 0x7fab6c0ceee0 2024-05-08T04:23:17.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.964+0000 7fab637fe640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fab4c06b710 0x7fab4c06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:17.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.964+0000 7fab637fe640 1 -- 172.21.15.104:0/94900810 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fab6408aeb0 con 0x7fab6c0ceee0 2024-05-08T04:23:17.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.964+0000 7fab6a59c640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fab4c06b710 0x7fab4c06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:17.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.964+0000 7fab6a59c640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fab4c06b710 0x7fab4c06dbd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fab5c034000 tx=0x7fab5c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:17.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:17.968+0000 7fab637fe640 1 -- 172.21.15.104:0/94900810 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab640599d0 con 0x7fab6c0ceee0 2024-05-08T04:23:18.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.177+0000 7fab70c4a640 1 -- 172.21.15.104:0/94900810 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab6c06f3f0 con 0x7fab6c0ceee0 2024-05-08T04:23:18.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.177+0000 7fab637fe640 1 -- 172.21.15.104:0/94900810 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fab640592d0 con 0x7fab6c0ceee0 2024-05-08T04:23:18.180 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:18.180 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:23:18.180 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:23:18.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.179+0000 7fab70c4a640 1 -- 172.21.15.104:0/94900810 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fab4c06b710 msgr2=0x7fab4c06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:18.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.179+0000 7fab70c4a640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fab4c06b710 0x7fab4c06dbd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fab5c034000 tx=0x7fab5c02e000 comp rx=0 tx=0).stop 2024-05-08T04:23:18.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.179+0000 7fab70c4a640 1 -- 172.21.15.104:0/94900810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0ceee0 msgr2=0x7fab6c14f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:18.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.179+0000 7fab70c4a640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0ceee0 0x7fab6c14f4c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fab6400cf20 tx=0x7fab6400a7d0 comp rx=0 tx=0).stop 2024-05-08T04:23:18.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.179+0000 7fab70c4a640 1 -- 172.21.15.104:0/94900810 shutdown_connections 2024-05-08T04:23:18.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.179+0000 7fab70c4a640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fab4c06b710 0x7fab4c06dbd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:18.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.179+0000 7fab70c4a640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c0ceee0 0x7fab6c14f4c0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:18.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.179+0000 7fab70c4a640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fab6c0b4700 0x7fab6c14b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:18.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.179+0000 7fab70c4a640 1 --2- 172.21.15.104:0/94900810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fab6c06e330 0x7fab6c14fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:18.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.179+0000 7fab70c4a640 1 -- 172.21.15.104:0/94900810 >> 172.21.15.104:0/94900810 conn(0x7fab6c0b13f0 msgr2=0x7fab6c0cc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:18.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.179+0000 7fab70c4a640 1 -- 172.21.15.104:0/94900810 shutdown_connections 2024-05-08T04:23:18.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:18.179+0000 7fab70c4a640 1 -- 172.21.15.104:0/94900810 wait complete. 2024-05-08T04:23:18.193 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:23:18.309 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":6.3919277829999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.678020227394263,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:23:18.310 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.678020227394263 }, "state": "open", "uptime": 6.391927783 } ] 2024-05-08T04:23:18.310 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-05-08T04:23:23.311 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:23:23.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.420+0000 7fb8702e1640 1 Processor -- start 2024-05-08T04:23:23.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.420+0000 7fb8702e1640 1 -- start start 2024-05-08T04:23:23.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.421+0000 7fb8702e1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb86815de10 0x7fb868161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:23.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.421+0000 7fb8702e1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb8680ce5a0 0x7fb8680d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:23.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.421+0000 7fb8702e1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8680d05f0 0x7fb8680b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:23.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.421+0000 7fb8702e1640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8680d0f50 con 0x7fb8680ce5a0 2024-05-08T04:23:23.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.421+0000 7fb8702e1640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb868161e60 con 0x7fb86815de10 2024-05-08T04:23:23.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.421+0000 7fb8702e1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680d1a90 con 0x7fb8680d05f0 2024-05-08T04:23:23.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.422+0000 7fb86d87c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb8680ce5a0 0x7fb8680d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:23.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.422+0000 7fb86d87c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb8680ce5a0 0x7fb8680d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51176/0 (socket says 172.21.15.104:51176) 2024-05-08T04:23:23.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.422+0000 7fb86d87c640 1 -- 172.21.15.104:0/2200722194 learned_addr learned my addr 172.21.15.104:0/2200722194 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:23.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.422+0000 7fb86e87e640 1 --2- 172.21.15.104:0/2200722194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8680d05f0 0x7fb8680b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:23.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.422+0000 7fb86e07d640 1 --2- 172.21.15.104:0/2200722194 >> v2:172.21.15.183:3300/0 conn(0x7fb86815de10 0x7fb868161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:23.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.422+0000 7fb86d87c640 1 -- 172.21.15.104:0/2200722194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8680d05f0 msgr2=0x7fb8680b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:23.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.422+0000 7fb86d87c640 1 --2- 172.21.15.104:0/2200722194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8680d05f0 0x7fb8680b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:23.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.422+0000 7fb86d87c640 1 -- 172.21.15.104:0/2200722194 >> v2:172.21.15.183:3300/0 conn(0x7fb86815de10 msgr2=0x7fb868161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:23.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.422+0000 7fb86d87c640 1 --2- 172.21.15.104:0/2200722194 >> v2:172.21.15.183:3300/0 conn(0x7fb86815de10 0x7fb868161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:23.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.422+0000 7fb86d87c640 1 -- 172.21.15.104:0/2200722194 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86815e1f0 con 0x7fb8680ce5a0 2024-05-08T04:23:23.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.423+0000 7fb86d87c640 1 --2- 172.21.15.104:0/2200722194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8680ce5a0 0x7fb8680d00b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb8680d15a0 tx=0x7fb85802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a982dcbff6ccca91 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:23.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.423+0000 7fb86d07b640 1 -- 172.21.15.104:0/2200722194 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858037070 con 0x7fb8680ce5a0 2024-05-08T04:23:23.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.423+0000 7fb86d07b640 1 -- 172.21.15.104:0/2200722194 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858032440 con 0x7fb8680ce5a0 2024-05-08T04:23:23.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.423+0000 7fb86d07b640 1 -- 172.21.15.104:0/2200722194 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858032810 con 0x7fb8680ce5a0 2024-05-08T04:23:23.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.423+0000 7fb8702e1640 1 -- 172.21.15.104:0/2200722194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8680ce5a0 msgr2=0x7fb8680d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:23.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.423+0000 7fb8702e1640 1 --2- 172.21.15.104:0/2200722194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8680ce5a0 0x7fb8680d00b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb8680d15a0 tx=0x7fb85802a140 comp rx=0 tx=0).stop 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.423+0000 7fb8702e1640 1 -- 172.21.15.104:0/2200722194 shutdown_connections 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.423+0000 7fb8702e1640 1 --2- 172.21.15.104:0/2200722194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8680d05f0 0x7fb8680b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.423+0000 7fb8702e1640 1 --2- 172.21.15.104:0/2200722194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8680ce5a0 0x7fb8680d00b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.423+0000 7fb8702e1640 1 --2- 172.21.15.104:0/2200722194 >> v2:172.21.15.183:3300/0 conn(0x7fb86815de10 0x7fb868161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.423+0000 7fb8702e1640 1 -- 172.21.15.104:0/2200722194 >> 172.21.15.104:0/2200722194 conn(0x7fb868072290 msgr2=0x7fb868072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.423+0000 7fb8702e1640 1 -- 172.21.15.104:0/2200722194 shutdown_connections 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.423+0000 7fb8702e1640 1 -- 172.21.15.104:0/2200722194 wait complete. 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.425+0000 7fb8702e1640 1 Processor -- start 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.425+0000 7fb8702e1640 1 -- start start 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.425+0000 7fb8702e1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8680ce5a0 0x7fb86815ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.425+0000 7fb8702e1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8680d05f0 0x7fb86813e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.425+0000 7fb8702e1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb86815de10 0x7fb8680cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.425+0000 7fb8702e1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb868162370 con 0x7fb8680ce5a0 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.425+0000 7fb8702e1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb868162090 con 0x7fb86815de10 2024-05-08T04:23:23.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.425+0000 7fb8702e1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb868162650 con 0x7fb8680d05f0 2024-05-08T04:23:23.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.425+0000 7fb86e07d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8680ce5a0 0x7fb86815ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:23.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.425+0000 7fb86e07d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8680ce5a0 0x7fb86815ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51190/0 (socket says 172.21.15.104:51190) 2024-05-08T04:23:23.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.425+0000 7fb86e07d640 1 -- 172.21.15.104:0/1891194165 learned_addr learned my addr 172.21.15.104:0/1891194165 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:23.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.426+0000 7fb86e07d640 1 -- 172.21.15.104:0/1891194165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8680d05f0 msgr2=0x7fb86813e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:23.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.426+0000 7fb86e07d640 1 --2- 172.21.15.104:0/1891194165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8680d05f0 0x7fb86813e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:23.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.426+0000 7fb86e07d640 1 -- 172.21.15.104:0/1891194165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb86815de10 msgr2=0x7fb8680cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:23.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.426+0000 7fb86e07d640 1 --2- 172.21.15.104:0/1891194165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb86815de10 0x7fb8680cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:23.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.426+0000 7fb86e07d640 1 -- 172.21.15.104:0/1891194165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8680cac90 con 0x7fb8680ce5a0 2024-05-08T04:23:23.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.426+0000 7fb86e07d640 1 --2- 172.21.15.104:0/1891194165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8680ce5a0 0x7fb86815ee30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb864007e40 tx=0x7fb86400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:23.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.426+0000 7fb85effd640 1 -- 172.21.15.104:0/1891194165 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864014620 con 0x7fb8680ce5a0 2024-05-08T04:23:23.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.426+0000 7fb85effd640 1 -- 172.21.15.104:0/1891194165 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb864019070 con 0x7fb8680ce5a0 2024-05-08T04:23:23.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.426+0000 7fb8702e1640 1 -- 172.21.15.104:0/1891194165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86813ed00 con 0x7fb8680ce5a0 2024-05-08T04:23:23.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.426+0000 7fb85effd640 1 -- 172.21.15.104:0/1891194165 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864014a00 con 0x7fb8680ce5a0 2024-05-08T04:23:23.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.426+0000 7fb8702e1640 1 -- 172.21.15.104:0/1891194165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86813f2c0 con 0x7fb8680ce5a0 2024-05-08T04:23:23.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.427+0000 7fb8702e1640 1 -- 172.21.15.104:0/1891194165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb868075010 con 0x7fb8680ce5a0 2024-05-08T04:23:23.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.427+0000 7fb85effd640 1 -- 172.21.15.104:0/1891194165 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 8) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fb864014ba0 con 0x7fb8680ce5a0 2024-05-08T04:23:23.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.428+0000 7fb85effd640 1 --2- 172.21.15.104:0/1891194165 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb84c06b710 0x7fb84c06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:23.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.428+0000 7fb85effd640 1 -- 172.21.15.104:0/1891194165 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fb86408ada0 con 0x7fb8680ce5a0 2024-05-08T04:23:23.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.428+0000 7fb86d87c640 1 --2- 172.21.15.104:0/1891194165 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb84c06b710 0x7fb84c06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:23.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.428+0000 7fb86d87c640 1 --2- 172.21.15.104:0/1891194165 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb84c06b710 0x7fb84c06dbd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb858034000 tx=0x7fb85802c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:23.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.432+0000 7fb85effd640 1 -- 172.21.15.104:0/1891194165 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb864059990 con 0x7fb8680ce5a0 2024-05-08T04:23:23.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.638+0000 7fb8702e1640 1 -- 172.21.15.104:0/1891194165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb86813f500 con 0x7fb8680ce5a0 2024-05-08T04:23:23.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.639+0000 7fb85effd640 1 -- 172.21.15.104:0/1891194165 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fb864059290 con 0x7fb8680ce5a0 2024-05-08T04:23:23.641 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:23.641 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:23:23.641 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:23:23.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.641+0000 7fb8702e1640 1 -- 172.21.15.104:0/1891194165 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb84c06b710 msgr2=0x7fb84c06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:23.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.641+0000 7fb8702e1640 1 --2- 172.21.15.104:0/1891194165 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb84c06b710 0x7fb84c06dbd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb858034000 tx=0x7fb85802c000 comp rx=0 tx=0).stop 2024-05-08T04:23:23.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.641+0000 7fb8702e1640 1 -- 172.21.15.104:0/1891194165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8680ce5a0 msgr2=0x7fb86815ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:23.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.641+0000 7fb8702e1640 1 --2- 172.21.15.104:0/1891194165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8680ce5a0 0x7fb86815ee30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb864007e40 tx=0x7fb86400e4b0 comp rx=0 tx=0).stop 2024-05-08T04:23:23.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.641+0000 7fb8702e1640 1 -- 172.21.15.104:0/1891194165 shutdown_connections 2024-05-08T04:23:23.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.641+0000 7fb8702e1640 1 --2- 172.21.15.104:0/1891194165 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb84c06b710 0x7fb84c06dbd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:23.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.641+0000 7fb8702e1640 1 --2- 172.21.15.104:0/1891194165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb86815de10 0x7fb8680cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:23.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.641+0000 7fb8702e1640 1 --2- 172.21.15.104:0/1891194165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8680d05f0 0x7fb86813e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:23.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.641+0000 7fb8702e1640 1 --2- 172.21.15.104:0/1891194165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8680ce5a0 0x7fb86815ee30 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:23.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.641+0000 7fb8702e1640 1 -- 172.21.15.104:0/1891194165 >> 172.21.15.104:0/1891194165 conn(0x7fb868072290 msgr2=0x7fb86815cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:23.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.641+0000 7fb8702e1640 1 -- 172.21.15.104:0/1891194165 shutdown_connections 2024-05-08T04:23:23.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:23.641+0000 7fb8702e1640 1 -- 172.21.15.104:0/1891194165 wait complete. 2024-05-08T04:23:23.654 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:23:23.770 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":11.852866083,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.406217299731935,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:23:23.773 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.406217299731935 }, "state": "open", "uptime": 11.852866083 } ] 2024-05-08T04:23:23.773 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-05-08T04:23:28.774 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:23:28.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.884+0000 7f269db6a640 1 Processor -- start 2024-05-08T04:23:28.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.884+0000 7f269db6a640 1 -- start start 2024-05-08T04:23:28.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.885+0000 7f269db6a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f26980711c0 0x7f269806d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:28.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.885+0000 7f269db6a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2698071fb0 con 0x7f2698144c80 2024-05-08T04:23:28.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.885+0000 7f269db6a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2698071710 con 0x7f26980cc930 2024-05-08T04:23:28.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.885+0000 7f269db6a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26980719f0 con 0x7f26980711c0 2024-05-08T04:23:28.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.885+0000 7f2696ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f26980711c0 0x7f269806d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:28.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.885+0000 7f2697fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f2698144c80 0x7f269806dd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:52802/0 (socket says 172.21.15.104:52802) 2024-05-08T04:23:28.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.885+0000 7f2697fff640 1 -- 172.21.15.104:0/450576488 learned_addr learned my addr 172.21.15.104:0/450576488 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:28.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.886+0000 7f2696ffd640 1 -- 172.21.15.104:0/450576488 >> v1:172.21.15.183:6789/0 conn(0x7f26980cc930 legacy=0x7f26980ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:28.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.886+0000 7f2696ffd640 1 -- 172.21.15.104:0/450576488 >> v1:172.21.15.104:6789/0 conn(0x7f2698144c80 legacy=0x7f269806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:28.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.886+0000 7f2696ffd640 1 -- 172.21.15.104:0/450576488 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2698071cd0 con 0x7f26980711c0 2024-05-08T04:23:28.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.886+0000 7f26967fc640 1 -- 172.21.15.104:0/450576488 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255778395 0 0) 0x7f2698071fb0 con 0x7f2698144c80 2024-05-08T04:23:28.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.886+0000 7f2696ffd640 1 --2- 172.21.15.104:0/450576488 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26980711c0 0x7f269806d850 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f268c009d90 tx=0x7f268c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4a26963d2ff5d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:28.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.886+0000 7f26967fc640 1 -- 172.21.15.104:0/450576488 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c031600 con 0x7f26980711c0 2024-05-08T04:23:28.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.886+0000 7f26967fc640 1 -- 172.21.15.104:0/450576488 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268c0317a0 con 0x7f26980711c0 2024-05-08T04:23:28.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.886+0000 7f26967fc640 1 -- 172.21.15.104:0/450576488 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c031b70 con 0x7f26980711c0 2024-05-08T04:23:28.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.887+0000 7f269db6a640 1 -- 172.21.15.104:0/450576488 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26980711c0 msgr2=0x7f269806d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:28.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.887+0000 7f269db6a640 1 --2- 172.21.15.104:0/450576488 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26980711c0 0x7f269806d850 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f268c009d90 tx=0x7f268c02a610 comp rx=0 tx=0).stop 2024-05-08T04:23:28.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.887+0000 7f269db6a640 1 -- 172.21.15.104:0/450576488 shutdown_connections 2024-05-08T04:23:28.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.887+0000 7f269db6a640 1 --2- 172.21.15.104:0/450576488 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26980711c0 0x7f269806d850 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:28.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.887+0000 7f269db6a640 1 -- 172.21.15.104:0/450576488 >> 172.21.15.104:0/450576488 conn(0x7f26980b13f0 msgr2=0x7f26980b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:28.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.887+0000 7f269db6a640 1 -- 172.21.15.104:0/450576488 shutdown_connections 2024-05-08T04:23:28.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.887+0000 7f269db6a640 1 -- 172.21.15.104:0/450576488 wait complete. 2024-05-08T04:23:28.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.888+0000 7f269db6a640 1 Processor -- start 2024-05-08T04:23:28.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.888+0000 7f269db6a640 1 -- start start 2024-05-08T04:23:28.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.889+0000 7f269db6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26980711c0 0x7f26980aa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:28.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.889+0000 7f269db6a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26980cc930 0x7f269815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:28.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.889+0000 7f269db6a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2698144c80 0x7f26980c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:28.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.889+0000 7f269db6a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26981453f0 con 0x7f2698144c80 2024-05-08T04:23:28.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.889+0000 7f269db6a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26980cf3b0 con 0x7f26980cc930 2024-05-08T04:23:28.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.889+0000 7f269db6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269806e4a0 con 0x7f26980711c0 2024-05-08T04:23:28.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.889+0000 7f2697fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2698144c80 0x7f26980c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:28.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.889+0000 7f2697fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2698144c80 0x7f26980c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:58302/0 (socket says 172.21.15.104:58302) 2024-05-08T04:23:28.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.889+0000 7f2697fff640 1 -- 172.21.15.104:0/3362695980 learned_addr learned my addr 172.21.15.104:0/3362695980 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:28.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.890+0000 7f2696ffd640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26980cc930 0x7f269815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.890+0000 7f2697fff640 1 -- 172.21.15.104:0/3362695980 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26980711c0 msgr2=0x7f26980aa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.890+0000 7f26977fe640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26980711c0 0x7f26980aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.890+0000 7f2697fff640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26980711c0 0x7f26980aa170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.890+0000 7f2697fff640 1 -- 172.21.15.104:0/3362695980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26980cc930 msgr2=0x7f269815f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.890+0000 7f2697fff640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26980cc930 0x7f269815f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.890+0000 7f2697fff640 1 -- 172.21.15.104:0/3362695980 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26980aa8c0 con 0x7f2698144c80 2024-05-08T04:23:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.890+0000 7f2697fff640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2698144c80 0x7f26980c58b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2690001eb0 tx=0x7f269000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.890+0000 7f267ffff640 1 -- 172.21.15.104:0/3362695980 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26900074e0 con 0x7f2698144c80 2024-05-08T04:23:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.890+0000 7f267ffff640 1 -- 172.21.15.104:0/3362695980 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26900047e0 con 0x7f2698144c80 2024-05-08T04:23:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.890+0000 7f267ffff640 1 -- 172.21.15.104:0/3362695980 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690004bb0 con 0x7f2698144c80 2024-05-08T04:23:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.890+0000 7f269db6a640 1 -- 172.21.15.104:0/3362695980 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26980aaba0 con 0x7f2698144c80 2024-05-08T04:23:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.890+0000 7f269db6a640 1 -- 172.21.15.104:0/3362695980 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26980ab160 con 0x7f2698144c80 2024-05-08T04:23:28.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.891+0000 7f269db6a640 1 -- 172.21.15.104:0/3362695980 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2698075010 con 0x7f2698144c80 2024-05-08T04:23:28.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.891+0000 7f267ffff640 1 -- 172.21.15.104:0/3362695980 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 8) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f2690011070 con 0x7f2698144c80 2024-05-08T04:23:28.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.892+0000 7f267ffff640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f268406b710 0x7f268406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:28.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.892+0000 7f267ffff640 1 -- 172.21.15.104:0/3362695980 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f269008a260 con 0x7f2698144c80 2024-05-08T04:23:28.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.892+0000 7f26977fe640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f268406b710 0x7f268406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:28.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.892+0000 7f26977fe640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f268406b710 0x7f268406dbd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2688003d90 tx=0x7f2688009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:28.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:28.896+0000 7f267ffff640 1 -- 172.21.15.104:0/3362695980 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f269000e280 con 0x7f2698144c80 2024-05-08T04:23:29.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.101+0000 7f269db6a640 1 -- 172.21.15.104:0/3362695980 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26980af040 con 0x7f2698144c80 2024-05-08T04:23:29.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.102+0000 7f267ffff640 1 -- 172.21.15.104:0/3362695980 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f2690058cf0 con 0x7f2698144c80 2024-05-08T04:23:29.104 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:29.104 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:23:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:23:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.104+0000 7f269db6a640 1 -- 172.21.15.104:0/3362695980 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f268406b710 msgr2=0x7f268406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.104+0000 7f269db6a640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f268406b710 0x7f268406dbd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2688003d90 tx=0x7f2688009040 comp rx=0 tx=0).stop 2024-05-08T04:23:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.104+0000 7f269db6a640 1 -- 172.21.15.104:0/3362695980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2698144c80 msgr2=0x7f26980c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.104+0000 7f269db6a640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2698144c80 0x7f26980c58b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2690001eb0 tx=0x7f269000c870 comp rx=0 tx=0).stop 2024-05-08T04:23:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.104+0000 7f269db6a640 1 -- 172.21.15.104:0/3362695980 shutdown_connections 2024-05-08T04:23:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.104+0000 7f269db6a640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f268406b710 0x7f268406dbd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.104+0000 7f269db6a640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26980cc930 0x7f269815f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.104+0000 7f269db6a640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2698144c80 0x7f26980c58b0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.104+0000 7f269db6a640 1 --2- 172.21.15.104:0/3362695980 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26980711c0 0x7f26980aa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.104+0000 7f269db6a640 1 -- 172.21.15.104:0/3362695980 >> 172.21.15.104:0/3362695980 conn(0x7f26980b13f0 msgr2=0x7f26980ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.104+0000 7f269db6a640 1 -- 172.21.15.104:0/3362695980 shutdown_connections 2024-05-08T04:23:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:29.104+0000 7f269db6a640 1 -- 172.21.15.104:0/3362695980 wait complete. 2024-05-08T04:23:29.118 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:23:29.234 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":17.316804350000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.137675772101808,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:23:29.234 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.137675772101808 }, "state": "open", "uptime": 17.31680435 } ] 2024-05-08T04:23:29.235 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-05-08T04:23:34.235 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:23:34.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.345+0000 7f93896fc640 1 Processor -- start 2024-05-08T04:23:34.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.346+0000 7f93896fc640 1 -- start start 2024-05-08T04:23:34.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.346+0000 7f93896fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f938415edf0 0x7f93840b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:34.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.346+0000 7f93896fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9384157ac0 0x7f9384157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:34.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.346+0000 7f93896fc640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93840d15c0 con 0x7f9384070c70 2024-05-08T04:23:34.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.346+0000 7f93896fc640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938406bc70 con 0x7f9384157ac0 2024-05-08T04:23:34.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.346+0000 7f93896fc640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938415f550 con 0x7f938415edf0 2024-05-08T04:23:34.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.347+0000 7f9382ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9384070c70 0x7f9384071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:52812/0 (socket says 172.21.15.104:52812) 2024-05-08T04:23:34.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.347+0000 7f9382ffd640 1 -- 172.21.15.104:0/3481980783 learned_addr learned my addr 172.21.15.104:0/3481980783 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:34.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.347+0000 7f93837fe640 1 --2- 172.21.15.104:0/3481980783 >> v2:172.21.15.104:3300/0 conn(0x7f9384157ac0 0x7f9384157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:34.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.347+0000 7f937a7fc640 1 --2- 172.21.15.104:0/3481980783 >> v2:172.21.15.183:3300/0 conn(0x7f938415edf0 0x7f93840b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:34.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.347+0000 7f93827fc640 1 -- 172.21.15.104:0/3481980783 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545484776 0 0) 0x7f93840d15c0 con 0x7f9384070c70 2024-05-08T04:23:34.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.347+0000 7f93827fc640 1 -- 172.21.15.104:0/3481980783 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9370003520 con 0x7f9384070c70 2024-05-08T04:23:34.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.347+0000 7f93837fe640 1 -- 172.21.15.104:0/3481980783 >> v2:172.21.15.183:3300/0 conn(0x7f938415edf0 msgr2=0x7f93840b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:34.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.347+0000 7f93837fe640 1 --2- 172.21.15.104:0/3481980783 >> v2:172.21.15.183:3300/0 conn(0x7f938415edf0 0x7f93840b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:34.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.347+0000 7f93837fe640 1 -- 172.21.15.104:0/3481980783 >> v1:172.21.15.104:6789/0 conn(0x7f9384070c70 legacy=0x7f9384071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:34.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.347+0000 7f93837fe640 1 -- 172.21.15.104:0/3481980783 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938415f830 con 0x7f9384157ac0 2024-05-08T04:23:34.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.348+0000 7f93837fe640 1 --2- 172.21.15.104:0/3481980783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9384157ac0 0x7f9384157f30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f93840b4150 tx=0x7f937c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a384f813cf64650e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:34.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.348+0000 7f93827fc640 1 -- 172.21.15.104:0/3481980783 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c007740 con 0x7f9384157ac0 2024-05-08T04:23:34.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.348+0000 7f93827fc640 1 -- 172.21.15.104:0/3481980783 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c0078e0 con 0x7f9384157ac0 2024-05-08T04:23:34.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.348+0000 7f93827fc640 1 -- 172.21.15.104:0/3481980783 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c007cb0 con 0x7f9384157ac0 2024-05-08T04:23:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.348+0000 7f93896fc640 1 -- 172.21.15.104:0/3481980783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9384157ac0 msgr2=0x7f9384157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.348+0000 7f93896fc640 1 --2- 172.21.15.104:0/3481980783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9384157ac0 0x7f9384157f30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f93840b4150 tx=0x7f937c02a680 comp rx=0 tx=0).stop 2024-05-08T04:23:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.348+0000 7f93896fc640 1 -- 172.21.15.104:0/3481980783 shutdown_connections 2024-05-08T04:23:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.348+0000 7f93896fc640 1 --2- 172.21.15.104:0/3481980783 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9384157ac0 0x7f9384157f30 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.348+0000 7f93896fc640 1 --2- 172.21.15.104:0/3481980783 >> v2:172.21.15.183:3300/0 conn(0x7f938415edf0 0x7f93840b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:34.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.348+0000 7f93896fc640 1 -- 172.21.15.104:0/3481980783 >> 172.21.15.104:0/3481980783 conn(0x7f93840b3450 msgr2=0x7f93840b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:34.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.349+0000 7f93896fc640 1 -- 172.21.15.104:0/3481980783 shutdown_connections 2024-05-08T04:23:34.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.349+0000 7f93896fc640 1 -- 172.21.15.104:0/3481980783 wait complete. 2024-05-08T04:23:34.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.350+0000 7f93896fc640 1 Processor -- start 2024-05-08T04:23:34.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.350+0000 7f93896fc640 1 -- start start 2024-05-08T04:23:34.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f93896fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9384070c70 0x7f93841448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:34.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f93896fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9384157ac0 0x7f93841450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:34.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f93896fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f938415edf0 0x7f93841618d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:34.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f93896fc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93840b57e0 con 0x7f9384157ac0 2024-05-08T04:23:34.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f93896fc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93840b5b80 con 0x7f9384070c70 2024-05-08T04:23:34.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f93896fc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93840b5960 con 0x7f938415edf0 2024-05-08T04:23:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f937a7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9384157ac0 0x7f93841450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f937a7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9384157ac0 0x7f93841450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:58328/0 (socket says 172.21.15.104:58328) 2024-05-08T04:23:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f937a7fc640 1 -- 172.21.15.104:0/175125666 learned_addr learned my addr 172.21.15.104:0/175125666 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f9382ffd640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9384070c70 0x7f93841448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f93837fe640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f938415edf0 0x7f93841618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f937a7fc640 1 -- 172.21.15.104:0/175125666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f938415edf0 msgr2=0x7f93841618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f937a7fc640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f938415edf0 0x7f93841618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f937a7fc640 1 -- 172.21.15.104:0/175125666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9384070c70 msgr2=0x7f93841448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f937a7fc640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9384070c70 0x7f93841448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f937a7fc640 1 -- 172.21.15.104:0/175125666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9384144de0 con 0x7f9384157ac0 2024-05-08T04:23:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f93837fe640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f938415edf0 0x7f93841618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:23:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f937a7fc640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9384157ac0 0x7f93841450c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f936c00d5c0 tx=0x7f936c00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:34.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f937bfff640 1 -- 172.21.15.104:0/175125666 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c0125f0 con 0x7f9384157ac0 2024-05-08T04:23:34.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f937bfff640 1 -- 172.21.15.104:0/175125666 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c019070 con 0x7f9384157ac0 2024-05-08T04:23:34.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f937bfff640 1 -- 172.21.15.104:0/175125666 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c0129d0 con 0x7f9384157ac0 2024-05-08T04:23:34.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f93896fc640 1 -- 172.21.15.104:0/175125666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9384145bc0 con 0x7f9384157ac0 2024-05-08T04:23:34.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.351+0000 7f93896fc640 1 -- 172.21.15.104:0/175125666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9384146180 con 0x7f9384157ac0 2024-05-08T04:23:34.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.352+0000 7f93896fc640 1 -- 172.21.15.104:0/175125666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9384075010 con 0x7f9384157ac0 2024-05-08T04:23:34.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.353+0000 7f937bfff640 1 -- 172.21.15.104:0/175125666 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 8) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f936c012b70 con 0x7f9384157ac0 2024-05-08T04:23:34.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.354+0000 7f937bfff640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f936406b710 0x7f936406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:34.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.354+0000 7f9382ffd640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f936406b710 0x7f936406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:34.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.354+0000 7f937bfff640 1 -- 172.21.15.104:0/175125666 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f936c08a8f0 con 0x7f9384157ac0 2024-05-08T04:23:34.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.354+0000 7f9382ffd640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f936406b710 0x7f936406dbd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9374005880 tx=0x7f9374009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:34.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.358+0000 7f937bfff640 1 -- 172.21.15.104:0/175125666 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9384144de0 con 0x7f9384157ac0 2024-05-08T04:23:34.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.563+0000 7f93896fc640 1 -- 172.21.15.104:0/175125666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9384071a50 con 0x7f9384157ac0 2024-05-08T04:23:34.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.563+0000 7f937bfff640 1 -- 172.21.15.104:0/175125666 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f936c08a020 con 0x7f9384157ac0 2024-05-08T04:23:34.566 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:34.566 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:23:34.566 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:23:34.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.565+0000 7f93896fc640 1 -- 172.21.15.104:0/175125666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f936406b710 msgr2=0x7f936406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:34.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.565+0000 7f93896fc640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f936406b710 0x7f936406dbd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9374005880 tx=0x7f9374009040 comp rx=0 tx=0).stop 2024-05-08T04:23:34.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.565+0000 7f93896fc640 1 -- 172.21.15.104:0/175125666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9384157ac0 msgr2=0x7f93841450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:34.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.565+0000 7f93896fc640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9384157ac0 0x7f93841450c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f936c00d5c0 tx=0x7f936c00da80 comp rx=0 tx=0).stop 2024-05-08T04:23:34.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.565+0000 7f93896fc640 1 -- 172.21.15.104:0/175125666 shutdown_connections 2024-05-08T04:23:34.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.565+0000 7f93896fc640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f936406b710 0x7f936406dbd0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:34.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.565+0000 7f93896fc640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f938415edf0 0x7f93841618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:34.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.565+0000 7f93896fc640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9384157ac0 0x7f93841450c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:34.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.565+0000 7f93896fc640 1 --2- 172.21.15.104:0/175125666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9384070c70 0x7f93841448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:34.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.565+0000 7f93896fc640 1 -- 172.21.15.104:0/175125666 >> 172.21.15.104:0/175125666 conn(0x7f93840b3450 msgr2=0x7f938415bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:34.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.566+0000 7f93896fc640 1 -- 172.21.15.104:0/175125666 shutdown_connections 2024-05-08T04:23:34.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:34.566+0000 7f93896fc640 1 -- 172.21.15.104:0/175125666 wait complete. 2024-05-08T04:23:34.579 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:23:34.695 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":11,"uptime":22.776742662,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.872696006215069,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:23:34.695 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 11, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.87269600621507 }, "state": "open", "uptime": 22.776742662 } ] 2024-05-08T04:23:34.695 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-05-08T04:23:39.696 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:23:39.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.807+0000 7fb539b29640 1 Processor -- start 2024-05-08T04:23:39.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.807+0000 7fb539b29640 1 -- start start 2024-05-08T04:23:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb539b29640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5340cc930 0x7fb5340ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb539b29640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb53406e860 0x7fb53415fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb539b29640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb534071fb0 con 0x7fb5340711c0 2024-05-08T04:23:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb539b29640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5340cd250 con 0x7fb53406e860 2024-05-08T04:23:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb539b29640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb534071710 con 0x7fb5340cc930 2024-05-08T04:23:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb533fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb53406e860 0x7fb53415fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb532ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb5340711c0 0x7fb53415f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:52546/0 (socket says 172.21.15.104:52546) 2024-05-08T04:23:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb532ffd640 1 -- 172.21.15.104:0/2167607349 learned_addr learned my addr 172.21.15.104:0/2167607349 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:39.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb5337fe640 1 --2- 172.21.15.104:0/2167607349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5340cc930 0x7fb5340ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:39.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb533fff640 1 -- 172.21.15.104:0/2167607349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5340cc930 msgr2=0x7fb5340ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:39.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb533fff640 1 --2- 172.21.15.104:0/2167607349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5340cc930 0x7fb5340ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:39.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb533fff640 1 -- 172.21.15.104:0/2167607349 >> v1:172.21.15.104:6789/0 conn(0x7fb5340711c0 legacy=0x7fb53415f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:39.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb533fff640 1 -- 172.21.15.104:0/2167607349 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5340719f0 con 0x7fb53406e860 2024-05-08T04:23:39.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb5327fc640 1 -- 172.21.15.104:0/2167607349 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166136583 0 0) 0x7fb534071fb0 con 0x7fb5340711c0 2024-05-08T04:23:39.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.808+0000 7fb5337fe640 1 --2- 172.21.15.104:0/2167607349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5340cc930 0x7fb5340ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:39.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.809+0000 7fb533fff640 1 --2- 172.21.15.104:0/2167607349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb53406e860 0x7fb53415fcb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009d90 tx=0x7fb52c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2b54e9dafe1f77 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:39.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.809+0000 7fb5327fc640 1 -- 172.21.15.104:0/2167607349 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c031600 con 0x7fb53406e860 2024-05-08T04:23:39.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.809+0000 7fb5327fc640 1 -- 172.21.15.104:0/2167607349 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c0317a0 con 0x7fb53406e860 2024-05-08T04:23:39.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.809+0000 7fb5327fc640 1 -- 172.21.15.104:0/2167607349 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c031b70 con 0x7fb53406e860 2024-05-08T04:23:39.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.810+0000 7fb539b29640 1 -- 172.21.15.104:0/2167607349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb53406e860 msgr2=0x7fb53415fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:39.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.810+0000 7fb539b29640 1 --2- 172.21.15.104:0/2167607349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb53406e860 0x7fb53415fcb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009d90 tx=0x7fb52c02a5d0 comp rx=0 tx=0).stop 2024-05-08T04:23:39.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.810+0000 7fb539b29640 1 -- 172.21.15.104:0/2167607349 shutdown_connections 2024-05-08T04:23:39.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.810+0000 7fb539b29640 1 --2- 172.21.15.104:0/2167607349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb53406e860 0x7fb53415fcb0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:39.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.810+0000 7fb539b29640 1 --2- 172.21.15.104:0/2167607349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5340cc930 0x7fb5340ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:39.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.810+0000 7fb539b29640 1 -- 172.21.15.104:0/2167607349 >> 172.21.15.104:0/2167607349 conn(0x7fb5340b13f0 msgr2=0x7fb5340b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:39.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.810+0000 7fb539b29640 1 -- 172.21.15.104:0/2167607349 shutdown_connections 2024-05-08T04:23:39.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.810+0000 7fb539b29640 1 -- 172.21.15.104:0/2167607349 wait complete. 2024-05-08T04:23:39.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.811+0000 7fb539b29640 1 Processor -- start 2024-05-08T04:23:39.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.811+0000 7fb539b29640 1 -- start start 2024-05-08T04:23:39.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb539b29640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb53406e860 0x7fb53413e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:39.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb539b29640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5340711c0 0x7fb53413ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:39.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb539b29640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5340cc930 0x7fb53413bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:39.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb539b29640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5340cf3b0 con 0x7fb53406e860 2024-05-08T04:23:39.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb539b29640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53406d330 con 0x7fb5340711c0 2024-05-08T04:23:39.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb539b29640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5341453f0 con 0x7fb5340cc930 2024-05-08T04:23:39.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb5337fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb53406e860 0x7fb53413e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:39.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb5337fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb53406e860 0x7fb53413e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35686/0 (socket says 172.21.15.104:35686) 2024-05-08T04:23:39.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb5337fe640 1 -- 172.21.15.104:0/1621333679 learned_addr learned my addr 172.21.15.104:0/1621333679 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:39.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb5337fe640 1 -- 172.21.15.104:0/1621333679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5340cc930 msgr2=0x7fb53413bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:39.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb5337fe640 1 --2- 172.21.15.104:0/1621333679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5340cc930 0x7fb53413bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:39.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb5337fe640 1 -- 172.21.15.104:0/1621333679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5340711c0 msgr2=0x7fb53413ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:39.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb5337fe640 1 --2- 172.21.15.104:0/1621333679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5340711c0 0x7fb53413ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:39.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb5337fe640 1 -- 172.21.15.104:0/1621333679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5340acb00 con 0x7fb53406e860 2024-05-08T04:23:39.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb5337fe640 1 --2- 172.21.15.104:0/1621333679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb53406e860 0x7fb53413e150 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb52400c7f0 tx=0x7fb52400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:39.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb51bfff640 1 -- 172.21.15.104:0/1621333679 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb524015070 con 0x7fb53406e860 2024-05-08T04:23:39.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb51bfff640 1 -- 172.21.15.104:0/1621333679 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb524007a30 con 0x7fb53406e860 2024-05-08T04:23:39.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb51bfff640 1 -- 172.21.15.104:0/1621333679 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb524007e00 con 0x7fb53406e860 2024-05-08T04:23:39.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.812+0000 7fb539b29640 1 -- 172.21.15.104:0/1621333679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5340acde0 con 0x7fb53406e860 2024-05-08T04:23:39.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.813+0000 7fb539b29640 1 -- 172.21.15.104:0/1621333679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5340ad3a0 con 0x7fb53406e860 2024-05-08T04:23:39.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.814+0000 7fb539b29640 1 -- 172.21.15.104:0/1621333679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb534075010 con 0x7fb53406e860 2024-05-08T04:23:39.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.814+0000 7fb51bfff640 1 -- 172.21.15.104:0/1621333679 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 8) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fb524018070 con 0x7fb53406e860 2024-05-08T04:23:39.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.814+0000 7fb51bfff640 1 --2- 172.21.15.104:0/1621333679 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb52006b710 0x7fb52006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:39.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.815+0000 7fb51bfff640 1 -- 172.21.15.104:0/1621333679 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fb52408a7b0 con 0x7fb53406e860 2024-05-08T04:23:39.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.815+0000 7fb532ffd640 1 --2- 172.21.15.104:0/1621333679 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb52006b710 0x7fb52006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:39.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.815+0000 7fb532ffd640 1 --2- 172.21.15.104:0/1621333679 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb52006b710 0x7fb52006dbd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb528007fd0 tx=0x7fb528007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:39.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:39.819+0000 7fb51bfff640 1 -- 172.21.15.104:0/1621333679 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb524059130 con 0x7fb53406e860 2024-05-08T04:23:40.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.026+0000 7fb539b29640 1 -- 172.21.15.104:0/1621333679 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5340af040 con 0x7fb53406e860 2024-05-08T04:23:40.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.027+0000 7fb51bfff640 1 -- 172.21.15.104:0/1621333679 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fb524058a30 con 0x7fb53406e860 2024-05-08T04:23:40.029 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:40.029 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:23:40.030 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:23:40.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.029+0000 7fb539b29640 1 -- 172.21.15.104:0/1621333679 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb52006b710 msgr2=0x7fb52006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:40.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.029+0000 7fb539b29640 1 --2- 172.21.15.104:0/1621333679 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb52006b710 0x7fb52006dbd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb528007fd0 tx=0x7fb528007920 comp rx=0 tx=0).stop 2024-05-08T04:23:40.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.029+0000 7fb539b29640 1 -- 172.21.15.104:0/1621333679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb53406e860 msgr2=0x7fb53413e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:40.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.029+0000 7fb539b29640 1 --2- 172.21.15.104:0/1621333679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb53406e860 0x7fb53413e150 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb52400c7f0 tx=0x7fb52400cbf0 comp rx=0 tx=0).stop 2024-05-08T04:23:40.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.029+0000 7fb539b29640 1 -- 172.21.15.104:0/1621333679 shutdown_connections 2024-05-08T04:23:40.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.029+0000 7fb539b29640 1 --2- 172.21.15.104:0/1621333679 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb52006b710 0x7fb52006dbd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:40.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.029+0000 7fb539b29640 1 --2- 172.21.15.104:0/1621333679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5340711c0 0x7fb53413ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:40.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.029+0000 7fb539b29640 1 --2- 172.21.15.104:0/1621333679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5340cc930 0x7fb53413bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:40.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.029+0000 7fb539b29640 1 --2- 172.21.15.104:0/1621333679 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb53406e860 0x7fb53413e150 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:40.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.029+0000 7fb539b29640 1 -- 172.21.15.104:0/1621333679 >> 172.21.15.104:0/1621333679 conn(0x7fb5340b13f0 msgr2=0x7fb534142bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:40.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.029+0000 7fb539b29640 1 -- 172.21.15.104:0/1621333679 shutdown_connections 2024-05-08T04:23:40.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:40.029+0000 7fb539b29640 1 -- 172.21.15.104:0/1621333679 wait complete. 2024-05-08T04:23:40.042 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:23:40.158 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":10,"uptime":28.240680927,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.610847516556902,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:23:40.159 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.610847516556902 }, "state": "open", "uptime": 28.240680927 } ] 2024-05-08T04:23:40.159 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-05-08T04:23:40.815 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:23:40.818 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:23:45.160 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:23:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.271+0000 7f1dcd01f640 1 Processor -- start 2024-05-08T04:23:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.271+0000 7f1dcd01f640 1 -- start start 2024-05-08T04:23:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.271+0000 7f1dcd01f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1dc806ea40 0x7f1dc80b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.271+0000 7f1dcd01f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc815e780 con 0x7f1dc80ceee0 2024-05-08T04:23:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.271+0000 7f1dcd01f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc815ea60 con 0x7f1dc80b3ff0 2024-05-08T04:23:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.271+0000 7f1dcd01f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc815f390 con 0x7f1dc806ea40 2024-05-08T04:23:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.272+0000 7f1dc6d9d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f1dc80ceee0 0x7f1dc806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:52562/0 (socket says 172.21.15.104:52562) 2024-05-08T04:23:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.272+0000 7f1dc659c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1dc806ea40 0x7f1dc80b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.272+0000 7f1dc6d9d640 1 -- 172.21.15.104:0/422321088 learned_addr learned my addr 172.21.15.104:0/422321088 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:23:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.272+0000 7f1dc659c640 1 -- 172.21.15.104:0/422321088 >> v1:172.21.15.183:6789/0 conn(0x7f1dc80b3ff0 legacy=0x7f1dc80b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.272+0000 7f1dc659c640 1 -- 172.21.15.104:0/422321088 >> v1:172.21.15.104:6789/0 conn(0x7f1dc80ceee0 legacy=0x7f1dc806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:45.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.272+0000 7f1dc5d9b640 1 -- 172.21.15.104:0/422321088 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279819784 0 0) 0x7f1dc815e780 con 0x7f1dc80ceee0 2024-05-08T04:23:45.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.272+0000 7f1dc659c640 1 -- 172.21.15.104:0/422321088 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc815ed40 con 0x7f1dc806ea40 2024-05-08T04:23:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.273+0000 7f1dc659c640 1 --2- 172.21.15.104:0/422321088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc806ea40 0x7f1dc80b26f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1dc815f510 tx=0x7f1db002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba57f924e21d6d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.273+0000 7f1dc5d9b640 1 -- 172.21.15.104:0/422321088 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0037070 con 0x7f1dc806ea40 2024-05-08T04:23:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.273+0000 7f1dc5d9b640 1 -- 172.21.15.104:0/422321088 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db0032440 con 0x7f1dc806ea40 2024-05-08T04:23:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.273+0000 7f1dc5d9b640 1 -- 172.21.15.104:0/422321088 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0032810 con 0x7f1dc806ea40 2024-05-08T04:23:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.273+0000 7f1dcd01f640 1 -- 172.21.15.104:0/422321088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc806ea40 msgr2=0x7f1dc80b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.273+0000 7f1dcd01f640 1 --2- 172.21.15.104:0/422321088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc806ea40 0x7f1dc80b26f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1dc815f510 tx=0x7f1db002a210 comp rx=0 tx=0).stop 2024-05-08T04:23:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.273+0000 7f1dcd01f640 1 -- 172.21.15.104:0/422321088 shutdown_connections 2024-05-08T04:23:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.273+0000 7f1dcd01f640 1 --2- 172.21.15.104:0/422321088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc806ea40 0x7f1dc80b26f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.273+0000 7f1dcd01f640 1 -- 172.21.15.104:0/422321088 >> 172.21.15.104:0/422321088 conn(0x7f1dc80b13f0 msgr2=0x7f1dc80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:45.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.273+0000 7f1dcd01f640 1 -- 172.21.15.104:0/422321088 shutdown_connections 2024-05-08T04:23:45.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.273+0000 7f1dcd01f640 1 -- 172.21.15.104:0/422321088 wait complete. 2024-05-08T04:23:45.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.275+0000 7f1dcd01f640 1 Processor -- start 2024-05-08T04:23:45.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.275+0000 7f1dcd01f640 1 -- start start 2024-05-08T04:23:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dcd01f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc806ea40 0x7f1dc80aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dcd01f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dc80b3ff0 0x7f1dc814a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dcd01f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dc80ceee0 0x7f1dc8159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dcd01f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80cf440 con 0x7f1dc806ea40 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dcd01f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80cf2c0 con 0x7f1dc80ceee0 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dcd01f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc815b210 con 0x7f1dc80b3ff0 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dc6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc806ea40 0x7f1dc80aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dc6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc806ea40 0x7f1dc80aca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35702/0 (socket says 172.21.15.104:35702) 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dc6d9d640 1 -- 172.21.15.104:0/406996415 learned_addr learned my addr 172.21.15.104:0/406996415 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dc759e640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dc80ceee0 0x7f1dc8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dc659c640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dc80b3ff0 0x7f1dc814a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dc6d9d640 1 -- 172.21.15.104:0/406996415 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dc80b3ff0 msgr2=0x7f1dc814a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dc6d9d640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dc80b3ff0 0x7f1dc814a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dc6d9d640 1 -- 172.21.15.104:0/406996415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dc80ceee0 msgr2=0x7f1dc8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dc6d9d640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dc80ceee0 0x7f1dc8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dc6d9d640 1 -- 172.21.15.104:0/406996415 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc814a6c0 con 0x7f1dc806ea40 2024-05-08T04:23:45.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dc759e640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dc80ceee0 0x7f1dc8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:45.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dc659c640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dc80b3ff0 0x7f1dc814a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:23:45.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dc6d9d640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc806ea40 0x7f1dc80aca60 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000c780 tx=0x7f1dc000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:45.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/406996415 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0018070 con 0x7f1dc806ea40 2024-05-08T04:23:45.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.276+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/406996415 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc000a640 con 0x7f1dc806ea40 2024-05-08T04:23:45.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.277+0000 7f1dcd01f640 1 -- 172.21.15.104:0/406996415 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc80ab9c0 con 0x7f1dc806ea40 2024-05-08T04:23:45.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.277+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/406996415 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000aa70 con 0x7f1dc806ea40 2024-05-08T04:23:45.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.277+0000 7f1dcd01f640 1 -- 172.21.15.104:0/406996415 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc80abf80 con 0x7f1dc806ea40 2024-05-08T04:23:45.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.278+0000 7f1dcd01f640 1 -- 172.21.15.104:0/406996415 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc8073180 con 0x7f1dc806ea40 2024-05-08T04:23:45.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.278+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/406996415 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 8) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f1dc001b070 con 0x7f1dc806ea40 2024-05-08T04:23:45.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.279+0000 7f1dbf7fe640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1da806b710 0x7f1da806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:45.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.279+0000 7f1dc659c640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1da806b710 0x7f1da806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:45.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.279+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/406996415 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f1dc0089cf0 con 0x7f1dc806ea40 2024-05-08T04:23:45.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.279+0000 7f1dc659c640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1da806b710 0x7f1da806dbd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1db0034000 tx=0x7f1db002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:45.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.283+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/406996415 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1dc8073180 con 0x7f1dc806ea40 2024-05-08T04:23:45.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.492+0000 7f1dcd01f640 1 -- 172.21.15.104:0/406996415 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dc8075010 con 0x7f1dc806ea40 2024-05-08T04:23:45.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.493+0000 7f1dbf7fe640 1 -- 172.21.15.104:0/406996415 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f1dc008e070 con 0x7f1dc806ea40 2024-05-08T04:23:45.494 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:45.494 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:23:45.495 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:23:45.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.495+0000 7f1dcd01f640 1 -- 172.21.15.104:0/406996415 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1da806b710 msgr2=0x7f1da806dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:45.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.495+0000 7f1dcd01f640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1da806b710 0x7f1da806dbd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1db0034000 tx=0x7f1db002e000 comp rx=0 tx=0).stop 2024-05-08T04:23:45.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.495+0000 7f1dcd01f640 1 -- 172.21.15.104:0/406996415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc806ea40 msgr2=0x7f1dc80aca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:45.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.495+0000 7f1dcd01f640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc806ea40 0x7f1dc80aca60 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000c780 tx=0x7f1dc000cc40 comp rx=0 tx=0).stop 2024-05-08T04:23:45.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.495+0000 7f1dcd01f640 1 -- 172.21.15.104:0/406996415 shutdown_connections 2024-05-08T04:23:45.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.495+0000 7f1dcd01f640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1da806b710 0x7f1da806dbd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:45.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.495+0000 7f1dcd01f640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dc80ceee0 0x7f1dc8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:45.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.495+0000 7f1dcd01f640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dc80b3ff0 0x7f1dc814a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:45.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.495+0000 7f1dcd01f640 1 --2- 172.21.15.104:0/406996415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc806ea40 0x7f1dc80aca60 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:45.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.495+0000 7f1dcd01f640 1 -- 172.21.15.104:0/406996415 >> 172.21.15.104:0/406996415 conn(0x7f1dc80b13f0 msgr2=0x7f1dc80b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:45.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.495+0000 7f1dcd01f640 1 -- 172.21.15.104:0/406996415 shutdown_connections 2024-05-08T04:23:45.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:45.495+0000 7f1dcd01f640 1 -- 172.21.15.104:0/406996415 wait complete. 2024-05-08T04:23:45.507 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:23:45.623 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":10,"uptime":33.706619173999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.35218987624534,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:23:45.623 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.35218987624534 }, "state": "open", "uptime": 33.706619174 } ] 2024-05-08T04:23:45.624 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-05-08T04:23:50.624 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:23:50.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.738+0000 7eff0804d640 1 Processor -- start 2024-05-08T04:23:50.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.738+0000 7eff0804d640 1 -- start start 2024-05-08T04:23:50.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.739+0000 7eff0804d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7eff0006c280 0x7eff000ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:50.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.739+0000 7eff0804d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff00072c40 con 0x7eff000acdf0 2024-05-08T04:23:50.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.739+0000 7eff0804d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0006de30 con 0x7eff00161190 2024-05-08T04:23:50.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.739+0000 7eff0804d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff000b4db0 con 0x7eff0006c280 2024-05-08T04:23:50.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.739+0000 7eff065ea640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7eff0006c280 0x7eff000ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:50.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.739+0000 7eff065ea640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7eff0006c280 0x7eff000ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47686/0 (socket says 172.21.15.104:47686) 2024-05-08T04:23:50.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.739+0000 7eff065ea640 1 -- 172.21.15.104:0/2856682448 learned_addr learned my addr 172.21.15.104:0/2856682448 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:50.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.740+0000 7eff065ea640 1 -- 172.21.15.104:0/2856682448 >> v1:172.21.15.183:6789/0 conn(0x7eff00161190 legacy=0x7eff00072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:50.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.740+0000 7eff065ea640 1 -- 172.21.15.104:0/2856682448 >> v1:172.21.15.104:6789/0 conn(0x7eff000acdf0 legacy=0x7eff0006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:50.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.740+0000 7eff065ea640 1 -- 172.21.15.104:0/2856682448 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0006e110 con 0x7eff0006c280 2024-05-08T04:23:50.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.740+0000 7eff065ea640 1 --2- 172.21.15.104:0/2856682448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff0006c280 0x7eff000ad280 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efef8009e50 tx=0x7efef802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c719089f5cc1d5f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:50.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.741+0000 7eff04de7640 1 -- 172.21.15.104:0/2856682448 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8036070 con 0x7eff0006c280 2024-05-08T04:23:50.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.741+0000 7eff04de7640 1 -- 172.21.15.104:0/2856682448 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef8031600 con 0x7eff0006c280 2024-05-08T04:23:50.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.741+0000 7eff04de7640 1 -- 172.21.15.104:0/2856682448 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef80319d0 con 0x7eff0006c280 2024-05-08T04:23:50.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.741+0000 7eff0804d640 1 -- 172.21.15.104:0/2856682448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff0006c280 msgr2=0x7eff000ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:50.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.741+0000 7eff0804d640 1 --2- 172.21.15.104:0/2856682448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff0006c280 0x7eff000ad280 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efef8009e50 tx=0x7efef802a760 comp rx=0 tx=0).stop 2024-05-08T04:23:50.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.741+0000 7eff0804d640 1 -- 172.21.15.104:0/2856682448 shutdown_connections 2024-05-08T04:23:50.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.741+0000 7eff0804d640 1 --2- 172.21.15.104:0/2856682448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff0006c280 0x7eff000ad280 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:50.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.741+0000 7eff0804d640 1 -- 172.21.15.104:0/2856682448 >> 172.21.15.104:0/2856682448 conn(0x7eff00071a10 msgr2=0x7eff00071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:50.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.741+0000 7eff0804d640 1 -- 172.21.15.104:0/2856682448 shutdown_connections 2024-05-08T04:23:50.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.741+0000 7eff0804d640 1 -- 172.21.15.104:0/2856682448 wait complete. 2024-05-08T04:23:50.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.742+0000 7eff0804d640 1 Processor -- start 2024-05-08T04:23:50.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.743+0000 7eff0804d640 1 -- start start 2024-05-08T04:23:50.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.743+0000 7eff0804d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff0006c280 0x7eff00157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:50.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.743+0000 7eff0804d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff000acdf0 0x7eff001437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:50.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.743+0000 7eff0804d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff00161190 0x7eff001564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:50.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.743+0000 7eff0804d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0006e9b0 con 0x7eff00161190 2024-05-08T04:23:50.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.743+0000 7eff0804d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0006e6d0 con 0x7eff0006c280 2024-05-08T04:23:50.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.743+0000 7eff0804d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0006da70 con 0x7eff000acdf0 2024-05-08T04:23:50.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.743+0000 7eff065ea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff00161190 0x7eff001564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.743+0000 7eff065ea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff00161190 0x7eff001564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47696/0 (socket says 172.21.15.104:47696) 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.743+0000 7eff065ea640 1 -- 172.21.15.104:0/829983194 learned_addr learned my addr 172.21.15.104:0/829983194 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.744+0000 7eff055e8640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff000acdf0 0x7eff001437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.744+0000 7eff05de9640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff0006c280 0x7eff00157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.744+0000 7eff065ea640 1 -- 172.21.15.104:0/829983194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff000acdf0 msgr2=0x7eff001437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.744+0000 7eff065ea640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff000acdf0 0x7eff001437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.744+0000 7eff065ea640 1 -- 172.21.15.104:0/829983194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff0006c280 msgr2=0x7eff00157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.744+0000 7eff065ea640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff0006c280 0x7eff00157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.744+0000 7eff065ea640 1 -- 172.21.15.104:0/829983194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00143d10 con 0x7eff00161190 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.744+0000 7eff065ea640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff00161190 0x7eff001564e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7efef8009e50 tx=0x7efef8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.744+0000 7efef67fc640 1 -- 172.21.15.104:0/829983194 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8036050 con 0x7eff00161190 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.744+0000 7efef67fc640 1 -- 172.21.15.104:0/829983194 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef8042070 con 0x7eff00161190 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.744+0000 7eff0804d640 1 -- 172.21.15.104:0/829983194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff00158390 con 0x7eff00161190 2024-05-08T04:23:50.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.744+0000 7efef67fc640 1 -- 172.21.15.104:0/829983194 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8009510 con 0x7eff00161190 2024-05-08T04:23:50.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.744+0000 7eff0804d640 1 -- 172.21.15.104:0/829983194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff00158950 con 0x7eff00161190 2024-05-08T04:23:50.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.746+0000 7eff0804d640 1 -- 172.21.15.104:0/829983194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff00075010 con 0x7eff00161190 2024-05-08T04:23:50.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.746+0000 7efef67fc640 1 -- 172.21.15.104:0/829983194 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 8) v1 ==== 89984+0+0 (secure 0 0 0) 0x7efef8007bd0 con 0x7eff00161190 2024-05-08T04:23:50.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.746+0000 7efef67fc640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efee406b710 0x7efee406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:50.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.746+0000 7eff05de9640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efee406b710 0x7efee406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:50.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.746+0000 7efef67fc640 1 -- 172.21.15.104:0/829983194 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7efef80ab5f0 con 0x7eff00161190 2024-05-08T04:23:50.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.747+0000 7eff05de9640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efee406b710 0x7efee406dbd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efefc006fd0 tx=0x7efefc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:50.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.751+0000 7efef67fc640 1 -- 172.21.15.104:0/829983194 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efef807a040 con 0x7eff00161190 2024-05-08T04:23:50.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.956+0000 7eff0804d640 1 -- 172.21.15.104:0/829983194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff00066a30 con 0x7eff00161190 2024-05-08T04:23:50.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.957+0000 7efef67fc640 1 -- 172.21.15.104:0/829983194 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7efef8079940 con 0x7eff00161190 2024-05-08T04:23:50.958 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:50.959 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:23:50.959 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:23:50.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.959+0000 7eff0804d640 1 -- 172.21.15.104:0/829983194 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efee406b710 msgr2=0x7efee406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:50.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.959+0000 7eff0804d640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efee406b710 0x7efee406dbd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efefc006fd0 tx=0x7efefc008040 comp rx=0 tx=0).stop 2024-05-08T04:23:50.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.959+0000 7eff0804d640 1 -- 172.21.15.104:0/829983194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff00161190 msgr2=0x7eff001564e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:50.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.959+0000 7eff0804d640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff00161190 0x7eff001564e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7efef8009e50 tx=0x7efef8004a40 comp rx=0 tx=0).stop 2024-05-08T04:23:50.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.959+0000 7eff0804d640 1 -- 172.21.15.104:0/829983194 shutdown_connections 2024-05-08T04:23:50.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.959+0000 7eff0804d640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efee406b710 0x7efee406dbd0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:50.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.959+0000 7eff0804d640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff00161190 0x7eff001564e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:50.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.959+0000 7eff0804d640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff000acdf0 0x7eff001437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:50.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.959+0000 7eff0804d640 1 --2- 172.21.15.104:0/829983194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff0006c280 0x7eff00157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:50.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.959+0000 7eff0804d640 1 -- 172.21.15.104:0/829983194 >> 172.21.15.104:0/829983194 conn(0x7eff00071a10 msgr2=0x7eff0015ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:50.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.959+0000 7eff0804d640 1 -- 172.21.15.104:0/829983194 shutdown_connections 2024-05-08T04:23:50.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:50.959+0000 7eff0804d640 1 -- 172.21.15.104:0/829983194 wait complete. 2024-05-08T04:23:50.971 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:23:51.086 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":39.169557453000003,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.096917581947078,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:23:51.087 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.09691758194708 }, "state": "open", "uptime": 39.169557453 } ] 2024-05-08T04:23:51.087 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-05-08T04:23:56.088 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:23:56.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.201+0000 7ffad2807640 1 Processor -- start 2024-05-08T04:23:56.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.201+0000 7ffad2807640 1 -- start start 2024-05-08T04:23:56.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad2807640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffacc161190 0x7ffacc072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:56.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad2807640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc072a70 0x7ffacc0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:56.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad2807640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffacc0ad330 0x7ffacc06bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:56.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad2807640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0b4db0 con 0x7ffacc0ad330 2024-05-08T04:23:56.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad2807640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc06de30 con 0x7ffacc161190 2024-05-08T04:23:56.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad2807640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc06e110 con 0x7ffacc072a70 2024-05-08T04:23:56.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad0da4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffacc0ad330 0x7ffacc06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:56.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad0da4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffacc0ad330 0x7ffacc06bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47710/0 (socket says 172.21.15.104:47710) 2024-05-08T04:23:56.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad0da4640 1 -- 172.21.15.104:0/4144312786 learned_addr learned my addr 172.21.15.104:0/4144312786 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:56.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffacbfff640 1 --2- 172.21.15.104:0/4144312786 >> v2:172.21.15.183:3300/0 conn(0x7ffacc161190 0x7ffacc072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:56.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffacb7fe640 1 --2- 172.21.15.104:0/4144312786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc072a70 0x7ffacc0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:56.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad0da4640 1 -- 172.21.15.104:0/4144312786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc072a70 msgr2=0x7ffacc0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:56.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad0da4640 1 --2- 172.21.15.104:0/4144312786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc072a70 0x7ffacc0acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:56.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad0da4640 1 -- 172.21.15.104:0/4144312786 >> v2:172.21.15.183:3300/0 conn(0x7ffacc161190 msgr2=0x7ffacc072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:23:56.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad0da4640 1 --2- 172.21.15.104:0/4144312786 >> v2:172.21.15.183:3300/0 conn(0x7ffacc161190 0x7ffacc072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:56.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffad0da4640 1 -- 172.21.15.104:0/4144312786 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc06e3f0 con 0x7ffacc0ad330 2024-05-08T04:23:56.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.202+0000 7ffacbfff640 1 --2- 172.21.15.104:0/4144312786 >> v2:172.21.15.183:3300/0 conn(0x7ffacc161190 0x7ffacc072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:23:56.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.203+0000 7ffad0da4640 1 --2- 172.21.15.104:0/4144312786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffacc0ad330 0x7ffacc06bb70 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ffacc06faa0 tx=0x7ffac402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212b840a5b25ee36 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:56.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.203+0000 7ffacaffd640 1 -- 172.21.15.104:0/4144312786 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4036070 con 0x7ffacc0ad330 2024-05-08T04:23:56.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.203+0000 7ffacaffd640 1 -- 172.21.15.104:0/4144312786 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac4031600 con 0x7ffacc0ad330 2024-05-08T04:23:56.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.203+0000 7ffacaffd640 1 -- 172.21.15.104:0/4144312786 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac40319d0 con 0x7ffacc0ad330 2024-05-08T04:23:56.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.204+0000 7ffad2807640 1 -- 172.21.15.104:0/4144312786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffacc0ad330 msgr2=0x7ffacc06bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:56.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.204+0000 7ffad2807640 1 --2- 172.21.15.104:0/4144312786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffacc0ad330 0x7ffacc06bb70 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ffacc06faa0 tx=0x7ffac402a6a0 comp rx=0 tx=0).stop 2024-05-08T04:23:56.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.204+0000 7ffad2807640 1 -- 172.21.15.104:0/4144312786 shutdown_connections 2024-05-08T04:23:56.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.204+0000 7ffad2807640 1 --2- 172.21.15.104:0/4144312786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffacc0ad330 0x7ffacc06bb70 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:56.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.204+0000 7ffad2807640 1 --2- 172.21.15.104:0/4144312786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc072a70 0x7ffacc0acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:56.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.204+0000 7ffad2807640 1 --2- 172.21.15.104:0/4144312786 >> v2:172.21.15.183:3300/0 conn(0x7ffacc161190 0x7ffacc072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:56.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.204+0000 7ffad2807640 1 -- 172.21.15.104:0/4144312786 >> 172.21.15.104:0/4144312786 conn(0x7ffacc071a10 msgr2=0x7ffacc071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:56.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.204+0000 7ffad2807640 1 -- 172.21.15.104:0/4144312786 shutdown_connections 2024-05-08T04:23:56.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.204+0000 7ffad2807640 1 -- 172.21.15.104:0/4144312786 wait complete. 2024-05-08T04:23:56.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.205+0000 7ffad2807640 1 Processor -- start 2024-05-08T04:23:56.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.205+0000 7ffad2807640 1 -- start start 2024-05-08T04:23:56.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffad2807640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffacc0ad330 0x7ffacc158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:56.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffad2807640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffacc161190 0x7ffacc1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:56.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffad2807640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc14d710 0x7ffacc14ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:56.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffad2807640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc06da70 con 0x7ffacc161190 2024-05-08T04:23:56.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffad2807640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc06e9b0 con 0x7ffacc0ad330 2024-05-08T04:23:56.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffad2807640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc06dbf0 con 0x7ffacc14d710 2024-05-08T04:23:56.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffacb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffacc161190 0x7ffacc1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:56.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffacb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffacc161190 0x7ffacc1561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47712/0 (socket says 172.21.15.104:47712) 2024-05-08T04:23:56.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffacb7fe640 1 -- 172.21.15.104:0/1451075797 learned_addr learned my addr 172.21.15.104:0/1451075797 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:23:56.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffad0da4640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc14d710 0x7ffacc14ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:56.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffacbfff640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffacc0ad330 0x7ffacc158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:56.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffacb7fe640 1 -- 172.21.15.104:0/1451075797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc14d710 msgr2=0x7ffacc14ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:56.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffacb7fe640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc14d710 0x7ffacc14ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:56.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffacb7fe640 1 -- 172.21.15.104:0/1451075797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffacc0ad330 msgr2=0x7ffacc158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:56.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffacb7fe640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffacc0ad330 0x7ffacc158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:56.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffacb7fe640 1 -- 172.21.15.104:0/1451075797 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc157d20 con 0x7ffacc161190 2024-05-08T04:23:56.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.206+0000 7ffad0da4640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc14d710 0x7ffacc14ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:23:56.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.207+0000 7ffacb7fe640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffacc161190 0x7ffacc1561c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ffac000d800 tx=0x7ffac000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:56.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.207+0000 7ffac8ff9640 1 -- 172.21.15.104:0/1451075797 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0018020 con 0x7ffacc161190 2024-05-08T04:23:56.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.207+0000 7ffac8ff9640 1 -- 172.21.15.104:0/1451075797 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac0009640 con 0x7ffacc161190 2024-05-08T04:23:56.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.207+0000 7ffad2807640 1 -- 172.21.15.104:0/1451075797 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc157fc0 con 0x7ffacc161190 2024-05-08T04:23:56.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.207+0000 7ffac8ff9640 1 -- 172.21.15.104:0/1451075797 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0009a10 con 0x7ffacc161190 2024-05-08T04:23:56.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.207+0000 7ffad2807640 1 -- 172.21.15.104:0/1451075797 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc158580 con 0x7ffacc161190 2024-05-08T04:23:56.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.208+0000 7ffad2807640 1 -- 172.21.15.104:0/1451075797 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc075010 con 0x7ffacc161190 2024-05-08T04:23:56.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.208+0000 7ffac8ff9640 1 -- 172.21.15.104:0/1451075797 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 8) v1 ==== 89984+0+0 (secure 0 0 0) 0x7ffac001b020 con 0x7ffacc161190 2024-05-08T04:23:56.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.209+0000 7ffac8ff9640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffab806b710 0x7ffab806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:23:56.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.209+0000 7ffac8ff9640 1 -- 172.21.15.104:0/1451075797 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ffac008a940 con 0x7ffacc161190 2024-05-08T04:23:56.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.209+0000 7ffacbfff640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffab806b710 0x7ffab806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:23:56.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.209+0000 7ffacbfff640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffab806b710 0x7ffab806dbd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffabc006fd0 tx=0x7ffabc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:23:56.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.213+0000 7ffac8ff9640 1 -- 172.21.15.104:0/1451075797 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffac0022030 con 0x7ffacc161190 2024-05-08T04:23:56.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.421+0000 7ffad2807640 1 -- 172.21.15.104:0/1451075797 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffacc0727f0 con 0x7ffacc161190 2024-05-08T04:23:56.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.421+0000 7ffac8ff9640 1 -- 172.21.15.104:0/1451075797 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7ffac0059340 con 0x7ffacc161190 2024-05-08T04:23:56.423 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:23:56.423 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:23:56.423 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:23:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.423+0000 7ffad2807640 1 -- 172.21.15.104:0/1451075797 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffab806b710 msgr2=0x7ffab806dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.423+0000 7ffad2807640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffab806b710 0x7ffab806dbd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffabc006fd0 tx=0x7ffabc008040 comp rx=0 tx=0).stop 2024-05-08T04:23:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.423+0000 7ffad2807640 1 -- 172.21.15.104:0/1451075797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffacc161190 msgr2=0x7ffacc1561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:23:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.423+0000 7ffad2807640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffacc161190 0x7ffacc1561c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ffac000d800 tx=0x7ffac000dcc0 comp rx=0 tx=0).stop 2024-05-08T04:23:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.424+0000 7ffad2807640 1 -- 172.21.15.104:0/1451075797 shutdown_connections 2024-05-08T04:23:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.424+0000 7ffad2807640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffab806b710 0x7ffab806dbd0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.424+0000 7ffad2807640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffacc14d710 0x7ffacc14ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.424+0000 7ffad2807640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffacc161190 0x7ffacc1561c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:56.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.424+0000 7ffad2807640 1 --2- 172.21.15.104:0/1451075797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffacc0ad330 0x7ffacc158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:23:56.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.424+0000 7ffad2807640 1 -- 172.21.15.104:0/1451075797 >> 172.21.15.104:0/1451075797 conn(0x7ffacc071a10 msgr2=0x7ffacc0b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:23:56.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.424+0000 7ffad2807640 1 -- 172.21.15.104:0/1451075797 shutdown_connections 2024-05-08T04:23:56.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:23:56.424+0000 7ffad2807640 1 -- 172.21.15.104:0/1451075797 wait complete. 2024-05-08T04:23:56.436 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:23:56.551 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":44.634495739999998,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.844755399701061,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:23:56.551 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.84475539970106 }, "state": "open", "uptime": 44.63449574 } ] 2024-05-08T04:23:56.551 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-05-08T04:24:01.552 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:01.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.661+0000 7f36e064c640 1 Processor -- start 2024-05-08T04:24:01.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.662+0000 7f36e064c640 1 -- start start 2024-05-08T04:24:01.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.662+0000 7f36e064c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f36d815de10 0x7f36d8161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:01.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36e064c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d815e1f0 con 0x7f36d80d07c0 2024-05-08T04:24:01.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36e064c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d8162090 con 0x7f36d80ce5a0 2024-05-08T04:24:01.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36e064c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d80d0f50 con 0x7f36d815de10 2024-05-08T04:24:01.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36debe9640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f36d80d07c0 0x7f36d80d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:36226/0 (socket says 172.21.15.104:36226) 2024-05-08T04:24:01.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36debe9640 1 -- 172.21.15.104:0/713093755 learned_addr learned my addr 172.21.15.104:0/713093755 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:01.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36de3e8640 1 --2- 172.21.15.104:0/713093755 >> v2:172.21.15.183:3300/0 conn(0x7f36d815de10 0x7f36d8161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:01.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183227641 0 0) 0x7f36d815e1f0 con 0x7f36d80d07c0 2024-05-08T04:24:01.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36c0003520 con 0x7f36d80d07c0 2024-05-08T04:24:01.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4243753616 0 0) 0x7f36c0003520 con 0x7f36d80d07c0 2024-05-08T04:24:01.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 >> v2:172.21.15.183:3300/0 conn(0x7f36d815de10 msgr2=0x7f36d8161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:01.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 --2- 172.21.15.104:0/713093755 >> v2:172.21.15.183:3300/0 conn(0x7f36d815de10 0x7f36d8161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:01.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 >> v1:172.21.15.183:6789/0 conn(0x7f36d80ce5a0 legacy=0x7f36d80d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:01.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d8162370 con 0x7f36d80d07c0 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f36c80019f0 con 0x7f36d80d07c0 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 >> v1:172.21.15.104:6789/0 conn(0x7f36d80d07c0 legacy=0x7f36d80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 --2- 172.21.15.104:0/713093755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36c00039b0 0x7f36c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 --2- 172.21.15.104:0/713093755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36c0004800 0x7f36c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 --2- 172.21.15.104:0/713093755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36c00051c0 0x7f36c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d80d0f50 con 0x7f36c0004800 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c000c160 con 0x7f36c00051c0 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c000c360 con 0x7f36c00039b0 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.663+0000 7f36ddbe7640 1 --2- 172.21.15.104:0/713093755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36c0004800 0x7f36c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.664+0000 7f36de3e8640 1 --2- 172.21.15.104:0/713093755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36c00039b0 0x7f36c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.664+0000 7f36debe9640 1 --2- 172.21.15.104:0/713093755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36c00051c0 0x7f36c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.664+0000 7f36ddbe7640 1 -- 172.21.15.104:0/713093755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36c00039b0 msgr2=0x7f36c0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.664+0000 7f36ddbe7640 1 --2- 172.21.15.104:0/713093755 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36c00039b0 0x7f36c0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:01.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.664+0000 7f36ddbe7640 1 -- 172.21.15.104:0/713093755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36c00051c0 msgr2=0x7f36c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.664+0000 7f36ddbe7640 1 --2- 172.21.15.104:0/713093755 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36c00051c0 0x7f36c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.664+0000 7f36debe9640 1 -- 172.21.15.104:0/713093755 reap_dead start 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.664+0000 7f36ddbe7640 1 -- 172.21.15.104:0/713093755 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c0003520 con 0x7f36c0004800 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.664+0000 7f36ddbe7640 1 --2- 172.21.15.104:0/713093755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36c0004800 0x7f36c0004c80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f36cc001750 tx=0x7f36c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb951cd166ee39b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.665+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc001370 con 0x7f36c0004800 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.665+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc0052d0 con 0x7f36c0004800 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.665+0000 7f36dd3e6640 1 -- 172.21.15.104:0/713093755 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc02abc0 con 0x7f36c0004800 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.665+0000 7f36e064c640 1 -- 172.21.15.104:0/713093755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36c0004800 msgr2=0x7f36c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.665+0000 7f36e064c640 1 --2- 172.21.15.104:0/713093755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36c0004800 0x7f36c0004c80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f36cc001750 tx=0x7f36c0005830 comp rx=0 tx=0).stop 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.665+0000 7f36e064c640 1 -- 172.21.15.104:0/713093755 shutdown_connections 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.665+0000 7f36e064c640 1 --2- 172.21.15.104:0/713093755 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36c0004800 0x7f36c0004c80 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.665+0000 7f36e064c640 1 -- 172.21.15.104:0/713093755 >> 172.21.15.104:0/713093755 conn(0x7f36d8072290 msgr2=0x7f36d8072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.665+0000 7f36e064c640 1 -- 172.21.15.104:0/713093755 shutdown_connections 2024-05-08T04:24:01.669 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.665+0000 7f36e064c640 1 -- 172.21.15.104:0/713093755 wait complete. 2024-05-08T04:24:01.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.667+0000 7f36e064c640 1 Processor -- start 2024-05-08T04:24:01.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.667+0000 7f36e064c640 1 -- start start 2024-05-08T04:24:01.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.667+0000 7f36e064c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36c0004800 0x7f36d814ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:01.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.667+0000 7f36e064c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d80d39b0 0x7f36d81605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:01.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.667+0000 7f36e064c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d8154d20 0x7f36d8160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:01.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.667+0000 7f36e064c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d80d1ce0 con 0x7f36d80d39b0 2024-05-08T04:24:01.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.667+0000 7f36e064c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d80d1a90 con 0x7f36c0004800 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.667+0000 7f36e064c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d80b6dc0 con 0x7f36d8154d20 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.667+0000 7f36ddbe7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d80d39b0 0x7f36d81605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.667+0000 7f36ddbe7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d80d39b0 0x7f36d81605f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33626/0 (socket says 172.21.15.104:33626) 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.667+0000 7f36ddbe7640 1 -- 172.21.15.104:0/2508177699 learned_addr learned my addr 172.21.15.104:0/2508177699 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.668+0000 7f36debe9640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d8154d20 0x7f36d8160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.668+0000 7f36de3e8640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36c0004800 0x7f36d814ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.668+0000 7f36ddbe7640 1 -- 172.21.15.104:0/2508177699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d8154d20 msgr2=0x7f36d8160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.668+0000 7f36ddbe7640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d8154d20 0x7f36d8160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.668+0000 7f36ddbe7640 1 -- 172.21.15.104:0/2508177699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36c0004800 msgr2=0x7f36d814ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.668+0000 7f36ddbe7640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36c0004800 0x7f36d814ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.668+0000 7f36ddbe7640 1 -- 172.21.15.104:0/2508177699 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d814f280 con 0x7f36d80d39b0 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.668+0000 7f36ddbe7640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d80d39b0 0x7f36d81605f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f36cc000c00 tx=0x7f36cc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.668+0000 7f36d6ffd640 1 -- 172.21.15.104:0/2508177699 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc03f030 con 0x7f36d80d39b0 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.668+0000 7f36d6ffd640 1 -- 172.21.15.104:0/2508177699 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc005480 con 0x7f36d80d39b0 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.668+0000 7f36d6ffd640 1 -- 172.21.15.104:0/2508177699 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc037040 con 0x7f36d80d39b0 2024-05-08T04:24:01.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.668+0000 7f36e064c640 1 -- 172.21.15.104:0/2508177699 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d8155e60 con 0x7f36d80d39b0 2024-05-08T04:24:01.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.668+0000 7f36e064c640 1 -- 172.21.15.104:0/2508177699 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d81555c0 con 0x7f36d80d39b0 2024-05-08T04:24:01.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.669+0000 7f36e064c640 1 -- 172.21.15.104:0/2508177699 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d8075010 con 0x7f36d80d39b0 2024-05-08T04:24:01.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.670+0000 7f36d6ffd640 1 -- 172.21.15.104:0/2508177699 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 8) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f36cc042070 con 0x7f36d80d39b0 2024-05-08T04:24:01.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.670+0000 7f36d6ffd640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f36c406b740 0x7f36c406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:01.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.670+0000 7f36d6ffd640 1 -- 172.21.15.104:0/2508177699 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f36cc0a9ae0 con 0x7f36d80d39b0 2024-05-08T04:24:01.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.670+0000 7f36de3e8640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f36c406b740 0x7f36c406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:01.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.671+0000 7f36de3e8640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f36c406b740 0x7f36c406dc00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f36d81f51b0 tx=0x7f36d0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:01.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.674+0000 7f36d6ffd640 1 -- 172.21.15.104:0/2508177699 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f36cc0784e0 con 0x7f36d80d39b0 2024-05-08T04:24:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.884+0000 7f36e064c640 1 -- 172.21.15.104:0/2508177699 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36d80d1870 con 0x7f36d80d39b0 2024-05-08T04:24:01.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.884+0000 7f36d6ffd640 1 -- 172.21.15.104:0/2508177699 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f36cc077de0 con 0x7f36d80d39b0 2024-05-08T04:24:01.886 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:01.886 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:24:01.886 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:24:01.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.886+0000 7f36e064c640 1 -- 172.21.15.104:0/2508177699 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f36c406b740 msgr2=0x7f36c406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:01.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.886+0000 7f36e064c640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f36c406b740 0x7f36c406dc00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f36d81f51b0 tx=0x7f36d0009190 comp rx=0 tx=0).stop 2024-05-08T04:24:01.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.886+0000 7f36e064c640 1 -- 172.21.15.104:0/2508177699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d80d39b0 msgr2=0x7f36d81605f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:01.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.886+0000 7f36e064c640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d80d39b0 0x7f36d81605f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f36cc000c00 tx=0x7f36cc001120 comp rx=0 tx=0).stop 2024-05-08T04:24:01.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.886+0000 7f36e064c640 1 -- 172.21.15.104:0/2508177699 shutdown_connections 2024-05-08T04:24:01.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.886+0000 7f36e064c640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f36c406b740 0x7f36c406dc00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:01.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.886+0000 7f36e064c640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36d8154d20 0x7f36d8160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:01.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.886+0000 7f36e064c640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d80d39b0 0x7f36d81605f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:01.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.886+0000 7f36e064c640 1 --2- 172.21.15.104:0/2508177699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36c0004800 0x7f36d814ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:01.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.886+0000 7f36e064c640 1 -- 172.21.15.104:0/2508177699 >> 172.21.15.104:0/2508177699 conn(0x7f36d8072290 msgr2=0x7f36d80cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:01.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.886+0000 7f36e064c640 1 -- 172.21.15.104:0/2508177699 shutdown_connections 2024-05-08T04:24:01.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:01.886+0000 7f36e064c640 1 -- 172.21.15.104:0/2508177699 wait complete. 2024-05-08T04:24:01.898 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:24:02.015 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":50.097434049,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.595847724452501,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:24:02.015 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.5958477244525 }, "state": "open", "uptime": 50.097434049 } ] 2024-05-08T04:24:02.015 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-05-08T04:24:07.016 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:07.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.129+0000 7f9c9181f640 1 Processor -- start 2024-05-08T04:24:07.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.129+0000 7f9c9181f640 1 -- start start 2024-05-08T04:24:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.130+0000 7f9c9181f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c8c15de10 0x7f9c8c161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.130+0000 7f9c9181f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8c15e1f0 con 0x7f9c8c0d07c0 2024-05-08T04:24:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.130+0000 7f9c9181f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8c162090 con 0x7f9c8c0ce5a0 2024-05-08T04:24:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.130+0000 7f9c9181f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8c0d0f50 con 0x7f9c8c15de10 2024-05-08T04:24:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.130+0000 7f9c8b7fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f9c8c0d07c0 0x7f9c8c0d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:36236/0 (socket says 172.21.15.104:36236) 2024-05-08T04:24:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.130+0000 7f9c8b7fe640 1 -- 172.21.15.104:0/3313848509 learned_addr learned my addr 172.21.15.104:0/3313848509 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.130+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748512630 0 0) 0x7f9c8c15e1f0 con 0x7f9c8c0d07c0 2024-05-08T04:24:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.130+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c78003520 con 0x7f9c8c0d07c0 2024-05-08T04:24:07.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.130+0000 7f9c8affd640 1 --2- 172.21.15.104:0/3313848509 >> v2:172.21.15.183:3300/0 conn(0x7f9c8c15de10 0x7f9c8c161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:07.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 904967875 0 0) 0x7f9c78003520 con 0x7f9c8c0d07c0 2024-05-08T04:24:07.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 >> v2:172.21.15.183:3300/0 conn(0x7f9c8c15de10 msgr2=0x7f9c8c161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:07.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8a7fc640 1 --2- 172.21.15.104:0/3313848509 >> v2:172.21.15.183:3300/0 conn(0x7f9c8c15de10 0x7f9c8c161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:07.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 >> v1:172.21.15.183:6789/0 conn(0x7f9c8c0ce5a0 legacy=0x7f9c8c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:07.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c162370 con 0x7f9c8c0d07c0 2024-05-08T04:24:07.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f9c840019f0 con 0x7f9c8c0d07c0 2024-05-08T04:24:07.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 >> v1:172.21.15.104:6789/0 conn(0x7f9c8c0d07c0 legacy=0x7f9c8c0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:07.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8a7fc640 1 --2- 172.21.15.104:0/3313848509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c780039b0 0x7f9c78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:07.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8a7fc640 1 --2- 172.21.15.104:0/3313848509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c78004800 0x7f9c78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:07.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8a7fc640 1 --2- 172.21.15.104:0/3313848509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c780051c0 0x7f9c7800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:07.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0d0f50 con 0x7f9c78004800 2024-05-08T04:24:07.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7800c160 con 0x7f9c780051c0 2024-05-08T04:24:07.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7800c360 con 0x7f9c780039b0 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c827fc640 1 --2- 172.21.15.104:0/3313848509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c78004800 0x7f9c78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8b7fe640 1 --2- 172.21.15.104:0/3313848509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c780051c0 0x7f9c7800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c827fc640 1 -- 172.21.15.104:0/3313848509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c780039b0 msgr2=0x7f9c78003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c827fc640 1 --2- 172.21.15.104:0/3313848509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c780039b0 0x7f9c78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c827fc640 1 -- 172.21.15.104:0/3313848509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c780051c0 msgr2=0x7f9c7800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c827fc640 1 --2- 172.21.15.104:0/3313848509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c780051c0 0x7f9c7800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c8b7fe640 1 -- 172.21.15.104:0/3313848509 reap_dead start 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.131+0000 7f9c827fc640 1 -- 172.21.15.104:0/3313848509 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78003520 con 0x7f9c78004800 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.132+0000 7f9c827fc640 1 --2- 172.21.15.104:0/3313848509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c78004800 0x7f9c78004c80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9c74001750 tx=0x7f9c78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ba128b3347293a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.132+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74001370 con 0x7f9c78004800 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.132+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c740052d0 con 0x7f9c78004800 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.132+0000 7f9c8a7fc640 1 -- 172.21.15.104:0/3313848509 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7402abc0 con 0x7f9c78004800 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.133+0000 7f9c9181f640 1 -- 172.21.15.104:0/3313848509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c78004800 msgr2=0x7f9c78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:07.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.133+0000 7f9c9181f640 1 --2- 172.21.15.104:0/3313848509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c78004800 0x7f9c78004c80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9c74001750 tx=0x7f9c78005830 comp rx=0 tx=0).stop 2024-05-08T04:24:07.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.133+0000 7f9c9181f640 1 -- 172.21.15.104:0/3313848509 shutdown_connections 2024-05-08T04:24:07.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.133+0000 7f9c9181f640 1 --2- 172.21.15.104:0/3313848509 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c78004800 0x7f9c78004c80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:07.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.133+0000 7f9c9181f640 1 -- 172.21.15.104:0/3313848509 >> 172.21.15.104:0/3313848509 conn(0x7f9c8c072290 msgr2=0x7f9c8c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:07.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.133+0000 7f9c9181f640 1 -- 172.21.15.104:0/3313848509 shutdown_connections 2024-05-08T04:24:07.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.133+0000 7f9c9181f640 1 -- 172.21.15.104:0/3313848509 wait complete. 2024-05-08T04:24:07.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.134+0000 7f9c9181f640 1 Processor -- start 2024-05-08T04:24:07.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.134+0000 7f9c9181f640 1 -- start start 2024-05-08T04:24:07.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c9181f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c78004800 0x7f9c8c160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:07.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c9181f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c8c14f090 0x7f9c8c14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:07.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c9181f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c8c0b88b0 0x7f9c8c0b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:07.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c9181f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0d1ce0 con 0x7f9c78004800 2024-05-08T04:24:07.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c9181f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0d1a90 con 0x7f9c8c0b88b0 2024-05-08T04:24:07.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c9181f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0b6dc0 con 0x7f9c8c14f090 2024-05-08T04:24:07.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c8affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c78004800 0x7f9c8c160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:07.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c8affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c78004800 0x7f9c8c160d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33646/0 (socket says 172.21.15.104:33646) 2024-05-08T04:24:07.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c8affd640 1 -- 172.21.15.104:0/700196029 learned_addr learned my addr 172.21.15.104:0/700196029 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:07.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c8affd640 1 -- 172.21.15.104:0/700196029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c8c14f090 msgr2=0x7f9c8c14e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:07.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c827fc640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c8c14f090 0x7f9c8c14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:07.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c8b7fe640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c8c0b88b0 0x7f9c8c0b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:07.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c8affd640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c8c14f090 0x7f9c8c14e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:07.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c8affd640 1 -- 172.21.15.104:0/700196029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c8c0b88b0 msgr2=0x7f9c8c0b8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:07.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c8affd640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c8c0b88b0 0x7f9c8c0b8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:07.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c8affd640 1 -- 172.21.15.104:0/700196029 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c155b00 con 0x7f9c78004800 2024-05-08T04:24:07.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c827fc640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c8c14f090 0x7f9c8c14e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:07.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c8b7fe640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c8c0b88b0 0x7f9c8c0b8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:07.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c8affd640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c78004800 0x7f9c8c160d50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00e860 tx=0x7f9c7c00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:07.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c88ff9640 1 -- 172.21.15.104:0/700196029 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c017070 con 0x7f9c78004800 2024-05-08T04:24:07.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c88ff9640 1 -- 172.21.15.104:0/700196029 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c00c940 con 0x7f9c78004800 2024-05-08T04:24:07.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.135+0000 7f9c9181f640 1 -- 172.21.15.104:0/700196029 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c154a60 con 0x7f9c78004800 2024-05-08T04:24:07.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.136+0000 7f9c88ff9640 1 -- 172.21.15.104:0/700196029 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00cd10 con 0x7f9c78004800 2024-05-08T04:24:07.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.136+0000 7f9c9181f640 1 -- 172.21.15.104:0/700196029 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c155020 con 0x7f9c78004800 2024-05-08T04:24:07.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.136+0000 7f9c9181f640 1 -- 172.21.15.104:0/700196029 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c075010 con 0x7f9c78004800 2024-05-08T04:24:07.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.137+0000 7f9c88ff9640 1 -- 172.21.15.104:0/700196029 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 8) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f9c7c01a070 con 0x7f9c78004800 2024-05-08T04:24:07.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.138+0000 7f9c88ff9640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c6c06b710 0x7f9c6c06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:07.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.138+0000 7f9c827fc640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c6c06b710 0x7f9c6c06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:07.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.138+0000 7f9c88ff9640 1 -- 172.21.15.104:0/700196029 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9c7c08a580 con 0x7f9c78004800 2024-05-08T04:24:07.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.138+0000 7f9c827fc640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c6c06b710 0x7f9c6c06dbd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9c74032000 tx=0x7f9c7402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:07.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.142+0000 7f9c88ff9640 1 -- 172.21.15.104:0/700196029 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9c7c059170 con 0x7f9c78004800 2024-05-08T04:24:07.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.346+0000 7f9c9181f640 1 -- 172.21.15.104:0/700196029 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c8c0d1870 con 0x7f9c78004800 2024-05-08T04:24:07.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.347+0000 7f9c88ff9640 1 -- 172.21.15.104:0/700196029 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f9c7c058a70 con 0x7f9c78004800 2024-05-08T04:24:07.348 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:07.348 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:24:07.349 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:24:07.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.349+0000 7f9c9181f640 1 -- 172.21.15.104:0/700196029 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c6c06b710 msgr2=0x7f9c6c06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:07.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.349+0000 7f9c9181f640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c6c06b710 0x7f9c6c06dbd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9c74032000 tx=0x7f9c7402e000 comp rx=0 tx=0).stop 2024-05-08T04:24:07.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.349+0000 7f9c9181f640 1 -- 172.21.15.104:0/700196029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c78004800 msgr2=0x7f9c8c160d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:07.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.349+0000 7f9c9181f640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c78004800 0x7f9c8c160d50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00e860 tx=0x7f9c7c00ed20 comp rx=0 tx=0).stop 2024-05-08T04:24:07.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.349+0000 7f9c9181f640 1 -- 172.21.15.104:0/700196029 shutdown_connections 2024-05-08T04:24:07.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.349+0000 7f9c9181f640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9c6c06b710 0x7f9c6c06dbd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:07.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.349+0000 7f9c9181f640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c8c0b88b0 0x7f9c8c0b8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:07.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.349+0000 7f9c9181f640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c8c14f090 0x7f9c8c14e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:07.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.349+0000 7f9c9181f640 1 --2- 172.21.15.104:0/700196029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c78004800 0x7f9c8c160d50 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:07.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.349+0000 7f9c9181f640 1 -- 172.21.15.104:0/700196029 >> 172.21.15.104:0/700196029 conn(0x7f9c8c072290 msgr2=0x7f9c8c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:07.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.349+0000 7f9c9181f640 1 -- 172.21.15.104:0/700196029 shutdown_connections 2024-05-08T04:24:07.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:07.349+0000 7f9c9181f640 1 -- 172.21.15.104:0/700196029 wait complete. 2024-05-08T04:24:07.361 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:24:07.476 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":55.559372371000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.350106741917237,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:24:07.476 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.350106741917237 }, "state": "open", "uptime": 55.559372371 } ] 2024-05-08T04:24:07.476 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-05-08T04:24:10.953 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:24:10.956 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:24:12.477 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:12.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.587+0000 7f1fb66ac640 1 Processor -- start 2024-05-08T04:24:12.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.587+0000 7f1fb66ac640 1 -- start start 2024-05-08T04:24:12.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.588+0000 7f1fb66ac640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1fb0072160 0x7f1fb006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:12.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.588+0000 7f1fb66ac640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1fb015a2a0 0x7f1fb015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:12.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.588+0000 7f1fb66ac640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb015dce0 con 0x7f1fb0159ec0 2024-05-08T04:24:12.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.588+0000 7f1fb66ac640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb006eb60 con 0x7f1fb015a2a0 2024-05-08T04:24:12.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.588+0000 7f1fb66ac640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb006ee40 con 0x7f1fb0072160 2024-05-08T04:24:12.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.588+0000 7f1fb4c49640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1fb015a2a0 0x7f1fb015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:12.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.588+0000 7f1fb4c49640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1fb015a2a0 0x7f1fb015b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36676/0 (socket says 172.21.15.104:36676) 2024-05-08T04:24:12.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.588+0000 7f1fb4c49640 1 -- 172.21.15.104:0/1674227370 learned_addr learned my addr 172.21.15.104:0/1674227370 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:12.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.588+0000 7f1faf7fe640 1 --2- 172.21.15.104:0/1674227370 >> v2:172.21.15.183:3300/0 conn(0x7f1fb0072160 0x7f1fb006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:12.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.589+0000 7f1fb4c49640 1 -- 172.21.15.104:0/1674227370 >> v2:172.21.15.183:3300/0 conn(0x7f1fb0072160 msgr2=0x7f1fb006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:12.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.589+0000 7f1fb4c49640 1 --2- 172.21.15.104:0/1674227370 >> v2:172.21.15.183:3300/0 conn(0x7f1fb0072160 0x7f1fb006e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:12.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.589+0000 7f1fb4c49640 1 -- 172.21.15.104:0/1674227370 >> v1:172.21.15.183:6789/0 conn(0x7f1fb0159ec0 legacy=0x7f1fb0071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:12.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.589+0000 7f1fb4c49640 1 -- 172.21.15.104:0/1674227370 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb015df80 con 0x7f1fb015a2a0 2024-05-08T04:24:12.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.589+0000 7f1fb4c49640 1 --2- 172.21.15.104:0/1674227370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fb015a2a0 0x7f1fb015b1e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00ae6b0 tx=0x7f1fa802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bac4f0a8c428cc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:12.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.590+0000 7f1faeffd640 1 -- 172.21.15.104:0/1674227370 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8038070 con 0x7f1fb015a2a0 2024-05-08T04:24:12.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.590+0000 7f1faeffd640 1 -- 172.21.15.104:0/1674227370 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa8008500 con 0x7f1fb015a2a0 2024-05-08T04:24:12.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.590+0000 7f1faeffd640 1 -- 172.21.15.104:0/1674227370 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa802f050 con 0x7f1fb015a2a0 2024-05-08T04:24:12.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.590+0000 7f1fb66ac640 1 -- 172.21.15.104:0/1674227370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fb015a2a0 msgr2=0x7f1fb015b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:12.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.590+0000 7f1fb66ac640 1 --2- 172.21.15.104:0/1674227370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fb015a2a0 0x7f1fb015b1e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00ae6b0 tx=0x7f1fa802b840 comp rx=0 tx=0).stop 2024-05-08T04:24:12.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.590+0000 7f1fb66ac640 1 -- 172.21.15.104:0/1674227370 shutdown_connections 2024-05-08T04:24:12.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.590+0000 7f1fb66ac640 1 --2- 172.21.15.104:0/1674227370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fb015a2a0 0x7f1fb015b1e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:12.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.590+0000 7f1fb66ac640 1 --2- 172.21.15.104:0/1674227370 >> v2:172.21.15.183:3300/0 conn(0x7f1fb0072160 0x7f1fb006e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:12.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.590+0000 7f1fb66ac640 1 -- 172.21.15.104:0/1674227370 >> 172.21.15.104:0/1674227370 conn(0x7f1fb00b13f0 msgr2=0x7f1fb00b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:12.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.590+0000 7f1fb66ac640 1 -- 172.21.15.104:0/1674227370 shutdown_connections 2024-05-08T04:24:12.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.590+0000 7f1fb66ac640 1 -- 172.21.15.104:0/1674227370 wait complete. 2024-05-08T04:24:12.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.591+0000 7f1fb66ac640 1 Processor -- start 2024-05-08T04:24:12.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.592+0000 7f1fb66ac640 1 -- start start 2024-05-08T04:24:12.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.592+0000 7f1fb66ac640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fb0072160 0x7f1fb0147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:12.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.592+0000 7f1fb66ac640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fb0159ec0 0x7f1fb0153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:12.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.592+0000 7f1fb66ac640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fb015a2a0 0x7f1fb0154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:12.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.592+0000 7f1fb66ac640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb015e900 con 0x7f1fb015a2a0 2024-05-08T04:24:12.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.592+0000 7f1fb66ac640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb015e780 con 0x7f1fb0072160 2024-05-08T04:24:12.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.592+0000 7f1fb66ac640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb015ea80 con 0x7f1fb0159ec0 2024-05-08T04:24:12.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.592+0000 7f1fb4c49640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fb015a2a0 0x7f1fb0154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:12.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1fb4c49640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fb015a2a0 0x7f1fb0154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36688/0 (socket says 172.21.15.104:36688) 2024-05-08T04:24:12.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1fb4c49640 1 -- 172.21.15.104:0/5397224 learned_addr learned my addr 172.21.15.104:0/5397224 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:12.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1faf7fe640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fb0159ec0 0x7f1fb0153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:12.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1faffff640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fb0072160 0x7f1fb0147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:12.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1fb4c49640 1 -- 172.21.15.104:0/5397224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fb0159ec0 msgr2=0x7f1fb0153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:12.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1fb4c49640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fb0159ec0 0x7f1fb0153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:12.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1fb4c49640 1 -- 172.21.15.104:0/5397224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fb0072160 msgr2=0x7f1fb0147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:12.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1fb4c49640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fb0072160 0x7f1fb0147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:12.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1fb4c49640 1 -- 172.21.15.104:0/5397224 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb0147d40 con 0x7f1fb015a2a0 2024-05-08T04:24:12.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1faf7fe640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fb0159ec0 0x7f1fb0153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:12.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1faffff640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fb0072160 0x7f1fb0147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:12.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1fb4c49640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fb015a2a0 0x7f1fb0154470 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800c140 tx=0x7f1fa8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:12.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1facff9640 1 -- 172.21.15.104:0/5397224 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8038040 con 0x7f1fb015a2a0 2024-05-08T04:24:12.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1facff9640 1 -- 172.21.15.104:0/5397224 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa8043070 con 0x7f1fb015a2a0 2024-05-08T04:24:12.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1facff9640 1 -- 172.21.15.104:0/5397224 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa803e8a0 con 0x7f1fb015a2a0 2024-05-08T04:24:12.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1fb66ac640 1 -- 172.21.15.104:0/5397224 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb0151fc0 con 0x7f1fb015a2a0 2024-05-08T04:24:12.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.593+0000 7f1fb66ac640 1 -- 172.21.15.104:0/5397224 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb0152580 con 0x7f1fb015a2a0 2024-05-08T04:24:12.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.594+0000 7f1fb66ac640 1 -- 172.21.15.104:0/5397224 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb0075010 con 0x7f1fb015a2a0 2024-05-08T04:24:12.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.595+0000 7f1facff9640 1 -- 172.21.15.104:0/5397224 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 8) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f1fa803ea40 con 0x7f1fb015a2a0 2024-05-08T04:24:12.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.595+0000 7f1facff9640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1f9c06b710 0x7f1f9c06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:12.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.595+0000 7f1facff9640 1 -- 172.21.15.104:0/5397224 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f1fa80aaff0 con 0x7f1fb015a2a0 2024-05-08T04:24:12.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.595+0000 7f1faffff640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1f9c06b710 0x7f1f9c06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:12.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.596+0000 7f1faffff640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1f9c06b710 0x7f1f9c06dbd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0001700 tx=0x7f1fa0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:12.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.600+0000 7f1facff9640 1 -- 172.21.15.104:0/5397224 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1fa8079ac0 con 0x7f1fb015a2a0 2024-05-08T04:24:12.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.806+0000 7f1fb66ac640 1 -- 172.21.15.104:0/5397224 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fb00b3a70 con 0x7f1fb015a2a0 2024-05-08T04:24:12.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.806+0000 7f1facff9640 1 -- 172.21.15.104:0/5397224 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f1fa80793c0 con 0x7f1fb015a2a0 2024-05-08T04:24:12.808 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:12.808 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:24:12.808 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:24:12.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.808+0000 7f1fb66ac640 1 -- 172.21.15.104:0/5397224 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1f9c06b710 msgr2=0x7f1f9c06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:12.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.808+0000 7f1fb66ac640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1f9c06b710 0x7f1f9c06dbd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0001700 tx=0x7f1fa0009040 comp rx=0 tx=0).stop 2024-05-08T04:24:12.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.808+0000 7f1fb66ac640 1 -- 172.21.15.104:0/5397224 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fb015a2a0 msgr2=0x7f1fb0154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:12.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.808+0000 7f1fb66ac640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fb015a2a0 0x7f1fb0154470 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800c140 tx=0x7f1fa8004a40 comp rx=0 tx=0).stop 2024-05-08T04:24:12.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.808+0000 7f1fb66ac640 1 -- 172.21.15.104:0/5397224 shutdown_connections 2024-05-08T04:24:12.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.808+0000 7f1fb66ac640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1f9c06b710 0x7f1f9c06dbd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:12.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.808+0000 7f1fb66ac640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fb015a2a0 0x7f1fb0154470 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:12.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.808+0000 7f1fb66ac640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1fb0159ec0 0x7f1fb0153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:12.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.808+0000 7f1fb66ac640 1 --2- 172.21.15.104:0/5397224 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1fb0072160 0x7f1fb0147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:12.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.808+0000 7f1fb66ac640 1 -- 172.21.15.104:0/5397224 >> 172.21.15.104:0/5397224 conn(0x7f1fb00b13f0 msgr2=0x7f1fb00b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:12.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.809+0000 7f1fb66ac640 1 -- 172.21.15.104:0/5397224 shutdown_connections 2024-05-08T04:24:12.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:12.809+0000 7f1fb66ac640 1 -- 172.21.15.104:0/5397224 wait complete. 2024-05-08T04:24:12.821 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:24:12.938 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":61.020310703,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.107491612007429,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:24:12.938 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.10749161200743 }, "state": "open", "uptime": 61.020310703 } ] 2024-05-08T04:24:12.938 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-05-08T04:24:17.939 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:18.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.050+0000 7f7297d2b640 1 Processor -- start 2024-05-08T04:24:18.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.051+0000 7f7297d2b640 1 -- start start 2024-05-08T04:24:18.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.051+0000 7f7297d2b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f729015ba10 0x7f7290099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:18.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.051+0000 7f7297d2b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f72900d04f0 0x7f72900b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:18.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.051+0000 7f7297d2b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72900cc5d0 con 0x7f729015ee90 2024-05-08T04:24:18.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.051+0000 7f7297d2b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729009a340 con 0x7f72900d04f0 2024-05-08T04:24:18.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.051+0000 7f7297d2b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729009a620 con 0x7f729015ba10 2024-05-08T04:24:18.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.052+0000 7f72962c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f72900d04f0 0x7f72900b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:18.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.052+0000 7f72962c8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f72900d04f0 0x7f72900b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45866/0 (socket says 172.21.15.104:45866) 2024-05-08T04:24:18.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.052+0000 7f72962c8640 1 -- 172.21.15.104:0/1947695830 learned_addr learned my addr 172.21.15.104:0/1947695830 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:18.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.052+0000 7f7295ac7640 1 --2- 172.21.15.104:0/1947695830 >> v2:172.21.15.183:3300/0 conn(0x7f729015ba10 0x7f7290099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:18.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.052+0000 7f72962c8640 1 -- 172.21.15.104:0/1947695830 >> v2:172.21.15.183:3300/0 conn(0x7f729015ba10 msgr2=0x7f7290099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:18.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.052+0000 7f72962c8640 1 --2- 172.21.15.104:0/1947695830 >> v2:172.21.15.183:3300/0 conn(0x7f729015ba10 0x7f7290099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:18.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.052+0000 7f72962c8640 1 -- 172.21.15.104:0/1947695830 >> v1:172.21.15.104:6789/0 conn(0x7f729015ee90 legacy=0x7f72900cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:18.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.052+0000 7f72962c8640 1 -- 172.21.15.104:0/1947695830 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729009a900 con 0x7f72900d04f0 2024-05-08T04:24:18.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.053+0000 7f72962c8640 1 --2- 172.21.15.104:0/1947695830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72900d04f0 0x7f72900b24c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f72900b3fa0 tx=0x7f728802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120dbb4d3ed12113 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:18.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.053+0000 7f7294ac5640 1 -- 172.21.15.104:0/1947695830 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288037070 con 0x7f72900d04f0 2024-05-08T04:24:18.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.053+0000 7f7294ac5640 1 -- 172.21.15.104:0/1947695830 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7288032440 con 0x7f72900d04f0 2024-05-08T04:24:18.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.053+0000 7f7294ac5640 1 -- 172.21.15.104:0/1947695830 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288032810 con 0x7f72900d04f0 2024-05-08T04:24:18.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.053+0000 7f7297d2b640 1 -- 172.21.15.104:0/1947695830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72900d04f0 msgr2=0x7f72900b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:18.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.053+0000 7f7297d2b640 1 --2- 172.21.15.104:0/1947695830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72900d04f0 0x7f72900b24c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f72900b3fa0 tx=0x7f728802a270 comp rx=0 tx=0).stop 2024-05-08T04:24:18.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.053+0000 7f7297d2b640 1 -- 172.21.15.104:0/1947695830 shutdown_connections 2024-05-08T04:24:18.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.053+0000 7f7297d2b640 1 --2- 172.21.15.104:0/1947695830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f72900d04f0 0x7f72900b24c0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:18.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.053+0000 7f7297d2b640 1 --2- 172.21.15.104:0/1947695830 >> v2:172.21.15.183:3300/0 conn(0x7f729015ba10 0x7f7290099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:18.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.053+0000 7f7297d2b640 1 -- 172.21.15.104:0/1947695830 >> 172.21.15.104:0/1947695830 conn(0x7f72900b3280 msgr2=0x7f72900b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:18.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.053+0000 7f7297d2b640 1 -- 172.21.15.104:0/1947695830 shutdown_connections 2024-05-08T04:24:18.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.054+0000 7f7297d2b640 1 -- 172.21.15.104:0/1947695830 wait complete. 2024-05-08T04:24:18.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.055+0000 7f7297d2b640 1 Processor -- start 2024-05-08T04:24:18.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.055+0000 7f7297d2b640 1 -- start start 2024-05-08T04:24:18.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.055+0000 7f7297d2b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72900d04f0 0x7f7290150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:18.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.055+0000 7f7297d2b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f729015ba10 0x7f72900ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:18.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.055+0000 7f7297d2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f729015ee90 0x7f729015d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.055+0000 7f7297d2b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729009a100 con 0x7f729015ee90 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.055+0000 7f7297d2b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7290099f80 con 0x7f72900d04f0 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.055+0000 7f7297d2b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729006bc70 con 0x7f729015ba10 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f72962c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f729015ee90 0x7f729015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f72962c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f729015ee90 0x7f729015d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45876/0 (socket says 172.21.15.104:45876) 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f72962c8640 1 -- 172.21.15.104:0/3551641656 learned_addr learned my addr 172.21.15.104:0/3551641656 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f7295ac7640 1 --2- 172.21.15.104:0/3551641656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72900d04f0 0x7f7290150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f72962c8640 1 -- 172.21.15.104:0/3551641656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f729015ba10 msgr2=0x7f72900ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f72962c8640 1 --2- 172.21.15.104:0/3551641656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f729015ba10 0x7f72900ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f72962c8640 1 -- 172.21.15.104:0/3551641656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72900d04f0 msgr2=0x7f7290150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f72962c8640 1 --2- 172.21.15.104:0/3551641656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72900d04f0 0x7f7290150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f72962c8640 1 -- 172.21.15.104:0/3551641656 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72900cb3d0 con 0x7f729015ee90 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f72962c8640 1 --2- 172.21.15.104:0/3551641656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f729015ee90 0x7f729015d330 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f728802a2b0 tx=0x7f72880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f728e7fc640 1 -- 172.21.15.104:0/3551641656 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288037040 con 0x7f729015ee90 2024-05-08T04:24:18.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f728e7fc640 1 -- 172.21.15.104:0/3551641656 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7288042070 con 0x7f729015ee90 2024-05-08T04:24:18.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f728e7fc640 1 -- 172.21.15.104:0/3551641656 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288030920 con 0x7f729015ee90 2024-05-08T04:24:18.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f7297d2b640 1 -- 172.21.15.104:0/3551641656 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72900c8990 con 0x7f729015ee90 2024-05-08T04:24:18.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.056+0000 7f7297d2b640 1 -- 172.21.15.104:0/3551641656 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72900c8f50 con 0x7f729015ee90 2024-05-08T04:24:18.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.057+0000 7f7297d2b640 1 -- 172.21.15.104:0/3551641656 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7290075010 con 0x7f729015ee90 2024-05-08T04:24:18.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.058+0000 7f728e7fc640 1 -- 172.21.15.104:0/3551641656 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 8) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f7288030ac0 con 0x7f729015ee90 2024-05-08T04:24:18.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.058+0000 7f728e7fc640 1 --2- 172.21.15.104:0/3551641656 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f727c06b710 0x7f727c06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:18.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.058+0000 7f7295ac7640 1 --2- 172.21.15.104:0/3551641656 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f727c06b710 0x7f727c06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:18.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.058+0000 7f728e7fc640 1 -- 172.21.15.104:0/3551641656 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f72880aaf00 con 0x7f729015ee90 2024-05-08T04:24:18.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.059+0000 7f7295ac7640 1 --2- 172.21.15.104:0/3551641656 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f727c06b710 0x7f727c06dbd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f72900c9fe0 tx=0x7f72800039b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:18.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.062+0000 7f728e7fc640 1 -- 172.21.15.104:0/3551641656 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f72880793d0 con 0x7f729015ee90 2024-05-08T04:24:18.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.267+0000 7f7297d2b640 1 -- 172.21.15.104:0/3551641656 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72900cfbc0 con 0x7f729015ee90 2024-05-08T04:24:18.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.267+0000 7f728e7fc640 1 -- 172.21.15.104:0/3551641656 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f728807d470 con 0x7f729015ee90 2024-05-08T04:24:18.268 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:18.268 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:24:18.269 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:24:18.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.269+0000 7f7297d2b640 1 -- 172.21.15.104:0/3551641656 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f727c06b710 msgr2=0x7f727c06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:18.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.269+0000 7f7297d2b640 1 --2- 172.21.15.104:0/3551641656 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f727c06b710 0x7f727c06dbd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f72900c9fe0 tx=0x7f72800039b0 comp rx=0 tx=0).stop 2024-05-08T04:24:18.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.269+0000 7f7297d2b640 1 -- 172.21.15.104:0/3551641656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f729015ee90 msgr2=0x7f729015d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:18.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.269+0000 7f7297d2b640 1 --2- 172.21.15.104:0/3551641656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f729015ee90 0x7f729015d330 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f728802a2b0 tx=0x7f72880046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:18.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.269+0000 7f7297d2b640 1 -- 172.21.15.104:0/3551641656 shutdown_connections 2024-05-08T04:24:18.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.269+0000 7f7297d2b640 1 --2- 172.21.15.104:0/3551641656 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f727c06b710 0x7f727c06dbd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:18.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.269+0000 7f7297d2b640 1 --2- 172.21.15.104:0/3551641656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f729015ee90 0x7f729015d330 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:18.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.269+0000 7f7297d2b640 1 --2- 172.21.15.104:0/3551641656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f729015ba10 0x7f72900ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:18.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.269+0000 7f7297d2b640 1 --2- 172.21.15.104:0/3551641656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72900d04f0 0x7f7290150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:18.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.269+0000 7f7297d2b640 1 -- 172.21.15.104:0/3551641656 >> 172.21.15.104:0/3551641656 conn(0x7f72900b3280 msgr2=0x7f7290160bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:18.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.269+0000 7f7297d2b640 1 -- 172.21.15.104:0/3551641656 shutdown_connections 2024-05-08T04:24:18.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:18.269+0000 7f7297d2b640 1 -- 172.21.15.104:0/3551641656 wait complete. 2024-05-08T04:24:18.281 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:24:18.396 INFO:teuthology.orchestra.run.smithi104.stdout:[{"id":6102,"entity":{"name":{"type":"client","num":6102},"addr":{"type":"any","addr":"172.21.15.104:0","nonce":2358580280}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":6,"uptime":66.479249057000004,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.868005621913294,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6102 172.21.15.104:0/2358580280","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20","ceph_version":"ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)","entity_id":"y","hostname":"smithi104","pid":"35695","root":"/"}}] 2024-05-08T04:24:18.397 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi104", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35695", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.104:0", "nonce": 2358580280, "type": "any" }, "name": { "num": 6102, "type": "client" } }, "id": 6102, "inst": "client.6102 172.21.15.104:0/2358580280", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 6, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.868005621913294 }, "state": "open", "uptime": 66.479249057 } ] 2024-05-08T04:24:18.397 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-05-08T04:24:23.397 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:23.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.508+0000 7fa20d37e640 1 Processor -- start 2024-05-08T04:24:23.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.508+0000 7fa20d37e640 1 -- start start 2024-05-08T04:24:23.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa20d37e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa20815de10 0x7fa208161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:23.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa20d37e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2080ce5a0 0x7fa2080d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:23.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa20d37e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa2080d05f0 0x7fa2080b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:23.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa20d37e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2080d0f50 con 0x7fa20815de10 2024-05-08T04:24:23.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa20d37e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa208161e60 con 0x7fa2080d05f0 2024-05-08T04:24:23.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa20d37e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080d1a90 con 0x7fa2080ce5a0 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa206ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa20815de10 0x7fa208161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa206ffd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa20815de10 0x7fa208161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45888/0 (socket says 172.21.15.104:45888) 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa206ffd640 1 -- 172.21.15.104:0/965972960 learned_addr learned my addr 172.21.15.104:0/965972960 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa1fffff640 1 --2- 172.21.15.104:0/965972960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2080ce5a0 0x7fa2080d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa206ffd640 1 -- 172.21.15.104:0/965972960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2080ce5a0 msgr2=0x7fa2080d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa2077fe640 1 --2- 172.21.15.104:0/965972960 >> v2:172.21.15.183:3300/0 conn(0x7fa2080d05f0 0x7fa2080b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa206ffd640 1 --2- 172.21.15.104:0/965972960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2080ce5a0 0x7fa2080d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa206ffd640 1 -- 172.21.15.104:0/965972960 >> v2:172.21.15.183:3300/0 conn(0x7fa2080d05f0 msgr2=0x7fa2080b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa206ffd640 1 --2- 172.21.15.104:0/965972960 >> v2:172.21.15.183:3300/0 conn(0x7fa2080d05f0 0x7fa2080b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa206ffd640 1 -- 172.21.15.104:0/965972960 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20815e1f0 con 0x7fa20815de10 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa1fffff640 1 --2- 172.21.15.104:0/965972960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2080ce5a0 0x7fa2080d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.509+0000 7fa2077fe640 1 --2- 172.21.15.104:0/965972960 >> v2:172.21.15.183:3300/0 conn(0x7fa2080d05f0 0x7fa2080b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.510+0000 7fa206ffd640 1 --2- 172.21.15.104:0/965972960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa20815de10 0x7fa208161920 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa20808cd90 tx=0x7fa1f802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b0df4a736569f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:23.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.510+0000 7fa2067fc640 1 -- 172.21.15.104:0/965972960 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8037070 con 0x7fa20815de10 2024-05-08T04:24:23.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.510+0000 7fa2067fc640 1 -- 172.21.15.104:0/965972960 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f8032440 con 0x7fa20815de10 2024-05-08T04:24:23.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.510+0000 7fa2067fc640 1 -- 172.21.15.104:0/965972960 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8032810 con 0x7fa20815de10 2024-05-08T04:24:23.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.511+0000 7fa20d37e640 1 -- 172.21.15.104:0/965972960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa20815de10 msgr2=0x7fa208161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:23.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.511+0000 7fa20d37e640 1 --2- 172.21.15.104:0/965972960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa20815de10 0x7fa208161920 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa20808cd90 tx=0x7fa1f802a140 comp rx=0 tx=0).stop 2024-05-08T04:24:23.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.511+0000 7fa20d37e640 1 -- 172.21.15.104:0/965972960 shutdown_connections 2024-05-08T04:24:23.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.511+0000 7fa20d37e640 1 --2- 172.21.15.104:0/965972960 >> v2:172.21.15.183:3300/0 conn(0x7fa2080d05f0 0x7fa2080b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:23.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.511+0000 7fa20d37e640 1 --2- 172.21.15.104:0/965972960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2080ce5a0 0x7fa2080d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:23.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.511+0000 7fa20d37e640 1 --2- 172.21.15.104:0/965972960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa20815de10 0x7fa208161920 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:23.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.511+0000 7fa20d37e640 1 -- 172.21.15.104:0/965972960 >> 172.21.15.104:0/965972960 conn(0x7fa208072290 msgr2=0x7fa208072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:23.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.511+0000 7fa20d37e640 1 -- 172.21.15.104:0/965972960 shutdown_connections 2024-05-08T04:24:23.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.511+0000 7fa20d37e640 1 -- 172.21.15.104:0/965972960 wait complete. 2024-05-08T04:24:23.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.512+0000 7fa20d37e640 1 Processor -- start 2024-05-08T04:24:23.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.512+0000 7fa20d37e640 1 -- start start 2024-05-08T04:24:23.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa20d37e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2080ce5a0 0x7fa2080c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:23.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa20d37e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2080d05f0 0x7fa2080b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:23.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa20d37e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa20815de10 0x7fa2080b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa20d37e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa208162370 con 0x7fa2080d05f0 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa20d37e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa208162090 con 0x7fa20815de10 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa20d37e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa208162650 con 0x7fa2080ce5a0 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa1fffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2080d05f0 0x7fa2080b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa1fffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2080d05f0 0x7fa2080b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45904/0 (socket says 172.21.15.104:45904) 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa1fffff640 1 -- 172.21.15.104:0/201896607 learned_addr learned my addr 172.21.15.104:0/201896607 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa206ffd640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2080ce5a0 0x7fa2080c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa2077fe640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa20815de10 0x7fa2080b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa1fffff640 1 -- 172.21.15.104:0/201896607 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2080ce5a0 msgr2=0x7fa2080c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa1fffff640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2080ce5a0 0x7fa2080c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa1fffff640 1 -- 172.21.15.104:0/201896607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa20815de10 msgr2=0x7fa2080b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa1fffff640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa20815de10 0x7fa2080b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa1fffff640 1 -- 172.21.15.104:0/201896607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20815e840 con 0x7fa2080d05f0 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa1fffff640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2080d05f0 0x7fa2080b6d80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000c7c0 tx=0x7fa1f000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:23.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.513+0000 7fa1ff7fe640 1 -- 172.21.15.104:0/201896607 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0015070 con 0x7fa2080d05f0 2024-05-08T04:24:23.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.514+0000 7fa1ff7fe640 1 -- 172.21.15.104:0/201896607 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f0007a30 con 0x7fa2080d05f0 2024-05-08T04:24:23.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.514+0000 7fa20d37e640 1 -- 172.21.15.104:0/201896607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20815eb20 con 0x7fa2080d05f0 2024-05-08T04:24:23.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.514+0000 7fa1ff7fe640 1 -- 172.21.15.104:0/201896607 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0007e00 con 0x7fa2080d05f0 2024-05-08T04:24:23.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.514+0000 7fa20d37e640 1 -- 172.21.15.104:0/201896607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20815f0e0 con 0x7fa2080d05f0 2024-05-08T04:24:23.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.514+0000 7fa20d37e640 1 -- 172.21.15.104:0/201896607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa208075010 con 0x7fa2080d05f0 2024-05-08T04:24:23.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.515+0000 7fa1ff7fe640 1 -- 172.21.15.104:0/201896607 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fa1f0018070 con 0x7fa2080d05f0 2024-05-08T04:24:23.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.515+0000 7fa1ff7fe640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa1e806b680 0x7fa1e806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:23.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.515+0000 7fa1ff7fe640 1 -- 172.21.15.104:0/201896607 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fa1f008a590 con 0x7fa2080d05f0 2024-05-08T04:24:23.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.516+0000 7fa206ffd640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa1e806b680 0x7fa1e806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:23.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.516+0000 7fa206ffd640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa1e806b680 0x7fa1e806db40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8034000 tx=0x7fa1f802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:23.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.520+0000 7fa1ff7fe640 1 -- 172.21.15.104:0/201896607 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa1f0059080 con 0x7fa2080d05f0 2024-05-08T04:24:23.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.723+0000 7fa20d37e640 1 -- 172.21.15.104:0/201896607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2080cb8c0 con 0x7fa2080d05f0 2024-05-08T04:24:23.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.723+0000 7fa1ff7fe640 1 -- 172.21.15.104:0/201896607 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fa1f0058980 con 0x7fa2080d05f0 2024-05-08T04:24:23.725 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:23.725 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:24:23.725 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:24:23.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.725+0000 7fa20d37e640 1 -- 172.21.15.104:0/201896607 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa1e806b680 msgr2=0x7fa1e806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:23.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.725+0000 7fa20d37e640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa1e806b680 0x7fa1e806db40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8034000 tx=0x7fa1f802e000 comp rx=0 tx=0).stop 2024-05-08T04:24:23.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.725+0000 7fa20d37e640 1 -- 172.21.15.104:0/201896607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2080d05f0 msgr2=0x7fa2080b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:23.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.725+0000 7fa20d37e640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2080d05f0 0x7fa2080b6d80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000c7c0 tx=0x7fa1f000cc80 comp rx=0 tx=0).stop 2024-05-08T04:24:23.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.725+0000 7fa20d37e640 1 -- 172.21.15.104:0/201896607 shutdown_connections 2024-05-08T04:24:23.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.725+0000 7fa20d37e640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa1e806b680 0x7fa1e806db40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:23.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.725+0000 7fa20d37e640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa20815de10 0x7fa2080b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:23.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.725+0000 7fa20d37e640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa2080d05f0 0x7fa2080b6d80 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:23.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.725+0000 7fa20d37e640 1 --2- 172.21.15.104:0/201896607 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2080ce5a0 0x7fa2080c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:23.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.725+0000 7fa20d37e640 1 -- 172.21.15.104:0/201896607 >> 172.21.15.104:0/201896607 conn(0x7fa208072290 msgr2=0x7fa2080ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:23.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.725+0000 7fa20d37e640 1 -- 172.21.15.104:0/201896607 shutdown_connections 2024-05-08T04:24:23.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:23.725+0000 7fa20d37e640 1 -- 172.21.15.104:0/201896607 wait complete. 2024-05-08T04:24:23.737 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-05-08T04:24:23.853 INFO:teuthology.orchestra.run.smithi104.stdout:[] 2024-05-08T04:24:23.854 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-05-08T04:24:23.854 DEBUG:tasks.ceph_test_case:wait_until_true: success in 65s and 0 retries 2024-05-08T04:24:23.854 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-08T04:24:23.854 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T04:24:23.897 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T04:24:23.941 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-08T04:24:23.942 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:24:23.942 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:24:23.957 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=587 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T04:24:23.958 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:24:23.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:23.958 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T04:24:24.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:24:24.013 INFO:teuthology.orchestra.run.smithi104.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-08T04:24:24.014 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:24:24.014 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:24:24.032 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13681 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T04:24:24.032 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:24:24.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:24.033 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-08T04:24:24.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:24:24.090 INFO:teuthology.orchestra.run.smithi183.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-05-08T04:24:24.091 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:24:24.091 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:24:24.106 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=587 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T04:24:24.107 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:24:24.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:24.107 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-08T04:24:24.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:24:24.162 INFO:teuthology.orchestra.run.smithi104.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-05-08T04:24:24.165 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:24:24.166 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:24:24.184 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13681 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T04:24:24.185 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:24:24.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:24.185 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-08T04:24:24.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:24:24.243 INFO:teuthology.orchestra.run.smithi183.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-05-08T04:24:24.243 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:24.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.340+0000 7fcc1c6ee640 1 Processor -- start 2024-05-08T04:24:24.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.340+0000 7fcc1c6ee640 1 -- start start 2024-05-08T04:24:24.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.341+0000 7fcc1c6ee640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcc14158540 0x7fcc1415e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.341+0000 7fcc1c6ee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc140701a0 0x7fcc14070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.341+0000 7fcc1c6ee640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc14073030 con 0x7fcc140cd120 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.341+0000 7fcc1c6ee640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc140cbf50 con 0x7fcc14158540 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.341+0000 7fcc1c6ee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc14072210 con 0x7fcc140701a0 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.342+0000 7fcc1a48a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcc14158540 0x7fcc1415e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.342+0000 7fcc19c89640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc140701a0 0x7fcc14070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.342+0000 7fcc1ac8b640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fcc140cd120 0x7fcc140cc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:36482/0 (socket says 172.21.15.104:36482) 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.342+0000 7fcc19c89640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc140701a0 0x7fcc14070600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:55816/0 (socket says 172.21.15.104:55816) 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.342+0000 7fcc1a48a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcc14158540 0x7fcc1415e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:45854/0 (socket says 172.21.15.104:45854) 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.342+0000 7fcc1ac8b640 1 -- 172.21.15.104:0/3956234286 learned_addr learned my addr 172.21.15.104:0/3956234286 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.342+0000 7fcc19488640 1 -- 172.21.15.104:0/3956234286 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162310147 0 0) 0x7fcc14073030 con 0x7fcc140cd120 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.342+0000 7fcc19488640 1 -- 172.21.15.104:0/3956234286 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbfc003520 con 0x7fcc140cd120 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.342+0000 7fcc19c89640 1 -- 172.21.15.104:0/3956234286 >> v2:172.21.15.183:3300/0 conn(0x7fcc14158540 msgr2=0x7fcc1415e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.342+0000 7fcc19c89640 1 --2- 172.21.15.104:0/3956234286 >> v2:172.21.15.183:3300/0 conn(0x7fcc14158540 0x7fcc1415e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.342+0000 7fcc19c89640 1 -- 172.21.15.104:0/3956234286 >> v1:172.21.15.183:6789/0 conn(0x7fcc140cd120 legacy=0x7fcc140cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.342+0000 7fcc19c89640 1 -- 172.21.15.104:0/3956234286 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1415e900 con 0x7fcc140701a0 2024-05-08T04:24:24.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.343+0000 7fcc19c89640 1 --2- 172.21.15.104:0/3956234286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc140701a0 0x7fcc14070600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcc080097a0 tx=0x7fcc0802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=874ffa808a5080fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:24.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.343+0000 7fcc19488640 1 -- 172.21.15.104:0/3956234286 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08037070 con 0x7fcc140701a0 2024-05-08T04:24:24.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.343+0000 7fcc19488640 1 -- 172.21.15.104:0/3956234286 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc08032440 con 0x7fcc140701a0 2024-05-08T04:24:24.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.343+0000 7fcc19488640 1 -- 172.21.15.104:0/3956234286 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08032810 con 0x7fcc140701a0 2024-05-08T04:24:24.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.344+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/3956234286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc140701a0 msgr2=0x7fcc14070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.344+0000 7fcc1c6ee640 1 --2- 172.21.15.104:0/3956234286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc140701a0 0x7fcc14070600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcc080097a0 tx=0x7fcc0802a180 comp rx=0 tx=0).stop 2024-05-08T04:24:24.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.344+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/3956234286 shutdown_connections 2024-05-08T04:24:24.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.344+0000 7fcc1c6ee640 1 --2- 172.21.15.104:0/3956234286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc140701a0 0x7fcc14070600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.344+0000 7fcc1c6ee640 1 --2- 172.21.15.104:0/3956234286 >> v2:172.21.15.183:3300/0 conn(0x7fcc14158540 0x7fcc1415e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.344+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/3956234286 >> 172.21.15.104:0/3956234286 conn(0x7fcc140b23e0 msgr2=0x7fcc140b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:24.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.344+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/3956234286 shutdown_connections 2024-05-08T04:24:24.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.344+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/3956234286 wait complete. 2024-05-08T04:24:24.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.345+0000 7fcc1c6ee640 1 Processor -- start 2024-05-08T04:24:24.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.345+0000 7fcc1c6ee640 1 -- start start 2024-05-08T04:24:24.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1c6ee640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc140701a0 0x7fcc1414f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1c6ee640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc140cd120 0x7fcc1415bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1c6ee640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc14158540 0x7fcc140c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1c6ee640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc14072a70 con 0x7fcc140701a0 2024-05-08T04:24:24.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1c6ee640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc14072790 con 0x7fcc14158540 2024-05-08T04:24:24.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1c6ee640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc14072d50 con 0x7fcc140cd120 2024-05-08T04:24:24.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1a48a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc140701a0 0x7fcc1414f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1a48a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc140701a0 0x7fcc1414f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45914/0 (socket says 172.21.15.104:45914) 2024-05-08T04:24:24.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1a48a640 1 -- 172.21.15.104:0/1815456668 learned_addr learned my addr 172.21.15.104:0/1815456668 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:24.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc19c89640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc140cd120 0x7fcc1415bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1ac8b640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc14158540 0x7fcc140c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1a48a640 1 -- 172.21.15.104:0/1815456668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc140cd120 msgr2=0x7fcc1415bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1a48a640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc140cd120 0x7fcc1415bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1a48a640 1 -- 172.21.15.104:0/1815456668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc14158540 msgr2=0x7fcc140c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1a48a640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc14158540 0x7fcc140c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1a48a640 1 -- 172.21.15.104:0/1815456668 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1415c530 con 0x7fcc140701a0 2024-05-08T04:24:24.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1ac8b640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc14158540 0x7fcc140c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:24.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1a48a640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc140701a0 0x7fcc1414f3b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400efc0 tx=0x7fcc0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:24.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc12ffd640 1 -- 172.21.15.104:0/1815456668 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04018020 con 0x7fcc140701a0 2024-05-08T04:24:24.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc12ffd640 1 -- 172.21.15.104:0/1815456668 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc04014480 con 0x7fcc140701a0 2024-05-08T04:24:24.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/1815456668 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1415c810 con 0x7fcc140701a0 2024-05-08T04:24:24.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc12ffd640 1 -- 172.21.15.104:0/1815456668 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04014850 con 0x7fcc140701a0 2024-05-08T04:24:24.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.346+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/1815456668 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1415cdd0 con 0x7fcc140701a0 2024-05-08T04:24:24.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.347+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/1815456668 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc14075010 con 0x7fcc140701a0 2024-05-08T04:24:24.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.348+0000 7fcc12ffd640 1 -- 172.21.15.104:0/1815456668 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fcc04005d10 con 0x7fcc140701a0 2024-05-08T04:24:24.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.348+0000 7fcc12ffd640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcc0006b680 0x7fcc0006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.349+0000 7fcc19c89640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcc0006b680 0x7fcc0006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.349+0000 7fcc12ffd640 1 -- 172.21.15.104:0/1815456668 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fcc0408b070 con 0x7fcc140701a0 2024-05-08T04:24:24.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.349+0000 7fcc19c89640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcc0006b680 0x7fcc0006db40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcc08034000 tx=0x7fcc0802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:24.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.353+0000 7fcc12ffd640 1 -- 172.21.15.104:0/1815456668 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc04022070 con 0x7fcc140701a0 2024-05-08T04:24:24.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.557+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/1815456668 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc140cb270 con 0x7fcc140701a0 2024-05-08T04:24:24.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.558+0000 7fcc12ffd640 1 -- 172.21.15.104:0/1815456668 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fcc04010040 con 0x7fcc140701a0 2024-05-08T04:24:24.559 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:24.559 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:24:24.559 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:24:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.559+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/1815456668 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcc0006b680 msgr2=0x7fcc0006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.559+0000 7fcc1c6ee640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcc0006b680 0x7fcc0006db40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcc08034000 tx=0x7fcc0802e000 comp rx=0 tx=0).stop 2024-05-08T04:24:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.559+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/1815456668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc140701a0 msgr2=0x7fcc1414f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.559+0000 7fcc1c6ee640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc140701a0 0x7fcc1414f3b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400efc0 tx=0x7fcc0400c490 comp rx=0 tx=0).stop 2024-05-08T04:24:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.559+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/1815456668 shutdown_connections 2024-05-08T04:24:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.559+0000 7fcc1c6ee640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fcc0006b680 0x7fcc0006db40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.559+0000 7fcc1c6ee640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc14158540 0x7fcc140c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.559+0000 7fcc1c6ee640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc140cd120 0x7fcc1415bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.559+0000 7fcc1c6ee640 1 --2- 172.21.15.104:0/1815456668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc140701a0 0x7fcc1414f3b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.560+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/1815456668 >> 172.21.15.104:0/1815456668 conn(0x7fcc140b23e0 msgr2=0x7fcc140b5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.560+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/1815456668 shutdown_connections 2024-05-08T04:24:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.560+0000 7fcc1c6ee640 1 -- 172.21.15.104:0/1815456668 wait complete. 2024-05-08T04:24:24.572 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:24:24.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.670+0000 7f3d026ac640 1 Processor -- start 2024-05-08T04:24:24.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.670+0000 7f3d026ac640 1 -- start start 2024-05-08T04:24:24.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3d026ac640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3cfc070c70 0x7f3cfc0d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3d026ac640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cfc071050 0x7f3cfc15c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3d026ac640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cfc15d420 con 0x7f3cfc15cad0 2024-05-08T04:24:24.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3d026ac640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cfc0d16a0 con 0x7f3cfc070c70 2024-05-08T04:24:24.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3d026ac640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc0d0eb0 con 0x7f3cfc071050 2024-05-08T04:24:24.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3cfb7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cfc071050 0x7f3cfc15c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3cfb7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cfc071050 0x7f3cfc15c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:55834/0 (socket says 172.21.15.104:55834) 2024-05-08T04:24:24.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3cfbfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3cfc070c70 0x7f3cfc0d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3d00c49640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f3cfc15cad0 0x7f3cfc15f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:36498/0 (socket says 172.21.15.104:36498) 2024-05-08T04:24:24.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3cfb7fe640 1 -- 172.21.15.104:0/2498471244 learned_addr learned my addr 172.21.15.104:0/2498471244 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:24.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3cfb7fe640 1 -- 172.21.15.104:0/2498471244 >> v2:172.21.15.183:3300/0 conn(0x7f3cfc070c70 msgr2=0x7f3cfc0d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:24.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3cfb7fe640 1 --2- 172.21.15.104:0/2498471244 >> v2:172.21.15.183:3300/0 conn(0x7f3cfc070c70 0x7f3cfc0d0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3cfb7fe640 1 -- 172.21.15.104:0/2498471244 >> v1:172.21.15.183:6789/0 conn(0x7f3cfc15cad0 legacy=0x7f3cfc15f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.671+0000 7f3cfb7fe640 1 -- 172.21.15.104:0/2498471244 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc0d10e0 con 0x7f3cfc071050 2024-05-08T04:24:24.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.672+0000 7f3cfb7fe640 1 --2- 172.21.15.104:0/2498471244 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cfc071050 0x7f3cfc15c590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009870 tx=0x7f3cf002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24001686738dfe9b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:24.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.672+0000 7f3cfaffd640 1 -- 172.21.15.104:0/2498471244 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0037070 con 0x7f3cfc071050 2024-05-08T04:24:24.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.672+0000 7f3cfaffd640 1 -- 172.21.15.104:0/2498471244 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf0032440 con 0x7f3cfc071050 2024-05-08T04:24:24.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.672+0000 7f3cfaffd640 1 -- 172.21.15.104:0/2498471244 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0032810 con 0x7f3cfc071050 2024-05-08T04:24:24.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.673+0000 7f3d026ac640 1 -- 172.21.15.104:0/2498471244 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cfc071050 msgr2=0x7f3cfc15c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.673+0000 7f3d026ac640 1 --2- 172.21.15.104:0/2498471244 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cfc071050 0x7f3cfc15c590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009870 tx=0x7f3cf002a270 comp rx=0 tx=0).stop 2024-05-08T04:24:24.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.673+0000 7f3d026ac640 1 -- 172.21.15.104:0/2498471244 shutdown_connections 2024-05-08T04:24:24.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.673+0000 7f3d026ac640 1 --2- 172.21.15.104:0/2498471244 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cfc071050 0x7f3cfc15c590 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.673+0000 7f3d026ac640 1 --2- 172.21.15.104:0/2498471244 >> v2:172.21.15.183:3300/0 conn(0x7f3cfc070c70 0x7f3cfc0d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.673+0000 7f3d026ac640 1 -- 172.21.15.104:0/2498471244 >> 172.21.15.104:0/2498471244 conn(0x7f3cfc0b3450 msgr2=0x7f3cfc0b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:24.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.673+0000 7f3d026ac640 1 -- 172.21.15.104:0/2498471244 shutdown_connections 2024-05-08T04:24:24.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.673+0000 7f3d026ac640 1 -- 172.21.15.104:0/2498471244 wait complete. 2024-05-08T04:24:24.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.674+0000 7f3d026ac640 1 Processor -- start 2024-05-08T04:24:24.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.674+0000 7f3d026ac640 1 -- start start 2024-05-08T04:24:24.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.675+0000 7f3d026ac640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cfc070c70 0x7f3cfc1f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.675+0000 7f3d026ac640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cfc071050 0x7f3cfc0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.675+0000 7f3d026ac640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cfc15cad0 0x7f3cfc14da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.675+0000 7f3d026ac640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc0714d0 con 0x7f3cfc071050 2024-05-08T04:24:24.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.675+0000 7f3d026ac640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc15d6c0 con 0x7f3cfc070c70 2024-05-08T04:24:24.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.675+0000 7f3d026ac640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc15ebf0 con 0x7f3cfc15cad0 2024-05-08T04:24:24.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.675+0000 7f3cfb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cfc071050 0x7f3cfc0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.675+0000 7f3cfb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cfc071050 0x7f3cfc0b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45918/0 (socket says 172.21.15.104:45918) 2024-05-08T04:24:24.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.675+0000 7f3cfb7fe640 1 -- 172.21.15.104:0/2160340496 learned_addr learned my addr 172.21.15.104:0/2160340496 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:24.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.675+0000 7f3cfbfff640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cfc070c70 0x7f3cfc1f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.675+0000 7f3d00c49640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cfc15cad0 0x7f3cfc14da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.676+0000 7f3cfb7fe640 1 -- 172.21.15.104:0/2160340496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cfc15cad0 msgr2=0x7f3cfc14da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.676+0000 7f3cfb7fe640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cfc15cad0 0x7f3cfc14da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.676+0000 7f3cfb7fe640 1 -- 172.21.15.104:0/2160340496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cfc070c70 msgr2=0x7f3cfc1f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.676+0000 7f3cfb7fe640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cfc070c70 0x7f3cfc1f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.676+0000 7f3cfb7fe640 1 -- 172.21.15.104:0/2160340496 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc1f1ee0 con 0x7f3cfc071050 2024-05-08T04:24:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.676+0000 7f3cfb7fe640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cfc071050 0x7f3cfc0b4f70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3cf002a2b0 tx=0x7f3cf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.676+0000 7f3cf8ff9640 1 -- 172.21.15.104:0/2160340496 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0037040 con 0x7f3cfc071050 2024-05-08T04:24:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.676+0000 7f3cf8ff9640 1 -- 172.21.15.104:0/2160340496 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf0042070 con 0x7f3cfc071050 2024-05-08T04:24:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.676+0000 7f3d026ac640 1 -- 172.21.15.104:0/2160340496 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cfc1f21c0 con 0x7f3cfc071050 2024-05-08T04:24:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.676+0000 7f3cf8ff9640 1 -- 172.21.15.104:0/2160340496 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0030880 con 0x7f3cfc071050 2024-05-08T04:24:24.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.676+0000 7f3d026ac640 1 -- 172.21.15.104:0/2160340496 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cfc1f2780 con 0x7f3cfc071050 2024-05-08T04:24:24.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.677+0000 7f3d026ac640 1 -- 172.21.15.104:0/2160340496 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cfc075010 con 0x7f3cfc071050 2024-05-08T04:24:24.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.678+0000 7f3cf8ff9640 1 -- 172.21.15.104:0/2160340496 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f3cf0030a20 con 0x7f3cfc071050 2024-05-08T04:24:24.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.678+0000 7f3cf8ff9640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3ce806b680 0x7f3ce806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.678+0000 7f3cfbfff640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3ce806b680 0x7f3ce806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.678+0000 7f3cf8ff9640 1 -- 172.21.15.104:0/2160340496 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f3cf00aae20 con 0x7f3cfc071050 2024-05-08T04:24:24.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.678+0000 7f3cfbfff640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3ce806b680 0x7f3ce806db40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0b2f40 tx=0x7f3cec009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:24.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.682+0000 7f3cf8ff9640 1 -- 172.21.15.104:0/2160340496 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3cf0079910 con 0x7f3cfc071050 2024-05-08T04:24:24.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.853+0000 7f3d026ac640 1 -- 172.21.15.104:0/2160340496 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cfc0b4180 con 0x7f3cfc071050 2024-05-08T04:24:24.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.854+0000 7f3cf8ff9640 1 -- 172.21.15.104:0/2160340496 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16961 (secure 0 0 0) 0x7f3cf0079210 con 0x7f3cfc071050 2024-05-08T04:24:24.855 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:24.855 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":47,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:52.009332+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:42.524824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:43.279621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.39","mappings":[{"from":5,"to":7}]},{"pgid":"7.3c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:24:24.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.856+0000 7f3d026ac640 1 -- 172.21.15.104:0/2160340496 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3ce806b680 msgr2=0x7f3ce806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.856+0000 7f3d026ac640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3ce806b680 0x7f3ce806db40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc0b2f40 tx=0x7f3cec009190 comp rx=0 tx=0).stop 2024-05-08T04:24:24.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.856+0000 7f3d026ac640 1 -- 172.21.15.104:0/2160340496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cfc071050 msgr2=0x7f3cfc0b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.856+0000 7f3d026ac640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cfc071050 0x7f3cfc0b4f70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3cf002a2b0 tx=0x7f3cf00046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.856+0000 7f3d026ac640 1 -- 172.21.15.104:0/2160340496 shutdown_connections 2024-05-08T04:24:24.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.856+0000 7f3d026ac640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3ce806b680 0x7f3ce806db40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.856+0000 7f3d026ac640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cfc15cad0 0x7f3cfc14da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.856+0000 7f3d026ac640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3cfc071050 0x7f3cfc0b4f70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.856+0000 7f3d026ac640 1 --2- 172.21.15.104:0/2160340496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cfc070c70 0x7f3cfc1f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.856+0000 7f3d026ac640 1 -- 172.21.15.104:0/2160340496 >> 172.21.15.104:0/2160340496 conn(0x7f3cfc0b3450 msgr2=0x7f3cfc15dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:24.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.856+0000 7f3d026ac640 1 -- 172.21.15.104:0/2160340496 shutdown_connections 2024-05-08T04:24:24.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.856+0000 7f3d026ac640 1 -- 172.21.15.104:0/2160340496 wait complete. 2024-05-08T04:24:24.868 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:22:42.524824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:22:43.279621+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:24:24.869 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:24:24.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.969+0000 7f4d44f32640 1 Processor -- start 2024-05-08T04:24:24.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.970+0000 7f4d44f32640 1 -- start start 2024-05-08T04:24:24.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d44f32640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4d400ce5a0 0x7f4d40161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d44f32640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d400d07c0 0x7f4d400d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d44f32640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4015e1f0 con 0x7f4d4015de10 2024-05-08T04:24:24.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d44f32640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d400d0f50 con 0x7f4d400ce5a0 2024-05-08T04:24:24.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d44f32640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40161e60 con 0x7f4d400d07c0 2024-05-08T04:24:24.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d3dd9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f4d400ce5a0 0x7f4d40161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d3e59c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f4d4015de10 0x7f4d400d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:52760/0 (socket says 172.21.15.104:52760) 2024-05-08T04:24:24.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d3e59c640 1 -- 172.21.15.104:0/3334737882 learned_addr learned my addr 172.21.15.104:0/3334737882 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:24.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d3ed9d640 1 --2- 172.21.15.104:0/3334737882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d400d07c0 0x7f4d400d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d3dd9b640 1 -- 172.21.15.104:0/3334737882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d400d07c0 msgr2=0x7f4d400d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:24.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d3dd9b640 1 --2- 172.21.15.104:0/3334737882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d400d07c0 0x7f4d400d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d3dd9b640 1 -- 172.21.15.104:0/3334737882 >> v1:172.21.15.104:6789/0 conn(0x7f4d4015de10 legacy=0x7f4d400d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d3dd9b640 1 -- 172.21.15.104:0/3334737882 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40162090 con 0x7f4d400ce5a0 2024-05-08T04:24:24.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d3d59a640 1 -- 172.21.15.104:0/3334737882 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019617283 0 0) 0x7f4d4015e1f0 con 0x7f4d4015de10 2024-05-08T04:24:24.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.971+0000 7f4d3ed9d640 1 --2- 172.21.15.104:0/3334737882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d400d07c0 0x7f4d400d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:24.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.972+0000 7f4d3dd9b640 1 --2- 172.21.15.104:0/3334737882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d400ce5a0 0x7f4d40161920 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4d340097a0 tx=0x7f4d3402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9972f0fb2c8cc425 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:24.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.972+0000 7f4d3d59a640 1 -- 172.21.15.104:0/3334737882 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34037070 con 0x7f4d400ce5a0 2024-05-08T04:24:24.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.972+0000 7f4d3d59a640 1 -- 172.21.15.104:0/3334737882 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3402ae50 con 0x7f4d400ce5a0 2024-05-08T04:24:24.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.972+0000 7f4d3d59a640 1 -- 172.21.15.104:0/3334737882 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34032660 con 0x7f4d400ce5a0 2024-05-08T04:24:24.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.972+0000 7f4d44f32640 1 -- 172.21.15.104:0/3334737882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d400ce5a0 msgr2=0x7f4d40161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.972+0000 7f4d44f32640 1 --2- 172.21.15.104:0/3334737882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d400ce5a0 0x7f4d40161920 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4d340097a0 tx=0x7f4d3402a100 comp rx=0 tx=0).stop 2024-05-08T04:24:24.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.972+0000 7f4d44f32640 1 -- 172.21.15.104:0/3334737882 shutdown_connections 2024-05-08T04:24:24.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.973+0000 7f4d44f32640 1 --2- 172.21.15.104:0/3334737882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d400d07c0 0x7f4d400d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.973+0000 7f4d44f32640 1 --2- 172.21.15.104:0/3334737882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d400ce5a0 0x7f4d40161920 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.973+0000 7f4d44f32640 1 -- 172.21.15.104:0/3334737882 >> 172.21.15.104:0/3334737882 conn(0x7f4d40072290 msgr2=0x7f4d40072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:24.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.973+0000 7f4d44f32640 1 -- 172.21.15.104:0/3334737882 shutdown_connections 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.973+0000 7f4d44f32640 1 -- 172.21.15.104:0/3334737882 wait complete. 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.974+0000 7f4d44f32640 1 Processor -- start 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.974+0000 7f4d44f32640 1 -- start start 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d44f32640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d400ce5a0 0x7f4d401f3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d44f32640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d400d07c0 0x7f4d400b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d44f32640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4015de10 0x7f4d400ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d44f32640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40162650 con 0x7f4d400ce5a0 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d44f32640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400d1a90 con 0x7f4d400d07c0 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d44f32640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400d1ce0 con 0x7f4d4015de10 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d3e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d400ce5a0 0x7f4d401f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d3e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d400ce5a0 0x7f4d401f3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45926/0 (socket says 172.21.15.104:45926) 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d3e59c640 1 -- 172.21.15.104:0/1020818040 learned_addr learned my addr 172.21.15.104:0/1020818040 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d3dd9b640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d400d07c0 0x7f4d400b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d3ed9d640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4015de10 0x7f4d400ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d3e59c640 1 -- 172.21.15.104:0/1020818040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4015de10 msgr2=0x7f4d400ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d3e59c640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4015de10 0x7f4d400ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d3e59c640 1 -- 172.21.15.104:0/1020818040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d400d07c0 msgr2=0x7f4d400b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d3e59c640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d400d07c0 0x7f4d400b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d3e59c640 1 -- 172.21.15.104:0/1020818040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400ca8c0 con 0x7f4d400ce5a0 2024-05-08T04:24:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d3e59c640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d400ce5a0 0x7f4d401f3670 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000c4d0 tx=0x7f4d3000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d2effd640 1 -- 172.21.15.104:0/1020818040 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30018070 con 0x7f4d400ce5a0 2024-05-08T04:24:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d2effd640 1 -- 172.21.15.104:0/1020818040 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d30007500 con 0x7f4d400ce5a0 2024-05-08T04:24:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d44f32640 1 -- 172.21.15.104:0/1020818040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d400b3e90 con 0x7f4d400ce5a0 2024-05-08T04:24:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d2effd640 1 -- 172.21.15.104:0/1020818040 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30004a20 con 0x7f4d400ce5a0 2024-05-08T04:24:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.975+0000 7f4d44f32640 1 -- 172.21.15.104:0/1020818040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d400b4450 con 0x7f4d400ce5a0 2024-05-08T04:24:24.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.976+0000 7f4d44f32640 1 -- 172.21.15.104:0/1020818040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d40075010 con 0x7f4d400ce5a0 2024-05-08T04:24:24.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.977+0000 7f4d2effd640 1 -- 172.21.15.104:0/1020818040 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f4d3001b070 con 0x7f4d400ce5a0 2024-05-08T04:24:24.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.977+0000 7f4d2effd640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d2006b680 0x7f4d2006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:24.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.977+0000 7f4d2effd640 1 -- 172.21.15.104:0/1020818040 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f4d30089860 con 0x7f4d400ce5a0 2024-05-08T04:24:24.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.977+0000 7f4d3dd9b640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d2006b680 0x7f4d2006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:24.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.978+0000 7f4d3dd9b640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d2006b680 0x7f4d2006db40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4d34034000 tx=0x7f4d3402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:24.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:24.981+0000 7f4d2effd640 1 -- 172.21.15.104:0/1020818040 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4d30058460 con 0x7f4d400ce5a0 2024-05-08T04:24:25.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.153+0000 7f4d44f32640 1 -- 172.21.15.104:0/1020818040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d400d1870 con 0x7f4d400ce5a0 2024-05-08T04:24:25.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.153+0000 7f4d2effd640 1 -- 172.21.15.104:0/1020818040 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d30057d60 con 0x7f4d400ce5a0 2024-05-08T04:24:25.155 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:24:25.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.155+0000 7f4d44f32640 1 -- 172.21.15.104:0/1020818040 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d2006b680 msgr2=0x7f4d2006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.155+0000 7f4d44f32640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d2006b680 0x7f4d2006db40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4d34034000 tx=0x7f4d3402e000 comp rx=0 tx=0).stop 2024-05-08T04:24:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.155+0000 7f4d44f32640 1 -- 172.21.15.104:0/1020818040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d400ce5a0 msgr2=0x7f4d401f3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.155+0000 7f4d44f32640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d400ce5a0 0x7f4d401f3670 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000c4d0 tx=0x7f4d3000c990 comp rx=0 tx=0).stop 2024-05-08T04:24:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.155+0000 7f4d44f32640 1 -- 172.21.15.104:0/1020818040 shutdown_connections 2024-05-08T04:24:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.155+0000 7f4d44f32640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f4d2006b680 0x7f4d2006db40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.155+0000 7f4d44f32640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d400d07c0 0x7f4d400b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.155+0000 7f4d44f32640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4015de10 0x7f4d400ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.155+0000 7f4d44f32640 1 --2- 172.21.15.104:0/1020818040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d400ce5a0 0x7f4d401f3670 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.155+0000 7f4d44f32640 1 -- 172.21.15.104:0/1020818040 >> 172.21.15.104:0/1020818040 conn(0x7f4d40072290 msgr2=0x7f4d40073fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.155+0000 7f4d44f32640 1 -- 172.21.15.104:0/1020818040 shutdown_connections 2024-05-08T04:24:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.155+0000 7f4d44f32640 1 -- 172.21.15.104:0/1020818040 wait complete. 2024-05-08T04:24:25.167 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:24:25.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.269+0000 7f16cd5c8640 1 Processor -- start 2024-05-08T04:24:25.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.269+0000 7f16cd5c8640 1 -- start start 2024-05-08T04:24:25.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.269+0000 7f16cd5c8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c815de10 0x7f16c8161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.269+0000 7f16cd5c8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f16c80ce5a0 0x7f16c80d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.269+0000 7f16cd5c8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c80d3210 con 0x7f16c80d05f0 2024-05-08T04:24:25.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.269+0000 7f16cd5c8640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c80d0f50 con 0x7f16c80ce5a0 2024-05-08T04:24:25.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.269+0000 7f16cd5c8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8161e60 con 0x7f16c815de10 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c77fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f16c80d05f0 0x7f16c80b54a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:52768/0 (socket says 172.21.15.104:52768) 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c77fe640 1 -- 172.21.15.104:0/2442170433 learned_addr learned my addr 172.21.15.104:0/2442170433 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c67fc640 1 --2- 172.21.15.104:0/2442170433 >> v2:172.21.15.183:3300/0 conn(0x7f16c80ce5a0 0x7f16c80d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c6ffd640 1 --2- 172.21.15.104:0/2442170433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c815de10 0x7f16c8161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240779952 0 0) 0x7f16c80d3210 con 0x7f16c80d05f0 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b0003520 con 0x7f16c80d05f0 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232985232 0 0) 0x7f16b0003520 con 0x7f16c80d05f0 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c815de10 msgr2=0x7f16c8161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 --2- 172.21.15.104:0/2442170433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c815de10 0x7f16c8161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 >> v2:172.21.15.183:3300/0 conn(0x7f16c80ce5a0 msgr2=0x7f16c80d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 --2- 172.21.15.104:0/2442170433 >> v2:172.21.15.183:3300/0 conn(0x7f16c80ce5a0 0x7f16c80d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c815e1f0 con 0x7f16c80d05f0 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f16c00019f0 con 0x7f16c80d05f0 2024-05-08T04:24:25.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 >> v1:172.21.15.104:6789/0 conn(0x7f16c80d05f0 legacy=0x7f16c80b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 --2- 172.21.15.104:0/2442170433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c815de10 0x7f16b00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 --2- 172.21.15.104:0/2442170433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16b0003f30 0x7f16b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 --2- 172.21.15.104:0/2442170433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16b0004d40 0x7f16b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80d0f50 con 0x7f16b0004d40 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b000b9c0 con 0x7f16b0003f30 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b000bb90 con 0x7f16c815de10 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c77fe640 1 --2- 172.21.15.104:0/2442170433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16b0004d40 0x7f16b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c67fc640 1 --2- 172.21.15.104:0/2442170433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16b0003f30 0x7f16b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.270+0000 7f16c6ffd640 1 --2- 172.21.15.104:0/2442170433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c815de10 0x7f16b00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.271+0000 7f16c77fe640 1 -- 172.21.15.104:0/2442170433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c815de10 msgr2=0x7f16b00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.271+0000 7f16c77fe640 1 --2- 172.21.15.104:0/2442170433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c815de10 0x7f16b00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.271+0000 7f16c77fe640 1 -- 172.21.15.104:0/2442170433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16b0003f30 msgr2=0x7f16b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.271+0000 7f16c77fe640 1 --2- 172.21.15.104:0/2442170433 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16b0003f30 0x7f16b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.271+0000 7f16c77fe640 1 -- 172.21.15.104:0/2442170433 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b0003520 con 0x7f16b0004d40 2024-05-08T04:24:25.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.271+0000 7f16c6ffd640 1 --2- 172.21.15.104:0/2442170433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c815de10 0x7f16b00039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.271+0000 7f16c77fe640 1 --2- 172.21.15.104:0/2442170433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16b0004d40 0x7f16b00051c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f16c000a890 tx=0x7f16b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46961ed5b92d7937 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.271+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000a4e0 con 0x7f16b0004d40 2024-05-08T04:24:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.271+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c002f070 con 0x7f16b0004d40 2024-05-08T04:24:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.271+0000 7f16c5ffb640 1 -- 172.21.15.104:0/2442170433 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c002bcf0 con 0x7f16b0004d40 2024-05-08T04:24:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.272+0000 7f16cd5c8640 1 -- 172.21.15.104:0/2442170433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16b0004d40 msgr2=0x7f16b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.272+0000 7f16cd5c8640 1 --2- 172.21.15.104:0/2442170433 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16b0004d40 0x7f16b00051c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f16c000a890 tx=0x7f16b0005830 comp rx=0 tx=0).stop 2024-05-08T04:24:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.272+0000 7f16c77fe640 1 -- 172.21.15.104:0/2442170433 reap_dead start 2024-05-08T04:24:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.272+0000 7f16cd5c8640 1 -- 172.21.15.104:0/2442170433 shutdown_connections 2024-05-08T04:24:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.272+0000 7f16cd5c8640 1 -- 172.21.15.104:0/2442170433 >> 172.21.15.104:0/2442170433 conn(0x7f16c8072290 msgr2=0x7f16c8072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.272+0000 7f16cd5c8640 1 -- 172.21.15.104:0/2442170433 shutdown_connections 2024-05-08T04:24:25.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.272+0000 7f16cd5c8640 1 -- 172.21.15.104:0/2442170433 wait complete. 2024-05-08T04:24:25.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.273+0000 7f16cd5c8640 1 Processor -- start 2024-05-08T04:24:25.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.273+0000 7f16cd5c8640 1 -- start start 2024-05-08T04:24:25.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16cd5c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16b0004d40 0x7f16c80b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16cd5c8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c80c99c0 0x7f16c815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16cd5c8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c8158480 0x7f16c815c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16cd5c8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8162090 con 0x7f16b0004d40 2024-05-08T04:24:25.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16cd5c8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80d1a90 con 0x7f16c8158480 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16cd5c8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8162370 con 0x7f16c80c99c0 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16c6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16b0004d40 0x7f16c80b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16c6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16b0004d40 0x7f16c80b5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45958/0 (socket says 172.21.15.104:45958) 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16c6ffd640 1 -- 172.21.15.104:0/1176969170 learned_addr learned my addr 172.21.15.104:0/1176969170 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16c67fc640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c80c99c0 0x7f16c815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16c6ffd640 1 -- 172.21.15.104:0/1176969170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c80c99c0 msgr2=0x7f16c815bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16c6ffd640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c80c99c0 0x7f16c815bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16c77fe640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c8158480 0x7f16c815c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16c6ffd640 1 -- 172.21.15.104:0/1176969170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c8158480 msgr2=0x7f16c815c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16c6ffd640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c8158480 0x7f16c815c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.274+0000 7f16c6ffd640 1 -- 172.21.15.104:0/1176969170 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c80b4df0 con 0x7f16b0004d40 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.275+0000 7f16c6ffd640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16b0004d40 0x7f16c80b5f90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f16b80116d0 tx=0x7f16b8011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.275+0000 7f16af7fe640 1 -- 172.21.15.104:0/1176969170 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b800f960 con 0x7f16b0004d40 2024-05-08T04:24:25.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.275+0000 7f16af7fe640 1 -- 172.21.15.104:0/1176969170 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b800fb00 con 0x7f16b0004d40 2024-05-08T04:24:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.275+0000 7f16cd5c8640 1 -- 172.21.15.104:0/1176969170 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c80b4270 con 0x7f16b0004d40 2024-05-08T04:24:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.275+0000 7f16af7fe640 1 -- 172.21.15.104:0/1176969170 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8015460 con 0x7f16b0004d40 2024-05-08T04:24:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.275+0000 7f16cd5c8640 1 -- 172.21.15.104:0/1176969170 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c80b4830 con 0x7f16b0004d40 2024-05-08T04:24:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.276+0000 7f16cd5c8640 1 -- 172.21.15.104:0/1176969170 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c8075010 con 0x7f16b0004d40 2024-05-08T04:24:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.276+0000 7f16af7fe640 1 -- 172.21.15.104:0/1176969170 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f16b8015600 con 0x7f16b0004d40 2024-05-08T04:24:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.277+0000 7f16af7fe640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f16b406b6b0 0x7f16b406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.277+0000 7f16c67fc640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f16b406b6b0 0x7f16b406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.277+0000 7f16af7fe640 1 -- 172.21.15.104:0/1176969170 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f16b808aeb0 con 0x7f16b0004d40 2024-05-08T04:24:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.277+0000 7f16c67fc640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f16b406b6b0 0x7f16b406db70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f16c80b33f0 tx=0x7f16bc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:25.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.281+0000 7f16af7fe640 1 -- 172.21.15.104:0/1176969170 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f16b8019030 con 0x7f16b0004d40 2024-05-08T04:24:25.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.449+0000 7f16cd5c8640 1 -- 172.21.15.104:0/1176969170 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16c80741b0 con 0x7f16b0004d40 2024-05-08T04:24:25.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.450+0000 7f16af7fe640 1 -- 172.21.15.104:0/1176969170 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16b8059a20 con 0x7f16b0004d40 2024-05-08T04:24:25.451 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:24:25.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.452+0000 7f16cd5c8640 1 -- 172.21.15.104:0/1176969170 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f16b406b6b0 msgr2=0x7f16b406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.452+0000 7f16cd5c8640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f16b406b6b0 0x7f16b406db70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f16c80b33f0 tx=0x7f16bc008040 comp rx=0 tx=0).stop 2024-05-08T04:24:25.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.452+0000 7f16cd5c8640 1 -- 172.21.15.104:0/1176969170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16b0004d40 msgr2=0x7f16c80b5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.452+0000 7f16cd5c8640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16b0004d40 0x7f16c80b5f90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f16b80116d0 tx=0x7f16b8011b90 comp rx=0 tx=0).stop 2024-05-08T04:24:25.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.452+0000 7f16cd5c8640 1 -- 172.21.15.104:0/1176969170 shutdown_connections 2024-05-08T04:24:25.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.452+0000 7f16cd5c8640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f16b406b6b0 0x7f16b406db70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.452+0000 7f16cd5c8640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c8158480 0x7f16c815c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.452+0000 7f16cd5c8640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f16c80c99c0 0x7f16c815bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.452+0000 7f16cd5c8640 1 --2- 172.21.15.104:0/1176969170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16b0004d40 0x7f16c80b5f90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.452+0000 7f16cd5c8640 1 -- 172.21.15.104:0/1176969170 >> 172.21.15.104:0/1176969170 conn(0x7f16c8072290 msgr2=0x7f16c80cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:25.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.452+0000 7f16cd5c8640 1 -- 172.21.15.104:0/1176969170 shutdown_connections 2024-05-08T04:24:25.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.452+0000 7f16cd5c8640 1 -- 172.21.15.104:0/1176969170 wait complete. 2024-05-08T04:24:25.464 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:24:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.565+0000 7fd69fafc640 1 Processor -- start 2024-05-08T04:24:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.566+0000 7fd69fafc640 1 -- start start 2024-05-08T04:24:25.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.566+0000 7fd69fafc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd6980d07c0 0x7fd698161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.566+0000 7fd69fafc640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69815e1f0 con 0x7fd69815de10 2024-05-08T04:24:25.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.566+0000 7fd69fafc640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd698162090 con 0x7fd6980ce5a0 2024-05-08T04:24:25.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.566+0000 7fd69fafc640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6980d0f50 con 0x7fd6980d07c0 2024-05-08T04:24:25.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.567+0000 7fd69e099640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fd6980d07c0 0x7fd698161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.567+0000 7fd69d898640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd69815de10 0x7fd6980d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:52770/0 (socket says 172.21.15.104:52770) 2024-05-08T04:24:25.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.567+0000 7fd69d898640 1 -- 172.21.15.104:0/3687269938 learned_addr learned my addr 172.21.15.104:0/3687269938 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:25.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.567+0000 7fd69e099640 1 -- 172.21.15.104:0/3687269938 >> v1:172.21.15.183:6789/0 conn(0x7fd6980ce5a0 legacy=0x7fd6980d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:25.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.567+0000 7fd69e099640 1 -- 172.21.15.104:0/3687269938 >> v1:172.21.15.104:6789/0 conn(0x7fd69815de10 legacy=0x7fd6980d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.567+0000 7fd69e099640 1 -- 172.21.15.104:0/3687269938 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd698162370 con 0x7fd6980d07c0 2024-05-08T04:24:25.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.567+0000 7fd69c896640 1 -- 172.21.15.104:0/3687269938 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793388598 0 0) 0x7fd69815e1f0 con 0x7fd69815de10 2024-05-08T04:24:25.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.567+0000 7fd69e099640 1 --2- 172.21.15.104:0/3687269938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6980d07c0 0x7fd698161920 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd690009d90 tx=0x7fd69002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5c9a2da9ac8948 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:25.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.568+0000 7fd69c896640 1 -- 172.21.15.104:0/3687269938 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690031600 con 0x7fd6980d07c0 2024-05-08T04:24:25.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.568+0000 7fd69c896640 1 -- 172.21.15.104:0/3687269938 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6900317a0 con 0x7fd6980d07c0 2024-05-08T04:24:25.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.568+0000 7fd69c896640 1 -- 172.21.15.104:0/3687269938 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690031b70 con 0x7fd6980d07c0 2024-05-08T04:24:25.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.568+0000 7fd69fafc640 1 -- 172.21.15.104:0/3687269938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6980d07c0 msgr2=0x7fd698161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.568+0000 7fd69fafc640 1 --2- 172.21.15.104:0/3687269938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6980d07c0 0x7fd698161920 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd690009d90 tx=0x7fd69002a610 comp rx=0 tx=0).stop 2024-05-08T04:24:25.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.568+0000 7fd69fafc640 1 -- 172.21.15.104:0/3687269938 shutdown_connections 2024-05-08T04:24:25.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.568+0000 7fd69fafc640 1 --2- 172.21.15.104:0/3687269938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6980d07c0 0x7fd698161920 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.568+0000 7fd69fafc640 1 -- 172.21.15.104:0/3687269938 >> 172.21.15.104:0/3687269938 conn(0x7fd698072290 msgr2=0x7fd698072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.568+0000 7fd69fafc640 1 -- 172.21.15.104:0/3687269938 shutdown_connections 2024-05-08T04:24:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.568+0000 7fd69fafc640 1 -- 172.21.15.104:0/3687269938 wait complete. 2024-05-08T04:24:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.569+0000 7fd69fafc640 1 Processor -- start 2024-05-08T04:24:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.570+0000 7fd69fafc640 1 -- start start 2024-05-08T04:24:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.570+0000 7fd69fafc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6980ce5a0 0x7fd6980cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.570+0000 7fd69fafc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6980d07c0 0x7fd6980c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.570+0000 7fd69fafc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd69815de10 0x7fd698152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.570+0000 7fd69fafc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980d1a90 con 0x7fd69815de10 2024-05-08T04:24:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.570+0000 7fd69fafc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980d1ce0 con 0x7fd6980d07c0 2024-05-08T04:24:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.570+0000 7fd69fafc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980b6dc0 con 0x7fd6980ce5a0 2024-05-08T04:24:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.570+0000 7fd69e099640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd69815de10 0x7fd698152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.570+0000 7fd69e099640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd69815de10 0x7fd698152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45976/0 (socket says 172.21.15.104:45976) 2024-05-08T04:24:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.570+0000 7fd69e099640 1 -- 172.21.15.104:0/2648519364 learned_addr learned my addr 172.21.15.104:0/2648519364 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.571+0000 7fd69d898640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6980ce5a0 0x7fd6980cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.571+0000 7fd69d097640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6980d07c0 0x7fd6980c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.571+0000 7fd69e099640 1 -- 172.21.15.104:0/2648519364 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6980ce5a0 msgr2=0x7fd6980cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.571+0000 7fd69e099640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6980ce5a0 0x7fd6980cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.571+0000 7fd69e099640 1 -- 172.21.15.104:0/2648519364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6980d07c0 msgr2=0x7fd6980c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.571+0000 7fd69e099640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6980d07c0 0x7fd6980c9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.571+0000 7fd69e099640 1 -- 172.21.15.104:0/2648519364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69815e890 con 0x7fd69815de10 2024-05-08T04:24:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.571+0000 7fd69e099640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd69815de10 0x7fd698152e50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd690009d90 tx=0x7fd690004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.571+0000 7fd68e7fc640 1 -- 172.21.15.104:0/2648519364 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690040070 con 0x7fd69815de10 2024-05-08T04:24:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.571+0000 7fd68e7fc640 1 -- 172.21.15.104:0/2648519364 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd690030b60 con 0x7fd69815de10 2024-05-08T04:24:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.571+0000 7fd69fafc640 1 -- 172.21.15.104:0/2648519364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69815eb70 con 0x7fd69815de10 2024-05-08T04:24:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.571+0000 7fd68e7fc640 1 -- 172.21.15.104:0/2648519364 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69003c420 con 0x7fd69815de10 2024-05-08T04:24:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.571+0000 7fd69fafc640 1 -- 172.21.15.104:0/2648519364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69815f130 con 0x7fd69815de10 2024-05-08T04:24:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.572+0000 7fd69fafc640 1 -- 172.21.15.104:0/2648519364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd698075010 con 0x7fd69815de10 2024-05-08T04:24:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.573+0000 7fd68e7fc640 1 -- 172.21.15.104:0/2648519364 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fd690039040 con 0x7fd69815de10 2024-05-08T04:24:25.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.573+0000 7fd68e7fc640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd67c06b680 0x7fd67c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.573+0000 7fd68e7fc640 1 -- 172.21.15.104:0/2648519364 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fd6900abb40 con 0x7fd69815de10 2024-05-08T04:24:25.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.573+0000 7fd69d898640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd67c06b680 0x7fd67c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.573+0000 7fd69d898640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd67c06b680 0x7fd67c06db40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd694000f60 tx=0x7fd694009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:25.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.577+0000 7fd68e7fc640 1 -- 172.21.15.104:0/2648519364 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd69007a010 con 0x7fd69815de10 2024-05-08T04:24:25.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.748+0000 7fd69fafc640 1 -- 172.21.15.104:0/2648519364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6980b9520 con 0x7fd69815de10 2024-05-08T04:24:25.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.748+0000 7fd68e7fc640 1 -- 172.21.15.104:0/2648519364 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd69007e0b0 con 0x7fd69815de10 2024-05-08T04:24:25.750 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:24:25.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.750+0000 7fd69fafc640 1 -- 172.21.15.104:0/2648519364 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd67c06b680 msgr2=0x7fd67c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.750+0000 7fd69fafc640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd67c06b680 0x7fd67c06db40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd694000f60 tx=0x7fd694009040 comp rx=0 tx=0).stop 2024-05-08T04:24:25.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.750+0000 7fd69fafc640 1 -- 172.21.15.104:0/2648519364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd69815de10 msgr2=0x7fd698152e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.750+0000 7fd69fafc640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd69815de10 0x7fd698152e50 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd690009d90 tx=0x7fd690004a40 comp rx=0 tx=0).stop 2024-05-08T04:24:25.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.750+0000 7fd69fafc640 1 -- 172.21.15.104:0/2648519364 shutdown_connections 2024-05-08T04:24:25.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.750+0000 7fd69fafc640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd67c06b680 0x7fd67c06db40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.750+0000 7fd69fafc640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6980d07c0 0x7fd6980c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.750+0000 7fd69fafc640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd69815de10 0x7fd698152e50 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.750+0000 7fd69fafc640 1 --2- 172.21.15.104:0/2648519364 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6980ce5a0 0x7fd6980cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.750+0000 7fd69fafc640 1 -- 172.21.15.104:0/2648519364 >> 172.21.15.104:0/2648519364 conn(0x7fd698072290 msgr2=0x7fd698158fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:25.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.750+0000 7fd69fafc640 1 -- 172.21.15.104:0/2648519364 shutdown_connections 2024-05-08T04:24:25.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.750+0000 7fd69fafc640 1 -- 172.21.15.104:0/2648519364 wait complete. 2024-05-08T04:24:25.762 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:25.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.860+0000 7fe7c22e4640 1 Processor -- start 2024-05-08T04:24:25.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.860+0000 7fe7c22e4640 1 -- start start 2024-05-08T04:24:25.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.861+0000 7fe7c22e4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7bc0715d0 0x7fe7bc0719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.861+0000 7fe7c22e4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe7bc0725b0 0x7fe7bc0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.861+0000 7fe7c22e4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7bc071ef0 con 0x7fe7bc0cf190 2024-05-08T04:24:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.861+0000 7fe7c22e4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7bc0cf680 con 0x7fe7bc0725b0 2024-05-08T04:24:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.861+0000 7fe7c22e4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc15c240 con 0x7fe7bc0715d0 2024-05-08T04:24:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.861+0000 7fe7bbfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7bc0715d0 0x7fe7bc0719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.861+0000 7fe7b3fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe7bc0725b0 0x7fe7bc0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.861+0000 7fe7bbfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7bc0715d0 0x7fe7bc0719b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:55902/0 (socket says 172.21.15.104:55902) 2024-05-08T04:24:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.861+0000 7fe7bbfff640 1 -- 172.21.15.104:0/558921501 learned_addr learned my addr 172.21.15.104:0/558921501 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.862+0000 7fe7bbfff640 1 -- 172.21.15.104:0/558921501 >> v2:172.21.15.183:3300/0 conn(0x7fe7bc0725b0 msgr2=0x7fe7bc0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.862+0000 7fe7bbfff640 1 --2- 172.21.15.104:0/558921501 >> v2:172.21.15.183:3300/0 conn(0x7fe7bc0725b0 0x7fe7bc0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.862+0000 7fe7bbfff640 1 -- 172.21.15.104:0/558921501 >> v1:172.21.15.183:6789/0 conn(0x7fe7bc0cf190 legacy=0x7fe7bc15f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.862+0000 7fe7bbfff640 1 -- 172.21.15.104:0/558921501 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc15c520 con 0x7fe7bc0715d0 2024-05-08T04:24:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.863+0000 7fe7bbfff640 1 --2- 172.21.15.104:0/558921501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7bc0715d0 0x7fe7bc0719b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009870 tx=0x7fe7ac02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9832cc597d434608 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:25.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.863+0000 7fe7bb7fe640 1 -- 172.21.15.104:0/558921501 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac037070 con 0x7fe7bc0715d0 2024-05-08T04:24:25.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.863+0000 7fe7bb7fe640 1 -- 172.21.15.104:0/558921501 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac032440 con 0x7fe7bc0715d0 2024-05-08T04:24:25.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.863+0000 7fe7bb7fe640 1 -- 172.21.15.104:0/558921501 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac032810 con 0x7fe7bc0715d0 2024-05-08T04:24:25.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.863+0000 7fe7c22e4640 1 -- 172.21.15.104:0/558921501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7bc0715d0 msgr2=0x7fe7bc0719b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.863+0000 7fe7c22e4640 1 --2- 172.21.15.104:0/558921501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7bc0715d0 0x7fe7bc0719b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009870 tx=0x7fe7ac02a130 comp rx=0 tx=0).stop 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.863+0000 7fe7c22e4640 1 -- 172.21.15.104:0/558921501 shutdown_connections 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.863+0000 7fe7c22e4640 1 --2- 172.21.15.104:0/558921501 >> v2:172.21.15.183:3300/0 conn(0x7fe7bc0725b0 0x7fe7bc0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.863+0000 7fe7c22e4640 1 --2- 172.21.15.104:0/558921501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7bc0715d0 0x7fe7bc0719b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.863+0000 7fe7c22e4640 1 -- 172.21.15.104:0/558921501 >> 172.21.15.104:0/558921501 conn(0x7fe7bc0cfa60 msgr2=0x7fe7bc0cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.863+0000 7fe7c22e4640 1 -- 172.21.15.104:0/558921501 shutdown_connections 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.863+0000 7fe7c22e4640 1 -- 172.21.15.104:0/558921501 wait complete. 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.864+0000 7fe7c22e4640 1 Processor -- start 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.865+0000 7fe7c22e4640 1 -- start start 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.865+0000 7fe7c22e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7bc0715d0 0x7fe7bc1f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.865+0000 7fe7c22e4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7bc0725b0 0x7fe7bc13c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.865+0000 7fe7c22e4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7bc0cf190 0x7fe7bc13ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.865+0000 7fe7c22e4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc15cea0 con 0x7fe7bc0715d0 2024-05-08T04:24:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.865+0000 7fe7c22e4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc15cd20 con 0x7fe7bc0cf190 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.865+0000 7fe7c22e4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc1f3790 con 0x7fe7bc0725b0 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.865+0000 7fe7bbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7bc0715d0 0x7fe7bc1f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.865+0000 7fe7bbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7bc0715d0 0x7fe7bc1f2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45992/0 (socket says 172.21.15.104:45992) 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.865+0000 7fe7bbfff640 1 -- 172.21.15.104:0/668306909 learned_addr learned my addr 172.21.15.104:0/668306909 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7b3fff640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7bc0725b0 0x7fe7bc13c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7c0881640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7bc0cf190 0x7fe7bc13ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7bbfff640 1 -- 172.21.15.104:0/668306909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7bc0725b0 msgr2=0x7fe7bc13c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7bbfff640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7bc0725b0 0x7fe7bc13c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7bbfff640 1 -- 172.21.15.104:0/668306909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7bc0cf190 msgr2=0x7fe7bc13ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7bbfff640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7bc0cf190 0x7fe7bc13ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7bbfff640 1 -- 172.21.15.104:0/668306909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc1f2ef0 con 0x7fe7bc0715d0 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7b3fff640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7bc0725b0 0x7fe7bc13c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7c0881640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7bc0cf190 0x7fe7bc13ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7bbfff640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7bc0715d0 0x7fe7bc1f2630 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac000c00 tx=0x7fe7ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7b97fa640 1 -- 172.21.15.104:0/668306909 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac037040 con 0x7fe7bc0715d0 2024-05-08T04:24:25.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7b97fa640 1 -- 172.21.15.104:0/668306909 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac042070 con 0x7fe7bc0715d0 2024-05-08T04:24:25.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7c22e4640 1 -- 172.21.15.104:0/668306909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7bc1f31d0 con 0x7fe7bc0715d0 2024-05-08T04:24:25.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7b97fa640 1 -- 172.21.15.104:0/668306909 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac030880 con 0x7fe7bc0715d0 2024-05-08T04:24:25.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.866+0000 7fe7c22e4640 1 -- 172.21.15.104:0/668306909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7bc1f2b70 con 0x7fe7bc0715d0 2024-05-08T04:24:25.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.867+0000 7fe7c22e4640 1 -- 172.21.15.104:0/668306909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7bc13ac30 con 0x7fe7bc0715d0 2024-05-08T04:24:25.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.867+0000 7fe7b97fa640 1 -- 172.21.15.104:0/668306909 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fe7ac030a20 con 0x7fe7bc0715d0 2024-05-08T04:24:25.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.868+0000 7fe7b97fa640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe79c06b680 0x7fe79c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:25.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.868+0000 7fe7b97fa640 1 -- 172.21.15.104:0/668306909 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fe7ac0aadd0 con 0x7fe7bc0715d0 2024-05-08T04:24:25.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.868+0000 7fe7b3fff640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe79c06b680 0x7fe79c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:25.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.868+0000 7fe7b3fff640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe79c06b680 0x7fe79c06db40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc13f640 tx=0x7fe7a4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:25.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:25.872+0000 7fe7b97fa640 1 -- 172.21.15.104:0/668306909 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe7bc13ac30 con 0x7fe7bc0715d0 2024-05-08T04:24:26.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.077+0000 7fe7c22e4640 1 -- 172.21.15.104:0/668306909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7bc075010 con 0x7fe7bc0715d0 2024-05-08T04:24:26.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.077+0000 7fe7b97fa640 1 -- 172.21.15.104:0/668306909 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fe7ac0ac090 con 0x7fe7bc0715d0 2024-05-08T04:24:26.079 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:26.079 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:24:26.079 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:24:26.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.079+0000 7fe7c22e4640 1 -- 172.21.15.104:0/668306909 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe79c06b680 msgr2=0x7fe79c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.079+0000 7fe7c22e4640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe79c06b680 0x7fe79c06db40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc13f640 tx=0x7fe7a4008040 comp rx=0 tx=0).stop 2024-05-08T04:24:26.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.079+0000 7fe7c22e4640 1 -- 172.21.15.104:0/668306909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7bc0715d0 msgr2=0x7fe7bc1f2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.079+0000 7fe7c22e4640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7bc0715d0 0x7fe7bc1f2630 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac000c00 tx=0x7fe7ac0046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.079+0000 7fe7c22e4640 1 -- 172.21.15.104:0/668306909 shutdown_connections 2024-05-08T04:24:26.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.079+0000 7fe7c22e4640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe79c06b680 0x7fe79c06db40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.079+0000 7fe7c22e4640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7bc0cf190 0x7fe7bc13ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.079+0000 7fe7c22e4640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7bc0725b0 0x7fe7bc13c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.079+0000 7fe7c22e4640 1 --2- 172.21.15.104:0/668306909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7bc0715d0 0x7fe7bc1f2630 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.079+0000 7fe7c22e4640 1 -- 172.21.15.104:0/668306909 >> 172.21.15.104:0/668306909 conn(0x7fe7bc0cfa60 msgr2=0x7fe7bc06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:26.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.079+0000 7fe7c22e4640 1 -- 172.21.15.104:0/668306909 shutdown_connections 2024-05-08T04:24:26.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.079+0000 7fe7c22e4640 1 -- 172.21.15.104:0/668306909 wait complete. 2024-05-08T04:24:26.091 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:24:26.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.190+0000 7ffa129ab640 1 Processor -- start 2024-05-08T04:24:26.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.190+0000 7ffa129ab640 1 -- start start 2024-05-08T04:24:26.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.191+0000 7ffa129ab640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffa0c158540 0x7ffa0c15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.191+0000 7ffa129ab640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa0c0cd830 0x7ffa0c070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.191+0000 7ffa129ab640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c073030 con 0x7ffa0c0701a0 2024-05-08T04:24:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.191+0000 7ffa129ab640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c0cbf50 con 0x7ffa0c158540 2024-05-08T04:24:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.191+0000 7ffa129ab640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c072210 con 0x7ffa0c0cd830 2024-05-08T04:24:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.192+0000 7ffa0b7fe640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7ffa0c0701a0 0x7ffa0c0cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:36524/0 (socket says 172.21.15.104:36524) 2024-05-08T04:24:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.192+0000 7ffa0b7fe640 1 -- 172.21.15.104:0/3905112057 learned_addr learned my addr 172.21.15.104:0/3905112057 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.192+0000 7ffa0bfff640 1 --2- 172.21.15.104:0/3905112057 >> v2:172.21.15.183:3300/0 conn(0x7ffa0c158540 0x7ffa0c15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.192+0000 7ffa10f48640 1 --2- 172.21.15.104:0/3905112057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa0c0cd830 0x7ffa0c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.192+0000 7ffa0affd640 1 -- 172.21.15.104:0/3905112057 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960342767 0 0) 0x7ffa0c073030 con 0x7ffa0c0701a0 2024-05-08T04:24:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.192+0000 7ffa0affd640 1 -- 172.21.15.104:0/3905112057 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9f4003520 con 0x7ffa0c0701a0 2024-05-08T04:24:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.192+0000 7ffa0bfff640 1 -- 172.21.15.104:0/3905112057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa0c0cd830 msgr2=0x7ffa0c070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.192+0000 7ffa0bfff640 1 --2- 172.21.15.104:0/3905112057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa0c0cd830 0x7ffa0c070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.192+0000 7ffa0bfff640 1 -- 172.21.15.104:0/3905112057 >> v1:172.21.15.183:6789/0 conn(0x7ffa0c0701a0 legacy=0x7ffa0c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.192+0000 7ffa0bfff640 1 -- 172.21.15.104:0/3905112057 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c15e900 con 0x7ffa0c158540 2024-05-08T04:24:26.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.193+0000 7ffa0bfff640 1 --2- 172.21.15.104:0/3905112057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa0c158540 0x7ffa0c15e3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0097a0 tx=0x7ff9fc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66eb230b92e8b5a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:26.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.193+0000 7ffa0affd640 1 -- 172.21.15.104:0/3905112057 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc037070 con 0x7ffa0c158540 2024-05-08T04:24:26.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.193+0000 7ffa0affd640 1 -- 172.21.15.104:0/3905112057 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc032440 con 0x7ffa0c158540 2024-05-08T04:24:26.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.193+0000 7ffa0affd640 1 -- 172.21.15.104:0/3905112057 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc0327f0 con 0x7ffa0c158540 2024-05-08T04:24:26.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.194+0000 7ffa129ab640 1 -- 172.21.15.104:0/3905112057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa0c158540 msgr2=0x7ffa0c15e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.194+0000 7ffa129ab640 1 --2- 172.21.15.104:0/3905112057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa0c158540 0x7ffa0c15e3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc0097a0 tx=0x7ff9fc02a180 comp rx=0 tx=0).stop 2024-05-08T04:24:26.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.194+0000 7ffa129ab640 1 -- 172.21.15.104:0/3905112057 shutdown_connections 2024-05-08T04:24:26.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.194+0000 7ffa129ab640 1 --2- 172.21.15.104:0/3905112057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa0c0cd830 0x7ffa0c070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.194+0000 7ffa129ab640 1 --2- 172.21.15.104:0/3905112057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa0c158540 0x7ffa0c15e3c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.194+0000 7ffa129ab640 1 -- 172.21.15.104:0/3905112057 >> 172.21.15.104:0/3905112057 conn(0x7ffa0c0b23e0 msgr2=0x7ffa0c0b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:26.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.194+0000 7ffa129ab640 1 -- 172.21.15.104:0/3905112057 shutdown_connections 2024-05-08T04:24:26.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.194+0000 7ffa129ab640 1 -- 172.21.15.104:0/3905112057 wait complete. 2024-05-08T04:24:26.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.195+0000 7ffa129ab640 1 Processor -- start 2024-05-08T04:24:26.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.195+0000 7ffa129ab640 1 -- start start 2024-05-08T04:24:26.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa129ab640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa0c0701a0 0x7ffa0c0c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa129ab640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c0cd830 0x7ffa0c155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa129ab640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa0c158540 0x7ffa0c15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa129ab640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c072a70 con 0x7ffa0c0cd830 2024-05-08T04:24:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa129ab640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c072790 con 0x7ffa0c158540 2024-05-08T04:24:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa129ab640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c072d50 con 0x7ffa0c0701a0 2024-05-08T04:24:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa0b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c0cd830 0x7ffa0c155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa0b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c0cd830 0x7ffa0c155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46004/0 (socket says 172.21.15.104:46004) 2024-05-08T04:24:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa0b7fe640 1 -- 172.21.15.104:0/3572280735 learned_addr learned my addr 172.21.15.104:0/3572280735 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa10f48640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa0c158540 0x7ffa0c15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa0bfff640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa0c0701a0 0x7ffa0c0c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa0b7fe640 1 -- 172.21.15.104:0/3572280735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa0c0701a0 msgr2=0x7ffa0c0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa0b7fe640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa0c0701a0 0x7ffa0c0c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa0b7fe640 1 -- 172.21.15.104:0/3572280735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa0c158540 msgr2=0x7ffa0c15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa0b7fe640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa0c158540 0x7ffa0c15d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa0b7fe640 1 -- 172.21.15.104:0/3572280735 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c0c9020 con 0x7ffa0c0cd830 2024-05-08T04:24:26.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa0b7fe640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c0cd830 0x7ffa0c155410 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000c430 tx=0x7ffa0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.196+0000 7ffa08ff9640 1 -- 172.21.15.104:0/3572280735 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00017070 con 0x7ffa0c0cd830 2024-05-08T04:24:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.197+0000 7ffa08ff9640 1 -- 172.21.15.104:0/3572280735 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa00005ce0 con 0x7ffa0c0cd830 2024-05-08T04:24:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.197+0000 7ffa08ff9640 1 -- 172.21.15.104:0/3572280735 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa000072f0 con 0x7ffa0c0cd830 2024-05-08T04:24:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.197+0000 7ffa129ab640 1 -- 172.21.15.104:0/3572280735 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c0c7a40 con 0x7ffa0c0cd830 2024-05-08T04:24:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.197+0000 7ffa129ab640 1 -- 172.21.15.104:0/3572280735 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c0c82e0 con 0x7ffa0c0cd830 2024-05-08T04:24:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.197+0000 7ffa129ab640 1 -- 172.21.15.104:0/3572280735 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c075010 con 0x7ffa0c0cd830 2024-05-08T04:24:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.198+0000 7ffa08ff9640 1 -- 172.21.15.104:0/3572280735 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7ffa0001a070 con 0x7ffa0c0cd830 2024-05-08T04:24:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.198+0000 7ffa08ff9640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff9f806b680 0x7ff9f806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.198+0000 7ffa08ff9640 1 -- 172.21.15.104:0/3572280735 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ffa00089980 con 0x7ffa0c0cd830 2024-05-08T04:24:26.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.198+0000 7ffa0bfff640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff9f806b680 0x7ff9f806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.199+0000 7ffa0bfff640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff9f806b680 0x7ff9f806db40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc034000 tx=0x7ff9fc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:26.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.202+0000 7ffa08ff9640 1 -- 172.21.15.104:0/3572280735 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffa00057ea0 con 0x7ffa0c0cd830 2024-05-08T04:24:26.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.374+0000 7ffa129ab640 1 -- 172.21.15.104:0/3572280735 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa0c0b3b90 con 0x7ffa0c0cd830 2024-05-08T04:24:26.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.375+0000 7ffa08ff9640 1 -- 172.21.15.104:0/3572280735 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16961 (secure 0 0 0) 0x7ffa0005bf40 con 0x7ffa0c0cd830 2024-05-08T04:24:26.376 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:26.377 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":47,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:52.009332+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:42.524824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:43.279621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.39","mappings":[{"from":5,"to":7}]},{"pgid":"7.3c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:24:26.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.377+0000 7ffa129ab640 1 -- 172.21.15.104:0/3572280735 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff9f806b680 msgr2=0x7ff9f806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.377+0000 7ffa129ab640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff9f806b680 0x7ff9f806db40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc034000 tx=0x7ff9fc02e000 comp rx=0 tx=0).stop 2024-05-08T04:24:26.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.377+0000 7ffa129ab640 1 -- 172.21.15.104:0/3572280735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c0cd830 msgr2=0x7ffa0c155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.377+0000 7ffa129ab640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c0cd830 0x7ffa0c155410 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000c430 tx=0x7ffa0000c8f0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.377+0000 7ffa129ab640 1 -- 172.21.15.104:0/3572280735 shutdown_connections 2024-05-08T04:24:26.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.377+0000 7ffa129ab640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff9f806b680 0x7ff9f806db40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.377+0000 7ffa129ab640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffa0c158540 0x7ffa0c15d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.377+0000 7ffa129ab640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa0c0cd830 0x7ffa0c155410 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.377+0000 7ffa129ab640 1 --2- 172.21.15.104:0/3572280735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffa0c0701a0 0x7ffa0c0c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.377+0000 7ffa129ab640 1 -- 172.21.15.104:0/3572280735 >> 172.21.15.104:0/3572280735 conn(0x7ffa0c0b23e0 msgr2=0x7ffa0c0b5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:26.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.377+0000 7ffa129ab640 1 -- 172.21.15.104:0/3572280735 shutdown_connections 2024-05-08T04:24:26.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.377+0000 7ffa129ab640 1 -- 172.21.15.104:0/3572280735 wait complete. 2024-05-08T04:24:26.389 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T04:24:26.389 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:26.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.487+0000 7f203be5d640 1 Processor -- start 2024-05-08T04:24:26.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.487+0000 7f203be5d640 1 -- start start 2024-05-08T04:24:26.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f203be5d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2034070c70 0x7f2034071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f203be5d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f203415edf0 0x7f20340b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f203be5d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2034071590 con 0x7f2034157ac0 2024-05-08T04:24:26.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f203be5d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203406bc70 con 0x7f203415edf0 2024-05-08T04:24:26.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f203be5d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20340d15c0 con 0x7f2034070c70 2024-05-08T04:24:26.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f20393f8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f203415edf0 0x7f20340b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f203a3fa640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f2034157ac0 0x7f2034157f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:52782/0 (socket says 172.21.15.104:52782) 2024-05-08T04:24:26.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f203a3fa640 1 -- 172.21.15.104:0/2988875512 learned_addr learned my addr 172.21.15.104:0/2988875512 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:26.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f20393f8640 1 -- 172.21.15.104:0/2988875512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2034070c70 msgr2=0x7f2034071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:26.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f2039bf9640 1 --2- 172.21.15.104:0/2988875512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2034070c70 0x7f2034071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f20393f8640 1 --2- 172.21.15.104:0/2988875512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2034070c70 0x7f2034071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f20393f8640 1 -- 172.21.15.104:0/2988875512 >> v1:172.21.15.104:6789/0 conn(0x7f2034157ac0 legacy=0x7f2034157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f2038bf7640 1 -- 172.21.15.104:0/2988875512 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335333286 0 0) 0x7f2034071590 con 0x7f2034157ac0 2024-05-08T04:24:26.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.488+0000 7f20393f8640 1 -- 172.21.15.104:0/2988875512 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203415f550 con 0x7f203415edf0 2024-05-08T04:24:26.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.489+0000 7f20393f8640 1 --2- 172.21.15.104:0/2988875512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f203415edf0 0x7f20340b52a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f20240097a0 tx=0x7f202402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6488f405a4770975 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:26.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.489+0000 7f2038bf7640 1 -- 172.21.15.104:0/2988875512 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024037070 con 0x7f203415edf0 2024-05-08T04:24:26.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.489+0000 7f2038bf7640 1 -- 172.21.15.104:0/2988875512 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2024032440 con 0x7f203415edf0 2024-05-08T04:24:26.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.489+0000 7f2038bf7640 1 -- 172.21.15.104:0/2988875512 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024032810 con 0x7f203415edf0 2024-05-08T04:24:26.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.490+0000 7f203be5d640 1 -- 172.21.15.104:0/2988875512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f203415edf0 msgr2=0x7f20340b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.490+0000 7f203be5d640 1 --2- 172.21.15.104:0/2988875512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f203415edf0 0x7f20340b52a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f20240097a0 tx=0x7f202402a180 comp rx=0 tx=0).stop 2024-05-08T04:24:26.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.490+0000 7f203be5d640 1 -- 172.21.15.104:0/2988875512 shutdown_connections 2024-05-08T04:24:26.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.490+0000 7f203be5d640 1 --2- 172.21.15.104:0/2988875512 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f203415edf0 0x7f20340b52a0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.490+0000 7f203be5d640 1 --2- 172.21.15.104:0/2988875512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2034070c70 0x7f2034071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.490+0000 7f203be5d640 1 -- 172.21.15.104:0/2988875512 >> 172.21.15.104:0/2988875512 conn(0x7f20340b3450 msgr2=0x7f20340b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:26.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.490+0000 7f203be5d640 1 -- 172.21.15.104:0/2988875512 shutdown_connections 2024-05-08T04:24:26.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.490+0000 7f203be5d640 1 -- 172.21.15.104:0/2988875512 wait complete. 2024-05-08T04:24:26.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.491+0000 7f203be5d640 1 Processor -- start 2024-05-08T04:24:26.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.491+0000 7f203be5d640 1 -- start start 2024-05-08T04:24:26.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203be5d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2034070c70 0x7f2034161770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203be5d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2034157ac0 0x7f20341e8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203be5d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f203415edf0 0x7f20341e8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203be5d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20340b5b80 con 0x7f203415edf0 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203be5d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203415fb10 con 0x7f2034070c70 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203be5d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20340b57e0 con 0x7f2034157ac0 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203a3fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f203415edf0 0x7f20341e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203a3fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f203415edf0 0x7f20341e8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46012/0 (socket says 172.21.15.104:46012) 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203a3fa640 1 -- 172.21.15.104:0/603070306 learned_addr learned my addr 172.21.15.104:0/603070306 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f20393f8640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2034157ac0 0x7f20341e8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f2039bf9640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2034070c70 0x7f2034161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203a3fa640 1 -- 172.21.15.104:0/603070306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2034157ac0 msgr2=0x7f20341e8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203a3fa640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2034157ac0 0x7f20341e8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203a3fa640 1 -- 172.21.15.104:0/603070306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2034070c70 msgr2=0x7f2034161770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203a3fa640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2034070c70 0x7f2034161770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203a3fa640 1 -- 172.21.15.104:0/603070306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20341f8720 con 0x7f203415edf0 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f20393f8640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2034157ac0 0x7f20341e8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f2039bf9640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2034070c70 0x7f2034161770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203a3fa640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f203415edf0 0x7f20341e8fc0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f202c00c810 tx=0x7f202c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f202a7fc640 1 -- 172.21.15.104:0/603070306 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c018070 con 0x7f203415edf0 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f202a7fc640 1 -- 172.21.15.104:0/603070306 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202c00a640 con 0x7f203415edf0 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f203be5d640 1 -- 172.21.15.104:0/603070306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20340cc8b0 con 0x7f203415edf0 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.492+0000 7f202a7fc640 1 -- 172.21.15.104:0/603070306 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c00aa30 con 0x7f203415edf0 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.493+0000 7f203be5d640 1 -- 172.21.15.104:0/603070306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2034161cb0 con 0x7f203415edf0 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.493+0000 7f203be5d640 1 -- 172.21.15.104:0/603070306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20340b7a40 con 0x7f203415edf0 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.494+0000 7f202a7fc640 1 -- 172.21.15.104:0/603070306 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f202c01b070 con 0x7f203415edf0 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.494+0000 7f202a7fc640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f201806b680 0x7f201806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.494+0000 7f2039bf9640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f201806b680 0x7f201806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.494+0000 7f202a7fc640 1 -- 172.21.15.104:0/603070306 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f202c089b00 con 0x7f203415edf0 2024-05-08T04:24:26.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.495+0000 7f2039bf9640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f201806b680 0x7f201806db40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2030008890 tx=0x7f2030008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:26.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.499+0000 7f202a7fc640 1 -- 172.21.15.104:0/603070306 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20340b7a40 con 0x7f203415edf0 2024-05-08T04:24:26.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.705+0000 7f203be5d640 1 -- 172.21.15.104:0/603070306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2034075010 con 0x7f203415edf0 2024-05-08T04:24:26.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.705+0000 7f202a7fc640 1 -- 172.21.15.104:0/603070306 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f202c058700 con 0x7f203415edf0 2024-05-08T04:24:26.707 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:26.707 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:24:26.707 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:24:26.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.707+0000 7f203be5d640 1 -- 172.21.15.104:0/603070306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f201806b680 msgr2=0x7f201806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.707+0000 7f203be5d640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f201806b680 0x7f201806db40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2030008890 tx=0x7f2030008040 comp rx=0 tx=0).stop 2024-05-08T04:24:26.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.707+0000 7f203be5d640 1 -- 172.21.15.104:0/603070306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f203415edf0 msgr2=0x7f20341e8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.707+0000 7f203be5d640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f203415edf0 0x7f20341e8fc0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f202c00c810 tx=0x7f202c00ccd0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.707+0000 7f203be5d640 1 -- 172.21.15.104:0/603070306 shutdown_connections 2024-05-08T04:24:26.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.707+0000 7f203be5d640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f201806b680 0x7f201806db40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.707+0000 7f203be5d640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f203415edf0 0x7f20341e8fc0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.707+0000 7f203be5d640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2034157ac0 0x7f20341e8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.707+0000 7f203be5d640 1 --2- 172.21.15.104:0/603070306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2034070c70 0x7f2034161770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.707+0000 7f203be5d640 1 -- 172.21.15.104:0/603070306 >> 172.21.15.104:0/603070306 conn(0x7f20340b3450 msgr2=0x7f203415e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:26.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.707+0000 7f203be5d640 1 -- 172.21.15.104:0/603070306 shutdown_connections 2024-05-08T04:24:26.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.707+0000 7f203be5d640 1 -- 172.21.15.104:0/603070306 wait complete. 2024-05-08T04:24:26.720 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:26.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.818+0000 7f0550c91640 1 Processor -- start 2024-05-08T04:24:26.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.818+0000 7f0550c91640 1 -- start start 2024-05-08T04:24:26.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.819+0000 7f0550c91640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f054c0cc930 0x7f054c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.819+0000 7f0550c91640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f054c0711c0 0x7f054c15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.819+0000 7f0550c91640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054c071fb0 con 0x7f054c144c80 2024-05-08T04:24:26.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.819+0000 7f0550c91640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054c0cd250 con 0x7f054c0cc930 2024-05-08T04:24:26.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.819+0000 7f0550c91640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054c071710 con 0x7f054c0711c0 2024-05-08T04:24:26.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054ad9d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f054c144c80 0x7f054c15fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:52788/0 (socket says 172.21.15.104:52788) 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054ad9d640 1 -- 172.21.15.104:0/2398102948 learned_addr learned my addr 172.21.15.104:0/2398102948 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903604883 0 0) 0x7f054c071fb0 con 0x7f054c144c80 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0538003520 con 0x7f054c144c80 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f0549d9b640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f054c0711c0 0x7f054c15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054a59c640 1 --2- 172.21.15.104:0/2398102948 >> v2:172.21.15.183:3300/0 conn(0x7f054c0cc930 0x7f054c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 406675201 0 0) 0x7f0538003520 con 0x7f054c144c80 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f054c0711c0 msgr2=0x7f054c15f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f054c0711c0 0x7f054c15f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 >> v2:172.21.15.183:3300/0 conn(0x7f054c0cc930 msgr2=0x7f054c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 --2- 172.21.15.104:0/2398102948 >> v2:172.21.15.183:3300/0 conn(0x7f054c0cc930 0x7f054c0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c0719f0 con 0x7f054c144c80 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f05440019f0 con 0x7f054c144c80 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 >> v1:172.21.15.104:6789/0 conn(0x7f054c144c80 legacy=0x7f054c15fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05380039b0 0x7f0538003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f054c0711c0 0x7f0538004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0538004d40 0x7f05380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c0cd250 con 0x7f05380039b0 2024-05-08T04:24:26.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c071710 con 0x7f0538004d40 2024-05-08T04:24:26.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053800bb20 con 0x7f054c0711c0 2024-05-08T04:24:26.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054a59c640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05380039b0 0x7f0538003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054ad9d640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0538004d40 0x7f05380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f0549d9b640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f054c0711c0 0x7f0538004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054a59c640 1 -- 172.21.15.104:0/2398102948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f054c0711c0 msgr2=0x7f0538004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:26.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054a59c640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f054c0711c0 0x7f0538004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054a59c640 1 -- 172.21.15.104:0/2398102948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0538004d40 msgr2=0x7f05380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:26.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054a59c640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0538004d40 0x7f05380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054a59c640 1 -- 172.21.15.104:0/2398102948 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538003520 con 0x7f05380039b0 2024-05-08T04:24:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f054ad9d640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0538004d40 0x7f05380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.820+0000 7f0549d9b640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f054c0711c0 0x7f0538004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.821+0000 7f054a59c640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05380039b0 0x7f0538003dd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f053400ba30 tx=0x7f0538005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6df5171c344e85 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.821+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534030070 con 0x7f05380039b0 2024-05-08T04:24:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.821+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053402ae10 con 0x7f05380039b0 2024-05-08T04:24:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.821+0000 7f054959a640 1 -- 172.21.15.104:0/2398102948 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053400b600 con 0x7f05380039b0 2024-05-08T04:24:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.822+0000 7f0550c91640 1 -- 172.21.15.104:0/2398102948 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05380039b0 msgr2=0x7f0538003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.822+0000 7f0550c91640 1 --2- 172.21.15.104:0/2398102948 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05380039b0 0x7f0538003dd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f053400ba30 tx=0x7f0538005830 comp rx=0 tx=0).stop 2024-05-08T04:24:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.822+0000 7f054ad9d640 1 -- 172.21.15.104:0/2398102948 reap_dead start 2024-05-08T04:24:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.822+0000 7f0550c91640 1 -- 172.21.15.104:0/2398102948 shutdown_connections 2024-05-08T04:24:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.822+0000 7f0550c91640 1 -- 172.21.15.104:0/2398102948 >> 172.21.15.104:0/2398102948 conn(0x7f054c0b13f0 msgr2=0x7f054c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.822+0000 7f0550c91640 1 -- 172.21.15.104:0/2398102948 shutdown_connections 2024-05-08T04:24:26.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.822+0000 7f0550c91640 1 -- 172.21.15.104:0/2398102948 wait complete. 2024-05-08T04:24:26.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.823+0000 7f0550c91640 1 Processor -- start 2024-05-08T04:24:26.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.823+0000 7f0550c91640 1 -- start start 2024-05-08T04:24:26.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0550c91640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05380039b0 0x7f054c15e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0550c91640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f054c0aaf10 0x7f054c1f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0550c91640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f054c0ab390 0x7f054c1f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0550c91640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c0cf3b0 con 0x7f054c0aaf10 2024-05-08T04:24:26.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0550c91640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c06d330 con 0x7f054c0ab390 2024-05-08T04:24:26.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0550c91640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054c1453f0 con 0x7f05380039b0 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0549d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f054c0aaf10 0x7f054c1f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0549d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f054c0aaf10 0x7f054c1f4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46036/0 (socket says 172.21.15.104:46036) 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0549d9b640 1 -- 172.21.15.104:0/3035646478 learned_addr learned my addr 172.21.15.104:0/3035646478 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f054a59c640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05380039b0 0x7f054c15e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f054ad9d640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f054c0ab390 0x7f054c1f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0549d9b640 1 -- 172.21.15.104:0/3035646478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05380039b0 msgr2=0x7f054c15e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0549d9b640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05380039b0 0x7f054c15e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0549d9b640 1 -- 172.21.15.104:0/3035646478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f054c0ab390 msgr2=0x7f054c1f52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0549d9b640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f054c0ab390 0x7f054c1f52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f0549d9b640 1 -- 172.21.15.104:0/3035646478 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c0a9e70 con 0x7f054c0aaf10 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.824+0000 7f054ad9d640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f054c0ab390 0x7f054c1f52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.825+0000 7f0549d9b640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f054c0aaf10 0x7f054c1f4d60 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f053c00e7e0 tx=0x7f053c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.825+0000 7f0542ffd640 1 -- 172.21.15.104:0/3035646478 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c017070 con 0x7f054c0aaf10 2024-05-08T04:24:26.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.825+0000 7f0542ffd640 1 -- 172.21.15.104:0/3035646478 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c00c6d0 con 0x7f054c0aaf10 2024-05-08T04:24:26.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.825+0000 7f0550c91640 1 -- 172.21.15.104:0/3035646478 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054c0aa150 con 0x7f054c0aaf10 2024-05-08T04:24:26.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.825+0000 7f0542ffd640 1 -- 172.21.15.104:0/3035646478 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c00f040 con 0x7f054c0aaf10 2024-05-08T04:24:26.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.825+0000 7f0550c91640 1 -- 172.21.15.104:0/3035646478 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054c0aa710 con 0x7f054c0aaf10 2024-05-08T04:24:26.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.826+0000 7f0550c91640 1 -- 172.21.15.104:0/3035646478 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054c0b0770 con 0x7f054c0aaf10 2024-05-08T04:24:26.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.826+0000 7f0542ffd640 1 -- 172.21.15.104:0/3035646478 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f053c01a070 con 0x7f054c0aaf10 2024-05-08T04:24:26.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.827+0000 7f0542ffd640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f052c06b680 0x7f052c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:26.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.827+0000 7f0542ffd640 1 -- 172.21.15.104:0/3035646478 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f053c08a250 con 0x7f054c0aaf10 2024-05-08T04:24:26.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.827+0000 7f054a59c640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f052c06b680 0x7f052c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:26.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.827+0000 7f054a59c640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f052c06b680 0x7f052c06db40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f053400ba00 tx=0x7f0534030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:26.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:26.831+0000 7f0542ffd640 1 -- 172.21.15.104:0/3035646478 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f054c0b0770 con 0x7f054c0aaf10 2024-05-08T04:24:27.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.035+0000 7f0550c91640 1 -- 172.21.15.104:0/3035646478 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f054c075010 con 0x7f054c0aaf10 2024-05-08T04:24:27.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.036+0000 7f0542ffd640 1 -- 172.21.15.104:0/3035646478 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f053c058cb0 con 0x7f054c0aaf10 2024-05-08T04:24:27.037 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:27.037 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:22:44.308604+0000","modified":"2024-05-08T04:22:46.323648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5742":{"gid":5742,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6837/3100292449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":3100292449},{"type":"v1","addr":"172.21.15.104:6837","nonce":3100292449}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-08T04:24:27.037 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-05-08T04:24:27.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.038+0000 7f0550c91640 1 -- 172.21.15.104:0/3035646478 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f052c06b680 msgr2=0x7f052c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.038+0000 7f0550c91640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f052c06b680 0x7f052c06db40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f053400ba00 tx=0x7f0534030000 comp rx=0 tx=0).stop 2024-05-08T04:24:27.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.038+0000 7f0550c91640 1 -- 172.21.15.104:0/3035646478 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f054c0aaf10 msgr2=0x7f054c1f4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.038+0000 7f0550c91640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f054c0aaf10 0x7f054c1f4d60 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f053c00e7e0 tx=0x7f053c00eca0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.038+0000 7f0550c91640 1 -- 172.21.15.104:0/3035646478 shutdown_connections 2024-05-08T04:24:27.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.038+0000 7f0550c91640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f052c06b680 0x7f052c06db40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.038+0000 7f0550c91640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f054c0ab390 0x7f054c1f52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.038+0000 7f0550c91640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f054c0aaf10 0x7f054c1f4d60 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.038+0000 7f0550c91640 1 --2- 172.21.15.104:0/3035646478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05380039b0 0x7f054c15e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.038+0000 7f0550c91640 1 -- 172.21.15.104:0/3035646478 >> 172.21.15.104:0/3035646478 conn(0x7f054c0b13f0 msgr2=0x7f054c144380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:27.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.038+0000 7f0550c91640 1 -- 172.21.15.104:0/3035646478 shutdown_connections 2024-05-08T04:24:27.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.038+0000 7f0550c91640 1 -- 172.21.15.104:0/3035646478 wait complete. 2024-05-08T04:24:27.051 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:24:27.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.149+0000 7fad4b1ab640 1 Processor -- start 2024-05-08T04:24:27.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.149+0000 7fad4b1ab640 1 -- start start 2024-05-08T04:24:27.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.150+0000 7fad4b1ab640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fad440711c0 0x7fad440b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.150+0000 7fad4b1ab640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad44162f30 con 0x7fad440715a0 2024-05-08T04:24:27.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.150+0000 7fad4b1ab640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad44163210 con 0x7fad4406d990 2024-05-08T04:24:27.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.150+0000 7fad4b1ab640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad440af1c0 con 0x7fad440711c0 2024-05-08T04:24:27.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.150+0000 7fad48f47640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fad440711c0 0x7fad440b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.150+0000 7fad43fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fad440715a0 0x7fad441625d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:52804/0 (socket says 172.21.15.104:52804) 2024-05-08T04:24:27.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.150+0000 7fad43fff640 1 -- 172.21.15.104:0/468240830 learned_addr learned my addr 172.21.15.104:0/468240830 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:27.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.151+0000 7fad437fe640 1 -- 172.21.15.104:0/468240830 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907056767 0 0) 0x7fad44162f30 con 0x7fad440715a0 2024-05-08T04:24:27.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.151+0000 7fad437fe640 1 -- 172.21.15.104:0/468240830 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad30003520 con 0x7fad440715a0 2024-05-08T04:24:27.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.151+0000 7fad48f47640 1 -- 172.21.15.104:0/468240830 >> v1:172.21.15.183:6789/0 conn(0x7fad4406d990 legacy=0x7fad4406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.151+0000 7fad48f47640 1 -- 172.21.15.104:0/468240830 >> v1:172.21.15.104:6789/0 conn(0x7fad440715a0 legacy=0x7fad441625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.151+0000 7fad48f47640 1 -- 172.21.15.104:0/468240830 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad441634f0 con 0x7fad440711c0 2024-05-08T04:24:27.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.151+0000 7fad48f47640 1 --2- 172.21.15.104:0/468240830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad440711c0 0x7fad440b29f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0097d0 tx=0x7fad3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf3855631a1336c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:27.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.151+0000 7fad437fe640 1 -- 172.21.15.104:0/468240830 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c037070 con 0x7fad440711c0 2024-05-08T04:24:27.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.152+0000 7fad437fe640 1 -- 172.21.15.104:0/468240830 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c032440 con 0x7fad440711c0 2024-05-08T04:24:27.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.152+0000 7fad437fe640 1 -- 172.21.15.104:0/468240830 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c032810 con 0x7fad440711c0 2024-05-08T04:24:27.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.152+0000 7fad4b1ab640 1 -- 172.21.15.104:0/468240830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad440711c0 msgr2=0x7fad440b29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.152+0000 7fad4b1ab640 1 --2- 172.21.15.104:0/468240830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad440711c0 0x7fad440b29f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0097d0 tx=0x7fad3c02a270 comp rx=0 tx=0).stop 2024-05-08T04:24:27.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.152+0000 7fad4b1ab640 1 -- 172.21.15.104:0/468240830 shutdown_connections 2024-05-08T04:24:27.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.152+0000 7fad4b1ab640 1 --2- 172.21.15.104:0/468240830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad440711c0 0x7fad440b29f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.152+0000 7fad4b1ab640 1 -- 172.21.15.104:0/468240830 >> 172.21.15.104:0/468240830 conn(0x7fad440b13f0 msgr2=0x7fad440b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:27.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.152+0000 7fad4b1ab640 1 -- 172.21.15.104:0/468240830 shutdown_connections 2024-05-08T04:24:27.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.152+0000 7fad4b1ab640 1 -- 172.21.15.104:0/468240830 wait complete. 2024-05-08T04:24:27.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.153+0000 7fad4b1ab640 1 Processor -- start 2024-05-08T04:24:27.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.153+0000 7fad4b1ab640 1 -- start start 2024-05-08T04:24:27.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.154+0000 7fad4b1ab640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad4406d990 0x7fad441f8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.154+0000 7fad4b1ab640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad440711c0 0x7fad441fb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.154+0000 7fad4b1ab640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad440715a0 0x7fad440cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.154+0000 7fad4b1ab640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad44162ce0 con 0x7fad4406d990 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.154+0000 7fad4b1ab640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4406d220 con 0x7fad440715a0 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.154+0000 7fad4b1ab640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad44071a10 con 0x7fad440711c0 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.154+0000 7fad48f47640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad4406d990 0x7fad441f8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.154+0000 7fad48f47640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad4406d990 0x7fad441f8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46058/0 (socket says 172.21.15.104:46058) 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.154+0000 7fad48f47640 1 -- 172.21.15.104:0/1371265531 learned_addr learned my addr 172.21.15.104:0/1371265531 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.154+0000 7fad49748640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad440715a0 0x7fad440cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad48f47640 1 -- 172.21.15.104:0/1371265531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad440711c0 msgr2=0x7fad441fb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad43fff640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad440711c0 0x7fad441fb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad48f47640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad440711c0 0x7fad441fb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad48f47640 1 -- 172.21.15.104:0/1371265531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad440715a0 msgr2=0x7fad440cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad48f47640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad440715a0 0x7fad440cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad48f47640 1 -- 172.21.15.104:0/1371265531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad441f7ed0 con 0x7fad4406d990 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad49748640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad440715a0 0x7fad440cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad43fff640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad440711c0 0x7fad441fb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:27.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad48f47640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad4406d990 0x7fad441f8990 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fad3c035040 tx=0x7fad3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:27.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad417fa640 1 -- 172.21.15.104:0/1371265531 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c037040 con 0x7fad4406d990 2024-05-08T04:24:27.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad417fa640 1 -- 172.21.15.104:0/1371265531 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c030500 con 0x7fad4406d990 2024-05-08T04:24:27.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad4b1ab640 1 -- 172.21.15.104:0/1371265531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad441fbf40 con 0x7fad4406d990 2024-05-08T04:24:27.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad417fa640 1 -- 172.21.15.104:0/1371265531 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c030910 con 0x7fad4406d990 2024-05-08T04:24:27.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.155+0000 7fad4b1ab640 1 -- 172.21.15.104:0/1371265531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad441f8190 con 0x7fad4406d990 2024-05-08T04:24:27.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.156+0000 7fad4b1ab640 1 -- 172.21.15.104:0/1371265531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad44075010 con 0x7fad4406d990 2024-05-08T04:24:27.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.156+0000 7fad417fa640 1 -- 172.21.15.104:0/1371265531 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fad3c044020 con 0x7fad4406d990 2024-05-08T04:24:27.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.157+0000 7fad417fa640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fad2406b680 0x7fad2406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.157+0000 7fad417fa640 1 -- 172.21.15.104:0/1371265531 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fad3c0aa810 con 0x7fad4406d990 2024-05-08T04:24:27.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.157+0000 7fad43fff640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fad2406b680 0x7fad2406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.157+0000 7fad43fff640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fad2406b680 0x7fad2406db40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad4415d710 tx=0x7fad34009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:27.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.161+0000 7fad417fa640 1 -- 172.21.15.104:0/1371265531 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fad3c079410 con 0x7fad4406d990 2024-05-08T04:24:27.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.332+0000 7fad4b1ab640 1 -- 172.21.15.104:0/1371265531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad440b2010 con 0x7fad4406d990 2024-05-08T04:24:27.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.333+0000 7fad417fa640 1 -- 172.21.15.104:0/1371265531 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16961 (secure 0 0 0) 0x7fad3c078d10 con 0x7fad4406d990 2024-05-08T04:24:27.335 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:27.335 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":47,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:22:52.009332+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:22:42.524824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-08T04:22:43.279621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.20","mappings":[{"from":5,"to":0}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.39","mappings":[{"from":5,"to":7}]},{"pgid":"7.3c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:24:27.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.335+0000 7fad4b1ab640 1 -- 172.21.15.104:0/1371265531 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fad2406b680 msgr2=0x7fad2406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.335+0000 7fad4b1ab640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fad2406b680 0x7fad2406db40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fad4415d710 tx=0x7fad34009040 comp rx=0 tx=0).stop 2024-05-08T04:24:27.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.335+0000 7fad4b1ab640 1 -- 172.21.15.104:0/1371265531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad4406d990 msgr2=0x7fad441f8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.335+0000 7fad4b1ab640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad4406d990 0x7fad441f8990 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fad3c035040 tx=0x7fad3c0046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.336+0000 7fad4b1ab640 1 -- 172.21.15.104:0/1371265531 shutdown_connections 2024-05-08T04:24:27.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.336+0000 7fad4b1ab640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fad2406b680 0x7fad2406db40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.336+0000 7fad4b1ab640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad440715a0 0x7fad440cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.336+0000 7fad4b1ab640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad440711c0 0x7fad441fb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.336+0000 7fad4b1ab640 1 --2- 172.21.15.104:0/1371265531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad4406d990 0x7fad441f8990 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.336+0000 7fad4b1ab640 1 -- 172.21.15.104:0/1371265531 >> 172.21.15.104:0/1371265531 conn(0x7fad440b13f0 msgr2=0x7fad4415a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:27.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.336+0000 7fad4b1ab640 1 -- 172.21.15.104:0/1371265531 shutdown_connections 2024-05-08T04:24:27.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.336+0000 7fad4b1ab640 1 -- 172.21.15.104:0/1371265531 wait complete. 2024-05-08T04:24:27.348 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T04:24:27.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.447+0000 7f0bb5b53640 1 Processor -- start 2024-05-08T04:24:27.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.447+0000 7f0bb5b53640 1 -- start start 2024-05-08T04:24:27.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.448+0000 7f0bb5b53640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0bb0070c70 0x7f0bb0071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.448+0000 7f0bb5b53640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bb0157ac0 0x7f0bb0157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.448+0000 7f0bb5b53640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb0071590 con 0x7f0bb015edf0 2024-05-08T04:24:27.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.448+0000 7f0bb5b53640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb006bc70 con 0x7f0bb0070c70 2024-05-08T04:24:27.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.448+0000 7f0bb5b53640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00d15c0 con 0x7f0bb0157ac0 2024-05-08T04:24:27.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.448+0000 7f0baf7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f0bb0070c70 0x7f0bb0071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.448+0000 7f0baeffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f0bb015edf0 0x7f0bb00b52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:52806/0 (socket says 172.21.15.104:52806) 2024-05-08T04:24:27.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.448+0000 7f0baeffd640 1 -- 172.21.15.104:0/502554362 learned_addr learned my addr 172.21.15.104:0/502554362 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:27.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.448+0000 7f0baf7fe640 1 -- 172.21.15.104:0/502554362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bb0157ac0 msgr2=0x7f0bb0157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:27.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.448+0000 7f0baf7fe640 1 --2- 172.21.15.104:0/502554362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bb0157ac0 0x7f0bb0157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.448+0000 7f0baf7fe640 1 -- 172.21.15.104:0/502554362 >> v1:172.21.15.104:6789/0 conn(0x7f0bb015edf0 legacy=0x7f0bb00b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.448+0000 7f0baf7fe640 1 -- 172.21.15.104:0/502554362 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb015f550 con 0x7f0bb0070c70 2024-05-08T04:24:27.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.449+0000 7f0baf7fe640 1 --2- 172.21.15.104:0/502554362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb0070c70 0x7f0bb0071050 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009d90 tx=0x7f0ba002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7c5f9e96e36567 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:27.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.449+0000 7f0bae7fc640 1 -- 172.21.15.104:0/502554362 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0007740 con 0x7f0bb0070c70 2024-05-08T04:24:27.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.449+0000 7f0bae7fc640 1 -- 172.21.15.104:0/502554362 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba00078e0 con 0x7f0bb0070c70 2024-05-08T04:24:27.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.449+0000 7f0bae7fc640 1 -- 172.21.15.104:0/502554362 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0007cb0 con 0x7f0bb0070c70 2024-05-08T04:24:27.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.450+0000 7f0bb5b53640 1 -- 172.21.15.104:0/502554362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb0070c70 msgr2=0x7f0bb0071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.450+0000 7f0bb5b53640 1 --2- 172.21.15.104:0/502554362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb0070c70 0x7f0bb0071050 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009d90 tx=0x7f0ba002a660 comp rx=0 tx=0).stop 2024-05-08T04:24:27.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.450+0000 7f0bb5b53640 1 -- 172.21.15.104:0/502554362 shutdown_connections 2024-05-08T04:24:27.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.450+0000 7f0bb5b53640 1 --2- 172.21.15.104:0/502554362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bb0157ac0 0x7f0bb0157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.450+0000 7f0bb5b53640 1 --2- 172.21.15.104:0/502554362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb0070c70 0x7f0bb0071050 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.450+0000 7f0bb5b53640 1 -- 172.21.15.104:0/502554362 >> 172.21.15.104:0/502554362 conn(0x7f0bb00b3450 msgr2=0x7f0bb00b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:27.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.450+0000 7f0bb5b53640 1 -- 172.21.15.104:0/502554362 shutdown_connections 2024-05-08T04:24:27.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.450+0000 7f0bb5b53640 1 -- 172.21.15.104:0/502554362 wait complete. 2024-05-08T04:24:27.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.451+0000 7f0bb5b53640 1 Processor -- start 2024-05-08T04:24:27.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.451+0000 7f0bb5b53640 1 -- start start 2024-05-08T04:24:27.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0bb5b53640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bb0070c70 0x7f0bb00cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0bb5b53640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bb0157ac0 0x7f0bb0161f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0bb5b53640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb015edf0 0x7f0bb0154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0bb5b53640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00b5b80 con 0x7f0bb015edf0 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0bb5b53640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb015fb10 con 0x7f0bb0070c70 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0bb5b53640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb0158490 con 0x7f0bb0157ac0 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0baffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb015edf0 0x7f0bb0154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0baffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb015edf0 0x7f0bb0154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46070/0 (socket says 172.21.15.104:46070) 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0baffff640 1 -- 172.21.15.104:0/1710814708 learned_addr learned my addr 172.21.15.104:0/1710814708 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0baffff640 1 -- 172.21.15.104:0/1710814708 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bb0157ac0 msgr2=0x7f0bb0161f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0baffff640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bb0157ac0 0x7f0bb0161f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0baffff640 1 -- 172.21.15.104:0/1710814708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bb0070c70 msgr2=0x7f0bb00cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0baf7fe640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bb0070c70 0x7f0bb00cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0baffff640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bb0070c70 0x7f0bb00cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0baffff640 1 -- 172.21.15.104:0/1710814708 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00cec20 con 0x7f0bb015edf0 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.452+0000 7f0baf7fe640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bb0070c70 0x7f0bb00cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:27.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.453+0000 7f0baffff640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb015edf0 0x7f0bb0154a80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009fd0 tx=0x7f0ba800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:27.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.453+0000 7f0b97fff640 1 -- 172.21.15.104:0/1710814708 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8011830 con 0x7f0bb015edf0 2024-05-08T04:24:27.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.453+0000 7f0b97fff640 1 -- 172.21.15.104:0/1710814708 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba8016070 con 0x7f0bb015edf0 2024-05-08T04:24:27.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.453+0000 7f0bb5b53640 1 -- 172.21.15.104:0/1710814708 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb00cef00 con 0x7f0bb015edf0 2024-05-08T04:24:27.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.453+0000 7f0b97fff640 1 -- 172.21.15.104:0/1710814708 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8011c10 con 0x7f0bb015edf0 2024-05-08T04:24:27.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.453+0000 7f0bb5b53640 1 -- 172.21.15.104:0/1710814708 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb00cf4c0 con 0x7f0bb015edf0 2024-05-08T04:24:27.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.454+0000 7f0bb5b53640 1 -- 172.21.15.104:0/1710814708 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb0075010 con 0x7f0bb015edf0 2024-05-08T04:24:27.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.454+0000 7f0b97fff640 1 -- 172.21.15.104:0/1710814708 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f0ba801b460 con 0x7f0bb015edf0 2024-05-08T04:24:27.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.455+0000 7f0b97fff640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0b9c06b6b0 0x7f0b9c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.455+0000 7f0b97fff640 1 -- 172.21.15.104:0/1710814708 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0ba808a330 con 0x7f0bb015edf0 2024-05-08T04:24:27.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.455+0000 7f0baf7fe640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0b9c06b6b0 0x7f0b9c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.455+0000 7f0baf7fe640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0b9c06b6b0 0x7f0b9c06db70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0034000 tx=0x7f0ba002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:27.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.459+0000 7f0b97fff640 1 -- 172.21.15.104:0/1710814708 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ba8058ea0 con 0x7f0bb015edf0 2024-05-08T04:24:27.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.662+0000 7f0bb5b53640 1 -- 172.21.15.104:0/1710814708 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0bb00b10a0 con 0x7f0bb015edf0 2024-05-08T04:24:27.664 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-05-08T04:24:27.663+0000 7f0fa0f98640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T04:24:27.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.666+0000 7f0b97fff640 1 -- 172.21.15.104:0/1710814708 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0ba80587a0 con 0x7f0bb015edf0 2024-05-08T04:24:27.667 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T04:24:27.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.668+0000 7f0bb5b53640 1 -- 172.21.15.104:0/1710814708 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0b9c06b6b0 msgr2=0x7f0b9c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.668+0000 7f0bb5b53640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0b9c06b6b0 0x7f0b9c06db70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0034000 tx=0x7f0ba002f000 comp rx=0 tx=0).stop 2024-05-08T04:24:27.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.668+0000 7f0bb5b53640 1 -- 172.21.15.104:0/1710814708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb015edf0 msgr2=0x7f0bb0154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.668+0000 7f0bb5b53640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb015edf0 0x7f0bb0154a80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009fd0 tx=0x7f0ba800b8e0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.668+0000 7f0bb5b53640 1 -- 172.21.15.104:0/1710814708 shutdown_connections 2024-05-08T04:24:27.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.668+0000 7f0bb5b53640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f0b9c06b6b0 0x7f0b9c06db70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.668+0000 7f0bb5b53640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb015edf0 0x7f0bb0154a80 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.668+0000 7f0bb5b53640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bb0157ac0 0x7f0bb0161f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.668+0000 7f0bb5b53640 1 --2- 172.21.15.104:0/1710814708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bb0070c70 0x7f0bb00cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.668+0000 7f0bb5b53640 1 -- 172.21.15.104:0/1710814708 >> 172.21.15.104:0/1710814708 conn(0x7f0bb00b3450 msgr2=0x7f0bb01505e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.668+0000 7f0bb5b53640 1 -- 172.21.15.104:0/1710814708 shutdown_connections 2024-05-08T04:24:27.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.669+0000 7f0bb5b53640 1 -- 172.21.15.104:0/1710814708 wait complete. 2024-05-08T04:24:27.673 INFO:tasks.ceph.mds.c.smithi104.stderr: -9460> 2024-05-08T04:22:50.218+0000 7f82890d7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T04:24:27.682 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T04:24:27.707 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-05-08T04:24:27.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.783+0000 7f778e5e7640 1 Processor -- start 2024-05-08T04:24:27.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.783+0000 7f778e5e7640 1 -- start start 2024-05-08T04:24:27.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.784+0000 7f778e5e7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f778815aa70 0x7f778806bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.784+0000 7f778e5e7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f778806c0b0 0x7f77880b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.784+0000 7f778e5e7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77880b4e90 0x7f778815e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.784+0000 7f778e5e7640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778806c510 con 0x7f778806c0b0 2024-05-08T04:24:27.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.784+0000 7f778e5e7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77880b3bc0 con 0x7f778815aa70 2024-05-08T04:24:27.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.784+0000 7f778e5e7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778815ae50 con 0x7f77880b4e90 2024-05-08T04:24:27.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.784+0000 7f777ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f778806c0b0 0x7f77880b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.784+0000 7f777ffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f778806c0b0 0x7f77880b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57822/0 (socket says 172.21.15.104:57822) 2024-05-08T04:24:27.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.784+0000 7f777ffff640 1 -- 172.21.15.104:0/2547527775 learned_addr learned my addr 172.21.15.104:0/2547527775 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:27.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.784+0000 7f7787fff640 1 --2- 172.21.15.104:0/2547527775 >> v2:172.21.15.183:3300/0 conn(0x7f778815aa70 0x7f778806bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.785+0000 7f778cb84640 1 --2- 172.21.15.104:0/2547527775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77880b4e90 0x7f778815e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.785+0000 7f777ffff640 1 -- 172.21.15.104:0/2547527775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77880b4e90 msgr2=0x7f778815e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:27.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.785+0000 7f777ffff640 1 --2- 172.21.15.104:0/2547527775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77880b4e90 0x7f778815e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.785+0000 7f777ffff640 1 -- 172.21.15.104:0/2547527775 >> v2:172.21.15.183:3300/0 conn(0x7f778815aa70 msgr2=0x7f778806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:27.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.785+0000 7f777ffff640 1 --2- 172.21.15.104:0/2547527775 >> v2:172.21.15.183:3300/0 conn(0x7f778815aa70 0x7f778806bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.785+0000 7f777ffff640 1 -- 172.21.15.104:0/2547527775 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77880b2fb0 con 0x7f778806c0b0 2024-05-08T04:24:27.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.785+0000 7f7787fff640 1 --2- 172.21.15.104:0/2547527775 >> v2:172.21.15.183:3300/0 conn(0x7f778815aa70 0x7f778806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:27.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.785+0000 7f778cb84640 1 --2- 172.21.15.104:0/2547527775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77880b4e90 0x7f778815e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:27.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.785+0000 7f777ffff640 1 --2- 172.21.15.104:0/2547527775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f778806c0b0 0x7f77880b4950 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f77880b5570 tx=0x7f777002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe066006b0ff2dba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:27.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.786+0000 7f77877fe640 1 -- 172.21.15.104:0/2547527775 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7770037070 con 0x7f778806c0b0 2024-05-08T04:24:27.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.786+0000 7f77877fe640 1 -- 172.21.15.104:0/2547527775 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7770032440 con 0x7f778806c0b0 2024-05-08T04:24:27.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.786+0000 7f77877fe640 1 -- 172.21.15.104:0/2547527775 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7770032810 con 0x7f778806c0b0 2024-05-08T04:24:27.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.786+0000 7f778e5e7640 1 -- 172.21.15.104:0/2547527775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f778806c0b0 msgr2=0x7f77880b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.786+0000 7f778e5e7640 1 --2- 172.21.15.104:0/2547527775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f778806c0b0 0x7f77880b4950 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f77880b5570 tx=0x7f777002a140 comp rx=0 tx=0).stop 2024-05-08T04:24:27.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.786+0000 7f778e5e7640 1 -- 172.21.15.104:0/2547527775 shutdown_connections 2024-05-08T04:24:27.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.786+0000 7f778e5e7640 1 --2- 172.21.15.104:0/2547527775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77880b4e90 0x7f778815e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.786+0000 7f778e5e7640 1 --2- 172.21.15.104:0/2547527775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f778806c0b0 0x7f77880b4950 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.786+0000 7f778e5e7640 1 --2- 172.21.15.104:0/2547527775 >> v2:172.21.15.183:3300/0 conn(0x7f778815aa70 0x7f778806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.786+0000 7f778e5e7640 1 -- 172.21.15.104:0/2547527775 >> 172.21.15.104:0/2547527775 conn(0x7f7788071a10 msgr2=0x7f7788071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:27.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.786+0000 7f778e5e7640 1 -- 172.21.15.104:0/2547527775 shutdown_connections 2024-05-08T04:24:27.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.786+0000 7f778e5e7640 1 -- 172.21.15.104:0/2547527775 wait complete. 2024-05-08T04:24:27.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.787+0000 7f778e5e7640 1 Processor -- start 2024-05-08T04:24:27.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.787+0000 7f778e5e7640 1 -- start start 2024-05-08T04:24:27.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.788+0000 7f778e5e7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f778806c0b0 0x7f778814f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.788+0000 7f778e5e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77880b4e90 0x7f77881514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.788+0000 7f778e5e7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f778815aa70 0x7f77881519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.788+0000 7f778e5e7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77880b3850 con 0x7f77880b4e90 2024-05-08T04:24:27.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.788+0000 7f778e5e7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77880b3570 con 0x7f778806c0b0 2024-05-08T04:24:27.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.788+0000 7f778e5e7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77880b5300 con 0x7f778815aa70 2024-05-08T04:24:27.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.788+0000 7f777ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77880b4e90 0x7f77881514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.788+0000 7f777ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77880b4e90 0x7f77881514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57836/0 (socket says 172.21.15.104:57836) 2024-05-08T04:24:27.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.788+0000 7f777ffff640 1 -- 172.21.15.104:0/1971416990 learned_addr learned my addr 172.21.15.104:0/1971416990 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.788+0000 7f778cb84640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f778815aa70 0x7f77881519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.788+0000 7f7787fff640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f778806c0b0 0x7f778814f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.788+0000 7f777ffff640 1 -- 172.21.15.104:0/1971416990 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f778815aa70 msgr2=0x7f77881519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.788+0000 7f777ffff640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f778815aa70 0x7f77881519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.789+0000 7f777ffff640 1 -- 172.21.15.104:0/1971416990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f778806c0b0 msgr2=0x7f778814f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.789+0000 7f777ffff640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f778806c0b0 0x7f778814f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.789+0000 7f777ffff640 1 -- 172.21.15.104:0/1971416990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77881536f0 con 0x7f77880b4e90 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.789+0000 7f777ffff640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77880b4e90 0x7f77881514b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f777002a180 tx=0x7f77700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.789+0000 7f77857fa640 1 -- 172.21.15.104:0/1971416990 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7770041020 con 0x7f77880b4e90 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.789+0000 7f77857fa640 1 -- 172.21.15.104:0/1971416990 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77700306c0 con 0x7f77880b4e90 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.789+0000 7f778e5e7640 1 -- 172.21.15.104:0/1971416990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7788150240 con 0x7f77880b4e90 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.789+0000 7f77857fa640 1 -- 172.21.15.104:0/1971416990 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7770037040 con 0x7f77880b4e90 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.789+0000 7f778e5e7640 1 -- 172.21.15.104:0/1971416990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7788150800 con 0x7f77880b4e90 2024-05-08T04:24:27.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.790+0000 7f778e5e7640 1 -- 172.21.15.104:0/1971416990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7788075010 con 0x7f77880b4e90 2024-05-08T04:24:27.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.790+0000 7f77857fa640 1 -- 172.21.15.104:0/1971416990 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f7770044020 con 0x7f77880b4e90 2024-05-08T04:24:27.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.791+0000 7f77857fa640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f776806b680 0x7f776806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:27.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.791+0000 7f77857fa640 1 -- 172.21.15.104:0/1971416990 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f77700aada0 con 0x7f77880b4e90 2024-05-08T04:24:27.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.791+0000 7f7787fff640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f776806b680 0x7f776806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:27.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.791+0000 7f7787fff640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f776806b680 0x7f776806db40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7778006fd0 tx=0x7f7778008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:27.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:27.795+0000 7f77857fa640 1 -- 172.21.15.104:0/1971416990 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f777004b030 con 0x7f77880b4e90 2024-05-08T04:24:28.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.001+0000 7f778e5e7640 1 -- 172.21.15.104:0/1971416990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f77880aec10 con 0x7f77880b4e90 2024-05-08T04:24:28.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.668+0000 7f77857fa640 1 -- 172.21.15.104:0/1971416990 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7770079940 con 0x7f77880b4e90 2024-05-08T04:24:28.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.670+0000 7f778e5e7640 1 -- 172.21.15.104:0/1971416990 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f776806b680 msgr2=0x7f776806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:28.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.670+0000 7f778e5e7640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f776806b680 0x7f776806db40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7778006fd0 tx=0x7f7778008040 comp rx=0 tx=0).stop 2024-05-08T04:24:28.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.670+0000 7f778e5e7640 1 -- 172.21.15.104:0/1971416990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77880b4e90 msgr2=0x7f77881514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:28.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.670+0000 7f778e5e7640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77880b4e90 0x7f77881514b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f777002a180 tx=0x7f77700046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:28.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.670+0000 7f778e5e7640 1 -- 172.21.15.104:0/1971416990 shutdown_connections 2024-05-08T04:24:28.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.670+0000 7f778e5e7640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f776806b680 0x7f776806db40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:28.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.670+0000 7f778e5e7640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f778815aa70 0x7f77881519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:28.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.670+0000 7f778e5e7640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77880b4e90 0x7f77881514b0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:28.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.670+0000 7f778e5e7640 1 --2- 172.21.15.104:0/1971416990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f778806c0b0 0x7f778814f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:28.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.670+0000 7f778e5e7640 1 -- 172.21.15.104:0/1971416990 >> 172.21.15.104:0/1971416990 conn(0x7f7788071a10 msgr2=0x7f77880b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:28.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.671+0000 7f778e5e7640 1 -- 172.21.15.104:0/1971416990 shutdown_connections 2024-05-08T04:24:28.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.671+0000 7f778e5e7640 1 -- 172.21.15.104:0/1971416990 wait complete. 2024-05-08T04:24:28.685 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T04:24:28.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.832+0000 7efc87415640 1 Processor -- start 2024-05-08T04:24:28.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.832+0000 7efc87415640 1 -- start start 2024-05-08T04:24:28.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc87415640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc80072160 0x7efc8006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:28.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc87415640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efc8015a2a0 0x7efc8015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:28.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc87415640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8015dce0 con 0x7efc80159ec0 2024-05-08T04:24:28.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc87415640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8006eb60 con 0x7efc8015a2a0 2024-05-08T04:24:28.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc87415640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8006ee40 con 0x7efc80072160 2024-05-08T04:24:28.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc849b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc80072160 0x7efc8006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:28.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc859b2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efc8015a2a0 0x7efc8015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:28.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc849b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc80072160 0x7efc8006e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:39888/0 (socket says 172.21.15.104:39888) 2024-05-08T04:24:28.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc849b0640 1 -- 172.21.15.104:0/375056707 learned_addr learned my addr 172.21.15.104:0/375056707 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:28.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc849b0640 1 -- 172.21.15.104:0/375056707 >> v2:172.21.15.183:3300/0 conn(0x7efc8015a2a0 msgr2=0x7efc8015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:28.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc849b0640 1 --2- 172.21.15.104:0/375056707 >> v2:172.21.15.183:3300/0 conn(0x7efc8015a2a0 0x7efc8015b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:28.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc849b0640 1 -- 172.21.15.104:0/375056707 >> v1:172.21.15.183:6789/0 conn(0x7efc80159ec0 legacy=0x7efc80071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:28.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc849b0640 1 -- 172.21.15.104:0/375056707 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8015df80 con 0x7efc80072160 2024-05-08T04:24:28.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.833+0000 7efc859b2640 1 --2- 172.21.15.104:0/375056707 >> v2:172.21.15.183:3300/0 conn(0x7efc8015a2a0 0x7efc8015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:24:28.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.834+0000 7efc849b0640 1 --2- 172.21.15.104:0/375056707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc80072160 0x7efc8006e4d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc70009870 tx=0x7efc7002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffc79bac14601dde server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:28.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.834+0000 7efc77fff640 1 -- 172.21.15.104:0/375056707 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70037070 con 0x7efc80072160 2024-05-08T04:24:28.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.834+0000 7efc77fff640 1 -- 172.21.15.104:0/375056707 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc70032440 con 0x7efc80072160 2024-05-08T04:24:28.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.834+0000 7efc77fff640 1 -- 172.21.15.104:0/375056707 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70032810 con 0x7efc80072160 2024-05-08T04:24:28.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.835+0000 7efc87415640 1 -- 172.21.15.104:0/375056707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc80072160 msgr2=0x7efc8006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:28.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.835+0000 7efc87415640 1 --2- 172.21.15.104:0/375056707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc80072160 0x7efc8006e4d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc70009870 tx=0x7efc7002a270 comp rx=0 tx=0).stop 2024-05-08T04:24:28.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.835+0000 7efc87415640 1 -- 172.21.15.104:0/375056707 shutdown_connections 2024-05-08T04:24:28.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.835+0000 7efc87415640 1 --2- 172.21.15.104:0/375056707 >> v2:172.21.15.183:3300/0 conn(0x7efc8015a2a0 0x7efc8015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:28.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.835+0000 7efc87415640 1 --2- 172.21.15.104:0/375056707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc80072160 0x7efc8006e4d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:28.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.835+0000 7efc87415640 1 -- 172.21.15.104:0/375056707 >> 172.21.15.104:0/375056707 conn(0x7efc800b13f0 msgr2=0x7efc800b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:28.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.835+0000 7efc87415640 1 -- 172.21.15.104:0/375056707 shutdown_connections 2024-05-08T04:24:28.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.835+0000 7efc87415640 1 -- 172.21.15.104:0/375056707 wait complete. 2024-05-08T04:24:28.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.836+0000 7efc87415640 1 Processor -- start 2024-05-08T04:24:28.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.836+0000 7efc87415640 1 -- start start 2024-05-08T04:24:28.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc87415640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc80072160 0x7efc800cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:28.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc87415640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc80159ec0 0x7efc80158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:28.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc87415640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc8015a2a0 0x7efc80158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc87415640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8015e900 con 0x7efc80159ec0 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc87415640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8015e780 con 0x7efc8015a2a0 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc87415640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8015ea80 con 0x7efc80072160 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc849b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc80159ec0 0x7efc80158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc849b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc80159ec0 0x7efc80158340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57838/0 (socket says 172.21.15.104:57838) 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc849b0640 1 -- 172.21.15.104:0/287108417 learned_addr learned my addr 172.21.15.104:0/287108417 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc859b2640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc8015a2a0 0x7efc80158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc851b1640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc80072160 0x7efc800cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc849b0640 1 -- 172.21.15.104:0/287108417 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc80072160 msgr2=0x7efc800cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc849b0640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc80072160 0x7efc800cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc849b0640 1 -- 172.21.15.104:0/287108417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc8015a2a0 msgr2=0x7efc80158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc849b0640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc8015a2a0 0x7efc80158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc849b0640 1 -- 172.21.15.104:0/287108417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc800ce250 con 0x7efc80159ec0 2024-05-08T04:24:28.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.837+0000 7efc851b1640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc80072160 0x7efc800cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:28.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.838+0000 7efc849b0640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc80159ec0 0x7efc80158340 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7efc70000c00 tx=0x7efc700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:28.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.838+0000 7efc75ffb640 1 -- 172.21.15.104:0/287108417 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70037040 con 0x7efc80159ec0 2024-05-08T04:24:28.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.838+0000 7efc75ffb640 1 -- 172.21.15.104:0/287108417 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc70042070 con 0x7efc80159ec0 2024-05-08T04:24:28.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.838+0000 7efc87415640 1 -- 172.21.15.104:0/287108417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc800ce530 con 0x7efc80159ec0 2024-05-08T04:24:28.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.838+0000 7efc75ffb640 1 -- 172.21.15.104:0/287108417 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70030880 con 0x7efc80159ec0 2024-05-08T04:24:28.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.838+0000 7efc87415640 1 -- 172.21.15.104:0/287108417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc800ceaf0 con 0x7efc80159ec0 2024-05-08T04:24:28.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.839+0000 7efc87415640 1 -- 172.21.15.104:0/287108417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc80075010 con 0x7efc80159ec0 2024-05-08T04:24:28.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.839+0000 7efc75ffb640 1 -- 172.21.15.104:0/287108417 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7efc70030a20 con 0x7efc80159ec0 2024-05-08T04:24:28.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.840+0000 7efc75ffb640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efc6406b680 0x7efc6406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:28.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.840+0000 7efc851b1640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efc6406b680 0x7efc6406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:28.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.840+0000 7efc75ffb640 1 -- 172.21.15.104:0/287108417 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5940+0+0 (secure 0 0 0) 0x7efc700aadd0 con 0x7efc80159ec0 2024-05-08T04:24:28.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.840+0000 7efc851b1640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efc6406b680 0x7efc6406db40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efc7c001700 tx=0x7efc7c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:28.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:28.844+0000 7efc75ffb640 1 -- 172.21.15.104:0/287108417 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc700798e0 con 0x7efc80159ec0 2024-05-08T04:24:29.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.018+0000 7efc87415640 1 -- 172.21.15.104:0/287108417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc8014f910 con 0x7efc80159ec0 2024-05-08T04:24:29.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.675+0000 7efc75ffb640 1 -- 172.21.15.104:0/287108417 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) v1 ==== 181+0+0 (secure 0 0 0) 0x7efc700ac020 con 0x7efc80159ec0 2024-05-08T04:24:29.676 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-05-08T04:24:29.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.679+0000 7efc87415640 1 -- 172.21.15.104:0/287108417 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efc6406b680 msgr2=0x7efc6406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:29.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.679+0000 7efc87415640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efc6406b680 0x7efc6406db40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efc7c001700 tx=0x7efc7c009040 comp rx=0 tx=0).stop 2024-05-08T04:24:29.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.679+0000 7efc87415640 1 -- 172.21.15.104:0/287108417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc80159ec0 msgr2=0x7efc80158340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:29.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.679+0000 7efc87415640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc80159ec0 0x7efc80158340 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7efc70000c00 tx=0x7efc700046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:29.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.679+0000 7efc87415640 1 -- 172.21.15.104:0/287108417 shutdown_connections 2024-05-08T04:24:29.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.679+0000 7efc87415640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efc6406b680 0x7efc6406db40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:29.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.679+0000 7efc87415640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc8015a2a0 0x7efc80158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:29.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.679+0000 7efc87415640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc80159ec0 0x7efc80158340 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:29.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.679+0000 7efc87415640 1 --2- 172.21.15.104:0/287108417 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc80072160 0x7efc800cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:29.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.679+0000 7efc87415640 1 -- 172.21.15.104:0/287108417 >> 172.21.15.104:0/287108417 conn(0x7efc800b13f0 msgr2=0x7efc80147d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:29.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.679+0000 7efc87415640 1 -- 172.21.15.104:0/287108417 shutdown_connections 2024-05-08T04:24:29.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.679+0000 7efc87415640 1 -- 172.21.15.104:0/287108417 wait complete. 2024-05-08T04:24:29.694 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T04:24:29.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.802+0000 7f74f374f640 1 Processor -- start 2024-05-08T04:24:29.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.802+0000 7f74f374f640 1 -- start start 2024-05-08T04:24:29.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74f374f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec15de20 0x7f74ec0b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:29.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74f374f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f74ec0d0150 0x7f74ec0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:29.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74f374f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ec0cd7a0 con 0x7f74ec0b1d50 2024-05-08T04:24:29.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74f374f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ec0caf50 con 0x7f74ec0d0150 2024-05-08T04:24:29.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74f374f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0cda80 con 0x7f74ec15de20 2024-05-08T04:24:29.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74f0cea640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f74ec0b1d50 0x7f74ec0cfa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44852/0 (socket says 172.21.15.104:44852) 2024-05-08T04:24:29.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74f0cea640 1 -- 172.21.15.104:0/2074993629 learned_addr learned my addr 172.21.15.104:0/2074993629 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:29.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74f14eb640 1 --2- 172.21.15.104:0/2074993629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec15de20 0x7f74ec0b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:29.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74f1cec640 1 --2- 172.21.15.104:0/2074993629 >> v2:172.21.15.183:3300/0 conn(0x7f74ec0d0150 0x7f74ec0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:29.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556779553 0 0) 0x7f74ec0cd7a0 con 0x7f74ec0b1d50 2024-05-08T04:24:29.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74d8003520 con 0x7f74ec0b1d50 2024-05-08T04:24:29.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4113105096 0 0) 0x7f74d8003520 con 0x7f74ec0b1d50 2024-05-08T04:24:29.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec15de20 msgr2=0x7f74ec0b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:29.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 --2- 172.21.15.104:0/2074993629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec15de20 0x7f74ec0b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:29.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 >> v2:172.21.15.183:3300/0 conn(0x7f74ec0d0150 msgr2=0x7f74ec0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:29.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 --2- 172.21.15.104:0/2074993629 >> v2:172.21.15.183:3300/0 conn(0x7f74ec0d0150 0x7f74ec0cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:29.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec0cdd60 con 0x7f74ec0b1d50 2024-05-08T04:24:29.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f74dc001670 con 0x7f74ec0b1d50 2024-05-08T04:24:29.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 >> v1:172.21.15.104:6789/0 conn(0x7f74ec0b1d50 legacy=0x7f74ec0cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:29.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 --2- 172.21.15.104:0/2074993629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74d80039b0 0x7f74d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:29.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 --2- 172.21.15.104:0/2074993629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec15de20 0x7f74d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:29.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 --2- 172.21.15.104:0/2074993629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74d8004d40 0x7f74d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:29.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0caf50 con 0x7f74d8004d40 2024-05-08T04:24:29.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0cda80 con 0x7f74d80039b0 2024-05-08T04:24:29.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.803+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d800b9c0 con 0x7f74ec15de20 2024-05-08T04:24:29.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.804+0000 7f74f1cec640 1 --2- 172.21.15.104:0/2074993629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74d8004d40 0x7f74d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:29.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.804+0000 7f74f14eb640 1 --2- 172.21.15.104:0/2074993629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74d80039b0 0x7f74d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:29.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.804+0000 7f74f0cea640 1 --2- 172.21.15.104:0/2074993629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec15de20 0x7f74d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:29.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.804+0000 7f74f1cec640 1 -- 172.21.15.104:0/2074993629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec15de20 msgr2=0x7f74d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:29.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.804+0000 7f74f1cec640 1 --2- 172.21.15.104:0/2074993629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec15de20 0x7f74d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:29.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.804+0000 7f74f1cec640 1 -- 172.21.15.104:0/2074993629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74d80039b0 msgr2=0x7f74d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:29.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.804+0000 7f74f1cec640 1 --2- 172.21.15.104:0/2074993629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74d80039b0 0x7f74d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:29.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.804+0000 7f74f1cec640 1 -- 172.21.15.104:0/2074993629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d8003520 con 0x7f74d8004d40 2024-05-08T04:24:29.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.804+0000 7f74f1cec640 1 --2- 172.21.15.104:0/2074993629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74d8004d40 0x7f74d80051c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009fc0 tx=0x7f74d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815d7dfabc7fea26 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:29.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.805+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4009c10 con 0x7f74d8004d40 2024-05-08T04:24:29.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.805+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e4036070 con 0x7f74d8004d40 2024-05-08T04:24:29.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.805+0000 7f74e3fff640 1 -- 172.21.15.104:0/2074993629 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e402d070 con 0x7f74d8004d40 2024-05-08T04:24:29.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.805+0000 7f74f374f640 1 -- 172.21.15.104:0/2074993629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74d8004d40 msgr2=0x7f74d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:29.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.805+0000 7f74f374f640 1 --2- 172.21.15.104:0/2074993629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74d8004d40 0x7f74d80051c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009fc0 tx=0x7f74d8005830 comp rx=0 tx=0).stop 2024-05-08T04:24:29.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.805+0000 7f74f1cec640 1 -- 172.21.15.104:0/2074993629 reap_dead start 2024-05-08T04:24:29.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.805+0000 7f74f374f640 1 -- 172.21.15.104:0/2074993629 shutdown_connections 2024-05-08T04:24:29.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.805+0000 7f74f374f640 1 -- 172.21.15.104:0/2074993629 >> 172.21.15.104:0/2074993629 conn(0x7f74ec0b2220 msgr2=0x7f74ec0b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:29.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.805+0000 7f74f374f640 1 -- 172.21.15.104:0/2074993629 shutdown_connections 2024-05-08T04:24:29.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.805+0000 7f74f374f640 1 -- 172.21.15.104:0/2074993629 wait complete. 2024-05-08T04:24:29.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.806+0000 7f74f374f640 1 Processor -- start 2024-05-08T04:24:29.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.807+0000 7f74f374f640 1 -- start start 2024-05-08T04:24:29.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.807+0000 7f74f374f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74d8004d40 0x7f74ec06f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:29.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.807+0000 7f74f374f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec0c6760 0x7f74ec0c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:29.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.807+0000 7f74f374f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74ec150690 0x7f74ec150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:29.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.807+0000 7f74f374f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec15e380 con 0x7f74d8004d40 2024-05-08T04:24:29.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.807+0000 7f74f374f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec15e200 con 0x7f74ec150690 2024-05-08T04:24:29.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.807+0000 7f74f374f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec0b1810 con 0x7f74ec0c6760 2024-05-08T04:24:29.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.807+0000 7f74f14eb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74d8004d40 0x7f74ec06f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:29.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.807+0000 7f74f14eb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74d8004d40 0x7f74ec06f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57854/0 (socket says 172.21.15.104:57854) 2024-05-08T04:24:29.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.807+0000 7f74f14eb640 1 -- 172.21.15.104:0/700874835 learned_addr learned my addr 172.21.15.104:0/700874835 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:29.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.807+0000 7f74f1cec640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74ec150690 0x7f74ec150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:29.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.807+0000 7f74f0cea640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec0c6760 0x7f74ec0c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:29.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.808+0000 7f74f14eb640 1 -- 172.21.15.104:0/700874835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec0c6760 msgr2=0x7f74ec0c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:29.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.808+0000 7f74f14eb640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec0c6760 0x7f74ec0c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:29.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.808+0000 7f74f14eb640 1 -- 172.21.15.104:0/700874835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74ec150690 msgr2=0x7f74ec150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:29.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.808+0000 7f74f14eb640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74ec150690 0x7f74ec150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:29.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.808+0000 7f74f14eb640 1 -- 172.21.15.104:0/700874835 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec151050 con 0x7f74d8004d40 2024-05-08T04:24:29.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.808+0000 7f74f0cea640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec0c6760 0x7f74ec0c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:29.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.808+0000 7f74f14eb640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74d8004d40 0x7f74ec06f6f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f74e80118e0 tx=0x7f74e8011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:29.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.808+0000 7f74e1ffb640 1 -- 172.21.15.104:0/700874835 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e800faf0 con 0x7f74d8004d40 2024-05-08T04:24:29.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.808+0000 7f74e1ffb640 1 -- 172.21.15.104:0/700874835 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e800fc90 con 0x7f74d8004d40 2024-05-08T04:24:29.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.808+0000 7f74f374f640 1 -- 172.21.15.104:0/700874835 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec0c7b00 con 0x7f74d8004d40 2024-05-08T04:24:29.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.808+0000 7f74e1ffb640 1 -- 172.21.15.104:0/700874835 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8014440 con 0x7f74d8004d40 2024-05-08T04:24:29.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.808+0000 7f74f374f640 1 -- 172.21.15.104:0/700874835 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec0c80c0 con 0x7f74d8004d40 2024-05-08T04:24:29.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.809+0000 7f74f374f640 1 -- 172.21.15.104:0/700874835 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec0c87e0 con 0x7f74d8004d40 2024-05-08T04:24:29.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.810+0000 7f74e1ffb640 1 -- 172.21.15.104:0/700874835 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f74e8012040 con 0x7f74d8004d40 2024-05-08T04:24:29.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.810+0000 7f74e1ffb640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f74d006b6b0 0x7f74d006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:29.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.810+0000 7f74e1ffb640 1 -- 172.21.15.104:0/700874835 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f74e808aa80 con 0x7f74d8004d40 2024-05-08T04:24:29.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.810+0000 7f74f0cea640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f74d006b6b0 0x7f74d006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:29.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.811+0000 7f74f0cea640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f74d006b6b0 0x7f74d006db70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f74dc007fd0 tx=0x7f74dc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:29.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.814+0000 7f74e1ffb640 1 -- 172.21.15.104:0/700874835 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f74e8019030 con 0x7f74d8004d40 2024-05-08T04:24:29.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:29.983+0000 7f74f374f640 1 -- 172.21.15.104:0/700874835 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f74ec075010 con 0x7f74d8004d40 2024-05-08T04:24:30.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.676+0000 7f74e1ffb640 1 -- 172.21.15.104:0/700874835 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) v1 ==== 169+0+0 (secure 0 0 0) 0x7f74e8059750 con 0x7f74d8004d40 2024-05-08T04:24:30.678 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-05-08T04:24:30.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.681+0000 7f74f374f640 1 -- 172.21.15.104:0/700874835 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f74d006b6b0 msgr2=0x7f74d006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:30.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.681+0000 7f74f374f640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f74d006b6b0 0x7f74d006db70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f74dc007fd0 tx=0x7f74dc009040 comp rx=0 tx=0).stop 2024-05-08T04:24:30.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.681+0000 7f74f374f640 1 -- 172.21.15.104:0/700874835 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74d8004d40 msgr2=0x7f74ec06f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:30.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.681+0000 7f74f374f640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74d8004d40 0x7f74ec06f6f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f74e80118e0 tx=0x7f74e8011da0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.681+0000 7f74f374f640 1 -- 172.21.15.104:0/700874835 shutdown_connections 2024-05-08T04:24:30.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.681+0000 7f74f374f640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f74d006b6b0 0x7f74d006db70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.681+0000 7f74f374f640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74ec150690 0x7f74ec150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.681+0000 7f74f374f640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74ec0c6760 0x7f74ec0c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.681+0000 7f74f374f640 1 --2- 172.21.15.104:0/700874835 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74d8004d40 0x7f74ec06f6f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.681+0000 7f74f374f640 1 -- 172.21.15.104:0/700874835 >> 172.21.15.104:0/700874835 conn(0x7f74ec0b2220 msgr2=0x7f74ec160bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:30.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.681+0000 7f74f374f640 1 -- 172.21.15.104:0/700874835 shutdown_connections 2024-05-08T04:24:30.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.681+0000 7f74f374f640 1 -- 172.21.15.104:0/700874835 wait complete. 2024-05-08T04:24:30.697 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-08T04:24:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.809+0000 7f2343f7e640 1 Processor -- start 2024-05-08T04:24:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.809+0000 7f2343f7e640 1 -- start start 2024-05-08T04:24:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.810+0000 7f2343f7e640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f233c15db30 0x7f233c06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.810+0000 7f2343f7e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f233c0b93b0 0x7f233c0b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.810+0000 7f2343f7e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c0b6b50 con 0x7f233c0b5970 2024-05-08T04:24:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.810+0000 7f2343f7e640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c06c800 con 0x7f233c15db30 2024-05-08T04:24:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.810+0000 7f2343f7e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c06cae0 con 0x7f233c0b93b0 2024-05-08T04:24:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.810+0000 7f2341d1a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f233c15db30 0x7f233c06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.810+0000 7f2341d1a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f233c15db30 0x7f233c06bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57868/0 (socket says 172.21.15.104:57868) 2024-05-08T04:24:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.810+0000 7f2341d1a640 1 -- 172.21.15.104:0/3378024272 learned_addr learned my addr 172.21.15.104:0/3378024272 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.810+0000 7f2341d1a640 1 -- 172.21.15.104:0/3378024272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f233c0b93b0 msgr2=0x7f233c0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.810+0000 7f2341d1a640 1 --2- 172.21.15.104:0/3378024272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f233c0b93b0 0x7f233c0b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.810+0000 7f2341d1a640 1 -- 172.21.15.104:0/3378024272 >> v1:172.21.15.183:6789/0 conn(0x7f233c0b5970 legacy=0x7f233c161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.810+0000 7f2341d1a640 1 -- 172.21.15.104:0/3378024272 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c06cdc0 con 0x7f233c15db30 2024-05-08T04:24:30.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.811+0000 7f2341d1a640 1 --2- 172.21.15.104:0/3378024272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f233c15db30 0x7f233c06bfb0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2338009870 tx=0x7f233802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03c5d91b55838b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:30.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.811+0000 7f2340d18640 1 -- 172.21.15.104:0/3378024272 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2338037070 con 0x7f233c15db30 2024-05-08T04:24:30.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.811+0000 7f2340d18640 1 -- 172.21.15.104:0/3378024272 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2338032440 con 0x7f233c15db30 2024-05-08T04:24:30.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.811+0000 7f2340d18640 1 -- 172.21.15.104:0/3378024272 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2338032810 con 0x7f233c15db30 2024-05-08T04:24:30.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.812+0000 7f2343f7e640 1 -- 172.21.15.104:0/3378024272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f233c15db30 msgr2=0x7f233c06bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:30.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.812+0000 7f2343f7e640 1 --2- 172.21.15.104:0/3378024272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f233c15db30 0x7f233c06bfb0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2338009870 tx=0x7f233802a210 comp rx=0 tx=0).stop 2024-05-08T04:24:30.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.812+0000 7f2343f7e640 1 -- 172.21.15.104:0/3378024272 shutdown_connections 2024-05-08T04:24:30.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.812+0000 7f2343f7e640 1 --2- 172.21.15.104:0/3378024272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f233c0b93b0 0x7f233c0b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.812+0000 7f2343f7e640 1 --2- 172.21.15.104:0/3378024272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f233c15db30 0x7f233c06bfb0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.812+0000 7f2343f7e640 1 -- 172.21.15.104:0/3378024272 >> 172.21.15.104:0/3378024272 conn(0x7f233c0d0430 msgr2=0x7f233c0d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:30.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.812+0000 7f2343f7e640 1 -- 172.21.15.104:0/3378024272 shutdown_connections 2024-05-08T04:24:30.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.812+0000 7f2343f7e640 1 -- 172.21.15.104:0/3378024272 wait complete. 2024-05-08T04:24:30.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.813+0000 7f2343f7e640 1 Processor -- start 2024-05-08T04:24:30.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.813+0000 7f2343f7e640 1 -- start start 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2343f7e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f233c0b5970 0x7f233c152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2343f7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f233c0b93b0 0x7f233c0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2343f7e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f233c15db30 0x7f233c153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2343f7e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c15df10 con 0x7f233c0b93b0 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2343f7e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c06c4f0 con 0x7f233c0b5970 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2343f7e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c1e9460 con 0x7f233c15db30 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2341519640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f233c0b93b0 0x7f233c0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2341519640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f233c0b93b0 0x7f233c0c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57882/0 (socket says 172.21.15.104:57882) 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2341519640 1 -- 172.21.15.104:0/772962471 learned_addr learned my addr 172.21.15.104:0/772962471 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2341d1a640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f233c0b5970 0x7f233c152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f234251b640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f233c15db30 0x7f233c153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2341519640 1 -- 172.21.15.104:0/772962471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f233c15db30 msgr2=0x7f233c153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2341519640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f233c15db30 0x7f233c153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2341519640 1 -- 172.21.15.104:0/772962471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f233c0b5970 msgr2=0x7f233c152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:30.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2341519640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f233c0b5970 0x7f233c152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2341519640 1 -- 172.21.15.104:0/772962471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c1e9740 con 0x7f233c0b93b0 2024-05-08T04:24:30.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f234251b640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f233c15db30 0x7f233c153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:30.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2341519640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f233c0b93b0 0x7f233c0c9750 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f232c00b4a0 tx=0x7f232c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:30.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f23327fc640 1 -- 172.21.15.104:0/772962471 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c014070 con 0x7f233c0b93b0 2024-05-08T04:24:30.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f23327fc640 1 -- 172.21.15.104:0/772962471 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c010610 con 0x7f233c0b93b0 2024-05-08T04:24:30.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f23327fc640 1 -- 172.21.15.104:0/772962471 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c010a00 con 0x7f233c0b93b0 2024-05-08T04:24:30.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2343f7e640 1 -- 172.21.15.104:0/772962471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c1e9a20 con 0x7f233c0b93b0 2024-05-08T04:24:30.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.814+0000 7f2343f7e640 1 -- 172.21.15.104:0/772962471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c0c9c90 con 0x7f233c0b93b0 2024-05-08T04:24:30.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.815+0000 7f2343f7e640 1 -- 172.21.15.104:0/772962471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c075010 con 0x7f233c0b93b0 2024-05-08T04:24:30.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.816+0000 7f23327fc640 1 -- 172.21.15.104:0/772962471 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f232c017070 con 0x7f233c0b93b0 2024-05-08T04:24:30.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.816+0000 7f23327fc640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f232006b680 0x7f232006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:30.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.816+0000 7f2341d1a640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f232006b680 0x7f232006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:30.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.816+0000 7f23327fc640 1 -- 172.21.15.104:0/772962471 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f232c089bc0 con 0x7f233c0b93b0 2024-05-08T04:24:30.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.817+0000 7f2341d1a640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f232006b680 0x7f232006db40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2338034000 tx=0x7f233802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:30.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.821+0000 7f23327fc640 1 -- 172.21.15.104:0/772962471 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f232c058b50 con 0x7f233c0b93b0 2024-05-08T04:24:30.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.992+0000 7f2343f7e640 1 -- 172.21.15.104:0/772962471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f233c06b040 con 0x7f233c0b93b0 2024-05-08T04:24:30.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.995+0000 7f23327fc640 1 -- 172.21.15.104:0/772962471 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f232c058450 con 0x7f233c0b93b0 2024-05-08T04:24:30.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.997+0000 7f2343f7e640 1 -- 172.21.15.104:0/772962471 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f232006b680 msgr2=0x7f232006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:30.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.997+0000 7f2343f7e640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f232006b680 0x7f232006db40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2338034000 tx=0x7f233802e000 comp rx=0 tx=0).stop 2024-05-08T04:24:30.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.997+0000 7f2343f7e640 1 -- 172.21.15.104:0/772962471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f233c0b93b0 msgr2=0x7f233c0c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:30.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.997+0000 7f2343f7e640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f233c0b93b0 0x7f233c0c9750 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f232c00b4a0 tx=0x7f232c00b960 comp rx=0 tx=0).stop 2024-05-08T04:24:30.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.998+0000 7f2343f7e640 1 -- 172.21.15.104:0/772962471 shutdown_connections 2024-05-08T04:24:30.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.998+0000 7f2343f7e640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f232006b680 0x7f232006db40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.998+0000 7f2343f7e640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f233c15db30 0x7f233c153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.998+0000 7f2343f7e640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f233c0b93b0 0x7f233c0c9750 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.998+0000 7f2343f7e640 1 --2- 172.21.15.104:0/772962471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f233c0b5970 0x7f233c152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:30.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.998+0000 7f2343f7e640 1 -- 172.21.15.104:0/772962471 >> 172.21.15.104:0/772962471 conn(0x7f233c0d0430 msgr2=0x7f233c0b73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:31.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.998+0000 7f2343f7e640 1 -- 172.21.15.104:0/772962471 shutdown_connections 2024-05-08T04:24:31.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:30.998+0000 7f2343f7e640 1 -- 172.21.15.104:0/772962471 wait complete. 2024-05-08T04:24:31.010 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-05-08T04:24:31.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.107+0000 7f9bc244d640 1 Processor -- start 2024-05-08T04:24:31.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.107+0000 7f9bc244d640 1 -- start start 2024-05-08T04:24:31.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.108+0000 7f9bc244d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bbc15de10 0x7f9bbc161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:31.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.108+0000 7f9bc244d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9bbc0d07c0 0x7f9bbc0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:31.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.108+0000 7f9bc244d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc15e1f0 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.108+0000 7f9bc244d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc0d0f50 con 0x7f9bbc0d07c0 2024-05-08T04:24:31.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.108+0000 7f9bc244d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc161e60 con 0x7f9bbc15de10 2024-05-08T04:24:31.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.109+0000 7f9bbbfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bbc15de10 0x7f9bbc161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:31.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.109+0000 7f9bc09ea640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9bbc0d07c0 0x7f9bbc0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:31.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.109+0000 7f9bbbfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bbc15de10 0x7f9bbc161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:39956/0 (socket says 172.21.15.104:39956) 2024-05-08T04:24:31.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.109+0000 7f9bbbfff640 1 -- 172.21.15.104:0/3083544729 learned_addr learned my addr 172.21.15.104:0/3083544729 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:31.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.109+0000 7f9bbbfff640 1 -- 172.21.15.104:0/3083544729 >> v2:172.21.15.183:3300/0 conn(0x7f9bbc0d07c0 msgr2=0x7f9bbc0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:31.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.109+0000 7f9bbbfff640 1 --2- 172.21.15.104:0/3083544729 >> v2:172.21.15.183:3300/0 conn(0x7f9bbc0d07c0 0x7f9bbc0d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.109+0000 7f9bbbfff640 1 -- 172.21.15.104:0/3083544729 >> v1:172.21.15.183:6789/0 conn(0x7f9bbc0ce5a0 legacy=0x7f9bbc0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:31.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.109+0000 7f9bbbfff640 1 -- 172.21.15.104:0/3083544729 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc162090 con 0x7f9bbc15de10 2024-05-08T04:24:31.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.110+0000 7f9bbbfff640 1 --2- 172.21.15.104:0/3083544729 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bbc15de10 0x7f9bbc161920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009870 tx=0x7f9bac02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa64491832687d8f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:31.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.110+0000 7f9bbaffd640 1 -- 172.21.15.104:0/3083544729 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac037070 con 0x7f9bbc15de10 2024-05-08T04:24:31.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.110+0000 7f9bbaffd640 1 -- 172.21.15.104:0/3083544729 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac032440 con 0x7f9bbc15de10 2024-05-08T04:24:31.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.110+0000 7f9bbaffd640 1 -- 172.21.15.104:0/3083544729 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac032810 con 0x7f9bbc15de10 2024-05-08T04:24:31.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.110+0000 7f9bc244d640 1 -- 172.21.15.104:0/3083544729 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bbc15de10 msgr2=0x7f9bbc161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:31.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.110+0000 7f9bc244d640 1 --2- 172.21.15.104:0/3083544729 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bbc15de10 0x7f9bbc161920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009870 tx=0x7f9bac02a1c0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.111+0000 7f9bc244d640 1 -- 172.21.15.104:0/3083544729 shutdown_connections 2024-05-08T04:24:31.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.111+0000 7f9bc244d640 1 --2- 172.21.15.104:0/3083544729 >> v2:172.21.15.183:3300/0 conn(0x7f9bbc0d07c0 0x7f9bbc0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.111+0000 7f9bc244d640 1 --2- 172.21.15.104:0/3083544729 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bbc15de10 0x7f9bbc161920 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.111+0000 7f9bc244d640 1 -- 172.21.15.104:0/3083544729 >> 172.21.15.104:0/3083544729 conn(0x7f9bbc072290 msgr2=0x7f9bbc072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:31.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.111+0000 7f9bc244d640 1 -- 172.21.15.104:0/3083544729 shutdown_connections 2024-05-08T04:24:31.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.111+0000 7f9bc244d640 1 -- 172.21.15.104:0/3083544729 wait complete. 2024-05-08T04:24:31.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.112+0000 7f9bc244d640 1 Processor -- start 2024-05-08T04:24:31.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.112+0000 7f9bc244d640 1 -- start start 2024-05-08T04:24:31.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bc244d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9bbc0ce5a0 0x7f9bbc0c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:31.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bc244d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bbc0d07c0 0x7f9bbc15a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:31.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bc244d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bbc15de10 0x7f9bbc15f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:31.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bc244d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc162650 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bc244d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc0d1a90 con 0x7f9bbc15de10 2024-05-08T04:24:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bc244d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc0d1ce0 con 0x7f9bbc0d07c0 2024-05-08T04:24:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bbbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9bbc0ce5a0 0x7f9bbc0c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bbbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9bbc0ce5a0 0x7f9bbc0c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57890/0 (socket says 172.21.15.104:57890) 2024-05-08T04:24:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bbbfff640 1 -- 172.21.15.104:0/4086206537 learned_addr learned my addr 172.21.15.104:0/4086206537 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bbb7fe640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bbc0d07c0 0x7f9bbc15a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bc09ea640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bbc15de10 0x7f9bbc15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bbbfff640 1 -- 172.21.15.104:0/4086206537 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bbc0d07c0 msgr2=0x7f9bbc15a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bbbfff640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bbc0d07c0 0x7f9bbc15a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bbbfff640 1 -- 172.21.15.104:0/4086206537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bbc15de10 msgr2=0x7f9bbc15f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bbbfff640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bbc15de10 0x7f9bbc15f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bbbfff640 1 -- 172.21.15.104:0/4086206537 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0b38e0 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bc09ea640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bbc15de10 0x7f9bbc15f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:31.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bbbfff640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9bbc0ce5a0 0x7f9bbc0c9270 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9bac000c00 tx=0x7f9bac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:31.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bb8ff9640 1 -- 172.21.15.104:0/4086206537 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac037040 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bb8ff9640 1 -- 172.21.15.104:0/4086206537 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac042070 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bc244d640 1 -- 172.21.15.104:0/4086206537 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc15d250 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bb8ff9640 1 -- 172.21.15.104:0/4086206537 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac030880 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.113+0000 7f9bc244d640 1 -- 172.21.15.104:0/4086206537 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc0b3b80 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.114+0000 7f9bc244d640 1 -- 172.21.15.104:0/4086206537 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc075010 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.115+0000 7f9bb8ff9640 1 -- 172.21.15.104:0/4086206537 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f9bac02ad10 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.115+0000 7f9bb8ff9640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9ba806b6b0 0x7f9ba806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:31.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.115+0000 7f9bbb7fe640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9ba806b6b0 0x7f9ba806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:31.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.115+0000 7f9bb8ff9640 1 -- 172.21.15.104:0/4086206537 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9bac0aa6c0 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.116+0000 7f9bbb7fe640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9ba806b6b0 0x7f9ba806db70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0c9de0 tx=0x7f9bb0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:31.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.119+0000 7f9bb8ff9640 1 -- 172.21.15.104:0/4086206537 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9bac0795c0 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.357+0000 7f9bc244d640 1 -- 172.21.15.104:0/4086206537 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7f9bbc0b3fa0 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.681+0000 7f9bb8ff9640 1 -- 172.21.15.104:0/4086206537 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v186) v1 ==== 140+0+0 (secure 0 0 0) 0x7f9bac078ec0 con 0x7f9bbc0ce5a0 2024-05-08T04:24:31.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.684+0000 7f9bc244d640 1 -- 172.21.15.104:0/4086206537 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9ba806b6b0 msgr2=0x7f9ba806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:31.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.684+0000 7f9bc244d640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9ba806b6b0 0x7f9ba806db70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0c9de0 tx=0x7f9bb0009040 comp rx=0 tx=0).stop 2024-05-08T04:24:31.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.684+0000 7f9bc244d640 1 -- 172.21.15.104:0/4086206537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9bbc0ce5a0 msgr2=0x7f9bbc0c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:31.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.684+0000 7f9bc244d640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9bbc0ce5a0 0x7f9bbc0c9270 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9bac000c00 tx=0x7f9bac0046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.684+0000 7f9bc244d640 1 -- 172.21.15.104:0/4086206537 shutdown_connections 2024-05-08T04:24:31.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.684+0000 7f9bc244d640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9ba806b6b0 0x7f9ba806db70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.684+0000 7f9bc244d640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bbc15de10 0x7f9bbc15f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.684+0000 7f9bc244d640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bbc0d07c0 0x7f9bbc15a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.684+0000 7f9bc244d640 1 --2- 172.21.15.104:0/4086206537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9bbc0ce5a0 0x7f9bbc0c9270 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.684+0000 7f9bc244d640 1 -- 172.21.15.104:0/4086206537 >> 172.21.15.104:0/4086206537 conn(0x7f9bbc072290 msgr2=0x7f9bbc0d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:31.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.684+0000 7f9bc244d640 1 -- 172.21.15.104:0/4086206537 shutdown_connections 2024-05-08T04:24:31.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.684+0000 7f9bc244d640 1 -- 172.21.15.104:0/4086206537 wait complete. 2024-05-08T04:24:31.696 INFO:tasks.cephfs_test_runner:test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-05-08T04:24:31.697 INFO:tasks.cephfs_test_runner:Starting test: test_dangling_symlink (tasks.cephfs.test_volumes.TestMisc) Tests for the presence of any dangling symlink, if yes, 2024-05-08T04:24:31.697 INFO:tasks.cephfs_test_runner:test_dangling_symlink (tasks.cephfs.test_volumes.TestMisc) 2024-05-08T04:24:31.697 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:24:31.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.796+0000 7f44a2c93640 1 Processor -- start 2024-05-08T04:24:31.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.796+0000 7f44a2c93640 1 -- start start 2024-05-08T04:24:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.797+0000 7f44a2c93640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f449c0b2b80 0x7f449c09a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.797+0000 7f44a2c93640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f449c099a40 0x7f449c099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.797+0000 7f44a2c93640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c0cd940 con 0x7f449c15d490 2024-05-08T04:24:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.797+0000 7f44a2c93640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449c09a3e0 con 0x7f449c099a40 2024-05-08T04:24:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.797+0000 7f44a2c93640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449c0cc8a0 con 0x7f449c0b2b80 2024-05-08T04:24:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.797+0000 7f449bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f449c099a40 0x7f449c099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.797+0000 7f44a1230640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f449c15d490 0x7f449c15d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44858/0 (socket says 172.21.15.104:44858) 2024-05-08T04:24:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.797+0000 7f44a1230640 1 -- 172.21.15.104:0/2353808566 learned_addr learned my addr 172.21.15.104:0/2353808566 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.797+0000 7f449bfff640 1 -- 172.21.15.104:0/2353808566 >> v2:172.21.15.183:3300/0 conn(0x7f449c0b2b80 msgr2=0x7f449c09a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.797+0000 7f449bfff640 1 --2- 172.21.15.104:0/2353808566 >> v2:172.21.15.183:3300/0 conn(0x7f449c0b2b80 0x7f449c09a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.797+0000 7f449bfff640 1 -- 172.21.15.104:0/2353808566 >> v1:172.21.15.104:6789/0 conn(0x7f449c15d490 legacy=0x7f449c15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.797+0000 7f449bfff640 1 -- 172.21.15.104:0/2353808566 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c0ccb80 con 0x7f449c099a40 2024-05-08T04:24:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.797+0000 7f449b7fe640 1 -- 172.21.15.104:0/2353808566 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798951156 0 0) 0x7f449c0cd940 con 0x7f449c15d490 2024-05-08T04:24:31.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.798+0000 7f449bfff640 1 --2- 172.21.15.104:0/2353808566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f449c099a40 0x7f449c099ea0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f449c0685d0 tx=0x7f448802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9942f87992b72ed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:31.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.798+0000 7f449b7fe640 1 -- 172.21.15.104:0/2353808566 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488037070 con 0x7f449c099a40 2024-05-08T04:24:31.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.798+0000 7f449b7fe640 1 -- 172.21.15.104:0/2353808566 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4488032440 con 0x7f449c099a40 2024-05-08T04:24:31.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.798+0000 7f449b7fe640 1 -- 172.21.15.104:0/2353808566 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488032810 con 0x7f449c099a40 2024-05-08T04:24:31.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.799+0000 7f44a2c93640 1 -- 172.21.15.104:0/2353808566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f449c099a40 msgr2=0x7f449c099ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:31.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.799+0000 7f44a2c93640 1 --2- 172.21.15.104:0/2353808566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f449c099a40 0x7f449c099ea0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f449c0685d0 tx=0x7f448802a230 comp rx=0 tx=0).stop 2024-05-08T04:24:31.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.799+0000 7f44a2c93640 1 -- 172.21.15.104:0/2353808566 shutdown_connections 2024-05-08T04:24:31.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.799+0000 7f44a2c93640 1 --2- 172.21.15.104:0/2353808566 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f449c099a40 0x7f449c099ea0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.799+0000 7f44a2c93640 1 --2- 172.21.15.104:0/2353808566 >> v2:172.21.15.183:3300/0 conn(0x7f449c0b2b80 0x7f449c09a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.799+0000 7f44a2c93640 1 -- 172.21.15.104:0/2353808566 >> 172.21.15.104:0/2353808566 conn(0x7f449c0b3310 msgr2=0x7f449c0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:31.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.799+0000 7f44a2c93640 1 -- 172.21.15.104:0/2353808566 shutdown_connections 2024-05-08T04:24:31.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.799+0000 7f44a2c93640 1 -- 172.21.15.104:0/2353808566 wait complete. 2024-05-08T04:24:31.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.800+0000 7f44a2c93640 1 Processor -- start 2024-05-08T04:24:31.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.800+0000 7f44a2c93640 1 -- start start 2024-05-08T04:24:31.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.801+0000 7f44a2c93640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f449c099a40 0x7f449c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:31.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.801+0000 7f44a2c93640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f449c0b2b80 0x7f449c1f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:31.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.801+0000 7f44a2c93640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f449c15d490 0x7f449c152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:31.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.801+0000 7f44a2c93640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c09aef0 con 0x7f449c15d490 2024-05-08T04:24:31.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.801+0000 7f44a2c93640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0cd140 con 0x7f449c099a40 2024-05-08T04:24:31.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.801+0000 7f44a2c93640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0cf830 con 0x7f449c0b2b80 2024-05-08T04:24:31.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.801+0000 7f44a1230640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f449c15d490 0x7f449c152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:31.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.801+0000 7f44a1230640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f449c15d490 0x7f449c152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57900/0 (socket says 172.21.15.104:57900) 2024-05-08T04:24:31.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.801+0000 7f44a1230640 1 -- 172.21.15.104:0/3816609334 learned_addr learned my addr 172.21.15.104:0/3816609334 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.801+0000 7f44a0a2f640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f449c099a40 0x7f449c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.801+0000 7f449bfff640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f449c0b2b80 0x7f449c1f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.802+0000 7f44a1230640 1 -- 172.21.15.104:0/3816609334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f449c0b2b80 msgr2=0x7f449c1f7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.802+0000 7f44a1230640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f449c0b2b80 0x7f449c1f7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.802+0000 7f44a1230640 1 -- 172.21.15.104:0/3816609334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f449c099a40 msgr2=0x7f449c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.802+0000 7f44a1230640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f449c099a40 0x7f449c15a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.802+0000 7f44a1230640 1 -- 172.21.15.104:0/3816609334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c0b4280 con 0x7f449c15d490 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.802+0000 7f44a0a2f640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f449c099a40 0x7f449c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.802+0000 7f44a1230640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f449c15d490 0x7f449c152e60 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f449400c700 tx=0x7f449400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.802+0000 7f44997fa640 1 -- 172.21.15.104:0/3816609334 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494018070 con 0x7f449c15d490 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.802+0000 7f44997fa640 1 -- 172.21.15.104:0/3816609334 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449400ce10 con 0x7f449c15d490 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.802+0000 7f44997fa640 1 -- 172.21.15.104:0/3816609334 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449400a860 con 0x7f449c15d490 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.802+0000 7f44a2c93640 1 -- 172.21.15.104:0/3816609334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c1f77b0 con 0x7f449c15d490 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.802+0000 7f44a2c93640 1 -- 172.21.15.104:0/3816609334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c1f7d30 con 0x7f449c15d490 2024-05-08T04:24:31.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.803+0000 7f44a2c93640 1 -- 172.21.15.104:0/3816609334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449c075010 con 0x7f449c15d490 2024-05-08T04:24:31.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.803+0000 7f44997fa640 1 -- 172.21.15.104:0/3816609334 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f449400aa00 con 0x7f449c15d490 2024-05-08T04:24:31.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.804+0000 7f44997fa640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f448006b680 0x7f448006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:31.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.804+0000 7f44997fa640 1 -- 172.21.15.104:0/3816609334 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4494089810 con 0x7f449c15d490 2024-05-08T04:24:31.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.804+0000 7f44a0a2f640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f448006b680 0x7f448006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:31.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.804+0000 7f44a0a2f640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f448006b680 0x7f448006db40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f449c0cf5f0 tx=0x7f4490008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:31.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.808+0000 7f44997fa640 1 -- 172.21.15.104:0/3816609334 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4494058710 con 0x7f449c15d490 2024-05-08T04:24:31.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.980+0000 7f44a2c93640 1 -- 172.21.15.104:0/3816609334 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f449c0b30f0 con 0x7f449c15d490 2024-05-08T04:24:31.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.981+0000 7f44997fa640 1 -- 172.21.15.104:0/3816609334 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+13082 (secure 0 0 0) 0x7f4494058010 con 0x7f449c15d490 2024-05-08T04:24:31.982 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:31.982 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":50,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:24:30.675720+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6837/3100292449":"2024-05-09T04:24:27.663626+0000","172.21.15.104:6835/3100292449":"2024-05-09T04:24:27.663626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:24:31.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.983+0000 7f44a2c93640 1 -- 172.21.15.104:0/3816609334 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f448006b680 msgr2=0x7f448006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:31.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.983+0000 7f44a2c93640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f448006b680 0x7f448006db40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f449c0cf5f0 tx=0x7f4490008040 comp rx=0 tx=0).stop 2024-05-08T04:24:31.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.983+0000 7f44a2c93640 1 -- 172.21.15.104:0/3816609334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f449c15d490 msgr2=0x7f449c152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:31.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.983+0000 7f44a2c93640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f449c15d490 0x7f449c152e60 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f449400c700 tx=0x7f449400cbc0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.983+0000 7f44a2c93640 1 -- 172.21.15.104:0/3816609334 shutdown_connections 2024-05-08T04:24:31.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.983+0000 7f44a2c93640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f448006b680 0x7f448006db40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.983+0000 7f44a2c93640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f449c15d490 0x7f449c152e60 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.983+0000 7f44a2c93640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f449c0b2b80 0x7f449c1f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.983+0000 7f44a2c93640 1 --2- 172.21.15.104:0/3816609334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f449c099a40 0x7f449c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:31.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.983+0000 7f44a2c93640 1 -- 172.21.15.104:0/3816609334 >> 172.21.15.104:0/3816609334 conn(0x7f449c0b3310 msgr2=0x7f449c161f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:31.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.983+0000 7f44a2c93640 1 -- 172.21.15.104:0/3816609334 shutdown_connections 2024-05-08T04:24:31.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:31.983+0000 7f44a2c93640 1 -- 172.21.15.104:0/3816609334 wait complete. 2024-05-08T04:24:31.995 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:24:31.996 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:24:32.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.097+0000 7f777554f640 1 Processor -- start 2024-05-08T04:24:32.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.097+0000 7f777554f640 1 -- start start 2024-05-08T04:24:32.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.098+0000 7f777554f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f77700d07c0 0x7f7770161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.098+0000 7f777554f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777015e1f0 con 0x7f77700ce5a0 2024-05-08T04:24:32.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.098+0000 7f777554f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7770162090 con 0x7f777015de10 2024-05-08T04:24:32.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.098+0000 7f777554f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77700d0f50 con 0x7f77700d07c0 2024-05-08T04:24:32.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.098+0000 7f776f7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f77700d07c0 0x7f7770161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.098+0000 7f77667fc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f77700ce5a0 0x7f77700d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44868/0 (socket says 172.21.15.104:44868) 2024-05-08T04:24:32.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.098+0000 7f77667fc640 1 -- 172.21.15.104:0/1050100407 learned_addr learned my addr 172.21.15.104:0/1050100407 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:32.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.098+0000 7f776f7fe640 1 -- 172.21.15.104:0/1050100407 >> v1:172.21.15.183:6789/0 conn(0x7f777015de10 legacy=0x7f77700d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:32.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.098+0000 7f776f7fe640 1 -- 172.21.15.104:0/1050100407 >> v1:172.21.15.104:6789/0 conn(0x7f77700ce5a0 legacy=0x7f77700d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.098+0000 7f776e7fc640 1 -- 172.21.15.104:0/1050100407 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226754406 0 0) 0x7f777015e1f0 con 0x7f77700ce5a0 2024-05-08T04:24:32.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.098+0000 7f776f7fe640 1 -- 172.21.15.104:0/1050100407 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7770162370 con 0x7f77700d07c0 2024-05-08T04:24:32.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.099+0000 7f776f7fe640 1 --2- 172.21.15.104:0/1050100407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77700d07c0 0x7f7770161920 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7768009d90 tx=0x7f776802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec883ddc1728277 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:32.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.099+0000 7f776e7fc640 1 -- 172.21.15.104:0/1050100407 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768031600 con 0x7f77700d07c0 2024-05-08T04:24:32.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.099+0000 7f776e7fc640 1 -- 172.21.15.104:0/1050100407 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77680317a0 con 0x7f77700d07c0 2024-05-08T04:24:32.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.099+0000 7f776e7fc640 1 -- 172.21.15.104:0/1050100407 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768031b70 con 0x7f77700d07c0 2024-05-08T04:24:32.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.100+0000 7f777554f640 1 -- 172.21.15.104:0/1050100407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77700d07c0 msgr2=0x7f7770161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.100+0000 7f777554f640 1 --2- 172.21.15.104:0/1050100407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77700d07c0 0x7f7770161920 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7768009d90 tx=0x7f776802a610 comp rx=0 tx=0).stop 2024-05-08T04:24:32.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.100+0000 7f777554f640 1 -- 172.21.15.104:0/1050100407 shutdown_connections 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.100+0000 7f777554f640 1 --2- 172.21.15.104:0/1050100407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77700d07c0 0x7f7770161920 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.100+0000 7f777554f640 1 -- 172.21.15.104:0/1050100407 >> 172.21.15.104:0/1050100407 conn(0x7f7770072290 msgr2=0x7f7770072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.100+0000 7f777554f640 1 -- 172.21.15.104:0/1050100407 shutdown_connections 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.100+0000 7f777554f640 1 -- 172.21.15.104:0/1050100407 wait complete. 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.101+0000 7f777554f640 1 Processor -- start 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.101+0000 7f777554f640 1 -- start start 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f777554f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77700ce5a0 0x7f77700c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f777554f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77700d07c0 0x7f77700c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f777554f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f777015de10 0x7f77700cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f777554f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77700d1a90 con 0x7f77700ce5a0 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f777554f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77700d1ce0 con 0x7f77700d07c0 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f777554f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77700b6dc0 con 0x7f777015de10 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f776effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77700ce5a0 0x7f77700c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f776effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77700ce5a0 0x7f77700c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57918/0 (socket says 172.21.15.104:57918) 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f776effd640 1 -- 172.21.15.104:0/1669131780 learned_addr learned my addr 172.21.15.104:0/1669131780 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f776effd640 1 -- 172.21.15.104:0/1669131780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f777015de10 msgr2=0x7f77700cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f776effd640 1 --2- 172.21.15.104:0/1669131780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f777015de10 0x7f77700cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f776effd640 1 -- 172.21.15.104:0/1669131780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77700d07c0 msgr2=0x7f77700c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f77667fc640 1 --2- 172.21.15.104:0/1669131780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77700d07c0 0x7f77700c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f776effd640 1 --2- 172.21.15.104:0/1669131780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77700d07c0 0x7f77700c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f776effd640 1 -- 172.21.15.104:0/1669131780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77700ca370 con 0x7f77700ce5a0 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.102+0000 7f776effd640 1 --2- 172.21.15.104:0/1669131780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77700ce5a0 0x7f77700c6440 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f776000b420 tx=0x7f776000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.103+0000 7f7767fff640 1 -- 172.21.15.104:0/1669131780 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760011830 con 0x7f77700ce5a0 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.103+0000 7f7767fff640 1 -- 172.21.15.104:0/1669131780 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7760016070 con 0x7f77700ce5a0 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.103+0000 7f7767fff640 1 -- 172.21.15.104:0/1669131780 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760011c10 con 0x7f77700ce5a0 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.103+0000 7f777554f640 1 -- 172.21.15.104:0/1669131780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77700ca090 con 0x7f77700ce5a0 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.103+0000 7f777554f640 1 -- 172.21.15.104:0/1669131780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777015e810 con 0x7f77700ce5a0 2024-05-08T04:24:32.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.104+0000 7f777554f640 1 -- 172.21.15.104:0/1669131780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777015c530 con 0x7f77700ce5a0 2024-05-08T04:24:32.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.104+0000 7f7767fff640 1 -- 172.21.15.104:0/1669131780 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f776001b460 con 0x7f77700ce5a0 2024-05-08T04:24:32.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.104+0000 7f7767fff640 1 --2- 172.21.15.104:0/1669131780 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f775006b680 0x7f775006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.105+0000 7f7767fff640 1 -- 172.21.15.104:0/1669131780 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7760089d90 con 0x7f77700ce5a0 2024-05-08T04:24:32.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.105+0000 7f77667fc640 1 --2- 172.21.15.104:0/1669131780 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f775006b680 0x7f775006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.105+0000 7f77667fc640 1 --2- 172.21.15.104:0/1669131780 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f775006b680 0x7f775006db40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7758007fd0 tx=0x7f7758009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:32.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.109+0000 7f7767fff640 1 -- 172.21.15.104:0/1669131780 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f777015c530 con 0x7f77700ce5a0 2024-05-08T04:24:32.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.278+0000 7f777554f640 1 -- 172.21.15.104:0/1669131780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7770075010 con 0x7f77700ce5a0 2024-05-08T04:24:32.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.279+0000 7f7767fff640 1 -- 172.21.15.104:0/1669131780 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7760020020 con 0x7f77700ce5a0 2024-05-08T04:24:32.280 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:24:32.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.281+0000 7f777554f640 1 -- 172.21.15.104:0/1669131780 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f775006b680 msgr2=0x7f775006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.281+0000 7f777554f640 1 --2- 172.21.15.104:0/1669131780 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f775006b680 0x7f775006db40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7758007fd0 tx=0x7f7758009040 comp rx=0 tx=0).stop 2024-05-08T04:24:32.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.281+0000 7f777554f640 1 -- 172.21.15.104:0/1669131780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77700ce5a0 msgr2=0x7f77700c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.281+0000 7f777554f640 1 --2- 172.21.15.104:0/1669131780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77700ce5a0 0x7f77700c6440 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f776000b420 tx=0x7f776000b8e0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.281+0000 7f777554f640 1 -- 172.21.15.104:0/1669131780 shutdown_connections 2024-05-08T04:24:32.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.281+0000 7f777554f640 1 --2- 172.21.15.104:0/1669131780 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f775006b680 0x7f775006db40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.281+0000 7f777554f640 1 --2- 172.21.15.104:0/1669131780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77700d07c0 0x7f77700c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.281+0000 7f777554f640 1 --2- 172.21.15.104:0/1669131780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f777015de10 0x7f77700cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.281+0000 7f777554f640 1 --2- 172.21.15.104:0/1669131780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f77700ce5a0 0x7f77700c6440 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.281+0000 7f777554f640 1 -- 172.21.15.104:0/1669131780 >> 172.21.15.104:0/1669131780 conn(0x7f7770072290 msgr2=0x7f7770159da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:32.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.281+0000 7f777554f640 1 -- 172.21.15.104:0/1669131780 shutdown_connections 2024-05-08T04:24:32.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.281+0000 7f777554f640 1 -- 172.21.15.104:0/1669131780 wait complete. 2024-05-08T04:24:32.293 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_dangling_symlink' 2024-05-08T04:24:32.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.390+0000 7f205f2dd640 1 Processor -- start 2024-05-08T04:24:32.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.390+0000 7f205f2dd640 1 -- start start 2024-05-08T04:24:32.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.391+0000 7f205f2dd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f20580ceee0 0x7f20580b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.391+0000 7f205f2dd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205815e780 con 0x7f20580b4700 2024-05-08T04:24:32.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.391+0000 7f205f2dd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205815ea60 con 0x7f205806e330 2024-05-08T04:24:32.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.391+0000 7f205f2dd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f205815f390 con 0x7f20580ceee0 2024-05-08T04:24:32.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.391+0000 7f205d87a640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f20580b4700 0x7f205815b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44882/0 (socket says 172.21.15.104:44882) 2024-05-08T04:24:32.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.391+0000 7f205d87a640 1 -- 172.21.15.104:0/1359593699 learned_addr learned my addr 172.21.15.104:0/1359593699 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:32.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.391+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369113624 0 0) 0x7f205815e780 con 0x7f20580b4700 2024-05-08T04:24:32.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.391+0000 7f205d079640 1 --2- 172.21.15.104:0/1359593699 >> v2:172.21.15.183:3300/0 conn(0x7f20580ceee0 0x7f20580b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.391+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2044005730 con 0x7f20580b4700 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2610351486 0 0) 0x7f2044005730 con 0x7f20580b4700 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 >> v2:172.21.15.183:3300/0 conn(0x7f20580ceee0 msgr2=0x7f20580b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f204ffff640 1 --2- 172.21.15.104:0/1359593699 >> v2:172.21.15.183:3300/0 conn(0x7f20580ceee0 0x7f20580b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 >> v1:172.21.15.183:6789/0 conn(0x7f205806e330 legacy=0x7f20580b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205815ed40 con 0x7f20580b4700 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f20500019f0 con 0x7f20580b4700 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 >> v1:172.21.15.104:6789/0 conn(0x7f20580b4700 legacy=0x7f205815b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f204ffff640 1 --2- 172.21.15.104:0/1359593699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044005bc0 0x7f2044005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f204ffff640 1 --2- 172.21.15.104:0/1359593699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2044006a10 0x7f2044006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f204ffff640 1 --2- 172.21.15.104:0/1359593699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20440073d0 0x7f204400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205815f390 con 0x7f2044006a10 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204400e270 con 0x7f2044005bc0 2024-05-08T04:24:32.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204400e470 con 0x7f20440073d0 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f205c878640 1 --2- 172.21.15.104:0/1359593699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2044006a10 0x7f2044006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f205d079640 1 --2- 172.21.15.104:0/1359593699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044005bc0 0x7f2044005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f205d87a640 1 --2- 172.21.15.104:0/1359593699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20440073d0 0x7f204400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f205c878640 1 -- 172.21.15.104:0/1359593699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20440073d0 msgr2=0x7f204400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f205c878640 1 --2- 172.21.15.104:0/1359593699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20440073d0 0x7f204400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f205c878640 1 -- 172.21.15.104:0/1359593699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044005bc0 msgr2=0x7f2044005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f205c878640 1 --2- 172.21.15.104:0/1359593699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044005bc0 0x7f2044005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f205c878640 1 -- 172.21.15.104:0/1359593699 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2044005730 con 0x7f2044006a10 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f205d87a640 1 --2- 172.21.15.104:0/1359593699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20440073d0 0x7f204400dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.392+0000 7f205d87a640 1 -- 172.21.15.104:0/1359593699 reap_dead start 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.393+0000 7f205c878640 1 --2- 172.21.15.104:0/1359593699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2044006a10 0x7f2044006e90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2048001750 tx=0x7f2044007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56f3e49df0bad48 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.393+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048001370 con 0x7f2044006a10 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.393+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20480052d0 con 0x7f2044006a10 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.393+0000 7f204ffff640 1 -- 172.21.15.104:0/1359593699 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204802abc0 con 0x7f2044006a10 2024-05-08T04:24:32.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.393+0000 7f205f2dd640 1 -- 172.21.15.104:0/1359593699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2044006a10 msgr2=0x7f2044006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.393+0000 7f205f2dd640 1 --2- 172.21.15.104:0/1359593699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2044006a10 0x7f2044006e90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2048001750 tx=0x7f2044007a40 comp rx=0 tx=0).stop 2024-05-08T04:24:32.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.394+0000 7f205f2dd640 1 -- 172.21.15.104:0/1359593699 shutdown_connections 2024-05-08T04:24:32.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.394+0000 7f205f2dd640 1 --2- 172.21.15.104:0/1359593699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2044006a10 0x7f2044006e90 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.394+0000 7f205f2dd640 1 -- 172.21.15.104:0/1359593699 >> 172.21.15.104:0/1359593699 conn(0x7f20580b13f0 msgr2=0x7f20580b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:32.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.394+0000 7f205f2dd640 1 -- 172.21.15.104:0/1359593699 shutdown_connections 2024-05-08T04:24:32.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.394+0000 7f205f2dd640 1 -- 172.21.15.104:0/1359593699 wait complete. 2024-05-08T04:24:32.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.395+0000 7f205f2dd640 1 Processor -- start 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.395+0000 7f205f2dd640 1 -- start start 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205f2dd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044006a10 0x7f2058154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205f2dd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20581f7780 0x7f205814c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205f2dd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2058154c60 0x7f20580ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205f2dd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20580cf440 con 0x7f20581f7780 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205f2dd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20580cf2c0 con 0x7f2044006a10 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205f2dd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20580b26f0 con 0x7f2058154c60 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205c878640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20581f7780 0x7f205814c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205c878640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20581f7780 0x7f205814c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57926/0 (socket says 172.21.15.104:57926) 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205c878640 1 -- 172.21.15.104:0/59514885 learned_addr learned my addr 172.21.15.104:0/59514885 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205c878640 1 -- 172.21.15.104:0/59514885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2058154c60 msgr2=0x7f20580ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205c878640 1 --2- 172.21.15.104:0/59514885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2058154c60 0x7f20580ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205c878640 1 -- 172.21.15.104:0/59514885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044006a10 msgr2=0x7f2058154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205c878640 1 --2- 172.21.15.104:0/59514885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044006a10 0x7f2058154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205c878640 1 -- 172.21.15.104:0/59514885 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205814cbc0 con 0x7f20581f7780 2024-05-08T04:24:32.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205c878640 1 --2- 172.21.15.104:0/59514885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20581f7780 0x7f205814c680 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2048001870 tx=0x7f2048001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:32.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f204dffb640 1 -- 172.21.15.104:0/59514885 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204803f030 con 0x7f20581f7780 2024-05-08T04:24:32.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f204dffb640 1 -- 172.21.15.104:0/59514885 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2048005480 con 0x7f20581f7780 2024-05-08T04:24:32.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f204dffb640 1 -- 172.21.15.104:0/59514885 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048037040 con 0x7f20581f7780 2024-05-08T04:24:32.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205f2dd640 1 -- 172.21.15.104:0/59514885 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20581554b0 con 0x7f20581f7780 2024-05-08T04:24:32.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.396+0000 7f205f2dd640 1 -- 172.21.15.104:0/59514885 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20581f6f80 con 0x7f20581f7780 2024-05-08T04:24:32.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.397+0000 7f205f2dd640 1 -- 172.21.15.104:0/59514885 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2058075010 con 0x7f20581f7780 2024-05-08T04:24:32.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.398+0000 7f204dffb640 1 -- 172.21.15.104:0/59514885 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f2048042070 con 0x7f20581f7780 2024-05-08T04:24:32.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.398+0000 7f204dffb640 1 --2- 172.21.15.104:0/59514885 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f203c06b680 0x7f203c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.398+0000 7f204dffb640 1 -- 172.21.15.104:0/59514885 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2048007640 con 0x7f20581f7780 2024-05-08T04:24:32.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.398+0000 7f205d079640 1 --2- 172.21.15.104:0/59514885 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f203c06b680 0x7f203c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.399+0000 7f205d079640 1 --2- 172.21.15.104:0/59514885 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f203c06b680 0x7f203c06db40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2054006e80 tx=0x7f2054006df0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:32.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.402+0000 7f204dffb640 1 -- 172.21.15.104:0/59514885 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f20480787e0 con 0x7f20581f7780 2024-05-08T04:24:32.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.636+0000 7f205f2dd640 1 -- 172.21.15.104:0/59514885 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_dangling_symlink"]} v 0) v1 -- 0x7f205806f3f0 con 0x7f20581f7780 2024-05-08T04:24:32.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.685+0000 7f204dffb640 1 -- 172.21.15.104:0/59514885 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_dangling_symlink"]}]=0 v187) v1 ==== 138+0+0 (secure 0 0 0) 0x7f20480780e0 con 0x7f20581f7780 2024-05-08T04:24:32.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.687+0000 7f205f2dd640 1 -- 172.21.15.104:0/59514885 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f203c06b680 msgr2=0x7f203c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.687+0000 7f205f2dd640 1 --2- 172.21.15.104:0/59514885 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f203c06b680 0x7f203c06db40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2054006e80 tx=0x7f2054006df0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.687+0000 7f205f2dd640 1 -- 172.21.15.104:0/59514885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20581f7780 msgr2=0x7f205814c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.687+0000 7f205f2dd640 1 --2- 172.21.15.104:0/59514885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20581f7780 0x7f205814c680 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2048001870 tx=0x7f2048001120 comp rx=0 tx=0).stop 2024-05-08T04:24:32.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.687+0000 7f205f2dd640 1 -- 172.21.15.104:0/59514885 shutdown_connections 2024-05-08T04:24:32.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.687+0000 7f205f2dd640 1 --2- 172.21.15.104:0/59514885 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f203c06b680 0x7f203c06db40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.687+0000 7f205f2dd640 1 --2- 172.21.15.104:0/59514885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2058154c60 0x7f20580ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.687+0000 7f205f2dd640 1 --2- 172.21.15.104:0/59514885 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f20581f7780 0x7f205814c680 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.687+0000 7f205f2dd640 1 --2- 172.21.15.104:0/59514885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044006a10 0x7f2058154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.687+0000 7f205f2dd640 1 -- 172.21.15.104:0/59514885 >> 172.21.15.104:0/59514885 conn(0x7f20580b13f0 msgr2=0x7f2058071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:32.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.688+0000 7f205f2dd640 1 -- 172.21.15.104:0/59514885 shutdown_connections 2024-05-08T04:24:32.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.688+0000 7f205f2dd640 1 -- 172.21.15.104:0/59514885 wait complete. 2024-05-08T04:24:32.700 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-08T04:24:32.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.800+0000 7f097346f640 1 Processor -- start 2024-05-08T04:24:32.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.800+0000 7f097346f640 1 -- start start 2024-05-08T04:24:32.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.801+0000 7f097346f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f096c070c70 0x7f096c071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.801+0000 7f097346f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f096c157ac0 0x7f096c157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.801+0000 7f097346f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f096c071590 con 0x7f096c15edf0 2024-05-08T04:24:32.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.801+0000 7f097346f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f096c06bc70 con 0x7f096c070c70 2024-05-08T04:24:32.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.801+0000 7f097346f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096c0d15c0 con 0x7f096c157ac0 2024-05-08T04:24:32.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.802+0000 7f097120b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f096c070c70 0x7f096c071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.802+0000 7f0971a0c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f096c157ac0 0x7f096c157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.802+0000 7f0970a0a640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f096c15edf0 0x7f096c0b52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:44574/0 (socket says 172.21.15.104:44574) 2024-05-08T04:24:32.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.802+0000 7f0970a0a640 1 -- 172.21.15.104:0/3569284204 learned_addr learned my addr 172.21.15.104:0/3569284204 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:32.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.802+0000 7f097120b640 1 -- 172.21.15.104:0/3569284204 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f096c157ac0 msgr2=0x7f096c157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:32.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.802+0000 7f097120b640 1 --2- 172.21.15.104:0/3569284204 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f096c157ac0 0x7f096c157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.802+0000 7f097120b640 1 -- 172.21.15.104:0/3569284204 >> v1:172.21.15.183:6789/0 conn(0x7f096c15edf0 legacy=0x7f096c0b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.802+0000 7f097120b640 1 -- 172.21.15.104:0/3569284204 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c15f550 con 0x7f096c070c70 2024-05-08T04:24:32.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.803+0000 7f097120b640 1 --2- 172.21.15.104:0/3569284204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f096c070c70 0x7f096c071050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09680097a0 tx=0x7f096802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=965cfc250be9f5e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:32.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.803+0000 7f0963fff640 1 -- 172.21.15.104:0/3569284204 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968037070 con 0x7f096c070c70 2024-05-08T04:24:32.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.803+0000 7f0963fff640 1 -- 172.21.15.104:0/3569284204 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0968032440 con 0x7f096c070c70 2024-05-08T04:24:32.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.803+0000 7f0963fff640 1 -- 172.21.15.104:0/3569284204 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968032810 con 0x7f096c070c70 2024-05-08T04:24:32.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.804+0000 7f097346f640 1 -- 172.21.15.104:0/3569284204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f096c070c70 msgr2=0x7f096c071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.804+0000 7f097346f640 1 --2- 172.21.15.104:0/3569284204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f096c070c70 0x7f096c071050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09680097a0 tx=0x7f096802a180 comp rx=0 tx=0).stop 2024-05-08T04:24:32.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.804+0000 7f097346f640 1 -- 172.21.15.104:0/3569284204 shutdown_connections 2024-05-08T04:24:32.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.804+0000 7f097346f640 1 --2- 172.21.15.104:0/3569284204 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f096c157ac0 0x7f096c157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.804+0000 7f097346f640 1 --2- 172.21.15.104:0/3569284204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f096c070c70 0x7f096c071050 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.804+0000 7f097346f640 1 -- 172.21.15.104:0/3569284204 >> 172.21.15.104:0/3569284204 conn(0x7f096c0b3450 msgr2=0x7f096c0b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:32.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.804+0000 7f097346f640 1 -- 172.21.15.104:0/3569284204 shutdown_connections 2024-05-08T04:24:32.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.804+0000 7f097346f640 1 -- 172.21.15.104:0/3569284204 wait complete. 2024-05-08T04:24:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.805+0000 7f097346f640 1 Processor -- start 2024-05-08T04:24:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.805+0000 7f097346f640 1 -- start start 2024-05-08T04:24:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f097346f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f096c070c70 0x7f096c1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f097346f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096c157ac0 0x7f096c1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f097346f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f096c15edf0 0x7f096c1f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f097346f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096c0b5b80 con 0x7f096c157ac0 2024-05-08T04:24:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f097346f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096c15fb10 con 0x7f096c070c70 2024-05-08T04:24:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f097346f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096c158490 con 0x7f096c15edf0 2024-05-08T04:24:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f0970a0a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096c157ac0 0x7f096c1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f0970a0a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096c157ac0 0x7f096c1548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57936/0 (socket says 172.21.15.104:57936) 2024-05-08T04:24:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f0970a0a640 1 -- 172.21.15.104:0/1685546487 learned_addr learned my addr 172.21.15.104:0/1685546487 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f0971a0c640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f096c15edf0 0x7f096c1f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f097120b640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f096c070c70 0x7f096c1543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f0970a0a640 1 -- 172.21.15.104:0/1685546487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f096c15edf0 msgr2=0x7f096c1f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f0970a0a640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f096c15edf0 0x7f096c1f4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f0970a0a640 1 -- 172.21.15.104:0/1685546487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f096c070c70 msgr2=0x7f096c1543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f0970a0a640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f096c070c70 0x7f096c1543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f0970a0a640 1 -- 172.21.15.104:0/1685546487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c1617a0 con 0x7f096c157ac0 2024-05-08T04:24:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f0970a0a640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096c157ac0 0x7f096c1548f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f095c00c3f0 tx=0x7f095c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f0961ffb640 1 -- 172.21.15.104:0/1685546487 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c017070 con 0x7f096c157ac0 2024-05-08T04:24:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f0961ffb640 1 -- 172.21.15.104:0/1685546487 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c005ce0 con 0x7f096c157ac0 2024-05-08T04:24:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f097346f640 1 -- 172.21.15.104:0/1685546487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f096c154e30 con 0x7f096c157ac0 2024-05-08T04:24:32.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.806+0000 7f0961ffb640 1 -- 172.21.15.104:0/1685546487 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c0072d0 con 0x7f096c157ac0 2024-05-08T04:24:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.807+0000 7f097346f640 1 -- 172.21.15.104:0/1685546487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096c1553c0 con 0x7f096c157ac0 2024-05-08T04:24:32.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.807+0000 7f097346f640 1 -- 172.21.15.104:0/1685546487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096c075010 con 0x7f096c157ac0 2024-05-08T04:24:32.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.808+0000 7f0961ffb640 1 -- 172.21.15.104:0/1685546487 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f095c01a070 con 0x7f096c157ac0 2024-05-08T04:24:32.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.808+0000 7f0961ffb640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f095006b680 0x7f095006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:32.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.809+0000 7f097120b640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f095006b680 0x7f095006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:32.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.809+0000 7f0961ffb640 1 -- 172.21.15.104:0/1685546487 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f095c089400 con 0x7f096c157ac0 2024-05-08T04:24:32.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.809+0000 7f097120b640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f095006b680 0x7f095006db40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0968034000 tx=0x7f096802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:32.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.813+0000 7f0961ffb640 1 -- 172.21.15.104:0/1685546487 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f095c057cb0 con 0x7f096c157ac0 2024-05-08T04:24:32.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.981+0000 7f097346f640 1 -- 172.21.15.104:0/1685546487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f096c071a50 con 0x7f096c157ac0 2024-05-08T04:24:32.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.984+0000 7f0961ffb640 1 -- 172.21.15.104:0/1685546487 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f095c05bd50 con 0x7f096c157ac0 2024-05-08T04:24:32.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.986+0000 7f097346f640 1 -- 172.21.15.104:0/1685546487 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f095006b680 msgr2=0x7f095006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.986+0000 7f097346f640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f095006b680 0x7f095006db40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0968034000 tx=0x7f096802e000 comp rx=0 tx=0).stop 2024-05-08T04:24:32.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.986+0000 7f097346f640 1 -- 172.21.15.104:0/1685546487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096c157ac0 msgr2=0x7f096c1548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:32.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.986+0000 7f097346f640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096c157ac0 0x7f096c1548f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f095c00c3f0 tx=0x7f095c00c8b0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.986+0000 7f097346f640 1 -- 172.21.15.104:0/1685546487 shutdown_connections 2024-05-08T04:24:32.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.986+0000 7f097346f640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f095006b680 0x7f095006db40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.986+0000 7f097346f640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f096c15edf0 0x7f096c1f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.986+0000 7f097346f640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f096c157ac0 0x7f096c1548f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.986+0000 7f097346f640 1 --2- 172.21.15.104:0/1685546487 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f096c070c70 0x7f096c1543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:32.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.986+0000 7f097346f640 1 -- 172.21.15.104:0/1685546487 >> 172.21.15.104:0/1685546487 conn(0x7f096c0b3450 msgr2=0x7f096c150450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:32.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.986+0000 7f097346f640 1 -- 172.21.15.104:0/1685546487 shutdown_connections 2024-05-08T04:24:32.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:32.986+0000 7f097346f640 1 -- 172.21.15.104:0/1685546487 wait complete. 2024-05-08T04:24:32.998 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-08T04:24:32.998 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T04:24:33.032 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T04:24:33.080 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-08T04:24:33.081 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:24:33.081 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:24:33.097 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=587 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T04:24:33.097 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:24:33.097 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:24:33.115 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13681 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T04:24:33.116 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:24:33.116 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:24:33.153 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=587 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T04:24:33.153 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:24:33.153 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:24:33.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13681 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T04:24:33.175 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-08T04:24:33.175 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:33.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.290+0000 7f296d62c640 1 Processor -- start 2024-05-08T04:24:33.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.290+0000 7f296d62c640 1 -- start start 2024-05-08T04:24:33.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.291+0000 7f296d62c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f296815ba10 0x7f2968099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:33.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.291+0000 7f296d62c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296815ee90 0x7f29680cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:33.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.291+0000 7f296d62c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f29680d0320 0x7f29680b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:33.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.291+0000 7f296d62c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29680d0790 con 0x7f29680d0320 2024-05-08T04:24:33.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.291+0000 7f296d62c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29680cc5d0 con 0x7f296815ba10 2024-05-08T04:24:33.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.291+0000 7f296d62c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296809a340 con 0x7f296815ee90 2024-05-08T04:24:33.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.291+0000 7f29677fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f29680d0320 0x7f29680b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:33.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.291+0000 7f29677fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f29680d0320 0x7f29680b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57946/0 (socket says 172.21.15.104:57946) 2024-05-08T04:24:33.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.291+0000 7f29677fe640 1 -- 172.21.15.104:0/3168024546 learned_addr learned my addr 172.21.15.104:0/3168024546 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:33.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.292+0000 7f29677fe640 1 -- 172.21.15.104:0/3168024546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296815ee90 msgr2=0x7f29680cfde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T04:24:33.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.292+0000 7f29677fe640 1 --2- 172.21.15.104:0/3168024546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296815ee90 0x7f29680cfde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.292+0000 7f29677fe640 1 -- 172.21.15.104:0/3168024546 >> v2:172.21.15.183:3300/0 conn(0x7f296815ba10 msgr2=0x7f2968099a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T04:24:33.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.292+0000 7f29677fe640 1 --2- 172.21.15.104:0/3168024546 >> v2:172.21.15.183:3300/0 conn(0x7f296815ba10 0x7f2968099a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.292+0000 7f29677fe640 1 -- 172.21.15.104:0/3168024546 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296809a620 con 0x7f29680d0320 2024-05-08T04:24:33.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.292+0000 7f29677fe640 1 --2- 172.21.15.104:0/3168024546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29680d0320 0x7f29680b24c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f29680b3fa0 tx=0x7f296002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7fbfc4dc0fff4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:33.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.292+0000 7f29667fc640 1 -- 172.21.15.104:0/3168024546 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960036070 con 0x7f29680d0320 2024-05-08T04:24:33.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.292+0000 7f29667fc640 1 -- 172.21.15.104:0/3168024546 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960031600 con 0x7f29680d0320 2024-05-08T04:24:33.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.293+0000 7f29667fc640 1 -- 172.21.15.104:0/3168024546 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29600319d0 con 0x7f29680d0320 2024-05-08T04:24:33.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.293+0000 7f296d62c640 1 -- 172.21.15.104:0/3168024546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29680d0320 msgr2=0x7f29680b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:33.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.293+0000 7f296d62c640 1 --2- 172.21.15.104:0/3168024546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29680d0320 0x7f29680b24c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f29680b3fa0 tx=0x7f296002a6d0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.293+0000 7f296d62c640 1 -- 172.21.15.104:0/3168024546 shutdown_connections 2024-05-08T04:24:33.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.293+0000 7f296d62c640 1 --2- 172.21.15.104:0/3168024546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29680d0320 0x7f29680b24c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.293+0000 7f296d62c640 1 --2- 172.21.15.104:0/3168024546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296815ee90 0x7f29680cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.293+0000 7f296d62c640 1 --2- 172.21.15.104:0/3168024546 >> v2:172.21.15.183:3300/0 conn(0x7f296815ba10 0x7f2968099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.293+0000 7f296d62c640 1 -- 172.21.15.104:0/3168024546 >> 172.21.15.104:0/3168024546 conn(0x7f29680b3280 msgr2=0x7f29680b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:33.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.293+0000 7f296d62c640 1 -- 172.21.15.104:0/3168024546 shutdown_connections 2024-05-08T04:24:33.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.293+0000 7f296d62c640 1 -- 172.21.15.104:0/3168024546 wait complete. 2024-05-08T04:24:33.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.294+0000 7f296d62c640 1 Processor -- start 2024-05-08T04:24:33.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.294+0000 7f296d62c640 1 -- start start 2024-05-08T04:24:33.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f296d62c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29680d0320 0x7f29680cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:33.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f296d62c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f296815ba10 0x7f2968150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:33.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f296d62c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296815ee90 0x7f29680cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:33.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f296d62c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2968099f80 con 0x7f29680d0320 2024-05-08T04:24:33.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f296d62c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29680cc870 con 0x7f296815ba10 2024-05-08T04:24:33.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f296d62c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296809a100 con 0x7f296815ee90 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f2966ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29680d0320 0x7f29680cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f2966ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29680d0320 0x7f29680cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57948/0 (socket says 172.21.15.104:57948) 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f2966ffd640 1 -- 172.21.15.104:0/528389734 learned_addr learned my addr 172.21.15.104:0/528389734 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f2966ffd640 1 -- 172.21.15.104:0/528389734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296815ee90 msgr2=0x7f29680cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f2966ffd640 1 --2- 172.21.15.104:0/528389734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296815ee90 0x7f29680cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f2966ffd640 1 -- 172.21.15.104:0/528389734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f296815ba10 msgr2=0x7f2968150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f2966ffd640 1 --2- 172.21.15.104:0/528389734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f296815ba10 0x7f2968150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.295+0000 7f2966ffd640 1 -- 172.21.15.104:0/528389734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29680c98b0 con 0x7f29680d0320 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.296+0000 7f2966ffd640 1 --2- 172.21.15.104:0/528389734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29680d0320 0x7f29680cac10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f295800b3c0 tx=0x7f295800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.296+0000 7f295ffff640 1 -- 172.21.15.104:0/528389734 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958005920 con 0x7f29680d0320 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.296+0000 7f295ffff640 1 -- 172.21.15.104:0/528389734 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2958005ae0 con 0x7f29680d0320 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.296+0000 7f296d62c640 1 -- 172.21.15.104:0/528389734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29680c9b70 con 0x7f29680d0320 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.296+0000 7f295ffff640 1 -- 172.21.15.104:0/528389734 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958006020 con 0x7f29680d0320 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.296+0000 7f296d62c640 1 -- 172.21.15.104:0/528389734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29680ca130 con 0x7f29680d0320 2024-05-08T04:24:33.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.297+0000 7f296d62c640 1 -- 172.21.15.104:0/528389734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2968075010 con 0x7f29680d0320 2024-05-08T04:24:33.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.297+0000 7f295ffff640 1 -- 172.21.15.104:0/528389734 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f2958018020 con 0x7f29680d0320 2024-05-08T04:24:33.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.298+0000 7f295ffff640 1 --2- 172.21.15.104:0/528389734 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f294806b680 0x7f294806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:33.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.298+0000 7f295ffff640 1 -- 172.21.15.104:0/528389734 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2958089790 con 0x7f29680d0320 2024-05-08T04:24:33.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.298+0000 7f295e7fc640 1 --2- 172.21.15.104:0/528389734 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f294806b680 0x7f294806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:33.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.298+0000 7f295e7fc640 1 --2- 172.21.15.104:0/528389734 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f294806b680 0x7f294806db40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f29500096f0 tx=0x7f2950006c40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:33.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.302+0000 7f295ffff640 1 -- 172.21.15.104:0/528389734 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2958058720 con 0x7f29680d0320 2024-05-08T04:24:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.509+0000 7f296d62c640 1 -- 172.21.15.104:0/528389734 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29680cfbc0 con 0x7f29680d0320 2024-05-08T04:24:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.510+0000 7f295ffff640 1 -- 172.21.15.104:0/528389734 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f2958058020 con 0x7f29680d0320 2024-05-08T04:24:33.511 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:33.512 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2330852483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2330852483},{"type":"v1","addr":"172.21.15.183:6834","nonce":2330852483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5066,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/344783045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":344783045},{"type":"v1","addr":"172.21.15.183:6835","nonce":344783045}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":5739,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6836/3034058693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3034058693},{"type":"v1","addr":"172.21.15.104:6836","nonce":3034058693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18},{"gid":6288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/78331134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6835","nonce":78331134},{"type":"v1","addr":"172.21.15.104:6837","nonce":78331134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[]} 2024-05-08T04:24:33.512 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 24 2024-05-08T04:24:33.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.512+0000 7f296d62c640 1 -- 172.21.15.104:0/528389734 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f294806b680 msgr2=0x7f294806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:33.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.512+0000 7f296d62c640 1 --2- 172.21.15.104:0/528389734 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f294806b680 0x7f294806db40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f29500096f0 tx=0x7f2950006c40 comp rx=0 tx=0).stop 2024-05-08T04:24:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.512+0000 7f296d62c640 1 -- 172.21.15.104:0/528389734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29680d0320 msgr2=0x7f29680cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.512+0000 7f296d62c640 1 --2- 172.21.15.104:0/528389734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29680d0320 0x7f29680cac10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f295800b3c0 tx=0x7f295800b880 comp rx=0 tx=0).stop 2024-05-08T04:24:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.512+0000 7f296d62c640 1 -- 172.21.15.104:0/528389734 shutdown_connections 2024-05-08T04:24:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.512+0000 7f296d62c640 1 --2- 172.21.15.104:0/528389734 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f294806b680 0x7f294806db40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.512+0000 7f296d62c640 1 --2- 172.21.15.104:0/528389734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f296815ba10 0x7f2968150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.512+0000 7f296d62c640 1 --2- 172.21.15.104:0/528389734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296815ee90 0x7f29680cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.512+0000 7f296d62c640 1 --2- 172.21.15.104:0/528389734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29680d0320 0x7f29680cac10 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.512+0000 7f296d62c640 1 -- 172.21.15.104:0/528389734 >> 172.21.15.104:0/528389734 conn(0x7f29680b3280 msgr2=0x7f296806f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.512+0000 7f296d62c640 1 -- 172.21.15.104:0/528389734 shutdown_connections 2024-05-08T04:24:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.512+0000 7f296d62c640 1 -- 172.21.15.104:0/528389734 wait complete. 2024-05-08T04:24:33.524 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T04:24:33.524 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-08T04:24:33.525 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T04:24:33.525 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:24:33.525 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T04:24:33.525 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-08T04:24:33.525 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T04:24:33.525 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:24:33.526 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T04:24:33.526 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-08T04:24:33.526 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T04:24:33.526 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:24:33.526 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T04:24:33.526 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-08T04:24:33.527 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T04:24:33.527 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:24:33.534 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T04:24:33.535 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T04:24:33.535 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T04:24:33.536 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T04:24:33.539 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T04:24:33.539 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T04:24:33.540 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T04:24:33.540 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T04:24:33.577 INFO:tasks.ceph.mds.a:Started 2024-05-08T04:24:33.577 DEBUG:teuthology.parallel:result is None 2024-05-08T04:24:33.578 INFO:tasks.ceph.mds.c:Started 2024-05-08T04:24:33.578 DEBUG:teuthology.parallel:result is None 2024-05-08T04:24:33.581 INFO:tasks.ceph.mds.b:Started 2024-05-08T04:24:33.582 DEBUG:teuthology.parallel:result is None 2024-05-08T04:24:33.582 INFO:tasks.ceph.mds.d:Started 2024-05-08T04:24:33.585 DEBUG:teuthology.parallel:result is None 2024-05-08T04:24:33.586 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-08T04:24:33.653 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-05-08T04:24:33.653 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-05-08T04:24:33.667 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2024-05-08T04:24:33.667 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2024-05-08T04:24:33.668 INFO:tasks.ceph.mds.b.smithi183.stderr:2024-05-08T04:24:33.666+0000 7ff356d86640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-05-08T04:24:33.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.690+0000 7f3858b02640 1 Processor -- start 2024-05-08T04:24:33.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.690+0000 7f3858b02640 1 -- start start 2024-05-08T04:24:33.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.691+0000 7f3858b02640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f385415ab50 0x7f38540cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:33.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.691+0000 7f3858b02640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38540ca5d0 con 0x7f38540cc470 2024-05-08T04:24:33.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.691+0000 7f3858b02640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385406bda0 con 0x7f38540aeac0 2024-05-08T04:24:33.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.691+0000 7f3858b02640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38540ce850 con 0x7f385415ab50 2024-05-08T04:24:33.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.691+0000 7f385259c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f385415ab50 0x7f38540cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:33.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.691+0000 7f385259c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f385415ab50 0x7f38540cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57984/0 (socket says 172.21.15.104:57984) 2024-05-08T04:24:33.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.691+0000 7f385259c640 1 -- 172.21.15.104:0/2683954644 learned_addr learned my addr 172.21.15.104:0/2683954644 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:33.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.691+0000 7f384bfff640 1 --1- 172.21.15.104:0/2683954644 >> v1:172.21.15.104:6789/0 conn(0x7f38540cc470 0x7f38540cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44906/0 (socket says 172.21.15.104:44906) 2024-05-08T04:24:33.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.691+0000 7f385259c640 1 -- 172.21.15.104:0/2683954644 >> v1:172.21.15.183:6789/0 conn(0x7f38540aeac0 legacy=0x7f38540cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:33.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.691+0000 7f385259c640 1 -- 172.21.15.104:0/2683954644 >> v1:172.21.15.104:6789/0 conn(0x7f38540cc470 legacy=0x7f38540cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:33.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.691+0000 7f385259c640 1 -- 172.21.15.104:0/2683954644 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385406c080 con 0x7f385415ab50 2024-05-08T04:24:33.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.692+0000 7f385259c640 1 --2- 172.21.15.104:0/2683954644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f385415ab50 0x7f38540cd9d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f384400bb10 tx=0x7f384402c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71039085fdfe14e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:33.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.695+0000 7f3851d9b640 1 -- 172.21.15.104:0/2683954644 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844033640 con 0x7f385415ab50 2024-05-08T04:24:33.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.695+0000 7f3851d9b640 1 -- 172.21.15.104:0/2683954644 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3844038070 con 0x7f385415ab50 2024-05-08T04:24:33.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.695+0000 7f3851d9b640 1 -- 172.21.15.104:0/2683954644 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844033a00 con 0x7f385415ab50 2024-05-08T04:24:33.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.696+0000 7f3858b02640 1 -- 172.21.15.104:0/2683954644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f385415ab50 msgr2=0x7f38540cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:33.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.696+0000 7f3858b02640 1 --2- 172.21.15.104:0/2683954644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f385415ab50 0x7f38540cd9d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f384400bb10 tx=0x7f384402c8b0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.696+0000 7f3858b02640 1 -- 172.21.15.104:0/2683954644 shutdown_connections 2024-05-08T04:24:33.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.696+0000 7f3858b02640 1 --2- 172.21.15.104:0/2683954644 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f385415ab50 0x7f38540cd9d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.696+0000 7f3858b02640 1 -- 172.21.15.104:0/2683954644 >> 172.21.15.104:0/2683954644 conn(0x7f38540cc880 msgr2=0x7f38540ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:33.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.696+0000 7f3858b02640 1 -- 172.21.15.104:0/2683954644 shutdown_connections 2024-05-08T04:24:33.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.696+0000 7f3858b02640 1 -- 172.21.15.104:0/2683954644 wait complete. 2024-05-08T04:24:33.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.698+0000 7f3858b02640 1 Processor -- start 2024-05-08T04:24:33.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.698+0000 7f3858b02640 1 -- start start 2024-05-08T04:24:33.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3858b02640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38540aeac0 0x7f38541555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:33.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3858b02640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38540cc470 0x7f38540b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:33.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3858b02640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f385415ab50 0x7f38540af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:33.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3858b02640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540acd80 con 0x7f385415ab50 2024-05-08T04:24:33.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3858b02640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540ca8b0 con 0x7f38540aeac0 2024-05-08T04:24:33.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3858b02640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38540acf00 con 0x7f38540cc470 2024-05-08T04:24:33.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3852d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f385415ab50 0x7f38540af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:33.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f384bfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38540cc470 0x7f38540b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:33.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f385259c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38540aeac0 0x7f38541555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:33.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3852d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f385415ab50 0x7f38540af8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:57994/0 (socket says 172.21.15.104:57994) 2024-05-08T04:24:33.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f384bfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38540cc470 0x7f38540b5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:40060/0 (socket says 172.21.15.104:40060) 2024-05-08T04:24:33.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3852d9d640 1 -- 172.21.15.104:0/2678424178 learned_addr learned my addr 172.21.15.104:0/2678424178 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:33.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3852d9d640 1 -- 172.21.15.104:0/2678424178 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38540cc470 msgr2=0x7f38540b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:33.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3852d9d640 1 --2- 172.21.15.104:0/2678424178 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38540cc470 0x7f38540b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3852d9d640 1 -- 172.21.15.104:0/2678424178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38540aeac0 msgr2=0x7f38541555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:33.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3852d9d640 1 --2- 172.21.15.104:0/2678424178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38540aeac0 0x7f38541555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:33.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3852d9d640 1 -- 172.21.15.104:0/2678424178 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385415be20 con 0x7f385415ab50 2024-05-08T04:24:33.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3852d9d640 1 --2- 172.21.15.104:0/2678424178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f385415ab50 0x7f38540af8a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f384c00c730 tx=0x7f384c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:33.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f384affd640 1 -- 172.21.15.104:0/2678424178 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c016020 con 0x7f385415ab50 2024-05-08T04:24:33.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f384affd640 1 -- 172.21.15.104:0/2678424178 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c006d50 con 0x7f385415ab50 2024-05-08T04:24:33.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f384affd640 1 -- 172.21.15.104:0/2678424178 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c003bb0 con 0x7f385415ab50 2024-05-08T04:24:33.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.699+0000 7f3858b02640 1 -- 172.21.15.104:0/2678424178 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385415b2a0 con 0x7f385415ab50 2024-05-08T04:24:33.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.700+0000 7f3858b02640 1 -- 172.21.15.104:0/2678424178 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385415b860 con 0x7f385415ab50 2024-05-08T04:24:33.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.701+0000 7f3858b02640 1 -- 172.21.15.104:0/2678424178 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38540c7990 con 0x7f385415ab50 2024-05-08T04:24:33.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.701+0000 7f384affd640 1 -- 172.21.15.104:0/2678424178 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f384c00a7f0 con 0x7f385415ab50 2024-05-08T04:24:33.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.701+0000 7f384affd640 1 --2- 172.21.15.104:0/2678424178 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f383406b680 0x7f383406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:33.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.702+0000 7f385259c640 1 --2- 172.21.15.104:0/2678424178 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f383406b680 0x7f383406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:33.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.702+0000 7f384affd640 1 -- 172.21.15.104:0/2678424178 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f384c089cc0 con 0x7f385415ab50 2024-05-08T04:24:33.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.702+0000 7f385259c640 1 --2- 172.21.15.104:0/2678424178 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f383406b680 0x7f383406db40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3844037000 tx=0x7f384403e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:33.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.707+0000 7f384affd640 1 -- 172.21.15.104:0/2678424178 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f384c020020 con 0x7f385415ab50 2024-05-08T04:24:33.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:33.886+0000 7f3858b02640 1 -- 172.21.15.104:0/2678424178 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3854075010 con 0x7f385415ab50 2024-05-08T04:24:34.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.704+0000 7f384affd640 1 -- 172.21.15.104:0/2678424178 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v55) v1 ==== 97+0+0 (secure 0 0 0) 0x7f384c058600 con 0x7f385415ab50 2024-05-08T04:24:34.705 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-05-08T04:24:34.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.707+0000 7f3858b02640 1 -- 172.21.15.104:0/2678424178 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f383406b680 msgr2=0x7f383406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:34.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.707+0000 7f3858b02640 1 --2- 172.21.15.104:0/2678424178 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f383406b680 0x7f383406db40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3844037000 tx=0x7f384403e040 comp rx=0 tx=0).stop 2024-05-08T04:24:34.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.707+0000 7f3858b02640 1 -- 172.21.15.104:0/2678424178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f385415ab50 msgr2=0x7f38540af8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:34.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.707+0000 7f3858b02640 1 --2- 172.21.15.104:0/2678424178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f385415ab50 0x7f38540af8a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f384c00c730 tx=0x7f384c00cbf0 comp rx=0 tx=0).stop 2024-05-08T04:24:34.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.707+0000 7f3858b02640 1 -- 172.21.15.104:0/2678424178 shutdown_connections 2024-05-08T04:24:34.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.707+0000 7f3858b02640 1 --2- 172.21.15.104:0/2678424178 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f383406b680 0x7f383406db40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:34.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.707+0000 7f3858b02640 1 --2- 172.21.15.104:0/2678424178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f385415ab50 0x7f38540af8a0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:34.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.707+0000 7f3858b02640 1 --2- 172.21.15.104:0/2678424178 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38540cc470 0x7f38540b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:34.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.707+0000 7f3858b02640 1 --2- 172.21.15.104:0/2678424178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38540aeac0 0x7f38541555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:34.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.707+0000 7f3858b02640 1 -- 172.21.15.104:0/2678424178 >> 172.21.15.104:0/2678424178 conn(0x7f38540cc880 msgr2=0x7f38540ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:34.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.707+0000 7f3858b02640 1 -- 172.21.15.104:0/2678424178 shutdown_connections 2024-05-08T04:24:34.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.707+0000 7f3858b02640 1 -- 172.21.15.104:0/2678424178 wait complete. 2024-05-08T04:24:34.722 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-08T04:24:34.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.827+0000 7f27eb122640 1 Processor -- start 2024-05-08T04:24:34.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.827+0000 7f27eb122640 1 -- start start 2024-05-08T04:24:34.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.828+0000 7f27eb122640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e4070c70 0x7f27e4071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:34.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.828+0000 7f27eb122640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f27e4157ac0 0x7f27e4157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:34.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.828+0000 7f27eb122640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e4071590 con 0x7f27e415edf0 2024-05-08T04:24:34.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.828+0000 7f27eb122640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e406bc70 con 0x7f27e4157ac0 2024-05-08T04:24:34.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.828+0000 7f27eb122640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40d15c0 con 0x7f27e4070c70 2024-05-08T04:24:34.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.828+0000 7f27dbfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f27e415edf0 0x7f27e40b52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44908/0 (socket says 172.21.15.104:44908) 2024-05-08T04:24:34.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.828+0000 7f27dbfff640 1 -- 172.21.15.104:0/654872207 learned_addr learned my addr 172.21.15.104:0/654872207 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:34.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.829+0000 7f27e8ebe640 1 --2- 172.21.15.104:0/654872207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e4070c70 0x7f27e4071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:34.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.829+0000 7f27e96bf640 1 --2- 172.21.15.104:0/654872207 >> v2:172.21.15.183:3300/0 conn(0x7f27e4157ac0 0x7f27e4157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.829+0000 7f27db7fe640 1 -- 172.21.15.104:0/654872207 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712798658 0 0) 0x7f27e4071590 con 0x7f27e415edf0 2024-05-08T04:24:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.829+0000 7f27db7fe640 1 -- 172.21.15.104:0/654872207 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27cc003520 con 0x7f27e415edf0 2024-05-08T04:24:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.829+0000 7f27e96bf640 1 -- 172.21.15.104:0/654872207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e4070c70 msgr2=0x7f27e4071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.829+0000 7f27db7fe640 1 -- 172.21.15.104:0/654872207 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1111898905 0 0) 0x7f27cc003520 con 0x7f27e415edf0 2024-05-08T04:24:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.829+0000 7f27e96bf640 1 --2- 172.21.15.104:0/654872207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e4070c70 0x7f27e4071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.829+0000 7f27e96bf640 1 -- 172.21.15.104:0/654872207 >> v1:172.21.15.104:6789/0 conn(0x7f27e415edf0 legacy=0x7f27e40b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.829+0000 7f27e96bf640 1 -- 172.21.15.104:0/654872207 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e415f550 con 0x7f27e4157ac0 2024-05-08T04:24:34.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.829+0000 7f27e8ebe640 1 --2- 172.21.15.104:0/654872207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e4070c70 0x7f27e4071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:24:34.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.830+0000 7f27e96bf640 1 --2- 172.21.15.104:0/654872207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27e4157ac0 0x7f27e4157f50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009d90 tx=0x7f27dc02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36ce01f0c28b9e2e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:34.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.830+0000 7f27db7fe640 1 -- 172.21.15.104:0/654872207 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4001670 con 0x7f27e4157ac0 2024-05-08T04:24:34.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.830+0000 7f27db7fe640 1 -- 172.21.15.104:0/654872207 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc007540 con 0x7f27e4157ac0 2024-05-08T04:24:34.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.830+0000 7f27db7fe640 1 -- 172.21.15.104:0/654872207 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc007910 con 0x7f27e4157ac0 2024-05-08T04:24:34.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.831+0000 7f27eb122640 1 -- 172.21.15.104:0/654872207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27e4157ac0 msgr2=0x7f27e4157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:34.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.831+0000 7f27eb122640 1 --2- 172.21.15.104:0/654872207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27e4157ac0 0x7f27e4157f50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009d90 tx=0x7f27dc02a5f0 comp rx=0 tx=0).stop 2024-05-08T04:24:34.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.831+0000 7f27eb122640 1 -- 172.21.15.104:0/654872207 shutdown_connections 2024-05-08T04:24:34.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.831+0000 7f27eb122640 1 --2- 172.21.15.104:0/654872207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27e4157ac0 0x7f27e4157f50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:34.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.831+0000 7f27eb122640 1 --2- 172.21.15.104:0/654872207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e4070c70 0x7f27e4071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:34.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.831+0000 7f27eb122640 1 -- 172.21.15.104:0/654872207 >> 172.21.15.104:0/654872207 conn(0x7f27e40b3450 msgr2=0x7f27e40b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:34.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.831+0000 7f27eb122640 1 -- 172.21.15.104:0/654872207 shutdown_connections 2024-05-08T04:24:34.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.831+0000 7f27eb122640 1 -- 172.21.15.104:0/654872207 wait complete. 2024-05-08T04:24:34.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.832+0000 7f27eb122640 1 Processor -- start 2024-05-08T04:24:34.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.832+0000 7f27eb122640 1 -- start start 2024-05-08T04:24:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27eb122640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27e4070c70 0x7f27e415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27eb122640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e4157ac0 0x7f27e4158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:34.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27eb122640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27e415edf0 0x7f27e41550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27eb122640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40b5b80 con 0x7f27e415edf0 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27eb122640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e415fb10 con 0x7f27e4070c70 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27eb122640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4158490 con 0x7f27e4157ac0 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27e96bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27e415edf0 0x7f27e41550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27e96bf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27e415edf0 0x7f27e41550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:58008/0 (socket says 172.21.15.104:58008) 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27e96bf640 1 -- 172.21.15.104:0/3077721086 learned_addr learned my addr 172.21.15.104:0/3077721086 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27dbfff640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e4157ac0 0x7f27e4158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27e8ebe640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27e4070c70 0x7f27e415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27e96bf640 1 -- 172.21.15.104:0/3077721086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e4157ac0 msgr2=0x7f27e4158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27e96bf640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e4157ac0 0x7f27e4158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.833+0000 7f27e96bf640 1 -- 172.21.15.104:0/3077721086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27e4070c70 msgr2=0x7f27e415b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.834+0000 7f27e96bf640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27e4070c70 0x7f27e415b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.834+0000 7f27e96bf640 1 -- 172.21.15.104:0/3077721086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e415adc0 con 0x7f27e415edf0 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.834+0000 7f27e96bf640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27e415edf0 0x7f27e41550b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009d90 tx=0x7f27dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.834+0000 7f27d97fa640 1 -- 172.21.15.104:0/3077721086 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc040070 con 0x7f27e415edf0 2024-05-08T04:24:34.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.834+0000 7f27d97fa640 1 -- 172.21.15.104:0/3077721086 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc031b40 con 0x7f27e415edf0 2024-05-08T04:24:34.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.834+0000 7f27d97fa640 1 -- 172.21.15.104:0/3077721086 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc007e90 con 0x7f27e415edf0 2024-05-08T04:24:34.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.834+0000 7f27eb122640 1 -- 172.21.15.104:0/3077721086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e415b590 con 0x7f27e415edf0 2024-05-08T04:24:34.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.834+0000 7f27eb122640 1 -- 172.21.15.104:0/3077721086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e41f4a80 con 0x7f27e415edf0 2024-05-08T04:24:34.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.835+0000 7f27eb122640 1 -- 172.21.15.104:0/3077721086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e4075010 con 0x7f27e415edf0 2024-05-08T04:24:34.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.835+0000 7f27d97fa640 1 -- 172.21.15.104:0/3077721086 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f27dc039040 con 0x7f27e415edf0 2024-05-08T04:24:34.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.836+0000 7f27d97fa640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f27d006b680 0x7f27d006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:34.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.836+0000 7f27d97fa640 1 -- 172.21.15.104:0/3077721086 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f27dc0ab320 con 0x7f27e415edf0 2024-05-08T04:24:34.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.836+0000 7f27e8ebe640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f27d006b680 0x7f27d006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:34.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.836+0000 7f27e8ebe640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f27d006b680 0x7f27d006db40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009560 tx=0x7f27e0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:34.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:34.840+0000 7f27d97fa640 1 -- 172.21.15.104:0/3077721086 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f27e415adc0 con 0x7f27e415edf0 2024-05-08T04:24:35.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.075+0000 7f27eb122640 1 -- 172.21.15.104:0/3077721086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f27e4071a50 con 0x7f27e415edf0 2024-05-08T04:24:35.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.076+0000 7f27d97fa640 1 -- 172.21.15.104:0/3077721086 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f27dc07a160 con 0x7f27e415edf0 2024-05-08T04:24:35.077 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:35.077 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:24:35.077 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-05-08T04:24:35.077 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.077 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-05-08T04:24:35.078 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmxdFrMRAAmzLHedytHXAGNpNucGZaCQ==", 2024-05-08T04:24:35.078 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.078 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:24:35.078 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:24:35.078 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:24:35.078 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.078 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.078 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.078 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.078 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-05-08T04:24:35.078 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmeApvARAAKgHwMIgcOw0WeJMA6B6Alw==", 2024-05-08T04:24:35.078 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.078 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmFB1nOBAAtAvmTbNBjWFX/1fOOdjN5g==", 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmvNx2CBAAiekQnEgL4wKKJK0cycdqmA==", 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCA/TpmI1TdKxAAmwA8+WnZMSYoYAZ9Jbq3PQ==", 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.080 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:24:35.081 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:24:35.081 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.081 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.081 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.081 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.081 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-05-08T04:24:35.081 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCD/TpmnHVwKhAA8eYNmL/xrJeFs5ZMoZEl7w==", 2024-05-08T04:24:35.081 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.081 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:24:35.081 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:24:35.081 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.081 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.081 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCG/Tpmx++nKBAAn79a9YBVJXBBwVb3odRT+Q==", 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCJ/Tpm2c4qJxAAAvpc8VwahQ3eipDq4B0sLw==", 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.082 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCP/TpmTSzlKhAALgVYlmQcoxc95iy2wGzNTw==", 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.083 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCS/TpmT8O4KRAAtJalEzRoN4egUhKDGgWG2Q==", 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCV/Tpmr9wbKBAAjTGgFWKdCTJQeKFh+Qy8rQ==", 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:24:35.084 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQCY/Tpmj8sIJxAAURnOCmVXzgueWr9WWIi5sg==", 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmmVCJDBAA7kFxGuTTRTJge+xrcPo3lw==", 2024-05-08T04:24:35.085 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow r", 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmnZVEFRAAxxoeoXxT01K0NTE9OIDjEA==", 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/Tpm8YYTEhAAv2yuipPFRLKgsYmLKsVvUw==", 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB9/TpmqiHcGhAAG6+jVhyfQkGUITvUBe7GxQ==", 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.087 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmVvyeFBAAHiDJbzlyvYLKJ86reB18sw==", 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.088 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmpYwyLhAAaPUMPrzgHp1zZyeBWtqiNA==", 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQB8/TpmC2JMKRAAuayaBslUW+T2xxUcFYJ2iQ==", 2024-05-08T04:24:35.089 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-05-08T04:24:35.090 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-05-08T04:24:35.090 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-05-08T04:24:35.090 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-05-08T04:24:35.090 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.090 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.090 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-05-08T04:24:35.090 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:24:35.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.078+0000 7f27eb122640 1 -- 172.21.15.104:0/3077721086 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f27d006b680 msgr2=0x7f27d006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.078+0000 7f27eb122640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f27d006b680 0x7f27d006db40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009560 tx=0x7f27e0008040 comp rx=0 tx=0).stop 2024-05-08T04:24:35.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.078+0000 7f27eb122640 1 -- 172.21.15.104:0/3077721086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27e415edf0 msgr2=0x7f27e41550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.078+0000 7f27eb122640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27e415edf0 0x7f27e41550b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009d90 tx=0x7f27dc004a40 comp rx=0 tx=0).stop 2024-05-08T04:24:35.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.078+0000 7f27eb122640 1 -- 172.21.15.104:0/3077721086 shutdown_connections 2024-05-08T04:24:35.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.078+0000 7f27eb122640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f27d006b680 0x7f27d006db40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.078+0000 7f27eb122640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27e415edf0 0x7f27e41550b0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.078+0000 7f27eb122640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27e4157ac0 0x7f27e4158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.078+0000 7f27eb122640 1 --2- 172.21.15.104:0/3077721086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27e4070c70 0x7f27e415b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.078+0000 7f27eb122640 1 -- 172.21.15.104:0/3077721086 >> 172.21.15.104:0/3077721086 conn(0x7f27e40b3450 msgr2=0x7f27e40b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:35.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.078+0000 7f27eb122640 1 -- 172.21.15.104:0/3077721086 shutdown_connections 2024-05-08T04:24:35.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.078+0000 7f27eb122640 1 -- 172.21.15.104:0/3077721086 wait complete. 2024-05-08T04:24:35.093 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:24:35.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.191+0000 7f8d7204a640 1 Processor -- start 2024-05-08T04:24:35.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.191+0000 7f8d7204a640 1 -- start start 2024-05-08T04:24:35.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.192+0000 7f8d7204a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8d6c15de20 0x7f8d6c0b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.192+0000 7f8d7204a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6c0b1d50 0x7f8d6c0cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.192+0000 7f8d7204a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6c0cd7a0 con 0x7f8d6c0cff80 2024-05-08T04:24:35.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.192+0000 7f8d7204a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6c0caf50 con 0x7f8d6c15de20 2024-05-08T04:24:35.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.192+0000 7f8d7204a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c0cda80 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.192+0000 7f8d6bfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f8d6c0cff80 0x7f8d6c06ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44910/0 (socket says 172.21.15.104:44910) 2024-05-08T04:24:35.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.192+0000 7f8d6bfff640 1 -- 172.21.15.104:0/208103423 learned_addr learned my addr 172.21.15.104:0/208103423 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:35.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.192+0000 7f8d6b7fe640 1 --2- 172.21.15.104:0/208103423 >> v2:172.21.15.183:3300/0 conn(0x7f8d6c15de20 0x7f8d6c0b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.192+0000 7f8d6affd640 1 --2- 172.21.15.104:0/208103423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6c0b1d50 0x7f8d6c0cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.193+0000 7f8d6a7fc640 1 -- 172.21.15.104:0/208103423 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895641862 0 0) 0x7f8d6c0cd7a0 con 0x7f8d6c0cff80 2024-05-08T04:24:35.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.193+0000 7f8d6a7fc640 1 -- 172.21.15.104:0/208103423 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d54003520 con 0x7f8d6c0cff80 2024-05-08T04:24:35.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.193+0000 7f8d6affd640 1 -- 172.21.15.104:0/208103423 >> v2:172.21.15.183:3300/0 conn(0x7f8d6c15de20 msgr2=0x7f8d6c0b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:35.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.193+0000 7f8d6affd640 1 --2- 172.21.15.104:0/208103423 >> v2:172.21.15.183:3300/0 conn(0x7f8d6c15de20 0x7f8d6c0b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.193+0000 7f8d6affd640 1 -- 172.21.15.104:0/208103423 >> v1:172.21.15.104:6789/0 conn(0x7f8d6c0cff80 legacy=0x7f8d6c06ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.193+0000 7f8d6affd640 1 -- 172.21.15.104:0/208103423 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c0cdd60 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.193+0000 7f8d6b7fe640 1 --2- 172.21.15.104:0/208103423 >> v2:172.21.15.183:3300/0 conn(0x7f8d6c15de20 0x7f8d6c0b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:24:35.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.193+0000 7f8d6affd640 1 --2- 172.21.15.104:0/208103423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6c0b1d50 0x7f8d6c0cfa40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d600097a0 tx=0x7f8d6002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9cae55d6807e0e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:35.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.194+0000 7f8d6a7fc640 1 -- 172.21.15.104:0/208103423 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60037070 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.194+0000 7f8d6a7fc640 1 -- 172.21.15.104:0/208103423 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60032440 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.194+0000 7f8d6a7fc640 1 -- 172.21.15.104:0/208103423 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60032810 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.194+0000 7f8d7204a640 1 -- 172.21.15.104:0/208103423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6c0b1d50 msgr2=0x7f8d6c0cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.194+0000 7f8d7204a640 1 --2- 172.21.15.104:0/208103423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6c0b1d50 0x7f8d6c0cfa40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d600097a0 tx=0x7f8d6002a180 comp rx=0 tx=0).stop 2024-05-08T04:24:35.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.194+0000 7f8d7204a640 1 -- 172.21.15.104:0/208103423 shutdown_connections 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.194+0000 7f8d7204a640 1 --2- 172.21.15.104:0/208103423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6c0b1d50 0x7f8d6c0cfa40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.194+0000 7f8d7204a640 1 --2- 172.21.15.104:0/208103423 >> v2:172.21.15.183:3300/0 conn(0x7f8d6c15de20 0x7f8d6c0b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.194+0000 7f8d7204a640 1 -- 172.21.15.104:0/208103423 >> 172.21.15.104:0/208103423 conn(0x7f8d6c0b2220 msgr2=0x7f8d6c0b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.194+0000 7f8d7204a640 1 -- 172.21.15.104:0/208103423 shutdown_connections 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.194+0000 7f8d7204a640 1 -- 172.21.15.104:0/208103423 wait complete. 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.195+0000 7f8d7204a640 1 Processor -- start 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.196+0000 7f8d7204a640 1 -- start start 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.196+0000 7f8d7204a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d6c0b1d50 0x7f8d6c0ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.196+0000 7f8d7204a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d6c0cff80 0x7f8d6c158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.196+0000 7f8d7204a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6c15de20 0x7f8d6c06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.196+0000 7f8d7204a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c15e200 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.196+0000 7f8d7204a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c0cd450 con 0x7f8d6c0cff80 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.196+0000 7f8d7204a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c15e380 con 0x7f8d6c15de20 2024-05-08T04:24:35.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.196+0000 7f8d6b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d6c0b1d50 0x7f8d6c0ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.196+0000 7f8d6b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d6c0b1d50 0x7f8d6c0ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:58022/0 (socket says 172.21.15.104:58022) 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.196+0000 7f8d6b7fe640 1 -- 172.21.15.104:0/2497384111 learned_addr learned my addr 172.21.15.104:0/2497384111 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.196+0000 7f8d6bfff640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6c15de20 0x7f8d6c06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.196+0000 7f8d6affd640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d6c0cff80 0x7f8d6c158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.197+0000 7f8d6b7fe640 1 -- 172.21.15.104:0/2497384111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6c15de20 msgr2=0x7f8d6c06f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.197+0000 7f8d6b7fe640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6c15de20 0x7f8d6c06f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.197+0000 7f8d6b7fe640 1 -- 172.21.15.104:0/2497384111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d6c0cff80 msgr2=0x7f8d6c158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.197+0000 7f8d6b7fe640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d6c0cff80 0x7f8d6c158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.197+0000 7f8d6b7fe640 1 -- 172.21.15.104:0/2497384111 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c0adae0 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.197+0000 7f8d6b7fe640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d6c0b1d50 0x7f8d6c0ad500 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00efc0 tx=0x7f8d5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.197+0000 7f8d53fff640 1 -- 172.21.15.104:0/2497384111 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c018020 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.197+0000 7f8d53fff640 1 -- 172.21.15.104:0/2497384111 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c014680 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.197+0000 7f8d7204a640 1 -- 172.21.15.104:0/2497384111 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6c0addc0 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.197+0000 7f8d53fff640 1 -- 172.21.15.104:0/2497384111 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c014a50 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.197+0000 7f8d7204a640 1 -- 172.21.15.104:0/2497384111 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6c0ae380 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.198+0000 7f8d7204a640 1 -- 172.21.15.104:0/2497384111 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d6c075010 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.198+0000 7f8d53fff640 1 -- 172.21.15.104:0/2497384111 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f8d5c005d10 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.199+0000 7f8d53fff640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8d5806b680 0x7f8d5806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.199+0000 7f8d6affd640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8d5806b680 0x7f8d5806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.199+0000 7f8d53fff640 1 -- 172.21.15.104:0/2497384111 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8d5c08afe0 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.199+0000 7f8d6affd640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8d5806b680 0x7f8d5806db40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8d60034000 tx=0x7f8d6002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:35.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.203+0000 7f8d53fff640 1 -- 172.21.15.104:0/2497384111 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d5c022030 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.377+0000 7f8d7204a640 1 -- 172.21.15.104:0/2497384111 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d6c0b2810 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.377+0000 7f8d53fff640 1 -- 172.21.15.104:0/2497384111 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+12951 (secure 0 0 0) 0x7f8d5c010040 con 0x7f8d6c0b1d50 2024-05-08T04:24:35.379 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:35.379 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":55,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:24:34.701436+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:24:35.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.380+0000 7f8d7204a640 1 -- 172.21.15.104:0/2497384111 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8d5806b680 msgr2=0x7f8d5806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.380+0000 7f8d7204a640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8d5806b680 0x7f8d5806db40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8d60034000 tx=0x7f8d6002e000 comp rx=0 tx=0).stop 2024-05-08T04:24:35.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.380+0000 7f8d7204a640 1 -- 172.21.15.104:0/2497384111 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d6c0b1d50 msgr2=0x7f8d6c0ad500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.380+0000 7f8d7204a640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d6c0b1d50 0x7f8d6c0ad500 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00efc0 tx=0x7f8d5c00c490 comp rx=0 tx=0).stop 2024-05-08T04:24:35.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.380+0000 7f8d7204a640 1 -- 172.21.15.104:0/2497384111 shutdown_connections 2024-05-08T04:24:35.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.380+0000 7f8d7204a640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8d5806b680 0x7f8d5806db40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.380+0000 7f8d7204a640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d6c0cff80 0x7f8d6c158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.380+0000 7f8d7204a640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d6c15de20 0x7f8d6c06f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.380+0000 7f8d7204a640 1 --2- 172.21.15.104:0/2497384111 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d6c0b1d50 0x7f8d6c0ad500 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.380+0000 7f8d7204a640 1 -- 172.21.15.104:0/2497384111 >> 172.21.15.104:0/2497384111 conn(0x7f8d6c0b2220 msgr2=0x7f8d6c15d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:35.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.380+0000 7f8d7204a640 1 -- 172.21.15.104:0/2497384111 shutdown_connections 2024-05-08T04:24:35.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.380+0000 7f8d7204a640 1 -- 172.21.15.104:0/2497384111 wait complete. 2024-05-08T04:24:35.392 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:24:35.392 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:24:35.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.494+0000 7f560e7e0640 1 Processor -- start 2024-05-08T04:24:35.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.494+0000 7f560e7e0640 1 -- start start 2024-05-08T04:24:35.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.494+0000 7f560e7e0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56080ce5a0 0x7f5608161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.494+0000 7f560e7e0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f56080d07c0 0x7f56080d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.494+0000 7f560e7e0640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560815e1f0 con 0x7f560815de10 2024-05-08T04:24:35.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.494+0000 7f560e7e0640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56080d0f50 con 0x7f56080d07c0 2024-05-08T04:24:35.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.494+0000 7f560e7e0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5608161e60 con 0x7f56080ce5a0 2024-05-08T04:24:35.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.495+0000 7f560cd7d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f56080d07c0 0x7f56080d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.495+0000 7f5607fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f560815de10 0x7f56080d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44926/0 (socket says 172.21.15.104:44926) 2024-05-08T04:24:35.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.495+0000 7f5607fff640 1 -- 172.21.15.104:0/45005280 learned_addr learned my addr 172.21.15.104:0/45005280 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:35.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.495+0000 7f56077fe640 1 --2- 172.21.15.104:0/45005280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56080ce5a0 0x7f5608161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.495+0000 7f560cd7d640 1 -- 172.21.15.104:0/45005280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56080ce5a0 msgr2=0x7f5608161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:35.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.495+0000 7f560cd7d640 1 --2- 172.21.15.104:0/45005280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56080ce5a0 0x7f5608161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.495+0000 7f560cd7d640 1 -- 172.21.15.104:0/45005280 >> v1:172.21.15.104:6789/0 conn(0x7f560815de10 legacy=0x7f56080d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.495+0000 7f560cd7d640 1 -- 172.21.15.104:0/45005280 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5608162090 con 0x7f56080d07c0 2024-05-08T04:24:35.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.495+0000 7f5606ffd640 1 -- 172.21.15.104:0/45005280 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893622421 0 0) 0x7f560815e1f0 con 0x7f560815de10 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.495+0000 7f560cd7d640 1 --2- 172.21.15.104:0/45005280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56080d07c0 0x7f56080d2200 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5600009d90 tx=0x7f560002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd05b183ad7efd4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.496+0000 7f5606ffd640 1 -- 172.21.15.104:0/45005280 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600031600 con 0x7f56080d07c0 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.496+0000 7f5606ffd640 1 -- 172.21.15.104:0/45005280 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56000317a0 con 0x7f56080d07c0 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.496+0000 7f5606ffd640 1 -- 172.21.15.104:0/45005280 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600031b70 con 0x7f56080d07c0 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.496+0000 7f560e7e0640 1 -- 172.21.15.104:0/45005280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56080d07c0 msgr2=0x7f56080d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.496+0000 7f560e7e0640 1 --2- 172.21.15.104:0/45005280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56080d07c0 0x7f56080d2200 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5600009d90 tx=0x7f560002a5d0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.496+0000 7f560e7e0640 1 -- 172.21.15.104:0/45005280 shutdown_connections 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.496+0000 7f560e7e0640 1 --2- 172.21.15.104:0/45005280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56080d07c0 0x7f56080d2200 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.496+0000 7f560e7e0640 1 --2- 172.21.15.104:0/45005280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56080ce5a0 0x7f5608161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.496+0000 7f560e7e0640 1 -- 172.21.15.104:0/45005280 >> 172.21.15.104:0/45005280 conn(0x7f5608072290 msgr2=0x7f5608072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.496+0000 7f560e7e0640 1 -- 172.21.15.104:0/45005280 shutdown_connections 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.496+0000 7f560e7e0640 1 -- 172.21.15.104:0/45005280 wait complete. 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.497+0000 7f560e7e0640 1 Processor -- start 2024-05-08T04:24:35.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.498+0000 7f560e7e0640 1 -- start start 2024-05-08T04:24:35.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.498+0000 7f560e7e0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56080ce5a0 0x7f56081550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.498+0000 7f560e7e0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56080d07c0 0x7f560815f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.498+0000 7f560e7e0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560815de10 0x7f5608156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.498+0000 7f560e7e0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5608162650 con 0x7f56080d07c0 2024-05-08T04:24:35.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.498+0000 7f560e7e0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080d1a90 con 0x7f560815de10 2024-05-08T04:24:35.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.498+0000 7f560e7e0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080d1ce0 con 0x7f56080ce5a0 2024-05-08T04:24:35.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.498+0000 7f56077fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56080d07c0 0x7f560815f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.498+0000 7f56077fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56080d07c0 0x7f560815f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:58050/0 (socket says 172.21.15.104:58050) 2024-05-08T04:24:35.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.498+0000 7f56077fe640 1 -- 172.21.15.104:0/2827916153 learned_addr learned my addr 172.21.15.104:0/2827916153 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f5607fff640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56080ce5a0 0x7f56081550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f560cd7d640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560815de10 0x7f5608156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f56077fe640 1 -- 172.21.15.104:0/2827916153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56080ce5a0 msgr2=0x7f56081550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f56077fe640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56080ce5a0 0x7f56081550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f56077fe640 1 -- 172.21.15.104:0/2827916153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560815de10 msgr2=0x7f5608156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f56077fe640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560815de10 0x7f5608156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f56077fe640 1 -- 172.21.15.104:0/2827916153 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5608155600 con 0x7f56080d07c0 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f5607fff640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56080ce5a0 0x7f56081550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f560cd7d640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560815de10 0x7f5608156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f56077fe640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56080d07c0 0x7f560815f470 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00c820 tx=0x7f55fc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f5604ff9640 1 -- 172.21.15.104:0/2827916153 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc015070 con 0x7f56080d07c0 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f5604ff9640 1 -- 172.21.15.104:0/2827916153 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc004240 con 0x7f56080d07c0 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f5604ff9640 1 -- 172.21.15.104:0/2827916153 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc00ce10 con 0x7f56080d07c0 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f560e7e0640 1 -- 172.21.15.104:0/2827916153 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560815feb0 con 0x7f56080d07c0 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.499+0000 7f560e7e0640 1 -- 172.21.15.104:0/2827916153 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56081606f0 con 0x7f56080d07c0 2024-05-08T04:24:35.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.500+0000 7f560e7e0640 1 -- 172.21.15.104:0/2827916153 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5608072b10 con 0x7f56080d07c0 2024-05-08T04:24:35.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.500+0000 7f5604ff9640 1 -- 172.21.15.104:0/2827916153 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f55fc007830 con 0x7f56080d07c0 2024-05-08T04:24:35.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.501+0000 7f5604ff9640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f55f406b680 0x7f55f406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.501+0000 7f5604ff9640 1 -- 172.21.15.104:0/2827916153 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f55fc08a1b0 con 0x7f56080d07c0 2024-05-08T04:24:35.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.501+0000 7f5607fff640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f55f406b680 0x7f55f406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.501+0000 7f5607fff640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f55f406b680 0x7f55f406db40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f55f8000f60 tx=0x7f55f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:35.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.505+0000 7f5604ff9640 1 -- 172.21.15.104:0/2827916153 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f560815feb0 con 0x7f56080d07c0 2024-05-08T04:24:35.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.672+0000 7f560e7e0640 1 -- 172.21.15.104:0/2827916153 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56080d1870 con 0x7f56080d07c0 2024-05-08T04:24:35.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.673+0000 7f5604ff9640 1 -- 172.21.15.104:0/2827916153 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55fc058ff0 con 0x7f56080d07c0 2024-05-08T04:24:35.674 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:24:35.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.674+0000 7f560e7e0640 1 -- 172.21.15.104:0/2827916153 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f55f406b680 msgr2=0x7f55f406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.674+0000 7f560e7e0640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f55f406b680 0x7f55f406db40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f55f8000f60 tx=0x7f55f8009040 comp rx=0 tx=0).stop 2024-05-08T04:24:35.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.674+0000 7f560e7e0640 1 -- 172.21.15.104:0/2827916153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56080d07c0 msgr2=0x7f560815f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.674+0000 7f560e7e0640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56080d07c0 0x7f560815f470 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00c820 tx=0x7f55fc00cce0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.675+0000 7f560e7e0640 1 -- 172.21.15.104:0/2827916153 shutdown_connections 2024-05-08T04:24:35.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.675+0000 7f560e7e0640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f55f406b680 0x7f55f406db40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.675+0000 7f560e7e0640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560815de10 0x7f5608156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.675+0000 7f560e7e0640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56080d07c0 0x7f560815f470 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.675+0000 7f560e7e0640 1 --2- 172.21.15.104:0/2827916153 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56080ce5a0 0x7f56081550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.675+0000 7f560e7e0640 1 -- 172.21.15.104:0/2827916153 >> 172.21.15.104:0/2827916153 conn(0x7f5608072290 msgr2=0x7f56080b8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:35.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.675+0000 7f560e7e0640 1 -- 172.21.15.104:0/2827916153 shutdown_connections 2024-05-08T04:24:35.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.675+0000 7f560e7e0640 1 -- 172.21.15.104:0/2827916153 wait complete. 2024-05-08T04:24:35.687 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T04:24:35.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.785+0000 7f797c1f9640 1 Processor -- start 2024-05-08T04:24:35.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.785+0000 7f797c1f9640 1 -- start start 2024-05-08T04:24:35.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.786+0000 7f797c1f9640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f797415de10 0x7f7974161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.786+0000 7f797c1f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79740ce5a0 0x7f79740d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.786+0000 7f797c1f9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79740d3210 con 0x7f79740d05f0 2024-05-08T04:24:35.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.786+0000 7f797c1f9640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79740d0f50 con 0x7f797415de10 2024-05-08T04:24:35.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.786+0000 7f797c1f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7974161e60 con 0x7f79740ce5a0 2024-05-08T04:24:35.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.786+0000 7f7979f95640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f797415de10 0x7f7974161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.786+0000 7f7979f95640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f797415de10 0x7f7974161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:58060/0 (socket says 172.21.15.104:58060) 2024-05-08T04:24:35.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.786+0000 7f7979f95640 1 -- 172.21.15.104:0/735782978 learned_addr learned my addr 172.21.15.104:0/735782978 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:35.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.787+0000 7f7979794640 1 --2- 172.21.15.104:0/735782978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79740ce5a0 0x7f79740d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.787+0000 7f7979f95640 1 -- 172.21.15.104:0/735782978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79740ce5a0 msgr2=0x7f79740d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:35.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.787+0000 7f7979f95640 1 --2- 172.21.15.104:0/735782978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79740ce5a0 0x7f79740d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.787+0000 7f7979f95640 1 -- 172.21.15.104:0/735782978 >> v1:172.21.15.183:6789/0 conn(0x7f79740d05f0 legacy=0x7f79740b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.787+0000 7f7979f95640 1 -- 172.21.15.104:0/735782978 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797415e1f0 con 0x7f797415de10 2024-05-08T04:24:35.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.787+0000 7f7979f95640 1 --2- 172.21.15.104:0/735782978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797415de10 0x7f7974161920 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7970009e50 tx=0x7f797002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb327f10f3d4019 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:35.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.788+0000 7f7978f93640 1 -- 172.21.15.104:0/735782978 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970036070 con 0x7f797415de10 2024-05-08T04:24:35.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.788+0000 7f7978f93640 1 -- 172.21.15.104:0/735782978 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7970031600 con 0x7f797415de10 2024-05-08T04:24:35.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.788+0000 7f7978f93640 1 -- 172.21.15.104:0/735782978 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79700319d0 con 0x7f797415de10 2024-05-08T04:24:35.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.788+0000 7f797c1f9640 1 -- 172.21.15.104:0/735782978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797415de10 msgr2=0x7f7974161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.788+0000 7f797c1f9640 1 --2- 172.21.15.104:0/735782978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797415de10 0x7f7974161920 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7970009e50 tx=0x7f797002a680 comp rx=0 tx=0).stop 2024-05-08T04:24:35.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.788+0000 7f797c1f9640 1 -- 172.21.15.104:0/735782978 shutdown_connections 2024-05-08T04:24:35.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.788+0000 7f797c1f9640 1 --2- 172.21.15.104:0/735782978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79740ce5a0 0x7f79740d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.788+0000 7f797c1f9640 1 --2- 172.21.15.104:0/735782978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f797415de10 0x7f7974161920 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.788+0000 7f797c1f9640 1 -- 172.21.15.104:0/735782978 >> 172.21.15.104:0/735782978 conn(0x7f7974072290 msgr2=0x7f7974072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:35.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.788+0000 7f797c1f9640 1 -- 172.21.15.104:0/735782978 shutdown_connections 2024-05-08T04:24:35.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.788+0000 7f797c1f9640 1 -- 172.21.15.104:0/735782978 wait complete. 2024-05-08T04:24:35.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.789+0000 7f797c1f9640 1 Processor -- start 2024-05-08T04:24:35.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.789+0000 7f797c1f9640 1 -- start start 2024-05-08T04:24:35.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f797c1f9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79740ce5a0 0x7f79740c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f797c1f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79740d05f0 0x7f797415bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f797c1f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f797415de10 0x7f7974159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f797c1f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7974162090 con 0x7f79740d05f0 2024-05-08T04:24:35.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f797c1f9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79740d1a90 con 0x7f79740ce5a0 2024-05-08T04:24:35.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f797c1f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7974162370 con 0x7f797415de10 2024-05-08T04:24:35.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f7979794640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79740d05f0 0x7f797415bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f7979794640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79740d05f0 0x7f797415bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:58072/0 (socket says 172.21.15.104:58072) 2024-05-08T04:24:35.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f7979794640 1 -- 172.21.15.104:0/862656475 learned_addr learned my addr 172.21.15.104:0/862656475 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:35.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f7979f95640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79740ce5a0 0x7f79740c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f797a796640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f797415de10 0x7f7974159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f7979794640 1 -- 172.21.15.104:0/862656475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f797415de10 msgr2=0x7f7974159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f7979794640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f797415de10 0x7f7974159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f7979794640 1 -- 172.21.15.104:0/862656475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79740ce5a0 msgr2=0x7f79740c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f7979794640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79740ce5a0 0x7f79740c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f7979794640 1 -- 172.21.15.104:0/862656475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797415c5f0 con 0x7f79740d05f0 2024-05-08T04:24:35.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.790+0000 7f7979f95640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79740ce5a0 0x7f79740c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:35.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.791+0000 7f7979794640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79740d05f0 0x7f797415bb50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f796400d830 tx=0x7f796400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:35.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.791+0000 7f796a7fc640 1 -- 172.21.15.104:0/862656475 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400b6c0 con 0x7f79740d05f0 2024-05-08T04:24:35.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.791+0000 7f796a7fc640 1 -- 172.21.15.104:0/862656475 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7964019070 con 0x7f79740d05f0 2024-05-08T04:24:35.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.791+0000 7f797c1f9640 1 -- 172.21.15.104:0/862656475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797415c8d0 con 0x7f79740d05f0 2024-05-08T04:24:35.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.791+0000 7f796a7fc640 1 -- 172.21.15.104:0/862656475 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400ba80 con 0x7f79740d05f0 2024-05-08T04:24:35.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.791+0000 7f797c1f9640 1 -- 172.21.15.104:0/862656475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797415ce90 con 0x7f79740d05f0 2024-05-08T04:24:35.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.792+0000 7f797c1f9640 1 -- 172.21.15.104:0/862656475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7974075010 con 0x7f79740d05f0 2024-05-08T04:24:35.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.792+0000 7f796a7fc640 1 -- 172.21.15.104:0/862656475 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f796401e460 con 0x7f79740d05f0 2024-05-08T04:24:35.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.793+0000 7f796a7fc640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f795806b680 0x7f795806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:35.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.793+0000 7f796a7fc640 1 -- 172.21.15.104:0/862656475 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f796408a7e0 con 0x7f79740d05f0 2024-05-08T04:24:35.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.793+0000 7f7979f95640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f795806b680 0x7f795806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:35.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.793+0000 7f7979f95640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f795806b680 0x7f795806db40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7970033000 tx=0x7f7970009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:35.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.797+0000 7f796a7fc640 1 -- 172.21.15.104:0/862656475 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f79640597c0 con 0x7f79740d05f0 2024-05-08T04:24:35.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.968+0000 7f797c1f9640 1 -- 172.21.15.104:0/862656475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f79740cddd0 con 0x7f79740d05f0 2024-05-08T04:24:35.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.969+0000 7f796a7fc640 1 -- 172.21.15.104:0/862656475 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) v1 ==== 84+0+65 (secure 0 0 0) 0x7f79640590c0 con 0x7f79740d05f0 2024-05-08T04:24:35.970 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:35.970 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-05-08T04:24:35.970 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:35.970 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-05-08T04:24:35.971 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-05-08T04:24:35.971 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:35.971 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-05-08T04:24:35.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.971+0000 7f797c1f9640 1 -- 172.21.15.104:0/862656475 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f795806b680 msgr2=0x7f795806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.971+0000 7f797c1f9640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f795806b680 0x7f795806db40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7970033000 tx=0x7f7970009000 comp rx=0 tx=0).stop 2024-05-08T04:24:35.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.971+0000 7f797c1f9640 1 -- 172.21.15.104:0/862656475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79740d05f0 msgr2=0x7f797415bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:35.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.971+0000 7f797c1f9640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79740d05f0 0x7f797415bb50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f796400d830 tx=0x7f796400dcf0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.971+0000 7f797c1f9640 1 -- 172.21.15.104:0/862656475 shutdown_connections 2024-05-08T04:24:35.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.971+0000 7f797c1f9640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f795806b680 0x7f795806db40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.971+0000 7f797c1f9640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f797415de10 0x7f7974159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.971+0000 7f797c1f9640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79740d05f0 0x7f797415bb50 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.971+0000 7f797c1f9640 1 --2- 172.21.15.104:0/862656475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79740ce5a0 0x7f79740c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:35.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.971+0000 7f797c1f9640 1 -- 172.21.15.104:0/862656475 >> 172.21.15.104:0/862656475 conn(0x7f7974072290 msgr2=0x7f79740d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:35.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.971+0000 7f797c1f9640 1 -- 172.21.15.104:0/862656475 shutdown_connections 2024-05-08T04:24:35.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:35.971+0000 7f797c1f9640 1 -- 172.21.15.104:0/862656475 wait complete. 2024-05-08T04:24:35.983 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T04:24:35.983 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T04:24:36.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.086+0000 7f275c841640 1 Processor -- start 2024-05-08T04:24:36.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.086+0000 7f275c841640 1 -- start start 2024-05-08T04:24:36.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.087+0000 7f275c841640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758099a40 0x7f2758099e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:36.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.087+0000 7f275c841640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f27580cf360 0x7f27580cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:36.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.087+0000 7f275c841640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27580cc700 con 0x7f275815f540 2024-05-08T04:24:36.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.087+0000 7f275c841640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275815ced0 con 0x7f27580cf360 2024-05-08T04:24:36.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.087+0000 7f275c841640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275809a360 con 0x7f2758099a40 2024-05-08T04:24:36.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.088+0000 7f2755d9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f27580cf360 0x7f27580cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:36.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.088+0000 7f275659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758099a40 0x7f2758099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:36.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.088+0000 7f2756d9d640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f275815f540 0x7f275815f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:44612/0 (socket says 172.21.15.104:44612) 2024-05-08T04:24:36.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.088+0000 7f275659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758099a40 0x7f2758099e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:40154/0 (socket says 172.21.15.104:40154) 2024-05-08T04:24:36.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.088+0000 7f2755d9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f27580cf360 0x7f27580cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:42982/0 (socket says 172.21.15.104:42982) 2024-05-08T04:24:36.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.088+0000 7f2756d9d640 1 -- 172.21.15.104:0/3926335775 learned_addr learned my addr 172.21.15.104:0/3926335775 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:36.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.088+0000 7f275659c640 1 -- 172.21.15.104:0/3926335775 >> v2:172.21.15.183:3300/0 conn(0x7f27580cf360 msgr2=0x7f27580cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:36.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.088+0000 7f275659c640 1 --2- 172.21.15.104:0/3926335775 >> v2:172.21.15.183:3300/0 conn(0x7f27580cf360 0x7f27580cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.088+0000 7f275659c640 1 -- 172.21.15.104:0/3926335775 >> v1:172.21.15.183:6789/0 conn(0x7f275815f540 legacy=0x7f275815f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:36.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.088+0000 7f275659c640 1 -- 172.21.15.104:0/3926335775 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27580d0020 con 0x7f2758099a40 2024-05-08T04:24:36.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.088+0000 7f2755d9b640 1 --2- 172.21.15.104:0/3926335775 >> v2:172.21.15.183:3300/0 conn(0x7f27580cf360 0x7f27580cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:24:36.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.089+0000 7f275659c640 1 --2- 172.21.15.104:0/3926335775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758099a40 0x7f2758099e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2748009de0 tx=0x7f274802a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a21181a24e681242 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:36.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.089+0000 7f275559a640 1 -- 172.21.15.104:0/3926335775 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748007740 con 0x7f2758099a40 2024-05-08T04:24:36.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.089+0000 7f275559a640 1 -- 172.21.15.104:0/3926335775 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27480078e0 con 0x7f2758099a40 2024-05-08T04:24:36.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.089+0000 7f275559a640 1 -- 172.21.15.104:0/3926335775 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748007cb0 con 0x7f2758099a40 2024-05-08T04:24:36.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.089+0000 7f275c841640 1 -- 172.21.15.104:0/3926335775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758099a40 msgr2=0x7f2758099e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:36.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.089+0000 7f275c841640 1 --2- 172.21.15.104:0/3926335775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758099a40 0x7f2758099e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2748009de0 tx=0x7f274802a6c0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.090+0000 7f275c841640 1 -- 172.21.15.104:0/3926335775 shutdown_connections 2024-05-08T04:24:36.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.090+0000 7f275c841640 1 --2- 172.21.15.104:0/3926335775 >> v2:172.21.15.183:3300/0 conn(0x7f27580cf360 0x7f27580cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.090+0000 7f275c841640 1 --2- 172.21.15.104:0/3926335775 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758099a40 0x7f2758099e20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.090+0000 7f275c841640 1 -- 172.21.15.104:0/3926335775 >> 172.21.15.104:0/3926335775 conn(0x7f27580b3280 msgr2=0x7f27580b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:36.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.090+0000 7f275c841640 1 -- 172.21.15.104:0/3926335775 shutdown_connections 2024-05-08T04:24:36.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.090+0000 7f275c841640 1 -- 172.21.15.104:0/3926335775 wait complete. 2024-05-08T04:24:36.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.091+0000 7f275c841640 1 Processor -- start 2024-05-08T04:24:36.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.091+0000 7f275c841640 1 -- start start 2024-05-08T04:24:36.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f275c841640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758099a40 0x7f27580b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:36.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f275c841640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27580cf360 0x7f27581555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:36.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f275c841640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f275815f540 0x7f27580b6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:36.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f275c841640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2758159860 con 0x7f275815f540 2024-05-08T04:24:36.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f275c841640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27580d05e0 con 0x7f27580cf360 2024-05-08T04:24:36.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f275c841640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27580cfd00 con 0x7f2758099a40 2024-05-08T04:24:36.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f2756d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f275815f540 0x7f27580b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:36.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f2756d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f275815f540 0x7f27580b6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:58080/0 (socket says 172.21.15.104:58080) 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f2756d9d640 1 -- 172.21.15.104:0/627793661 learned_addr learned my addr 172.21.15.104:0/627793661 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f2755d9b640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27580cf360 0x7f27581555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f275659c640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758099a40 0x7f27580b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f2756d9d640 1 -- 172.21.15.104:0/627793661 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758099a40 msgr2=0x7f27580b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f2756d9d640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758099a40 0x7f27580b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f2756d9d640 1 -- 172.21.15.104:0/627793661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27580cf360 msgr2=0x7f27581555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f2756d9d640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27580cf360 0x7f27581555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f2756d9d640 1 -- 172.21.15.104:0/627793661 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27580b4a90 con 0x7f275815f540 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f2756d9d640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f275815f540 0x7f27580b6860 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2750001eb0 tx=0x7f275000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f2746ffd640 1 -- 172.21.15.104:0/627793661 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750017070 con 0x7f275815f540 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f2746ffd640 1 -- 172.21.15.104:0/627793661 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2750005ce0 con 0x7f275815f540 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f2746ffd640 1 -- 172.21.15.104:0/627793661 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750007310 con 0x7f275815f540 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.092+0000 7f275c841640 1 -- 172.21.15.104:0/627793661 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27580b4d70 con 0x7f275815f540 2024-05-08T04:24:36.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.093+0000 7f275c841640 1 -- 172.21.15.104:0/627793661 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27580b5330 con 0x7f275815f540 2024-05-08T04:24:36.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.093+0000 7f275c841640 1 -- 172.21.15.104:0/627793661 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2758075010 con 0x7f275815f540 2024-05-08T04:24:36.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.094+0000 7f2746ffd640 1 -- 172.21.15.104:0/627793661 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f275001a070 con 0x7f275815f540 2024-05-08T04:24:36.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.094+0000 7f2746ffd640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f273806b680 0x7f273806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:36.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.094+0000 7f275659c640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f273806b680 0x7f273806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:36.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.094+0000 7f2746ffd640 1 -- 172.21.15.104:0/627793661 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2750089650 con 0x7f275815f540 2024-05-08T04:24:36.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.095+0000 7f275659c640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f273806b680 0x7f273806db40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2748034000 tx=0x7f2748033040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:36.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.098+0000 7f2746ffd640 1 -- 172.21.15.104:0/627793661 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2750058500 con 0x7f275815f540 2024-05-08T04:24:36.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.268+0000 7f275c841640 1 -- 172.21.15.104:0/627793661 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2758071b90 con 0x7f275815f540 2024-05-08T04:24:36.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.712+0000 7f2746ffd640 1 -- 172.21.15.104:0/627793661 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v56) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2750057e00 con 0x7f275815f540 2024-05-08T04:24:36.713 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-05-08T04:24:36.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.714+0000 7f275c841640 1 -- 172.21.15.104:0/627793661 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f273806b680 msgr2=0x7f273806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:36.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.714+0000 7f275c841640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f273806b680 0x7f273806db40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2748034000 tx=0x7f2748033040 comp rx=0 tx=0).stop 2024-05-08T04:24:36.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.714+0000 7f275c841640 1 -- 172.21.15.104:0/627793661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f275815f540 msgr2=0x7f27580b6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:36.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.714+0000 7f275c841640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f275815f540 0x7f27580b6860 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2750001eb0 tx=0x7f275000c890 comp rx=0 tx=0).stop 2024-05-08T04:24:36.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.714+0000 7f275c841640 1 -- 172.21.15.104:0/627793661 shutdown_connections 2024-05-08T04:24:36.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.714+0000 7f275c841640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f273806b680 0x7f273806db40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.714+0000 7f275c841640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27580cf360 0x7f27581555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.714+0000 7f275c841640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f275815f540 0x7f27580b6860 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.714+0000 7f275c841640 1 --2- 172.21.15.104:0/627793661 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758099a40 0x7f27580b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.714+0000 7f275c841640 1 -- 172.21.15.104:0/627793661 >> 172.21.15.104:0/627793661 conn(0x7f27580b3280 msgr2=0x7f27580b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:36.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.714+0000 7f275c841640 1 -- 172.21.15.104:0/627793661 shutdown_connections 2024-05-08T04:24:36.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.714+0000 7f275c841640 1 -- 172.21.15.104:0/627793661 wait complete. 2024-05-08T04:24:36.730 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T04:24:36.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.836+0000 7f154f734640 1 Processor -- start 2024-05-08T04:24:36.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.836+0000 7f154f734640 1 -- start start 2024-05-08T04:24:36.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.837+0000 7f154f734640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1548157f80 0x7f154815ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:36.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.837+0000 7f154f734640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1548158360 0x7f1548162160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:36.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.837+0000 7f154f734640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15481616c0 con 0x7f15480c6960 2024-05-08T04:24:36.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.837+0000 7f154f734640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15480c7170 con 0x7f1548157f80 2024-05-08T04:24:36.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.837+0000 7f154f734640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15480c7450 con 0x7f1548158360 2024-05-08T04:24:36.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.837+0000 7f154d4d0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1548157f80 0x7f154815ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:36.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.837+0000 7f154dcd1640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f15480c6960 0x7f15480ce030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:44928/0 (socket says 172.21.15.104:44928) 2024-05-08T04:24:36.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.837+0000 7f154dcd1640 1 -- 172.21.15.104:0/4092760819 learned_addr learned my addr 172.21.15.104:0/4092760819 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:36.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.837+0000 7f154d4d0640 1 -- 172.21.15.104:0/4092760819 >> v2:172.21.15.183:3300/0 conn(0x7f1548158360 msgr2=0x7f1548162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:36.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.837+0000 7f154d4d0640 1 --2- 172.21.15.104:0/4092760819 >> v2:172.21.15.183:3300/0 conn(0x7f1548158360 0x7f1548162160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.837+0000 7f154d4d0640 1 -- 172.21.15.104:0/4092760819 >> v1:172.21.15.104:6789/0 conn(0x7f15480c6960 legacy=0x7f15480ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:36.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.837+0000 7f154d4d0640 1 -- 172.21.15.104:0/4092760819 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1548161960 con 0x7f1548157f80 2024-05-08T04:24:36.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.838+0000 7f154d4d0640 1 --2- 172.21.15.104:0/4092760819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1548157f80 0x7f154815ece0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f15480d0530 tx=0x7f154402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3292fccbd602b2a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:36.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.838+0000 7f153ffff640 1 -- 172.21.15.104:0/4092760819 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544037070 con 0x7f1548157f80 2024-05-08T04:24:36.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.838+0000 7f153ffff640 1 -- 172.21.15.104:0/4092760819 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1544032440 con 0x7f1548157f80 2024-05-08T04:24:36.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.838+0000 7f153ffff640 1 -- 172.21.15.104:0/4092760819 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544032810 con 0x7f1548157f80 2024-05-08T04:24:36.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.839+0000 7f154f734640 1 -- 172.21.15.104:0/4092760819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1548157f80 msgr2=0x7f154815ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:36.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.839+0000 7f154f734640 1 --2- 172.21.15.104:0/4092760819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1548157f80 0x7f154815ece0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f15480d0530 tx=0x7f154402a230 comp rx=0 tx=0).stop 2024-05-08T04:24:36.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.839+0000 7f154f734640 1 -- 172.21.15.104:0/4092760819 shutdown_connections 2024-05-08T04:24:36.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.839+0000 7f154f734640 1 --2- 172.21.15.104:0/4092760819 >> v2:172.21.15.183:3300/0 conn(0x7f1548158360 0x7f1548162160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.839+0000 7f154f734640 1 --2- 172.21.15.104:0/4092760819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1548157f80 0x7f154815ece0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.839+0000 7f154f734640 1 -- 172.21.15.104:0/4092760819 >> 172.21.15.104:0/4092760819 conn(0x7f15480b33e0 msgr2=0x7f15480b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:36.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.839+0000 7f154f734640 1 -- 172.21.15.104:0/4092760819 shutdown_connections 2024-05-08T04:24:36.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.839+0000 7f154f734640 1 -- 172.21.15.104:0/4092760819 wait complete. 2024-05-08T04:24:36.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.840+0000 7f154f734640 1 Processor -- start 2024-05-08T04:24:36.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.840+0000 7f154f734640 1 -- start start 2024-05-08T04:24:36.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154f734640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15480c6960 0x7f15480afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:36.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154f734640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1548157f80 0x7f1548150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:36.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154f734640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1548158360 0x7f1548151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:36.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154f734640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15480c6ec0 con 0x7f1548157f80 2024-05-08T04:24:36.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154f734640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15480c6d40 con 0x7f1548158360 2024-05-08T04:24:36.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154f734640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15480ce740 con 0x7f15480c6960 2024-05-08T04:24:36.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154cccf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1548157f80 0x7f1548150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:36.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154cccf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1548157f80 0x7f1548150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:58108/0 (socket says 172.21.15.104:58108) 2024-05-08T04:24:36.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154cccf640 1 -- 172.21.15.104:0/2235288037 learned_addr learned my addr 172.21.15.104:0/2235288037 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154cccf640 1 -- 172.21.15.104:0/2235288037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15480c6960 msgr2=0x7f15480afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154cccf640 1 --2- 172.21.15.104:0/2235288037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15480c6960 0x7f15480afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154cccf640 1 -- 172.21.15.104:0/2235288037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1548158360 msgr2=0x7f1548151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154cccf640 1 --2- 172.21.15.104:0/2235288037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1548158360 0x7f1548151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154cccf640 1 -- 172.21.15.104:0/2235288037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1548156cb0 con 0x7f1548157f80 2024-05-08T04:24:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154cccf640 1 --2- 172.21.15.104:0/2235288037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1548157f80 0x7f1548150dc0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f153800b410 tx=0x7f153800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f153dffb640 1 -- 172.21.15.104:0/2235288037 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538015020 con 0x7f1548157f80 2024-05-08T04:24:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f153dffb640 1 -- 172.21.15.104:0/2235288037 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1538011850 con 0x7f1548157f80 2024-05-08T04:24:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f154f734640 1 -- 172.21.15.104:0/2235288037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15480b4cd0 con 0x7f1548157f80 2024-05-08T04:24:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.841+0000 7f153dffb640 1 -- 172.21.15.104:0/2235288037 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538011c40 con 0x7f1548157f80 2024-05-08T04:24:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.842+0000 7f154f734640 1 -- 172.21.15.104:0/2235288037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15480b5290 con 0x7f1548157f80 2024-05-08T04:24:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.843+0000 7f154f734640 1 -- 172.21.15.104:0/2235288037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1548074830 con 0x7f1548157f80 2024-05-08T04:24:36.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.843+0000 7f153dffb640 1 -- 172.21.15.104:0/2235288037 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f1538018020 con 0x7f1548157f80 2024-05-08T04:24:36.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.844+0000 7f153dffb640 1 --2- 172.21.15.104:0/2235288037 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f152c06b680 0x7f152c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:36.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.844+0000 7f153dffb640 1 -- 172.21.15.104:0/2235288037 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f153808a1d0 con 0x7f1548157f80 2024-05-08T04:24:36.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.844+0000 7f154d4d0640 1 --2- 172.21.15.104:0/2235288037 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f152c06b680 0x7f152c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:36.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.844+0000 7f154d4d0640 1 --2- 172.21.15.104:0/2235288037 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f152c06b680 0x7f152c06db40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1544034000 tx=0x7f154402c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:36.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:36.848+0000 7f153dffb640 1 -- 172.21.15.104:0/2235288037 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f153801f020 con 0x7f1548157f80 2024-05-08T04:24:37.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.019+0000 7f154f734640 1 -- 172.21.15.104:0/2235288037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f15480b0b00 con 0x7f1548157f80 2024-05-08T04:24:37.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.713+0000 7f153dffb640 1 -- 172.21.15.104:0/2235288037 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v57) v1 ==== 170+0+0 (secure 0 0 0) 0x7f15380172c0 con 0x7f1548157f80 2024-05-08T04:24:37.715 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-05-08T04:24:37.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.716+0000 7f154f734640 1 -- 172.21.15.104:0/2235288037 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f152c06b680 msgr2=0x7f152c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:37.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.716+0000 7f154f734640 1 --2- 172.21.15.104:0/2235288037 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f152c06b680 0x7f152c06db40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1544034000 tx=0x7f154402c000 comp rx=0 tx=0).stop 2024-05-08T04:24:37.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.716+0000 7f154f734640 1 -- 172.21.15.104:0/2235288037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1548157f80 msgr2=0x7f1548150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:37.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.716+0000 7f154f734640 1 --2- 172.21.15.104:0/2235288037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1548157f80 0x7f1548150dc0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f153800b410 tx=0x7f153800b8d0 comp rx=0 tx=0).stop 2024-05-08T04:24:37.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.716+0000 7f154f734640 1 -- 172.21.15.104:0/2235288037 shutdown_connections 2024-05-08T04:24:37.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.716+0000 7f154f734640 1 --2- 172.21.15.104:0/2235288037 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f152c06b680 0x7f152c06db40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:37.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.716+0000 7f154f734640 1 --2- 172.21.15.104:0/2235288037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1548158360 0x7f1548151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:37.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.716+0000 7f154f734640 1 --2- 172.21.15.104:0/2235288037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1548157f80 0x7f1548150dc0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:37.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.716+0000 7f154f734640 1 --2- 172.21.15.104:0/2235288037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15480c6960 0x7f15480afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:37.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.716+0000 7f154f734640 1 -- 172.21.15.104:0/2235288037 >> 172.21.15.104:0/2235288037 conn(0x7f15480b33e0 msgr2=0x7f15480ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:37.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.716+0000 7f154f734640 1 -- 172.21.15.104:0/2235288037 shutdown_connections 2024-05-08T04:24:37.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.717+0000 7f154f734640 1 -- 172.21.15.104:0/2235288037 wait complete. 2024-05-08T04:24:37.742 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T04:24:37.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.843+0000 7fb60b7d5640 1 Processor -- start 2024-05-08T04:24:37.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.843+0000 7fb60b7d5640 1 -- start start 2024-05-08T04:24:37.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.844+0000 7fb60b7d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb604161190 0x7fb604072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:37.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.844+0000 7fb60b7d5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60406de30 con 0x7fb60406bb70 2024-05-08T04:24:37.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.844+0000 7fb60b7d5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60406e110 con 0x7fb604072a70 2024-05-08T04:24:37.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.844+0000 7fb60b7d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6040b4db0 con 0x7fb604161190 2024-05-08T04:24:37.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.844+0000 7fb609d72640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb60406bb70 0x7fb60406eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:47412/0 (socket says 172.21.15.104:47412) 2024-05-08T04:24:37.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.844+0000 7fb609d72640 1 -- 172.21.15.104:0/1808524101 learned_addr learned my addr 172.21.15.104:0/1808524101 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:37.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.844+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499565106 0 0) 0x7fb60406de30 con 0x7fb60406bb70 2024-05-08T04:24:37.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.844+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5f0003520 con 0x7fb60406bb70 2024-05-08T04:24:37.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb609571640 1 --2- 172.21.15.104:0/1808524101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb604161190 0x7fb604072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:37.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4174193198 0 0) 0x7fb5f0003520 con 0x7fb60406bb70 2024-05-08T04:24:37.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb604161190 msgr2=0x7fb604072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:37.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb5fbfff640 1 --2- 172.21.15.104:0/1808524101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb604161190 0x7fb604072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 >> v1:172.21.15.183:6789/0 conn(0x7fb604072a70 legacy=0x7fb6040acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60406e3f0 con 0x7fb60406bb70 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fb5fc0019f0 con 0x7fb60406bb70 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 >> v1:172.21.15.104:6789/0 conn(0x7fb60406bb70 legacy=0x7fb60406eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb5fbfff640 1 --2- 172.21.15.104:0/1808524101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5f00039e0 0x7fb5f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb5fbfff640 1 --2- 172.21.15.104:0/1808524101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5f0004800 0x7fb5f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb5fbfff640 1 --2- 172.21.15.104:0/1808524101 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5f00051c0 0x7fb5f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f000c090 con 0x7fb5f00051c0 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f000c210 con 0x7fb5f0004800 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f000c410 con 0x7fb5f00039e0 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb609571640 1 --2- 172.21.15.104:0/1808524101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb604161190 0x7fb604072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb609d72640 1 --2- 172.21.15.104:0/1808524101 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5f00051c0 0x7fb5f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb608d70640 1 --2- 172.21.15.104:0/1808524101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5f0004800 0x7fb5f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:37.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb609571640 1 --2- 172.21.15.104:0/1808524101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5f00039e0 0x7fb5f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb609d72640 1 -- 172.21.15.104:0/1808524101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5f00039e0 msgr2=0x7fb5f0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb609d72640 1 --2- 172.21.15.104:0/1808524101 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5f00039e0 0x7fb5f0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb609d72640 1 -- 172.21.15.104:0/1808524101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5f0004800 msgr2=0x7fb5f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb609d72640 1 --2- 172.21.15.104:0/1808524101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5f0004800 0x7fb5f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.845+0000 7fb609d72640 1 -- 172.21.15.104:0/1808524101 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f0003520 con 0x7fb5f00051c0 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.846+0000 7fb609d72640 1 --2- 172.21.15.104:0/1808524101 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5f00051c0 0x7fb5f000b9c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00a840 tx=0x7fb5f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87b1aed9260bfb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.846+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00a460 con 0x7fb5f00051c0 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.846+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc02f070 con 0x7fb5f00051c0 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.846+0000 7fb5fbfff640 1 -- 172.21.15.104:0/1808524101 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc02bcb0 con 0x7fb5f00051c0 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.846+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1808524101 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5f00051c0 msgr2=0x7fb5f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.846+0000 7fb60b7d5640 1 --2- 172.21.15.104:0/1808524101 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5f00051c0 0x7fb5f000b9c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00a840 tx=0x7fb5f0005830 comp rx=0 tx=0).stop 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.846+0000 7fb609d72640 1 -- 172.21.15.104:0/1808524101 reap_dead start 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.846+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1808524101 shutdown_connections 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.846+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1808524101 >> 172.21.15.104:0/1808524101 conn(0x7fb604071a10 msgr2=0x7fb604071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:37.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.847+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1808524101 shutdown_connections 2024-05-08T04:24:37.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.847+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1808524101 wait complete. 2024-05-08T04:24:37.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.848+0000 7fb60b7d5640 1 Processor -- start 2024-05-08T04:24:37.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.848+0000 7fb60b7d5640 1 -- start start 2024-05-08T04:24:37.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.848+0000 7fb60b7d5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5f00051c0 0x7fb6041477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:37.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.848+0000 7fb60b7d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb604147ce0 0x7fb604156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:37.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.848+0000 7fb60b7d5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb604157330 0x7fb6040af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:37.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.848+0000 7fb60b7d5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6040ad500 con 0x7fb5f00051c0 2024-05-08T04:24:37.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.848+0000 7fb60b7d5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60406e9b0 con 0x7fb604157330 2024-05-08T04:24:37.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.848+0000 7fb60b7d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60406da70 con 0x7fb604147ce0 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.848+0000 7fb609571640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5f00051c0 0x7fb6041477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb609571640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5f00051c0 0x7fb6041477a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56170/0 (socket says 172.21.15.104:56170) 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb609571640 1 -- 172.21.15.104:0/1598480666 learned_addr learned my addr 172.21.15.104:0/1598480666 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb608d70640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb604147ce0 0x7fb604156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb609d72640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb604157330 0x7fb6040af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb609571640 1 -- 172.21.15.104:0/1598480666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb604147ce0 msgr2=0x7fb604156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb609571640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb604147ce0 0x7fb604156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb609571640 1 -- 172.21.15.104:0/1598480666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb604157330 msgr2=0x7fb6040af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb609571640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb604157330 0x7fb6040af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb609571640 1 -- 172.21.15.104:0/1598480666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb604158fe0 con 0x7fb5f00051c0 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb609d72640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb604157330 0x7fb6040af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb609571640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5f00051c0 0x7fb6041477a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb600010810 tx=0x7fb600010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb5f9ffb640 1 -- 172.21.15.104:0/1598480666 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60001a070 con 0x7fb5f00051c0 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb5f9ffb640 1 -- 172.21.15.104:0/1598480666 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60000c930 con 0x7fb5f00051c0 2024-05-08T04:24:37.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb5f9ffb640 1 -- 172.21.15.104:0/1598480666 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60000f040 con 0x7fb5f00051c0 2024-05-08T04:24:37.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1598480666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb604157960 con 0x7fb5f00051c0 2024-05-08T04:24:37.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.849+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1598480666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb604157f20 con 0x7fb5f00051c0 2024-05-08T04:24:37.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.850+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1598480666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6040af080 con 0x7fb5f00051c0 2024-05-08T04:24:37.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.851+0000 7fb5f9ffb640 1 -- 172.21.15.104:0/1598480666 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fb60001d070 con 0x7fb5f00051c0 2024-05-08T04:24:37.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.851+0000 7fb5f9ffb640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb5e806b6b0 0x7fb5e806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:37.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.851+0000 7fb5f9ffb640 1 -- 172.21.15.104:0/1598480666 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb60008aa90 con 0x7fb5f00051c0 2024-05-08T04:24:37.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.851+0000 7fb608d70640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb5e806b6b0 0x7fb5e806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:37.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.852+0000 7fb608d70640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb5e806b6b0 0x7fb5e806db70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb6041480e0 tx=0x7fb5f4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:37.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:37.856+0000 7fb5f9ffb640 1 -- 172.21.15.104:0/1598480666 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb6040af080 con 0x7fb5f00051c0 2024-05-08T04:24:38.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.060+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1598480666 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb604075010 con 0x7fb5f00051c0 2024-05-08T04:24:38.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.734+0000 7fb5f9ffb640 1 -- 172.21.15.104:0/1598480666 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v26) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb600058fc0 con 0x7fb5f00051c0 2024-05-08T04:24:38.738 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 8 and data pool 9 2024-05-08T04:24:38.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.741+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1598480666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb5e806b6b0 msgr2=0x7fb5e806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:38.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.741+0000 7fb60b7d5640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb5e806b6b0 0x7fb5e806db70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb6041480e0 tx=0x7fb5f4009040 comp rx=0 tx=0).stop 2024-05-08T04:24:38.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.741+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1598480666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5f00051c0 msgr2=0x7fb6041477a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:38.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.741+0000 7fb60b7d5640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5f00051c0 0x7fb6041477a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb600010810 tx=0x7fb600010cd0 comp rx=0 tx=0).stop 2024-05-08T04:24:38.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.742+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1598480666 shutdown_connections 2024-05-08T04:24:38.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.742+0000 7fb60b7d5640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb5e806b6b0 0x7fb5e806db70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:38.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.742+0000 7fb60b7d5640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb604157330 0x7fb6040af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:38.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.742+0000 7fb60b7d5640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb604147ce0 0x7fb604156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:38.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.742+0000 7fb60b7d5640 1 --2- 172.21.15.104:0/1598480666 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5f00051c0 0x7fb6041477a0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:38.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.742+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1598480666 >> 172.21.15.104:0/1598480666 conn(0x7fb604071a10 msgr2=0x7fb60415d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:38.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.744+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1598480666 shutdown_connections 2024-05-08T04:24:38.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.745+0000 7fb60b7d5640 1 -- 172.21.15.104:0/1598480666 wait complete. 2024-05-08T04:24:38.763 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:24:38.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.861+0000 7fdfe0f2b640 1 Processor -- start 2024-05-08T04:24:38.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.861+0000 7fdfe0f2b640 1 -- start start 2024-05-08T04:24:38.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.862+0000 7fdfe0f2b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdfdc15bac0 0x7fdfdc0b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:38.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.862+0000 7fdfe0f2b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc0b1e30 con 0x7fdfdc0b51b0 2024-05-08T04:24:38.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.862+0000 7fdfe0f2b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc0b36c0 con 0x7fdfdc06ab60 2024-05-08T04:24:38.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.862+0000 7fdfe0f2b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc0b1c00 con 0x7fdfdc15bac0 2024-05-08T04:24:38.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.862+0000 7fdfda59c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdfdc15bac0 0x7fdfdc0b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:38.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.862+0000 7fdfda59c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fdfdc15bac0 0x7fdfdc0b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56180/0 (socket says 172.21.15.104:56180) 2024-05-08T04:24:38.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.862+0000 7fdfdad9d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fdfdc0b51b0 0x7fdfdc0ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:47420/0 (socket says 172.21.15.104:47420) 2024-05-08T04:24:38.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.862+0000 7fdfda59c640 1 -- 172.21.15.104:0/2657276030 learned_addr learned my addr 172.21.15.104:0/2657276030 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:38.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.862+0000 7fdfda59c640 1 -- 172.21.15.104:0/2657276030 >> v1:172.21.15.183:6789/0 conn(0x7fdfdc06ab60 legacy=0x7fdfdc0cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:38.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.862+0000 7fdfda59c640 1 -- 172.21.15.104:0/2657276030 >> v1:172.21.15.104:6789/0 conn(0x7fdfdc0b51b0 legacy=0x7fdfdc0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:38.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.862+0000 7fdfd959a640 1 -- 172.21.15.104:0/2657276030 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627924557 0 0) 0x7fdfdc0b1e30 con 0x7fdfdc0b51b0 2024-05-08T04:24:38.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.862+0000 7fdfda59c640 1 -- 172.21.15.104:0/2657276030 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc0b39a0 con 0x7fdfdc15bac0 2024-05-08T04:24:38.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.863+0000 7fdfda59c640 1 --2- 172.21.15.104:0/2657276030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfdc15bac0 0x7fdfdc0b16c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009e50 tx=0x7fdfcc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17643b2f0d74007 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:38.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.863+0000 7fdfd959a640 1 -- 172.21.15.104:0/2657276030 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc036070 con 0x7fdfdc15bac0 2024-05-08T04:24:38.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.863+0000 7fdfd959a640 1 -- 172.21.15.104:0/2657276030 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc031600 con 0x7fdfdc15bac0 2024-05-08T04:24:38.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.863+0000 7fdfd959a640 1 -- 172.21.15.104:0/2657276030 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc0319d0 con 0x7fdfdc15bac0 2024-05-08T04:24:38.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.864+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/2657276030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfdc15bac0 msgr2=0x7fdfdc0b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:38.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.864+0000 7fdfe0f2b640 1 --2- 172.21.15.104:0/2657276030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfdc15bac0 0x7fdfdc0b16c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009e50 tx=0x7fdfcc02a6a0 comp rx=0 tx=0).stop 2024-05-08T04:24:38.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.864+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/2657276030 shutdown_connections 2024-05-08T04:24:38.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.864+0000 7fdfe0f2b640 1 --2- 172.21.15.104:0/2657276030 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfdc15bac0 0x7fdfdc0b16c0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:38.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.864+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/2657276030 >> 172.21.15.104:0/2657276030 conn(0x7fdfdc0b2220 msgr2=0x7fdfdc0b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:38.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.864+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/2657276030 shutdown_connections 2024-05-08T04:24:38.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.864+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/2657276030 wait complete. 2024-05-08T04:24:38.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.865+0000 7fdfe0f2b640 1 Processor -- start 2024-05-08T04:24:38.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.865+0000 7fdfe0f2b640 1 -- start start 2024-05-08T04:24:38.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfe0f2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfdc06ab60 0x7fdfdc154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:38.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfe0f2b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfdc0b51b0 0x7fdfdc0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:38.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfe0f2b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc15bac0 0x7fdfdc0ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:38.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfe0f2b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0cd1c0 con 0x7fdfdc06ab60 2024-05-08T04:24:38.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfe0f2b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0b3d10 con 0x7fdfdc0b51b0 2024-05-08T04:24:38.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfe0f2b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc15bea0 con 0x7fdfdc15bac0 2024-05-08T04:24:38.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfda59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfdc06ab60 0x7fdfdc154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:38.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfda59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfdc06ab60 0x7fdfdc154e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56186/0 (socket says 172.21.15.104:56186) 2024-05-08T04:24:38.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfda59c640 1 -- 172.21.15.104:0/1116802154 learned_addr learned my addr 172.21.15.104:0/1116802154 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:38.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfdad9d640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc15bac0 0x7fdfdc0ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:38.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfd9d9b640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfdc0b51b0 0x7fdfdc0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:38.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfda59c640 1 -- 172.21.15.104:0/1116802154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc15bac0 msgr2=0x7fdfdc0ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:38.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfda59c640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc15bac0 0x7fdfdc0ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:38.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfda59c640 1 -- 172.21.15.104:0/1116802154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfdc0b51b0 msgr2=0x7fdfdc0c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:38.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfda59c640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfdc0b51b0 0x7fdfdc0c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:38.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.866+0000 7fdfda59c640 1 -- 172.21.15.104:0/1116802154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc0c4e40 con 0x7fdfdc06ab60 2024-05-08T04:24:38.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.867+0000 7fdfda59c640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfdc06ab60 0x7fdfdc154e00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009e50 tx=0x7fdfcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:38.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.867+0000 7fdfcaffd640 1 -- 172.21.15.104:0/1116802154 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc036050 con 0x7fdfdc06ab60 2024-05-08T04:24:38.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.867+0000 7fdfcaffd640 1 -- 172.21.15.104:0/1116802154 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc042070 con 0x7fdfdc06ab60 2024-05-08T04:24:38.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.867+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/1116802154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfdc0c5120 con 0x7fdfdc06ab60 2024-05-08T04:24:38.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.867+0000 7fdfcaffd640 1 -- 172.21.15.104:0/1116802154 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc007c50 con 0x7fdfdc06ab60 2024-05-08T04:24:38.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.867+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/1116802154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc0c56e0 con 0x7fdfdc06ab60 2024-05-08T04:24:38.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.868+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/1116802154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc075010 con 0x7fdfdc06ab60 2024-05-08T04:24:38.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.868+0000 7fdfcaffd640 1 -- 172.21.15.104:0/1116802154 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fdfcc047460 con 0x7fdfdc06ab60 2024-05-08T04:24:38.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.869+0000 7fdfcaffd640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdfbc06b680 0x7fdfbc06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:38.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.869+0000 7fdfd9d9b640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdfbc06b680 0x7fdfbc06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:38.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.869+0000 7fdfcaffd640 1 -- 172.21.15.104:0/1116802154 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfcc0ab6f0 con 0x7fdfdc06ab60 2024-05-08T04:24:38.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.869+0000 7fdfd9d9b640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdfbc06b680 0x7fdfbc06db40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc06b830 tx=0x7fdfd0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:38.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:38.873+0000 7fdfcaffd640 1 -- 172.21.15.104:0/1116802154 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdfcc045360 con 0x7fdfdc06ab60 2024-05-08T04:24:39.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.045+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/1116802154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfdc06ee00 con 0x7fdfdc06ab60 2024-05-08T04:24:39.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.046+0000 7fdfcaffd640 1 -- 172.21.15.104:0/1116802154 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16738 (secure 0 0 0) 0x7fdfcc07a1e0 con 0x7fdfdc06ab60 2024-05-08T04:24:39.048 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:39.048 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":58,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:24:38.062940+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:24:36.286493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-08T04:24:37.038502+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:24:39.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.048+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/1116802154 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdfbc06b680 msgr2=0x7fdfbc06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.048+0000 7fdfe0f2b640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdfbc06b680 0x7fdfbc06db40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc06b830 tx=0x7fdfd0009040 comp rx=0 tx=0).stop 2024-05-08T04:24:39.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.048+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/1116802154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfdc06ab60 msgr2=0x7fdfdc154e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.048+0000 7fdfe0f2b640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfdc06ab60 0x7fdfdc154e00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009e50 tx=0x7fdfcc004a40 comp rx=0 tx=0).stop 2024-05-08T04:24:39.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.048+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/1116802154 shutdown_connections 2024-05-08T04:24:39.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.048+0000 7fdfe0f2b640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdfbc06b680 0x7fdfbc06db40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.048+0000 7fdfe0f2b640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfdc0b51b0 0x7fdfdc0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.048+0000 7fdfe0f2b640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfdc15bac0 0x7fdfdc0ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.048+0000 7fdfe0f2b640 1 --2- 172.21.15.104:0/1116802154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdfdc06ab60 0x7fdfdc154e00 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.048+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/1116802154 >> 172.21.15.104:0/1116802154 conn(0x7fdfdc0b2220 msgr2=0x7fdfdc0cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:39.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.048+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/1116802154 shutdown_connections 2024-05-08T04:24:39.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.048+0000 7fdfe0f2b640 1 -- 172.21.15.104:0/1116802154 wait complete. 2024-05-08T04:24:39.061 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:24:39.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.158+0000 7f6ca2b29640 1 Processor -- start 2024-05-08T04:24:39.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.158+0000 7f6ca2b29640 1 -- start start 2024-05-08T04:24:39.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.159+0000 7f6ca2b29640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6c9c15edf0 0x7f6c9c0b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.159+0000 7f6ca2b29640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9c0d15c0 con 0x7f6c9c070c70 2024-05-08T04:24:39.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.159+0000 7f6ca2b29640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9c15f550 con 0x7f6c9c157ac0 2024-05-08T04:24:39.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.159+0000 7f6ca2b29640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9c06bc70 con 0x7f6c9c15edf0 2024-05-08T04:24:39.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.159+0000 7f6c9bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6c9c15edf0 0x7f6c9c0b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.159+0000 7f6c9bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6c9c15edf0 0x7f6c9c0b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56198/0 (socket says 172.21.15.104:56198) 2024-05-08T04:24:39.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.159+0000 7f6c9bfff640 1 -- 172.21.15.104:0/1590281459 learned_addr learned my addr 172.21.15.104:0/1590281459 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:39.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.159+0000 7f6ca08c5640 1 --1- 172.21.15.104:0/1590281459 >> v1:172.21.15.104:6789/0 conn(0x7f6c9c070c70 0x7f6c9c071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:47430/0 (socket says 172.21.15.104:47430) 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.159+0000 7f6c9bfff640 1 -- 172.21.15.104:0/1590281459 >> v1:172.21.15.183:6789/0 conn(0x7f6c9c157ac0 legacy=0x7f6c9c157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.159+0000 7f6c9bfff640 1 -- 172.21.15.104:0/1590281459 >> v1:172.21.15.104:6789/0 conn(0x7f6c9c070c70 legacy=0x7f6c9c071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.160+0000 7f6c9b7fe640 1 -- 172.21.15.104:0/1590281459 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859410326 0 0) 0x7f6c9c0d15c0 con 0x7f6c9c070c70 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.160+0000 7f6c9bfff640 1 -- 172.21.15.104:0/1590281459 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c15f830 con 0x7f6c9c15edf0 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.160+0000 7f6c9bfff640 1 --2- 172.21.15.104:0/1590281459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c9c15edf0 0x7f6c9c0b52a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009870 tx=0x7f6c8802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff53ccfab0218998 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.160+0000 7f6c9b7fe640 1 -- 172.21.15.104:0/1590281459 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88037070 con 0x7f6c9c15edf0 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.160+0000 7f6c9b7fe640 1 -- 172.21.15.104:0/1590281459 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c88032440 con 0x7f6c9c15edf0 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.160+0000 7f6c9b7fe640 1 -- 172.21.15.104:0/1590281459 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88032810 con 0x7f6c9c15edf0 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.161+0000 7f6ca2b29640 1 -- 172.21.15.104:0/1590281459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c9c15edf0 msgr2=0x7f6c9c0b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.161+0000 7f6ca2b29640 1 --2- 172.21.15.104:0/1590281459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c9c15edf0 0x7f6c9c0b52a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009870 tx=0x7f6c8802a2a0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.161+0000 7f6ca2b29640 1 -- 172.21.15.104:0/1590281459 shutdown_connections 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.161+0000 7f6ca2b29640 1 --2- 172.21.15.104:0/1590281459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c9c15edf0 0x7f6c9c0b52a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.161+0000 7f6ca2b29640 1 -- 172.21.15.104:0/1590281459 >> 172.21.15.104:0/1590281459 conn(0x7f6c9c0b3450 msgr2=0x7f6c9c0b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:39.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.161+0000 7f6ca2b29640 1 -- 172.21.15.104:0/1590281459 shutdown_connections 2024-05-08T04:24:39.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.161+0000 7f6ca2b29640 1 -- 172.21.15.104:0/1590281459 wait complete. 2024-05-08T04:24:39.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.162+0000 7f6ca2b29640 1 Processor -- start 2024-05-08T04:24:39.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.162+0000 7f6ca2b29640 1 -- start start 2024-05-08T04:24:39.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6ca2b29640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c9c070c70 0x7f6c9c1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6ca2b29640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c9c157ac0 0x7f6c9c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6ca2b29640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c9c15edf0 0x7f6c9c14c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6ca2b29640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0b57e0 con 0x7f6c9c157ac0 2024-05-08T04:24:39.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6ca2b29640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0b5b80 con 0x7f6c9c070c70 2024-05-08T04:24:39.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6ca2b29640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0b5960 con 0x7f6c9c15edf0 2024-05-08T04:24:39.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6c9bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c9c157ac0 0x7f6c9c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6c9bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c9c157ac0 0x7f6c9c0cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56214/0 (socket says 172.21.15.104:56214) 2024-05-08T04:24:39.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6c9bfff640 1 -- 172.21.15.104:0/3500415555 learned_addr learned my addr 172.21.15.104:0/3500415555 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:39.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6c9bfff640 1 -- 172.21.15.104:0/3500415555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c9c15edf0 msgr2=0x7f6c9c14c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6c9bfff640 1 --2- 172.21.15.104:0/3500415555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c9c15edf0 0x7f6c9c14c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6c9bfff640 1 -- 172.21.15.104:0/3500415555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c9c070c70 msgr2=0x7f6c9c1462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6c9bfff640 1 --2- 172.21.15.104:0/3500415555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c9c070c70 0x7f6c9c1462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.163+0000 7f6c9bfff640 1 -- 172.21.15.104:0/3500415555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c0caad0 con 0x7f6c9c157ac0 2024-05-08T04:24:39.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.164+0000 7f6c9bfff640 1 --2- 172.21.15.104:0/3500415555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c9c157ac0 0x7f6c9c0cbb70 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6c880090b0 tx=0x7f6c880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:39.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.164+0000 7f6c997fa640 1 -- 172.21.15.104:0/3500415555 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88041070 con 0x7f6c9c157ac0 2024-05-08T04:24:39.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.164+0000 7f6c997fa640 1 -- 172.21.15.104:0/3500415555 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8803c890 con 0x7f6c9c157ac0 2024-05-08T04:24:39.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.164+0000 7f6ca2b29640 1 -- 172.21.15.104:0/3500415555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9c0cadb0 con 0x7f6c9c157ac0 2024-05-08T04:24:39.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.164+0000 7f6c997fa640 1 -- 172.21.15.104:0/3500415555 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88037040 con 0x7f6c9c157ac0 2024-05-08T04:24:39.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.164+0000 7f6ca2b29640 1 -- 172.21.15.104:0/3500415555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9c0cb370 con 0x7f6c9c157ac0 2024-05-08T04:24:39.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.165+0000 7f6ca2b29640 1 -- 172.21.15.104:0/3500415555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c9c075010 con 0x7f6c9c157ac0 2024-05-08T04:24:39.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.165+0000 7f6c997fa640 1 -- 172.21.15.104:0/3500415555 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f6c88044070 con 0x7f6c9c157ac0 2024-05-08T04:24:39.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.166+0000 7f6c997fa640 1 --2- 172.21.15.104:0/3500415555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c8006b680 0x7f6c8006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.166+0000 7f6c997fa640 1 -- 172.21.15.104:0/3500415555 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c880ab360 con 0x7f6c9c157ac0 2024-05-08T04:24:39.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.166+0000 7f6ca08c5640 1 --2- 172.21.15.104:0/3500415555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c8006b680 0x7f6c8006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.166+0000 7f6ca08c5640 1 --2- 172.21.15.104:0/3500415555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c8006b680 0x7f6c8006db40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6c90007fd0 tx=0x7f6c90007920 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:39.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.170+0000 7f6c997fa640 1 -- 172.21.15.104:0/3500415555 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c8807a080 con 0x7f6c9c157ac0 2024-05-08T04:24:39.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.342+0000 7f6ca2b29640 1 -- 172.21.15.104:0/3500415555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c9c0b10a0 con 0x7f6c9c157ac0 2024-05-08T04:24:39.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.343+0000 7f6c997fa640 1 -- 172.21.15.104:0/3500415555 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16738 (secure 0 0 0) 0x7f6c88079980 con 0x7f6c9c157ac0 2024-05-08T04:24:39.346 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:39.346 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":58,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:24:38.062940+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:24:36.286493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-08T04:24:37.038502+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:24:39.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.345+0000 7f6ca2b29640 1 -- 172.21.15.104:0/3500415555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c8006b680 msgr2=0x7f6c8006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.345+0000 7f6ca2b29640 1 --2- 172.21.15.104:0/3500415555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c8006b680 0x7f6c8006db40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6c90007fd0 tx=0x7f6c90007920 comp rx=0 tx=0).stop 2024-05-08T04:24:39.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.345+0000 7f6ca2b29640 1 -- 172.21.15.104:0/3500415555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c9c157ac0 msgr2=0x7f6c9c0cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.345+0000 7f6ca2b29640 1 --2- 172.21.15.104:0/3500415555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c9c157ac0 0x7f6c9c0cbb70 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6c880090b0 tx=0x7f6c880046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.345+0000 7f6ca2b29640 1 -- 172.21.15.104:0/3500415555 shutdown_connections 2024-05-08T04:24:39.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.345+0000 7f6ca2b29640 1 --2- 172.21.15.104:0/3500415555 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c8006b680 0x7f6c8006db40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.345+0000 7f6ca2b29640 1 --2- 172.21.15.104:0/3500415555 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c9c15edf0 0x7f6c9c14c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.345+0000 7f6ca2b29640 1 --2- 172.21.15.104:0/3500415555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c9c157ac0 0x7f6c9c0cbb70 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.345+0000 7f6ca2b29640 1 --2- 172.21.15.104:0/3500415555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c9c070c70 0x7f6c9c1462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.345+0000 7f6ca2b29640 1 -- 172.21.15.104:0/3500415555 >> 172.21.15.104:0/3500415555 conn(0x7f6c9c0b3450 msgr2=0x7f6c9c0b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:39.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.345+0000 7f6ca2b29640 1 -- 172.21.15.104:0/3500415555 shutdown_connections 2024-05-08T04:24:39.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.345+0000 7f6ca2b29640 1 -- 172.21.15.104:0/3500415555 wait complete. 2024-05-08T04:24:39.359 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T04:24:39.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.458+0000 7fd26177e640 1 Processor -- start 2024-05-08T04:24:39.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.458+0000 7fd26177e640 1 -- start start 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.459+0000 7fd26177e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd25c15de10 0x7fd25c161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.459+0000 7fd26177e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd25c0ce5a0 0x7fd25c0d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.459+0000 7fd26177e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25c0d3210 con 0x7fd25c0d05f0 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.459+0000 7fd26177e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c0d0f50 con 0x7fd25c0ce5a0 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.459+0000 7fd26177e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c161e60 con 0x7fd25c15de10 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.459+0000 7fd25b7fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fd25c0d05f0 0x7fd25c0b54a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:47442/0 (socket says 172.21.15.104:47442) 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.459+0000 7fd25b7fe640 1 -- 172.21.15.104:0/2792712956 learned_addr learned my addr 172.21.15.104:0/2792712956 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.459+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 858853455 0 0) 0x7fd25c0d3210 con 0x7fd25c0d05f0 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.459+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd248003520 con 0x7fd25c0d05f0 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.459+0000 7fd2527fc640 1 --2- 172.21.15.104:0/2792712956 >> v2:172.21.15.183:3300/0 conn(0x7fd25c0ce5a0 0x7fd25c0d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.459+0000 7fd25affd640 1 --2- 172.21.15.104:0/2792712956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd25c15de10 0x7fd25c161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 866804535 0 0) 0x7fd248003520 con 0x7fd25c0d05f0 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd25c15de10 msgr2=0x7fd25c161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:39.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 --2- 172.21.15.104:0/2792712956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd25c15de10 0x7fd25c161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 >> v2:172.21.15.183:3300/0 conn(0x7fd25c0ce5a0 msgr2=0x7fd25c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 --2- 172.21.15.104:0/2792712956 >> v2:172.21.15.183:3300/0 conn(0x7fd25c0ce5a0 0x7fd25c0d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c15e1f0 con 0x7fd25c0d05f0 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fd2540019f0 con 0x7fd25c0d05f0 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25affd640 1 --2- 172.21.15.104:0/2792712956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd25c15de10 0x7fd25c161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 >> v1:172.21.15.104:6789/0 conn(0x7fd25c0d05f0 legacy=0x7fd25c0b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 --2- 172.21.15.104:0/2792712956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd25c15de10 0x7fd2480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 --2- 172.21.15.104:0/2792712956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd248003ef0 0x7fd248004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 --2- 172.21.15.104:0/2792712956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd248004d40 0x7fd2480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c0d0f50 con 0x7fd248003ef0 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24800b9f0 con 0x7fd248004d40 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24800bbf0 con 0x7fd25c15de10 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd2527fc640 1 --2- 172.21.15.104:0/2792712956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd248003ef0 0x7fd248004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25affd640 1 --2- 172.21.15.104:0/2792712956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd25c15de10 0x7fd2480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd25b7fe640 1 --2- 172.21.15.104:0/2792712956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd248004d40 0x7fd2480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd2527fc640 1 -- 172.21.15.104:0/2792712956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd25c15de10 msgr2=0x7fd2480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd2527fc640 1 --2- 172.21.15.104:0/2792712956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd25c15de10 0x7fd2480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd2527fc640 1 -- 172.21.15.104:0/2792712956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd248004d40 msgr2=0x7fd2480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd2527fc640 1 --2- 172.21.15.104:0/2792712956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd248004d40 0x7fd2480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.460+0000 7fd2527fc640 1 -- 172.21.15.104:0/2792712956 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd248003520 con 0x7fd248003ef0 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.461+0000 7fd2527fc640 1 --2- 172.21.15.104:0/2792712956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd248003ef0 0x7fd248004800 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd244009ac0 tx=0x7fd248005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840b3888e92e83f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.461+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244036070 con 0x7fd248003ef0 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.461+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd244031400 con 0x7fd248003ef0 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.461+0000 7fd25a7fc640 1 -- 172.21.15.104:0/2792712956 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244009690 con 0x7fd248003ef0 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.461+0000 7fd26177e640 1 -- 172.21.15.104:0/2792712956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd248003ef0 msgr2=0x7fd248004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.461+0000 7fd26177e640 1 --2- 172.21.15.104:0/2792712956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd248003ef0 0x7fd248004800 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd244009ac0 tx=0x7fd248005830 comp rx=0 tx=0).stop 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.461+0000 7fd25b7fe640 1 -- 172.21.15.104:0/2792712956 reap_dead start 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.462+0000 7fd26177e640 1 -- 172.21.15.104:0/2792712956 shutdown_connections 2024-05-08T04:24:39.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.462+0000 7fd26177e640 1 -- 172.21.15.104:0/2792712956 >> 172.21.15.104:0/2792712956 conn(0x7fd25c072290 msgr2=0x7fd25c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:39.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.462+0000 7fd26177e640 1 -- 172.21.15.104:0/2792712956 shutdown_connections 2024-05-08T04:24:39.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.462+0000 7fd26177e640 1 -- 172.21.15.104:0/2792712956 wait complete. 2024-05-08T04:24:39.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.463+0000 7fd26177e640 1 Processor -- start 2024-05-08T04:24:39.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.463+0000 7fd26177e640 1 -- start start 2024-05-08T04:24:39.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd26177e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd248003ef0 0x7fd25c0b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd26177e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25c1606b0 0x7fd25c1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd26177e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd25c160b30 0x7fd25c148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd26177e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c162090 con 0x7fd25c160b30 2024-05-08T04:24:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd26177e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c0d1a90 con 0x7fd25c1606b0 2024-05-08T04:24:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd26177e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c162370 con 0x7fd248003ef0 2024-05-08T04:24:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd25b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd25c160b30 0x7fd25c148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd25b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd25c160b30 0x7fd25c148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56246/0 (socket says 172.21.15.104:56246) 2024-05-08T04:24:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd25b7fe640 1 -- 172.21.15.104:0/1836079584 learned_addr learned my addr 172.21.15.104:0/1836079584 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd25affd640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd248003ef0 0x7fd25c0b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd2527fc640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25c1606b0 0x7fd25c1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd25b7fe640 1 -- 172.21.15.104:0/1836079584 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd248003ef0 msgr2=0x7fd25c0b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd25b7fe640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd248003ef0 0x7fd25c0b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd25b7fe640 1 -- 172.21.15.104:0/1836079584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25c1606b0 msgr2=0x7fd25c1598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd25b7fe640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25c1606b0 0x7fd25c1598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd25b7fe640 1 -- 172.21.15.104:0/1836079584 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c0b6350 con 0x7fd25c160b30 2024-05-08T04:24:39.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd25b7fe640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd25c160b30 0x7fd25c148050 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0d3630 tx=0x7fd254007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:39.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd253fff640 1 -- 172.21.15.104:0/1836079584 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25400acd0 con 0x7fd25c160b30 2024-05-08T04:24:39.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd253fff640 1 -- 172.21.15.104:0/1836079584 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd254018070 con 0x7fd25c160b30 2024-05-08T04:24:39.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd26177e640 1 -- 172.21.15.104:0/1836079584 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c1563b0 con 0x7fd25c160b30 2024-05-08T04:24:39.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd253fff640 1 -- 172.21.15.104:0/1836079584 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254013630 con 0x7fd25c160b30 2024-05-08T04:24:39.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.464+0000 7fd26177e640 1 -- 172.21.15.104:0/1836079584 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25c15f8f0 con 0x7fd25c160b30 2024-05-08T04:24:39.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.465+0000 7fd26177e640 1 -- 172.21.15.104:0/1836079584 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25c075010 con 0x7fd25c160b30 2024-05-08T04:24:39.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.466+0000 7fd253fff640 1 -- 172.21.15.104:0/1836079584 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fd2540137d0 con 0x7fd25c160b30 2024-05-08T04:24:39.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.466+0000 7fd253fff640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd23c06b6b0 0x7fd23c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.466+0000 7fd253fff640 1 -- 172.21.15.104:0/1836079584 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd25408aa40 con 0x7fd25c160b30 2024-05-08T04:24:39.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.466+0000 7fd25affd640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd23c06b6b0 0x7fd23c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.467+0000 7fd25affd640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd23c06b6b0 0x7fd23c06db70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd24c006fa0 tx=0x7fd24c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:39.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.470+0000 7fd253fff640 1 -- 172.21.15.104:0/1836079584 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd254058ff0 con 0x7fd25c160b30 2024-05-08T04:24:39.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.678+0000 7fd26177e640 1 -- 172.21.15.104:0/1836079584 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd25c0d29a0 con 0x7fd25c160b30 2024-05-08T04:24:39.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.734+0000 7fd253fff640 1 -- 172.21.15.104:0/1836079584 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd25408ae20 con 0x7fd25c160b30 2024-05-08T04:24:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.736+0000 7fd26177e640 1 -- 172.21.15.104:0/1836079584 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd23c06b6b0 msgr2=0x7fd23c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.736+0000 7fd26177e640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd23c06b6b0 0x7fd23c06db70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd24c006fa0 tx=0x7fd24c008040 comp rx=0 tx=0).stop 2024-05-08T04:24:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.736+0000 7fd26177e640 1 -- 172.21.15.104:0/1836079584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd25c160b30 msgr2=0x7fd25c148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.736+0000 7fd26177e640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd25c160b30 0x7fd25c148050 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0d3630 tx=0x7fd254007b20 comp rx=0 tx=0).stop 2024-05-08T04:24:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.736+0000 7fd26177e640 1 -- 172.21.15.104:0/1836079584 shutdown_connections 2024-05-08T04:24:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.736+0000 7fd26177e640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fd23c06b6b0 0x7fd23c06db70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.736+0000 7fd26177e640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd25c1606b0 0x7fd25c1598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.736+0000 7fd26177e640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd25c160b30 0x7fd25c148050 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.736+0000 7fd26177e640 1 --2- 172.21.15.104:0/1836079584 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd248003ef0 0x7fd25c0b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.736+0000 7fd26177e640 1 -- 172.21.15.104:0/1836079584 >> 172.21.15.104:0/1836079584 conn(0x7fd25c072290 msgr2=0x7fd25c0cabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:39.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.737+0000 7fd26177e640 1 -- 172.21.15.104:0/1836079584 shutdown_connections 2024-05-08T04:24:39.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.737+0000 7fd26177e640 1 -- 172.21.15.104:0/1836079584 wait complete. 2024-05-08T04:24:39.750 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-08T04:24:39.751 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-08T04:24:39.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.851+0000 7fde0c3e7640 1 Processor -- start 2024-05-08T04:24:39.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.851+0000 7fde0c3e7640 1 -- start start 2024-05-08T04:24:39.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde0c3e7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fde0415edf0 0x7fde040b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde0c3e7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde04157ac0 0x7fde04157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde0c3e7640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde040d15c0 con 0x7fde04070c70 2024-05-08T04:24:39.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde0c3e7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0406bc70 con 0x7fde0415edf0 2024-05-08T04:24:39.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde0c3e7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0415f550 con 0x7fde04157ac0 2024-05-08T04:24:39.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde0a183640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fde04070c70 0x7fde04071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:47448/0 (socket says 172.21.15.104:47448) 2024-05-08T04:24:39.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde0a183640 1 -- 172.21.15.104:0/1965927882 learned_addr learned my addr 172.21.15.104:0/1965927882 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:39.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde09982640 1 --2- 172.21.15.104:0/1965927882 >> v2:172.21.15.183:3300/0 conn(0x7fde0415edf0 0x7fde040b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde0a984640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde04157ac0 0x7fde04157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131965426 0 0) 0x7fde040d15c0 con 0x7fde04070c70 2024-05-08T04:24:39.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf0003520 con 0x7fde04070c70 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 259105441 0 0) 0x7fddf0003520 con 0x7fde04070c70 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde04157ac0 msgr2=0x7fde04157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde09181640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde04157ac0 0x7fde04157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 >> v2:172.21.15.183:3300/0 conn(0x7fde0415edf0 msgr2=0x7fde040b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde09181640 1 --2- 172.21.15.104:0/1965927882 >> v2:172.21.15.183:3300/0 conn(0x7fde0415edf0 0x7fde040b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0415f830 con 0x7fde04070c70 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fde00001670 con 0x7fde04070c70 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 >> v1:172.21.15.104:6789/0 conn(0x7fde04070c70 legacy=0x7fde04071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.852+0000 7fde09181640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fddf00039b0 0x7fddf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde09181640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde04157ac0 0x7fddf0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde09181640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf0004d40 0x7fddf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0415f550 con 0x7fddf00039b0 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000b9c0 con 0x7fddf0004d40 2024-05-08T04:24:39.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000bb40 con 0x7fde04157ac0 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde0a183640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fddf00039b0 0x7fddf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde09982640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde04157ac0 0x7fddf0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde0a984640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf0004d40 0x7fddf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde0a183640 1 -- 172.21.15.104:0/1965927882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde04157ac0 msgr2=0x7fddf0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde0a183640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde04157ac0 0x7fddf0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde0a183640 1 -- 172.21.15.104:0/1965927882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf0004d40 msgr2=0x7fddf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde0a183640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf0004d40 0x7fddf00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde0a183640 1 -- 172.21.15.104:0/1965927882 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0003520 con 0x7fddf00039b0 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde0a984640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf0004d40 0x7fddf00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.853+0000 7fde09982640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde04157ac0 0x7fddf0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.854+0000 7fde0a183640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fddf00039b0 0x7fddf0003dd0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fde00001050 tx=0x7fddf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd3ce4441c77005 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.854+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0002e070 con 0x7fddf00039b0 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.854+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde00005af0 con 0x7fddf00039b0 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.854+0000 7fde09181640 1 -- 172.21.15.104:0/1965927882 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00007d70 con 0x7fddf00039b0 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.854+0000 7fde0c3e7640 1 -- 172.21.15.104:0/1965927882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fddf00039b0 msgr2=0x7fddf0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.854+0000 7fde0c3e7640 1 --2- 172.21.15.104:0/1965927882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fddf00039b0 0x7fddf0003dd0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fde00001050 tx=0x7fddf0005830 comp rx=0 tx=0).stop 2024-05-08T04:24:39.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.854+0000 7fde0a984640 1 -- 172.21.15.104:0/1965927882 reap_dead start 2024-05-08T04:24:39.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.854+0000 7fde0c3e7640 1 -- 172.21.15.104:0/1965927882 shutdown_connections 2024-05-08T04:24:39.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.854+0000 7fde0c3e7640 1 -- 172.21.15.104:0/1965927882 >> 172.21.15.104:0/1965927882 conn(0x7fde040b3450 msgr2=0x7fde040b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:39.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.854+0000 7fde0c3e7640 1 -- 172.21.15.104:0/1965927882 shutdown_connections 2024-05-08T04:24:39.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.854+0000 7fde0c3e7640 1 -- 172.21.15.104:0/1965927882 wait complete. 2024-05-08T04:24:39.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.855+0000 7fde0c3e7640 1 Processor -- start 2024-05-08T04:24:39.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.856+0000 7fde0c3e7640 1 -- start start 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.856+0000 7fde0c3e7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf00039b0 0x7fde04156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.856+0000 7fde0c3e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde040cc5a0 0x7fde04161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.856+0000 7fde0c3e7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde041618a0 0x7fde0415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.856+0000 7fde0c3e7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040b57e0 con 0x7fde040cc5a0 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.856+0000 7fde0c3e7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040b5b80 con 0x7fddf00039b0 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.856+0000 7fde0c3e7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde040b5960 con 0x7fde041618a0 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.856+0000 7fde09982640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde040cc5a0 0x7fde04161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.856+0000 7fde09982640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde040cc5a0 0x7fde04161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56266/0 (socket says 172.21.15.104:56266) 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.856+0000 7fde09982640 1 -- 172.21.15.104:0/289386408 learned_addr learned my addr 172.21.15.104:0/289386408 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.857+0000 7fde09982640 1 -- 172.21.15.104:0/289386408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde041618a0 msgr2=0x7fde0415aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.857+0000 7fde0a183640 1 --2- 172.21.15.104:0/289386408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf00039b0 0x7fde04156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.857+0000 7fde09982640 1 --2- 172.21.15.104:0/289386408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde041618a0 0x7fde0415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.857+0000 7fde09982640 1 -- 172.21.15.104:0/289386408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf00039b0 msgr2=0x7fde04156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:39.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.857+0000 7fde09982640 1 --2- 172.21.15.104:0/289386408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf00039b0 0x7fde04156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:39.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.857+0000 7fde09982640 1 -- 172.21.15.104:0/289386408 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde04159630 con 0x7fde040cc5a0 2024-05-08T04:24:39.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.857+0000 7fde09982640 1 --2- 172.21.15.104:0/289386408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde040cc5a0 0x7fde04161360 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fddf4011590 tx=0x7fddf4011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:39.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.857+0000 7fddfaffd640 1 -- 172.21.15.104:0/289386408 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4015870 con 0x7fde040cc5a0 2024-05-08T04:24:39.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.857+0000 7fddfaffd640 1 -- 172.21.15.104:0/289386408 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4015a10 con 0x7fde040cc5a0 2024-05-08T04:24:39.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.857+0000 7fde0c3e7640 1 -- 172.21.15.104:0/289386408 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde040cc170 con 0x7fde040cc5a0 2024-05-08T04:24:39.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.857+0000 7fddfaffd640 1 -- 172.21.15.104:0/289386408 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4015dc0 con 0x7fde040cc5a0 2024-05-08T04:24:39.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.857+0000 7fde0c3e7640 1 -- 172.21.15.104:0/289386408 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde04158fe0 con 0x7fde040cc5a0 2024-05-08T04:24:39.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.858+0000 7fde0c3e7640 1 -- 172.21.15.104:0/289386408 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde04075010 con 0x7fde040cc5a0 2024-05-08T04:24:39.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.858+0000 7fddfaffd640 1 -- 172.21.15.104:0/289386408 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fddf401d400 con 0x7fde040cc5a0 2024-05-08T04:24:39.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.859+0000 7fddfaffd640 1 --2- 172.21.15.104:0/289386408 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdde806b6b0 0x7fdde806db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:39.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.859+0000 7fddfaffd640 1 -- 172.21.15.104:0/289386408 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddf408ac50 con 0x7fde040cc5a0 2024-05-08T04:24:39.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.859+0000 7fde0a183640 1 --2- 172.21.15.104:0/289386408 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdde806b6b0 0x7fdde806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:39.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.859+0000 7fde0a183640 1 --2- 172.21.15.104:0/289386408 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdde806b6b0 0x7fdde806db70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fde00033000 tx=0x7fde00009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:39.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:39.863+0000 7fddfaffd640 1 -- 172.21.15.104:0/289386408 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fddf4090020 con 0x7fde040cc5a0 2024-05-08T04:24:40.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.067+0000 7fde0c3e7640 1 -- 172.21.15.104:0/289386408 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fde040cab00 con 0x7fde040cc5a0 2024-05-08T04:24:40.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.747+0000 7fddfaffd640 1 -- 172.21.15.104:0/289386408 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7fde040cab00 con 0x7fde040cc5a0 2024-05-08T04:24:40.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.749+0000 7fde0c3e7640 1 -- 172.21.15.104:0/289386408 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdde806b6b0 msgr2=0x7fdde806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:40.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.749+0000 7fde0c3e7640 1 --2- 172.21.15.104:0/289386408 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdde806b6b0 0x7fdde806db70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fde00033000 tx=0x7fde00009030 comp rx=0 tx=0).stop 2024-05-08T04:24:40.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.750+0000 7fde0c3e7640 1 -- 172.21.15.104:0/289386408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde040cc5a0 msgr2=0x7fde04161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:40.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.750+0000 7fde0c3e7640 1 --2- 172.21.15.104:0/289386408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde040cc5a0 0x7fde04161360 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fddf4011590 tx=0x7fddf4011a50 comp rx=0 tx=0).stop 2024-05-08T04:24:40.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.750+0000 7fde0c3e7640 1 -- 172.21.15.104:0/289386408 shutdown_connections 2024-05-08T04:24:40.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.750+0000 7fde0c3e7640 1 --2- 172.21.15.104:0/289386408 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdde806b6b0 0x7fdde806db70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:40.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.750+0000 7fde0c3e7640 1 --2- 172.21.15.104:0/289386408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde041618a0 0x7fde0415aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:40.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.750+0000 7fde0c3e7640 1 --2- 172.21.15.104:0/289386408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde040cc5a0 0x7fde04161360 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:40.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.750+0000 7fde0c3e7640 1 --2- 172.21.15.104:0/289386408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fddf00039b0 0x7fde04156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:40.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.750+0000 7fde0c3e7640 1 -- 172.21.15.104:0/289386408 >> 172.21.15.104:0/289386408 conn(0x7fde040b3450 msgr2=0x7fde0415c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:40.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.750+0000 7fde0c3e7640 1 -- 172.21.15.104:0/289386408 shutdown_connections 2024-05-08T04:24:40.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.750+0000 7fde0c3e7640 1 -- 172.21.15.104:0/289386408 wait complete. 2024-05-08T04:24:40.764 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-08T04:24:40.764 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:40.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.863+0000 7f5153e1f640 1 Processor -- start 2024-05-08T04:24:40.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.864+0000 7f5153e1f640 1 -- start start 2024-05-08T04:24:40.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.864+0000 7f5153e1f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f514c0ce5a0 0x7f514c161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:40.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.864+0000 7f5153e1f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f514c0d07c0 0x7f514c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:40.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.864+0000 7f5153e1f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c15e1f0 con 0x7f514c15de10 2024-05-08T04:24:40.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.864+0000 7f5153e1f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c0d0f50 con 0x7f514c0d07c0 2024-05-08T04:24:40.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.864+0000 7f5153e1f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c161e60 con 0x7f514c0ce5a0 2024-05-08T04:24:40.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.865+0000 7f51513ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f514c0ce5a0 0x7f514c161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:40.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.865+0000 7f51513ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f514c0ce5a0 0x7f514c161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:49570/0 (socket says 172.21.15.104:49570) 2024-05-08T04:24:40.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.865+0000 7f51523bc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f514c0d07c0 0x7f514c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:40.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.865+0000 7f51513ba640 1 -- 172.21.15.104:0/3324633402 learned_addr learned my addr 172.21.15.104:0/3324633402 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:40.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.865+0000 7f51513ba640 1 -- 172.21.15.104:0/3324633402 >> v2:172.21.15.183:3300/0 conn(0x7f514c0d07c0 msgr2=0x7f514c0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:40.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.865+0000 7f51513ba640 1 --2- 172.21.15.104:0/3324633402 >> v2:172.21.15.183:3300/0 conn(0x7f514c0d07c0 0x7f514c0d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:40.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.865+0000 7f51513ba640 1 -- 172.21.15.104:0/3324633402 >> v1:172.21.15.183:6789/0 conn(0x7f514c15de10 legacy=0x7f514c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:40.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.865+0000 7f51513ba640 1 -- 172.21.15.104:0/3324633402 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c162090 con 0x7f514c0ce5a0 2024-05-08T04:24:40.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.865+0000 7f51523bc640 1 --2- 172.21.15.104:0/3324633402 >> v2:172.21.15.183:3300/0 conn(0x7f514c0d07c0 0x7f514c0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:24:40.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.866+0000 7f51513ba640 1 --2- 172.21.15.104:0/3324633402 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f514c0ce5a0 0x7f514c161920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5148009870 tx=0x7f514802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bac393b69121e304 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:40.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.866+0000 7f5150bb9640 1 -- 172.21.15.104:0/3324633402 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148037070 con 0x7f514c0ce5a0 2024-05-08T04:24:40.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.866+0000 7f5150bb9640 1 -- 172.21.15.104:0/3324633402 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5148032440 con 0x7f514c0ce5a0 2024-05-08T04:24:40.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.866+0000 7f5150bb9640 1 -- 172.21.15.104:0/3324633402 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148032810 con 0x7f514c0ce5a0 2024-05-08T04:24:40.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.867+0000 7f5153e1f640 1 -- 172.21.15.104:0/3324633402 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f514c0ce5a0 msgr2=0x7f514c161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:40.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.867+0000 7f5153e1f640 1 --2- 172.21.15.104:0/3324633402 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f514c0ce5a0 0x7f514c161920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5148009870 tx=0x7f514802a1c0 comp rx=0 tx=0).stop 2024-05-08T04:24:40.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.867+0000 7f5153e1f640 1 -- 172.21.15.104:0/3324633402 shutdown_connections 2024-05-08T04:24:40.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.867+0000 7f5153e1f640 1 --2- 172.21.15.104:0/3324633402 >> v2:172.21.15.183:3300/0 conn(0x7f514c0d07c0 0x7f514c0d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:40.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.867+0000 7f5153e1f640 1 --2- 172.21.15.104:0/3324633402 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f514c0ce5a0 0x7f514c161920 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:40.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.867+0000 7f5153e1f640 1 -- 172.21.15.104:0/3324633402 >> 172.21.15.104:0/3324633402 conn(0x7f514c072290 msgr2=0x7f514c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:40.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.867+0000 7f5153e1f640 1 -- 172.21.15.104:0/3324633402 shutdown_connections 2024-05-08T04:24:40.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.867+0000 7f5153e1f640 1 -- 172.21.15.104:0/3324633402 wait complete. 2024-05-08T04:24:40.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.868+0000 7f5153e1f640 1 Processor -- start 2024-05-08T04:24:40.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.868+0000 7f5153e1f640 1 -- start start 2024-05-08T04:24:40.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f5153e1f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f514c0ce5a0 0x7f514c0b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:40.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f5153e1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f514c0d07c0 0x7f514c0c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:40.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f5153e1f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f514c15de10 0x7f514c156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:40.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f5153e1f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c162650 con 0x7f514c0d07c0 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f5153e1f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0d1a90 con 0x7f514c0ce5a0 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f5153e1f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0d1ce0 con 0x7f514c15de10 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f51513ba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f514c0d07c0 0x7f514c0c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f51513ba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f514c0d07c0 0x7f514c0c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56278/0 (socket says 172.21.15.104:56278) 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f51513ba640 1 -- 172.21.15.104:0/3884570867 learned_addr learned my addr 172.21.15.104:0/3884570867 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f5151bbb640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f514c0ce5a0 0x7f514c0b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f51523bc640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f514c15de10 0x7f514c156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f51513ba640 1 -- 172.21.15.104:0/3884570867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f514c15de10 msgr2=0x7f514c156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f51513ba640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f514c15de10 0x7f514c156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f51513ba640 1 -- 172.21.15.104:0/3884570867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f514c0ce5a0 msgr2=0x7f514c0b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f51513ba640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f514c0ce5a0 0x7f514c0b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f51513ba640 1 -- 172.21.15.104:0/3884570867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c0b4080 con 0x7f514c0d07c0 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f51523bc640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f514c15de10 0x7f514c156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f51513ba640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f514c0d07c0 0x7f514c0c9610 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5148000c00 tx=0x7f51480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:40.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f513e7fc640 1 -- 172.21.15.104:0/3884570867 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148037040 con 0x7f514c0d07c0 2024-05-08T04:24:40.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f513e7fc640 1 -- 172.21.15.104:0/3884570867 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5148042070 con 0x7f514c0d07c0 2024-05-08T04:24:40.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f5153e1f640 1 -- 172.21.15.104:0/3884570867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c155270 con 0x7f514c0d07c0 2024-05-08T04:24:40.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f513e7fc640 1 -- 172.21.15.104:0/3884570867 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148030860 con 0x7f514c0d07c0 2024-05-08T04:24:40.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.869+0000 7f5153e1f640 1 -- 172.21.15.104:0/3884570867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c0b4320 con 0x7f514c0d07c0 2024-05-08T04:24:40.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.870+0000 7f5153e1f640 1 -- 172.21.15.104:0/3884570867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c075010 con 0x7f514c0d07c0 2024-05-08T04:24:40.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.871+0000 7f513e7fc640 1 -- 172.21.15.104:0/3884570867 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f514802ad10 con 0x7f514c0d07c0 2024-05-08T04:24:40.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.871+0000 7f513e7fc640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f513006b6b0 0x7f513006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:40.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.871+0000 7f513e7fc640 1 -- 172.21.15.104:0/3884570867 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51480aaab0 con 0x7f514c0d07c0 2024-05-08T04:24:40.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.871+0000 7f5151bbb640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f513006b6b0 0x7f513006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:40.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.872+0000 7f5151bbb640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f513006b6b0 0x7f513006db70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5140007fd0 tx=0x7f5140009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:40.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:40.876+0000 7f513e7fc640 1 -- 172.21.15.104:0/3884570867 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f51480796b0 con 0x7f514c0d07c0 2024-05-08T04:24:41.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.082+0000 7f5153e1f640 1 -- 172.21.15.104:0/3884570867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f514c0d1870 con 0x7f514c0d07c0 2024-05-08T04:24:41.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.082+0000 7f513e7fc640 1 -- 172.21.15.104:0/3884570867 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f5148078fb0 con 0x7f514c0d07c0 2024-05-08T04:24:41.084 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:41.084 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5336,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1609011099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1609011099},{"type":"v1","addr":"172.21.15.183:6834","nonce":1609011099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6354,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3867059822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3867059822},{"type":"v1","addr":"172.21.15.104:6835","nonce":3867059822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6357,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/3119972029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":3119972029},{"type":"v1","addr":"172.21.15.104:6837","nonce":3119972029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:24:38.063241+0000","modified":"2024-05-08T04:24:40.069539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6366":{"gid":6366,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/495908291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":495908291},{"type":"v1","addr":"172.21.15.183:6835","nonce":495908291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-05-08T04:24:41.085 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 28 2024-05-08T04:24:41.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.084+0000 7f5153e1f640 1 -- 172.21.15.104:0/3884570867 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f513006b6b0 msgr2=0x7f513006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.084+0000 7f5153e1f640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f513006b6b0 0x7f513006db70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5140007fd0 tx=0x7f5140009040 comp rx=0 tx=0).stop 2024-05-08T04:24:41.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.084+0000 7f5153e1f640 1 -- 172.21.15.104:0/3884570867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f514c0d07c0 msgr2=0x7f514c0c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.084+0000 7f5153e1f640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f514c0d07c0 0x7f514c0c9610 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5148000c00 tx=0x7f51480046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.084+0000 7f5153e1f640 1 -- 172.21.15.104:0/3884570867 shutdown_connections 2024-05-08T04:24:41.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.084+0000 7f5153e1f640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f513006b6b0 0x7f513006db70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.084+0000 7f5153e1f640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f514c15de10 0x7f514c156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.084+0000 7f5153e1f640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f514c0d07c0 0x7f514c0c9610 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.084+0000 7f5153e1f640 1 --2- 172.21.15.104:0/3884570867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f514c0ce5a0 0x7f514c0b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.084+0000 7f5153e1f640 1 -- 172.21.15.104:0/3884570867 >> 172.21.15.104:0/3884570867 conn(0x7f514c072290 msgr2=0x7f514c0d2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:41.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.084+0000 7f5153e1f640 1 -- 172.21.15.104:0/3884570867 shutdown_connections 2024-05-08T04:24:41.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.084+0000 7f5153e1f640 1 -- 172.21.15.104:0/3884570867 wait complete. 2024-05-08T04:24:41.096 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:24:41.097 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:24:41.139 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:24:41.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.238+0000 7effb3cac640 1 Processor -- start 2024-05-08T04:24:41.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.239+0000 7effb3cac640 1 -- start start 2024-05-08T04:24:41.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.239+0000 7effb3cac640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7effac099a40 0x7effac099e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.239+0000 7effb3cac640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7effac0cf360 0x7effac0cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.239+0000 7effb3cac640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effac15f540 0x7effac15f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.239+0000 7effb3cac640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac15ced0 con 0x7effac099a40 2024-05-08T04:24:41.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.239+0000 7effb3cac640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac0cc700 con 0x7effac0cf360 2024-05-08T04:24:41.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.239+0000 7effb3cac640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac09a360 con 0x7effac15f540 2024-05-08T04:24:41.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.239+0000 7effb1a48640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7effac099a40 0x7effac099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.239+0000 7effb1a48640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7effac099a40 0x7effac099e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56290/0 (socket says 172.21.15.104:56290) 2024-05-08T04:24:41.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.239+0000 7effb1a48640 1 -- 172.21.15.104:0/2451965849 learned_addr learned my addr 172.21.15.104:0/2451965849 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:41.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.240+0000 7effb1a48640 1 -- 172.21.15.104:0/2451965849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effac15f540 msgr2=0x7effac15f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:41.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.240+0000 7effb1a48640 1 --2- 172.21.15.104:0/2451965849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effac15f540 0x7effac15f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.240+0000 7effb1a48640 1 -- 172.21.15.104:0/2451965849 >> v2:172.21.15.183:3300/0 conn(0x7effac0cf360 msgr2=0x7effac0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:41.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.240+0000 7effb1a48640 1 --2- 172.21.15.104:0/2451965849 >> v2:172.21.15.183:3300/0 conn(0x7effac0cf360 0x7effac0cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.240+0000 7effb1a48640 1 -- 172.21.15.104:0/2451965849 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac0d0020 con 0x7effac099a40 2024-05-08T04:24:41.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.240+0000 7effb1a48640 1 --2- 172.21.15.104:0/2451965849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7effac099a40 0x7effac099e20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7effac072b30 tx=0x7eff9c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2021cef096d6dde server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:41.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.241+0000 7effb0a46640 1 -- 172.21.15.104:0/2451965849 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c004030 con 0x7effac099a40 2024-05-08T04:24:41.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.241+0000 7effb0a46640 1 -- 172.21.15.104:0/2451965849 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c0041d0 con 0x7effac099a40 2024-05-08T04:24:41.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.241+0000 7effb0a46640 1 -- 172.21.15.104:0/2451965849 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c003610 con 0x7effac099a40 2024-05-08T04:24:41.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.241+0000 7effb3cac640 1 -- 172.21.15.104:0/2451965849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7effac099a40 msgr2=0x7effac099e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.241+0000 7effb3cac640 1 --2- 172.21.15.104:0/2451965849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7effac099a40 0x7effac099e20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7effac072b30 tx=0x7eff9c02a1c0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.241+0000 7effb3cac640 1 -- 172.21.15.104:0/2451965849 shutdown_connections 2024-05-08T04:24:41.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.241+0000 7effb3cac640 1 --2- 172.21.15.104:0/2451965849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effac15f540 0x7effac15f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.241+0000 7effb3cac640 1 --2- 172.21.15.104:0/2451965849 >> v2:172.21.15.183:3300/0 conn(0x7effac0cf360 0x7effac0cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.241+0000 7effb3cac640 1 --2- 172.21.15.104:0/2451965849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7effac099a40 0x7effac099e20 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.241+0000 7effb3cac640 1 -- 172.21.15.104:0/2451965849 >> 172.21.15.104:0/2451965849 conn(0x7effac0b3280 msgr2=0x7effac0b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:41.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.241+0000 7effb3cac640 1 -- 172.21.15.104:0/2451965849 shutdown_connections 2024-05-08T04:24:41.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.241+0000 7effb3cac640 1 -- 172.21.15.104:0/2451965849 wait complete. 2024-05-08T04:24:41.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.242+0000 7effb3cac640 1 Processor -- start 2024-05-08T04:24:41.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.242+0000 7effb3cac640 1 -- start start 2024-05-08T04:24:41.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.243+0000 7effb3cac640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7effac099a40 0x7effac158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.243+0000 7effb3cac640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effac0cf360 0x7effac15d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.243+0000 7effb3cac640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effac15f540 0x7effac1567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.243+0000 7effb3cac640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0cfd30 con 0x7effac099a40 2024-05-08T04:24:41.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.243+0000 7effb3cac640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0d05e0 con 0x7effac0cf360 2024-05-08T04:24:41.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.243+0000 7effb3cac640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac159860 con 0x7effac15f540 2024-05-08T04:24:41.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.243+0000 7effb1a48640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7effac099a40 0x7effac158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.243+0000 7effb1a48640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7effac099a40 0x7effac158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56304/0 (socket says 172.21.15.104:56304) 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.243+0000 7effb1a48640 1 -- 172.21.15.104:0/2164490274 learned_addr learned my addr 172.21.15.104:0/2164490274 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effb1247640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effac0cf360 0x7effac15d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effb1a48640 1 -- 172.21.15.104:0/2164490274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effac15f540 msgr2=0x7effac1567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effb2249640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effac15f540 0x7effac1567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effb1a48640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effac15f540 0x7effac1567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effb1a48640 1 -- 172.21.15.104:0/2164490274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effac0cf360 msgr2=0x7effac15d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effb1a48640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effac0cf360 0x7effac15d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effb1a48640 1 -- 172.21.15.104:0/2164490274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac15e220 con 0x7effac099a40 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effb1247640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effac0cf360 0x7effac15d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effb2249640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effac15f540 0x7effac1567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effb1a48640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7effac099a40 0x7effac158070 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7eff9c000c00 tx=0x7eff9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effaa7fc640 1 -- 172.21.15.104:0/2164490274 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c041020 con 0x7effac099a40 2024-05-08T04:24:41.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effaa7fc640 1 -- 172.21.15.104:0/2164490274 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c003c50 con 0x7effac099a40 2024-05-08T04:24:41.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effaa7fc640 1 -- 172.21.15.104:0/2164490274 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c004030 con 0x7effac099a40 2024-05-08T04:24:41.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effb3cac640 1 -- 172.21.15.104:0/2164490274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac15e7e0 con 0x7effac099a40 2024-05-08T04:24:41.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.244+0000 7effb3cac640 1 -- 172.21.15.104:0/2164490274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac15eda0 con 0x7effac099a40 2024-05-08T04:24:41.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.245+0000 7effb3cac640 1 -- 172.21.15.104:0/2164490274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effac075010 con 0x7effac099a40 2024-05-08T04:24:41.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.245+0000 7effaa7fc640 1 -- 172.21.15.104:0/2164490274 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7eff9c044020 con 0x7effac099a40 2024-05-08T04:24:41.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.246+0000 7effaa7fc640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff9806b680 0x7eff9806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.246+0000 7effb1247640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff9806b680 0x7eff9806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.246+0000 7effaa7fc640 1 -- 172.21.15.104:0/2164490274 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff9c0ab1c0 con 0x7effac099a40 2024-05-08T04:24:41.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.246+0000 7effb1247640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff9806b680 0x7eff9806db40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7effa0006fd0 tx=0x7effa0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:41.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.250+0000 7effaa7fc640 1 -- 172.21.15.104:0/2164490274 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7eff9c04b030 con 0x7effac099a40 2024-05-08T04:24:41.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.419+0000 7effb3cac640 1 -- 172.21.15.104:0/2164490274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effac15f320 con 0x7effac099a40 2024-05-08T04:24:41.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.420+0000 7effaa7fc640 1 -- 172.21.15.104:0/2164490274 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16725 (secure 0 0 0) 0x7eff9c079e50 con 0x7effac099a40 2024-05-08T04:24:41.423 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:41.423 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":59,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:24:39.735412+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:24:36.286493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-08T04:24:37.038502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:24:41.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.422+0000 7effb3cac640 1 -- 172.21.15.104:0/2164490274 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff9806b680 msgr2=0x7eff9806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.422+0000 7effb3cac640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff9806b680 0x7eff9806db40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7effa0006fd0 tx=0x7effa0008040 comp rx=0 tx=0).stop 2024-05-08T04:24:41.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.422+0000 7effb3cac640 1 -- 172.21.15.104:0/2164490274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7effac099a40 msgr2=0x7effac158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.422+0000 7effb3cac640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7effac099a40 0x7effac158070 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7eff9c000c00 tx=0x7eff9c0046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.422+0000 7effb3cac640 1 -- 172.21.15.104:0/2164490274 shutdown_connections 2024-05-08T04:24:41.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.422+0000 7effb3cac640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7eff9806b680 0x7eff9806db40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.422+0000 7effb3cac640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effac0cf360 0x7effac15d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.422+0000 7effb3cac640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effac15f540 0x7effac1567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.422+0000 7effb3cac640 1 --2- 172.21.15.104:0/2164490274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7effac099a40 0x7effac158070 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.423+0000 7effb3cac640 1 -- 172.21.15.104:0/2164490274 >> 172.21.15.104:0/2164490274 conn(0x7effac0b3280 msgr2=0x7effac158ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:41.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.423+0000 7effb3cac640 1 -- 172.21.15.104:0/2164490274 shutdown_connections 2024-05-08T04:24:41.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.423+0000 7effb3cac640 1 -- 172.21.15.104:0/2164490274 wait complete. 2024-05-08T04:24:41.436 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-08T04:24:41.436 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:24:41.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.573+0000 7fb963e07640 1 Processor -- start 2024-05-08T04:24:41.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.573+0000 7fb963e07640 1 -- start start 2024-05-08T04:24:41.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.574+0000 7fb963e07640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb95c161190 0x7fb95c072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.574+0000 7fb963e07640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb95c072a70 0x7fb95c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.574+0000 7fb963e07640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb95c06de30 con 0x7fb95c0ad330 2024-05-08T04:24:41.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.574+0000 7fb963e07640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95c0b4db0 con 0x7fb95c161190 2024-05-08T04:24:41.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.574+0000 7fb963e07640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95c06e110 con 0x7fb95c072a70 2024-05-08T04:24:41.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.574+0000 7fb961ba3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb95c161190 0x7fb95c072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.574+0000 7fb961ba3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fb95c161190 0x7fb95c072530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56318/0 (socket says 172.21.15.104:56318) 2024-05-08T04:24:41.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.574+0000 7fb961ba3640 1 -- 172.21.15.104:0/75311100 learned_addr learned my addr 172.21.15.104:0/75311100 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:41.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.574+0000 7fb961ba3640 1 -- 172.21.15.104:0/75311100 >> v2:172.21.15.183:3300/0 conn(0x7fb95c072a70 msgr2=0x7fb95c0acdf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T04:24:41.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.574+0000 7fb961ba3640 1 --2- 172.21.15.104:0/75311100 >> v2:172.21.15.183:3300/0 conn(0x7fb95c072a70 0x7fb95c0acdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.574+0000 7fb961ba3640 1 -- 172.21.15.104:0/75311100 >> v1:172.21.15.183:6789/0 conn(0x7fb95c0ad330 legacy=0x7fb95c06bb70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T04:24:41.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.575+0000 7fb961ba3640 1 -- 172.21.15.104:0/75311100 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c06e3f0 con 0x7fb95c161190 2024-05-08T04:24:41.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.575+0000 7fb961ba3640 1 --2- 172.21.15.104:0/75311100 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb95c161190 0x7fb95c072530 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb95c067930 tx=0x7fb95802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bdf804e8d6f8ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:41.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.575+0000 7fb960ba1640 1 -- 172.21.15.104:0/75311100 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958037070 con 0x7fb95c161190 2024-05-08T04:24:41.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.575+0000 7fb960ba1640 1 -- 172.21.15.104:0/75311100 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb958032440 con 0x7fb95c161190 2024-05-08T04:24:41.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.575+0000 7fb960ba1640 1 -- 172.21.15.104:0/75311100 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958032810 con 0x7fb95c161190 2024-05-08T04:24:41.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.576+0000 7fb963e07640 1 -- 172.21.15.104:0/75311100 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb95c161190 msgr2=0x7fb95c072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.576+0000 7fb963e07640 1 --2- 172.21.15.104:0/75311100 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb95c161190 0x7fb95c072530 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb95c067930 tx=0x7fb95802a250 comp rx=0 tx=0).stop 2024-05-08T04:24:41.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.576+0000 7fb963e07640 1 -- 172.21.15.104:0/75311100 shutdown_connections 2024-05-08T04:24:41.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.576+0000 7fb963e07640 1 --2- 172.21.15.104:0/75311100 >> v2:172.21.15.183:3300/0 conn(0x7fb95c072a70 0x7fb95c0acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.576+0000 7fb963e07640 1 --2- 172.21.15.104:0/75311100 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb95c161190 0x7fb95c072530 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.576+0000 7fb963e07640 1 -- 172.21.15.104:0/75311100 >> 172.21.15.104:0/75311100 conn(0x7fb95c071a10 msgr2=0x7fb95c071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:41.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.576+0000 7fb963e07640 1 -- 172.21.15.104:0/75311100 shutdown_connections 2024-05-08T04:24:41.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.576+0000 7fb963e07640 1 -- 172.21.15.104:0/75311100 wait complete. 2024-05-08T04:24:41.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.577+0000 7fb963e07640 1 Processor -- start 2024-05-08T04:24:41.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.577+0000 7fb963e07640 1 -- start start 2024-05-08T04:24:41.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb963e07640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb95c0ad330 0x7fb95c160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb963e07640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb95c161190 0x7fb95c1e8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb963e07640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb95c1e9500 0x7fb95c157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb963e07640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c06da70 con 0x7fb95c161190 2024-05-08T04:24:41.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb963e07640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c06e9b0 con 0x7fb95c0ad330 2024-05-08T04:24:41.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb963e07640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c06dbf0 con 0x7fb95c1e9500 2024-05-08T04:24:41.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb9613a2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb95c161190 0x7fb95c1e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb9613a2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb95c161190 0x7fb95c1e8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56334/0 (socket says 172.21.15.104:56334) 2024-05-08T04:24:41.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb9613a2640 1 -- 172.21.15.104:0/434512737 learned_addr learned my addr 172.21.15.104:0/434512737 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:41.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb9613a2640 1 -- 172.21.15.104:0/434512737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb95c1e9500 msgr2=0x7fb95c157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb9623a4640 1 --2- 172.21.15.104:0/434512737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb95c1e9500 0x7fb95c157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb9613a2640 1 --2- 172.21.15.104:0/434512737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb95c1e9500 0x7fb95c157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb9613a2640 1 -- 172.21.15.104:0/434512737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb95c0ad330 msgr2=0x7fb95c160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb9613a2640 1 --2- 172.21.15.104:0/434512737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb95c0ad330 0x7fb95c160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb9613a2640 1 -- 172.21.15.104:0/434512737 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c13d690 con 0x7fb95c161190 2024-05-08T04:24:41.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.578+0000 7fb9613a2640 1 --2- 172.21.15.104:0/434512737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb95c161190 0x7fb95c1e8fc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00b450 tx=0x7fb94c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:41.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.579+0000 7fb9527fc640 1 -- 172.21.15.104:0/434512737 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c015020 con 0x7fb95c161190 2024-05-08T04:24:41.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.579+0000 7fb9527fc640 1 -- 172.21.15.104:0/434512737 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c0118b0 con 0x7fb95c161190 2024-05-08T04:24:41.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.579+0000 7fb963e07640 1 -- 172.21.15.104:0/434512737 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95c150f80 con 0x7fb95c161190 2024-05-08T04:24:41.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.579+0000 7fb9527fc640 1 -- 172.21.15.104:0/434512737 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c011ca0 con 0x7fb95c161190 2024-05-08T04:24:41.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.579+0000 7fb963e07640 1 -- 172.21.15.104:0/434512737 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95c1e9df0 con 0x7fb95c161190 2024-05-08T04:24:41.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.580+0000 7fb963e07640 1 -- 172.21.15.104:0/434512737 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95c075010 con 0x7fb95c161190 2024-05-08T04:24:41.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.580+0000 7fb9527fc640 1 -- 172.21.15.104:0/434512737 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fb94c018020 con 0x7fb95c161190 2024-05-08T04:24:41.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.581+0000 7fb9527fc640 1 --2- 172.21.15.104:0/434512737 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb94006b680 0x7fb94006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.581+0000 7fb9527fc640 1 -- 172.21.15.104:0/434512737 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb94c08a6c0 con 0x7fb95c161190 2024-05-08T04:24:41.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.581+0000 7fb961ba3640 1 --2- 172.21.15.104:0/434512737 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb94006b680 0x7fb94006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.581+0000 7fb961ba3640 1 --2- 172.21.15.104:0/434512737 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb94006b680 0x7fb94006db40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb958034000 tx=0x7fb95802c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:41.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.585+0000 7fb9527fc640 1 -- 172.21.15.104:0/434512737 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb94c01f020 con 0x7fb95c161190 2024-05-08T04:24:41.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.754+0000 7fb963e07640 1 -- 172.21.15.104:0/434512737 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb95c06c480 con 0x7fb94006b680 2024-05-08T04:24:41.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.760+0000 7fb9527fc640 1 -- 172.21.15.104:0/434512737 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+240079 (secure 0 0 0) 0x7fb95c06c480 con 0x7fb94006b680 2024-05-08T04:24:41.765 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:41.767 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:24:41.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.762+0000 7fb963e07640 1 -- 172.21.15.104:0/434512737 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb94006b680 msgr2=0x7fb94006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.762+0000 7fb963e07640 1 --2- 172.21.15.104:0/434512737 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb94006b680 0x7fb94006db40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb958034000 tx=0x7fb95802c000 comp rx=0 tx=0).stop 2024-05-08T04:24:41.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.762+0000 7fb963e07640 1 -- 172.21.15.104:0/434512737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb95c161190 msgr2=0x7fb95c1e8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.762+0000 7fb963e07640 1 --2- 172.21.15.104:0/434512737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb95c161190 0x7fb95c1e8fc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00b450 tx=0x7fb94c00b910 comp rx=0 tx=0).stop 2024-05-08T04:24:41.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.762+0000 7fb963e07640 1 -- 172.21.15.104:0/434512737 shutdown_connections 2024-05-08T04:24:41.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.762+0000 7fb963e07640 1 --2- 172.21.15.104:0/434512737 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb94006b680 0x7fb94006db40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.762+0000 7fb963e07640 1 --2- 172.21.15.104:0/434512737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb95c1e9500 0x7fb95c157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.762+0000 7fb963e07640 1 --2- 172.21.15.104:0/434512737 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb95c161190 0x7fb95c1e8fc0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.762+0000 7fb963e07640 1 --2- 172.21.15.104:0/434512737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb95c0ad330 0x7fb95c160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.762+0000 7fb963e07640 1 -- 172.21.15.104:0/434512737 >> 172.21.15.104:0/434512737 conn(0x7fb95c071a10 msgr2=0x7fb95c0afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:41.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.763+0000 7fb963e07640 1 -- 172.21.15.104:0/434512737 shutdown_connections 2024-05-08T04:24:41.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.763+0000 7fb963e07640 1 -- 172.21.15.104:0/434512737 wait complete. 2024-05-08T04:24:41.776 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-05-08T04:24:40.681403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222572,"kb_used_data":6396,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752148,"statfs":{"total":773094113280,"available":772866199552,"internally_reserved":0,"allocated":6549504,"data_stored":3386615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000922"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718820+0000","last_change":"2024-05-08T04:24:36.718820+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718820+0000","last_undegraded":"2024-05-08T04:24:36.718820+0000","last_fullsized":"2024-05-08T04:24:36.718820+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720984+0000","last_change":"2024-05-08T04:24:36.720984+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720984+0000","last_undegraded":"2024-05-08T04:24:36.720984+0000","last_fullsized":"2024-05-08T04:24:36.720984+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718803+0000","last_change":"2024-05-08T04:24:36.718803+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718803+0000","last_undegraded":"2024-05-08T04:24:36.718803+0000","last_fullsized":"2024-05-08T04:24:36.718803+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718898+0000","last_change":"2024-05-08T04:24:36.718898+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718898+0000","last_undegraded":"2024-05-08T04:24:36.718898+0000","last_fullsized":"2024-05-08T04:24:36.718898+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720408+0000","last_change":"2024-05-08T04:24:36.720408+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720408+0000","last_undegraded":"2024-05-08T04:24:36.720408+0000","last_fullsized":"2024-05-08T04:24:36.720408+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718830+0000","last_change":"2024-05-08T04:24:36.718830+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718830+0000","last_undegraded":"2024-05-08T04:24:36.718830+0000","last_fullsized":"2024-05-08T04:24:36.718830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720678+0000","last_change":"2024-05-08T04:24:36.720678+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720678+0000","last_undegraded":"2024-05-08T04:24:36.720678+0000","last_fullsized":"2024-05-08T04:24:36.720678+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.722883+0000","last_change":"2024-05-08T04:24:36.722883+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.722883+0000","last_undegraded":"2024-05-08T04:24:36.722883+0000","last_fullsized":"2024-05-08T04:24:36.722883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720800+0000","last_change":"2024-05-08T04:24:36.720800+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720800+0000","last_undegraded":"2024-05-08T04:24:36.720800+0000","last_fullsized":"2024-05-08T04:24:36.720800+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.716088+0000","last_change":"2024-05-08T04:24:36.716088+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.716088+0000","last_undegraded":"2024-05-08T04:24:36.716088+0000","last_fullsized":"2024-05-08T04:24:36.716088+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718811+0000","last_change":"2024-05-08T04:24:36.718811+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718811+0000","last_undegraded":"2024-05-08T04:24:36.718811+0000","last_fullsized":"2024-05-08T04:24:36.718811+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.722913+0000","last_change":"2024-05-08T04:24:36.722913+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.722913+0000","last_undegraded":"2024-05-08T04:24:36.722913+0000","last_fullsized":"2024-05-08T04:24:36.722913+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715492+0000","last_change":"2024-05-08T04:24:36.715492+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715492+0000","last_undegraded":"2024-05-08T04:24:36.715492+0000","last_fullsized":"2024-05-08T04:24:36.715492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718796+0000","last_change":"2024-05-08T04:24:36.718796+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718796+0000","last_undegraded":"2024-05-08T04:24:36.718796+0000","last_fullsized":"2024-05-08T04:24:36.718796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718772+0000","last_change":"2024-05-08T04:24:36.718772+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718772+0000","last_undegraded":"2024-05-08T04:24:36.718772+0000","last_fullsized":"2024-05-08T04:24:36.718772+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718801+0000","last_change":"2024-05-08T04:24:36.718801+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718801+0000","last_undegraded":"2024-05-08T04:24:36.718801+0000","last_fullsized":"2024-05-08T04:24:36.718801+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721555+0000","last_change":"2024-05-08T04:24:36.721555+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721555+0000","last_undegraded":"2024-05-08T04:24:36.721555+0000","last_fullsized":"2024-05-08T04:24:36.721555+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715492+0000","last_change":"2024-05-08T04:24:36.715492+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715492+0000","last_undegraded":"2024-05-08T04:24:36.715492+0000","last_fullsized":"2024-05-08T04:24:36.715492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720415+0000","last_change":"2024-05-08T04:24:36.720415+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720415+0000","last_undegraded":"2024-05-08T04:24:36.720415+0000","last_fullsized":"2024-05-08T04:24:36.720415+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715521+0000","last_change":"2024-05-08T04:24:36.715521+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715521+0000","last_undegraded":"2024-05-08T04:24:36.715521+0000","last_fullsized":"2024-05-08T04:24:36.715521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718788+0000","last_change":"2024-05-08T04:24:36.718788+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718788+0000","last_undegraded":"2024-05-08T04:24:36.718788+0000","last_fullsized":"2024-05-08T04:24:36.718788+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715524+0000","last_change":"2024-05-08T04:24:36.715524+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715524+0000","last_undegraded":"2024-05-08T04:24:36.715524+0000","last_fullsized":"2024-05-08T04:24:36.715524+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721030+0000","last_change":"2024-05-08T04:24:36.721030+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721030+0000","last_undegraded":"2024-05-08T04:24:36.721030+0000","last_fullsized":"2024-05-08T04:24:36.721030+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721022+0000","last_change":"2024-05-08T04:24:36.721022+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721022+0000","last_undegraded":"2024-05-08T04:24:36.721022+0000","last_fullsized":"2024-05-08T04:24:36.721022+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718774+0000","last_change":"2024-05-08T04:24:36.718774+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718774+0000","last_undegraded":"2024-05-08T04:24:36.718774+0000","last_fullsized":"2024-05-08T04:24:36.718774+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721107+0000","last_change":"2024-05-08T04:24:36.721107+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721107+0000","last_undegraded":"2024-05-08T04:24:36.721107+0000","last_fullsized":"2024-05-08T04:24:36.721107+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720402+0000","last_change":"2024-05-08T04:24:36.720402+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720402+0000","last_undegraded":"2024-05-08T04:24:36.720402+0000","last_fullsized":"2024-05-08T04:24:36.720402+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720946+0000","last_change":"2024-05-08T04:24:36.720946+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720946+0000","last_undegraded":"2024-05-08T04:24:36.720946+0000","last_fullsized":"2024-05-08T04:24:36.720946+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720535+0000","last_change":"2024-05-08T04:24:36.720535+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720535+0000","last_undegraded":"2024-05-08T04:24:36.720535+0000","last_fullsized":"2024-05-08T04:24:36.720535+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718729+0000","last_change":"2024-05-08T04:24:36.718729+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718729+0000","last_undegraded":"2024-05-08T04:24:36.718729+0000","last_fullsized":"2024-05-08T04:24:36.718729+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715520+0000","last_change":"2024-05-08T04:24:36.715520+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715520+0000","last_undegraded":"2024-05-08T04:24:36.715520+0000","last_fullsized":"2024-05-08T04:24:36.715520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.722913+0000","last_change":"2024-05-08T04:24:36.722913+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.722913+0000","last_undegraded":"2024-05-08T04:24:36.722913+0000","last_fullsized":"2024-05-08T04:24:36.722913+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":234,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-05-08T04:24:36.721518+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:24:36.721518+0000","last_peered":"2024-05-08T04:24:36.721518+0000","last_clean":"2024-05-08T04:24:36.721518+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:24:36.721518+0000","last_undegraded":"2024-05-08T04:24:36.721518+0000","last_fullsized":"2024-05-08T04:24:36.721518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":270645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1265664,"data_stored":866830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1265664,"data_stored":866830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:24:41.780 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:24:41.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.914+0000 7f0644076640 1 Processor -- start 2024-05-08T04:24:41.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.914+0000 7f0644076640 1 -- start start 2024-05-08T04:24:41.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.915+0000 7f0644076640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f063c161190 0x7f063c072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.915+0000 7f0644076640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f063c06bb70 0x7f063c06bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.915+0000 7f0644076640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c06c4c0 con 0x7f063c072a70 2024-05-08T04:24:41.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.915+0000 7f0644076640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c0b4db0 con 0x7f063c06bb70 2024-05-08T04:24:41.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.915+0000 7f0644076640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c06de30 con 0x7f063c161190 2024-05-08T04:24:41.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.915+0000 7f0642613640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f063c06bb70 0x7f063c06bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.915+0000 7f0642613640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f063c06bb70 0x7f063c06bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56340/0 (socket says 172.21.15.104:56340) 2024-05-08T04:24:41.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.915+0000 7f0642613640 1 -- 172.21.15.104:0/3704004097 learned_addr learned my addr 172.21.15.104:0/3704004097 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:41.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.916+0000 7f0642613640 1 -- 172.21.15.104:0/3704004097 >> v2:172.21.15.183:3300/0 conn(0x7f063c161190 msgr2=0x7f063c072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:41.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.916+0000 7f0642613640 1 --2- 172.21.15.104:0/3704004097 >> v2:172.21.15.183:3300/0 conn(0x7f063c161190 0x7f063c072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.916+0000 7f0642613640 1 -- 172.21.15.104:0/3704004097 >> v1:172.21.15.183:6789/0 conn(0x7f063c072a70 legacy=0x7f063c0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:41.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.916+0000 7f0642613640 1 -- 172.21.15.104:0/3704004097 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c06e110 con 0x7f063c06bb70 2024-05-08T04:24:41.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.916+0000 7f0642613640 1 --2- 172.21.15.104:0/3704004097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f063c06bb70 0x7f063c06bf80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f063c06faa0 tx=0x7f063402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aab0b2a3c2856cb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:41.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.916+0000 7f0640e10640 1 -- 172.21.15.104:0/3704004097 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634036070 con 0x7f063c06bb70 2024-05-08T04:24:41.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.916+0000 7f0640e10640 1 -- 172.21.15.104:0/3704004097 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634031600 con 0x7f063c06bb70 2024-05-08T04:24:41.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.916+0000 7f0640e10640 1 -- 172.21.15.104:0/3704004097 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340319d0 con 0x7f063c06bb70 2024-05-08T04:24:41.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.917+0000 7f0644076640 1 -- 172.21.15.104:0/3704004097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f063c06bb70 msgr2=0x7f063c06bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.917+0000 7f0644076640 1 --2- 172.21.15.104:0/3704004097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f063c06bb70 0x7f063c06bf80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f063c06faa0 tx=0x7f063402a6f0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.917+0000 7f0644076640 1 -- 172.21.15.104:0/3704004097 shutdown_connections 2024-05-08T04:24:41.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.917+0000 7f0644076640 1 --2- 172.21.15.104:0/3704004097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f063c06bb70 0x7f063c06bf80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.917+0000 7f0644076640 1 --2- 172.21.15.104:0/3704004097 >> v2:172.21.15.183:3300/0 conn(0x7f063c161190 0x7f063c072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.917+0000 7f0644076640 1 -- 172.21.15.104:0/3704004097 >> 172.21.15.104:0/3704004097 conn(0x7f063c071a10 msgr2=0x7f063c071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:41.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.917+0000 7f0644076640 1 -- 172.21.15.104:0/3704004097 shutdown_connections 2024-05-08T04:24:41.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.917+0000 7f0644076640 1 -- 172.21.15.104:0/3704004097 wait complete. 2024-05-08T04:24:41.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.918+0000 7f0644076640 1 Processor -- start 2024-05-08T04:24:41.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.918+0000 7f0644076640 1 -- start start 2024-05-08T04:24:41.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0644076640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f063c06bb70 0x7f063c0b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0644076640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f063c161190 0x7f063c154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0644076640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f063c154c40 0x7f063c15a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0644076640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c06e9b0 con 0x7f063c154c40 2024-05-08T04:24:41.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0644076640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c06e6d0 con 0x7f063c161190 2024-05-08T04:24:41.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0644076640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0ad500 con 0x7f063c06bb70 2024-05-08T04:24:41.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0642613640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f063c154c40 0x7f063c15a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0642613640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f063c154c40 0x7f063c15a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56352/0 (socket says 172.21.15.104:56352) 2024-05-08T04:24:41.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0642613640 1 -- 172.21.15.104:0/3108558573 learned_addr learned my addr 172.21.15.104:0/3108558573 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:41.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0641611640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f063c161190 0x7f063c154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0641e12640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f063c06bb70 0x7f063c0b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0642613640 1 -- 172.21.15.104:0/3108558573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f063c06bb70 msgr2=0x7f063c0b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0642613640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f063c06bb70 0x7f063c0b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0642613640 1 -- 172.21.15.104:0/3108558573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f063c161190 msgr2=0x7f063c154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:41.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0642613640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f063c161190 0x7f063c154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:41.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0642613640 1 -- 172.21.15.104:0/3108558573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c157c80 con 0x7f063c154c40 2024-05-08T04:24:41.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.919+0000 7f0642613640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f063c154c40 0x7f063c15a0b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0634034040 tx=0x7f0634004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:41.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.920+0000 7f06327fc640 1 -- 172.21.15.104:0/3108558573 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634041020 con 0x7f063c154c40 2024-05-08T04:24:41.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.920+0000 7f06327fc640 1 -- 172.21.15.104:0/3108558573 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634007780 con 0x7f063c154c40 2024-05-08T04:24:41.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.920+0000 7f06327fc640 1 -- 172.21.15.104:0/3108558573 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634036040 con 0x7f063c154c40 2024-05-08T04:24:41.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.920+0000 7f0644076640 1 -- 172.21.15.104:0/3108558573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c155310 con 0x7f063c154c40 2024-05-08T04:24:41.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.920+0000 7f0644076640 1 -- 172.21.15.104:0/3108558573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c143900 con 0x7f063c154c40 2024-05-08T04:24:41.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.921+0000 7f0644076640 1 -- 172.21.15.104:0/3108558573 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c075010 con 0x7f063c154c40 2024-05-08T04:24:41.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.921+0000 7f06327fc640 1 -- 172.21.15.104:0/3108558573 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f0634044020 con 0x7f063c154c40 2024-05-08T04:24:41.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.922+0000 7f06327fc640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f062006b680 0x7f062006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:41.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.922+0000 7f0641e12640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f062006b680 0x7f062006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:41.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.922+0000 7f06327fc640 1 -- 172.21.15.104:0/3108558573 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06340ab3f0 con 0x7f063c154c40 2024-05-08T04:24:41.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.922+0000 7f0641e12640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f062006b680 0x7f062006db40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f063c0b0920 tx=0x7f0638008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:41.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:41.926+0000 7f06327fc640 1 -- 172.21.15.104:0/3108558573 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f063404b030 con 0x7f063c154c40 2024-05-08T04:24:42.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.091+0000 7f0644076640 1 -- 172.21.15.104:0/3108558573 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f063c143110 con 0x7f062006b680 2024-05-08T04:24:42.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.097+0000 7f06327fc640 1 -- 172.21.15.104:0/3108558573 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+240079 (secure 0 0 0) 0x7f063800bdc0 con 0x7f062006b680 2024-05-08T04:24:42.101 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:42.102 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:24:42.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.100+0000 7f0644076640 1 -- 172.21.15.104:0/3108558573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f062006b680 msgr2=0x7f062006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.100+0000 7f0644076640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f062006b680 0x7f062006db40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f063c0b0920 tx=0x7f0638008040 comp rx=0 tx=0).stop 2024-05-08T04:24:42.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.100+0000 7f0644076640 1 -- 172.21.15.104:0/3108558573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f063c154c40 msgr2=0x7f063c15a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.100+0000 7f0644076640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f063c154c40 0x7f063c15a0b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0634034040 tx=0x7f0634004a40 comp rx=0 tx=0).stop 2024-05-08T04:24:42.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.100+0000 7f0644076640 1 -- 172.21.15.104:0/3108558573 shutdown_connections 2024-05-08T04:24:42.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.100+0000 7f0644076640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f062006b680 0x7f062006db40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.100+0000 7f0644076640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f063c161190 0x7f063c154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.100+0000 7f0644076640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f063c154c40 0x7f063c15a0b0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.100+0000 7f0644076640 1 --2- 172.21.15.104:0/3108558573 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f063c06bb70 0x7f063c0b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.100+0000 7f0644076640 1 -- 172.21.15.104:0/3108558573 >> 172.21.15.104:0/3108558573 conn(0x7f063c071a10 msgr2=0x7f063c0b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:42.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.100+0000 7f0644076640 1 -- 172.21.15.104:0/3108558573 shutdown_connections 2024-05-08T04:24:42.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.100+0000 7f0644076640 1 -- 172.21.15.104:0/3108558573 wait complete. 2024-05-08T04:24:42.113 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-05-08T04:24:40.681403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222572,"kb_used_data":6396,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752148,"statfs":{"total":773094113280,"available":772866199552,"internally_reserved":0,"allocated":6549504,"data_stored":3386615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000922"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718820+0000","last_change":"2024-05-08T04:24:36.718820+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718820+0000","last_undegraded":"2024-05-08T04:24:36.718820+0000","last_fullsized":"2024-05-08T04:24:36.718820+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720984+0000","last_change":"2024-05-08T04:24:36.720984+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720984+0000","last_undegraded":"2024-05-08T04:24:36.720984+0000","last_fullsized":"2024-05-08T04:24:36.720984+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718803+0000","last_change":"2024-05-08T04:24:36.718803+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718803+0000","last_undegraded":"2024-05-08T04:24:36.718803+0000","last_fullsized":"2024-05-08T04:24:36.718803+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718898+0000","last_change":"2024-05-08T04:24:36.718898+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718898+0000","last_undegraded":"2024-05-08T04:24:36.718898+0000","last_fullsized":"2024-05-08T04:24:36.718898+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720408+0000","last_change":"2024-05-08T04:24:36.720408+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720408+0000","last_undegraded":"2024-05-08T04:24:36.720408+0000","last_fullsized":"2024-05-08T04:24:36.720408+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718830+0000","last_change":"2024-05-08T04:24:36.718830+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718830+0000","last_undegraded":"2024-05-08T04:24:36.718830+0000","last_fullsized":"2024-05-08T04:24:36.718830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720678+0000","last_change":"2024-05-08T04:24:36.720678+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720678+0000","last_undegraded":"2024-05-08T04:24:36.720678+0000","last_fullsized":"2024-05-08T04:24:36.720678+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.722883+0000","last_change":"2024-05-08T04:24:36.722883+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.722883+0000","last_undegraded":"2024-05-08T04:24:36.722883+0000","last_fullsized":"2024-05-08T04:24:36.722883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720800+0000","last_change":"2024-05-08T04:24:36.720800+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720800+0000","last_undegraded":"2024-05-08T04:24:36.720800+0000","last_fullsized":"2024-05-08T04:24:36.720800+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.716088+0000","last_change":"2024-05-08T04:24:36.716088+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.716088+0000","last_undegraded":"2024-05-08T04:24:36.716088+0000","last_fullsized":"2024-05-08T04:24:36.716088+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718811+0000","last_change":"2024-05-08T04:24:36.718811+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718811+0000","last_undegraded":"2024-05-08T04:24:36.718811+0000","last_fullsized":"2024-05-08T04:24:36.718811+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.722913+0000","last_change":"2024-05-08T04:24:36.722913+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.722913+0000","last_undegraded":"2024-05-08T04:24:36.722913+0000","last_fullsized":"2024-05-08T04:24:36.722913+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715492+0000","last_change":"2024-05-08T04:24:36.715492+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715492+0000","last_undegraded":"2024-05-08T04:24:36.715492+0000","last_fullsized":"2024-05-08T04:24:36.715492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718796+0000","last_change":"2024-05-08T04:24:36.718796+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718796+0000","last_undegraded":"2024-05-08T04:24:36.718796+0000","last_fullsized":"2024-05-08T04:24:36.718796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718772+0000","last_change":"2024-05-08T04:24:36.718772+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718772+0000","last_undegraded":"2024-05-08T04:24:36.718772+0000","last_fullsized":"2024-05-08T04:24:36.718772+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718801+0000","last_change":"2024-05-08T04:24:36.718801+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718801+0000","last_undegraded":"2024-05-08T04:24:36.718801+0000","last_fullsized":"2024-05-08T04:24:36.718801+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721555+0000","last_change":"2024-05-08T04:24:36.721555+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721555+0000","last_undegraded":"2024-05-08T04:24:36.721555+0000","last_fullsized":"2024-05-08T04:24:36.721555+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715492+0000","last_change":"2024-05-08T04:24:36.715492+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715492+0000","last_undegraded":"2024-05-08T04:24:36.715492+0000","last_fullsized":"2024-05-08T04:24:36.715492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720415+0000","last_change":"2024-05-08T04:24:36.720415+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720415+0000","last_undegraded":"2024-05-08T04:24:36.720415+0000","last_fullsized":"2024-05-08T04:24:36.720415+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715521+0000","last_change":"2024-05-08T04:24:36.715521+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715521+0000","last_undegraded":"2024-05-08T04:24:36.715521+0000","last_fullsized":"2024-05-08T04:24:36.715521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718788+0000","last_change":"2024-05-08T04:24:36.718788+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718788+0000","last_undegraded":"2024-05-08T04:24:36.718788+0000","last_fullsized":"2024-05-08T04:24:36.718788+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715524+0000","last_change":"2024-05-08T04:24:36.715524+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715524+0000","last_undegraded":"2024-05-08T04:24:36.715524+0000","last_fullsized":"2024-05-08T04:24:36.715524+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721030+0000","last_change":"2024-05-08T04:24:36.721030+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721030+0000","last_undegraded":"2024-05-08T04:24:36.721030+0000","last_fullsized":"2024-05-08T04:24:36.721030+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721022+0000","last_change":"2024-05-08T04:24:36.721022+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721022+0000","last_undegraded":"2024-05-08T04:24:36.721022+0000","last_fullsized":"2024-05-08T04:24:36.721022+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718774+0000","last_change":"2024-05-08T04:24:36.718774+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718774+0000","last_undegraded":"2024-05-08T04:24:36.718774+0000","last_fullsized":"2024-05-08T04:24:36.718774+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721107+0000","last_change":"2024-05-08T04:24:36.721107+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721107+0000","last_undegraded":"2024-05-08T04:24:36.721107+0000","last_fullsized":"2024-05-08T04:24:36.721107+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720402+0000","last_change":"2024-05-08T04:24:36.720402+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720402+0000","last_undegraded":"2024-05-08T04:24:36.720402+0000","last_fullsized":"2024-05-08T04:24:36.720402+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720946+0000","last_change":"2024-05-08T04:24:36.720946+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720946+0000","last_undegraded":"2024-05-08T04:24:36.720946+0000","last_fullsized":"2024-05-08T04:24:36.720946+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720535+0000","last_change":"2024-05-08T04:24:36.720535+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720535+0000","last_undegraded":"2024-05-08T04:24:36.720535+0000","last_fullsized":"2024-05-08T04:24:36.720535+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718729+0000","last_change":"2024-05-08T04:24:36.718729+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718729+0000","last_undegraded":"2024-05-08T04:24:36.718729+0000","last_fullsized":"2024-05-08T04:24:36.718729+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715520+0000","last_change":"2024-05-08T04:24:36.715520+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715520+0000","last_undegraded":"2024-05-08T04:24:36.715520+0000","last_fullsized":"2024-05-08T04:24:36.715520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.722913+0000","last_change":"2024-05-08T04:24:36.722913+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.722913+0000","last_undegraded":"2024-05-08T04:24:36.722913+0000","last_fullsized":"2024-05-08T04:24:36.722913+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":234,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-05-08T04:24:36.721518+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:24:36.721518+0000","last_peered":"2024-05-08T04:24:36.721518+0000","last_clean":"2024-05-08T04:24:36.721518+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:24:36.721518+0000","last_undegraded":"2024-05-08T04:24:36.721518+0000","last_fullsized":"2024-05-08T04:24:36.721518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":270645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1265664,"data_stored":866830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1265664,"data_stored":866830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:24:42.116 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:24:42.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.250+0000 7f9b73ecb640 1 Processor -- start 2024-05-08T04:24:42.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.250+0000 7f9b73ecb640 1 -- start start 2024-05-08T04:24:42.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.251+0000 7f9b73ecb640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9b6c06ab60 0x7f9b6c070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.251+0000 7f9b73ecb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b6c15de30 0x7f9b6c15e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.251+0000 7f9b73ecb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6c0d0450 con 0x7f9b6c0cff50 2024-05-08T04:24:42.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.251+0000 7f9b73ecb640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b6c161630 con 0x7f9b6c06ab60 2024-05-08T04:24:42.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.251+0000 7f9b73ecb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c072ab0 con 0x7f9b6c15de30 2024-05-08T04:24:42.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.251+0000 7f9b71c67640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9b6c06ab60 0x7f9b6c070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:42.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.252+0000 7f9b71c67640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9b6c06ab60 0x7f9b6c070820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56362/0 (socket says 172.21.15.104:56362) 2024-05-08T04:24:42.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.252+0000 7f9b71c67640 1 -- 172.21.15.104:0/3569138083 learned_addr learned my addr 172.21.15.104:0/3569138083 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:42.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.252+0000 7f9b72468640 1 --2- 172.21.15.104:0/3569138083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b6c15de30 0x7f9b6c15e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:42.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.252+0000 7f9b71c67640 1 -- 172.21.15.104:0/3569138083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b6c15de30 msgr2=0x7f9b6c15e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:42.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.252+0000 7f9b71c67640 1 --2- 172.21.15.104:0/3569138083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b6c15de30 0x7f9b6c15e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.252+0000 7f9b71c67640 1 -- 172.21.15.104:0/3569138083 >> v1:172.21.15.183:6789/0 conn(0x7f9b6c0cff50 legacy=0x7f9b6c06af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.252+0000 7f9b71c67640 1 -- 172.21.15.104:0/3569138083 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c072d90 con 0x7f9b6c06ab60 2024-05-08T04:24:42.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.253+0000 7f9b71c67640 1 --2- 172.21.15.104:0/3569138083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b6c06ab60 0x7f9b6c070820 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009e50 tx=0x7f9b5c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc95c817a8b2ed92 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:42.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.253+0000 7f9b70c65640 1 -- 172.21.15.104:0/3569138083 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c036070 con 0x7f9b6c06ab60 2024-05-08T04:24:42.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.253+0000 7f9b70c65640 1 -- 172.21.15.104:0/3569138083 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c031600 con 0x7f9b6c06ab60 2024-05-08T04:24:42.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.253+0000 7f9b70c65640 1 -- 172.21.15.104:0/3569138083 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c0319d0 con 0x7f9b6c06ab60 2024-05-08T04:24:42.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.253+0000 7f9b73ecb640 1 -- 172.21.15.104:0/3569138083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b6c06ab60 msgr2=0x7f9b6c070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.253+0000 7f9b73ecb640 1 --2- 172.21.15.104:0/3569138083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b6c06ab60 0x7f9b6c070820 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009e50 tx=0x7f9b5c02a680 comp rx=0 tx=0).stop 2024-05-08T04:24:42.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.253+0000 7f9b73ecb640 1 -- 172.21.15.104:0/3569138083 shutdown_connections 2024-05-08T04:24:42.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.253+0000 7f9b73ecb640 1 --2- 172.21.15.104:0/3569138083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b6c15de30 0x7f9b6c15e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.253+0000 7f9b73ecb640 1 --2- 172.21.15.104:0/3569138083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b6c06ab60 0x7f9b6c070820 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.253+0000 7f9b73ecb640 1 -- 172.21.15.104:0/3569138083 >> 172.21.15.104:0/3569138083 conn(0x7f9b6c0b23e0 msgr2=0x7f9b6c0b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:42.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.253+0000 7f9b73ecb640 1 -- 172.21.15.104:0/3569138083 shutdown_connections 2024-05-08T04:24:42.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.253+0000 7f9b73ecb640 1 -- 172.21.15.104:0/3569138083 wait complete. 2024-05-08T04:24:42.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.254+0000 7f9b73ecb640 1 Processor -- start 2024-05-08T04:24:42.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.255+0000 7f9b73ecb640 1 -- start start 2024-05-08T04:24:42.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.255+0000 7f9b73ecb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b6c06ab60 0x7f9b6c1e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.255+0000 7f9b73ecb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b6c0cff50 0x7f9b6c1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.255+0000 7f9b73ecb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b6c15de30 0x7f9b6c146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.255+0000 7f9b73ecb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c161ac0 con 0x7f9b6c15de30 2024-05-08T04:24:42.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.255+0000 7f9b73ecb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c070370 con 0x7f9b6c0cff50 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.255+0000 7f9b73ecb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c161c40 con 0x7f9b6c06ab60 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.255+0000 7f9b72468640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b6c15de30 0x7f9b6c146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.255+0000 7f9b72468640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b6c15de30 0x7f9b6c146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56368/0 (socket says 172.21.15.104:56368) 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.255+0000 7f9b72468640 1 -- 172.21.15.104:0/1829913132 learned_addr learned my addr 172.21.15.104:0/1829913132 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.255+0000 7f9b71c67640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b6c06ab60 0x7f9b6c1e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.255+0000 7f9b71466640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b6c0cff50 0x7f9b6c1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.256+0000 7f9b72468640 1 -- 172.21.15.104:0/1829913132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b6c06ab60 msgr2=0x7f9b6c1e6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.256+0000 7f9b72468640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b6c06ab60 0x7f9b6c1e6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.256+0000 7f9b72468640 1 -- 172.21.15.104:0/1829913132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b6c0cff50 msgr2=0x7f9b6c1564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.256+0000 7f9b72468640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b6c0cff50 0x7f9b6c1564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.256+0000 7f9b72468640 1 -- 172.21.15.104:0/1829913132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c0cbf70 con 0x7f9b6c15de30 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.256+0000 7f9b71c67640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b6c06ab60 0x7f9b6c1e6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.256+0000 7f9b71466640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b6c0cff50 0x7f9b6c1564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.256+0000 7f9b72468640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b6c15de30 0x7f9b6c146e00 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400e7f0 tx=0x7f9b6400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:42.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.256+0000 7f9b6a7fc640 1 -- 172.21.15.104:0/1829913132 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64017070 con 0x7f9b6c15de30 2024-05-08T04:24:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.256+0000 7f9b6a7fc640 1 -- 172.21.15.104:0/1829913132 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6400ee40 con 0x7f9b6c15de30 2024-05-08T04:24:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.256+0000 7f9b6a7fc640 1 -- 172.21.15.104:0/1829913132 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6400cb80 con 0x7f9b6c15de30 2024-05-08T04:24:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.256+0000 7f9b73ecb640 1 -- 172.21.15.104:0/1829913132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6c0cc250 con 0x7f9b6c15de30 2024-05-08T04:24:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.256+0000 7f9b73ecb640 1 -- 172.21.15.104:0/1829913132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6c0cc810 con 0x7f9b6c15de30 2024-05-08T04:24:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.257+0000 7f9b73ecb640 1 -- 172.21.15.104:0/1829913132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6c075010 con 0x7f9b6c15de30 2024-05-08T04:24:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.257+0000 7f9b6a7fc640 1 -- 172.21.15.104:0/1829913132 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f9b6401a070 con 0x7f9b6c15de30 2024-05-08T04:24:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.258+0000 7f9b6a7fc640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b5806b680 0x7f9b5806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.258+0000 7f9b6a7fc640 1 -- 172.21.15.104:0/1829913132 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b6408a770 con 0x7f9b6c15de30 2024-05-08T04:24:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.258+0000 7f9b71c67640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b5806b680 0x7f9b5806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:42.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.258+0000 7f9b71c67640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b5806b680 0x7f9b5806db40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c033000 tx=0x7f9b5c009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:42.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.262+0000 7f9b6a7fc640 1 -- 172.21.15.104:0/1829913132 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b64059370 con 0x7f9b6c15de30 2024-05-08T04:24:42.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.429+0000 7f9b73ecb640 1 -- 172.21.15.104:0/1829913132 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b6c0afe20 con 0x7f9b5806b680 2024-05-08T04:24:42.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.435+0000 7f9b6a7fc640 1 -- 172.21.15.104:0/1829913132 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+240079 (secure 0 0 0) 0x7f9b6c0afe20 con 0x7f9b5806b680 2024-05-08T04:24:42.439 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:42.440 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:24:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.437+0000 7f9b73ecb640 1 -- 172.21.15.104:0/1829913132 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b5806b680 msgr2=0x7f9b5806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.437+0000 7f9b73ecb640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b5806b680 0x7f9b5806db40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c033000 tx=0x7f9b5c009000 comp rx=0 tx=0).stop 2024-05-08T04:24:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.437+0000 7f9b73ecb640 1 -- 172.21.15.104:0/1829913132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b6c15de30 msgr2=0x7f9b6c146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.437+0000 7f9b73ecb640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b6c15de30 0x7f9b6c146e00 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400e7f0 tx=0x7f9b6400ebf0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.438+0000 7f9b73ecb640 1 -- 172.21.15.104:0/1829913132 shutdown_connections 2024-05-08T04:24:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.438+0000 7f9b73ecb640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b5806b680 0x7f9b5806db40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.438+0000 7f9b73ecb640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b6c0cff50 0x7f9b6c1564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.438+0000 7f9b73ecb640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b6c15de30 0x7f9b6c146e00 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.438+0000 7f9b73ecb640 1 --2- 172.21.15.104:0/1829913132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b6c06ab60 0x7f9b6c1e6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.438+0000 7f9b73ecb640 1 -- 172.21.15.104:0/1829913132 >> 172.21.15.104:0/1829913132 conn(0x7f9b6c0b23e0 msgr2=0x7f9b6c06af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:42.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.438+0000 7f9b73ecb640 1 -- 172.21.15.104:0/1829913132 shutdown_connections 2024-05-08T04:24:42.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.438+0000 7f9b73ecb640 1 -- 172.21.15.104:0/1829913132 wait complete. 2024-05-08T04:24:42.451 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-05-08T04:24:40.681403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222572,"kb_used_data":6396,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752148,"statfs":{"total":773094113280,"available":772866199552,"internally_reserved":0,"allocated":6549504,"data_stored":3386615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000922"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718820+0000","last_change":"2024-05-08T04:24:36.718820+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718820+0000","last_undegraded":"2024-05-08T04:24:36.718820+0000","last_fullsized":"2024-05-08T04:24:36.718820+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720984+0000","last_change":"2024-05-08T04:24:36.720984+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720984+0000","last_undegraded":"2024-05-08T04:24:36.720984+0000","last_fullsized":"2024-05-08T04:24:36.720984+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718803+0000","last_change":"2024-05-08T04:24:36.718803+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718803+0000","last_undegraded":"2024-05-08T04:24:36.718803+0000","last_fullsized":"2024-05-08T04:24:36.718803+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718898+0000","last_change":"2024-05-08T04:24:36.718898+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718898+0000","last_undegraded":"2024-05-08T04:24:36.718898+0000","last_fullsized":"2024-05-08T04:24:36.718898+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720408+0000","last_change":"2024-05-08T04:24:36.720408+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720408+0000","last_undegraded":"2024-05-08T04:24:36.720408+0000","last_fullsized":"2024-05-08T04:24:36.720408+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718830+0000","last_change":"2024-05-08T04:24:36.718830+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718830+0000","last_undegraded":"2024-05-08T04:24:36.718830+0000","last_fullsized":"2024-05-08T04:24:36.718830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720678+0000","last_change":"2024-05-08T04:24:36.720678+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720678+0000","last_undegraded":"2024-05-08T04:24:36.720678+0000","last_fullsized":"2024-05-08T04:24:36.720678+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.722883+0000","last_change":"2024-05-08T04:24:36.722883+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.722883+0000","last_undegraded":"2024-05-08T04:24:36.722883+0000","last_fullsized":"2024-05-08T04:24:36.722883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720800+0000","last_change":"2024-05-08T04:24:36.720800+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720800+0000","last_undegraded":"2024-05-08T04:24:36.720800+0000","last_fullsized":"2024-05-08T04:24:36.720800+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.716088+0000","last_change":"2024-05-08T04:24:36.716088+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.716088+0000","last_undegraded":"2024-05-08T04:24:36.716088+0000","last_fullsized":"2024-05-08T04:24:36.716088+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718811+0000","last_change":"2024-05-08T04:24:36.718811+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718811+0000","last_undegraded":"2024-05-08T04:24:36.718811+0000","last_fullsized":"2024-05-08T04:24:36.718811+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.722913+0000","last_change":"2024-05-08T04:24:36.722913+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.722913+0000","last_undegraded":"2024-05-08T04:24:36.722913+0000","last_fullsized":"2024-05-08T04:24:36.722913+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715492+0000","last_change":"2024-05-08T04:24:36.715492+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715492+0000","last_undegraded":"2024-05-08T04:24:36.715492+0000","last_fullsized":"2024-05-08T04:24:36.715492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718796+0000","last_change":"2024-05-08T04:24:36.718796+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718796+0000","last_undegraded":"2024-05-08T04:24:36.718796+0000","last_fullsized":"2024-05-08T04:24:36.718796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718772+0000","last_change":"2024-05-08T04:24:36.718772+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718772+0000","last_undegraded":"2024-05-08T04:24:36.718772+0000","last_fullsized":"2024-05-08T04:24:36.718772+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718801+0000","last_change":"2024-05-08T04:24:36.718801+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718801+0000","last_undegraded":"2024-05-08T04:24:36.718801+0000","last_fullsized":"2024-05-08T04:24:36.718801+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721555+0000","last_change":"2024-05-08T04:24:36.721555+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721555+0000","last_undegraded":"2024-05-08T04:24:36.721555+0000","last_fullsized":"2024-05-08T04:24:36.721555+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715492+0000","last_change":"2024-05-08T04:24:36.715492+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715492+0000","last_undegraded":"2024-05-08T04:24:36.715492+0000","last_fullsized":"2024-05-08T04:24:36.715492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720415+0000","last_change":"2024-05-08T04:24:36.720415+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720415+0000","last_undegraded":"2024-05-08T04:24:36.720415+0000","last_fullsized":"2024-05-08T04:24:36.720415+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715521+0000","last_change":"2024-05-08T04:24:36.715521+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715521+0000","last_undegraded":"2024-05-08T04:24:36.715521+0000","last_fullsized":"2024-05-08T04:24:36.715521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718788+0000","last_change":"2024-05-08T04:24:36.718788+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718788+0000","last_undegraded":"2024-05-08T04:24:36.718788+0000","last_fullsized":"2024-05-08T04:24:36.718788+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715524+0000","last_change":"2024-05-08T04:24:36.715524+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715524+0000","last_undegraded":"2024-05-08T04:24:36.715524+0000","last_fullsized":"2024-05-08T04:24:36.715524+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721030+0000","last_change":"2024-05-08T04:24:36.721030+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721030+0000","last_undegraded":"2024-05-08T04:24:36.721030+0000","last_fullsized":"2024-05-08T04:24:36.721030+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721022+0000","last_change":"2024-05-08T04:24:36.721022+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721022+0000","last_undegraded":"2024-05-08T04:24:36.721022+0000","last_fullsized":"2024-05-08T04:24:36.721022+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718774+0000","last_change":"2024-05-08T04:24:36.718774+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718774+0000","last_undegraded":"2024-05-08T04:24:36.718774+0000","last_fullsized":"2024-05-08T04:24:36.718774+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721107+0000","last_change":"2024-05-08T04:24:36.721107+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721107+0000","last_undegraded":"2024-05-08T04:24:36.721107+0000","last_fullsized":"2024-05-08T04:24:36.721107+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720402+0000","last_change":"2024-05-08T04:24:36.720402+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720402+0000","last_undegraded":"2024-05-08T04:24:36.720402+0000","last_fullsized":"2024-05-08T04:24:36.720402+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720946+0000","last_change":"2024-05-08T04:24:36.720946+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720946+0000","last_undegraded":"2024-05-08T04:24:36.720946+0000","last_fullsized":"2024-05-08T04:24:36.720946+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720535+0000","last_change":"2024-05-08T04:24:36.720535+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720535+0000","last_undegraded":"2024-05-08T04:24:36.720535+0000","last_fullsized":"2024-05-08T04:24:36.720535+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718729+0000","last_change":"2024-05-08T04:24:36.718729+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718729+0000","last_undegraded":"2024-05-08T04:24:36.718729+0000","last_fullsized":"2024-05-08T04:24:36.718729+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715520+0000","last_change":"2024-05-08T04:24:36.715520+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715520+0000","last_undegraded":"2024-05-08T04:24:36.715520+0000","last_fullsized":"2024-05-08T04:24:36.715520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.722913+0000","last_change":"2024-05-08T04:24:36.722913+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.722913+0000","last_undegraded":"2024-05-08T04:24:36.722913+0000","last_fullsized":"2024-05-08T04:24:36.722913+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":234,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-05-08T04:24:36.721518+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:24:36.721518+0000","last_peered":"2024-05-08T04:24:36.721518+0000","last_clean":"2024-05-08T04:24:36.721518+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:24:36.721518+0000","last_undegraded":"2024-05-08T04:24:36.721518+0000","last_fullsized":"2024-05-08T04:24:36.721518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":270645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1265664,"data_stored":866830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1265664,"data_stored":866830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:24:42.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2024-05-08T04:24:42.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2024-05-08T04:24:42.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2024-05-08T04:24:42.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2024-05-08T04:24:42.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2024-05-08T04:24:42.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2024-05-08T04:24:42.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2024-05-08T04:24:42.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2024-05-08T04:24:42.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2024-05-08T04:24:42.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2024-05-08T04:24:42.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2024-05-08T04:24:42.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2024-05-08T04:24:42.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2024-05-08T04:24:42.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2024-05-08T04:24:42.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2024-05-08T04:24:42.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2024-05-08T04:24:42.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2024-05-08T04:24:42.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2024-05-08T04:24:42.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2024-05-08T04:24:42.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2024-05-08T04:24:42.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2024-05-08T04:24:42.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2024-05-08T04:24:42.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2024-05-08T04:24:42.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2024-05-08T04:24:42.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2024-05-08T04:24:42.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2024-05-08T04:24:42.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2024-05-08T04:24:42.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2024-05-08T04:24:42.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2024-05-08T04:24:42.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2024-05-08T04:24:42.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2024-05-08T04:24:42.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2024-05-08T04:24:42.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2024-05-08T04:24:42.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2024-05-08T04:24:42.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.718820+0000', 'last_change': '2024-05-08T04:24:36.718820+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.718820+0000', 'last_undegraded': '2024-05-08T04:24:36.718820+0000', 'last_fullsized': '2024-05-08T04:24:36.718820+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:24:42.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2024-05-08T04:24:42.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2024-05-08T04:24:42.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.720984+0000', 'last_change': '2024-05-08T04:24:36.720984+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.720984+0000', 'last_undegraded': '2024-05-08T04:24:36.720984+0000', 'last_fullsized': '2024-05-08T04:24:36.720984+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T04:24:42.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2024-05-08T04:24:42.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-05-08T04:24:42.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.718803+0000', 'last_change': '2024-05-08T04:24:36.718803+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.718803+0000', 'last_undegraded': '2024-05-08T04:24:36.718803+0000', 'last_fullsized': '2024-05-08T04:24:36.718803+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T04:24:42.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2024-05-08T04:24:42.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2024-05-08T04:24:42.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.718898+0000', 'last_change': '2024-05-08T04:24:36.718898+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.718898+0000', 'last_undegraded': '2024-05-08T04:24:36.718898+0000', 'last_fullsized': '2024-05-08T04:24:36.718898+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:24:42.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2024-05-08T04:24:42.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2024-05-08T04:24:42.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.720408+0000', 'last_change': '2024-05-08T04:24:36.720408+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.720408+0000', 'last_undegraded': '2024-05-08T04:24:36.720408+0000', 'last_fullsized': '2024-05-08T04:24:36.720408+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:24:42.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2024-05-08T04:24:42.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-05-08T04:24:42.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.718830+0000', 'last_change': '2024-05-08T04:24:36.718830+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.718830+0000', 'last_undegraded': '2024-05-08T04:24:36.718830+0000', 'last_fullsized': '2024-05-08T04:24:36.718830+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T04:24:42.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2024-05-08T04:24:42.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2024-05-08T04:24:42.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.720678+0000', 'last_change': '2024-05-08T04:24:36.720678+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.720678+0000', 'last_undegraded': '2024-05-08T04:24:36.720678+0000', 'last_fullsized': '2024-05-08T04:24:36.720678+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T04:24:42.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2024-05-08T04:24:42.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2024-05-08T04:24:42.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.722883+0000', 'last_change': '2024-05-08T04:24:36.722883+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.722883+0000', 'last_undegraded': '2024-05-08T04:24:36.722883+0000', 'last_fullsized': '2024-05-08T04:24:36.722883+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T04:24:42.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2024-05-08T04:24:42.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2024-05-08T04:24:42.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.720800+0000', 'last_change': '2024-05-08T04:24:36.720800+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.720800+0000', 'last_undegraded': '2024-05-08T04:24:36.720800+0000', 'last_fullsized': '2024-05-08T04:24:36.720800+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T04:24:42.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2024-05-08T04:24:42.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2024-05-08T04:24:42.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.716088+0000', 'last_change': '2024-05-08T04:24:36.716088+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.716088+0000', 'last_undegraded': '2024-05-08T04:24:36.716088+0000', 'last_fullsized': '2024-05-08T04:24:36.716088+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T04:24:42.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2024-05-08T04:24:42.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2024-05-08T04:24:42.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.718811+0000', 'last_change': '2024-05-08T04:24:36.718811+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.718811+0000', 'last_undegraded': '2024-05-08T04:24:36.718811+0000', 'last_fullsized': '2024-05-08T04:24:36.718811+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:24:42.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2024-05-08T04:24:42.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2024-05-08T04:24:42.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.722913+0000', 'last_change': '2024-05-08T04:24:36.722913+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.722913+0000', 'last_undegraded': '2024-05-08T04:24:36.722913+0000', 'last_fullsized': '2024-05-08T04:24:36.722913+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T04:24:42.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2024-05-08T04:24:42.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2024-05-08T04:24:42.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.715492+0000', 'last_change': '2024-05-08T04:24:36.715492+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.715492+0000', 'last_undegraded': '2024-05-08T04:24:36.715492+0000', 'last_fullsized': '2024-05-08T04:24:36.715492+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T04:24:42.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2024-05-08T04:24:42.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-05-08T04:24:42.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.718796+0000', 'last_change': '2024-05-08T04:24:36.718796+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.718796+0000', 'last_undegraded': '2024-05-08T04:24:36.718796+0000', 'last_fullsized': '2024-05-08T04:24:36.718796+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:24:42.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2024-05-08T04:24:42.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2024-05-08T04:24:42.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.718772+0000', 'last_change': '2024-05-08T04:24:36.718772+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.718772+0000', 'last_undegraded': '2024-05-08T04:24:36.718772+0000', 'last_fullsized': '2024-05-08T04:24:36.718772+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:24:42.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2024-05-08T04:24:42.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2024-05-08T04:24:42.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.718801+0000', 'last_change': '2024-05-08T04:24:36.718801+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.718801+0000', 'last_undegraded': '2024-05-08T04:24:36.718801+0000', 'last_fullsized': '2024-05-08T04:24:36.718801+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-08T04:24:42.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2024-05-08T04:24:42.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2024-05-08T04:24:42.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.721555+0000', 'last_change': '2024-05-08T04:24:36.721555+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.721555+0000', 'last_undegraded': '2024-05-08T04:24:36.721555+0000', 'last_fullsized': '2024-05-08T04:24:36.721555+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T04:24:42.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2024-05-08T04:24:42.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2024-05-08T04:24:42.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.715492+0000', 'last_change': '2024-05-08T04:24:36.715492+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.715492+0000', 'last_undegraded': '2024-05-08T04:24:36.715492+0000', 'last_fullsized': '2024-05-08T04:24:36.715492+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T04:24:42.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2024-05-08T04:24:42.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2024-05-08T04:24:42.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.720415+0000', 'last_change': '2024-05-08T04:24:36.720415+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.720415+0000', 'last_undegraded': '2024-05-08T04:24:36.720415+0000', 'last_fullsized': '2024-05-08T04:24:36.720415+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:24:42.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2024-05-08T04:24:42.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2024-05-08T04:24:42.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.715521+0000', 'last_change': '2024-05-08T04:24:36.715521+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.715521+0000', 'last_undegraded': '2024-05-08T04:24:36.715521+0000', 'last_fullsized': '2024-05-08T04:24:36.715521+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T04:24:42.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2024-05-08T04:24:42.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2024-05-08T04:24:42.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.718788+0000', 'last_change': '2024-05-08T04:24:36.718788+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.718788+0000', 'last_undegraded': '2024-05-08T04:24:36.718788+0000', 'last_fullsized': '2024-05-08T04:24:36.718788+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-08T04:24:42.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2024-05-08T04:24:42.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-05-08T04:24:42.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.715524+0000', 'last_change': '2024-05-08T04:24:36.715524+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.715524+0000', 'last_undegraded': '2024-05-08T04:24:36.715524+0000', 'last_fullsized': '2024-05-08T04:24:36.715524+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T04:24:42.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2024-05-08T04:24:42.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2024-05-08T04:24:42.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.721030+0000', 'last_change': '2024-05-08T04:24:36.721030+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.721030+0000', 'last_undegraded': '2024-05-08T04:24:36.721030+0000', 'last_fullsized': '2024-05-08T04:24:36.721030+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T04:24:42.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2024-05-08T04:24:42.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-05-08T04:24:42.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.721022+0000', 'last_change': '2024-05-08T04:24:36.721022+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.721022+0000', 'last_undegraded': '2024-05-08T04:24:36.721022+0000', 'last_fullsized': '2024-05-08T04:24:36.721022+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T04:24:42.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2024-05-08T04:24:42.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-05-08T04:24:42.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.718774+0000', 'last_change': '2024-05-08T04:24:36.718774+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.718774+0000', 'last_undegraded': '2024-05-08T04:24:36.718774+0000', 'last_fullsized': '2024-05-08T04:24:36.718774+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T04:24:42.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2024-05-08T04:24:42.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-05-08T04:24:42.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.721107+0000', 'last_change': '2024-05-08T04:24:36.721107+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.721107+0000', 'last_undegraded': '2024-05-08T04:24:36.721107+0000', 'last_fullsized': '2024-05-08T04:24:36.721107+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-08T04:24:42.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2024-05-08T04:24:42.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2024-05-08T04:24:42.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.720402+0000', 'last_change': '2024-05-08T04:24:36.720402+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.720402+0000', 'last_undegraded': '2024-05-08T04:24:36.720402+0000', 'last_fullsized': '2024-05-08T04:24:36.720402+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:24:42.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2024-05-08T04:24:42.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-05-08T04:24:42.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.720946+0000', 'last_change': '2024-05-08T04:24:36.720946+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.720946+0000', 'last_undegraded': '2024-05-08T04:24:36.720946+0000', 'last_fullsized': '2024-05-08T04:24:36.720946+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-08T04:24:42.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2024-05-08T04:24:42.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2024-05-08T04:24:42.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.720535+0000', 'last_change': '2024-05-08T04:24:36.720535+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.720535+0000', 'last_undegraded': '2024-05-08T04:24:36.720535+0000', 'last_fullsized': '2024-05-08T04:24:36.720535+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-08T04:24:42.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2024-05-08T04:24:42.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-05-08T04:24:42.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.718729+0000', 'last_change': '2024-05-08T04:24:36.718729+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.718729+0000', 'last_undegraded': '2024-05-08T04:24:36.718729+0000', 'last_fullsized': '2024-05-08T04:24:36.718729+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-08T04:24:42.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2024-05-08T04:24:42.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2024-05-08T04:24:42.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.715520+0000', 'last_change': '2024-05-08T04:24:36.715520+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.715520+0000', 'last_undegraded': '2024-05-08T04:24:36.715520+0000', 'last_fullsized': '2024-05-08T04:24:36.715520+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-08T04:24:42.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2024-05-08T04:24:42.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-08T04:24:37.712930+0000', 'last_change': '2024-05-08T04:24:37.712930+0000', 'last_active': '2024-05-08T04:24:37.712930+0000', 'last_peered': '2024-05-08T04:24:37.712930+0000', 'last_clean': '2024-05-08T04:24:37.712930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:37.712930+0000', 'last_undegraded': '2024-05-08T04:24:37.712930+0000', 'last_fullsized': '2024-05-08T04:24:37.712930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:37.712930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-08T04:24:42.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-05-08T04:24:42.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-08T04:24:36.722913+0000', 'last_change': '2024-05-08T04:24:36.722913+0000', 'last_active': '2024-05-08T04:24:36.706346+0000', 'last_peered': '2024-05-08T04:24:36.706346+0000', 'last_clean': '2024-05-08T04:24:36.706346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-08T04:24:36.722913+0000', 'last_undegraded': '2024-05-08T04:24:36.722913+0000', 'last_fullsized': '2024-05-08T04:24:36.722913+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'last_clean_scrub_stamp': '2024-05-08T04:24:36.706346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-08T04:24:42.475 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-08T04:24:42.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.587+0000 7f2604f70640 1 Processor -- start 2024-05-08T04:24:42.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.587+0000 7f2604f70640 1 -- start start 2024-05-08T04:24:42.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.588+0000 7f2604f70640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26000ada00 0x7f2600072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.588+0000 7f2604f70640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f260015c080 0x7f26000acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.588+0000 7f2604f70640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260006f4f0 con 0x7f260015bca0 2024-05-08T04:24:42.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.588+0000 7f2604f70640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260015c510 con 0x7f260015c080 2024-05-08T04:24:42.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.588+0000 7f2604f70640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260006f7b0 con 0x7f26000ada00 2024-05-08T04:24:42.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.588+0000 7f25fed9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f260015c080 0x7f26000acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:42.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.588+0000 7f25fed9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f260015c080 0x7f26000acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56370/0 (socket says 172.21.15.104:56370) 2024-05-08T04:24:42.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.588+0000 7f25fed9d640 1 -- 172.21.15.104:0/3257277139 learned_addr learned my addr 172.21.15.104:0/3257277139 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:42.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.588+0000 7f25fed9d640 1 -- 172.21.15.104:0/3257277139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26000ada00 msgr2=0x7f2600072810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T04:24:42.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.588+0000 7f25fed9d640 1 --2- 172.21.15.104:0/3257277139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26000ada00 0x7f2600072810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.589+0000 7f25fed9d640 1 -- 172.21.15.104:0/3257277139 >> v1:172.21.15.183:6789/0 conn(0x7f260015bca0 legacy=0x7f2600160010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T04:24:42.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.589+0000 7f25fed9d640 1 -- 172.21.15.104:0/3257277139 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26000af570 con 0x7f260015c080 2024-05-08T04:24:42.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.589+0000 7f25fed9d640 1 --2- 172.21.15.104:0/3257277139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260015c080 0x7f26000acdf0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009870 tx=0x7f25f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ee70f7f8bc4d62 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:42.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.589+0000 7f25fd59a640 1 -- 172.21.15.104:0/3257277139 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8037070 con 0x7f260015c080 2024-05-08T04:24:42.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.589+0000 7f25fd59a640 1 -- 172.21.15.104:0/3257277139 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f8032440 con 0x7f260015c080 2024-05-08T04:24:42.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.589+0000 7f25fd59a640 1 -- 172.21.15.104:0/3257277139 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8032810 con 0x7f260015c080 2024-05-08T04:24:42.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.590+0000 7f2604f70640 1 -- 172.21.15.104:0/3257277139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260015c080 msgr2=0x7f26000acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.590+0000 7f2604f70640 1 --2- 172.21.15.104:0/3257277139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260015c080 0x7f26000acdf0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009870 tx=0x7f25f802a1a0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.590+0000 7f2604f70640 1 -- 172.21.15.104:0/3257277139 shutdown_connections 2024-05-08T04:24:42.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.590+0000 7f2604f70640 1 --2- 172.21.15.104:0/3257277139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260015c080 0x7f26000acdf0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.590+0000 7f2604f70640 1 --2- 172.21.15.104:0/3257277139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26000ada00 0x7f2600072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.590+0000 7f2604f70640 1 -- 172.21.15.104:0/3257277139 >> 172.21.15.104:0/3257277139 conn(0x7f2600071a10 msgr2=0x7f2600071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:42.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.590+0000 7f2604f70640 1 -- 172.21.15.104:0/3257277139 shutdown_connections 2024-05-08T04:24:42.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.590+0000 7f2604f70640 1 -- 172.21.15.104:0/3257277139 wait complete. 2024-05-08T04:24:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.591+0000 7f2604f70640 1 Processor -- start 2024-05-08T04:24:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.591+0000 7f2604f70640 1 -- start start 2024-05-08T04:24:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f2604f70640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26000ada00 0x7f2600151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f2604f70640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260015bca0 0x7f26001f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f2604f70640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f260015c080 0x7f26001f2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f2604f70640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000ad330 con 0x7f260015bca0 2024-05-08T04:24:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f2604f70640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000af850 con 0x7f26000ada00 2024-05-08T04:24:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f2604f70640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26000ad4b0 con 0x7f260015c080 2024-05-08T04:24:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f25fdd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260015bca0 0x7f26001f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f25fdd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260015bca0 0x7f26001f5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56380/0 (socket says 172.21.15.104:56380) 2024-05-08T04:24:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f25fdd9b640 1 -- 172.21.15.104:0/150731327 learned_addr learned my addr 172.21.15.104:0/150731327 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f25fdd9b640 1 -- 172.21.15.104:0/150731327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f260015c080 msgr2=0x7f26001f2610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T04:24:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f25fdd9b640 1 --2- 172.21.15.104:0/150731327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f260015c080 0x7f26001f2610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f25fdd9b640 1 -- 172.21.15.104:0/150731327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26000ada00 msgr2=0x7f2600151960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T04:24:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f25fdd9b640 1 --2- 172.21.15.104:0/150731327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26000ada00 0x7f2600151960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.592+0000 7f25fdd9b640 1 -- 172.21.15.104:0/150731327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26000ceea0 con 0x7f260015bca0 2024-05-08T04:24:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.593+0000 7f25fdd9b640 1 --2- 172.21.15.104:0/150731327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260015bca0 0x7f26001f5be0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f25e800b3e0 tx=0x7f25e800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.593+0000 7f25f6ffd640 1 -- 172.21.15.104:0/150731327 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8015020 con 0x7f260015bca0 2024-05-08T04:24:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.593+0000 7f25f6ffd640 1 -- 172.21.15.104:0/150731327 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e8011850 con 0x7f260015bca0 2024-05-08T04:24:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.593+0000 7f2604f70640 1 -- 172.21.15.104:0/150731327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26000cf180 con 0x7f260015bca0 2024-05-08T04:24:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.593+0000 7f25f6ffd640 1 -- 172.21.15.104:0/150731327 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e8011c40 con 0x7f260015bca0 2024-05-08T04:24:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.593+0000 7f2604f70640 1 -- 172.21.15.104:0/150731327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26001f1840 con 0x7f260015bca0 2024-05-08T04:24:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.594+0000 7f2604f70640 1 -- 172.21.15.104:0/150731327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26000aead0 con 0x7f260015bca0 2024-05-08T04:24:42.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.594+0000 7f25f6ffd640 1 -- 172.21.15.104:0/150731327 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f25e8018020 con 0x7f260015bca0 2024-05-08T04:24:42.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.595+0000 7f25f6ffd640 1 --2- 172.21.15.104:0/150731327 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f25e006b680 0x7f25e006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.595+0000 7f25f6ffd640 1 -- 172.21.15.104:0/150731327 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25e808a3d0 con 0x7f260015bca0 2024-05-08T04:24:42.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.595+0000 7f25fe59c640 1 --2- 172.21.15.104:0/150731327 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f25e006b680 0x7f25e006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:42.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.595+0000 7f25fe59c640 1 --2- 172.21.15.104:0/150731327 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f25e006b680 0x7f25e006db40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f26000ce8e0 tx=0x7f25f0009250 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:42.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.599+0000 7f25f6ffd640 1 -- 172.21.15.104:0/150731327 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f26000aead0 con 0x7f260015bca0 2024-05-08T04:24:42.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.839+0000 7f2604f70640 1 -- 172.21.15.104:0/150731327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f26000cf350 con 0x7f260015bca0 2024-05-08T04:24:42.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.839+0000 7f25f6ffd640 1 -- 172.21.15.104:0/150731327 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1174 (secure 0 0 0) 0x7f25e801f020 con 0x7f260015bca0 2024-05-08T04:24:42.842 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:42.842 INFO:teuthology.orchestra.run.smithi104.stdout:{"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":236,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":59,"num_osds":8,"num_up_osds":8,"osd_up_since":1715142057,"num_in_osds":8,"osd_in_since":1715142048,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":46},{"state_name":"unknown","count":35},{"state_name":"creating+peering","count":16}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":592140,"bytes_used":228106240,"bytes_avail":772866007040,"bytes_total":773094113280,"unknown_pgs_ratio":0.36082473397254944,"inactive_pgs_ratio":0.16494844853878021,"write_bytes_sec":858,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":28,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":6366}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-05-08T04:23:50.670221+0000","services":{}},"progress_events":{}} 2024-05-08T04:24:42.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.841+0000 7f2604f70640 1 -- 172.21.15.104:0/150731327 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f25e006b680 msgr2=0x7f25e006db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.841+0000 7f2604f70640 1 --2- 172.21.15.104:0/150731327 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f25e006b680 0x7f25e006db40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f26000ce8e0 tx=0x7f25f0009250 comp rx=0 tx=0).stop 2024-05-08T04:24:42.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.841+0000 7f2604f70640 1 -- 172.21.15.104:0/150731327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260015bca0 msgr2=0x7f26001f5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.841+0000 7f2604f70640 1 --2- 172.21.15.104:0/150731327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260015bca0 0x7f26001f5be0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f25e800b3e0 tx=0x7f25e800b8a0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.841+0000 7f2604f70640 1 -- 172.21.15.104:0/150731327 shutdown_connections 2024-05-08T04:24:42.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.841+0000 7f2604f70640 1 --2- 172.21.15.104:0/150731327 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f25e006b680 0x7f25e006db40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.841+0000 7f2604f70640 1 --2- 172.21.15.104:0/150731327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f260015c080 0x7f26001f2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.841+0000 7f2604f70640 1 --2- 172.21.15.104:0/150731327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f260015bca0 0x7f26001f5be0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.841+0000 7f2604f70640 1 --2- 172.21.15.104:0/150731327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26000ada00 0x7f2600151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.841+0000 7f2604f70640 1 -- 172.21.15.104:0/150731327 >> 172.21.15.104:0/150731327 conn(0x7f2600071a10 msgr2=0x7f26000cf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:42.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.841+0000 7f2604f70640 1 -- 172.21.15.104:0/150731327 shutdown_connections 2024-05-08T04:24:42.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.841+0000 7f2604f70640 1 -- 172.21.15.104:0/150731327 wait complete. 2024-05-08T04:24:42.854 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-08T04:24:42.854 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:24:42.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.951+0000 7f51e975c640 1 Processor -- start 2024-05-08T04:24:42.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.951+0000 7f51e975c640 1 -- start start 2024-05-08T04:24:42.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.952+0000 7f51e975c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f51e4099a40 0x7f51e4099e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.952+0000 7f51e975c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f51e40ccbe0 0x7f51e40ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.952+0000 7f51e975c640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e40cc700 con 0x7f51e40cf360 2024-05-08T04:24:42.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.952+0000 7f51e975c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e415ced0 con 0x7f51e40ccbe0 2024-05-08T04:24:42.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.952+0000 7f51e975c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e409a360 con 0x7f51e4099a40 2024-05-08T04:24:42.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.952+0000 7f51e37fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f51e40ccbe0 0x7f51e40ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:42.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.952+0000 7f51e27fc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f51e40cf360 0x7f51e40cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:47452/0 (socket says 172.21.15.104:47452) 2024-05-08T04:24:42.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.952+0000 7f51e27fc640 1 -- 172.21.15.104:0/1703472354 learned_addr learned my addr 172.21.15.104:0/1703472354 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:42.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.953+0000 7f51e37fe640 1 -- 172.21.15.104:0/1703472354 >> v2:172.21.15.183:3300/0 conn(0x7f51e4099a40 msgr2=0x7f51e4099e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T04:24:42.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.953+0000 7f51e37fe640 1 --2- 172.21.15.104:0/1703472354 >> v2:172.21.15.183:3300/0 conn(0x7f51e4099a40 0x7f51e4099e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.953+0000 7f51e37fe640 1 -- 172.21.15.104:0/1703472354 >> v1:172.21.15.104:6789/0 conn(0x7f51e40cf360 legacy=0x7f51e40cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.953+0000 7f51e1ffb640 1 -- 172.21.15.104:0/1703472354 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202364032 0 0) 0x7f51e40cc700 con 0x7f51e40cf360 2024-05-08T04:24:42.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.953+0000 7f51e37fe640 1 -- 172.21.15.104:0/1703472354 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e40d0020 con 0x7f51e40ccbe0 2024-05-08T04:24:42.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.953+0000 7f51e37fe640 1 --2- 172.21.15.104:0/1703472354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e40ccbe0 0x7f51e40ccfe0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f51e4072ec0 tx=0x7f51dc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6d497c5032b2b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:42.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.953+0000 7f51e1ffb640 1 -- 172.21.15.104:0/1703472354 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc037070 con 0x7f51e40ccbe0 2024-05-08T04:24:42.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.953+0000 7f51e1ffb640 1 -- 172.21.15.104:0/1703472354 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc032440 con 0x7f51e40ccbe0 2024-05-08T04:24:42.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.953+0000 7f51e1ffb640 1 -- 172.21.15.104:0/1703472354 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc032810 con 0x7f51e40ccbe0 2024-05-08T04:24:42.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.954+0000 7f51e975c640 1 -- 172.21.15.104:0/1703472354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e40ccbe0 msgr2=0x7f51e40ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.954+0000 7f51e975c640 1 --2- 172.21.15.104:0/1703472354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e40ccbe0 0x7f51e40ccfe0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f51e4072ec0 tx=0x7f51dc02a1c0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.954+0000 7f51e975c640 1 -- 172.21.15.104:0/1703472354 shutdown_connections 2024-05-08T04:24:42.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.954+0000 7f51e975c640 1 --2- 172.21.15.104:0/1703472354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e40ccbe0 0x7f51e40ccfe0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.954+0000 7f51e975c640 1 --2- 172.21.15.104:0/1703472354 >> v2:172.21.15.183:3300/0 conn(0x7f51e4099a40 0x7f51e4099e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.954+0000 7f51e975c640 1 -- 172.21.15.104:0/1703472354 >> 172.21.15.104:0/1703472354 conn(0x7f51e40b3280 msgr2=0x7f51e40b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:42.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.954+0000 7f51e975c640 1 -- 172.21.15.104:0/1703472354 shutdown_connections 2024-05-08T04:24:42.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.954+0000 7f51e975c640 1 -- 172.21.15.104:0/1703472354 wait complete. 2024-05-08T04:24:42.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.955+0000 7f51e975c640 1 Processor -- start 2024-05-08T04:24:42.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.955+0000 7f51e975c640 1 -- start start 2024-05-08T04:24:42.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e975c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51e4099a40 0x7f51e4158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e975c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e40ccbe0 0x7f51e41f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e975c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e40cf360 0x7f51e40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e975c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4159860 con 0x7f51e40cf360 2024-05-08T04:24:42.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e975c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40d05e0 con 0x7f51e40ccbe0 2024-05-08T04:24:42.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e975c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40d08c0 con 0x7f51e4099a40 2024-05-08T04:24:42.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e40cf360 0x7f51e40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:42.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e40cf360 0x7f51e40b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56394/0 (socket says 172.21.15.104:56394) 2024-05-08T04:24:42.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e37fe640 1 -- 172.21.15.104:0/2445761355 learned_addr learned my addr 172.21.15.104:0/2445761355 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:42.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e37fe640 1 -- 172.21.15.104:0/2445761355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51e4099a40 msgr2=0x7f51e4158da0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T04:24:42.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e37fe640 1 --2- 172.21.15.104:0/2445761355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51e4099a40 0x7f51e4158da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e37fe640 1 -- 172.21.15.104:0/2445761355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e40ccbe0 msgr2=0x7f51e41f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:42.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e37fe640 1 --2- 172.21.15.104:0/2445761355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e40ccbe0 0x7f51e41f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:42.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.956+0000 7f51e37fe640 1 -- 172.21.15.104:0/2445761355 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e40c6500 con 0x7f51e40cf360 2024-05-08T04:24:42.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.957+0000 7f51e37fe640 1 --2- 172.21.15.104:0/2445761355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e40cf360 0x7f51e40b4dc0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009890 tx=0x7f51dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:42.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.957+0000 7f51db7fe640 1 -- 172.21.15.104:0/2445761355 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc041070 con 0x7f51e40cf360 2024-05-08T04:24:42.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.957+0000 7f51db7fe640 1 -- 172.21.15.104:0/2445761355 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc03c870 con 0x7f51e40cf360 2024-05-08T04:24:42.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.957+0000 7f51e975c640 1 -- 172.21.15.104:0/2445761355 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e41f2ba0 con 0x7f51e40cf360 2024-05-08T04:24:42.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.957+0000 7f51db7fe640 1 -- 172.21.15.104:0/2445761355 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc037040 con 0x7f51e40cf360 2024-05-08T04:24:42.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.957+0000 7f51e975c640 1 -- 172.21.15.104:0/2445761355 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e40b73b0 con 0x7f51e40cf360 2024-05-08T04:24:42.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.958+0000 7f51e975c640 1 -- 172.21.15.104:0/2445761355 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e40b3e30 con 0x7f51e40cf360 2024-05-08T04:24:42.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.958+0000 7f51db7fe640 1 -- 172.21.15.104:0/2445761355 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f51dc044070 con 0x7f51e40cf360 2024-05-08T04:24:42.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.959+0000 7f51db7fe640 1 --2- 172.21.15.104:0/2445761355 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f51c406b680 0x7f51c406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:42.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.959+0000 7f51db7fe640 1 -- 172.21.15.104:0/2445761355 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51dc0ab010 con 0x7f51e40cf360 2024-05-08T04:24:42.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.959+0000 7f51e2ffd640 1 --2- 172.21.15.104:0/2445761355 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f51c406b680 0x7f51c406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:42.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.959+0000 7f51e2ffd640 1 --2- 172.21.15.104:0/2445761355 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f51c406b680 0x7f51c406db40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f51d400abb0 tx=0x7f51d4009250 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:42.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:42.963+0000 7f51db7fe640 1 -- 172.21.15.104:0/2445761355 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f51e40b3e30 con 0x7f51e40cf360 2024-05-08T04:24:43.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.127+0000 7f51e975c640 1 -- 172.21.15.104:0/2445761355 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51e41f30c0 con 0x7f51c406b680 2024-05-08T04:24:43.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.133+0000 7f51db7fe640 1 -- 172.21.15.104:0/2445761355 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+245684 (secure 0 0 0) 0x7f51d40163f0 con 0x7f51c406b680 2024-05-08T04:24:43.137 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:43.139 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:24:43.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.136+0000 7f51e975c640 1 -- 172.21.15.104:0/2445761355 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f51c406b680 msgr2=0x7f51c406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:43.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.136+0000 7f51e975c640 1 --2- 172.21.15.104:0/2445761355 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f51c406b680 0x7f51c406db40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f51d400abb0 tx=0x7f51d4009250 comp rx=0 tx=0).stop 2024-05-08T04:24:43.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.136+0000 7f51e975c640 1 -- 172.21.15.104:0/2445761355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e40cf360 msgr2=0x7f51e40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:43.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.136+0000 7f51e975c640 1 --2- 172.21.15.104:0/2445761355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e40cf360 0x7f51e40b4dc0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009890 tx=0x7f51dc0046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:43.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.136+0000 7f51e975c640 1 -- 172.21.15.104:0/2445761355 shutdown_connections 2024-05-08T04:24:43.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.136+0000 7f51e975c640 1 --2- 172.21.15.104:0/2445761355 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f51c406b680 0x7f51c406db40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:43.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.136+0000 7f51e975c640 1 --2- 172.21.15.104:0/2445761355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e40ccbe0 0x7f51e41f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:43.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.136+0000 7f51e975c640 1 --2- 172.21.15.104:0/2445761355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51e40cf360 0x7f51e40b4dc0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:43.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.136+0000 7f51e975c640 1 --2- 172.21.15.104:0/2445761355 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51e4099a40 0x7f51e4158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:43.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.136+0000 7f51e975c640 1 -- 172.21.15.104:0/2445761355 >> 172.21.15.104:0/2445761355 conn(0x7f51e40b3280 msgr2=0x7f51e40b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:43.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.136+0000 7f51e975c640 1 -- 172.21.15.104:0/2445761355 shutdown_connections 2024-05-08T04:24:43.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:43.136+0000 7f51e975c640 1 -- 172.21.15.104:0/2445761355 wait complete. 2024-05-08T04:24:43.149 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-05-08T04:24:42.681695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592140,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":185,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":124,"acting":124,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222760,"kb_used_data":6580,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751960,"statfs":{"total":773094113280,"available":772866007040,"internally_reserved":0,"allocated":6737920,"data_stored":3468071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1772,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.966073"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748380+0000","last_change":"2024-05-08T04:24:38.738320+0000","last_active":"2024-05-08T04:24:39.748380+0000","last_peered":"2024-05-08T04:24:39.748380+0000","last_clean":"2024-05-08T04:24:39.748380+0000","last_became_active":"2024-05-08T04:24:38.738026+0000","last_became_peered":"2024-05-08T04:24:38.738026+0000","last_unstale":"2024-05-08T04:24:39.748380+0000","last_undegraded":"2024-05-08T04:24:39.748380+0000","last_fullsized":"2024-05-08T04:24:39.748380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:12:52.144717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.622098+0000","last_change":"2024-05-08T04:24:38.745020+0000","last_active":"2024-05-08T04:24:40.622098+0000","last_peered":"2024-05-08T04:24:40.622098+0000","last_clean":"2024-05-08T04:24:40.622098+0000","last_became_active":"2024-05-08T04:24:38.744684+0000","last_became_peered":"2024-05-08T04:24:38.744684+0000","last_unstale":"2024-05-08T04:24:40.622098+0000","last_undegraded":"2024-05-08T04:24:40.622098+0000","last_fullsized":"2024-05-08T04:24:40.622098+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:16:13.548014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621877+0000","last_change":"2024-05-08T04:24:38.739106+0000","last_active":"2024-05-08T04:24:40.621877+0000","last_peered":"2024-05-08T04:24:40.621877+0000","last_clean":"2024-05-08T04:24:40.621877+0000","last_became_active":"2024-05-08T04:24:38.738839+0000","last_became_peered":"2024-05-08T04:24:38.738839+0000","last_unstale":"2024-05-08T04:24:40.621877+0000","last_undegraded":"2024-05-08T04:24:40.621877+0000","last_fullsized":"2024-05-08T04:24:40.621877+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:44:54.535193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714964+0000","last_change":"2024-05-08T04:24:38.748172+0000","last_active":"2024-05-08T04:24:40.714964+0000","last_peered":"2024-05-08T04:24:40.714964+0000","last_clean":"2024-05-08T04:24:40.714964+0000","last_became_active":"2024-05-08T04:24:38.747901+0000","last_became_peered":"2024-05-08T04:24:38.747901+0000","last_unstale":"2024-05-08T04:24:40.714964+0000","last_undegraded":"2024-05-08T04:24:40.714964+0000","last_fullsized":"2024-05-08T04:24:40.714964+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:35:14.175811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715135+0000","last_change":"2024-05-08T04:24:38.737774+0000","last_active":"2024-05-08T04:24:40.715135+0000","last_peered":"2024-05-08T04:24:40.715135+0000","last_clean":"2024-05-08T04:24:40.715135+0000","last_became_active":"2024-05-08T04:24:38.737495+0000","last_became_peered":"2024-05-08T04:24:38.737495+0000","last_unstale":"2024-05-08T04:24:40.715135+0000","last_undegraded":"2024-05-08T04:24:40.715135+0000","last_fullsized":"2024-05-08T04:24:40.715135+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:18.654354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715233+0000","last_change":"2024-05-08T04:24:38.743303+0000","last_active":"2024-05-08T04:24:40.715233+0000","last_peered":"2024-05-08T04:24:40.715233+0000","last_clean":"2024-05-08T04:24:40.715233+0000","last_became_active":"2024-05-08T04:24:38.743039+0000","last_became_peered":"2024-05-08T04:24:38.743039+0000","last_unstale":"2024-05-08T04:24:40.715233+0000","last_undegraded":"2024-05-08T04:24:40.715233+0000","last_fullsized":"2024-05-08T04:24:40.715233+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:31.165497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748300+0000","last_change":"2024-05-08T04:24:38.746594+0000","last_active":"2024-05-08T04:24:39.748300+0000","last_peered":"2024-05-08T04:24:39.748300+0000","last_clean":"2024-05-08T04:24:39.748300+0000","last_became_active":"2024-05-08T04:24:38.746302+0000","last_became_peered":"2024-05-08T04:24:38.746302+0000","last_unstale":"2024-05-08T04:24:39.748300+0000","last_undegraded":"2024-05-08T04:24:39.748300+0000","last_fullsized":"2024-05-08T04:24:39.748300+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:48:11.015094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715201+0000","last_change":"2024-05-08T04:24:38.748964+0000","last_active":"2024-05-08T04:24:40.715201+0000","last_peered":"2024-05-08T04:24:40.715201+0000","last_clean":"2024-05-08T04:24:40.715201+0000","last_became_active":"2024-05-08T04:24:38.748642+0000","last_became_peered":"2024-05-08T04:24:38.748642+0000","last_unstale":"2024-05-08T04:24:40.715201+0000","last_undegraded":"2024-05-08T04:24:40.715201+0000","last_fullsized":"2024-05-08T04:24:40.715201+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:48:05.993554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748193+0000","last_change":"2024-05-08T04:24:38.744306+0000","last_active":"2024-05-08T04:24:39.748193+0000","last_peered":"2024-05-08T04:24:39.748193+0000","last_clean":"2024-05-08T04:24:39.748193+0000","last_became_active":"2024-05-08T04:24:38.743725+0000","last_became_peered":"2024-05-08T04:24:38.743725+0000","last_unstale":"2024-05-08T04:24:39.748193+0000","last_undegraded":"2024-05-08T04:24:39.748193+0000","last_fullsized":"2024-05-08T04:24:39.748193+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:05.757648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715280+0000","last_change":"2024-05-08T04:24:38.738535+0000","last_active":"2024-05-08T04:24:40.715280+0000","last_peered":"2024-05-08T04:24:40.715280+0000","last_clean":"2024-05-08T04:24:40.715280+0000","last_became_active":"2024-05-08T04:24:38.738255+0000","last_became_peered":"2024-05-08T04:24:38.738255+0000","last_unstale":"2024-05-08T04:24:40.715280+0000","last_undegraded":"2024-05-08T04:24:40.715280+0000","last_fullsized":"2024-05-08T04:24:40.715280+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:07:35.206873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621888+0000","last_change":"2024-05-08T04:24:38.741514+0000","last_active":"2024-05-08T04:24:40.621888+0000","last_peered":"2024-05-08T04:24:40.621888+0000","last_clean":"2024-05-08T04:24:40.621888+0000","last_became_active":"2024-05-08T04:24:38.741252+0000","last_became_peered":"2024-05-08T04:24:38.741252+0000","last_unstale":"2024-05-08T04:24:40.621888+0000","last_undegraded":"2024-05-08T04:24:40.621888+0000","last_fullsized":"2024-05-08T04:24:40.621888+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:19:40.824803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714791+0000","last_change":"2024-05-08T04:24:38.750390+0000","last_active":"2024-05-08T04:24:40.714791+0000","last_peered":"2024-05-08T04:24:40.714791+0000","last_clean":"2024-05-08T04:24:40.714791+0000","last_became_active":"2024-05-08T04:24:38.750133+0000","last_became_peered":"2024-05-08T04:24:38.750133+0000","last_unstale":"2024-05-08T04:24:40.714791+0000","last_undegraded":"2024-05-08T04:24:40.714791+0000","last_fullsized":"2024-05-08T04:24:40.714791+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:20:49.352910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715366+0000","last_change":"2024-05-08T04:24:38.735407+0000","last_active":"2024-05-08T04:24:40.715366+0000","last_peered":"2024-05-08T04:24:40.715366+0000","last_clean":"2024-05-08T04:24:40.715366+0000","last_became_active":"2024-05-08T04:24:38.735129+0000","last_became_peered":"2024-05-08T04:24:38.735129+0000","last_unstale":"2024-05-08T04:24:40.715366+0000","last_undegraded":"2024-05-08T04:24:40.715366+0000","last_fullsized":"2024-05-08T04:24:40.715366+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:28:56.236902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621964+0000","last_change":"2024-05-08T04:24:38.737426+0000","last_active":"2024-05-08T04:24:40.621964+0000","last_peered":"2024-05-08T04:24:40.621964+0000","last_clean":"2024-05-08T04:24:40.621964+0000","last_became_active":"2024-05-08T04:24:38.737153+0000","last_became_peered":"2024-05-08T04:24:38.737153+0000","last_unstale":"2024-05-08T04:24:40.621964+0000","last_undegraded":"2024-05-08T04:24:40.621964+0000","last_fullsized":"2024-05-08T04:24:40.621964+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:55:13.415009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718820+0000","last_change":"2024-05-08T04:24:36.718820+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718820+0000","last_undegraded":"2024-05-08T04:24:36.718820+0000","last_fullsized":"2024-05-08T04:24:36.718820+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720984+0000","last_change":"2024-05-08T04:24:36.720984+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720984+0000","last_undegraded":"2024-05-08T04:24:36.720984+0000","last_fullsized":"2024-05-08T04:24:36.720984+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718803+0000","last_change":"2024-05-08T04:24:36.718803+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718803+0000","last_undegraded":"2024-05-08T04:24:36.718803+0000","last_fullsized":"2024-05-08T04:24:36.718803+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.622044+0000","last_change":"2024-05-08T04:24:37.729547+0000","last_active":"2024-05-08T04:24:40.622044+0000","last_peered":"2024-05-08T04:24:40.622044+0000","last_clean":"2024-05-08T04:24:40.622044+0000","last_became_active":"2024-05-08T04:24:37.729285+0000","last_became_peered":"2024-05-08T04:24:37.729285+0000","last_unstale":"2024-05-08T04:24:40.622044+0000","last_undegraded":"2024-05-08T04:24:40.622044+0000","last_fullsized":"2024-05-08T04:24:40.622044+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:20:24.834907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748210+0000","last_change":"2024-05-08T04:24:37.733429+0000","last_active":"2024-05-08T04:24:39.748210+0000","last_peered":"2024-05-08T04:24:39.748210+0000","last_clean":"2024-05-08T04:24:39.748210+0000","last_became_active":"2024-05-08T04:24:37.733187+0000","last_became_peered":"2024-05-08T04:24:37.733187+0000","last_unstale":"2024-05-08T04:24:39.748210+0000","last_undegraded":"2024-05-08T04:24:39.748210+0000","last_fullsized":"2024-05-08T04:24:39.748210+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:32:55.752926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718830+0000","last_change":"2024-05-08T04:24:36.718830+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718830+0000","last_undegraded":"2024-05-08T04:24:36.718830+0000","last_fullsized":"2024-05-08T04:24:36.718830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.747992+0000","last_change":"2024-05-08T04:24:38.738429+0000","last_active":"2024-05-08T04:24:39.747992+0000","last_peered":"2024-05-08T04:24:39.747992+0000","last_clean":"2024-05-08T04:24:39.747992+0000","last_became_active":"2024-05-08T04:24:38.738159+0000","last_became_peered":"2024-05-08T04:24:38.738159+0000","last_unstale":"2024-05-08T04:24:39.747992+0000","last_undegraded":"2024-05-08T04:24:39.747992+0000","last_fullsized":"2024-05-08T04:24:39.747992+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:39:01.204213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714742+0000","last_change":"2024-05-08T04:24:37.726677+0000","last_active":"2024-05-08T04:24:40.714742+0000","last_peered":"2024-05-08T04:24:40.714742+0000","last_clean":"2024-05-08T04:24:40.714742+0000","last_became_active":"2024-05-08T04:24:37.726402+0000","last_became_peered":"2024-05-08T04:24:37.726402+0000","last_unstale":"2024-05-08T04:24:40.714742+0000","last_undegraded":"2024-05-08T04:24:40.714742+0000","last_fullsized":"2024-05-08T04:24:40.714742+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:43:51.484538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715092+0000","last_change":"2024-05-08T04:24:37.734072+0000","last_active":"2024-05-08T04:24:40.715092+0000","last_peered":"2024-05-08T04:24:40.715092+0000","last_clean":"2024-05-08T04:24:40.715092+0000","last_became_active":"2024-05-08T04:24:37.733786+0000","last_became_peered":"2024-05-08T04:24:37.733786+0000","last_unstale":"2024-05-08T04:24:40.715092+0000","last_undegraded":"2024-05-08T04:24:40.715092+0000","last_fullsized":"2024-05-08T04:24:40.715092+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:28:40.958510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715450+0000","last_change":"2024-05-08T04:24:38.746588+0000","last_active":"2024-05-08T04:24:40.715450+0000","last_peered":"2024-05-08T04:24:40.715450+0000","last_clean":"2024-05-08T04:24:40.715450+0000","last_became_active":"2024-05-08T04:24:38.746308+0000","last_became_peered":"2024-05-08T04:24:38.746308+0000","last_unstale":"2024-05-08T04:24:40.715450+0000","last_undegraded":"2024-05-08T04:24:40.715450+0000","last_fullsized":"2024-05-08T04:24:40.715450+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:05.757648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714826+0000","last_change":"2024-05-08T04:24:37.730751+0000","last_active":"2024-05-08T04:24:40.714826+0000","last_peered":"2024-05-08T04:24:40.714826+0000","last_clean":"2024-05-08T04:24:40.714826+0000","last_became_active":"2024-05-08T04:24:37.730492+0000","last_became_peered":"2024-05-08T04:24:37.730492+0000","last_unstale":"2024-05-08T04:24:40.714826+0000","last_undegraded":"2024-05-08T04:24:40.714826+0000","last_fullsized":"2024-05-08T04:24:40.714826+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:54:38.666024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748497+0000","last_change":"2024-05-08T04:24:38.747024+0000","last_active":"2024-05-08T04:24:39.748497+0000","last_peered":"2024-05-08T04:24:39.748497+0000","last_clean":"2024-05-08T04:24:39.748497+0000","last_became_active":"2024-05-08T04:24:38.745832+0000","last_became_peered":"2024-05-08T04:24:38.745832+0000","last_unstale":"2024-05-08T04:24:39.748497+0000","last_undegraded":"2024-05-08T04:24:39.748497+0000","last_fullsized":"2024-05-08T04:24:39.748497+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:08:23.365140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.716088+0000","last_change":"2024-05-08T04:24:36.716088+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.716088+0000","last_undegraded":"2024-05-08T04:24:36.716088+0000","last_fullsized":"2024-05-08T04:24:36.716088+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.622028+0000","last_change":"2024-05-08T04:24:37.729552+0000","last_active":"2024-05-08T04:24:40.622028+0000","last_peered":"2024-05-08T04:24:40.622028+0000","last_clean":"2024-05-08T04:24:40.622028+0000","last_became_active":"2024-05-08T04:24:37.729298+0000","last_became_peered":"2024-05-08T04:24:37.729298+0000","last_unstale":"2024-05-08T04:24:40.622028+0000","last_undegraded":"2024-05-08T04:24:40.622028+0000","last_fullsized":"2024-05-08T04:24:40.622028+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:30:37.114473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621939+0000","last_change":"2024-05-08T04:24:38.744459+0000","last_active":"2024-05-08T04:24:40.621939+0000","last_peered":"2024-05-08T04:24:40.621939+0000","last_clean":"2024-05-08T04:24:40.621939+0000","last_became_active":"2024-05-08T04:24:38.744157+0000","last_became_peered":"2024-05-08T04:24:38.744157+0000","last_unstale":"2024-05-08T04:24:40.621939+0000","last_undegraded":"2024-05-08T04:24:40.621939+0000","last_fullsized":"2024-05-08T04:24:40.621939+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:31:42.104525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715466+0000","last_change":"2024-05-08T04:24:37.731429+0000","last_active":"2024-05-08T04:24:40.715466+0000","last_peered":"2024-05-08T04:24:40.715466+0000","last_clean":"2024-05-08T04:24:40.715466+0000","last_became_active":"2024-05-08T04:24:37.731140+0000","last_became_peered":"2024-05-08T04:24:37.731140+0000","last_unstale":"2024-05-08T04:24:40.715466+0000","last_undegraded":"2024-05-08T04:24:40.715466+0000","last_fullsized":"2024-05-08T04:24:40.715466+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:17.647771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714794+0000","last_change":"2024-05-08T04:24:38.741970+0000","last_active":"2024-05-08T04:24:40.714794+0000","last_peered":"2024-05-08T04:24:40.714794+0000","last_clean":"2024-05-08T04:24:40.714794+0000","last_became_active":"2024-05-08T04:24:38.741734+0000","last_became_peered":"2024-05-08T04:24:38.741734+0000","last_unstale":"2024-05-08T04:24:40.714794+0000","last_undegraded":"2024-05-08T04:24:40.714794+0000","last_fullsized":"2024-05-08T04:24:40.714794+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:50:11.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715492+0000","last_change":"2024-05-08T04:24:36.715492+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715492+0000","last_undegraded":"2024-05-08T04:24:36.715492+0000","last_fullsized":"2024-05-08T04:24:36.715492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748156+0000","last_change":"2024-05-08T04:24:38.738330+0000","last_active":"2024-05-08T04:24:39.748156+0000","last_peered":"2024-05-08T04:24:39.748156+0000","last_clean":"2024-05-08T04:24:39.748156+0000","last_became_active":"2024-05-08T04:24:38.738064+0000","last_became_peered":"2024-05-08T04:24:38.738064+0000","last_unstale":"2024-05-08T04:24:39.748156+0000","last_undegraded":"2024-05-08T04:24:39.748156+0000","last_fullsized":"2024-05-08T04:24:39.748156+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:28:56.236902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621843+0000","last_change":"2024-05-08T04:24:37.726111+0000","last_active":"2024-05-08T04:24:40.621843+0000","last_peered":"2024-05-08T04:24:40.621843+0000","last_clean":"2024-05-08T04:24:40.621843+0000","last_became_active":"2024-05-08T04:24:37.725848+0000","last_became_peered":"2024-05-08T04:24:37.725848+0000","last_unstale":"2024-05-08T04:24:40.621843+0000","last_undegraded":"2024-05-08T04:24:40.621843+0000","last_fullsized":"2024-05-08T04:24:40.621843+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:13.383603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714925+0000","last_change":"2024-05-08T04:24:38.737794+0000","last_active":"2024-05-08T04:24:40.714925+0000","last_peered":"2024-05-08T04:24:40.714925+0000","last_clean":"2024-05-08T04:24:40.714925+0000","last_became_active":"2024-05-08T04:24:38.737516+0000","last_became_peered":"2024-05-08T04:24:38.737516+0000","last_unstale":"2024-05-08T04:24:40.714925+0000","last_undegraded":"2024-05-08T04:24:40.714925+0000","last_fullsized":"2024-05-08T04:24:40.714925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:48:13.424946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621996+0000","last_change":"2024-05-08T04:24:37.726302+0000","last_active":"2024-05-08T04:24:40.621996+0000","last_peered":"2024-05-08T04:24:40.621996+0000","last_clean":"2024-05-08T04:24:40.621996+0000","last_became_active":"2024-05-08T04:24:37.726031+0000","last_became_peered":"2024-05-08T04:24:37.726031+0000","last_unstale":"2024-05-08T04:24:40.621996+0000","last_undegraded":"2024-05-08T04:24:40.621996+0000","last_fullsized":"2024-05-08T04:24:40.621996+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:22:51.480262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.622046+0000","last_change":"2024-05-08T04:24:38.741139+0000","last_active":"2024-05-08T04:24:40.622046+0000","last_peered":"2024-05-08T04:24:40.622046+0000","last_clean":"2024-05-08T04:24:40.622046+0000","last_became_active":"2024-05-08T04:24:38.740860+0000","last_became_peered":"2024-05-08T04:24:38.740860+0000","last_unstale":"2024-05-08T04:24:40.622046+0000","last_undegraded":"2024-05-08T04:24:40.622046+0000","last_fullsized":"2024-05-08T04:24:40.622046+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:55:15.406668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":22,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621771+0000","last_change":"2024-05-08T04:24:37.726764+0000","last_active":"2024-05-08T04:24:40.621771+0000","last_peered":"2024-05-08T04:24:40.621771+0000","last_clean":"2024-05-08T04:24:40.621771+0000","last_became_active":"2024-05-08T04:24:37.726502+0000","last_became_peered":"2024-05-08T04:24:37.726502+0000","last_unstale":"2024-05-08T04:24:40.621771+0000","last_undegraded":"2024-05-08T04:24:40.621771+0000","last_fullsized":"2024-05-08T04:24:40.621771+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:20.582763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748245+0000","last_change":"2024-05-08T04:24:38.744171+0000","last_active":"2024-05-08T04:24:39.748245+0000","last_peered":"2024-05-08T04:24:39.748245+0000","last_clean":"2024-05-08T04:24:39.748245+0000","last_became_active":"2024-05-08T04:24:38.743404+0000","last_became_peered":"2024-05-08T04:24:38.743404+0000","last_unstale":"2024-05-08T04:24:39.748245+0000","last_undegraded":"2024-05-08T04:24:39.748245+0000","last_fullsized":"2024-05-08T04:24:39.748245+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:00:10.303156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721555+0000","last_change":"2024-05-08T04:24:36.721555+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721555+0000","last_undegraded":"2024-05-08T04:24:36.721555+0000","last_fullsized":"2024-05-08T04:24:36.721555+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748328+0000","last_change":"2024-05-08T04:24:38.745875+0000","last_active":"2024-05-08T04:24:39.748328+0000","last_peered":"2024-05-08T04:24:39.748328+0000","last_clean":"2024-05-08T04:24:39.748328+0000","last_became_active":"2024-05-08T04:24:38.745348+0000","last_became_peered":"2024-05-08T04:24:38.745348+0000","last_unstale":"2024-05-08T04:24:39.748328+0000","last_undegraded":"2024-05-08T04:24:39.748328+0000","last_fullsized":"2024-05-08T04:24:39.748328+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:12.262834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715492+0000","last_change":"2024-05-08T04:24:36.715492+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715492+0000","last_undegraded":"2024-05-08T04:24:36.715492+0000","last_fullsized":"2024-05-08T04:24:36.715492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748457+0000","last_change":"2024-05-08T04:24:37.733039+0000","last_active":"2024-05-08T04:24:39.748457+0000","last_peered":"2024-05-08T04:24:39.748457+0000","last_clean":"2024-05-08T04:24:39.748457+0000","last_became_active":"2024-05-08T04:24:37.732629+0000","last_became_peered":"2024-05-08T04:24:37.732629+0000","last_unstale":"2024-05-08T04:24:39.748457+0000","last_undegraded":"2024-05-08T04:24:39.748457+0000","last_fullsized":"2024-05-08T04:24:39.748457+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:25:59.076125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621943+0000","last_change":"2024-05-08T04:24:38.744746+0000","last_active":"2024-05-08T04:24:40.621943+0000","last_peered":"2024-05-08T04:24:40.621943+0000","last_clean":"2024-05-08T04:24:40.621943+0000","last_became_active":"2024-05-08T04:24:38.744383+0000","last_became_peered":"2024-05-08T04:24:38.744383+0000","last_unstale":"2024-05-08T04:24:40.621943+0000","last_undegraded":"2024-05-08T04:24:40.621943+0000","last_fullsized":"2024-05-08T04:24:40.621943+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:10:22.579891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715521+0000","last_change":"2024-05-08T04:24:36.715521+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715521+0000","last_undegraded":"2024-05-08T04:24:36.715521+0000","last_fullsized":"2024-05-08T04:24:36.715521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714992+0000","last_change":"2024-05-08T04:24:38.751172+0000","last_active":"2024-05-08T04:24:40.714992+0000","last_peered":"2024-05-08T04:24:40.714992+0000","last_clean":"2024-05-08T04:24:40.714992+0000","last_became_active":"2024-05-08T04:24:38.750933+0000","last_became_peered":"2024-05-08T04:24:38.750933+0000","last_unstale":"2024-05-08T04:24:40.714992+0000","last_undegraded":"2024-05-08T04:24:40.714992+0000","last_fullsized":"2024-05-08T04:24:40.714992+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:26:00.082709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718788+0000","last_change":"2024-05-08T04:24:36.718788+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718788+0000","last_undegraded":"2024-05-08T04:24:36.718788+0000","last_fullsized":"2024-05-08T04:24:36.718788+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715524+0000","last_change":"2024-05-08T04:24:36.715524+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715524+0000","last_undegraded":"2024-05-08T04:24:36.715524+0000","last_fullsized":"2024-05-08T04:24:36.715524+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714844+0000","last_change":"2024-05-08T04:24:37.729709+0000","last_active":"2024-05-08T04:24:40.714844+0000","last_peered":"2024-05-08T04:24:40.714844+0000","last_clean":"2024-05-08T04:24:40.714844+0000","last_became_active":"2024-05-08T04:24:37.729447+0000","last_became_peered":"2024-05-08T04:24:37.729447+0000","last_unstale":"2024-05-08T04:24:40.714844+0000","last_undegraded":"2024-05-08T04:24:40.714844+0000","last_fullsized":"2024-05-08T04:24:40.714844+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:04:59.629751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748317+0000","last_change":"2024-05-08T04:24:38.743959+0000","last_active":"2024-05-08T04:24:39.748317+0000","last_peered":"2024-05-08T04:24:39.748317+0000","last_clean":"2024-05-08T04:24:39.748317+0000","last_became_active":"2024-05-08T04:24:38.743347+0000","last_became_peered":"2024-05-08T04:24:38.743347+0000","last_unstale":"2024-05-08T04:24:39.748317+0000","last_undegraded":"2024-05-08T04:24:39.748317+0000","last_fullsized":"2024-05-08T04:24:39.748317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:30:28.681033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.721022+0000","last_change":"2024-05-08T04:24:36.721022+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.721022+0000","last_undegraded":"2024-05-08T04:24:36.721022+0000","last_fullsized":"2024-05-08T04:24:36.721022+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748463+0000","last_change":"2024-05-08T04:24:38.740493+0000","last_active":"2024-05-08T04:24:39.748463+0000","last_peered":"2024-05-08T04:24:39.748463+0000","last_clean":"2024-05-08T04:24:39.748463+0000","last_became_active":"2024-05-08T04:24:38.740125+0000","last_became_peered":"2024-05-08T04:24:38.740125+0000","last_unstale":"2024-05-08T04:24:39.748463+0000","last_undegraded":"2024-05-08T04:24:39.748463+0000","last_fullsized":"2024-05-08T04:24:39.748463+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:46:48.098417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718774+0000","last_change":"2024-05-08T04:24:36.718774+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718774+0000","last_undegraded":"2024-05-08T04:24:36.718774+0000","last_fullsized":"2024-05-08T04:24:36.718774+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714977+0000","last_change":"2024-05-08T04:24:37.734970+0000","last_active":"2024-05-08T04:24:40.714977+0000","last_peered":"2024-05-08T04:24:40.714977+0000","last_clean":"2024-05-08T04:24:40.714977+0000","last_became_active":"2024-05-08T04:24:37.734674+0000","last_became_peered":"2024-05-08T04:24:37.734674+0000","last_unstale":"2024-05-08T04:24:40.714977+0000","last_undegraded":"2024-05-08T04:24:40.714977+0000","last_fullsized":"2024-05-08T04:24:40.714977+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:45.805309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748102+0000","last_change":"2024-05-08T04:24:37.730743+0000","last_active":"2024-05-08T04:24:39.748102+0000","last_peered":"2024-05-08T04:24:39.748102+0000","last_clean":"2024-05-08T04:24:39.748102+0000","last_became_active":"2024-05-08T04:24:37.730431+0000","last_became_peered":"2024-05-08T04:24:37.730431+0000","last_unstale":"2024-05-08T04:24:39.748102+0000","last_undegraded":"2024-05-08T04:24:39.748102+0000","last_fullsized":"2024-05-08T04:24:39.748102+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:17.647771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.720946+0000","last_change":"2024-05-08T04:24:36.720946+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.720946+0000","last_undegraded":"2024-05-08T04:24:36.720946+0000","last_fullsized":"2024-05-08T04:24:36.720946+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715356+0000","last_change":"2024-05-08T04:24:38.748044+0000","last_active":"2024-05-08T04:24:40.715356+0000","last_peered":"2024-05-08T04:24:40.715356+0000","last_clean":"2024-05-08T04:24:40.715356+0000","last_became_active":"2024-05-08T04:24:38.747782+0000","last_became_peered":"2024-05-08T04:24:38.747782+0000","last_unstale":"2024-05-08T04:24:40.715356+0000","last_undegraded":"2024-05-08T04:24:40.715356+0000","last_fullsized":"2024-05-08T04:24:40.715356+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:39:01.204213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748046+0000","last_change":"2024-05-08T04:24:37.733092+0000","last_active":"2024-05-08T04:24:39.748046+0000","last_peered":"2024-05-08T04:24:39.748046+0000","last_clean":"2024-05-08T04:24:39.748046+0000","last_became_active":"2024-05-08T04:24:37.732708+0000","last_became_peered":"2024-05-08T04:24:37.732708+0000","last_unstale":"2024-05-08T04:24:39.748046+0000","last_undegraded":"2024-05-08T04:24:39.748046+0000","last_fullsized":"2024-05-08T04:24:39.748046+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:28:40.958510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.718729+0000","last_change":"2024-05-08T04:24:36.718729+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.718729+0000","last_undegraded":"2024-05-08T04:24:36.718729+0000","last_fullsized":"2024-05-08T04:24:36.718729+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-08T04:24:36.715520+0000","last_change":"2024-05-08T04:24:36.715520+0000","last_active":"2024-05-08T04:24:36.706346+0000","last_peered":"2024-05-08T04:24:36.706346+0000","last_clean":"2024-05-08T04:24:36.706346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:36.715520+0000","last_undegraded":"2024-05-08T04:24:36.715520+0000","last_fullsized":"2024-05-08T04:24:36.715520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-08T04:24:37.712930+0000","last_change":"2024-05-08T04:24:37.712930+0000","last_active":"2024-05-08T04:24:37.712930+0000","last_peered":"2024-05-08T04:24:37.712930+0000","last_clean":"2024-05-08T04:24:37.712930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-08T04:24:37.712930+0000","last_undegraded":"2024-05-08T04:24:37.712930+0000","last_fullsized":"2024-05-08T04:24:37.712930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715120+0000","last_change":"2024-05-08T04:24:37.731682+0000","last_active":"2024-05-08T04:24:40.715120+0000","last_peered":"2024-05-08T04:24:40.715120+0000","last_clean":"2024-05-08T04:24:40.715120+0000","last_became_active":"2024-05-08T04:24:37.731222+0000","last_became_peered":"2024-05-08T04:24:37.731222+0000","last_unstale":"2024-05-08T04:24:40.715120+0000","last_undegraded":"2024-05-08T04:24:40.715120+0000","last_fullsized":"2024-05-08T04:24:40.715120+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:32:55.752926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":240,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714947+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:24:40.714947+0000","last_peered":"2024-05-08T04:24:40.714947+0000","last_clean":"2024-05-08T04:24:40.714947+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:24:40.714947+0000","last_undegraded":"2024-05-08T04:24:40.714947+0000","last_fullsized":"2024-05-08T04:24:40.714947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":58,"acting":58,"num_store_stats":4},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1772,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":4056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":270645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1265664,"data_stored":866830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":276462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":712704,"data_stored":295902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":297584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1306624,"data_stored":886762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":297424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:24:43.994 INFO:tasks.ceph.mds.b.smithi183.stderr:2024-05-08T04:24:43.993+0000 7ff350d7a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T04:24:46.153 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:24:46.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.263+0000 7fc3ce70a640 1 Processor -- start 2024-05-08T04:24:46.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.263+0000 7fc3ce70a640 1 -- start start 2024-05-08T04:24:46.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.264+0000 7fc3ce70a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3c815edf0 0x7fc3c80b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.264+0000 7fc3ce70a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c80d15c0 con 0x7fc3c8157ac0 2024-05-08T04:24:46.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.264+0000 7fc3ce70a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c815f550 con 0x7fc3c8070c70 2024-05-08T04:24:46.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.264+0000 7fc3ce70a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c806bc70 con 0x7fc3c815edf0 2024-05-08T04:24:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.264+0000 7fc3ccca7640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc3c8157ac0 0x7fc3c8157f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:47456/0 (socket says 172.21.15.104:47456) 2024-05-08T04:24:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.264+0000 7fc3ccca7640 1 -- 172.21.15.104:0/3484447530 learned_addr learned my addr 172.21.15.104:0/3484447530 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.264+0000 7fc3c77fe640 1 --2- 172.21.15.104:0/3484447530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3c815edf0 0x7fc3c80b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.264+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278100875 0 0) 0x7fc3c80d15c0 con 0x7fc3c8157ac0 2024-05-08T04:24:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.264+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3b0003520 con 0x7fc3c8157ac0 2024-05-08T04:24:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931465914 0 0) 0x7fc3c815f550 con 0x7fc3c8070c70 2024-05-08T04:24:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3c80d15c0 con 0x7fc3c8070c70 2024-05-08T04:24:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2302878343 0 0) 0x7fc3b0003520 con 0x7fc3c8157ac0 2024-05-08T04:24:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3c815edf0 msgr2=0x7fc3c80b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 --2- 172.21.15.104:0/3484447530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3c815edf0 0x7fc3c80b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 >> v1:172.21.15.183:6789/0 conn(0x7fc3c8070c70 legacy=0x7fc3c8071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c815f830 con 0x7fc3c8157ac0 2024-05-08T04:24:46.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fc3c00019f0 con 0x7fc3c8157ac0 2024-05-08T04:24:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 >> v1:172.21.15.104:6789/0 conn(0x7fc3c8157ac0 legacy=0x7fc3c8157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 --2- 172.21.15.104:0/3484447530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3b0003b70 0x7fc3b0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 --2- 172.21.15.104:0/3484447530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b0004800 0x7fc3b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 --2- 172.21.15.104:0/3484447530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3c815edf0 0x7fc3b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b000ba70 con 0x7fc3b0003b70 2024-05-08T04:24:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b000bbf0 con 0x7fc3b0004800 2024-05-08T04:24:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b000bdf0 con 0x7fc3c815edf0 2024-05-08T04:24:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c7fff640 1 --2- 172.21.15.104:0/3484447530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3b0003b70 0x7fc3b0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c77fe640 1 --2- 172.21.15.104:0/3484447530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b0004800 0x7fc3b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3ccca7640 1 --2- 172.21.15.104:0/3484447530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3c815edf0 0x7fc3b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c7fff640 1 -- 172.21.15.104:0/3484447530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3c815edf0 msgr2=0x7fc3b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c7fff640 1 --2- 172.21.15.104:0/3484447530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3c815edf0 0x7fc3b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c7fff640 1 -- 172.21.15.104:0/3484447530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b0004800 msgr2=0x7fc3b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c7fff640 1 --2- 172.21.15.104:0/3484447530 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b0004800 0x7fc3b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.265+0000 7fc3c7fff640 1 -- 172.21.15.104:0/3484447530 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0003520 con 0x7fc3b0003b70 2024-05-08T04:24:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.266+0000 7fc3c7fff640 1 --2- 172.21.15.104:0/3484447530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3b0003b70 0x7fc3b0003f70 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80018d0 tx=0x7fc3b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143fb9d67684d1ed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.266+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80014f0 con 0x7fc3b0003b70 2024-05-08T04:24:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.266+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b80052d0 con 0x7fc3b0003b70 2024-05-08T04:24:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.266+0000 7fc3c6ffd640 1 -- 172.21.15.104:0/3484447530 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b802aca0 con 0x7fc3b0003b70 2024-05-08T04:24:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.267+0000 7fc3ce70a640 1 -- 172.21.15.104:0/3484447530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3b0003b70 msgr2=0x7fc3b0003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.267+0000 7fc3ce70a640 1 --2- 172.21.15.104:0/3484447530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3b0003b70 0x7fc3b0003f70 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80018d0 tx=0x7fc3b0005830 comp rx=0 tx=0).stop 2024-05-08T04:24:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.267+0000 7fc3ccca7640 1 -- 172.21.15.104:0/3484447530 reap_dead start 2024-05-08T04:24:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.267+0000 7fc3ce70a640 1 -- 172.21.15.104:0/3484447530 shutdown_connections 2024-05-08T04:24:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.267+0000 7fc3ce70a640 1 -- 172.21.15.104:0/3484447530 >> 172.21.15.104:0/3484447530 conn(0x7fc3c80b3450 msgr2=0x7fc3c80b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.267+0000 7fc3ce70a640 1 -- 172.21.15.104:0/3484447530 shutdown_connections 2024-05-08T04:24:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.267+0000 7fc3ce70a640 1 -- 172.21.15.104:0/3484447530 wait complete. 2024-05-08T04:24:46.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.268+0000 7fc3ce70a640 1 Processor -- start 2024-05-08T04:24:46.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.268+0000 7fc3ce70a640 1 -- start start 2024-05-08T04:24:46.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3ce70a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3b0003b70 0x7fc3c80caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3ce70a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3c8159360 0x7fc3c815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3ce70a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3c814c0c0 0x7fc3c815bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3ce70a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c8161320 con 0x7fc3b0003b70 2024-05-08T04:24:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3ce70a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80b5b80 con 0x7fc3c8159360 2024-05-08T04:24:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3ce70a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c815a450 con 0x7fc3c814c0c0 2024-05-08T04:24:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3c7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3b0003b70 0x7fc3c80caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3c7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3b0003b70 0x7fc3c80caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56418/0 (socket says 172.21.15.104:56418) 2024-05-08T04:24:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3c7fff640 1 -- 172.21.15.104:0/2669875965 learned_addr learned my addr 172.21.15.104:0/2669875965 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3c7fff640 1 -- 172.21.15.104:0/2669875965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3c814c0c0 msgr2=0x7fc3c815bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3c7fff640 1 --2- 172.21.15.104:0/2669875965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3c814c0c0 0x7fc3c815bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3c7fff640 1 -- 172.21.15.104:0/2669875965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3c8159360 msgr2=0x7fc3c815a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3c7fff640 1 --2- 172.21.15.104:0/2669875965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3c8159360 0x7fc3c815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3c7fff640 1 -- 172.21.15.104:0/2669875965 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c8159840 con 0x7fc3b0003b70 2024-05-08T04:24:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3c7fff640 1 --2- 172.21.15.104:0/2669875965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3b0003b70 0x7fc3c80caad0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8000c00 tx=0x7fc3b80012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.269+0000 7fc3c4ff9640 1 -- 172.21.15.104:0/2669875965 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8037040 con 0x7fc3b0003b70 2024-05-08T04:24:46.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.270+0000 7fc3c4ff9640 1 -- 172.21.15.104:0/2669875965 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b8005480 con 0x7fc3b0003b70 2024-05-08T04:24:46.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.270+0000 7fc3c4ff9640 1 -- 172.21.15.104:0/2669875965 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80014f0 con 0x7fc3b0003b70 2024-05-08T04:24:46.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.270+0000 7fc3ce70a640 1 -- 172.21.15.104:0/2669875965 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c8159b20 con 0x7fc3b0003b70 2024-05-08T04:24:46.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.270+0000 7fc3ce70a640 1 -- 172.21.15.104:0/2669875965 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c815a0e0 con 0x7fc3b0003b70 2024-05-08T04:24:46.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.271+0000 7fc3ce70a640 1 -- 172.21.15.104:0/2669875965 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c8075010 con 0x7fc3b0003b70 2024-05-08T04:24:46.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.271+0000 7fc3c4ff9640 1 -- 172.21.15.104:0/2669875965 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fc3b8044020 con 0x7fc3b0003b70 2024-05-08T04:24:46.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.272+0000 7fc3c4ff9640 1 --2- 172.21.15.104:0/2669875965 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc3b406b6b0 0x7fc3b406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.272+0000 7fc3c4ff9640 1 -- 172.21.15.104:0/2669875965 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3b80aa420 con 0x7fc3b0003b70 2024-05-08T04:24:46.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.272+0000 7fc3c77fe640 1 --2- 172.21.15.104:0/2669875965 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc3b406b6b0 0x7fc3b406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.272+0000 7fc3c77fe640 1 --2- 172.21.15.104:0/2669875965 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc3b406b6b0 0x7fc3b406db70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80cb2d0 tx=0x7fc3bc009320 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:46.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.276+0000 7fc3c4ff9640 1 -- 172.21.15.104:0/2669875965 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc3b80790b0 con 0x7fc3b0003b70 2024-05-08T04:24:46.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.444+0000 7fc3ce70a640 1 -- 172.21.15.104:0/2669875965 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3c80683d0 con 0x7fc3b406b6b0 2024-05-08T04:24:46.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.450+0000 7fc3c4ff9640 1 -- 172.21.15.104:0/2669875965 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251958 (secure 0 0 0) 0x7fc3bc0118c0 con 0x7fc3b406b6b0 2024-05-08T04:24:46.455 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:46.456 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:24:46.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.453+0000 7fc3ce70a640 1 -- 172.21.15.104:0/2669875965 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc3b406b6b0 msgr2=0x7fc3b406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.453+0000 7fc3ce70a640 1 --2- 172.21.15.104:0/2669875965 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc3b406b6b0 0x7fc3b406db70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80cb2d0 tx=0x7fc3bc009320 comp rx=0 tx=0).stop 2024-05-08T04:24:46.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.453+0000 7fc3ce70a640 1 -- 172.21.15.104:0/2669875965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3b0003b70 msgr2=0x7fc3c80caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.453+0000 7fc3ce70a640 1 --2- 172.21.15.104:0/2669875965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3b0003b70 0x7fc3c80caad0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8000c00 tx=0x7fc3b80012d0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.453+0000 7fc3ce70a640 1 -- 172.21.15.104:0/2669875965 shutdown_connections 2024-05-08T04:24:46.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.453+0000 7fc3ce70a640 1 --2- 172.21.15.104:0/2669875965 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc3b406b6b0 0x7fc3b406db70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.453+0000 7fc3ce70a640 1 --2- 172.21.15.104:0/2669875965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3c8159360 0x7fc3c815a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.453+0000 7fc3ce70a640 1 --2- 172.21.15.104:0/2669875965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3c814c0c0 0x7fc3c815bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.453+0000 7fc3ce70a640 1 --2- 172.21.15.104:0/2669875965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3b0003b70 0x7fc3c80caad0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.453+0000 7fc3ce70a640 1 -- 172.21.15.104:0/2669875965 >> 172.21.15.104:0/2669875965 conn(0x7fc3c80b3450 msgr2=0x7fc3c815ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:46.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.453+0000 7fc3ce70a640 1 -- 172.21.15.104:0/2669875965 shutdown_connections 2024-05-08T04:24:46.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.453+0000 7fc3ce70a640 1 -- 172.21.15.104:0/2669875965 wait complete. 2024-05-08T04:24:46.466 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-05-08T04:24:44.682108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222952,"kb_used_data":6760,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751768,"statfs":{"total":773094113280,"available":772865810432,"internally_reserved":0,"allocated":6922240,"data_stored":3552052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.966455"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716467+0000","last_change":"2024-05-08T04:24:38.743720+0000","last_active":"2024-05-08T04:24:40.716467+0000","last_peered":"2024-05-08T04:24:40.716467+0000","last_clean":"2024-05-08T04:24:40.716467+0000","last_became_active":"2024-05-08T04:24:38.743401+0000","last_became_peered":"2024-05-08T04:24:38.743401+0000","last_unstale":"2024-05-08T04:24:40.716467+0000","last_undegraded":"2024-05-08T04:24:40.716467+0000","last_fullsized":"2024-05-08T04:24:40.716467+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:12.262834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.717129+0000","last_change":"2024-05-08T04:24:38.751619+0000","last_active":"2024-05-08T04:24:40.717129+0000","last_peered":"2024-05-08T04:24:40.717129+0000","last_clean":"2024-05-08T04:24:40.717129+0000","last_became_active":"2024-05-08T04:24:38.751323+0000","last_became_peered":"2024-05-08T04:24:38.751323+0000","last_unstale":"2024-05-08T04:24:40.717129+0000","last_undegraded":"2024-05-08T04:24:40.717129+0000","last_fullsized":"2024-05-08T04:24:40.717129+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:16:52.078719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748380+0000","last_change":"2024-05-08T04:24:38.738320+0000","last_active":"2024-05-08T04:24:39.748380+0000","last_peered":"2024-05-08T04:24:39.748380+0000","last_clean":"2024-05-08T04:24:39.748380+0000","last_became_active":"2024-05-08T04:24:38.738026+0000","last_became_peered":"2024-05-08T04:24:38.738026+0000","last_unstale":"2024-05-08T04:24:39.748380+0000","last_undegraded":"2024-05-08T04:24:39.748380+0000","last_fullsized":"2024-05-08T04:24:39.748380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:12:52.144717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.622098+0000","last_change":"2024-05-08T04:24:38.745020+0000","last_active":"2024-05-08T04:24:40.622098+0000","last_peered":"2024-05-08T04:24:40.622098+0000","last_clean":"2024-05-08T04:24:40.622098+0000","last_became_active":"2024-05-08T04:24:38.744684+0000","last_became_peered":"2024-05-08T04:24:38.744684+0000","last_unstale":"2024-05-08T04:24:40.622098+0000","last_undegraded":"2024-05-08T04:24:40.622098+0000","last_fullsized":"2024-05-08T04:24:40.622098+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:16:13.548014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715778+0000","last_change":"2024-05-08T04:24:38.739613+0000","last_active":"2024-05-08T04:24:40.715778+0000","last_peered":"2024-05-08T04:24:40.715778+0000","last_clean":"2024-05-08T04:24:40.715778+0000","last_became_active":"2024-05-08T04:24:38.739302+0000","last_became_peered":"2024-05-08T04:24:38.739302+0000","last_unstale":"2024-05-08T04:24:40.715778+0000","last_undegraded":"2024-05-08T04:24:40.715778+0000","last_fullsized":"2024-05-08T04:24:40.715778+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:05.757648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715562+0000","last_change":"2024-05-08T04:24:38.749834+0000","last_active":"2024-05-08T04:24:40.715562+0000","last_peered":"2024-05-08T04:24:40.715562+0000","last_clean":"2024-05-08T04:24:40.715562+0000","last_became_active":"2024-05-08T04:24:38.749483+0000","last_became_peered":"2024-05-08T04:24:38.749483+0000","last_unstale":"2024-05-08T04:24:40.715562+0000","last_undegraded":"2024-05-08T04:24:40.715562+0000","last_fullsized":"2024-05-08T04:24:40.715562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:39:01.204213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621877+0000","last_change":"2024-05-08T04:24:38.739106+0000","last_active":"2024-05-08T04:24:40.621877+0000","last_peered":"2024-05-08T04:24:40.621877+0000","last_clean":"2024-05-08T04:24:40.621877+0000","last_became_active":"2024-05-08T04:24:38.738839+0000","last_became_peered":"2024-05-08T04:24:38.738839+0000","last_unstale":"2024-05-08T04:24:40.621877+0000","last_undegraded":"2024-05-08T04:24:40.621877+0000","last_fullsized":"2024-05-08T04:24:40.621877+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:44:54.535193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745803+0000","last_change":"2024-05-08T04:24:38.745418+0000","last_active":"2024-05-08T04:24:39.745803+0000","last_peered":"2024-05-08T04:24:39.745803+0000","last_clean":"2024-05-08T04:24:39.745803+0000","last_became_active":"2024-05-08T04:24:38.745173+0000","last_became_peered":"2024-05-08T04:24:38.745173+0000","last_unstale":"2024-05-08T04:24:39.745803+0000","last_undegraded":"2024-05-08T04:24:39.745803+0000","last_fullsized":"2024-05-08T04:24:39.745803+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:14.390187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714964+0000","last_change":"2024-05-08T04:24:38.748172+0000","last_active":"2024-05-08T04:24:40.714964+0000","last_peered":"2024-05-08T04:24:40.714964+0000","last_clean":"2024-05-08T04:24:40.714964+0000","last_became_active":"2024-05-08T04:24:38.747901+0000","last_became_peered":"2024-05-08T04:24:38.747901+0000","last_unstale":"2024-05-08T04:24:40.714964+0000","last_undegraded":"2024-05-08T04:24:40.714964+0000","last_fullsized":"2024-05-08T04:24:40.714964+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:35:14.175811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716019+0000","last_change":"2024-05-08T04:24:38.738459+0000","last_active":"2024-05-08T04:24:40.716019+0000","last_peered":"2024-05-08T04:24:40.716019+0000","last_clean":"2024-05-08T04:24:40.716019+0000","last_became_active":"2024-05-08T04:24:38.738167+0000","last_became_peered":"2024-05-08T04:24:38.738167+0000","last_unstale":"2024-05-08T04:24:40.716019+0000","last_undegraded":"2024-05-08T04:24:40.716019+0000","last_fullsized":"2024-05-08T04:24:40.716019+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:48:11.015094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715613+0000","last_change":"2024-05-08T04:24:38.749551+0000","last_active":"2024-05-08T04:24:40.715613+0000","last_peered":"2024-05-08T04:24:40.715613+0000","last_clean":"2024-05-08T04:24:40.715613+0000","last_became_active":"2024-05-08T04:24:38.749252+0000","last_became_peered":"2024-05-08T04:24:38.749252+0000","last_unstale":"2024-05-08T04:24:40.715613+0000","last_undegraded":"2024-05-08T04:24:40.715613+0000","last_fullsized":"2024-05-08T04:24:40.715613+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:12.262834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715135+0000","last_change":"2024-05-08T04:24:38.737774+0000","last_active":"2024-05-08T04:24:40.715135+0000","last_peered":"2024-05-08T04:24:40.715135+0000","last_clean":"2024-05-08T04:24:40.715135+0000","last_became_active":"2024-05-08T04:24:38.737495+0000","last_became_peered":"2024-05-08T04:24:38.737495+0000","last_unstale":"2024-05-08T04:24:40.715135+0000","last_undegraded":"2024-05-08T04:24:40.715135+0000","last_fullsized":"2024-05-08T04:24:40.715135+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:18.654354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715233+0000","last_change":"2024-05-08T04:24:38.743303+0000","last_active":"2024-05-08T04:24:40.715233+0000","last_peered":"2024-05-08T04:24:40.715233+0000","last_clean":"2024-05-08T04:24:40.715233+0000","last_became_active":"2024-05-08T04:24:38.743039+0000","last_became_peered":"2024-05-08T04:24:38.743039+0000","last_unstale":"2024-05-08T04:24:40.715233+0000","last_undegraded":"2024-05-08T04:24:40.715233+0000","last_fullsized":"2024-05-08T04:24:40.715233+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:31.165497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748300+0000","last_change":"2024-05-08T04:24:38.746594+0000","last_active":"2024-05-08T04:24:39.748300+0000","last_peered":"2024-05-08T04:24:39.748300+0000","last_clean":"2024-05-08T04:24:39.748300+0000","last_became_active":"2024-05-08T04:24:38.746302+0000","last_became_peered":"2024-05-08T04:24:38.746302+0000","last_unstale":"2024-05-08T04:24:39.748300+0000","last_undegraded":"2024-05-08T04:24:39.748300+0000","last_fullsized":"2024-05-08T04:24:39.748300+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:48:11.015094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715201+0000","last_change":"2024-05-08T04:24:38.748964+0000","last_active":"2024-05-08T04:24:40.715201+0000","last_peered":"2024-05-08T04:24:40.715201+0000","last_clean":"2024-05-08T04:24:40.715201+0000","last_became_active":"2024-05-08T04:24:38.748642+0000","last_became_peered":"2024-05-08T04:24:38.748642+0000","last_unstale":"2024-05-08T04:24:40.715201+0000","last_undegraded":"2024-05-08T04:24:40.715201+0000","last_fullsized":"2024-05-08T04:24:40.715201+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:48:05.993554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715307+0000","last_change":"2024-05-08T04:24:38.736544+0000","last_active":"2024-05-08T04:24:40.715307+0000","last_peered":"2024-05-08T04:24:40.715307+0000","last_clean":"2024-05-08T04:24:40.715307+0000","last_became_active":"2024-05-08T04:24:38.736238+0000","last_became_peered":"2024-05-08T04:24:38.736238+0000","last_unstale":"2024-05-08T04:24:40.715307+0000","last_undegraded":"2024-05-08T04:24:40.715307+0000","last_fullsized":"2024-05-08T04:24:40.715307+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:31.165497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716540+0000","last_change":"2024-05-08T04:24:38.741406+0000","last_active":"2024-05-08T04:24:40.716540+0000","last_peered":"2024-05-08T04:24:40.716540+0000","last_clean":"2024-05-08T04:24:40.716540+0000","last_became_active":"2024-05-08T04:24:38.741109+0000","last_became_peered":"2024-05-08T04:24:38.741109+0000","last_unstale":"2024-05-08T04:24:40.716540+0000","last_undegraded":"2024-05-08T04:24:40.716540+0000","last_fullsized":"2024-05-08T04:24:40.716540+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:12:52.144717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748193+0000","last_change":"2024-05-08T04:24:38.744306+0000","last_active":"2024-05-08T04:24:39.748193+0000","last_peered":"2024-05-08T04:24:39.748193+0000","last_clean":"2024-05-08T04:24:39.748193+0000","last_became_active":"2024-05-08T04:24:38.743725+0000","last_became_peered":"2024-05-08T04:24:38.743725+0000","last_unstale":"2024-05-08T04:24:39.748193+0000","last_undegraded":"2024-05-08T04:24:39.748193+0000","last_fullsized":"2024-05-08T04:24:39.748193+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:05.757648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716983+0000","last_change":"2024-05-08T04:24:38.750620+0000","last_active":"2024-05-08T04:24:40.716983+0000","last_peered":"2024-05-08T04:24:40.716983+0000","last_clean":"2024-05-08T04:24:40.716983+0000","last_became_active":"2024-05-08T04:24:38.750333+0000","last_became_peered":"2024-05-08T04:24:38.750333+0000","last_unstale":"2024-05-08T04:24:40.716983+0000","last_undegraded":"2024-05-08T04:24:40.716983+0000","last_fullsized":"2024-05-08T04:24:40.716983+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:18.654354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716071+0000","last_change":"2024-05-08T04:24:38.757033+0000","last_active":"2024-05-08T04:24:40.716071+0000","last_peered":"2024-05-08T04:24:40.716071+0000","last_clean":"2024-05-08T04:24:40.716071+0000","last_became_active":"2024-05-08T04:24:38.756768+0000","last_became_peered":"2024-05-08T04:24:38.756768+0000","last_unstale":"2024-05-08T04:24:40.716071+0000","last_undegraded":"2024-05-08T04:24:40.716071+0000","last_fullsized":"2024-05-08T04:24:40.716071+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:46:48.098417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715280+0000","last_change":"2024-05-08T04:24:38.738535+0000","last_active":"2024-05-08T04:24:40.715280+0000","last_peered":"2024-05-08T04:24:40.715280+0000","last_clean":"2024-05-08T04:24:40.715280+0000","last_became_active":"2024-05-08T04:24:38.738255+0000","last_became_peered":"2024-05-08T04:24:38.738255+0000","last_unstale":"2024-05-08T04:24:40.715280+0000","last_undegraded":"2024-05-08T04:24:40.715280+0000","last_fullsized":"2024-05-08T04:24:40.715280+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:07:35.206873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716124+0000","last_change":"2024-05-08T04:24:38.748648+0000","last_active":"2024-05-08T04:24:40.716124+0000","last_peered":"2024-05-08T04:24:40.716124+0000","last_clean":"2024-05-08T04:24:40.716124+0000","last_became_active":"2024-05-08T04:24:38.748370+0000","last_became_peered":"2024-05-08T04:24:38.748370+0000","last_unstale":"2024-05-08T04:24:40.716124+0000","last_undegraded":"2024-05-08T04:24:40.716124+0000","last_fullsized":"2024-05-08T04:24:40.716124+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:08:23.365140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621888+0000","last_change":"2024-05-08T04:24:38.741514+0000","last_active":"2024-05-08T04:24:40.621888+0000","last_peered":"2024-05-08T04:24:40.621888+0000","last_clean":"2024-05-08T04:24:40.621888+0000","last_became_active":"2024-05-08T04:24:38.741252+0000","last_became_peered":"2024-05-08T04:24:38.741252+0000","last_unstale":"2024-05-08T04:24:40.621888+0000","last_undegraded":"2024-05-08T04:24:40.621888+0000","last_fullsized":"2024-05-08T04:24:40.621888+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:19:40.824803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714791+0000","last_change":"2024-05-08T04:24:38.750390+0000","last_active":"2024-05-08T04:24:40.714791+0000","last_peered":"2024-05-08T04:24:40.714791+0000","last_clean":"2024-05-08T04:24:40.714791+0000","last_became_active":"2024-05-08T04:24:38.750133+0000","last_became_peered":"2024-05-08T04:24:38.750133+0000","last_unstale":"2024-05-08T04:24:40.714791+0000","last_undegraded":"2024-05-08T04:24:40.714791+0000","last_fullsized":"2024-05-08T04:24:40.714791+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:20:49.352910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.717055+0000","last_change":"2024-05-08T04:24:38.752286+0000","last_active":"2024-05-08T04:24:40.717055+0000","last_peered":"2024-05-08T04:24:40.717055+0000","last_clean":"2024-05-08T04:24:40.717055+0000","last_became_active":"2024-05-08T04:24:38.752022+0000","last_became_peered":"2024-05-08T04:24:38.752022+0000","last_unstale":"2024-05-08T04:24:40.717055+0000","last_undegraded":"2024-05-08T04:24:40.717055+0000","last_fullsized":"2024-05-08T04:24:40.717055+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:32:56.759509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715366+0000","last_change":"2024-05-08T04:24:38.735407+0000","last_active":"2024-05-08T04:24:40.715366+0000","last_peered":"2024-05-08T04:24:40.715366+0000","last_clean":"2024-05-08T04:24:40.715366+0000","last_became_active":"2024-05-08T04:24:38.735129+0000","last_became_peered":"2024-05-08T04:24:38.735129+0000","last_unstale":"2024-05-08T04:24:40.715366+0000","last_undegraded":"2024-05-08T04:24:40.715366+0000","last_fullsized":"2024-05-08T04:24:40.715366+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:28:56.236902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.717080+0000","last_change":"2024-05-08T04:24:38.740800+0000","last_active":"2024-05-08T04:24:40.717080+0000","last_peered":"2024-05-08T04:24:40.717080+0000","last_clean":"2024-05-08T04:24:40.717080+0000","last_became_active":"2024-05-08T04:24:38.740534+0000","last_became_peered":"2024-05-08T04:24:38.740534+0000","last_unstale":"2024-05-08T04:24:40.717080+0000","last_undegraded":"2024-05-08T04:24:40.717080+0000","last_fullsized":"2024-05-08T04:24:40.717080+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:28:41.965094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745971+0000","last_change":"2024-05-08T04:24:38.745020+0000","last_active":"2024-05-08T04:24:39.745971+0000","last_peered":"2024-05-08T04:24:39.745971+0000","last_clean":"2024-05-08T04:24:39.745971+0000","last_became_active":"2024-05-08T04:24:38.744746+0000","last_became_peered":"2024-05-08T04:24:38.744746+0000","last_unstale":"2024-05-08T04:24:39.745971+0000","last_undegraded":"2024-05-08T04:24:39.745971+0000","last_fullsized":"2024-05-08T04:24:39.745971+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:42:40.171111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745747+0000","last_change":"2024-05-08T04:24:38.746692+0000","last_active":"2024-05-08T04:24:39.745747+0000","last_peered":"2024-05-08T04:24:39.745747+0000","last_clean":"2024-05-08T04:24:39.745747+0000","last_became_active":"2024-05-08T04:24:38.746339+0000","last_became_peered":"2024-05-08T04:24:38.746339+0000","last_unstale":"2024-05-08T04:24:39.745747+0000","last_undegraded":"2024-05-08T04:24:39.745747+0000","last_fullsized":"2024-05-08T04:24:39.745747+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:59:55.343608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621964+0000","last_change":"2024-05-08T04:24:38.737426+0000","last_active":"2024-05-08T04:24:40.621964+0000","last_peered":"2024-05-08T04:24:40.621964+0000","last_clean":"2024-05-08T04:24:40.621964+0000","last_became_active":"2024-05-08T04:24:38.737153+0000","last_became_peered":"2024-05-08T04:24:38.737153+0000","last_unstale":"2024-05-08T04:24:40.621964+0000","last_undegraded":"2024-05-08T04:24:40.621964+0000","last_fullsized":"2024-05-08T04:24:40.621964+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:55:13.415009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716671+0000","last_change":"2024-05-08T04:24:38.737189+0000","last_active":"2024-05-08T04:24:40.716671+0000","last_peered":"2024-05-08T04:24:40.716671+0000","last_clean":"2024-05-08T04:24:40.716671+0000","last_became_active":"2024-05-08T04:24:38.736903+0000","last_became_peered":"2024-05-08T04:24:38.736903+0000","last_unstale":"2024-05-08T04:24:40.716671+0000","last_undegraded":"2024-05-08T04:24:40.716671+0000","last_fullsized":"2024-05-08T04:24:40.716671+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:50:11.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715445+0000","last_change":"2024-05-08T04:24:38.749487+0000","last_active":"2024-05-08T04:24:40.715445+0000","last_peered":"2024-05-08T04:24:40.715445+0000","last_clean":"2024-05-08T04:24:40.715445+0000","last_became_active":"2024-05-08T04:24:38.749073+0000","last_became_peered":"2024-05-08T04:24:38.749073+0000","last_unstale":"2024-05-08T04:24:40.715445+0000","last_undegraded":"2024-05-08T04:24:40.715445+0000","last_fullsized":"2024-05-08T04:24:40.715445+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:30:28.681033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716037+0000","last_change":"2024-05-08T04:24:38.737745+0000","last_active":"2024-05-08T04:24:40.716037+0000","last_peered":"2024-05-08T04:24:40.716037+0000","last_clean":"2024-05-08T04:24:40.716037+0000","last_became_active":"2024-05-08T04:24:38.737481+0000","last_became_peered":"2024-05-08T04:24:38.737481+0000","last_unstale":"2024-05-08T04:24:40.716037+0000","last_undegraded":"2024-05-08T04:24:40.716037+0000","last_fullsized":"2024-05-08T04:24:40.716037+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:30:28.681033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715681+0000","last_change":"2024-05-08T04:24:37.735829+0000","last_active":"2024-05-08T04:24:40.715681+0000","last_peered":"2024-05-08T04:24:40.715681+0000","last_clean":"2024-05-08T04:24:40.715681+0000","last_became_active":"2024-05-08T04:24:37.735572+0000","last_became_peered":"2024-05-08T04:24:37.735572+0000","last_unstale":"2024-05-08T04:24:40.715681+0000","last_undegraded":"2024-05-08T04:24:40.715681+0000","last_fullsized":"2024-05-08T04:24:40.715681+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:30.158913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716617+0000","last_change":"2024-05-08T04:24:38.750597+0000","last_active":"2024-05-08T04:24:40.716617+0000","last_peered":"2024-05-08T04:24:40.716617+0000","last_clean":"2024-05-08T04:24:40.716617+0000","last_became_active":"2024-05-08T04:24:38.750211+0000","last_became_peered":"2024-05-08T04:24:38.750211+0000","last_unstale":"2024-05-08T04:24:40.716617+0000","last_undegraded":"2024-05-08T04:24:40.716617+0000","last_fullsized":"2024-05-08T04:24:40.716617+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:46:48.098417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716997+0000","last_change":"2024-05-08T04:24:37.735350+0000","last_active":"2024-05-08T04:24:40.716997+0000","last_peered":"2024-05-08T04:24:40.716997+0000","last_clean":"2024-05-08T04:24:40.716997+0000","last_became_active":"2024-05-08T04:24:37.735073+0000","last_became_peered":"2024-05-08T04:24:37.735073+0000","last_unstale":"2024-05-08T04:24:40.716997+0000","last_undegraded":"2024-05-08T04:24:40.716997+0000","last_fullsized":"2024-05-08T04:24:40.716997+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:45.805309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745793+0000","last_change":"2024-05-08T04:24:38.752230+0000","last_active":"2024-05-08T04:24:39.745793+0000","last_peered":"2024-05-08T04:24:39.745793+0000","last_clean":"2024-05-08T04:24:39.745793+0000","last_became_active":"2024-05-08T04:24:38.751914+0000","last_became_peered":"2024-05-08T04:24:38.751914+0000","last_unstale":"2024-05-08T04:24:39.745793+0000","last_undegraded":"2024-05-08T04:24:39.745793+0000","last_fullsized":"2024-05-08T04:24:39.745793+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:30:38.121057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715915+0000","last_change":"2024-05-08T04:24:37.733403+0000","last_active":"2024-05-08T04:24:40.715915+0000","last_peered":"2024-05-08T04:24:40.715915+0000","last_clean":"2024-05-08T04:24:40.715915+0000","last_became_active":"2024-05-08T04:24:37.733106+0000","last_became_peered":"2024-05-08T04:24:37.733106+0000","last_unstale":"2024-05-08T04:24:40.715915+0000","last_undegraded":"2024-05-08T04:24:40.715915+0000","last_fullsized":"2024-05-08T04:24:40.715915+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:50:10.868709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715883+0000","last_change":"2024-05-08T04:24:38.747170+0000","last_active":"2024-05-08T04:24:40.715883+0000","last_peered":"2024-05-08T04:24:40.715883+0000","last_clean":"2024-05-08T04:24:40.715883+0000","last_became_active":"2024-05-08T04:24:38.746875+0000","last_became_peered":"2024-05-08T04:24:38.746875+0000","last_unstale":"2024-05-08T04:24:40.715883+0000","last_undegraded":"2024-05-08T04:24:40.715883+0000","last_fullsized":"2024-05-08T04:24:40.715883+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:00:10.303156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.622044+0000","last_change":"2024-05-08T04:24:37.729547+0000","last_active":"2024-05-08T04:24:40.622044+0000","last_peered":"2024-05-08T04:24:40.622044+0000","last_clean":"2024-05-08T04:24:40.622044+0000","last_became_active":"2024-05-08T04:24:37.729285+0000","last_became_peered":"2024-05-08T04:24:37.729285+0000","last_unstale":"2024-05-08T04:24:40.622044+0000","last_undegraded":"2024-05-08T04:24:40.622044+0000","last_fullsized":"2024-05-08T04:24:40.622044+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:20:24.834907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745479+0000","last_change":"2024-05-08T04:24:38.748687+0000","last_active":"2024-05-08T04:24:39.745479+0000","last_peered":"2024-05-08T04:24:39.745479+0000","last_clean":"2024-05-08T04:24:39.745479+0000","last_became_active":"2024-05-08T04:24:38.748419+0000","last_became_peered":"2024-05-08T04:24:38.748419+0000","last_unstale":"2024-05-08T04:24:39.745479+0000","last_undegraded":"2024-05-08T04:24:39.745479+0000","last_fullsized":"2024-05-08T04:24:39.745479+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:36:57.179653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748210+0000","last_change":"2024-05-08T04:24:37.733429+0000","last_active":"2024-05-08T04:24:39.748210+0000","last_peered":"2024-05-08T04:24:39.748210+0000","last_clean":"2024-05-08T04:24:39.748210+0000","last_became_active":"2024-05-08T04:24:37.733187+0000","last_became_peered":"2024-05-08T04:24:37.733187+0000","last_unstale":"2024-05-08T04:24:39.748210+0000","last_undegraded":"2024-05-08T04:24:39.748210+0000","last_fullsized":"2024-05-08T04:24:39.748210+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:32:55.752926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715798+0000","last_change":"2024-05-08T04:24:38.749323+0000","last_active":"2024-05-08T04:24:40.715798+0000","last_peered":"2024-05-08T04:24:40.715798+0000","last_clean":"2024-05-08T04:24:40.715798+0000","last_became_active":"2024-05-08T04:24:38.749023+0000","last_became_peered":"2024-05-08T04:24:38.749023+0000","last_unstale":"2024-05-08T04:24:40.715798+0000","last_undegraded":"2024-05-08T04:24:40.715798+0000","last_fullsized":"2024-05-08T04:24:40.715798+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:12:52.144717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715449+0000","last_change":"2024-05-08T04:24:37.731689+0000","last_active":"2024-05-08T04:24:40.715449+0000","last_peered":"2024-05-08T04:24:40.715449+0000","last_clean":"2024-05-08T04:24:40.715449+0000","last_became_active":"2024-05-08T04:24:37.731385+0000","last_became_peered":"2024-05-08T04:24:37.731385+0000","last_unstale":"2024-05-08T04:24:40.715449+0000","last_undegraded":"2024-05-08T04:24:40.715449+0000","last_fullsized":"2024-05-08T04:24:40.715449+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:25:59.076125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.747992+0000","last_change":"2024-05-08T04:24:38.738429+0000","last_active":"2024-05-08T04:24:39.747992+0000","last_peered":"2024-05-08T04:24:39.747992+0000","last_clean":"2024-05-08T04:24:39.747992+0000","last_became_active":"2024-05-08T04:24:38.738159+0000","last_became_peered":"2024-05-08T04:24:38.738159+0000","last_unstale":"2024-05-08T04:24:39.747992+0000","last_undegraded":"2024-05-08T04:24:39.747992+0000","last_fullsized":"2024-05-08T04:24:39.747992+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:39:01.204213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714742+0000","last_change":"2024-05-08T04:24:37.726677+0000","last_active":"2024-05-08T04:24:40.714742+0000","last_peered":"2024-05-08T04:24:40.714742+0000","last_clean":"2024-05-08T04:24:40.714742+0000","last_became_active":"2024-05-08T04:24:37.726402+0000","last_became_peered":"2024-05-08T04:24:37.726402+0000","last_unstale":"2024-05-08T04:24:40.714742+0000","last_undegraded":"2024-05-08T04:24:40.714742+0000","last_fullsized":"2024-05-08T04:24:40.714742+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:43:51.484538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715384+0000","last_change":"2024-05-08T04:24:38.736433+0000","last_active":"2024-05-08T04:24:40.715384+0000","last_peered":"2024-05-08T04:24:40.715384+0000","last_clean":"2024-05-08T04:24:40.715384+0000","last_became_active":"2024-05-08T04:24:38.736134+0000","last_became_peered":"2024-05-08T04:24:38.736134+0000","last_unstale":"2024-05-08T04:24:40.715384+0000","last_undegraded":"2024-05-08T04:24:40.715384+0000","last_fullsized":"2024-05-08T04:24:40.715384+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:28:56.236902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715092+0000","last_change":"2024-05-08T04:24:37.734072+0000","last_active":"2024-05-08T04:24:40.715092+0000","last_peered":"2024-05-08T04:24:40.715092+0000","last_clean":"2024-05-08T04:24:40.715092+0000","last_became_active":"2024-05-08T04:24:37.733786+0000","last_became_peered":"2024-05-08T04:24:37.733786+0000","last_unstale":"2024-05-08T04:24:40.715092+0000","last_undegraded":"2024-05-08T04:24:40.715092+0000","last_fullsized":"2024-05-08T04:24:40.715092+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:28:40.958510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715450+0000","last_change":"2024-05-08T04:24:38.746588+0000","last_active":"2024-05-08T04:24:40.715450+0000","last_peered":"2024-05-08T04:24:40.715450+0000","last_clean":"2024-05-08T04:24:40.715450+0000","last_became_active":"2024-05-08T04:24:38.746308+0000","last_became_peered":"2024-05-08T04:24:38.746308+0000","last_unstale":"2024-05-08T04:24:40.715450+0000","last_undegraded":"2024-05-08T04:24:40.715450+0000","last_fullsized":"2024-05-08T04:24:40.715450+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:05.757648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714826+0000","last_change":"2024-05-08T04:24:37.730751+0000","last_active":"2024-05-08T04:24:40.714826+0000","last_peered":"2024-05-08T04:24:40.714826+0000","last_clean":"2024-05-08T04:24:40.714826+0000","last_became_active":"2024-05-08T04:24:37.730492+0000","last_became_peered":"2024-05-08T04:24:37.730492+0000","last_unstale":"2024-05-08T04:24:40.714826+0000","last_undegraded":"2024-05-08T04:24:40.714826+0000","last_fullsized":"2024-05-08T04:24:40.714826+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:54:38.666024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748497+0000","last_change":"2024-05-08T04:24:38.747024+0000","last_active":"2024-05-08T04:24:39.748497+0000","last_peered":"2024-05-08T04:24:39.748497+0000","last_clean":"2024-05-08T04:24:39.748497+0000","last_became_active":"2024-05-08T04:24:38.745832+0000","last_became_peered":"2024-05-08T04:24:38.745832+0000","last_unstale":"2024-05-08T04:24:39.748497+0000","last_undegraded":"2024-05-08T04:24:39.748497+0000","last_fullsized":"2024-05-08T04:24:39.748497+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:08:23.365140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.746075+0000","last_change":"2024-05-08T04:24:37.733821+0000","last_active":"2024-05-08T04:24:39.746075+0000","last_peered":"2024-05-08T04:24:39.746075+0000","last_clean":"2024-05-08T04:24:39.746075+0000","last_became_active":"2024-05-08T04:24:37.733188+0000","last_became_peered":"2024-05-08T04:24:37.733188+0000","last_unstale":"2024-05-08T04:24:39.746075+0000","last_undegraded":"2024-05-08T04:24:39.746075+0000","last_fullsized":"2024-05-08T04:24:39.746075+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:48:04.986970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745874+0000","last_change":"2024-05-08T04:24:38.753006+0000","last_active":"2024-05-08T04:24:39.745874+0000","last_peered":"2024-05-08T04:24:39.745874+0000","last_clean":"2024-05-08T04:24:39.745874+0000","last_became_active":"2024-05-08T04:24:38.752381+0000","last_became_peered":"2024-05-08T04:24:38.752381+0000","last_unstale":"2024-05-08T04:24:39.745874+0000","last_undegraded":"2024-05-08T04:24:39.745874+0000","last_fullsized":"2024-05-08T04:24:39.745874+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:20:25.841490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.622028+0000","last_change":"2024-05-08T04:24:37.729552+0000","last_active":"2024-05-08T04:24:40.622028+0000","last_peered":"2024-05-08T04:24:40.622028+0000","last_clean":"2024-05-08T04:24:40.622028+0000","last_became_active":"2024-05-08T04:24:37.729298+0000","last_became_peered":"2024-05-08T04:24:37.729298+0000","last_unstale":"2024-05-08T04:24:40.622028+0000","last_undegraded":"2024-05-08T04:24:40.622028+0000","last_fullsized":"2024-05-08T04:24:40.622028+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:30:37.114473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621939+0000","last_change":"2024-05-08T04:24:38.744459+0000","last_active":"2024-05-08T04:24:40.621939+0000","last_peered":"2024-05-08T04:24:40.621939+0000","last_clean":"2024-05-08T04:24:40.621939+0000","last_became_active":"2024-05-08T04:24:38.744157+0000","last_became_peered":"2024-05-08T04:24:38.744157+0000","last_unstale":"2024-05-08T04:24:40.621939+0000","last_undegraded":"2024-05-08T04:24:40.621939+0000","last_fullsized":"2024-05-08T04:24:40.621939+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:31:42.104525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715466+0000","last_change":"2024-05-08T04:24:37.731429+0000","last_active":"2024-05-08T04:24:40.715466+0000","last_peered":"2024-05-08T04:24:40.715466+0000","last_clean":"2024-05-08T04:24:40.715466+0000","last_became_active":"2024-05-08T04:24:37.731140+0000","last_became_peered":"2024-05-08T04:24:37.731140+0000","last_unstale":"2024-05-08T04:24:40.715466+0000","last_undegraded":"2024-05-08T04:24:40.715466+0000","last_fullsized":"2024-05-08T04:24:40.715466+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:17.647771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714794+0000","last_change":"2024-05-08T04:24:38.741970+0000","last_active":"2024-05-08T04:24:40.714794+0000","last_peered":"2024-05-08T04:24:40.714794+0000","last_clean":"2024-05-08T04:24:40.714794+0000","last_became_active":"2024-05-08T04:24:38.741734+0000","last_became_peered":"2024-05-08T04:24:38.741734+0000","last_unstale":"2024-05-08T04:24:40.714794+0000","last_undegraded":"2024-05-08T04:24:40.714794+0000","last_fullsized":"2024-05-08T04:24:40.714794+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:50:11.875293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745981+0000","last_change":"2024-05-08T04:24:37.731637+0000","last_active":"2024-05-08T04:24:39.745981+0000","last_peered":"2024-05-08T04:24:39.745981+0000","last_clean":"2024-05-08T04:24:39.745981+0000","last_became_active":"2024-05-08T04:24:37.731359+0000","last_became_peered":"2024-05-08T04:24:37.731359+0000","last_unstale":"2024-05-08T04:24:39.745981+0000","last_undegraded":"2024-05-08T04:24:39.745981+0000","last_fullsized":"2024-05-08T04:24:39.745981+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:50:04.751065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748156+0000","last_change":"2024-05-08T04:24:38.738330+0000","last_active":"2024-05-08T04:24:39.748156+0000","last_peered":"2024-05-08T04:24:39.748156+0000","last_clean":"2024-05-08T04:24:39.748156+0000","last_became_active":"2024-05-08T04:24:38.738064+0000","last_became_peered":"2024-05-08T04:24:38.738064+0000","last_unstale":"2024-05-08T04:24:39.748156+0000","last_undegraded":"2024-05-08T04:24:39.748156+0000","last_fullsized":"2024-05-08T04:24:39.748156+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:28:56.236902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621843+0000","last_change":"2024-05-08T04:24:37.726111+0000","last_active":"2024-05-08T04:24:40.621843+0000","last_peered":"2024-05-08T04:24:40.621843+0000","last_clean":"2024-05-08T04:24:40.621843+0000","last_became_active":"2024-05-08T04:24:37.725848+0000","last_became_peered":"2024-05-08T04:24:37.725848+0000","last_unstale":"2024-05-08T04:24:40.621843+0000","last_undegraded":"2024-05-08T04:24:40.621843+0000","last_fullsized":"2024-05-08T04:24:40.621843+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:13.383603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714925+0000","last_change":"2024-05-08T04:24:38.737794+0000","last_active":"2024-05-08T04:24:40.714925+0000","last_peered":"2024-05-08T04:24:40.714925+0000","last_clean":"2024-05-08T04:24:40.714925+0000","last_became_active":"2024-05-08T04:24:38.737516+0000","last_became_peered":"2024-05-08T04:24:38.737516+0000","last_unstale":"2024-05-08T04:24:40.714925+0000","last_undegraded":"2024-05-08T04:24:40.714925+0000","last_fullsized":"2024-05-08T04:24:40.714925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:48:13.424946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621996+0000","last_change":"2024-05-08T04:24:37.726302+0000","last_active":"2024-05-08T04:24:40.621996+0000","last_peered":"2024-05-08T04:24:40.621996+0000","last_clean":"2024-05-08T04:24:40.621996+0000","last_became_active":"2024-05-08T04:24:37.726031+0000","last_became_peered":"2024-05-08T04:24:37.726031+0000","last_unstale":"2024-05-08T04:24:40.621996+0000","last_undegraded":"2024-05-08T04:24:40.621996+0000","last_fullsized":"2024-05-08T04:24:40.621996+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:22:51.480262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.622046+0000","last_change":"2024-05-08T04:24:38.741139+0000","last_active":"2024-05-08T04:24:40.622046+0000","last_peered":"2024-05-08T04:24:40.622046+0000","last_clean":"2024-05-08T04:24:40.622046+0000","last_became_active":"2024-05-08T04:24:38.740860+0000","last_became_peered":"2024-05-08T04:24:38.740860+0000","last_unstale":"2024-05-08T04:24:40.622046+0000","last_undegraded":"2024-05-08T04:24:40.622046+0000","last_fullsized":"2024-05-08T04:24:40.622046+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:55:15.406668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":22,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621771+0000","last_change":"2024-05-08T04:24:37.726764+0000","last_active":"2024-05-08T04:24:40.621771+0000","last_peered":"2024-05-08T04:24:40.621771+0000","last_clean":"2024-05-08T04:24:40.621771+0000","last_became_active":"2024-05-08T04:24:37.726502+0000","last_became_peered":"2024-05-08T04:24:37.726502+0000","last_unstale":"2024-05-08T04:24:40.621771+0000","last_undegraded":"2024-05-08T04:24:40.621771+0000","last_fullsized":"2024-05-08T04:24:40.621771+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:20.582763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748245+0000","last_change":"2024-05-08T04:24:38.744171+0000","last_active":"2024-05-08T04:24:39.748245+0000","last_peered":"2024-05-08T04:24:39.748245+0000","last_clean":"2024-05-08T04:24:39.748245+0000","last_became_active":"2024-05-08T04:24:38.743404+0000","last_became_peered":"2024-05-08T04:24:38.743404+0000","last_unstale":"2024-05-08T04:24:39.748245+0000","last_undegraded":"2024-05-08T04:24:39.748245+0000","last_fullsized":"2024-05-08T04:24:39.748245+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:00:10.303156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.717017+0000","last_change":"2024-05-08T04:24:37.736593+0000","last_active":"2024-05-08T04:24:40.717017+0000","last_peered":"2024-05-08T04:24:40.717017+0000","last_clean":"2024-05-08T04:24:40.717017+0000","last_became_active":"2024-05-08T04:24:37.736324+0000","last_became_peered":"2024-05-08T04:24:37.736324+0000","last_unstale":"2024-05-08T04:24:40.717017+0000","last_undegraded":"2024-05-08T04:24:40.717017+0000","last_fullsized":"2024-05-08T04:24:40.717017+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:43:51.484538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748328+0000","last_change":"2024-05-08T04:24:38.745875+0000","last_active":"2024-05-08T04:24:39.748328+0000","last_peered":"2024-05-08T04:24:39.748328+0000","last_clean":"2024-05-08T04:24:39.748328+0000","last_became_active":"2024-05-08T04:24:38.745348+0000","last_became_peered":"2024-05-08T04:24:38.745348+0000","last_unstale":"2024-05-08T04:24:39.748328+0000","last_undegraded":"2024-05-08T04:24:39.748328+0000","last_fullsized":"2024-05-08T04:24:39.748328+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:12.262834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745598+0000","last_change":"2024-05-08T04:24:37.733431+0000","last_active":"2024-05-08T04:24:39.745598+0000","last_peered":"2024-05-08T04:24:39.745598+0000","last_clean":"2024-05-08T04:24:39.745598+0000","last_became_active":"2024-05-08T04:24:37.733089+0000","last_became_peered":"2024-05-08T04:24:37.733089+0000","last_unstale":"2024-05-08T04:24:39.745598+0000","last_undegraded":"2024-05-08T04:24:39.745598+0000","last_fullsized":"2024-05-08T04:24:39.745598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:30.158913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716901+0000","last_change":"2024-05-08T04:24:38.738968+0000","last_active":"2024-05-08T04:24:40.716901+0000","last_peered":"2024-05-08T04:24:40.716901+0000","last_clean":"2024-05-08T04:24:40.716901+0000","last_became_active":"2024-05-08T04:24:38.738667+0000","last_became_peered":"2024-05-08T04:24:38.738667+0000","last_unstale":"2024-05-08T04:24:40.716901+0000","last_undegraded":"2024-05-08T04:24:40.716901+0000","last_fullsized":"2024-05-08T04:24:40.716901+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:35:14.175811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748457+0000","last_change":"2024-05-08T04:24:37.733039+0000","last_active":"2024-05-08T04:24:39.748457+0000","last_peered":"2024-05-08T04:24:39.748457+0000","last_clean":"2024-05-08T04:24:39.748457+0000","last_became_active":"2024-05-08T04:24:37.732629+0000","last_became_peered":"2024-05-08T04:24:37.732629+0000","last_unstale":"2024-05-08T04:24:39.748457+0000","last_undegraded":"2024-05-08T04:24:39.748457+0000","last_fullsized":"2024-05-08T04:24:39.748457+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:25:59.076125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.621943+0000","last_change":"2024-05-08T04:24:38.744746+0000","last_active":"2024-05-08T04:24:40.621943+0000","last_peered":"2024-05-08T04:24:40.621943+0000","last_clean":"2024-05-08T04:24:40.621943+0000","last_became_active":"2024-05-08T04:24:38.744383+0000","last_became_peered":"2024-05-08T04:24:38.744383+0000","last_unstale":"2024-05-08T04:24:40.621943+0000","last_undegraded":"2024-05-08T04:24:40.621943+0000","last_fullsized":"2024-05-08T04:24:40.621943+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:10:22.579891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745930+0000","last_change":"2024-05-08T04:24:37.730262+0000","last_active":"2024-05-08T04:24:39.745930+0000","last_peered":"2024-05-08T04:24:39.745930+0000","last_clean":"2024-05-08T04:24:39.745930+0000","last_became_active":"2024-05-08T04:24:37.729922+0000","last_became_peered":"2024-05-08T04:24:37.729922+0000","last_unstale":"2024-05-08T04:24:39.745930+0000","last_undegraded":"2024-05-08T04:24:39.745930+0000","last_fullsized":"2024-05-08T04:24:39.745930+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:39:00.197630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714992+0000","last_change":"2024-05-08T04:24:38.751172+0000","last_active":"2024-05-08T04:24:40.714992+0000","last_peered":"2024-05-08T04:24:40.714992+0000","last_clean":"2024-05-08T04:24:40.714992+0000","last_became_active":"2024-05-08T04:24:38.750933+0000","last_became_peered":"2024-05-08T04:24:38.750933+0000","last_unstale":"2024-05-08T04:24:40.714992+0000","last_undegraded":"2024-05-08T04:24:40.714992+0000","last_fullsized":"2024-05-08T04:24:40.714992+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:26:00.082709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715712+0000","last_change":"2024-05-08T04:24:37.735155+0000","last_active":"2024-05-08T04:24:40.715712+0000","last_peered":"2024-05-08T04:24:40.715712+0000","last_clean":"2024-05-08T04:24:40.715712+0000","last_became_active":"2024-05-08T04:24:37.734560+0000","last_became_peered":"2024-05-08T04:24:37.734560+0000","last_unstale":"2024-05-08T04:24:40.715712+0000","last_undegraded":"2024-05-08T04:24:40.715712+0000","last_fullsized":"2024-05-08T04:24:40.715712+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:48:04.986970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745924+0000","last_change":"2024-05-08T04:24:38.748047+0000","last_active":"2024-05-08T04:24:39.745924+0000","last_peered":"2024-05-08T04:24:39.745924+0000","last_clean":"2024-05-08T04:24:39.745924+0000","last_became_active":"2024-05-08T04:24:38.747694+0000","last_became_peered":"2024-05-08T04:24:38.747694+0000","last_unstale":"2024-05-08T04:24:39.745924+0000","last_undegraded":"2024-05-08T04:24:39.745924+0000","last_fullsized":"2024-05-08T04:24:39.745924+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:13.800463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745417+0000","last_change":"2024-05-08T04:24:37.733335+0000","last_active":"2024-05-08T04:24:39.745417+0000","last_peered":"2024-05-08T04:24:39.745417+0000","last_clean":"2024-05-08T04:24:39.745417+0000","last_became_active":"2024-05-08T04:24:37.733031+0000","last_became_peered":"2024-05-08T04:24:37.733031+0000","last_unstale":"2024-05-08T04:24:39.745417+0000","last_undegraded":"2024-05-08T04:24:39.745417+0000","last_fullsized":"2024-05-08T04:24:39.745417+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:28:55.230318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745414+0000","last_change":"2024-05-08T04:24:38.744538+0000","last_active":"2024-05-08T04:24:39.745414+0000","last_peered":"2024-05-08T04:24:39.745414+0000","last_clean":"2024-05-08T04:24:39.745414+0000","last_became_active":"2024-05-08T04:24:38.744263+0000","last_became_peered":"2024-05-08T04:24:38.744263+0000","last_unstale":"2024-05-08T04:24:39.745414+0000","last_undegraded":"2024-05-08T04:24:39.745414+0000","last_fullsized":"2024-05-08T04:24:39.745414+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:14:59.219568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714844+0000","last_change":"2024-05-08T04:24:37.729709+0000","last_active":"2024-05-08T04:24:40.714844+0000","last_peered":"2024-05-08T04:24:40.714844+0000","last_clean":"2024-05-08T04:24:40.714844+0000","last_became_active":"2024-05-08T04:24:37.729447+0000","last_became_peered":"2024-05-08T04:24:37.729447+0000","last_unstale":"2024-05-08T04:24:40.714844+0000","last_undegraded":"2024-05-08T04:24:40.714844+0000","last_fullsized":"2024-05-08T04:24:40.714844+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:04:59.629751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748317+0000","last_change":"2024-05-08T04:24:38.743959+0000","last_active":"2024-05-08T04:24:39.748317+0000","last_peered":"2024-05-08T04:24:39.748317+0000","last_clean":"2024-05-08T04:24:39.748317+0000","last_became_active":"2024-05-08T04:24:38.743347+0000","last_became_peered":"2024-05-08T04:24:38.743347+0000","last_unstale":"2024-05-08T04:24:39.748317+0000","last_undegraded":"2024-05-08T04:24:39.748317+0000","last_fullsized":"2024-05-08T04:24:39.748317+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:30:28.681033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.717125+0000","last_change":"2024-05-08T04:24:37.734532+0000","last_active":"2024-05-08T04:24:40.717125+0000","last_peered":"2024-05-08T04:24:40.717125+0000","last_clean":"2024-05-08T04:24:40.717125+0000","last_became_active":"2024-05-08T04:24:37.734071+0000","last_became_peered":"2024-05-08T04:24:37.734071+0000","last_unstale":"2024-05-08T04:24:40.717125+0000","last_undegraded":"2024-05-08T04:24:40.717125+0000","last_fullsized":"2024-05-08T04:24:40.717125+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:04:59.629751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748463+0000","last_change":"2024-05-08T04:24:38.740493+0000","last_active":"2024-05-08T04:24:39.748463+0000","last_peered":"2024-05-08T04:24:39.748463+0000","last_clean":"2024-05-08T04:24:39.748463+0000","last_became_active":"2024-05-08T04:24:38.740125+0000","last_became_peered":"2024-05-08T04:24:38.740125+0000","last_unstale":"2024-05-08T04:24:39.748463+0000","last_undegraded":"2024-05-08T04:24:39.748463+0000","last_fullsized":"2024-05-08T04:24:39.748463+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:46:48.098417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716083+0000","last_change":"2024-05-08T04:24:37.731673+0000","last_active":"2024-05-08T04:24:40.716083+0000","last_peered":"2024-05-08T04:24:40.716083+0000","last_clean":"2024-05-08T04:24:40.716083+0000","last_became_active":"2024-05-08T04:24:37.731358+0000","last_became_peered":"2024-05-08T04:24:37.731358+0000","last_unstale":"2024-05-08T04:24:40.716083+0000","last_undegraded":"2024-05-08T04:24:40.716083+0000","last_fullsized":"2024-05-08T04:24:40.716083+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:35:13.169228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716915+0000","last_change":"2024-05-08T04:24:38.735230+0000","last_active":"2024-05-08T04:24:40.716915+0000","last_peered":"2024-05-08T04:24:40.716915+0000","last_clean":"2024-05-08T04:24:40.716915+0000","last_became_active":"2024-05-08T04:24:38.734907+0000","last_became_peered":"2024-05-08T04:24:38.734907+0000","last_unstale":"2024-05-08T04:24:40.716915+0000","last_undegraded":"2024-05-08T04:24:40.716915+0000","last_fullsized":"2024-05-08T04:24:40.716915+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:26:00.082709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714977+0000","last_change":"2024-05-08T04:24:37.734970+0000","last_active":"2024-05-08T04:24:40.714977+0000","last_peered":"2024-05-08T04:24:40.714977+0000","last_clean":"2024-05-08T04:24:40.714977+0000","last_became_active":"2024-05-08T04:24:37.734674+0000","last_became_peered":"2024-05-08T04:24:37.734674+0000","last_unstale":"2024-05-08T04:24:40.714977+0000","last_undegraded":"2024-05-08T04:24:40.714977+0000","last_fullsized":"2024-05-08T04:24:40.714977+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:45.805309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745766+0000","last_change":"2024-05-08T04:24:38.745672+0000","last_active":"2024-05-08T04:24:39.745766+0000","last_peered":"2024-05-08T04:24:39.745766+0000","last_clean":"2024-05-08T04:24:39.745766+0000","last_became_active":"2024-05-08T04:24:38.745422+0000","last_became_peered":"2024-05-08T04:24:38.745422+0000","last_unstale":"2024-05-08T04:24:39.745766+0000","last_undegraded":"2024-05-08T04:24:39.745766+0000","last_fullsized":"2024-05-08T04:24:39.745766+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:21.589347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748102+0000","last_change":"2024-05-08T04:24:37.730743+0000","last_active":"2024-05-08T04:24:39.748102+0000","last_peered":"2024-05-08T04:24:39.748102+0000","last_clean":"2024-05-08T04:24:39.748102+0000","last_became_active":"2024-05-08T04:24:37.730431+0000","last_became_peered":"2024-05-08T04:24:37.730431+0000","last_unstale":"2024-05-08T04:24:39.748102+0000","last_undegraded":"2024-05-08T04:24:39.748102+0000","last_fullsized":"2024-05-08T04:24:39.748102+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:18:17.647771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715371+0000","last_change":"2024-05-08T04:24:38.750903+0000","last_active":"2024-05-08T04:24:40.715371+0000","last_peered":"2024-05-08T04:24:40.715371+0000","last_clean":"2024-05-08T04:24:40.715371+0000","last_became_active":"2024-05-08T04:24:38.750631+0000","last_became_peered":"2024-05-08T04:24:38.750631+0000","last_unstale":"2024-05-08T04:24:40.715371+0000","last_undegraded":"2024-05-08T04:24:40.715371+0000","last_fullsized":"2024-05-08T04:24:40.715371+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:07:35.206873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716743+0000","last_change":"2024-05-08T04:24:37.736656+0000","last_active":"2024-05-08T04:24:40.716743+0000","last_peered":"2024-05-08T04:24:40.716743+0000","last_clean":"2024-05-08T04:24:40.716743+0000","last_became_active":"2024-05-08T04:24:37.736358+0000","last_became_peered":"2024-05-08T04:24:37.736358+0000","last_unstale":"2024-05-08T04:24:40.716743+0000","last_undegraded":"2024-05-08T04:24:40.716743+0000","last_fullsized":"2024-05-08T04:24:40.716743+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:07:07.257101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715356+0000","last_change":"2024-05-08T04:24:38.748044+0000","last_active":"2024-05-08T04:24:40.715356+0000","last_peered":"2024-05-08T04:24:40.715356+0000","last_clean":"2024-05-08T04:24:40.715356+0000","last_became_active":"2024-05-08T04:24:38.747782+0000","last_became_peered":"2024-05-08T04:24:38.747782+0000","last_unstale":"2024-05-08T04:24:40.715356+0000","last_undegraded":"2024-05-08T04:24:40.715356+0000","last_fullsized":"2024-05-08T04:24:40.715356+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:39:01.204213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.748046+0000","last_change":"2024-05-08T04:24:37.733092+0000","last_active":"2024-05-08T04:24:39.748046+0000","last_peered":"2024-05-08T04:24:39.748046+0000","last_clean":"2024-05-08T04:24:39.748046+0000","last_became_active":"2024-05-08T04:24:37.732708+0000","last_became_peered":"2024-05-08T04:24:37.732708+0000","last_unstale":"2024-05-08T04:24:39.748046+0000","last_undegraded":"2024-05-08T04:24:39.748046+0000","last_fullsized":"2024-05-08T04:24:39.748046+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:28:40.958510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745913+0000","last_change":"2024-05-08T04:24:38.744626+0000","last_active":"2024-05-08T04:24:39.745913+0000","last_peered":"2024-05-08T04:24:39.745913+0000","last_clean":"2024-05-08T04:24:39.745913+0000","last_became_active":"2024-05-08T04:24:38.744358+0000","last_became_peered":"2024-05-08T04:24:38.744358+0000","last_unstale":"2024-05-08T04:24:39.745913+0000","last_undegraded":"2024-05-08T04:24:39.745913+0000","last_fullsized":"2024-05-08T04:24:39.745913+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:22:52.486846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715438+0000","last_change":"2024-05-08T04:24:37.734117+0000","last_active":"2024-05-08T04:24:40.715438+0000","last_peered":"2024-05-08T04:24:40.715438+0000","last_clean":"2024-05-08T04:24:40.715438+0000","last_became_active":"2024-05-08T04:24:37.733822+0000","last_became_peered":"2024-05-08T04:24:37.733822+0000","last_unstale":"2024-05-08T04:24:40.715438+0000","last_undegraded":"2024-05-08T04:24:40.715438+0000","last_fullsized":"2024-05-08T04:24:40.715438+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:48:12.418362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.716812+0000","last_change":"2024-05-08T04:24:38.752701+0000","last_active":"2024-05-08T04:24:40.716812+0000","last_peered":"2024-05-08T04:24:40.716812+0000","last_clean":"2024-05-08T04:24:40.716812+0000","last_became_active":"2024-05-08T04:24:38.751882+0000","last_became_peered":"2024-05-08T04:24:38.751882+0000","last_unstale":"2024-05-08T04:24:40.716812+0000","last_undegraded":"2024-05-08T04:24:40.716812+0000","last_fullsized":"2024-05-08T04:24:40.716812+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:48:13.424946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.745878+0000","last_change":"2024-05-08T04:24:37.731877+0000","last_active":"2024-05-08T04:24:39.745878+0000","last_peered":"2024-05-08T04:24:39.745878+0000","last_clean":"2024-05-08T04:24:39.745878+0000","last_became_active":"2024-05-08T04:24:37.729875+0000","last_became_peered":"2024-05-08T04:24:37.729875+0000","last_unstale":"2024-05-08T04:24:39.745878+0000","last_undegraded":"2024-05-08T04:24:39.745878+0000","last_fullsized":"2024-05-08T04:24:39.745878+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:07:34.200290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:39.746129+0000","last_change":"2024-05-08T04:24:38.748591+0000","last_active":"2024-05-08T04:24:39.746129+0000","last_peered":"2024-05-08T04:24:39.746129+0000","last_clean":"2024-05-08T04:24:39.746129+0000","last_became_active":"2024-05-08T04:24:38.748251+0000","last_became_peered":"2024-05-08T04:24:38.748251+0000","last_unstale":"2024-05-08T04:24:39.746129+0000","last_undegraded":"2024-05-08T04:24:39.746129+0000","last_fullsized":"2024-05-08T04:24:39.746129+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:37.712930+0000","last_clean_scrub_stamp":"2024-05-08T04:24:37.712930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:29.227221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.715120+0000","last_change":"2024-05-08T04:24:37.731682+0000","last_active":"2024-05-08T04:24:40.715120+0000","last_peered":"2024-05-08T04:24:40.715120+0000","last_clean":"2024-05-08T04:24:40.715120+0000","last_became_active":"2024-05-08T04:24:37.731222+0000","last_became_peered":"2024-05-08T04:24:37.731222+0000","last_unstale":"2024-05-08T04:24:40.715120+0000","last_undegraded":"2024-05-08T04:24:40.715120+0000","last_fullsized":"2024-05-08T04:24:40.715120+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:24:36.706346+0000","last_clean_scrub_stamp":"2024-05-08T04:24:36.706346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T04:32:55.752926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":240,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-08T04:24:40.714947+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:24:40.714947+0000","last_peered":"2024-05-08T04:24:40.714947+0000","last_clean":"2024-05-08T04:24:40.714947+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:24:40.714947+0000","last_undegraded":"2024-05-08T04:24:40.714947+0000","last_fullsized":"2024-05-08T04:24:40.714947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":295904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":712704,"data_stored":295834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1306624,"data_stored":886214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":296428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":712704,"data_stored":295902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":729088,"data_stored":297584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28296,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343544,"statfs":{"total":96636764160,"available":96607789056,"internally_reserved":0,"allocated":1306624,"data_stored":886762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":720896,"data_stored":297424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:24:46.510 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-08T04:24:46.510 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-08T04:24:46.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.614+0000 7f49d62fc640 1 Processor -- start 2024-05-08T04:24:46.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.614+0000 7f49d62fc640 1 -- start start 2024-05-08T04:24:46.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.615+0000 7f49d62fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f49d01422e0 0x7f49d00b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.615+0000 7f49d62fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f49d00ce4c0 0x7f49d0142e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.615+0000 7f49d62fc640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d00cf3f0 con 0x7f49d00b36b0 2024-05-08T04:24:46.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.615+0000 7f49d62fc640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d00ce910 con 0x7f49d01422e0 2024-05-08T04:24:46.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.615+0000 7f49d62fc640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d00ceb50 con 0x7f49d00ce4c0 2024-05-08T04:24:46.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.615+0000 7f49cffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f49d01422e0 0x7f49d00b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.615+0000 7f49cffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f49d01422e0 0x7f49d00b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56420/0 (socket says 172.21.15.104:56420) 2024-05-08T04:24:46.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.615+0000 7f49cffff640 1 -- 172.21.15.104:0/3424684803 learned_addr learned my addr 172.21.15.104:0/3424684803 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:46.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.615+0000 7f49cffff640 1 -- 172.21.15.104:0/3424684803 >> v2:172.21.15.183:3300/0 conn(0x7f49d00ce4c0 msgr2=0x7f49d0142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:46.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.615+0000 7f49cffff640 1 --2- 172.21.15.104:0/3424684803 >> v2:172.21.15.183:3300/0 conn(0x7f49d00ce4c0 0x7f49d0142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.616+0000 7f49cffff640 1 -- 172.21.15.104:0/3424684803 >> v1:172.21.15.183:6789/0 conn(0x7f49d00b36b0 legacy=0x7f49d00cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:46.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.616+0000 7f49cffff640 1 -- 172.21.15.104:0/3424684803 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d00cee30 con 0x7f49d01422e0 2024-05-08T04:24:46.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.616+0000 7f49cffff640 1 --2- 172.21.15.104:0/3424684803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49d01422e0 0x7f49d00b3170 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f49d00a8530 tx=0x7f49c002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12facaead2553e0d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:46.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.616+0000 7f49ceffd640 1 -- 172.21.15.104:0/3424684803 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c0037070 con 0x7f49d01422e0 2024-05-08T04:24:46.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.616+0000 7f49ceffd640 1 -- 172.21.15.104:0/3424684803 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c0032440 con 0x7f49d01422e0 2024-05-08T04:24:46.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.616+0000 7f49ceffd640 1 -- 172.21.15.104:0/3424684803 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c0032810 con 0x7f49d01422e0 2024-05-08T04:24:46.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.617+0000 7f49d62fc640 1 -- 172.21.15.104:0/3424684803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49d01422e0 msgr2=0x7f49d00b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.617+0000 7f49d62fc640 1 --2- 172.21.15.104:0/3424684803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49d01422e0 0x7f49d00b3170 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f49d00a8530 tx=0x7f49c002a230 comp rx=0 tx=0).stop 2024-05-08T04:24:46.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.617+0000 7f49d62fc640 1 -- 172.21.15.104:0/3424684803 shutdown_connections 2024-05-08T04:24:46.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.617+0000 7f49d62fc640 1 --2- 172.21.15.104:0/3424684803 >> v2:172.21.15.183:3300/0 conn(0x7f49d00ce4c0 0x7f49d0142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.617+0000 7f49d62fc640 1 --2- 172.21.15.104:0/3424684803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49d01422e0 0x7f49d00b3170 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.617+0000 7f49d62fc640 1 -- 172.21.15.104:0/3424684803 >> 172.21.15.104:0/3424684803 conn(0x7f49d006ab60 msgr2=0x7f49d006af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:46.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.617+0000 7f49d62fc640 1 -- 172.21.15.104:0/3424684803 shutdown_connections 2024-05-08T04:24:46.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.617+0000 7f49d62fc640 1 -- 172.21.15.104:0/3424684803 wait complete. 2024-05-08T04:24:46.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.618+0000 7f49d62fc640 1 Processor -- start 2024-05-08T04:24:46.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.618+0000 7f49d62fc640 1 -- start start 2024-05-08T04:24:46.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49d62fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49d00b36b0 0x7f49d013d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49d62fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49d00ce4c0 0x7f49d013b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49d62fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49d01422e0 0x7f49d015a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49d62fc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d0143350 con 0x7f49d00ce4c0 2024-05-08T04:24:46.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49d62fc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d01428f0 con 0x7f49d01422e0 2024-05-08T04:24:46.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49d62fc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d01434d0 con 0x7f49d00b36b0 2024-05-08T04:24:46.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49cf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49d00ce4c0 0x7f49d013b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49cf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49d00ce4c0 0x7f49d013b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56430/0 (socket says 172.21.15.104:56430) 2024-05-08T04:24:46.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49cf7fe640 1 -- 172.21.15.104:0/3550153535 learned_addr learned my addr 172.21.15.104:0/3550153535 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:46.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49cffff640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49d00b36b0 0x7f49d013d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49cf7fe640 1 -- 172.21.15.104:0/3550153535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49d00b36b0 msgr2=0x7f49d013d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49cf7fe640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49d00b36b0 0x7f49d013d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49cf7fe640 1 -- 172.21.15.104:0/3550153535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49d01422e0 msgr2=0x7f49d015a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49cf7fe640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49d01422e0 0x7f49d015a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49cf7fe640 1 -- 172.21.15.104:0/3550153535 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d013ca30 con 0x7f49d00ce4c0 2024-05-08T04:24:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.619+0000 7f49cffff640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49d00b36b0 0x7f49d013d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.620+0000 7f49cf7fe640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49d00ce4c0 0x7f49d013b1f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f49c400c410 tx=0x7f49c400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.620+0000 7f49ccff9640 1 -- 172.21.15.104:0/3550153535 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4017070 con 0x7f49d00ce4c0 2024-05-08T04:24:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.620+0000 7f49ccff9640 1 -- 172.21.15.104:0/3550153535 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c40035f0 con 0x7f49d00ce4c0 2024-05-08T04:24:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.620+0000 7f49ccff9640 1 -- 172.21.15.104:0/3550153535 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4003a20 con 0x7f49d00ce4c0 2024-05-08T04:24:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.620+0000 7f49d62fc640 1 -- 172.21.15.104:0/3550153535 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d013cd10 con 0x7f49d00ce4c0 2024-05-08T04:24:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.620+0000 7f49d62fc640 1 -- 172.21.15.104:0/3550153535 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d01e4560 con 0x7f49d00ce4c0 2024-05-08T04:24:46.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.621+0000 7f49d62fc640 1 -- 172.21.15.104:0/3550153535 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d006baf0 con 0x7f49d00ce4c0 2024-05-08T04:24:46.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.621+0000 7f49ccff9640 1 -- 172.21.15.104:0/3550153535 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f49c401a070 con 0x7f49d00ce4c0 2024-05-08T04:24:46.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.622+0000 7f49ccff9640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f49bc06b680 0x7f49bc06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.622+0000 7f49ccff9640 1 -- 172.21.15.104:0/3550153535 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49c40899c0 con 0x7f49d00ce4c0 2024-05-08T04:24:46.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.622+0000 7f49cffff640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f49bc06b680 0x7f49bc06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.622+0000 7f49cffff640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f49bc06b680 0x7f49bc06db40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f49c0034000 tx=0x7f49c002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:46.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.626+0000 7f49ccff9640 1 -- 172.21.15.104:0/3550153535 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f49c40585a0 con 0x7f49d00ce4c0 2024-05-08T04:24:46.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.868+0000 7f49d62fc640 1 -- 172.21.15.104:0/3550153535 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f49d0074830 con 0x7f49d00ce4c0 2024-05-08T04:24:46.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.871+0000 7f49ccff9640 1 -- 172.21.15.104:0/3550153535 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f49c40010c0 con 0x7f49d00ce4c0 2024-05-08T04:24:46.873 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-05-08T04:24:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQB9/TpmmVCJDBAA7kFxGuTTRTJge+xrcPo3lw== 2024-05-08T04:24:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: caps mds = "allow" 2024-05-08T04:24:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: caps mon = "allow r" 2024-05-08T04:24:46.873 INFO:teuthology.orchestra.run.smithi104.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-08T04:24:46.873 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-05-08T04:24:46.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.873+0000 7f49d62fc640 1 -- 172.21.15.104:0/3550153535 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f49bc06b680 msgr2=0x7f49bc06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.873+0000 7f49d62fc640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f49bc06b680 0x7f49bc06db40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f49c0034000 tx=0x7f49c002e000 comp rx=0 tx=0).stop 2024-05-08T04:24:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.873+0000 7f49d62fc640 1 -- 172.21.15.104:0/3550153535 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49d00ce4c0 msgr2=0x7f49d013b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.873+0000 7f49d62fc640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49d00ce4c0 0x7f49d013b1f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f49c400c410 tx=0x7f49c400c8d0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.873+0000 7f49d62fc640 1 -- 172.21.15.104:0/3550153535 shutdown_connections 2024-05-08T04:24:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.873+0000 7f49d62fc640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f49bc06b680 0x7f49bc06db40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.873+0000 7f49d62fc640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f49d01422e0 0x7f49d015a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.873+0000 7f49d62fc640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f49d00ce4c0 0x7f49d013b1f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.873+0000 7f49d62fc640 1 --2- 172.21.15.104:0/3550153535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f49d00b36b0 0x7f49d013d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.873+0000 7f49d62fc640 1 -- 172.21.15.104:0/3550153535 >> 172.21.15.104:0/3550153535 conn(0x7f49d006ab60 msgr2=0x7f49d0143900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.873+0000 7f49d62fc640 1 -- 172.21.15.104:0/3550153535 shutdown_connections 2024-05-08T04:24:46.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.873+0000 7f49d62fc640 1 -- 172.21.15.104:0/3550153535 wait complete. 2024-05-08T04:24:46.886 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:46.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.984+0000 7efc98a58640 1 Processor -- start 2024-05-08T04:24:46.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.984+0000 7efc98a58640 1 -- start start 2024-05-08T04:24:46.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.985+0000 7efc98a58640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efc940cc930 0x7efc940ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.985+0000 7efc98a58640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940711c0 0x7efc9415f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.985+0000 7efc98a58640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efc94144c80 0x7efc9415fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.985+0000 7efc98a58640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc94071fb0 con 0x7efc94144c80 2024-05-08T04:24:46.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.985+0000 7efc98a58640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc940cd250 con 0x7efc940cc930 2024-05-08T04:24:46.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.985+0000 7efc98a58640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc94071710 con 0x7efc940711c0 2024-05-08T04:24:46.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.985+0000 7efc92d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efc94144c80 0x7efc9415fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.985+0000 7efc92d9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7efc94144c80 0x7efc9415fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56432/0 (socket says 172.21.15.104:56432) 2024-05-08T04:24:46.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.985+0000 7efc92d9d640 1 -- 172.21.15.104:0/2435357964 learned_addr learned my addr 172.21.15.104:0/2435357964 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:46.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.985+0000 7efc9259c640 1 --2- 172.21.15.104:0/2435357964 >> v2:172.21.15.183:3300/0 conn(0x7efc940cc930 0x7efc940ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.986+0000 7efc92d9d640 1 -- 172.21.15.104:0/2435357964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940711c0 msgr2=0x7efc9415f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:46.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.986+0000 7efc92d9d640 1 --2- 172.21.15.104:0/2435357964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940711c0 0x7efc9415f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.986+0000 7efc92d9d640 1 -- 172.21.15.104:0/2435357964 >> v2:172.21.15.183:3300/0 conn(0x7efc940cc930 msgr2=0x7efc940ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:46.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.986+0000 7efc92d9d640 1 --2- 172.21.15.104:0/2435357964 >> v2:172.21.15.183:3300/0 conn(0x7efc940cc930 0x7efc940ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.986+0000 7efc92d9d640 1 -- 172.21.15.104:0/2435357964 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc940719f0 con 0x7efc94144c80 2024-05-08T04:24:46.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.986+0000 7efc9259c640 1 --2- 172.21.15.104:0/2435357964 >> v2:172.21.15.183:3300/0 conn(0x7efc940cc930 0x7efc940ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:46.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.986+0000 7efc92d9d640 1 --2- 172.21.15.104:0/2435357964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc94144c80 0x7efc9415fae0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7efc940685c0 tx=0x7efc8c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe6eb2c6319acb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:46.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.986+0000 7efc9159a640 1 -- 172.21.15.104:0/2435357964 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c037070 con 0x7efc94144c80 2024-05-08T04:24:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.986+0000 7efc9159a640 1 -- 172.21.15.104:0/2435357964 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c032440 con 0x7efc94144c80 2024-05-08T04:24:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.986+0000 7efc9159a640 1 -- 172.21.15.104:0/2435357964 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c032810 con 0x7efc94144c80 2024-05-08T04:24:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.987+0000 7efc98a58640 1 -- 172.21.15.104:0/2435357964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc94144c80 msgr2=0x7efc9415fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.987+0000 7efc98a58640 1 --2- 172.21.15.104:0/2435357964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc94144c80 0x7efc9415fae0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7efc940685c0 tx=0x7efc8c02a140 comp rx=0 tx=0).stop 2024-05-08T04:24:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.987+0000 7efc98a58640 1 -- 172.21.15.104:0/2435357964 shutdown_connections 2024-05-08T04:24:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.987+0000 7efc98a58640 1 --2- 172.21.15.104:0/2435357964 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc94144c80 0x7efc9415fae0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.987+0000 7efc98a58640 1 --2- 172.21.15.104:0/2435357964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940711c0 0x7efc9415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.987+0000 7efc98a58640 1 --2- 172.21.15.104:0/2435357964 >> v2:172.21.15.183:3300/0 conn(0x7efc940cc930 0x7efc940ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.987+0000 7efc98a58640 1 -- 172.21.15.104:0/2435357964 >> 172.21.15.104:0/2435357964 conn(0x7efc940b13f0 msgr2=0x7efc940b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.987+0000 7efc98a58640 1 -- 172.21.15.104:0/2435357964 shutdown_connections 2024-05-08T04:24:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.987+0000 7efc98a58640 1 -- 172.21.15.104:0/2435357964 wait complete. 2024-05-08T04:24:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.988+0000 7efc98a58640 1 Processor -- start 2024-05-08T04:24:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.988+0000 7efc98a58640 1 -- start start 2024-05-08T04:24:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.989+0000 7efc98a58640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940711c0 0x7efc940c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.989+0000 7efc98a58640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc940cc930 0x7efc940ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.989+0000 7efc98a58640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94144c80 0x7efc940aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.989+0000 7efc98a58640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc940cf3b0 con 0x7efc940cc930 2024-05-08T04:24:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.989+0000 7efc98a58640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9406d330 con 0x7efc94144c80 2024-05-08T04:24:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.989+0000 7efc98a58640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc941453f0 con 0x7efc940711c0 2024-05-08T04:24:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.989+0000 7efc91d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc940cc930 0x7efc940ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.989+0000 7efc91d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc940cc930 0x7efc940ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56440/0 (socket says 172.21.15.104:56440) 2024-05-08T04:24:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.989+0000 7efc91d9b640 1 -- 172.21.15.104:0/2710838811 learned_addr learned my addr 172.21.15.104:0/2710838811 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.989+0000 7efc9259c640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940711c0 0x7efc940c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.989+0000 7efc92d9d640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94144c80 0x7efc940aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.990+0000 7efc91d9b640 1 -- 172.21.15.104:0/2710838811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940711c0 msgr2=0x7efc940c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.990+0000 7efc91d9b640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940711c0 0x7efc940c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.990+0000 7efc91d9b640 1 -- 172.21.15.104:0/2710838811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94144c80 msgr2=0x7efc940aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.990+0000 7efc91d9b640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94144c80 0x7efc940aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.990+0000 7efc91d9b640 1 -- 172.21.15.104:0/2710838811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc940ab2d0 con 0x7efc940cc930 2024-05-08T04:24:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.990+0000 7efc91d9b640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc940cc930 0x7efc940ac640 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00b410 tx=0x7efc7c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.990+0000 7efc8affd640 1 -- 172.21.15.104:0/2710838811 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c015020 con 0x7efc940cc930 2024-05-08T04:24:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.990+0000 7efc8affd640 1 -- 172.21.15.104:0/2710838811 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c011850 con 0x7efc940cc930 2024-05-08T04:24:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.990+0000 7efc8affd640 1 -- 172.21.15.104:0/2710838811 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c011c40 con 0x7efc940cc930 2024-05-08T04:24:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.990+0000 7efc98a58640 1 -- 172.21.15.104:0/2710838811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc940ab5a0 con 0x7efc940cc930 2024-05-08T04:24:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.990+0000 7efc98a58640 1 -- 172.21.15.104:0/2710838811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc940abb60 con 0x7efc940cc930 2024-05-08T04:24:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.991+0000 7efc98a58640 1 -- 172.21.15.104:0/2710838811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc94075010 con 0x7efc940cc930 2024-05-08T04:24:46.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.991+0000 7efc8affd640 1 -- 172.21.15.104:0/2710838811 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7efc7c018020 con 0x7efc940cc930 2024-05-08T04:24:46.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.992+0000 7efc8affd640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efc7406b680 0x7efc7406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:46.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.992+0000 7efc9259c640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efc7406b680 0x7efc7406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:46.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.992+0000 7efc8affd640 1 -- 172.21.15.104:0/2710838811 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc7c08a350 con 0x7efc940cc930 2024-05-08T04:24:46.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.992+0000 7efc9259c640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efc7406b680 0x7efc7406db40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efc8400f500 tx=0x7efc84007770 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:46.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:46.996+0000 7efc8affd640 1 -- 172.21.15.104:0/2710838811 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc7c01f020 con 0x7efc940cc930 2024-05-08T04:24:47.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.199+0000 7efc98a58640 1 -- 172.21.15.104:0/2710838811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc940af040 con 0x7efc940cc930 2024-05-08T04:24:47.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.199+0000 7efc8affd640 1 -- 172.21.15.104:0/2710838811 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4947 (secure 0 0 0) 0x7efc7c058850 con 0x7efc940cc930 2024-05-08T04:24:47.202 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:47.202 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5336,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1609011099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1609011099},{"type":"v1","addr":"172.21.15.183:6834","nonce":1609011099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6354,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3867059822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3867059822},{"type":"v1","addr":"172.21.15.104:6835","nonce":3867059822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6357,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/3119972029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":3119972029},{"type":"v1","addr":"172.21.15.104:6837","nonce":3119972029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:24:38.063241+0000","modified":"2024-05-08T04:24:40.069539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6366":{"gid":6366,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/495908291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":495908291},{"type":"v1","addr":"172.21.15.183:6835","nonce":495908291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-05-08T04:24:47.202 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 28 2024-05-08T04:24:47.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.201+0000 7efc98a58640 1 -- 172.21.15.104:0/2710838811 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efc7406b680 msgr2=0x7efc7406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.201+0000 7efc98a58640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efc7406b680 0x7efc7406db40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efc8400f500 tx=0x7efc84007770 comp rx=0 tx=0).stop 2024-05-08T04:24:47.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.201+0000 7efc98a58640 1 -- 172.21.15.104:0/2710838811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc940cc930 msgr2=0x7efc940ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.201+0000 7efc98a58640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc940cc930 0x7efc940ac640 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00b410 tx=0x7efc7c00b8d0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.201+0000 7efc98a58640 1 -- 172.21.15.104:0/2710838811 shutdown_connections 2024-05-08T04:24:47.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.201+0000 7efc98a58640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7efc7406b680 0x7efc7406db40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.201+0000 7efc98a58640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94144c80 0x7efc940aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.201+0000 7efc98a58640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc940cc930 0x7efc940ac640 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.201+0000 7efc98a58640 1 --2- 172.21.15.104:0/2710838811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940711c0 0x7efc940c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.201+0000 7efc98a58640 1 -- 172.21.15.104:0/2710838811 >> 172.21.15.104:0/2710838811 conn(0x7efc940b13f0 msgr2=0x7efc940b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:47.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.201+0000 7efc98a58640 1 -- 172.21.15.104:0/2710838811 shutdown_connections 2024-05-08T04:24:47.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.202+0000 7efc98a58640 1 -- 172.21.15.104:0/2710838811 wait complete. 2024-05-08T04:24:47.618 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T04:24:38.063241+0000', 'modified': '2024-05-08T04:24:40.069539+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6366}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6366': {'gid': 6366, 'name': 'b', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.183:6835/495908291', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6833', 'nonce': 495908291}, {'type': 'v1', 'addr': '172.21.15.183:6835', 'nonce': 495908291}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T04:24:47.618 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T04:24:47.618 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-08T04:24:47.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.722+0000 7ff2be0dd640 1 Processor -- start 2024-05-08T04:24:47.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.722+0000 7ff2be0dd640 1 -- start start 2024-05-08T04:24:47.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.723+0000 7ff2be0dd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff2b80ceee0 0x7ff2b80b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.723+0000 7ff2be0dd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b815e780 con 0x7ff2b806e330 2024-05-08T04:24:47.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.723+0000 7ff2be0dd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b815ea60 con 0x7ff2b80b4700 2024-05-08T04:24:47.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.723+0000 7ff2be0dd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b815f390 con 0x7ff2b80ceee0 2024-05-08T04:24:47.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.723+0000 7ff2b77fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ff2b80ceee0 0x7ff2b80b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.723+0000 7ff2b6ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff2b806e330 0x7ff2b80b3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54462/0 (socket says 172.21.15.104:54462) 2024-05-08T04:24:47.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.723+0000 7ff2b6ffd640 1 -- 172.21.15.104:0/997469537 learned_addr learned my addr 172.21.15.104:0/997469537 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:47.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.723+0000 7ff2b77fe640 1 -- 172.21.15.104:0/997469537 >> v1:172.21.15.183:6789/0 conn(0x7ff2b80b4700 legacy=0x7ff2b815b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:47.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.723+0000 7ff2b77fe640 1 -- 172.21.15.104:0/997469537 >> v1:172.21.15.104:6789/0 conn(0x7ff2b806e330 legacy=0x7ff2b80b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.723+0000 7ff2b77fe640 1 -- 172.21.15.104:0/997469537 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b815ed40 con 0x7ff2b80ceee0 2024-05-08T04:24:47.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.723+0000 7ff2b67fc640 1 -- 172.21.15.104:0/997469537 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035067408 0 0) 0x7ff2b815e780 con 0x7ff2b806e330 2024-05-08T04:24:47.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.724+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/997469537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b80ceee0 0x7ff2b80b26f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80097a0 tx=0x7ff2a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a967a8c905e64c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:47.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.724+0000 7ff2b67fc640 1 -- 172.21.15.104:0/997469537 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8037070 con 0x7ff2b80ceee0 2024-05-08T04:24:47.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.724+0000 7ff2b67fc640 1 -- 172.21.15.104:0/997469537 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a8032440 con 0x7ff2b80ceee0 2024-05-08T04:24:47.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.724+0000 7ff2b67fc640 1 -- 172.21.15.104:0/997469537 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8032810 con 0x7ff2b80ceee0 2024-05-08T04:24:47.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.724+0000 7ff2be0dd640 1 -- 172.21.15.104:0/997469537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b80ceee0 msgr2=0x7ff2b80b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.724+0000 7ff2be0dd640 1 --2- 172.21.15.104:0/997469537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b80ceee0 0x7ff2b80b26f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80097a0 tx=0x7ff2a802a1e0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.724+0000 7ff2be0dd640 1 -- 172.21.15.104:0/997469537 shutdown_connections 2024-05-08T04:24:47.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.724+0000 7ff2be0dd640 1 --2- 172.21.15.104:0/997469537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b80ceee0 0x7ff2b80b26f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.724+0000 7ff2be0dd640 1 -- 172.21.15.104:0/997469537 >> 172.21.15.104:0/997469537 conn(0x7ff2b80b13f0 msgr2=0x7ff2b80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:47.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.724+0000 7ff2be0dd640 1 -- 172.21.15.104:0/997469537 shutdown_connections 2024-05-08T04:24:47.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.725+0000 7ff2be0dd640 1 -- 172.21.15.104:0/997469537 wait complete. 2024-05-08T04:24:47.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.726+0000 7ff2be0dd640 1 Processor -- start 2024-05-08T04:24:47.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.726+0000 7ff2be0dd640 1 -- start start 2024-05-08T04:24:47.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.726+0000 7ff2be0dd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2b806e330 0x7ff2b80c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.726+0000 7ff2be0dd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b80b4700 0x7ff2b81f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.726+0000 7ff2be0dd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2b80ceee0 0x7ff2b8149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.726+0000 7ff2be0dd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b80cf440 con 0x7ff2b80b4700 2024-05-08T04:24:47.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.726+0000 7ff2be0dd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b80cf2c0 con 0x7ff2b80ceee0 2024-05-08T04:24:47.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.726+0000 7ff2be0dd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b806e7e0 con 0x7ff2b806e330 2024-05-08T04:24:47.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2b6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b80b4700 0x7ff2b81f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2b6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b80b4700 0x7ff2b81f1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39104/0 (socket says 172.21.15.104:39104) 2024-05-08T04:24:47.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2b6ffd640 1 -- 172.21.15.104:0/2853066032 learned_addr learned my addr 172.21.15.104:0/2853066032 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:47.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2b806e330 0x7ff2b80c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2b7fff640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2b80ceee0 0x7ff2b8149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2b6ffd640 1 -- 172.21.15.104:0/2853066032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2b806e330 msgr2=0x7ff2b80c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2b6ffd640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2b806e330 0x7ff2b80c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2b6ffd640 1 -- 172.21.15.104:0/2853066032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2b80ceee0 msgr2=0x7ff2b8149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2b6ffd640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2b80ceee0 0x7ff2b8149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2b6ffd640 1 -- 172.21.15.104:0/2853066032 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b80c7760 con 0x7ff2b80b4700 2024-05-08T04:24:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2b7fff640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2b80ceee0 0x7ff2b8149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2b6ffd640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b80b4700 0x7ff2b81f1ed0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00c500 tx=0x7ff2ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff29ffff640 1 -- 172.21.15.104:0/2853066032 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac018070 con 0x7ff2b80b4700 2024-05-08T04:24:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff29ffff640 1 -- 172.21.15.104:0/2853066032 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac007580 con 0x7ff2b80b4700 2024-05-08T04:24:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2be0dd640 1 -- 172.21.15.104:0/2853066032 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b80c6ec0 con 0x7ff2b80b4700 2024-05-08T04:24:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff29ffff640 1 -- 172.21.15.104:0/2853066032 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac004a20 con 0x7ff2b80b4700 2024-05-08T04:24:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.727+0000 7ff2be0dd640 1 -- 172.21.15.104:0/2853066032 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b80c7480 con 0x7ff2b80b4700 2024-05-08T04:24:47.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.729+0000 7ff29ffff640 1 -- 172.21.15.104:0/2853066032 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7ff2ac01b070 con 0x7ff2b80b4700 2024-05-08T04:24:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.729+0000 7ff29ffff640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff2a406b680 0x7ff2a406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.729+0000 7ff29ffff640 1 -- 172.21.15.104:0/2853066032 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2ac0896e0 con 0x7ff2b80b4700 2024-05-08T04:24:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.729+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff2a406b680 0x7ff2a406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.730+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff2a406b680 0x7ff2a406db40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8034000 tx=0x7ff2a802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.730+0000 7ff2c0ddc740 1 Processor -- start 2024-05-08T04:24:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.730+0000 7ff2c0ddc740 1 -- start start 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2c0ddc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf52230 0x55d3bdf52610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2c0ddc740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf6fad0 0x55d3bdf70020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2c0ddc740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf27f10 0x55d3bdf6e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2c0ddc740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3bde8aa10 con 0x55d3bdf6fad0 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2c0ddc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3bde33b30 con 0x55d3bdf52230 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2c0ddc740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d3bde86c50 con 0x55d3bdf27f10 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2b6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf6fad0 0x55d3bdf70020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2b6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf6fad0 0x55d3bdf70020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39120/0 (socket says 172.21.15.104:39120) 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2b6ffd640 1 -- 172.21.15.104:0/1143213934 learned_addr learned my addr 172.21.15.104:0/1143213934 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2b6ffd640 1 -- 172.21.15.104:0/1143213934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf27f10 msgr2=0x55d3bdf6e190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2b6ffd640 1 --2- 172.21.15.104:0/1143213934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf27f10 0x55d3bdf6e190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2b6ffd640 1 -- 172.21.15.104:0/1143213934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf52230 msgr2=0x55d3bdf52610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2b6ffd640 1 --2- 172.21.15.104:0/1143213934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf52230 0x55d3bdf52610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2b6ffd640 1 -- 172.21.15.104:0/1143213934 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3bde48e10 con 0x55d3bdf6fad0 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff2b6ffd640 1 --2- 172.21.15.104:0/1143213934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf6fad0 0x55d3bdf70020 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac001120 tx=0x7ff2ac057990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15afd7a2c02d1604 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.731+0000 7ff29d7fa640 1 -- 172.21.15.104:0/1143213934 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac054390 con 0x55d3bdf6fad0 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.732+0000 7ff29d7fa640 1 -- 172.21.15.104:0/1143213934 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac004bc0 con 0x55d3bdf6fad0 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.732+0000 7ff29d7fa640 1 -- 172.21.15.104:0/1143213934 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac054530 con 0x55d3bdf6fad0 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.732+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/1143213934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf6fad0 msgr2=0x55d3bdf70020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.732+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/1143213934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf6fad0 0x55d3bdf70020 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac001120 tx=0x7ff2ac057990 comp rx=0 tx=0).stop 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.732+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/1143213934 shutdown_connections 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.732+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/1143213934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf27f10 0x55d3bdf6e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.732+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/1143213934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf6fad0 0x55d3bdf70020 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.732+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/1143213934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf52230 0x55d3bdf52610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.732+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/1143213934 >> 172.21.15.104:0/1143213934 conn(0x55d3bdf24840 msgr2=0x55d3bdf6d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.732+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/1143213934 shutdown_connections 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.732+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/1143213934 wait complete. 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.733+0000 7ff2c0ddc740 1 -- start start 2024-05-08T04:24:47.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.733+0000 7ff2c0ddc740 1 Processor -- start 2024-05-08T04:24:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2c0ddc740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf52230 0x55d3bdf3f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2c0ddc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf6fad0 0x55d3bdf3ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2c0ddc740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf64b20 0x55d3bdf72bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2c0ddc740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3bdf28cb0 con 0x55d3bdf64b20 2024-05-08T04:24:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2c0ddc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3bde470c0 con 0x55d3bdf6fad0 2024-05-08T04:24:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2c0ddc740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d3bdf22770 con 0x55d3bdf52230 2024-05-08T04:24:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2c0ddc740 10 client.0 _ll_register_callbacks cb 0x55d3bde3aec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T04:24:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2b7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf64b20 0x55d3bdf72bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2b7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf64b20 0x55d3bdf72bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39122/0 (socket says 172.21.15.104:39122) 2024-05-08T04:24:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2b7fff640 1 -- 172.21.15.104:0/868205138 learned_addr learned my addr 172.21.15.104:0/868205138 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/868205138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf52230 0x55d3bdf3f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2b7fff640 1 -- 172.21.15.104:0/868205138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf52230 msgr2=0x55d3bdf3f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:47.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2b7fff640 1 --2- 172.21.15.104:0/868205138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf52230 0x55d3bdf3f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2b7fff640 1 -- 172.21.15.104:0/868205138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf6fad0 msgr2=0x55d3bdf3ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2b7fff640 1 --2- 172.21.15.104:0/868205138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf6fad0 0x55d3bdf3ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2b7fff640 1 -- 172.21.15.104:0/868205138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d3bdb9f2d0 con 0x55d3bdf64b20 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/868205138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf52230 0x55d3bdf3f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2b7fff640 1 --2- 172.21.15.104:0/868205138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf64b20 0x55d3bdf72bd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000e4c0 tx=0x7ff2b0004930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ff8add47f0eca1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2967fc640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2967fc640 1 -- 172.21.15.104:0/868205138 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00135f0 con 0x55d3bdf64b20 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2967fc640 1 -- 172.21.15.104:0/868205138 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2b0013790 con 0x55d3bdf64b20 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/868205138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2ac004bc0 con 0x55d3bdf64b20 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2967fc640 1 -- 172.21.15.104:0/868205138 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2b0022050 con 0x55d3bdf64b20 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2c0ddc740 10 client.6528 fetch_fsmap learned FSMap version 28 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.734+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/868205138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55d3bdc696b0 con 0x55d3bdf64b20 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.735+0000 7ff2967fc640 1 -- 172.21.15.104:0/868205138 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac004bc0 con 0x55d3bdf64b20 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.735+0000 7ff2967fc640 1 -- 172.21.15.104:0/868205138 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff2b0025020 con 0x55d3bdf64b20 2024-05-08T04:24:47.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.735+0000 7ff2c0ddc740 10 client.6528 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.735+0000 7ff2c0ddc740 10 client.6528 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.735+0000 7ff2c0ddc740 20 client.6528 populate_metadata read hostname 'smithi104' 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.735+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/868205138 >> [v2:172.21.15.183:6833/495908291,v1:172.21.15.183:6835/495908291] conn(0x55d3bdf21a00 0x55d3bdf21de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.735+0000 7ff2c0ddc740 4 client.6528 mds_command: new command op to 6366 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.735+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/868205138 --> [v2:172.21.15.183:6833/495908291,v1:172.21.15.183:6835/495908291] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d3bdee9920 con 0x55d3bdf21a00 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.735+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/868205138 >> [v2:172.21.15.183:6833/495908291,v1:172.21.15.183:6835/495908291] conn(0x55d3bdf21a00 0x55d3bdf21de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.735+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/868205138 >> [v2:172.21.15.183:6833/495908291,v1:172.21.15.183:6835/495908291] conn(0x55d3bdf21a00 0x55d3bdf21de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26a1057410569a74 server_cookie=7c41f5d62bdf9b35 in_seq=0 out_seq=0 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.735+0000 7ff2967fc640 10 client.6528 ms_handle_connect on v2:172.21.15.183:6833/495908291 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2967fc640 1 -- 172.21.15.104:0/868205138 <== mds.0 v2:172.21.15.183:6833/495908291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d3bdee9920 con 0x55d3bdf21a00 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2967fc640 10 client.6528 handle_command_reply: tid=0 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2c0ddc740 1 client.6528 shutdown 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/868205138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf64b20 msgr2=0x55d3bdf72bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/868205138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf64b20 0x55d3bdf72bd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000e4c0 tx=0x7ff2b0004930 comp rx=0 tx=0).stop 2024-05-08T04:24:47.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/868205138 shutdown_connections 2024-05-08T04:24:47.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/868205138 >> [v2:172.21.15.183:6833/495908291,v1:172.21.15.183:6835/495908291] conn(0x55d3bdf21a00 0x55d3bdf21de0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/868205138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf6fad0 0x55d3bdf3ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/868205138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf64b20 0x55d3bdf72bd0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2967fc640 0 client.6528 ms_handle_reset on v2:172.21.15.183:6833/495908291 2024-05-08T04:24:47.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/868205138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf52230 0x55d3bdf3f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/868205138 >> 172.21.15.104:0/868205138 conn(0x55d3bdf27f10 msgr2=0x55d3bdf6c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:47.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/868205138 shutdown_connections 2024-05-08T04:24:47.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/868205138 wait complete. 2024-05-08T04:24:47.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.736+0000 7ff2c0ddc740 20 client.6528 trim_cache size 0 max 16384 2024-05-08T04:24:47.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.752+0000 7ff2c0ddc740 1 Processor -- start 2024-05-08T04:24:47.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.752+0000 7ff2c0ddc740 1 -- start start 2024-05-08T04:24:47.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2c0ddc740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 0x55d3bdf63e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2c0ddc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf52230 0x55d3bdf643d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2c0ddc740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf64b20 0x55d3bdf71710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2c0ddc740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b81fcdb0 con 0x55d3bdf21a00 2024-05-08T04:24:47.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2c0ddc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b80c91a0 con 0x55d3bdf52230 2024-05-08T04:24:47.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2c0ddc740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b80c97a0 con 0x55d3bdf64b20 2024-05-08T04:24:47.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2b77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 0x55d3bdf63e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2b77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 0x55d3bdf63e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39124/0 (socket says 172.21.15.104:39124) 2024-05-08T04:24:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2b77fe640 1 -- 172.21.15.104:0/1017520845 learned_addr learned my addr 172.21.15.104:0/1017520845 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2b77fe640 1 -- 172.21.15.104:0/1017520845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf64b20 msgr2=0x55d3bdf71710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2b7fff640 1 --2- 172.21.15.104:0/1017520845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf64b20 0x55d3bdf71710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2b6ffd640 1 --2- 172.21.15.104:0/1017520845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf52230 0x55d3bdf643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/1017520845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf64b20 0x55d3bdf71710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2b77fe640 1 -- 172.21.15.104:0/1017520845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf52230 msgr2=0x55d3bdf643d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/1017520845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf52230 0x55d3bdf643d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2b77fe640 1 -- 172.21.15.104:0/1017520845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3bdf90810 con 0x55d3bdf21a00 2024-05-08T04:24:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.753+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/1017520845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 0x55d3bdf63e90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff2a802a7d0 tx=0x7ff2a802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6d5d7e987a11b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.754+0000 7ff29cff9640 1 -- 172.21.15.104:0/1017520845 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8037040 con 0x55d3bdf21a00 2024-05-08T04:24:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.754+0000 7ff29cff9640 1 -- 172.21.15.104:0/1017520845 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a8055070 con 0x55d3bdf21a00 2024-05-08T04:24:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.754+0000 7ff29cff9640 1 -- 172.21.15.104:0/1017520845 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8050dc0 con 0x55d3bdf21a00 2024-05-08T04:24:47.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.754+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/1017520845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 msgr2=0x55d3bdf63e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.754+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/1017520845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 0x55d3bdf63e90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff2a802a7d0 tx=0x7ff2a802c000 comp rx=0 tx=0).stop 2024-05-08T04:24:47.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.754+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/1017520845 shutdown_connections 2024-05-08T04:24:47.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.754+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/1017520845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf52230 0x55d3bdf643d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.754+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/1017520845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf64b20 0x55d3bdf71710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.754+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/1017520845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 0x55d3bdf63e90 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.754+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/1017520845 >> 172.21.15.104:0/1017520845 conn(0x55d3bdf27f10 msgr2=0x55d3bdf27650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:47.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.754+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/1017520845 shutdown_connections 2024-05-08T04:24:47.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.754+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/1017520845 wait complete. 2024-05-08T04:24:47.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.755+0000 7ff2c0ddc740 1 -- start start 2024-05-08T04:24:47.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.755+0000 7ff2c0ddc740 1 Processor -- start 2024-05-08T04:24:47.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2c0ddc740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 0x55d3bdf3eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2c0ddc740 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf52230 0x55d3bdfc23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2c0ddc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf64b20 0x55d3bdf715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2c0ddc740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3bdf53fc0 con 0x55d3bdf21a00 2024-05-08T04:24:47.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2c0ddc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3bdf40730 con 0x55d3bdf64b20 2024-05-08T04:24:47.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2c0ddc740 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d3bdf41690 con 0x55d3bdf52230 2024-05-08T04:24:47.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2c0ddc740 10 client.0 _ll_register_callbacks cb 0x55d3bdf22c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T04:24:47.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2b77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 0x55d3bdf3eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2b77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 0x55d3bdf3eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39128/0 (socket says 172.21.15.104:39128) 2024-05-08T04:24:47.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2b77fe640 1 -- 172.21.15.104:0/2990919733 learned_addr learned my addr 172.21.15.104:0/2990919733 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:47.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2b77fe640 1 -- 172.21.15.104:0/2990919733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf52230 msgr2=0x55d3bdfc23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:47.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/2990919733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf52230 0x55d3bdfc23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2b77fe640 1 -- 172.21.15.104:0/2990919733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf64b20 msgr2=0x55d3bdf715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:47.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/2990919733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf64b20 0x55d3bdf715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2b77fe640 1 -- 172.21.15.104:0/2990919733 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d3bdf3f3a0 con 0x55d3bdf21a00 2024-05-08T04:24:47.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2b77fe640 1 --2- 172.21.15.104:0/2990919733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 0x55d3bdf3eb50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8035040 tx=0x7ff2a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c83caac6ecf9cbc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:47.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2967fc640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-05-08T04:24:47.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2967fc640 1 -- 172.21.15.104:0/2990919733 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8060060 con 0x55d3bdf21a00 2024-05-08T04:24:47.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2967fc640 1 -- 172.21.15.104:0/2990919733 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2a8050d80 con 0x55d3bdf21a00 2024-05-08T04:24:47.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/2990919733 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2a8055070 con 0x55d3bdf21a00 2024-05-08T04:24:47.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2967fc640 1 -- 172.21.15.104:0/2990919733 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2a8037040 con 0x55d3bdf21a00 2024-05-08T04:24:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2c0ddc740 10 client.6534 fetch_fsmap learned FSMap version 28 2024-05-08T04:24:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.756+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/2990919733 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55d3bdf6e480 con 0x55d3bdf21a00 2024-05-08T04:24:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2967fc640 1 -- 172.21.15.104:0/2990919733 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a8055070 con 0x55d3bdf21a00 2024-05-08T04:24:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2967fc640 1 -- 172.21.15.104:0/2990919733 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff2a8050340 con 0x55d3bdf21a00 2024-05-08T04:24:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2c0ddc740 10 client.6534 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T04:24:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2c0ddc740 10 client.6534 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T04:24:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2c0ddc740 20 client.6534 populate_metadata read hostname 'smithi104' 2024-05-08T04:24:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/2990919733 >> [v2:172.21.15.183:6833/495908291,v1:172.21.15.183:6835/495908291] conn(0x55d3bdf6fad0 0x55d3bdf26de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2c0ddc740 4 client.6534 mds_command: new command op to 6366 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T04:24:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/2990919733 --> [v2:172.21.15.183:6833/495908291,v1:172.21.15.183:6835/495908291] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d3bdf65d80 con 0x55d3bdf6fad0 2024-05-08T04:24:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2b6ffd640 1 --2- 172.21.15.104:0/2990919733 >> [v2:172.21.15.183:6833/495908291,v1:172.21.15.183:6835/495908291] conn(0x55d3bdf6fad0 0x55d3bdf26de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2967fc640 10 client.6534 ms_handle_connect on v2:172.21.15.183:6833/495908291 2024-05-08T04:24:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2b6ffd640 1 --2- 172.21.15.104:0/2990919733 >> [v2:172.21.15.183:6833/495908291,v1:172.21.15.183:6835/495908291] conn(0x55d3bdf6fad0 0x55d3bdf26de0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=764ab87a6e01c47e server_cookie=6119f76a5b1e6e7c in_seq=0 out_seq=0 2024-05-08T04:24:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2967fc640 1 -- 172.21.15.104:0/2990919733 <== mds.0 v2:172.21.15.183:6833/495908291 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55d3bdf65d80 con 0x55d3bdf6fad0 2024-05-08T04:24:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2967fc640 10 client.6534 handle_command_reply: tid=0 2024-05-08T04:24:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.757+0000 7ff2c0ddc740 1 client.6534 shutdown 2024-05-08T04:24:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/2990919733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 msgr2=0x55d3bdf3eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/2990919733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 0x55d3bdf3eb50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8035040 tx=0x7ff2a8004730 comp rx=0 tx=0).stop 2024-05-08T04:24:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/2990919733 shutdown_connections 2024-05-08T04:24:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/2990919733 >> [v2:172.21.15.183:6833/495908291,v1:172.21.15.183:6835/495908291] conn(0x55d3bdf6fad0 0x55d3bdf26de0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/2990919733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d3bdf64b20 0x55d3bdf715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/2990919733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55d3bdf52230 0x55d3bdfc23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2967fc640 0 client.6534 ms_handle_reset on v2:172.21.15.183:6833/495908291 2024-05-08T04:24:47.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2c0ddc740 1 --2- 172.21.15.104:0/2990919733 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55d3bdf21a00 0x55d3bdf3eb50 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/2990919733 >> 172.21.15.104:0/2990919733 conn(0x55d3bdf27f10 msgr2=0x55d3bdf3e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:47.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/2990919733 shutdown_connections 2024-05-08T04:24:47.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2c0ddc740 1 -- 172.21.15.104:0/2990919733 wait complete. 2024-05-08T04:24:47.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2c0ddc740 20 client.6534 trim_cache size 0 max 16384 2024-05-08T04:24:47.767 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:24:47.767 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "c8b1f73b-90d2-40b8-ad3c-a036617abfed", 2024-05-08T04:24:47.768 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-05-08T04:24:47.768 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 6366, 2024-05-08T04:24:47.768 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-05-08T04:24:47.768 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-05-08T04:24:47.768 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-05-08T04:24:47.768 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 9.0232201770000007, 2024-05-08T04:24:47.768 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 28, 2024-05-08T04:24:47.768 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 59, 2024-05-08T04:24:47.768 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 59, 2024-05-08T04:24:47.768 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 14.090979529 2024-05-08T04:24:47.768 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:24:47.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2be0dd640 1 -- 172.21.15.104:0/2853066032 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff2a406b680 msgr2=0x7ff2a406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2be0dd640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff2a406b680 0x7ff2a406db40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8034000 tx=0x7ff2a802e000 comp rx=0 tx=0).stop 2024-05-08T04:24:47.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2be0dd640 1 -- 172.21.15.104:0/2853066032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b80b4700 msgr2=0x7ff2b81f1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2be0dd640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b80b4700 0x7ff2b81f1ed0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00c500 tx=0x7ff2ac00c9c0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2be0dd640 1 -- 172.21.15.104:0/2853066032 shutdown_connections 2024-05-08T04:24:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2be0dd640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff2a406b680 0x7ff2a406db40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2be0dd640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2b80ceee0 0x7ff2b8149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2be0dd640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2b80b4700 0x7ff2b81f1ed0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2be0dd640 1 --2- 172.21.15.104:0/2853066032 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff2b806e330 0x7ff2b80c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2be0dd640 1 -- 172.21.15.104:0/2853066032 >> 172.21.15.104:0/2853066032 conn(0x7ff2b80b13f0 msgr2=0x7ff2b80cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2be0dd640 1 -- 172.21.15.104:0/2853066032 shutdown_connections 2024-05-08T04:24:47.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.758+0000 7ff2be0dd640 1 -- 172.21.15.104:0/2853066032 wait complete. 2024-05-08T04:24:47.772 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T04:24:47.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.869+0000 7fb88ef6a640 1 Processor -- start 2024-05-08T04:24:47.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.869+0000 7fb88ef6a640 1 -- start start 2024-05-08T04:24:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.870+0000 7fb88ef6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88815de20 0x7fb8880b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.870+0000 7fb88ef6a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb8880d0150 0x7fb8880cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.870+0000 7fb88ef6a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8880cd7a0 con 0x7fb8880b1d50 2024-05-08T04:24:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.870+0000 7fb88ef6a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8880caf50 con 0x7fb8880d0150 2024-05-08T04:24:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.870+0000 7fb88ef6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8880cda80 con 0x7fb88815de20 2024-05-08T04:24:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.870+0000 7fb88d507640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb8880d0150 0x7fb8880cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.870+0000 7fb88cd06640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88815de20 0x7fb8880b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.870+0000 7fb88d507640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb8880d0150 0x7fb8880cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:42004/0 (socket says 172.21.15.104:42004) 2024-05-08T04:24:47.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.870+0000 7fb88cd06640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88815de20 0x7fb8880b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:51434/0 (socket says 172.21.15.104:51434) 2024-05-08T04:24:47.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.870+0000 7fb88d507640 1 -- 172.21.15.104:0/1081857668 learned_addr learned my addr 172.21.15.104:0/1081857668 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:47.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.871+0000 7fb88cd06640 1 -- 172.21.15.104:0/1081857668 >> v2:172.21.15.183:3300/0 conn(0x7fb8880d0150 msgr2=0x7fb8880cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:47.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.871+0000 7fb88cd06640 1 --2- 172.21.15.104:0/1081857668 >> v2:172.21.15.183:3300/0 conn(0x7fb8880d0150 0x7fb8880cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.871+0000 7fb88cd06640 1 -- 172.21.15.104:0/1081857668 >> v1:172.21.15.183:6789/0 conn(0x7fb8880b1d50 legacy=0x7fb8880cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.871+0000 7fb88cd06640 1 -- 172.21.15.104:0/1081857668 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8880cdd60 con 0x7fb88815de20 2024-05-08T04:24:47.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.871+0000 7fb88d507640 1 --2- 172.21.15.104:0/1081857668 >> v2:172.21.15.183:3300/0 conn(0x7fb8880d0150 0x7fb8880cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:24:47.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.872+0000 7fb88cd06640 1 --2- 172.21.15.104:0/1081857668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88815de20 0x7fb8880b1810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0097a0 tx=0x7fb87c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff5ed6d1d95b66c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:47.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.872+0000 7fb8877fe640 1 -- 172.21.15.104:0/1081857668 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c037070 con 0x7fb88815de20 2024-05-08T04:24:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.872+0000 7fb8877fe640 1 -- 172.21.15.104:0/1081857668 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87c02ae50 con 0x7fb88815de20 2024-05-08T04:24:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.872+0000 7fb8877fe640 1 -- 172.21.15.104:0/1081857668 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c032660 con 0x7fb88815de20 2024-05-08T04:24:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.872+0000 7fb88ef6a640 1 -- 172.21.15.104:0/1081857668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88815de20 msgr2=0x7fb8880b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.872+0000 7fb88ef6a640 1 --2- 172.21.15.104:0/1081857668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88815de20 0x7fb8880b1810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0097a0 tx=0x7fb87c02a100 comp rx=0 tx=0).stop 2024-05-08T04:24:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.872+0000 7fb88ef6a640 1 -- 172.21.15.104:0/1081857668 shutdown_connections 2024-05-08T04:24:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.872+0000 7fb88ef6a640 1 --2- 172.21.15.104:0/1081857668 >> v2:172.21.15.183:3300/0 conn(0x7fb8880d0150 0x7fb8880cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.872+0000 7fb88ef6a640 1 --2- 172.21.15.104:0/1081857668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88815de20 0x7fb8880b1810 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.872+0000 7fb88ef6a640 1 -- 172.21.15.104:0/1081857668 >> 172.21.15.104:0/1081857668 conn(0x7fb8880b2220 msgr2=0x7fb8880b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.872+0000 7fb88ef6a640 1 -- 172.21.15.104:0/1081857668 shutdown_connections 2024-05-08T04:24:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.872+0000 7fb88ef6a640 1 -- 172.21.15.104:0/1081857668 wait complete. 2024-05-08T04:24:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.873+0000 7fb88ef6a640 1 Processor -- start 2024-05-08T04:24:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.873+0000 7fb88ef6a640 1 -- start start 2024-05-08T04:24:47.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.874+0000 7fb88ef6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8880b1d50 0x7fb88815ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.874+0000 7fb88ef6a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8880d0150 0x7fb8881f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.874+0000 7fb88ef6a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88815de20 0x7fb8880adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.874+0000 7fb88ef6a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88815e380 con 0x7fb8880d0150 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.874+0000 7fb88ef6a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88815e200 con 0x7fb88815de20 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.874+0000 7fb88ef6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8880cb920 con 0x7fb8880b1d50 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.874+0000 7fb887fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8880d0150 0x7fb8881f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb88cd06640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8880b1d50 0x7fb88815ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb887fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8880d0150 0x7fb8881f41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39140/0 (socket says 172.21.15.104:39140) 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb887fff640 1 -- 172.21.15.104:0/4269191650 learned_addr learned my addr 172.21.15.104:0/4269191650 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb88d507640 1 --2- 172.21.15.104:0/4269191650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88815de20 0x7fb8880adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb887fff640 1 -- 172.21.15.104:0/4269191650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8880b1d50 msgr2=0x7fb88815ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb887fff640 1 --2- 172.21.15.104:0/4269191650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8880b1d50 0x7fb88815ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb887fff640 1 -- 172.21.15.104:0/4269191650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88815de20 msgr2=0x7fb8880adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb887fff640 1 --2- 172.21.15.104:0/4269191650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88815de20 0x7fb8880adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb887fff640 1 -- 172.21.15.104:0/4269191650 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8881f4720 con 0x7fb8880d0150 2024-05-08T04:24:47.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb887fff640 1 --2- 172.21.15.104:0/4269191650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8880d0150 0x7fb8881f41e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb87400c450 tx=0x7fb87400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:47.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb8857fa640 1 -- 172.21.15.104:0/4269191650 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8740052d0 con 0x7fb8880d0150 2024-05-08T04:24:47.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb8857fa640 1 -- 172.21.15.104:0/4269191650 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb874005470 con 0x7fb8880d0150 2024-05-08T04:24:47.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb88ef6a640 1 -- 172.21.15.104:0/4269191650 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8880b0010 con 0x7fb8880d0150 2024-05-08T04:24:47.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb8857fa640 1 -- 172.21.15.104:0/4269191650 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb874012870 con 0x7fb8880d0150 2024-05-08T04:24:47.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.875+0000 7fb88ef6a640 1 -- 172.21.15.104:0/4269191650 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8880ad750 con 0x7fb8880d0150 2024-05-08T04:24:47.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.876+0000 7fb88ef6a640 1 -- 172.21.15.104:0/4269191650 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8880ad560 con 0x7fb8880d0150 2024-05-08T04:24:47.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.877+0000 7fb8857fa640 1 -- 172.21.15.104:0/4269191650 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fb874012a10 con 0x7fb8880d0150 2024-05-08T04:24:47.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.877+0000 7fb8857fa640 1 --2- 172.21.15.104:0/4269191650 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb86c06b680 0x7fb86c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:47.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.877+0000 7fb8857fa640 1 -- 172.21.15.104:0/4269191650 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb87408a040 con 0x7fb8880d0150 2024-05-08T04:24:47.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.877+0000 7fb88cd06640 1 --2- 172.21.15.104:0/4269191650 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb86c06b680 0x7fb86c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:47.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.878+0000 7fb88cd06640 1 --2- 172.21.15.104:0/4269191650 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb86c06b680 0x7fb86c06db40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb87c034000 tx=0x7fb87c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:47.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:47.881+0000 7fb8857fa640 1 -- 172.21.15.104:0/4269191650 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb8881f4720 con 0x7fb8880d0150 2024-05-08T04:24:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.089+0000 7fb88ef6a640 1 -- 172.21.15.104:0/4269191650 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb8880b2b20 con 0x7fb8880d0150 2024-05-08T04:24:48.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.089+0000 7fb8857fa640 1 -- 172.21.15.104:0/4269191650 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb874058560 con 0x7fb8880d0150 2024-05-08T04:24:48.091 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T04:24:48.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.091+0000 7fb88ef6a640 1 -- 172.21.15.104:0/4269191650 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb86c06b680 msgr2=0x7fb86c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:48.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.091+0000 7fb88ef6a640 1 --2- 172.21.15.104:0/4269191650 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb86c06b680 0x7fb86c06db40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb87c034000 tx=0x7fb87c02e000 comp rx=0 tx=0).stop 2024-05-08T04:24:48.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.091+0000 7fb88ef6a640 1 -- 172.21.15.104:0/4269191650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8880d0150 msgr2=0x7fb8881f41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:48.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.091+0000 7fb88ef6a640 1 --2- 172.21.15.104:0/4269191650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8880d0150 0x7fb8881f41e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb87400c450 tx=0x7fb87400c910 comp rx=0 tx=0).stop 2024-05-08T04:24:48.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.091+0000 7fb88ef6a640 1 -- 172.21.15.104:0/4269191650 shutdown_connections 2024-05-08T04:24:48.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.091+0000 7fb88ef6a640 1 --2- 172.21.15.104:0/4269191650 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb86c06b680 0x7fb86c06db40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:48.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.091+0000 7fb88ef6a640 1 --2- 172.21.15.104:0/4269191650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88815de20 0x7fb8880adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:48.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.091+0000 7fb88ef6a640 1 --2- 172.21.15.104:0/4269191650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8880d0150 0x7fb8881f41e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:48.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.091+0000 7fb88ef6a640 1 --2- 172.21.15.104:0/4269191650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8880b1d50 0x7fb88815ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:48.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.091+0000 7fb88ef6a640 1 -- 172.21.15.104:0/4269191650 >> 172.21.15.104:0/4269191650 conn(0x7fb8880b2220 msgr2=0x7fb8880ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:48.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.091+0000 7fb88ef6a640 1 -- 172.21.15.104:0/4269191650 shutdown_connections 2024-05-08T04:24:48.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48.091+0000 7fb88ef6a640 1 -- 172.21.15.104:0/4269191650 wait complete. 2024-05-08T04:24:48.104 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T04:24:48.104 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T04:24:48.104 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-05-08T04:24:48.104 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T04:24:48.104 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T04:24:48.104 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T04:24:48.104 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T04:24:48.105 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T04:24:48.105 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T04:24:48.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:48.105 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-05-08T04:24:48.121 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:24:48.121 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:24:48.121 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:24:48.122 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:48.122 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-05-08T04:24:48.122 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:24:48.122 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-05-08T04:24:48.122 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-05-08T04:24:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:24:48.122 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-05-08T04:24:48.122 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-05-08T04:24:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:24:48.122 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:24:48.122 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T04:24:48.122 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42489sec preferred_lft 42489sec 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether c6:d6:f9:07:c5:21 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::fc58:88ff:fed3:93d7/64 scope link 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether ca:ef:a4:8b:34:e2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::c8ef:a4ff:fe8b:34e2/64 scope link 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:48.123 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:24:48.124 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether c6:d6:f9:07:c5:21 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:24:48.124 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::c4d6:f9ff:fe07:c521/64 scope link 2024-05-08T04:24:48.124 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:48.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:48.124 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T04:24:48.186 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-05-08T04:24:48.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:48.187 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-05-08T04:24:48.244 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-05-08T04:24:48.245 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T04:24:48.245 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T04:24:48.245 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T04:24:48.245 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T04:24:48.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:48.245 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec bash -c ' 2024-05-08T04:24:48.245 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-05-08T04:24:48.245 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T04:24:48.245 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T04:24:48.246 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T04:24:48.246 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-05-08T04:24:48.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:48.332 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-05-08T04:24:48.347 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-08T04:24:48.348 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T04:24:48.348 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T04:24:48.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:48.348 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-05-08T04:24:48.413 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-08T04:24:48.413 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:24:48.413 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T04:24:48.469 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T04:24:48.469 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:24:48.469 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T04:24:48.525 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-05-08T04:24:48.590 DEBUG:teuthology.orchestra.run.smithi104:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:24:48.647 INFO:teuthology.orchestra.run.smithi104.stdout:/proc 2024-05-08T04:24:48.647 INFO:teuthology.orchestra.run.smithi104.stdout:/sys 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/dev 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/security 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/shm 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/pts 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/run 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/cgroup 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/pstore 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/bpf 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/ 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/selinux 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/mqueue 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/hugepages 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/debug 2024-05-08T04:24:48.648 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/tracing 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/fuse/connections 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/config 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/run/user/1000 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-0 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-1 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-2 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-3 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:24:48.649 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:24:48.650 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:24:48.650 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:24:48.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:48.650 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-05-08T04:24:48.703 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T04:24:48.703 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-08T04:24:48.747 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe fuse 2024-05-08T04:24:48.772 DEBUG:teuthology.orchestra.run.smithi104:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:24:48.829 INFO:teuthology.orchestra.run.smithi104.stdout:/proc 2024-05-08T04:24:48.830 INFO:teuthology.orchestra.run.smithi104.stdout:/sys 2024-05-08T04:24:48.830 INFO:teuthology.orchestra.run.smithi104.stdout:/dev 2024-05-08T04:24:48.830 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/security 2024-05-08T04:24:48.830 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/shm 2024-05-08T04:24:48.830 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/pts 2024-05-08T04:24:48.830 INFO:teuthology.orchestra.run.smithi104.stdout:/run 2024-05-08T04:24:48.830 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/cgroup 2024-05-08T04:24:48.830 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/pstore 2024-05-08T04:24:48.830 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/bpf 2024-05-08T04:24:48.830 INFO:teuthology.orchestra.run.smithi104.stdout:/ 2024-05-08T04:24:48.830 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/selinux 2024-05-08T04:24:48.831 INFO:teuthology.orchestra.run.smithi104.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:24:48.831 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/mqueue 2024-05-08T04:24:48.831 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/hugepages 2024-05-08T04:24:48.831 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/debug 2024-05-08T04:24:48.831 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/tracing 2024-05-08T04:24:48.831 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:24:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/fs/fuse/connections 2024-05-08T04:24:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:/sys/kernel/config 2024-05-08T04:24:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:24:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:24:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:24:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:/run/user/1000 2024-05-08T04:24:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph 2024-05-08T04:24:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-0 2024-05-08T04:24:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-1 2024-05-08T04:24:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-2 2024-05-08T04:24:48.832 INFO:teuthology.orchestra.run.smithi104.stdout:/var/lib/ceph/osd/ceph-3 2024-05-08T04:24:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns 2024-05-08T04:24:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:24:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:24:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:24:48.833 INFO:teuthology.orchestra.run.smithi104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:24:48.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:48.833 DEBUG:teuthology.orchestra.run.smithi104:> ls /sys/fs/fuse/connections 2024-05-08T04:24:48.834 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:2024-05-08T04:24:48.828+0000 7faa0f0d2480 -1 init, newargv = 0x5586cffe58d0 newargc=15 2024-05-08T04:24:48.834 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[58504]: starting ceph client 2024-05-08T04:24:48.836 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[58504]: starting fuse 2024-05-08T04:24:48.849 INFO:teuthology.orchestra.run.smithi104.stdout:41 2024-05-08T04:24:48.849 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-05-08T04:24:48.849 DEBUG:teuthology.orchestra.run.smithi104:> sudo stdin-killer -- python3 -c ' 2024-05-08T04:24:48.849 DEBUG:teuthology.orchestra.run.smithi104:> import glob 2024-05-08T04:24:48.849 DEBUG:teuthology.orchestra.run.smithi104:> import re 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> def _find_admin_socket(client_name): 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> files = glob.glob(asok_path) 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> # Given a non-glob path, it better be there 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> if "*" not in asok_path: 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> assert(len(files) == 1) 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> return files[0] 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> for f in files: 2024-05-08T04:24:48.850 DEBUG:teuthology.orchestra.run.smithi104:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T04:24:48.851 DEBUG:teuthology.orchestra.run.smithi104:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T04:24:48.851 DEBUG:teuthology.orchestra.run.smithi104:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T04:24:48.851 DEBUG:teuthology.orchestra.run.smithi104:> contents = proc_f.read() 2024-05-08T04:24:48.851 DEBUG:teuthology.orchestra.run.smithi104:> if mountpoint in contents: 2024-05-08T04:24:48.851 DEBUG:teuthology.orchestra.run.smithi104:> return f 2024-05-08T04:24:48.851 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T04:24:48.851 DEBUG:teuthology.orchestra.run.smithi104:> 2024-05-08T04:24:48.851 DEBUG:teuthology.orchestra.run.smithi104:> print(_find_admin_socket("client.0")) 2024-05-08T04:24:48.851 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-05-08T04:24:48.967 INFO:teuthology.orchestra.run.smithi104.stdout:/var/run/ceph/ceph-client.0.58504.asok 2024-05-08T04:24:48.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T04:24:48.977 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.58504.asok 2024-05-08T04:24:48.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:48.977 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.58504.asok status 2024-05-08T04:24:49.111 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": { 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: "entity_id": "0", 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: "hostname": "smithi104", 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: "pid": "58504", 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: "root": "/" 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_count": 0, 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: "dentry_pinned_count": 0, 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 6540, 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: "inst": { 2024-05-08T04:24:49.112 INFO:teuthology.orchestra.run.smithi104.stdout: "name": { 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "client", 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: "num": 6540 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3490569448 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": { 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3490569448 2024-05-08T04:24:49.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-05-08T04:24:49.114 INFO:teuthology.orchestra.run.smithi104.stdout: "inst_str": "client.6540 192.168.0.1:0/3490569448", 2024-05-08T04:24:49.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addr_str": "192.168.0.1:0/3490569448", 2024-05-08T04:24:49.114 INFO:teuthology.orchestra.run.smithi104.stdout: "inode_count": 1, 2024-05-08T04:24:49.114 INFO:teuthology.orchestra.run.smithi104.stdout: "mds_epoch": 28, 2024-05-08T04:24:49.114 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch": 59, 2024-05-08T04:24:49.114 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_epoch_barrier": 0, 2024-05-08T04:24:49.114 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklisted": false, 2024-05-08T04:24:49.114 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs" 2024-05-08T04:24:49.114 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:24:49.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:49.123 DEBUG:teuthology.orchestra.run.smithi104:> stat --file-system '--printf=%T 2024-05-08T04:24:49.123 DEBUG:teuthology.orchestra.run.smithi104:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-08T04:24:49.139 INFO:teuthology.orchestra.run.smithi104.stdout:fuseblk 2024-05-08T04:24:49.139 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-08T04:24:49.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:49.140 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T04:24:49.206 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T04:24:49.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.343+0000 7f268088f640 1 Processor -- start 2024-05-08T04:24:49.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.343+0000 7f268088f640 1 -- start start 2024-05-08T04:24:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.344+0000 7f268088f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f267c0b4700 0x7f267c0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.344+0000 7f268088f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267c15e780 con 0x7f267c0ceee0 2024-05-08T04:24:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.344+0000 7f268088f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267c15ea60 con 0x7f267c06ea40 2024-05-08T04:24:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.344+0000 7f268088f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267c15f390 con 0x7f267c0b4700 2024-05-08T04:24:49.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.344+0000 7f267a59c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f267c0ceee0 0x7f267c06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54468/0 (socket says 172.21.15.104:54468) 2024-05-08T04:24:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.344+0000 7f267a59c640 1 -- 172.21.15.104:0/1036171486 learned_addr learned my addr 172.21.15.104:0/1036171486 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.344+0000 7f267ad9d640 1 --2- 172.21.15.104:0/1036171486 >> v2:172.21.15.183:3300/0 conn(0x7f267c0b4700 0x7f267c0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.344+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571032598 0 0) 0x7f267c15e780 con 0x7f267c0ceee0 2024-05-08T04:24:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.344+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2668005730 con 0x7f267c0ceee0 2024-05-08T04:24:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4083087504 0 0) 0x7f2668005730 con 0x7f267c0ceee0 2024-05-08T04:24:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 >> v2:172.21.15.183:3300/0 conn(0x7f267c0b4700 msgr2=0x7f267c0b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2679d9b640 1 --2- 172.21.15.104:0/1036171486 >> v2:172.21.15.183:3300/0 conn(0x7f267c0b4700 0x7f267c0b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 >> v1:172.21.15.183:6789/0 conn(0x7f267c06ea40 legacy=0x7f267c0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c15ed40 con 0x7f267c0ceee0 2024-05-08T04:24:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f266c001670 con 0x7f267c0ceee0 2024-05-08T04:24:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 >> v1:172.21.15.104:6789/0 conn(0x7f267c0ceee0 legacy=0x7f267c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2679d9b640 1 --2- 172.21.15.104:0/1036171486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2668005bc0 0x7f2668006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:49.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2679d9b640 1 --2- 172.21.15.104:0/1036171486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2668006a10 0x7f2668006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2679d9b640 1 --2- 172.21.15.104:0/1036171486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26680073d0 0x7f266800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c15f390 con 0x7f2668005bc0 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266800e2a0 con 0x7f26680073d0 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266800e4a0 con 0x7f2668006a10 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f267a59c640 1 --2- 172.21.15.104:0/1036171486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2668005bc0 0x7f2668006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f2671d9b640 1 --2- 172.21.15.104:0/1036171486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2668006a10 0x7f2668006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f267ad9d640 1 --2- 172.21.15.104:0/1036171486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26680073d0 0x7f266800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f267a59c640 1 -- 172.21.15.104:0/1036171486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2668006a10 msgr2=0x7f2668006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f267a59c640 1 --2- 172.21.15.104:0/1036171486 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2668006a10 0x7f2668006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f267a59c640 1 -- 172.21.15.104:0/1036171486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26680073d0 msgr2=0x7f266800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f267a59c640 1 --2- 172.21.15.104:0/1036171486 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26680073d0 0x7f266800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f267a59c640 1 -- 172.21.15.104:0/1036171486 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2668005730 con 0x7f2668005bc0 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.345+0000 7f267ad9d640 1 -- 172.21.15.104:0/1036171486 reap_dead start 2024-05-08T04:24:49.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.346+0000 7f267a59c640 1 --2- 172.21.15.104:0/1036171486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2668005bc0 0x7f2668006000 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f266c00c240 tx=0x7f2668007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3515e4f30c7d40fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:49.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.346+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c007d10 con 0x7f2668005bc0 2024-05-08T04:24:49.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.346+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c0058d0 con 0x7f2668005bc0 2024-05-08T04:24:49.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.346+0000 7f2679d9b640 1 -- 172.21.15.104:0/1036171486 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c005d00 con 0x7f2668005bc0 2024-05-08T04:24:49.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.346+0000 7f268088f640 1 -- 172.21.15.104:0/1036171486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2668005bc0 msgr2=0x7f2668006000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:49.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.346+0000 7f268088f640 1 --2- 172.21.15.104:0/1036171486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2668005bc0 0x7f2668006000 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f266c00c240 tx=0x7f2668007a40 comp rx=0 tx=0).stop 2024-05-08T04:24:49.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.346+0000 7f268088f640 1 -- 172.21.15.104:0/1036171486 shutdown_connections 2024-05-08T04:24:49.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.347+0000 7f268088f640 1 --2- 172.21.15.104:0/1036171486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2668005bc0 0x7f2668006000 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:49.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.347+0000 7f268088f640 1 -- 172.21.15.104:0/1036171486 >> 172.21.15.104:0/1036171486 conn(0x7f267c0b13f0 msgr2=0x7f267c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:49.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.347+0000 7f268088f640 1 -- 172.21.15.104:0/1036171486 shutdown_connections 2024-05-08T04:24:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.347+0000 7f268088f640 1 -- 172.21.15.104:0/1036171486 wait complete. 2024-05-08T04:24:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.348+0000 7f268088f640 1 Processor -- start 2024-05-08T04:24:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.348+0000 7f268088f640 1 -- start start 2024-05-08T04:24:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f268088f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2668005bc0 0x7f267c14c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f268088f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f267c14be20 0x7f267c14b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f268088f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f267c14dd00 0x7f267c157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f268088f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0cf440 con 0x7f2668005bc0 2024-05-08T04:24:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f268088f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0cf2c0 con 0x7f267c14be20 2024-05-08T04:24:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f268088f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0b26f0 con 0x7f267c14dd00 2024-05-08T04:24:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f267a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2668005bc0 0x7f267c14c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f267a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2668005bc0 0x7f267c14c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39158/0 (socket says 172.21.15.104:39158) 2024-05-08T04:24:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f267a59c640 1 -- 172.21.15.104:0/3172300324 learned_addr learned my addr 172.21.15.104:0/3172300324 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:49.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f2671d9b640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f267c14be20 0x7f267c14b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f267ad9d640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f267c14dd00 0x7f267c157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f267a59c640 1 -- 172.21.15.104:0/3172300324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f267c14dd00 msgr2=0x7f267c157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f267a59c640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f267c14dd00 0x7f267c157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f267a59c640 1 -- 172.21.15.104:0/3172300324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f267c14be20 msgr2=0x7f267c14b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f267a59c640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f267c14be20 0x7f267c14b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f267a59c640 1 -- 172.21.15.104:0/3172300324 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c14cc80 con 0x7f2668005bc0 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f2671d9b640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f267c14be20 0x7f267c14b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f267a59c640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2668005bc0 0x7f267c14c350 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f266c00c360 tx=0x7f267c15e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.349+0000 7f26737fe640 1 -- 172.21.15.104:0/3172300324 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c040020 con 0x7f2668005bc0 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.350+0000 7f26737fe640 1 -- 172.21.15.104:0/3172300324 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c000ed0 con 0x7f2668005bc0 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.350+0000 7f268088f640 1 -- 172.21.15.104:0/3172300324 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267c14cf40 con 0x7f2668005bc0 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.350+0000 7f26737fe640 1 -- 172.21.15.104:0/3172300324 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c007d10 con 0x7f2668005bc0 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.350+0000 7f268088f640 1 -- 172.21.15.104:0/3172300324 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267c14d500 con 0x7f2668005bc0 2024-05-08T04:24:49.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.351+0000 7f268088f640 1 -- 172.21.15.104:0/3172300324 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267c075010 con 0x7f2668005bc0 2024-05-08T04:24:49.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.351+0000 7f26737fe640 1 -- 172.21.15.104:0/3172300324 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f266c043020 con 0x7f2668005bc0 2024-05-08T04:24:49.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.352+0000 7f26737fe640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f265c06b680 0x7f265c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:49.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.352+0000 7f2671d9b640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f265c06b680 0x7f265c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:49.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.352+0000 7f26737fe640 1 -- 172.21.15.104:0/3172300324 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f266c0aa4e0 con 0x7f2668005bc0 2024-05-08T04:24:49.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.352+0000 7f2671d9b640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f265c06b680 0x7f265c06db40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2664000c00 tx=0x7f2664009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:49.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.356+0000 7f26737fe640 1 -- 172.21.15.104:0/3172300324 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f266c04a020 con 0x7f2668005bc0 2024-05-08T04:24:49.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.564+0000 7f268088f640 1 -- 172.21.15.104:0/3172300324 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f267c06f3f0 con 0x7f2668005bc0 2024-05-08T04:24:49.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.564+0000 7f26737fe640 1 -- 172.21.15.104:0/3172300324 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+73 (secure 0 0 0) 0x7f266c0790e0 con 0x7f2668005bc0 2024-05-08T04:24:49.567 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T04:24:49.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.566+0000 7f268088f640 1 -- 172.21.15.104:0/3172300324 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f265c06b680 msgr2=0x7f265c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:49.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.566+0000 7f268088f640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f265c06b680 0x7f265c06db40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2664000c00 tx=0x7f2664009040 comp rx=0 tx=0).stop 2024-05-08T04:24:49.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.566+0000 7f268088f640 1 -- 172.21.15.104:0/3172300324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2668005bc0 msgr2=0x7f267c14c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:49.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.566+0000 7f268088f640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2668005bc0 0x7f267c14c350 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f266c00c360 tx=0x7f267c15e950 comp rx=0 tx=0).stop 2024-05-08T04:24:49.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.566+0000 7f268088f640 1 -- 172.21.15.104:0/3172300324 shutdown_connections 2024-05-08T04:24:49.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.566+0000 7f268088f640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f265c06b680 0x7f265c06db40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:49.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.566+0000 7f268088f640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f267c14be20 0x7f267c14b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:49.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.566+0000 7f268088f640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f267c14dd00 0x7f267c157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:49.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.566+0000 7f268088f640 1 --2- 172.21.15.104:0/3172300324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2668005bc0 0x7f267c14c350 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:49.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.566+0000 7f268088f640 1 -- 172.21.15.104:0/3172300324 >> 172.21.15.104:0/3172300324 conn(0x7f267c0b13f0 msgr2=0x7f267c158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:49.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.566+0000 7f268088f640 1 -- 172.21.15.104:0/3172300324 shutdown_connections 2024-05-08T04:24:49.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:49.566+0000 7f268088f640 1 -- 172.21.15.104:0/3172300324 wait complete. 2024-05-08T04:24:49.579 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T04:24:49.580 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T04:24:49.580 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2024-05-08T04:24:49.580 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-08T04:24:49.580 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T04:24:49.580 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T04:24:49.580 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T04:24:49.580 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T04:24:49.580 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-08T04:24:49.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:49.580 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2024-05-08T04:24:49.600 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T04:24:49.600 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T04:24:49.600 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T04:24:49.600 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42535sec preferred_lft 42535sec 2024-05-08T04:24:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2024-05-08T04:24:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:49.602 INFO:teuthology.orchestra.run.smithi183.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T04:24:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 8a:51:89:24:45:ec brd ff:ff:ff:ff:ff:ff 2024-05-08T04:24:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T04:24:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::b018:2eff:fef9:2486/64 scope link 2024-05-08T04:24:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:49.602 INFO:teuthology.orchestra.run.smithi183.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:24:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 8a:51:89:24:45:ec brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:24:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::8851:89ff:fe24:45ec/64 scope link 2024-05-08T04:24:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:49.602 INFO:teuthology.orchestra.run.smithi183.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T04:24:49.603 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether f6:96:c9:db:32:7c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:24:49.603 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::f496:c9ff:fedb:327c/64 scope link 2024-05-08T04:24:49.603 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2024-05-08T04:24:49.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:49.603 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T04:24:49.669 INFO:teuthology.orchestra.run.smithi183.stdout:1 2024-05-08T04:24:49.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:49.671 DEBUG:teuthology.orchestra.run.smithi183:> route 2024-05-08T04:24:49.730 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2024-05-08T04:24:49.730 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T04:24:49.730 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T04:24:49.730 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T04:24:49.730 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T04:24:49.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:49.731 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2024-05-08T04:24:49.731 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2024-05-08T04:24:49.731 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T04:24:49.731 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T04:24:49.731 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T04:24:49.731 DEBUG:teuthology.orchestra.run.smithi183:> ') 2024-05-08T04:24:49.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:49.822 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2024-05-08T04:24:49.838 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-08T04:24:49.838 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-08T04:24:49.839 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-08T04:24:49.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:49.839 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2024-05-08T04:24:49.905 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-05-08T04:24:49.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:24:49.905 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-08T04:24:49.962 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-08T04:24:49.963 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T04:24:49.963 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-08T04:24:50.019 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2024-05-08T04:24:50.085 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:24:50.143 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2024-05-08T04:24:50.143 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2024-05-08T04:24:50.143 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2024-05-08T04:24:50.143 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2024-05-08T04:24:50.143 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2024-05-08T04:24:50.143 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2024-05-08T04:24:50.143 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2024-05-08T04:24:50.143 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2024-05-08T04:24:50.143 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2024-05-08T04:24:50.143 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/bpf 2024-05-08T04:24:50.143 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2024-05-08T04:24:50.143 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2024-05-08T04:24:50.144 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:24:50.144 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2024-05-08T04:24:50.144 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2024-05-08T04:24:50.144 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2024-05-08T04:24:50.144 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2024-05-08T04:24:50.144 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2024-05-08T04:24:50.144 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2024-05-08T04:24:50.144 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:24:50.145 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:24:50.145 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:24:50.145 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:24:50.145 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2024-05-08T04:24:50.145 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2024-05-08T04:24:50.145 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2024-05-08T04:24:50.145 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2024-05-08T04:24:50.146 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2024-05-08T04:24:50.146 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2024-05-08T04:24:50.146 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2024-05-08T04:24:50.146 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:24:50.146 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:24:50.150 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:24:50.151 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:24:50.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:50.151 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2024-05-08T04:24:50.198 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T04:24:50.198 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-05-08T04:24:50.240 DEBUG:teuthology.orchestra.run.smithi183:> sudo modprobe fuse 2024-05-08T04:24:50.264 DEBUG:teuthology.orchestra.run.smithi183:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T04:24:50.321 INFO:teuthology.orchestra.run.smithi183.stdout:/proc 2024-05-08T04:24:50.321 INFO:teuthology.orchestra.run.smithi183.stdout:/sys 2024-05-08T04:24:50.321 INFO:teuthology.orchestra.run.smithi183.stdout:/dev 2024-05-08T04:24:50.321 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/security 2024-05-08T04:24:50.321 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/shm 2024-05-08T04:24:50.321 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/pts 2024-05-08T04:24:50.322 INFO:teuthology.orchestra.run.smithi183.stdout:/run 2024-05-08T04:24:50.322 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/cgroup 2024-05-08T04:24:50.322 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/pstore 2024-05-08T04:24:50.322 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/bpf 2024-05-08T04:24:50.322 INFO:teuthology.orchestra.run.smithi183.stdout:/ 2024-05-08T04:24:50.322 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/selinux 2024-05-08T04:24:50.322 INFO:teuthology.orchestra.run.smithi183.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T04:24:50.322 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/hugepages 2024-05-08T04:24:50.322 INFO:teuthology.orchestra.run.smithi183.stdout:/dev/mqueue 2024-05-08T04:24:50.322 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/debug 2024-05-08T04:24:50.322 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/tracing 2024-05-08T04:24:50.322 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/fs/fuse/connections 2024-05-08T04:24:50.322 INFO:teuthology.orchestra.run.smithi183.stdout:/sys/kernel/config 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/run/user/1000 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-4 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-5 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-6 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/var/lib/ceph/osd/ceph-7 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:24:50.323 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:24:50.324 INFO:teuthology.orchestra.run.smithi183.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:24:50.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:50.324 DEBUG:teuthology.orchestra.run.smithi183:> ls /sys/fs/fuse/connections 2024-05-08T04:24:50.325 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:2024-05-08T04:24:50.320+0000 7fb2a2c93480 -1 init, newargv = 0x5631624ce720 newargc=15 2024-05-08T04:24:50.325 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[44236]: starting ceph client 2024-05-08T04:24:50.325 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[44236]: starting fuse 2024-05-08T04:24:50.340 INFO:teuthology.orchestra.run.smithi183.stdout:42 2024-05-08T04:24:50.340 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-08T04:24:50.340 DEBUG:teuthology.orchestra.run.smithi183:> sudo stdin-killer -- python3 -c ' 2024-05-08T04:24:50.340 DEBUG:teuthology.orchestra.run.smithi183:> import glob 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> import re 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> import os 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> import subprocess 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> def _find_admin_socket(client_name): 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> files = glob.glob(asok_path) 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> # Given a non-glob path, it better be there 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> if "*" not in asok_path: 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> assert(len(files) == 1) 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> return files[0] 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> for f in files: 2024-05-08T04:24:50.341 DEBUG:teuthology.orchestra.run.smithi183:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T04:24:50.342 DEBUG:teuthology.orchestra.run.smithi183:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T04:24:50.342 DEBUG:teuthology.orchestra.run.smithi183:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T04:24:50.342 DEBUG:teuthology.orchestra.run.smithi183:> contents = proc_f.read() 2024-05-08T04:24:50.342 DEBUG:teuthology.orchestra.run.smithi183:> if mountpoint in contents: 2024-05-08T04:24:50.342 DEBUG:teuthology.orchestra.run.smithi183:> return f 2024-05-08T04:24:50.342 DEBUG:teuthology.orchestra.run.smithi183:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T04:24:50.342 DEBUG:teuthology.orchestra.run.smithi183:> 2024-05-08T04:24:50.342 DEBUG:teuthology.orchestra.run.smithi183:> print(_find_admin_socket("client.1")) 2024-05-08T04:24:50.342 DEBUG:teuthology.orchestra.run.smithi183:> ' 2024-05-08T04:24:50.459 INFO:teuthology.orchestra.run.smithi183.stdout:/var/run/ceph/ceph-client.1.44236.asok 2024-05-08T04:24:50.462 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T04:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T04:24:50.469 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44236.asok 2024-05-08T04:24:50.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:50.469 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44236.asok status 2024-05-08T04:24:50.605 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-05-08T04:24:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: "metadata": { 2024-05-08T04:24:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_sha1": "4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20", 2024-05-08T04:24:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_version": "ceph version 19.0.0-1629-g4f7075d1 (4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20) squid (dev)", 2024-05-08T04:24:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "entity_id": "1", 2024-05-08T04:24:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "hostname": "smithi183", 2024-05-08T04:24:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-08T04:24:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "pid": "44236", 2024-05-08T04:24:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "root": "/" 2024-05-08T04:24:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:24:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_count": 0, 2024-05-08T04:24:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "dentry_pinned_count": 0, 2024-05-08T04:24:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "id": 5426, 2024-05-08T04:24:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "inst": { 2024-05-08T04:24:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "name": { 2024-05-08T04:24:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "client", 2024-05-08T04:24:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "num": 5426 2024-05-08T04:24:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:24:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-05-08T04:24:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-05-08T04:24:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:24:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 497739514 2024-05-08T04:24:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-05-08T04:24:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": { 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "type": "v1", 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "addr": "192.168.0.1:0", 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "nonce": 497739514 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "inst_str": "client.5426 192.168.0.1:0/497739514", 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "addr_str": "192.168.0.1:0/497739514", 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "inode_count": 1, 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_epoch": 28, 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch": 59, 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_epoch_barrier": 0, 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "blocklisted": false, 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "fs_name": "cephfs" 2024-05-08T04:24:50.608 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-05-08T04:24:50.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:50.613 DEBUG:teuthology.orchestra.run.smithi183:> stat --file-system '--printf=%T 2024-05-08T04:24:50.614 DEBUG:teuthology.orchestra.run.smithi183:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-08T04:24:50.630 INFO:teuthology.orchestra.run.smithi183.stdout:fuseblk 2024-05-08T04:24:50.630 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-08T04:24:50.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:50.631 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-08T04:24:50.696 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-08T04:24:50.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.809+0000 7f8df8134640 1 Processor -- start 2024-05-08T04:24:50.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.810+0000 7f8df8134640 1 -- start start 2024-05-08T04:24:50.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df8134640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df015de10 0x7f8df0161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:50.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df8134640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8df00d07c0 0x7f8df00d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:50.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df8134640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df015e1f0 con 0x7f8df00ce5a0 2024-05-08T04:24:50.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df8134640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df00d0f50 con 0x7f8df00d07c0 2024-05-08T04:24:50.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df8134640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0161e60 con 0x7f8df015de10 2024-05-08T04:24:50.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df66d1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8df00d07c0 0x7f8df00d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:50.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df56cf640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f8df00ce5a0 0x7f8df00d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54478/0 (socket says 172.21.15.104:54478) 2024-05-08T04:24:50.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df56cf640 1 -- 172.21.15.104:0/3641552170 learned_addr learned my addr 172.21.15.104:0/3641552170 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:50.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df5ed0640 1 --2- 172.21.15.104:0/3641552170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df015de10 0x7f8df0161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:50.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df4ece640 1 -- 172.21.15.104:0/3641552170 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243377155 0 0) 0x7f8df015e1f0 con 0x7f8df00ce5a0 2024-05-08T04:24:50.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df4ece640 1 -- 172.21.15.104:0/3641552170 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ddc003520 con 0x7f8df00ce5a0 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df66d1640 1 -- 172.21.15.104:0/3641552170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df015de10 msgr2=0x7f8df0161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df66d1640 1 --2- 172.21.15.104:0/3641552170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df015de10 0x7f8df0161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df66d1640 1 -- 172.21.15.104:0/3641552170 >> v1:172.21.15.104:6789/0 conn(0x7f8df00ce5a0 legacy=0x7f8df00d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.811+0000 7f8df66d1640 1 -- 172.21.15.104:0/3641552170 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df0162090 con 0x7f8df00d07c0 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.812+0000 7f8df66d1640 1 --2- 172.21.15.104:0/3641552170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8df00d07c0 0x7f8df00d2200 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009d90 tx=0x7f8de802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477fcfa6123547ec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.812+0000 7f8df4ece640 1 -- 172.21.15.104:0/3641552170 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de8031600 con 0x7f8df00d07c0 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.812+0000 7f8df4ece640 1 -- 172.21.15.104:0/3641552170 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de80317a0 con 0x7f8df00d07c0 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.812+0000 7f8df4ece640 1 -- 172.21.15.104:0/3641552170 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de8031b70 con 0x7f8df00d07c0 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.812+0000 7f8df8134640 1 -- 172.21.15.104:0/3641552170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8df00d07c0 msgr2=0x7f8df00d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.812+0000 7f8df8134640 1 --2- 172.21.15.104:0/3641552170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8df00d07c0 0x7f8df00d2200 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009d90 tx=0x7f8de802a5d0 comp rx=0 tx=0).stop 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.813+0000 7f8df8134640 1 -- 172.21.15.104:0/3641552170 shutdown_connections 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.813+0000 7f8df8134640 1 --2- 172.21.15.104:0/3641552170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8df00d07c0 0x7f8df00d2200 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.813+0000 7f8df8134640 1 --2- 172.21.15.104:0/3641552170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df015de10 0x7f8df0161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:50.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.813+0000 7f8df8134640 1 -- 172.21.15.104:0/3641552170 >> 172.21.15.104:0/3641552170 conn(0x7f8df0072290 msgr2=0x7f8df0072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:50.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.813+0000 7f8df8134640 1 -- 172.21.15.104:0/3641552170 shutdown_connections 2024-05-08T04:24:50.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.813+0000 7f8df8134640 1 -- 172.21.15.104:0/3641552170 wait complete. 2024-05-08T04:24:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.814+0000 7f8df8134640 1 Processor -- start 2024-05-08T04:24:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.814+0000 7f8df8134640 1 -- start start 2024-05-08T04:24:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.814+0000 7f8df8134640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8df00ce5a0 0x7f8df0146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.814+0000 7f8df8134640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df00d07c0 0x7f8df015b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.814+0000 7f8df8134640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8df015de10 0x7f8df015b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.814+0000 7f8df8134640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0162650 con 0x7f8df015de10 2024-05-08T04:24:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.814+0000 7f8df8134640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00d1a90 con 0x7f8df00ce5a0 2024-05-08T04:24:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.814+0000 7f8df8134640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df00d1ce0 con 0x7f8df00d07c0 2024-05-08T04:24:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8df66d1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8df015de10 0x7f8df015b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8df66d1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8df015de10 0x7f8df015b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39182/0 (socket says 172.21.15.104:39182) 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8df66d1640 1 -- 172.21.15.104:0/3560591962 learned_addr learned my addr 172.21.15.104:0/3560591962 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8df5ed0640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8df00ce5a0 0x7f8df0146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8df66d1640 1 -- 172.21.15.104:0/3560591962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df00d07c0 msgr2=0x7f8df015b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8df66d1640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df00d07c0 0x7f8df015b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8df66d1640 1 -- 172.21.15.104:0/3560591962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8df00ce5a0 msgr2=0x7f8df0146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8df66d1640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8df00ce5a0 0x7f8df0146570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8df66d1640 1 -- 172.21.15.104:0/3560591962 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df01f40d0 con 0x7f8df015de10 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8df5ed0640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8df00ce5a0 0x7f8df0146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8df66d1640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8df015de10 0x7f8df015b940 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009eb0 tx=0x7f8de8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8de67fc640 1 -- 172.21.15.104:0/3560591962 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de8040070 con 0x7f8df015de10 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8de67fc640 1 -- 172.21.15.104:0/3560591962 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de8030b60 con 0x7f8df015de10 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8df8134640 1 -- 172.21.15.104:0/3560591962 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df01f43b0 con 0x7f8df015de10 2024-05-08T04:24:50.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8de67fc640 1 -- 172.21.15.104:0/3560591962 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de8009450 con 0x7f8df015de10 2024-05-08T04:24:50.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.815+0000 7f8df8134640 1 -- 172.21.15.104:0/3560591962 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df0146050 con 0x7f8df015de10 2024-05-08T04:24:50.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.816+0000 7f8df8134640 1 -- 172.21.15.104:0/3560591962 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df0075010 con 0x7f8df015de10 2024-05-08T04:24:50.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.817+0000 7f8de67fc640 1 -- 172.21.15.104:0/3560591962 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f8de8039040 con 0x7f8df015de10 2024-05-08T04:24:50.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.817+0000 7f8de67fc640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8dd406b680 0x7f8dd406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:50.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.817+0000 7f8df5ed0640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8dd406b680 0x7f8dd406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:50.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.817+0000 7f8de67fc640 1 -- 172.21.15.104:0/3560591962 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8de80abc40 con 0x7f8df015de10 2024-05-08T04:24:50.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.818+0000 7f8df5ed0640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8dd406b680 0x7f8dd406db40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8de0006fd0 tx=0x7f8de0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:50.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:50.822+0000 7f8de67fc640 1 -- 172.21.15.104:0/3560591962 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8de807a7c0 con 0x7f8df015de10 2024-05-08T04:24:51.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.032+0000 7f8df8134640 1 -- 172.21.15.104:0/3560591962 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8df00d1870 con 0x7f8df015de10 2024-05-08T04:24:51.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.779+0000 7f8de67fc640 1 -- 172.21.15.104:0/3560591962 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 136+0+0 (secure 0 0 0) 0x7f8de807a0c0 con 0x7f8df015de10 2024-05-08T04:24:51.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.782+0000 7f8df8134640 1 -- 172.21.15.104:0/3560591962 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8dd406b680 msgr2=0x7f8dd406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:51.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.782+0000 7f8df8134640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8dd406b680 0x7f8dd406db40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8de0006fd0 tx=0x7f8de0008040 comp rx=0 tx=0).stop 2024-05-08T04:24:51.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.782+0000 7f8df8134640 1 -- 172.21.15.104:0/3560591962 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8df015de10 msgr2=0x7f8df015b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:51.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.782+0000 7f8df8134640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8df015de10 0x7f8df015b940 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009eb0 tx=0x7f8de8004a40 comp rx=0 tx=0).stop 2024-05-08T04:24:51.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.782+0000 7f8df8134640 1 -- 172.21.15.104:0/3560591962 shutdown_connections 2024-05-08T04:24:51.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.782+0000 7f8df8134640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8dd406b680 0x7f8dd406db40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:51.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.782+0000 7f8df8134640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8df015de10 0x7f8df015b940 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:51.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.782+0000 7f8df8134640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8df00d07c0 0x7f8df015b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:51.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.782+0000 7f8df8134640 1 --2- 172.21.15.104:0/3560591962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8df00ce5a0 0x7f8df0146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:51.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.782+0000 7f8df8134640 1 -- 172.21.15.104:0/3560591962 >> 172.21.15.104:0/3560591962 conn(0x7f8df0072290 msgr2=0x7f8df00d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:51.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.782+0000 7f8df8134640 1 -- 172.21.15.104:0/3560591962 shutdown_connections 2024-05-08T04:24:51.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.782+0000 7f8df8134640 1 -- 172.21.15.104:0/3560591962 wait complete. 2024-05-08T04:24:51.800 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-08T04:24:51.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.904+0000 7f8d17913640 1 Processor -- start 2024-05-08T04:24:51.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.904+0000 7f8d17913640 1 -- start start 2024-05-08T04:24:51.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d17913640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8d1015bac0 0x7f8d100b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:51.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d17913640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8d100b51b0 0x7f8d1006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:51.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d17913640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d100b1e30 con 0x7f8d1006ab60 2024-05-08T04:24:51.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d17913640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d100b1c00 con 0x7f8d1015bac0 2024-05-08T04:24:51.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d17913640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1006b500 con 0x7f8d100b51b0 2024-05-08T04:24:51.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d156af640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f8d1015bac0 0x7f8d100b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:51.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d14eae640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f8d1006ab60 0x7f8d100cc3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54488/0 (socket says 172.21.15.104:54488) 2024-05-08T04:24:51.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d14eae640 1 -- 172.21.15.104:0/3067676517 learned_addr learned my addr 172.21.15.104:0/3067676517 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:51.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d156af640 1 -- 172.21.15.104:0/3067676517 >> v2:172.21.15.183:3300/0 conn(0x7f8d100b51b0 msgr2=0x7f8d1006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:51.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d15eb0640 1 --2- 172.21.15.104:0/3067676517 >> v2:172.21.15.183:3300/0 conn(0x7f8d100b51b0 0x7f8d1006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d07fff640 1 -- 172.21.15.104:0/3067676517 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968879972 0 0) 0x7f8d100b1e30 con 0x7f8d1006ab60 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d156af640 1 --2- 172.21.15.104:0/3067676517 >> v2:172.21.15.183:3300/0 conn(0x7f8d100b51b0 0x7f8d1006afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d156af640 1 -- 172.21.15.104:0/3067676517 >> v1:172.21.15.104:6789/0 conn(0x7f8d1006ab60 legacy=0x7f8d100cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d156af640 1 -- 172.21.15.104:0/3067676517 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d100b36c0 con 0x7f8d1015bac0 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.905+0000 7f8d15eb0640 1 --2- 172.21.15.104:0/3067676517 >> v2:172.21.15.183:3300/0 conn(0x7f8d100b51b0 0x7f8d1006afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.906+0000 7f8d156af640 1 --2- 172.21.15.104:0/3067676517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1015bac0 0x7f8d100b16c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8d100c3bc0 tx=0x7f8d0c02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d8628228f5fed5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.906+0000 7f8d07fff640 1 -- 172.21.15.104:0/3067676517 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c037070 con 0x7f8d1015bac0 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.906+0000 7f8d07fff640 1 -- 172.21.15.104:0/3067676517 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c02add0 con 0x7f8d1015bac0 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.906+0000 7f8d07fff640 1 -- 172.21.15.104:0/3067676517 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c032660 con 0x7f8d1015bac0 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.907+0000 7f8d17913640 1 -- 172.21.15.104:0/3067676517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1015bac0 msgr2=0x7f8d100b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.907+0000 7f8d17913640 1 --2- 172.21.15.104:0/3067676517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1015bac0 0x7f8d100b16c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8d100c3bc0 tx=0x7f8d0c02a080 comp rx=0 tx=0).stop 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.907+0000 7f8d17913640 1 -- 172.21.15.104:0/3067676517 shutdown_connections 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.907+0000 7f8d17913640 1 --2- 172.21.15.104:0/3067676517 >> v2:172.21.15.183:3300/0 conn(0x7f8d100b51b0 0x7f8d1006afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:51.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.907+0000 7f8d17913640 1 --2- 172.21.15.104:0/3067676517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1015bac0 0x7f8d100b16c0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:51.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.907+0000 7f8d17913640 1 -- 172.21.15.104:0/3067676517 >> 172.21.15.104:0/3067676517 conn(0x7f8d100b2220 msgr2=0x7f8d100b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:51.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.907+0000 7f8d17913640 1 -- 172.21.15.104:0/3067676517 shutdown_connections 2024-05-08T04:24:51.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.907+0000 7f8d17913640 1 -- 172.21.15.104:0/3067676517 wait complete. 2024-05-08T04:24:51.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.908+0000 7f8d17913640 1 Processor -- start 2024-05-08T04:24:51.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.908+0000 7f8d17913640 1 -- start start 2024-05-08T04:24:51.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d17913640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1006ab60 0x7f8d101506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:51.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d17913640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d100b51b0 0x7f8d1015d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:51.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d17913640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d1015bac0 0x7f8d10159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:51.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d17913640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d100c3f00 con 0x7f8d1006ab60 2024-05-08T04:24:51.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d17913640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d100b3d10 con 0x7f8d1015bac0 2024-05-08T04:24:51.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d17913640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1015bea0 con 0x7f8d100b51b0 2024-05-08T04:24:51.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d156af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1006ab60 0x7f8d101506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:51.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d156af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1006ab60 0x7f8d101506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39210/0 (socket says 172.21.15.104:39210) 2024-05-08T04:24:51.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d156af640 1 -- 172.21.15.104:0/3616024218 learned_addr learned my addr 172.21.15.104:0/3616024218 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:51.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d156af640 1 -- 172.21.15.104:0/3616024218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d100b51b0 msgr2=0x7f8d1015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:51.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d156af640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d100b51b0 0x7f8d1015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:51.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d156af640 1 -- 172.21.15.104:0/3616024218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d1015bac0 msgr2=0x7f8d10159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:51.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d15eb0640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d1015bac0 0x7f8d10159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:51.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d156af640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d1015bac0 0x7f8d10159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:51.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d156af640 1 -- 172.21.15.104:0/3616024218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1015e390 con 0x7f8d1006ab60 2024-05-08T04:24:51.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d15eb0640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d1015bac0 0x7f8d10159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:51.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d156af640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1006ab60 0x7f8d101506e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c035040 tx=0x7f8d0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:51.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d05ffb640 1 -- 172.21.15.104:0/3616024218 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c037040 con 0x7f8d1006ab60 2024-05-08T04:24:51.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d05ffb640 1 -- 172.21.15.104:0/3616024218 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c03b430 con 0x7f8d1006ab60 2024-05-08T04:24:51.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d05ffb640 1 -- 172.21.15.104:0/3616024218 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c03b820 con 0x7f8d1006ab60 2024-05-08T04:24:51.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.909+0000 7f8d17913640 1 -- 172.21.15.104:0/3616024218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d10153550 con 0x7f8d1006ab60 2024-05-08T04:24:51.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.910+0000 7f8d17913640 1 -- 172.21.15.104:0/3616024218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d10153b10 con 0x7f8d1006ab60 2024-05-08T04:24:51.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.911+0000 7f8d17913640 1 -- 172.21.15.104:0/3616024218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d10075010 con 0x7f8d1006ab60 2024-05-08T04:24:51.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.911+0000 7f8d05ffb640 1 -- 172.21.15.104:0/3616024218 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f8d0c044020 con 0x7f8d1006ab60 2024-05-08T04:24:51.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.912+0000 7f8d05ffb640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8cf406b680 0x7f8cf406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:51.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.912+0000 7f8d05ffb640 1 -- 172.21.15.104:0/3616024218 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8d0c0aa590 con 0x7f8d1006ab60 2024-05-08T04:24:51.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.912+0000 7f8d14eae640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8cf406b680 0x7f8cf406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:51.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.912+0000 7f8d14eae640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8cf406b680 0x7f8cf406db40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8d00007fd0 tx=0x7f8d00007960 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:51.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:51.916+0000 7f8d05ffb640 1 -- 172.21.15.104:0/3616024218 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d0c0791e0 con 0x7f8d1006ab60 2024-05-08T04:24:52.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.106+0000 7f8d17913640 1 -- 172.21.15.104:0/3616024218 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d100b2980 con 0x7f8cf406b680 2024-05-08T04:24:52.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.107+0000 7f8d05ffb640 1 -- 172.21.15.104:0/3616024218 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f8d100b2980 con 0x7f8cf406b680 2024-05-08T04:24:52.109 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-05-08T04:24:52.109 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-05-08T04:24:52.109 INFO:teuthology.orchestra.run.smithi104.stdout: "name": "cephfs" 2024-05-08T04:24:52.109 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-05-08T04:24:52.109 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-05-08T04:24:52.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.109+0000 7f8d17913640 1 -- 172.21.15.104:0/3616024218 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8cf406b680 msgr2=0x7f8cf406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.109+0000 7f8d17913640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8cf406b680 0x7f8cf406db40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8d00007fd0 tx=0x7f8d00007960 comp rx=0 tx=0).stop 2024-05-08T04:24:52.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.109+0000 7f8d17913640 1 -- 172.21.15.104:0/3616024218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1006ab60 msgr2=0x7f8d101506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.109+0000 7f8d17913640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1006ab60 0x7f8d101506e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c035040 tx=0x7f8d0c0046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.109+0000 7f8d17913640 1 -- 172.21.15.104:0/3616024218 shutdown_connections 2024-05-08T04:24:52.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.109+0000 7f8d17913640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f8cf406b680 0x7f8cf406db40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.109+0000 7f8d17913640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d1015bac0 0x7f8d10159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.109+0000 7f8d17913640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d100b51b0 0x7f8d1015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.109+0000 7f8d17913640 1 --2- 172.21.15.104:0/3616024218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8d1006ab60 0x7f8d101506e0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.109+0000 7f8d17913640 1 -- 172.21.15.104:0/3616024218 >> 172.21.15.104:0/3616024218 conn(0x7f8d100b2220 msgr2=0x7f8d1006f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:52.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.109+0000 7f8d17913640 1 -- 172.21.15.104:0/3616024218 shutdown_connections 2024-05-08T04:24:52.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.109+0000 7f8d17913640 1 -- 172.21.15.104:0/3616024218 wait complete. 2024-05-08T04:24:52.122 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-08T04:24:52.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.222+0000 7f10997b0640 1 Processor -- start 2024-05-08T04:24:52.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.222+0000 7f10997b0640 1 -- start start 2024-05-08T04:24:52.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.223+0000 7f10997b0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f10940ce5a0 0x7f1094161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.223+0000 7f10997b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10940d07c0 0x7f10940d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.223+0000 7f10997b0640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109415e1f0 con 0x7f109415de10 2024-05-08T04:24:52.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.223+0000 7f10997b0640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10940d0f50 con 0x7f10940ce5a0 2024-05-08T04:24:52.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.223+0000 7f10997b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1094161e60 con 0x7f10940d07c0 2024-05-08T04:24:52.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.223+0000 7f108a7fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f10940ce5a0 0x7f1094161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.223+0000 7f1092ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f109415de10 0x7f10940d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54490/0 (socket says 172.21.15.104:54490) 2024-05-08T04:24:52.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.223+0000 7f1092ffd640 1 -- 172.21.15.104:0/2239758431 learned_addr learned my addr 172.21.15.104:0/2239758431 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:52.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.223+0000 7f108a7fc640 1 -- 172.21.15.104:0/2239758431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10940d07c0 msgr2=0x7f10940d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:52.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.223+0000 7f108a7fc640 1 --2- 172.21.15.104:0/2239758431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10940d07c0 0x7f10940d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.223+0000 7f108a7fc640 1 -- 172.21.15.104:0/2239758431 >> v1:172.21.15.104:6789/0 conn(0x7f109415de10 legacy=0x7f10940d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.223+0000 7f108a7fc640 1 -- 172.21.15.104:0/2239758431 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1094162090 con 0x7f10940ce5a0 2024-05-08T04:24:52.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.223+0000 7f10927fc640 1 -- 172.21.15.104:0/2239758431 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310138621 0 0) 0x7f109415e1f0 con 0x7f109415de10 2024-05-08T04:24:52.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.224+0000 7f108a7fc640 1 --2- 172.21.15.104:0/2239758431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10940ce5a0 0x7f1094161920 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f107c0097a0 tx=0x7f107c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3670bd216f5a03 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:52.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.224+0000 7f10927fc640 1 -- 172.21.15.104:0/2239758431 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c037070 con 0x7f10940ce5a0 2024-05-08T04:24:52.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.224+0000 7f10927fc640 1 -- 172.21.15.104:0/2239758431 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c02ae50 con 0x7f10940ce5a0 2024-05-08T04:24:52.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.224+0000 7f10927fc640 1 -- 172.21.15.104:0/2239758431 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c032660 con 0x7f10940ce5a0 2024-05-08T04:24:52.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.225+0000 7f10997b0640 1 -- 172.21.15.104:0/2239758431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10940ce5a0 msgr2=0x7f1094161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.225+0000 7f10997b0640 1 --2- 172.21.15.104:0/2239758431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10940ce5a0 0x7f1094161920 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f107c0097a0 tx=0x7f107c02a100 comp rx=0 tx=0).stop 2024-05-08T04:24:52.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.225+0000 7f10997b0640 1 -- 172.21.15.104:0/2239758431 shutdown_connections 2024-05-08T04:24:52.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.225+0000 7f10997b0640 1 --2- 172.21.15.104:0/2239758431 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10940d07c0 0x7f10940d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.225+0000 7f10997b0640 1 --2- 172.21.15.104:0/2239758431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10940ce5a0 0x7f1094161920 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.225+0000 7f10997b0640 1 -- 172.21.15.104:0/2239758431 >> 172.21.15.104:0/2239758431 conn(0x7f1094072290 msgr2=0x7f1094072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:52.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.225+0000 7f10997b0640 1 -- 172.21.15.104:0/2239758431 shutdown_connections 2024-05-08T04:24:52.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.225+0000 7f10997b0640 1 -- 172.21.15.104:0/2239758431 wait complete. 2024-05-08T04:24:52.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.226+0000 7f10997b0640 1 Processor -- start 2024-05-08T04:24:52.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.226+0000 7f10997b0640 1 -- start start 2024-05-08T04:24:52.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f10997b0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10940ce5a0 0x7f10941f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f10997b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10940d07c0 0x7f10940b7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f10997b0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f109415de10 0x7f10940b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f10997b0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1094162650 con 0x7f10940d07c0 2024-05-08T04:24:52.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f10997b0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10940d1a90 con 0x7f10940ce5a0 2024-05-08T04:24:52.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f10997b0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10940d1ce0 con 0x7f109415de10 2024-05-08T04:24:52.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f108a7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10940d07c0 0x7f10940b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f108a7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10940d07c0 0x7f10940b7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39230/0 (socket says 172.21.15.104:39230) 2024-05-08T04:24:52.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f108a7fc640 1 -- 172.21.15.104:0/53931846 learned_addr learned my addr 172.21.15.104:0/53931846 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:52.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f108a7fc640 1 -- 172.21.15.104:0/53931846 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f109415de10 msgr2=0x7f10940b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f108a7fc640 1 --2- 172.21.15.104:0/53931846 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f109415de10 0x7f10940b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f1092ffd640 1 --2- 172.21.15.104:0/53931846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10940ce5a0 0x7f10941f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f108a7fc640 1 -- 172.21.15.104:0/53931846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10940ce5a0 msgr2=0x7f10941f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f108a7fc640 1 --2- 172.21.15.104:0/53931846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10940ce5a0 0x7f10941f3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f108a7fc640 1 -- 172.21.15.104:0/53931846 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10941f6eb0 con 0x7f10940d07c0 2024-05-08T04:24:52.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.227+0000 7f108a7fc640 1 --2- 172.21.15.104:0/53931846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10940d07c0 0x7f10940b7770 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f107c0097a0 tx=0x7f107c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.228+0000 7f108bfff640 1 -- 172.21.15.104:0/53931846 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c037040 con 0x7f10940d07c0 2024-05-08T04:24:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.228+0000 7f108bfff640 1 -- 172.21.15.104:0/53931846 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c004030 con 0x7f10940d07c0 2024-05-08T04:24:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.228+0000 7f10997b0640 1 -- 172.21.15.104:0/53931846 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10941f7190 con 0x7f10940d07c0 2024-05-08T04:24:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.228+0000 7f108bfff640 1 -- 172.21.15.104:0/53931846 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c006e10 con 0x7f10940d07c0 2024-05-08T04:24:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.228+0000 7f10997b0640 1 -- 172.21.15.104:0/53931846 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10941f7750 con 0x7f10940d07c0 2024-05-08T04:24:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.229+0000 7f10997b0640 1 -- 172.21.15.104:0/53931846 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10940d1870 con 0x7f10940d07c0 2024-05-08T04:24:52.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.229+0000 7f108bfff640 1 -- 172.21.15.104:0/53931846 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f107c03d650 con 0x7f10940d07c0 2024-05-08T04:24:52.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.229+0000 7f108bfff640 1 --2- 172.21.15.104:0/53931846 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f107406b680 0x7f107406db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.230+0000 7f108bfff640 1 -- 172.21.15.104:0/53931846 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f107c0aad80 con 0x7f10940d07c0 2024-05-08T04:24:52.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.230+0000 7f1092ffd640 1 --2- 172.21.15.104:0/53931846 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f107406b680 0x7f107406db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.230+0000 7f1092ffd640 1 --2- 172.21.15.104:0/53931846 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f107406b680 0x7f107406db40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1084000f60 tx=0x7f1084009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:52.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.234+0000 7f108bfff640 1 -- 172.21.15.104:0/53931846 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f107c042020 con 0x7f10940d07c0 2024-05-08T04:24:52.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.405+0000 7f10997b0640 1 -- 172.21.15.104:0/53931846 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1094074ff0 con 0x7f10940d07c0 2024-05-08T04:24:52.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.406+0000 7f108bfff640 1 -- 172.21.15.104:0/53931846 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f107c0799d0 con 0x7f10940d07c0 2024-05-08T04:24:52.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.408+0000 7f10997b0640 1 -- 172.21.15.104:0/53931846 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f107406b680 msgr2=0x7f107406db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.408+0000 7f10997b0640 1 --2- 172.21.15.104:0/53931846 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f107406b680 0x7f107406db40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1084000f60 tx=0x7f1084009040 comp rx=0 tx=0).stop 2024-05-08T04:24:52.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.408+0000 7f10997b0640 1 -- 172.21.15.104:0/53931846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10940d07c0 msgr2=0x7f10940b7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.408+0000 7f10997b0640 1 --2- 172.21.15.104:0/53931846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10940d07c0 0x7f10940b7770 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f107c0097a0 tx=0x7f107c0046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.408+0000 7f10997b0640 1 -- 172.21.15.104:0/53931846 shutdown_connections 2024-05-08T04:24:52.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.408+0000 7f10997b0640 1 --2- 172.21.15.104:0/53931846 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f107406b680 0x7f107406db40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.408+0000 7f10997b0640 1 --2- 172.21.15.104:0/53931846 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f109415de10 0x7f10940b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.408+0000 7f10997b0640 1 --2- 172.21.15.104:0/53931846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10940d07c0 0x7f10940b7770 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.408+0000 7f10997b0640 1 --2- 172.21.15.104:0/53931846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10940ce5a0 0x7f10941f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.408+0000 7f10997b0640 1 -- 172.21.15.104:0/53931846 >> 172.21.15.104:0/53931846 conn(0x7f1094072290 msgr2=0x7f10940cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:52.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.408+0000 7f10997b0640 1 -- 172.21.15.104:0/53931846 shutdown_connections 2024-05-08T04:24:52.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.408+0000 7f10997b0640 1 -- 172.21.15.104:0/53931846 wait complete. 2024-05-08T04:24:52.421 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs subvol_grp9070 2024-05-08T04:24:52.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.522+0000 7fb4ced61640 1 Processor -- start 2024-05-08T04:24:52.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.522+0000 7fb4ced61640 1 -- start start 2024-05-08T04:24:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4ced61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c80ceee0 0x7fb4c80b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4ced61640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c815e780 con 0x7fb4c80b4700 2024-05-08T04:24:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4ced61640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c815ea60 con 0x7fb4c806e330 2024-05-08T04:24:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4ced61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c815f390 con 0x7fb4c80ceee0 2024-05-08T04:24:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4cd2fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fb4c80b4700 0x7fb4c815b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54504/0 (socket says 172.21.15.104:54504) 2024-05-08T04:24:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4cd2fe640 1 -- 172.21.15.104:0/3461275614 learned_addr learned my addr 172.21.15.104:0/3461275614 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578458260 0 0) 0x7fb4c815e780 con 0x7fb4c80b4700 2024-05-08T04:24:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4b8003520 con 0x7fb4c80b4700 2024-05-08T04:24:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4ccafd640 1 --2- 172.21.15.104:0/3461275614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c80ceee0 0x7fb4c80b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 291796441 0 0) 0x7fb4b8003520 con 0x7fb4c80b4700 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c80ceee0 msgr2=0x7fb4c80b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 --2- 172.21.15.104:0/3461275614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c80ceee0 0x7fb4c80b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 >> v1:172.21.15.183:6789/0 conn(0x7fb4c806e330 legacy=0x7fb4c80b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c815ed40 con 0x7fb4c80b4700 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fb4c00019f0 con 0x7fb4c80b4700 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 >> v1:172.21.15.104:6789/0 conn(0x7fb4c80b4700 legacy=0x7fb4c815b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 --2- 172.21.15.104:0/3461275614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c80ceee0 0x7fb4b80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 --2- 172.21.15.104:0/3461275614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4b8004010 0x7fb4b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 --2- 172.21.15.104:0/3461275614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4b8004d40 0x7fb4b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c815f390 con 0x7fb4b8004d40 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b800bb80 con 0x7fb4b8004010 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b800bd80 con 0x7fb4c80ceee0 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4cd2fe640 1 --2- 172.21.15.104:0/3461275614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4b8004d40 0x7fb4b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4ccafd640 1 --2- 172.21.15.104:0/3461275614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c80ceee0 0x7fb4b80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.523+0000 7fb4c7fff640 1 --2- 172.21.15.104:0/3461275614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4b8004010 0x7fb4b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.524+0000 7fb4cd2fe640 1 -- 172.21.15.104:0/3461275614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c80ceee0 msgr2=0x7fb4b80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.524+0000 7fb4cd2fe640 1 --2- 172.21.15.104:0/3461275614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c80ceee0 0x7fb4b80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.524+0000 7fb4cd2fe640 1 -- 172.21.15.104:0/3461275614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4b8004010 msgr2=0x7fb4b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.524+0000 7fb4cd2fe640 1 --2- 172.21.15.104:0/3461275614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4b8004010 0x7fb4b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.524+0000 7fb4cd2fe640 1 -- 172.21.15.104:0/3461275614 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b8003520 con 0x7fb4b8004d40 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.524+0000 7fb4cd2fe640 1 --2- 172.21.15.104:0/3461275614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4b8004d40 0x7fb4b80051c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000a860 tx=0x7fb4b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b89004850e4175 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.524+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c000a480 con 0x7fb4b8004d40 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.525+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c0031070 con 0x7fb4b8004d40 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.525+0000 7fb4c77fe640 1 -- 172.21.15.104:0/3461275614 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0036470 con 0x7fb4b8004d40 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.525+0000 7fb4ced61640 1 -- 172.21.15.104:0/3461275614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4b8004d40 msgr2=0x7fb4b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.525+0000 7fb4ced61640 1 --2- 172.21.15.104:0/3461275614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4b8004d40 0x7fb4b80051c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000a860 tx=0x7fb4b8005830 comp rx=0 tx=0).stop 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.525+0000 7fb4cd2fe640 1 -- 172.21.15.104:0/3461275614 reap_dead start 2024-05-08T04:24:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.525+0000 7fb4ced61640 1 -- 172.21.15.104:0/3461275614 shutdown_connections 2024-05-08T04:24:52.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.525+0000 7fb4ced61640 1 -- 172.21.15.104:0/3461275614 >> 172.21.15.104:0/3461275614 conn(0x7fb4c80b13f0 msgr2=0x7fb4c80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:52.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.525+0000 7fb4ced61640 1 -- 172.21.15.104:0/3461275614 shutdown_connections 2024-05-08T04:24:52.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.525+0000 7fb4ced61640 1 -- 172.21.15.104:0/3461275614 wait complete. 2024-05-08T04:24:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.526+0000 7fb4ced61640 1 Processor -- start 2024-05-08T04:24:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.526+0000 7fb4ced61640 1 -- start start 2024-05-08T04:24:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.527+0000 7fb4ced61640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4b8004d40 0x7fb4c80cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.527+0000 7fb4ced61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c8152010 0x7fb4c8142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.527+0000 7fb4ced61640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4c81587e0 0x7fb4c8158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.527+0000 7fb4ced61640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c80cf440 con 0x7fb4c81587e0 2024-05-08T04:24:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.527+0000 7fb4ced61640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c80cf2c0 con 0x7fb4b8004d40 2024-05-08T04:24:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.527+0000 7fb4ced61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c80b26f0 con 0x7fb4c8152010 2024-05-08T04:24:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.527+0000 7fb4cd2fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4c81587e0 0x7fb4c8158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.527+0000 7fb4cd2fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4c81587e0 0x7fb4c8158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39256/0 (socket says 172.21.15.104:39256) 2024-05-08T04:24:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.527+0000 7fb4cd2fe640 1 -- 172.21.15.104:0/452309280 learned_addr learned my addr 172.21.15.104:0/452309280 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4ccafd640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4b8004d40 0x7fb4c80cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4c7fff640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c8152010 0x7fb4c8142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4cd2fe640 1 -- 172.21.15.104:0/452309280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c8152010 msgr2=0x7fb4c8142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4cd2fe640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c8152010 0x7fb4c8142fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4cd2fe640 1 -- 172.21.15.104:0/452309280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4b8004d40 msgr2=0x7fb4c80cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4cd2fe640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4b8004d40 0x7fb4c80cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4cd2fe640 1 -- 172.21.15.104:0/452309280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c80cb600 con 0x7fb4c81587e0 2024-05-08T04:24:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4ccafd640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4b8004d40 0x7fb4c80cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4cd2fe640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4c81587e0 0x7fb4c8158c60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000a950 tx=0x7fb4c815f300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4c57fa640 1 -- 172.21.15.104:0/452309280 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c000a480 con 0x7fb4c81587e0 2024-05-08T04:24:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4c57fa640 1 -- 172.21.15.104:0/452309280 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c0036670 con 0x7fb4c81587e0 2024-05-08T04:24:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4ced61640 1 -- 172.21.15.104:0/452309280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c8143500 con 0x7fb4c81587e0 2024-05-08T04:24:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4c57fa640 1 -- 172.21.15.104:0/452309280 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0036a40 con 0x7fb4c81587e0 2024-05-08T04:24:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.528+0000 7fb4ced61640 1 -- 172.21.15.104:0/452309280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c8143a60 con 0x7fb4c81587e0 2024-05-08T04:24:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.529+0000 7fb4ced61640 1 -- 172.21.15.104:0/452309280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c8075010 con 0x7fb4c81587e0 2024-05-08T04:24:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.530+0000 7fb4c57fa640 1 -- 172.21.15.104:0/452309280 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7fb4c0040070 con 0x7fb4c81587e0 2024-05-08T04:24:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.530+0000 7fb4c57fa640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb4ac06b680 0x7fb4ac06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.530+0000 7fb4c57fa640 1 -- 172.21.15.104:0/452309280 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb4c00acab0 con 0x7fb4c81587e0 2024-05-08T04:24:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.530+0000 7fb4ccafd640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb4ac06b680 0x7fb4ac06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.530+0000 7fb4ccafd640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb4ac06b680 0x7fb4ac06db40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc006fd0 tx=0x7fb4bc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.534+0000 7fb4c57fa640 1 -- 172.21.15.104:0/452309280 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb4c8143500 con 0x7fb4c81587e0 2024-05-08T04:24:52.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.729+0000 7fb4ced61640 1 -- 172.21.15.104:0/452309280 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "subvol_grp9070", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4c8156740 con 0x7fb4ac06b680 2024-05-08T04:24:52.735 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:24:52.733+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:24:52.735 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:24:52.733+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:24:52.735 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:24:52.733+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:24:52.735 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:24:52.733+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:24:52.735 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:24:52.733+0000 7f27f31d2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T04:24:52.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.748+0000 7fb4c57fa640 1 -- 172.21.15.104:0/452309280 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb4c8156740 con 0x7fb4ac06b680 2024-05-08T04:24:52.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.750+0000 7fb4ced61640 1 -- 172.21.15.104:0/452309280 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb4ac06b680 msgr2=0x7fb4ac06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.750+0000 7fb4ced61640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb4ac06b680 0x7fb4ac06db40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc006fd0 tx=0x7fb4bc008040 comp rx=0 tx=0).stop 2024-05-08T04:24:52.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.750+0000 7fb4ced61640 1 -- 172.21.15.104:0/452309280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4c81587e0 msgr2=0x7fb4c8158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.750+0000 7fb4ced61640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4c81587e0 0x7fb4c8158c60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000a950 tx=0x7fb4c815f300 comp rx=0 tx=0).stop 2024-05-08T04:24:52.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.751+0000 7fb4ced61640 1 -- 172.21.15.104:0/452309280 shutdown_connections 2024-05-08T04:24:52.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.751+0000 7fb4ced61640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fb4ac06b680 0x7fb4ac06db40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.751+0000 7fb4ced61640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4c81587e0 0x7fb4c8158c60 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.751+0000 7fb4ced61640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c8152010 0x7fb4c8142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.751+0000 7fb4ced61640 1 --2- 172.21.15.104:0/452309280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4b8004d40 0x7fb4c80cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.751+0000 7fb4ced61640 1 -- 172.21.15.104:0/452309280 >> 172.21.15.104:0/452309280 conn(0x7fb4c80b13f0 msgr2=0x7fb4c80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.751+0000 7fb4ced61640 1 -- 172.21.15.104:0/452309280 shutdown_connections 2024-05-08T04:24:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.751+0000 7fb4ced61640 1 -- 172.21.15.104:0/452309280 wait complete. 2024-05-08T04:24:52.764 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol91640 --group_name subvol_grp9070 2024-05-08T04:24:52.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.868+0000 7f5931fd5640 1 Processor -- start 2024-05-08T04:24:52.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.868+0000 7f5931fd5640 1 -- start start 2024-05-08T04:24:52.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.869+0000 7f5931fd5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f592c15ba10 0x7f592c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.869+0000 7f5931fd5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f592c0d04f0 0x7f592c0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.869+0000 7f5931fd5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c0cc5d0 con 0x7f592c15ee90 2024-05-08T04:24:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.869+0000 7f5931fd5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c09a340 con 0x7f592c15ba10 2024-05-08T04:24:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.869+0000 7f5931fd5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c09a620 con 0x7f592c0d04f0 2024-05-08T04:24:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.869+0000 7f592b7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f592c15ba10 0x7f592c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.869+0000 7f592b7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f592c15ba10 0x7f592c099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39280/0 (socket says 172.21.15.104:39280) 2024-05-08T04:24:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.869+0000 7f592b7fe640 1 -- 172.21.15.104:0/1949275323 learned_addr learned my addr 172.21.15.104:0/1949275323 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.869+0000 7f592bfff640 1 --2- 172.21.15.104:0/1949275323 >> v2:172.21.15.183:3300/0 conn(0x7f592c0d04f0 0x7f592c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.869+0000 7f592b7fe640 1 -- 172.21.15.104:0/1949275323 >> v2:172.21.15.183:3300/0 conn(0x7f592c0d04f0 msgr2=0x7f592c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.869+0000 7f592b7fe640 1 --2- 172.21.15.104:0/1949275323 >> v2:172.21.15.183:3300/0 conn(0x7f592c0d04f0 0x7f592c0b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.869+0000 7f592b7fe640 1 -- 172.21.15.104:0/1949275323 >> v1:172.21.15.183:6789/0 conn(0x7f592c15ee90 legacy=0x7f592c0cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.869+0000 7f592b7fe640 1 -- 172.21.15.104:0/1949275323 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c09a900 con 0x7f592c15ba10 2024-05-08T04:24:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.870+0000 7f592b7fe640 1 --2- 172.21.15.104:0/1949275323 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c15ba10 0x7f592c099a40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f592c0732a0 tx=0x7f591c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357502cbd441ed1a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:52.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.870+0000 7f592affd640 1 -- 172.21.15.104:0/1949275323 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c004030 con 0x7f592c15ba10 2024-05-08T04:24:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.870+0000 7f592affd640 1 -- 172.21.15.104:0/1949275323 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c0041d0 con 0x7f592c15ba10 2024-05-08T04:24:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.870+0000 7f592affd640 1 -- 172.21.15.104:0/1949275323 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c003610 con 0x7f592c15ba10 2024-05-08T04:24:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.870+0000 7f5931fd5640 1 -- 172.21.15.104:0/1949275323 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c15ba10 msgr2=0x7f592c099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.870+0000 7f5931fd5640 1 --2- 172.21.15.104:0/1949275323 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c15ba10 0x7f592c099a40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f592c0732a0 tx=0x7f591c02a210 comp rx=0 tx=0).stop 2024-05-08T04:24:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.871+0000 7f5931fd5640 1 -- 172.21.15.104:0/1949275323 shutdown_connections 2024-05-08T04:24:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.871+0000 7f5931fd5640 1 --2- 172.21.15.104:0/1949275323 >> v2:172.21.15.183:3300/0 conn(0x7f592c0d04f0 0x7f592c0b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.871+0000 7f5931fd5640 1 --2- 172.21.15.104:0/1949275323 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c15ba10 0x7f592c099a40 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.871+0000 7f5931fd5640 1 -- 172.21.15.104:0/1949275323 >> 172.21.15.104:0/1949275323 conn(0x7f592c0b3280 msgr2=0x7f592c0b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.871+0000 7f5931fd5640 1 -- 172.21.15.104:0/1949275323 shutdown_connections 2024-05-08T04:24:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.871+0000 7f5931fd5640 1 -- 172.21.15.104:0/1949275323 wait complete. 2024-05-08T04:24:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.872+0000 7f5931fd5640 1 Processor -- start 2024-05-08T04:24:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.872+0000 7f5931fd5640 1 -- start start 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.872+0000 7f5931fd5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c0d04f0 0x7f592c156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f5931fd5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f592c15ba10 0x7f592c0b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f5931fd5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f592c15ee90 0x7f592c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f5931fd5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c09a100 con 0x7f592c0d04f0 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f5931fd5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c099f80 con 0x7f592c15ba10 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f5931fd5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c06bc70 con 0x7f592c15ee90 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f592b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c0d04f0 0x7f592c156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f592b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c0d04f0 0x7f592c156830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39286/0 (socket says 172.21.15.104:39286) 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f592b7fe640 1 -- 172.21.15.104:0/366326190 learned_addr learned my addr 172.21.15.104:0/366326190 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f592b7fe640 1 -- 172.21.15.104:0/366326190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f592c15ee90 msgr2=0x7f592c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f592b7fe640 1 --2- 172.21.15.104:0/366326190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f592c15ee90 0x7f592c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f592b7fe640 1 -- 172.21.15.104:0/366326190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f592c15ba10 msgr2=0x7f592c0b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f5923fff640 1 --2- 172.21.15.104:0/366326190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f592c15ba10 0x7f592c0b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f592b7fe640 1 --2- 172.21.15.104:0/366326190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f592c15ba10 0x7f592c0b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f592b7fe640 1 -- 172.21.15.104:0/366326190 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0c9d70 con 0x7f592c0d04f0 2024-05-08T04:24:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f592b7fe640 1 --2- 172.21.15.104:0/366326190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c0d04f0 0x7f592c156830 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f591c000c00 tx=0x7f591c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f5928ff9640 1 -- 172.21.15.104:0/366326190 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c041020 con 0x7f592c0d04f0 2024-05-08T04:24:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f5928ff9640 1 -- 172.21.15.104:0/366326190 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c003c50 con 0x7f592c0d04f0 2024-05-08T04:24:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f5928ff9640 1 -- 172.21.15.104:0/366326190 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c004030 con 0x7f592c0d04f0 2024-05-08T04:24:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f5931fd5640 1 -- 172.21.15.104:0/366326190 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c0ca050 con 0x7f592c0d04f0 2024-05-08T04:24:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.873+0000 7f5931fd5640 1 -- 172.21.15.104:0/366326190 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c0ca610 con 0x7f592c0d04f0 2024-05-08T04:24:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.874+0000 7f5931fd5640 1 -- 172.21.15.104:0/366326190 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c075010 con 0x7f592c0d04f0 2024-05-08T04:24:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.875+0000 7f5928ff9640 1 -- 172.21.15.104:0/366326190 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f591c044020 con 0x7f592c0d04f0 2024-05-08T04:24:52.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.875+0000 7f5928ff9640 1 --2- 172.21.15.104:0/366326190 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f590c06b680 0x7f590c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:52.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.875+0000 7f5928ff9640 1 -- 172.21.15.104:0/366326190 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f591c0ab190 con 0x7f592c0d04f0 2024-05-08T04:24:52.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.875+0000 7f5923fff640 1 --2- 172.21.15.104:0/366326190 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f590c06b680 0x7f590c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:52.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.876+0000 7f5923fff640 1 --2- 172.21.15.104:0/366326190 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f590c06b680 0x7f590c06db40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f592c06c290 tx=0x7f5914009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:52.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:52.879+0000 7f5928ff9640 1 -- 172.21.15.104:0/366326190 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f591c04b030 con 0x7f592c0d04f0 2024-05-08T04:24:53.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.075+0000 7f5931fd5640 1 -- 172.21.15.104:0/366326190 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol91640", "group_name": "subvol_grp9070", "target": ["mon-mgr", ""]}) v1 -- 0x7f592c0cfbc0 con 0x7f590c06b680 2024-05-08T04:24:53.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.099+0000 7f5928ff9640 1 -- 172.21.15.104:0/366326190 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f592c0cfbc0 con 0x7f590c06b680 2024-05-08T04:24:53.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.101+0000 7f5931fd5640 1 -- 172.21.15.104:0/366326190 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f590c06b680 msgr2=0x7f590c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.101+0000 7f5931fd5640 1 --2- 172.21.15.104:0/366326190 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f590c06b680 0x7f590c06db40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f592c06c290 tx=0x7f5914009040 comp rx=0 tx=0).stop 2024-05-08T04:24:53.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.101+0000 7f5931fd5640 1 -- 172.21.15.104:0/366326190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c0d04f0 msgr2=0x7f592c156830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.101+0000 7f5931fd5640 1 --2- 172.21.15.104:0/366326190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c0d04f0 0x7f592c156830 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f591c000c00 tx=0x7f591c0046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.101+0000 7f5931fd5640 1 -- 172.21.15.104:0/366326190 shutdown_connections 2024-05-08T04:24:53.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.101+0000 7f5931fd5640 1 --2- 172.21.15.104:0/366326190 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f590c06b680 0x7f590c06db40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.101+0000 7f5931fd5640 1 --2- 172.21.15.104:0/366326190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f592c15ba10 0x7f592c0b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.101+0000 7f5931fd5640 1 --2- 172.21.15.104:0/366326190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f592c15ee90 0x7f592c0cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.101+0000 7f5931fd5640 1 --2- 172.21.15.104:0/366326190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f592c0d04f0 0x7f592c156830 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.101+0000 7f5931fd5640 1 -- 172.21.15.104:0/366326190 >> 172.21.15.104:0/366326190 conn(0x7f592c0b3280 msgr2=0x7f592c15f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:53.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.101+0000 7f5931fd5640 1 -- 172.21.15.104:0/366326190 shutdown_connections 2024-05-08T04:24:53.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.101+0000 7f5931fd5640 1 -- 172.21.15.104:0/366326190 wait complete. 2024-05-08T04:24:53.114 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot create cephfs subvol_grp9070 subvol_snap54470 2024-05-08T04:24:53.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.218+0000 7f4640fc1640 1 Processor -- start 2024-05-08T04:24:53.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.218+0000 7f4640fc1640 1 -- start start 2024-05-08T04:24:53.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.219+0000 7f4640fc1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f463c070c70 0x7f463c071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.219+0000 7f4640fc1640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f463c157ac0 0x7f463c157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.219+0000 7f4640fc1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463c071590 con 0x7f463c15edf0 2024-05-08T04:24:53.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.219+0000 7f4640fc1640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463c06bc70 con 0x7f463c157ac0 2024-05-08T04:24:53.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.219+0000 7f4640fc1640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463c0d15c0 con 0x7f463c070c70 2024-05-08T04:24:53.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.219+0000 7f463ad9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f463c157ac0 0x7f463c157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.219+0000 7f463ad9d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f463c157ac0 0x7f463c157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39294/0 (socket says 172.21.15.104:39294) 2024-05-08T04:24:53.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.219+0000 7f463ad9d640 1 -- 172.21.15.104:0/3488087830 learned_addr learned my addr 172.21.15.104:0/3488087830 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:53.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.220+0000 7f463a59c640 1 --2- 172.21.15.104:0/3488087830 >> v2:172.21.15.183:3300/0 conn(0x7f463c070c70 0x7f463c071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.220+0000 7f463ad9d640 1 -- 172.21.15.104:0/3488087830 >> v2:172.21.15.183:3300/0 conn(0x7f463c070c70 msgr2=0x7f463c071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:53.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.220+0000 7f463ad9d640 1 --2- 172.21.15.104:0/3488087830 >> v2:172.21.15.183:3300/0 conn(0x7f463c070c70 0x7f463c071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.220+0000 7f463ad9d640 1 -- 172.21.15.104:0/3488087830 >> v1:172.21.15.183:6789/0 conn(0x7f463c15edf0 legacy=0x7f463c0b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:53.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.220+0000 7f463ad9d640 1 -- 172.21.15.104:0/3488087830 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c15f550 con 0x7f463c157ac0 2024-05-08T04:24:53.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.220+0000 7f463ad9d640 1 --2- 172.21.15.104:0/3488087830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f463c157ac0 0x7f463c157f10 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f463c071f80 tx=0x7f463402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92141fc506155f54 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:53.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.220+0000 7f463959a640 1 -- 172.21.15.104:0/3488087830 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634036070 con 0x7f463c157ac0 2024-05-08T04:24:53.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.220+0000 7f463959a640 1 -- 172.21.15.104:0/3488087830 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4634031600 con 0x7f463c157ac0 2024-05-08T04:24:53.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.220+0000 7f463959a640 1 -- 172.21.15.104:0/3488087830 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46340319d0 con 0x7f463c157ac0 2024-05-08T04:24:53.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.221+0000 7f4640fc1640 1 -- 172.21.15.104:0/3488087830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f463c157ac0 msgr2=0x7f463c157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.221+0000 7f4640fc1640 1 --2- 172.21.15.104:0/3488087830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f463c157ac0 0x7f463c157f10 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f463c071f80 tx=0x7f463402a6f0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.221+0000 7f4640fc1640 1 -- 172.21.15.104:0/3488087830 shutdown_connections 2024-05-08T04:24:53.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.221+0000 7f4640fc1640 1 --2- 172.21.15.104:0/3488087830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f463c157ac0 0x7f463c157f10 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.221+0000 7f4640fc1640 1 --2- 172.21.15.104:0/3488087830 >> v2:172.21.15.183:3300/0 conn(0x7f463c070c70 0x7f463c071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.221+0000 7f4640fc1640 1 -- 172.21.15.104:0/3488087830 >> 172.21.15.104:0/3488087830 conn(0x7f463c0b3450 msgr2=0x7f463c0b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:53.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.221+0000 7f4640fc1640 1 -- 172.21.15.104:0/3488087830 shutdown_connections 2024-05-08T04:24:53.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.221+0000 7f4640fc1640 1 -- 172.21.15.104:0/3488087830 wait complete. 2024-05-08T04:24:53.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.222+0000 7f4640fc1640 1 Processor -- start 2024-05-08T04:24:53.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.222+0000 7f4640fc1640 1 -- start start 2024-05-08T04:24:53.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.223+0000 7f4640fc1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f463c070c70 0x7f463c1f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.223+0000 7f4640fc1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463c157ac0 0x7f463c0b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.223+0000 7f4640fc1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463c15edf0 0x7f463c0b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.223+0000 7f4640fc1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0b5b80 con 0x7f463c070c70 2024-05-08T04:24:53.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.223+0000 7f4640fc1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c15fb10 con 0x7f463c157ac0 2024-05-08T04:24:53.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.223+0000 7f4640fc1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c158450 con 0x7f463c15edf0 2024-05-08T04:24:53.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.223+0000 7f463a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f463c070c70 0x7f463c1f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.223+0000 7f463a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f463c070c70 0x7f463c1f3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39308/0 (socket says 172.21.15.104:39308) 2024-05-08T04:24:53.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.223+0000 7f463a59c640 1 -- 172.21.15.104:0/2814787328 learned_addr learned my addr 172.21.15.104:0/2814787328 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:53.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.223+0000 7f4639d9b640 1 --2- 172.21.15.104:0/2814787328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463c157ac0 0x7f463c0b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.223+0000 7f463ad9d640 1 --2- 172.21.15.104:0/2814787328 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463c15edf0 0x7f463c0b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.224+0000 7f463a59c640 1 -- 172.21.15.104:0/2814787328 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463c15edf0 msgr2=0x7f463c0b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.224+0000 7f463a59c640 1 --2- 172.21.15.104:0/2814787328 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463c15edf0 0x7f463c0b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.224+0000 7f463a59c640 1 -- 172.21.15.104:0/2814787328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463c157ac0 msgr2=0x7f463c0b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.224+0000 7f463a59c640 1 --2- 172.21.15.104:0/2814787328 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463c157ac0 0x7f463c0b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.224+0000 7f463a59c640 1 -- 172.21.15.104:0/2814787328 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c1f79e0 con 0x7f463c070c70 2024-05-08T04:24:53.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.224+0000 7f463ad9d640 1 --2- 172.21.15.104:0/2814787328 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463c15edf0 0x7f463c0b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:53.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.224+0000 7f463a59c640 1 --2- 172.21.15.104:0/2814787328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f463c070c70 0x7f463c1f3e30 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f462c00d800 tx=0x7f462c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:53.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.224+0000 7f462affd640 1 -- 172.21.15.104:0/2814787328 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00b6c0 con 0x7f463c070c70 2024-05-08T04:24:53.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.224+0000 7f462affd640 1 -- 172.21.15.104:0/2814787328 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c019070 con 0x7f463c070c70 2024-05-08T04:24:53.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.224+0000 7f462affd640 1 -- 172.21.15.104:0/2814787328 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00ba80 con 0x7f463c070c70 2024-05-08T04:24:53.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.224+0000 7f4640fc1640 1 -- 172.21.15.104:0/2814787328 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463c1f7c50 con 0x7f463c070c70 2024-05-08T04:24:53.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.224+0000 7f4640fc1640 1 -- 172.21.15.104:0/2814787328 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463c1f8210 con 0x7f463c070c70 2024-05-08T04:24:53.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.225+0000 7f4640fc1640 1 -- 172.21.15.104:0/2814787328 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c075010 con 0x7f463c070c70 2024-05-08T04:24:53.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.225+0000 7f462affd640 1 -- 172.21.15.104:0/2814787328 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f462c00bc20 con 0x7f463c070c70 2024-05-08T04:24:53.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.226+0000 7f462affd640 1 --2- 172.21.15.104:0/2814787328 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f461c06b680 0x7f461c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.226+0000 7f462affd640 1 -- 172.21.15.104:0/2814787328 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f462c08a960 con 0x7f463c070c70 2024-05-08T04:24:53.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.226+0000 7f4639d9b640 1 --2- 172.21.15.104:0/2814787328 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f461c06b680 0x7f461c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.226+0000 7f4639d9b640 1 --2- 172.21.15.104:0/2814787328 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f461c06b680 0x7f461c06db40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f463c1f78a0 tx=0x7f4630009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:53.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.230+0000 7f462affd640 1 -- 172.21.15.104:0/2814787328 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f462c059520 con 0x7f463c070c70 2024-05-08T04:24:53.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.427+0000 7f4640fc1640 1 -- 172.21.15.104:0/2814787328 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot create", "vol_name": "cephfs", "group_name": "subvol_grp9070", "snap_name": "subvol_snap54470", "target": ["mon-mgr", ""]}) v1 -- 0x7f463c0683d0 con 0x7f461c06b680 2024-05-08T04:24:53.431 INFO:tasks.ceph.mgr.y.smithi104.stderr:2024-05-08T04:24:53.429+0000 7f27f31d2640 -1 mgr.server reply reply (38) Function not implemented subvolume group snapshots are not supported 2024-05-08T04:24:53.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.429+0000 7f462affd640 1 -- 172.21.15.104:0/2814787328 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: -38 subvolume group snapshots are not supported) v1 ==== 51+0+0 (secure 0 0 0) 0x7f4630009570 con 0x7f461c06b680 2024-05-08T04:24:53.431 INFO:teuthology.orchestra.run.smithi104.stderr:Error ENOSYS: subvolume group snapshots are not supported 2024-05-08T04:24:53.436 DEBUG:teuthology.orchestra.run:got remote process result: 38 2024-05-08T04:24:53.436 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-08T04:24:53.437 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T04:24:53.472 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-08T04:24:53.523 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-08T04:24:53.524 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:24:53.524 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:24:53.540 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:24:53.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.678+0000 7f47b5934640 1 Processor -- start 2024-05-08T04:24:53.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.678+0000 7f47b5934640 1 -- start start 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.678+0000 7f47b5934640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b015b650 0x7f47b006ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.678+0000 7f47b5934640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b00cdd00 con 0x7f47b015ba30 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.678+0000 7f47b5934640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b015f4f0 con 0x7f47b015ffd0 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.678+0000 7f47b5934640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00cb0b0 con 0x7f47b015b650 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47ae7fc640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f47b015ba30 0x7f47b00cd020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54506/0 (socket says 172.21.15.104:54506) 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47ae7fc640 1 -- 172.21.15.104:0/1273025170 learned_addr learned my addr 172.21.15.104:0/1273025170 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831866546 0 0) 0x7f47b00cdd00 con 0x7f47b015ba30 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4798003520 con 0x7f47b015ba30 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47aeffd640 1 --2- 172.21.15.104:0/1273025170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b015b650 0x7f47b006ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1511683797 0 0) 0x7f4798003520 con 0x7f47b015ba30 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b015b650 msgr2=0x7f47b006ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 --2- 172.21.15.104:0/1273025170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b015b650 0x7f47b006ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 >> v1:172.21.15.183:6789/0 conn(0x7f47b015ffd0 legacy=0x7f47b0072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b015f7d0 con 0x7f47b015ba30 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f47a4001670 con 0x7f47b015ba30 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 >> v1:172.21.15.104:6789/0 conn(0x7f47b015ba30 legacy=0x7f47b00cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 --2- 172.21.15.104:0/1273025170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47980039e0 0x7f4798003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 --2- 172.21.15.104:0/1273025170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4798004800 0x7f4798004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 --2- 172.21.15.104:0/1273025170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b015b650 0x7f479800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47980054f0 con 0x7f4798004800 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479800bf00 con 0x7f47980039e0 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479800c080 con 0x7f47b015b650 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47ae7fc640 1 --2- 172.21.15.104:0/1273025170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4798004800 0x7f4798004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47aeffd640 1 --2- 172.21.15.104:0/1273025170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47980039e0 0x7f4798003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47af7fe640 1 --2- 172.21.15.104:0/1273025170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b015b650 0x7f479800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47ae7fc640 1 -- 172.21.15.104:0/1273025170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b015b650 msgr2=0x7f479800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.679+0000 7f47ae7fc640 1 --2- 172.21.15.104:0/1273025170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b015b650 0x7f479800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.680+0000 7f47ae7fc640 1 -- 172.21.15.104:0/1273025170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47980039e0 msgr2=0x7f4798003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:53.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.680+0000 7f47ae7fc640 1 --2- 172.21.15.104:0/1273025170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47980039e0 0x7f4798003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.680+0000 7f47ae7fc640 1 -- 172.21.15.104:0/1273025170 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798003520 con 0x7f4798004800 2024-05-08T04:24:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.680+0000 7f47aeffd640 1 --2- 172.21.15.104:0/1273025170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47980039e0 0x7f4798003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.680+0000 7f47ae7fc640 1 --2- 172.21.15.104:0/1273025170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4798004800 0x7f4798004c80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c210 tx=0x7f4798005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6818563e8b6797c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.680+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4007d10 con 0x7f4798004800 2024-05-08T04:24:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.680+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a40058d0 con 0x7f4798004800 2024-05-08T04:24:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.680+0000 7f47adffb640 1 -- 172.21.15.104:0/1273025170 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4005d00 con 0x7f4798004800 2024-05-08T04:24:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.681+0000 7f47b5934640 1 -- 172.21.15.104:0/1273025170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4798004800 msgr2=0x7f4798004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.681+0000 7f47b5934640 1 --2- 172.21.15.104:0/1273025170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4798004800 0x7f4798004c80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f47a400c210 tx=0x7f4798005830 comp rx=0 tx=0).stop 2024-05-08T04:24:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.681+0000 7f47af7fe640 1 -- 172.21.15.104:0/1273025170 reap_dead start 2024-05-08T04:24:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.681+0000 7f47b5934640 1 -- 172.21.15.104:0/1273025170 shutdown_connections 2024-05-08T04:24:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.681+0000 7f47b5934640 1 -- 172.21.15.104:0/1273025170 >> 172.21.15.104:0/1273025170 conn(0x7f47b00b23e0 msgr2=0x7f47b00b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.681+0000 7f47b5934640 1 -- 172.21.15.104:0/1273025170 shutdown_connections 2024-05-08T04:24:53.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.681+0000 7f47b5934640 1 -- 172.21.15.104:0/1273025170 wait complete. 2024-05-08T04:24:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.682+0000 7f47b5934640 1 Processor -- start 2024-05-08T04:24:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.682+0000 7f47b5934640 1 -- start start 2024-05-08T04:24:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47b5934640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4798004800 0x7f47b014e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47b5934640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b014f150 0x7f47b015c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47b5934640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47b00b4d20 0x7f47b00b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47b5934640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00cd8b0 con 0x7f4798004800 2024-05-08T04:24:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47b5934640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00cd730 con 0x7f47b00b4d20 2024-05-08T04:24:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47b5934640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00cda30 con 0x7f47b014f150 2024-05-08T04:24:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47aeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4798004800 0x7f47b014e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47aeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4798004800 0x7f47b014e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39326/0 (socket says 172.21.15.104:39326) 2024-05-08T04:24:53.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47aeffd640 1 -- 172.21.15.104:0/3067848770 learned_addr learned my addr 172.21.15.104:0/3067848770 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47ae7fc640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b014f150 0x7f47b015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47aeffd640 1 -- 172.21.15.104:0/3067848770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b014f150 msgr2=0x7f47b015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47af7fe640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47b00b4d20 0x7f47b00b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47aeffd640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b014f150 0x7f47b015c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47aeffd640 1 -- 172.21.15.104:0/3067848770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47b00b4d20 msgr2=0x7f47b00b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47aeffd640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47b00b4d20 0x7f47b00b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47aeffd640 1 -- 172.21.15.104:0/3067848770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b015de20 con 0x7f4798004800 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.683+0000 7f47aeffd640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4798004800 0x7f47b014e8f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f47a8006a90 tx=0x7f47a8004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.684+0000 7f4797fff640 1 -- 172.21.15.104:0/3067848770 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8019020 con 0x7f4798004800 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.684+0000 7f4797fff640 1 -- 172.21.15.104:0/3067848770 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8014870 con 0x7f4798004800 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.684+0000 7f47b5934640 1 -- 172.21.15.104:0/3067848770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b015d1a0 con 0x7f4798004800 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.684+0000 7f4797fff640 1 -- 172.21.15.104:0/3067848770 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8014c40 con 0x7f4798004800 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.684+0000 7f47b5934640 1 -- 172.21.15.104:0/3067848770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b015d760 con 0x7f4798004800 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.685+0000 7f47b5934640 1 -- 172.21.15.104:0/3067848770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b0075010 con 0x7f4798004800 2024-05-08T04:24:53.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.685+0000 7f4797fff640 1 -- 172.21.15.104:0/3067848770 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f47a801c020 con 0x7f4798004800 2024-05-08T04:24:53.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.686+0000 7f4797fff640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f479c06b680 0x7f479c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.686+0000 7f4797fff640 1 -- 172.21.15.104:0/3067848770 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f47a808ab20 con 0x7f4798004800 2024-05-08T04:24:53.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.686+0000 7f47ae7fc640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f479c06b680 0x7f479c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.686+0000 7f47ae7fc640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f479c06b680 0x7f479c06db40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f47a4033000 tx=0x7f47a402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:53.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.690+0000 7f4797fff640 1 -- 172.21.15.104:0/3067848770 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f47a8023030 con 0x7f4798004800 2024-05-08T04:24:53.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.865+0000 7f47b5934640 1 -- 172.21.15.104:0/3067848770 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47b0150490 con 0x7f4798004800 2024-05-08T04:24:53.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.866+0000 7f4797fff640 1 -- 172.21.15.104:0/3067848770 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16821 (secure 0 0 0) 0x7f47a8025300 con 0x7f4798004800 2024-05-08T04:24:53.869 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:53.869 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":61,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:24:52.781593+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:24:36.286493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-08T04:24:37.038502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.14","mappings":[{"from":6,"to":1}]},{"pgid":"9.3b","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:24:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.869+0000 7f47b5934640 1 -- 172.21.15.104:0/3067848770 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f479c06b680 msgr2=0x7f479c06db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.869+0000 7f47b5934640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f479c06b680 0x7f479c06db40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f47a4033000 tx=0x7f47a402e000 comp rx=0 tx=0).stop 2024-05-08T04:24:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.869+0000 7f47b5934640 1 -- 172.21.15.104:0/3067848770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4798004800 msgr2=0x7f47b014e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.869+0000 7f47b5934640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4798004800 0x7f47b014e8f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f47a8006a90 tx=0x7f47a8004610 comp rx=0 tx=0).stop 2024-05-08T04:24:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.869+0000 7f47b5934640 1 -- 172.21.15.104:0/3067848770 shutdown_connections 2024-05-08T04:24:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.869+0000 7f47b5934640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f479c06b680 0x7f479c06db40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.869+0000 7f47b5934640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47b00b4d20 0x7f47b00b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.869+0000 7f47b5934640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b014f150 0x7f47b015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.869+0000 7f47b5934640 1 --2- 172.21.15.104:0/3067848770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4798004800 0x7f47b014e8f0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.869+0000 7f47b5934640 1 -- 172.21.15.104:0/3067848770 >> 172.21.15.104:0/3067848770 conn(0x7f47b00b23e0 msgr2=0x7f47b00caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:53.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.869+0000 7f47b5934640 1 -- 172.21.15.104:0/3067848770 shutdown_connections 2024-05-08T04:24:53.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.869+0000 7f47b5934640 1 -- 172.21.15.104:0/3067848770 wait complete. 2024-05-08T04:24:53.882 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:24:36.286493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:24:37.038502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:24:53.882 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:24:53.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.984+0000 7f506166f640 1 Processor -- start 2024-05-08T04:24:53.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.984+0000 7f506166f640 1 -- start start 2024-05-08T04:24:53.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.984+0000 7f506166f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f505c0ce5a0 0x7f505c161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.984+0000 7f506166f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f505c0d07c0 0x7f505c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.984+0000 7f506166f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505c15e1f0 con 0x7f505c15de10 2024-05-08T04:24:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.984+0000 7f506166f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c0d0f50 con 0x7f505c0d07c0 2024-05-08T04:24:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.984+0000 7f506166f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c161e60 con 0x7f505c0ce5a0 2024-05-08T04:24:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505affd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f505c15de10 0x7f505c0d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54508/0 (socket says 172.21.15.104:54508) 2024-05-08T04:24:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505affd640 1 -- 172.21.15.104:0/1932103090 learned_addr learned my addr 172.21.15.104:0/1932103090 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505b7fe640 1 --2- 172.21.15.104:0/1932103090 >> v2:172.21.15.183:3300/0 conn(0x7f505c0d07c0 0x7f505c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984154659 0 0) 0x7f505c15e1f0 con 0x7f505c15de10 2024-05-08T04:24:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5048003520 con 0x7f505c15de10 2024-05-08T04:24:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f50527fc640 1 --2- 172.21.15.104:0/1932103090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f505c0ce5a0 0x7f505c161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2524606088 0 0) 0x7f5048003520 con 0x7f505c15de10 2024-05-08T04:24:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f505c0ce5a0 msgr2=0x7f505c161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 --2- 172.21.15.104:0/1932103090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f505c0ce5a0 0x7f505c161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 >> v2:172.21.15.183:3300/0 conn(0x7f505c0d07c0 msgr2=0x7f505c0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 --2- 172.21.15.104:0/1932103090 >> v2:172.21.15.183:3300/0 conn(0x7f505c0d07c0 0x7f505c0d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c162090 con 0x7f505c15de10 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f504c001670 con 0x7f505c15de10 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 >> v1:172.21.15.104:6789/0 conn(0x7f505c15de10 legacy=0x7f505c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 --2- 172.21.15.104:0/1932103090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50480039b0 0x7f5048003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 --2- 172.21.15.104:0/1932103090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5048004800 0x7f5048004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 --2- 172.21.15.104:0/1932103090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f505c0ce5a0 0x7f50480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c0d0f50 con 0x7f5048004800 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504800b9f0 con 0x7f50480039b0 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504800bbf0 con 0x7f505c0ce5a0 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f50527fc640 1 --2- 172.21.15.104:0/1932103090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5048004800 0x7f5048004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f505affd640 1 --2- 172.21.15.104:0/1932103090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50480039b0 0x7f5048003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f50527fc640 1 -- 172.21.15.104:0/1932103090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f505c0ce5a0 msgr2=0x7f50480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:53.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.985+0000 7f50527fc640 1 --2- 172.21.15.104:0/1932103090 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f505c0ce5a0 0x7f50480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.986+0000 7f50527fc640 1 -- 172.21.15.104:0/1932103090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50480039b0 msgr2=0x7f5048003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.986+0000 7f50527fc640 1 --2- 172.21.15.104:0/1932103090 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50480039b0 0x7f5048003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.986+0000 7f50527fc640 1 -- 172.21.15.104:0/1932103090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048003520 con 0x7f5048004800 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.986+0000 7f50527fc640 1 --2- 172.21.15.104:0/1932103090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5048004800 0x7f5048004c80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f504400ba00 tx=0x7f5048005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2455c28e6391770 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.986+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5044030070 con 0x7f5048004800 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.986+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504402acf0 con 0x7f5048004800 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.986+0000 7f505a7fc640 1 -- 172.21.15.104:0/1932103090 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504400b600 con 0x7f5048004800 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.987+0000 7f506166f640 1 -- 172.21.15.104:0/1932103090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5048004800 msgr2=0x7f5048004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.987+0000 7f506166f640 1 --2- 172.21.15.104:0/1932103090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5048004800 0x7f5048004c80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f504400ba00 tx=0x7f5048005830 comp rx=0 tx=0).stop 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.987+0000 7f505b7fe640 1 -- 172.21.15.104:0/1932103090 reap_dead start 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.987+0000 7f506166f640 1 -- 172.21.15.104:0/1932103090 shutdown_connections 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.987+0000 7f506166f640 1 -- 172.21.15.104:0/1932103090 >> 172.21.15.104:0/1932103090 conn(0x7f505c072290 msgr2=0x7f505c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.987+0000 7f506166f640 1 -- 172.21.15.104:0/1932103090 shutdown_connections 2024-05-08T04:24:53.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.987+0000 7f506166f640 1 -- 172.21.15.104:0/1932103090 wait complete. 2024-05-08T04:24:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.988+0000 7f506166f640 1 Processor -- start 2024-05-08T04:24:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.988+0000 7f506166f640 1 -- start start 2024-05-08T04:24:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f506166f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5048004800 0x7f505c160b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f506166f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f505c1f38d0 0x7f505c159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f506166f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f505c0caaf0 0x7f505c1f73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f506166f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c162650 con 0x7f5048004800 2024-05-08T04:24:53.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f506166f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c0d1a90 con 0x7f505c0caaf0 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f506166f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c0d1ce0 con 0x7f505c1f38d0 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f505affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5048004800 0x7f505c160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f505affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5048004800 0x7f505c160b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39336/0 (socket says 172.21.15.104:39336) 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f505affd640 1 -- 172.21.15.104:0/643895814 learned_addr learned my addr 172.21.15.104:0/643895814 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f505affd640 1 -- 172.21.15.104:0/643895814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f505c1f38d0 msgr2=0x7f505c159140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f505affd640 1 --2- 172.21.15.104:0/643895814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f505c1f38d0 0x7f505c159140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f505affd640 1 -- 172.21.15.104:0/643895814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f505c0caaf0 msgr2=0x7f505c1f73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f505b7fe640 1 --2- 172.21.15.104:0/643895814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f505c0caaf0 0x7f505c1f73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f505affd640 1 --2- 172.21.15.104:0/643895814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f505c0caaf0 0x7f505c1f73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.989+0000 7f505affd640 1 -- 172.21.15.104:0/643895814 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c161080 con 0x7f5048004800 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.990+0000 7f505affd640 1 --2- 172.21.15.104:0/643895814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5048004800 0x7f505c160b40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f504c000fb0 tx=0x7f504c0077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.990+0000 7f5053fff640 1 -- 172.21.15.104:0/643895814 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c00f990 con 0x7f5048004800 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.990+0000 7f5053fff640 1 -- 172.21.15.104:0/643895814 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c018070 con 0x7f5048004800 2024-05-08T04:24:53.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.990+0000 7f506166f640 1 -- 172.21.15.104:0/643895814 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505c1f3e40 con 0x7f5048004800 2024-05-08T04:24:53.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.990+0000 7f5053fff640 1 -- 172.21.15.104:0/643895814 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c00fd70 con 0x7f5048004800 2024-05-08T04:24:53.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.990+0000 7f506166f640 1 -- 172.21.15.104:0/643895814 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505c1f4400 con 0x7f5048004800 2024-05-08T04:24:53.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.991+0000 7f506166f640 1 -- 172.21.15.104:0/643895814 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505c0d1870 con 0x7f5048004800 2024-05-08T04:24:53.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.991+0000 7f5053fff640 1 -- 172.21.15.104:0/643895814 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f504c01d460 con 0x7f5048004800 2024-05-08T04:24:53.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.992+0000 7f5053fff640 1 --2- 172.21.15.104:0/643895814 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f503c06b6b0 0x7f503c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:53.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.992+0000 7f5053fff640 1 -- 172.21.15.104:0/643895814 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f504c08a5a0 con 0x7f5048004800 2024-05-08T04:24:53.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.992+0000 7f50527fc640 1 --2- 172.21.15.104:0/643895814 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f503c06b6b0 0x7f503c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:53.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.992+0000 7f50527fc640 1 --2- 172.21.15.104:0/643895814 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f503c06b6b0 0x7f503c06db70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f50480057e0 tx=0x7f5044030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:53.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:53.996+0000 7f5053fff640 1 -- 172.21.15.104:0/643895814 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f504c0591f0 con 0x7f5048004800 2024-05-08T04:24:54.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.166+0000 7f506166f640 1 -- 172.21.15.104:0/643895814 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f505c0743b0 con 0x7f5048004800 2024-05-08T04:24:54.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.166+0000 7f5053fff640 1 -- 172.21.15.104:0/643895814 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f504c058af0 con 0x7f5048004800 2024-05-08T04:24:54.169 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:24:54.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.168+0000 7f506166f640 1 -- 172.21.15.104:0/643895814 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f503c06b6b0 msgr2=0x7f503c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.168+0000 7f506166f640 1 --2- 172.21.15.104:0/643895814 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f503c06b6b0 0x7f503c06db70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f50480057e0 tx=0x7f5044030000 comp rx=0 tx=0).stop 2024-05-08T04:24:54.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.168+0000 7f506166f640 1 -- 172.21.15.104:0/643895814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5048004800 msgr2=0x7f505c160b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.168+0000 7f506166f640 1 --2- 172.21.15.104:0/643895814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5048004800 0x7f505c160b40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f504c000fb0 tx=0x7f504c0077a0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.168+0000 7f506166f640 1 -- 172.21.15.104:0/643895814 shutdown_connections 2024-05-08T04:24:54.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.168+0000 7f506166f640 1 --2- 172.21.15.104:0/643895814 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f503c06b6b0 0x7f503c06db70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.168+0000 7f506166f640 1 --2- 172.21.15.104:0/643895814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f505c0caaf0 0x7f505c1f73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.168+0000 7f506166f640 1 --2- 172.21.15.104:0/643895814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f505c1f38d0 0x7f505c159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.168+0000 7f506166f640 1 --2- 172.21.15.104:0/643895814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5048004800 0x7f505c160b40 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.168+0000 7f506166f640 1 -- 172.21.15.104:0/643895814 >> 172.21.15.104:0/643895814 conn(0x7f505c072290 msgr2=0x7f505c0b8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:54.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.169+0000 7f506166f640 1 -- 172.21.15.104:0/643895814 shutdown_connections 2024-05-08T04:24:54.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.169+0000 7f506166f640 1 -- 172.21.15.104:0/643895814 wait complete. 2024-05-08T04:24:54.182 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:24:54.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.283+0000 7f53cce1f640 1 Processor -- start 2024-05-08T04:24:54.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.283+0000 7f53cce1f640 1 -- start start 2024-05-08T04:24:54.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53cce1f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53c815bca0 0x7f53c80ada00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53cce1f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f53c815c080 0x7f53c80acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53cce1f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c806f4f0 con 0x7f53c8072810 2024-05-08T04:24:54.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53cce1f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c815c510 con 0x7f53c815c080 2024-05-08T04:24:54.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53cce1f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c806f7b0 con 0x7f53c815bca0 2024-05-08T04:24:54.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53c6d9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f53c815c080 0x7f53c80acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53c659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53c815bca0 0x7f53c80ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53c6d9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f53c815c080 0x7f53c80acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:42182/0 (socket says 172.21.15.104:42182) 2024-05-08T04:24:54.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53c6d9d640 1 -- 172.21.15.104:0/1381955561 learned_addr learned my addr 172.21.15.104:0/1381955561 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:54.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53c6d9d640 1 -- 172.21.15.104:0/1381955561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53c815bca0 msgr2=0x7f53c80ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:54.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53c6d9d640 1 --2- 172.21.15.104:0/1381955561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53c815bca0 0x7f53c80ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53c6d9d640 1 -- 172.21.15.104:0/1381955561 >> v1:172.21.15.183:6789/0 conn(0x7f53c8072810 legacy=0x7f53c8160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53c6d9d640 1 -- 172.21.15.104:0/1381955561 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c80af570 con 0x7f53c815c080 2024-05-08T04:24:54.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.284+0000 7f53c559a640 1 -- 172.21.15.104:0/1381955561 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563424631 0 0) 0x7f53c806f4f0 con 0x7f53c8072810 2024-05-08T04:24:54.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.285+0000 7f53c6d9d640 1 --2- 172.21.15.104:0/1381955561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53c815c080 0x7f53c80acdf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009e50 tx=0x7f53c002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ad92db9e52fd025 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:54.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.285+0000 7f53c559a640 1 -- 172.21.15.104:0/1381955561 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0036070 con 0x7f53c815c080 2024-05-08T04:24:54.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.285+0000 7f53c559a640 1 -- 172.21.15.104:0/1381955561 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c0031600 con 0x7f53c815c080 2024-05-08T04:24:54.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.285+0000 7f53c559a640 1 -- 172.21.15.104:0/1381955561 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c00319d0 con 0x7f53c815c080 2024-05-08T04:24:54.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.286+0000 7f53cce1f640 1 -- 172.21.15.104:0/1381955561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53c815c080 msgr2=0x7f53c80acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.286+0000 7f53cce1f640 1 --2- 172.21.15.104:0/1381955561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53c815c080 0x7f53c80acdf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f53c0009e50 tx=0x7f53c002a680 comp rx=0 tx=0).stop 2024-05-08T04:24:54.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.286+0000 7f53cce1f640 1 -- 172.21.15.104:0/1381955561 shutdown_connections 2024-05-08T04:24:54.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.286+0000 7f53cce1f640 1 --2- 172.21.15.104:0/1381955561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53c815c080 0x7f53c80acdf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.286+0000 7f53cce1f640 1 --2- 172.21.15.104:0/1381955561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53c815bca0 0x7f53c80ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.286+0000 7f53cce1f640 1 -- 172.21.15.104:0/1381955561 >> 172.21.15.104:0/1381955561 conn(0x7f53c8071a10 msgr2=0x7f53c8071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:54.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.286+0000 7f53cce1f640 1 -- 172.21.15.104:0/1381955561 shutdown_connections 2024-05-08T04:24:54.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.286+0000 7f53cce1f640 1 -- 172.21.15.104:0/1381955561 wait complete. 2024-05-08T04:24:54.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.287+0000 7f53cce1f640 1 Processor -- start 2024-05-08T04:24:54.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.287+0000 7f53cce1f640 1 -- start start 2024-05-08T04:24:54.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53cce1f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53c8072810 0x7f53c814ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53cce1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53c815bca0 0x7f53c80cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53cce1f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53c815c080 0x7f53c80ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53cce1f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80ad330 con 0x7f53c815bca0 2024-05-08T04:24:54.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53cce1f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80af850 con 0x7f53c8072810 2024-05-08T04:24:54.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53cce1f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80ad4b0 con 0x7f53c815c080 2024-05-08T04:24:54.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53c5d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53c815bca0 0x7f53c80cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53c5d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53c815bca0 0x7f53c80cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39352/0 (socket says 172.21.15.104:39352) 2024-05-08T04:24:54.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53c5d9b640 1 -- 172.21.15.104:0/1569775853 learned_addr learned my addr 172.21.15.104:0/1569775853 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:54.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53c659c640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53c8072810 0x7f53c814ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53c6d9d640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53c815c080 0x7f53c80ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53c5d9b640 1 -- 172.21.15.104:0/1569775853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53c815c080 msgr2=0x7f53c80ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53c5d9b640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53c815c080 0x7f53c80ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53c5d9b640 1 -- 172.21.15.104:0/1569775853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53c8072810 msgr2=0x7f53c814ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53c5d9b640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53c8072810 0x7f53c814ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53c5d9b640 1 -- 172.21.15.104:0/1569775853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c814b040 con 0x7f53c815bca0 2024-05-08T04:24:54.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.288+0000 7f53c659c640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53c8072810 0x7f53c814ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:54.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.289+0000 7f53c5d9b640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53c815bca0 0x7f53c80cdd20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f53b000c440 tx=0x7f53b000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:54.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.289+0000 7f53beffd640 1 -- 172.21.15.104:0/1569775853 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0017070 con 0x7f53c815bca0 2024-05-08T04:24:54.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.289+0000 7f53beffd640 1 -- 172.21.15.104:0/1569775853 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b0005480 con 0x7f53c815bca0 2024-05-08T04:24:54.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.289+0000 7f53cce1f640 1 -- 172.21.15.104:0/1569775853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c80c9450 con 0x7f53c815bca0 2024-05-08T04:24:54.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.289+0000 7f53beffd640 1 -- 172.21.15.104:0/1569775853 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0003830 con 0x7f53c815bca0 2024-05-08T04:24:54.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.289+0000 7f53cce1f640 1 -- 172.21.15.104:0/1569775853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c80c9a10 con 0x7f53c815bca0 2024-05-08T04:24:54.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.290+0000 7f53cce1f640 1 -- 172.21.15.104:0/1569775853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c8075010 con 0x7f53c815bca0 2024-05-08T04:24:54.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.290+0000 7f53beffd640 1 -- 172.21.15.104:0/1569775853 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f53b001a070 con 0x7f53c815bca0 2024-05-08T04:24:54.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.291+0000 7f53beffd640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f53a806b680 0x7f53a806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.291+0000 7f53beffd640 1 -- 172.21.15.104:0/1569775853 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f53b00898c0 con 0x7f53c815bca0 2024-05-08T04:24:54.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.291+0000 7f53c659c640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f53a806b680 0x7f53a806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.291+0000 7f53c659c640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f53a806b680 0x7f53a806db40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53c80ca8a0 tx=0x7f53b8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:54.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.295+0000 7f53beffd640 1 -- 172.21.15.104:0/1569775853 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f53b0058400 con 0x7f53c815bca0 2024-05-08T04:24:54.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.464+0000 7f53cce1f640 1 -- 172.21.15.104:0/1569775853 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53c80b5380 con 0x7f53c815bca0 2024-05-08T04:24:54.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.464+0000 7f53beffd640 1 -- 172.21.15.104:0/1569775853 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53b0057d00 con 0x7f53c815bca0 2024-05-08T04:24:54.467 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:24:54.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.466+0000 7f53cce1f640 1 -- 172.21.15.104:0/1569775853 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f53a806b680 msgr2=0x7f53a806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.466+0000 7f53cce1f640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f53a806b680 0x7f53a806db40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f53c80ca8a0 tx=0x7f53b8008040 comp rx=0 tx=0).stop 2024-05-08T04:24:54.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.466+0000 7f53cce1f640 1 -- 172.21.15.104:0/1569775853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53c815bca0 msgr2=0x7f53c80cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.466+0000 7f53cce1f640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53c815bca0 0x7f53c80cdd20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f53b000c440 tx=0x7f53b000c900 comp rx=0 tx=0).stop 2024-05-08T04:24:54.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.466+0000 7f53cce1f640 1 -- 172.21.15.104:0/1569775853 shutdown_connections 2024-05-08T04:24:54.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.466+0000 7f53cce1f640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f53a806b680 0x7f53a806db40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.466+0000 7f53cce1f640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f53c815c080 0x7f53c80ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.466+0000 7f53cce1f640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f53c815bca0 0x7f53c80cdd20 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.466+0000 7f53cce1f640 1 --2- 172.21.15.104:0/1569775853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f53c8072810 0x7f53c814ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.466+0000 7f53cce1f640 1 -- 172.21.15.104:0/1569775853 >> 172.21.15.104:0/1569775853 conn(0x7f53c8071a10 msgr2=0x7f53c815c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:54.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.466+0000 7f53cce1f640 1 -- 172.21.15.104:0/1569775853 shutdown_connections 2024-05-08T04:24:54.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.466+0000 7f53cce1f640 1 -- 172.21.15.104:0/1569775853 wait complete. 2024-05-08T04:24:54.479 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:24:54.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.579+0000 7f91dc76a640 1 Processor -- start 2024-05-08T04:24:54.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.579+0000 7f91dc76a640 1 -- start start 2024-05-08T04:24:54.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.580+0000 7f91dc76a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d415db30 0x7f91d406bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.580+0000 7f91dc76a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f91d40b93b0 0x7f91d40b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.580+0000 7f91dc76a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f91d40b5970 0x7f91d4161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.580+0000 7f91dc76a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d40b6b50 con 0x7f91d40b93b0 2024-05-08T04:24:54.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.580+0000 7f91dc76a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d406c800 con 0x7f91d40b5970 2024-05-08T04:24:54.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.580+0000 7f91dc76a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d406cae0 con 0x7f91d415db30 2024-05-08T04:24:54.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.580+0000 7f91d9d05640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f91d40b93b0 0x7f91d40b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.581+0000 7f91d9d05640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f91d40b93b0 0x7f91d40b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39362/0 (socket says 172.21.15.104:39362) 2024-05-08T04:24:54.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.581+0000 7f91d9d05640 1 -- 172.21.15.104:0/3681825956 learned_addr learned my addr 172.21.15.104:0/3681825956 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:54.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.581+0000 7f91dad07640 1 --2- 172.21.15.104:0/3681825956 >> v2:172.21.15.183:3300/0 conn(0x7f91d40b5970 0x7f91d4161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.581+0000 7f91da506640 1 --2- 172.21.15.104:0/3681825956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d415db30 0x7f91d406bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.581+0000 7f91d9d05640 1 -- 172.21.15.104:0/3681825956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d415db30 msgr2=0x7f91d406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:54.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.581+0000 7f91d9d05640 1 --2- 172.21.15.104:0/3681825956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d415db30 0x7f91d406bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.581+0000 7f91d9d05640 1 -- 172.21.15.104:0/3681825956 >> v2:172.21.15.183:3300/0 conn(0x7f91d40b5970 msgr2=0x7f91d4161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.581+0000 7f91d9d05640 1 --2- 172.21.15.104:0/3681825956 >> v2:172.21.15.183:3300/0 conn(0x7f91d40b5970 0x7f91d4161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.581+0000 7f91d9d05640 1 -- 172.21.15.104:0/3681825956 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d406cdc0 con 0x7f91d40b93b0 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.581+0000 7f91d9d05640 1 --2- 172.21.15.104:0/3681825956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91d40b93b0 0x7f91d40b5430 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f91d40b6550 tx=0x7f91c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ec9d2c54d5ab21 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.582+0000 7f91d9504640 1 -- 172.21.15.104:0/3681825956 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4037070 con 0x7f91d40b93b0 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.582+0000 7f91d9504640 1 -- 172.21.15.104:0/3681825956 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c4032440 con 0x7f91d40b93b0 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.582+0000 7f91d9504640 1 -- 172.21.15.104:0/3681825956 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4032810 con 0x7f91d40b93b0 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.582+0000 7f91dc76a640 1 -- 172.21.15.104:0/3681825956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91d40b93b0 msgr2=0x7f91d40b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.582+0000 7f91dc76a640 1 --2- 172.21.15.104:0/3681825956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91d40b93b0 0x7f91d40b5430 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f91d40b6550 tx=0x7f91c402a1e0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.582+0000 7f91dc76a640 1 -- 172.21.15.104:0/3681825956 shutdown_connections 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.582+0000 7f91dc76a640 1 --2- 172.21.15.104:0/3681825956 >> v2:172.21.15.183:3300/0 conn(0x7f91d40b5970 0x7f91d4161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.582+0000 7f91dc76a640 1 --2- 172.21.15.104:0/3681825956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91d40b93b0 0x7f91d40b5430 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.582+0000 7f91dc76a640 1 --2- 172.21.15.104:0/3681825956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d415db30 0x7f91d406bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.582+0000 7f91dc76a640 1 -- 172.21.15.104:0/3681825956 >> 172.21.15.104:0/3681825956 conn(0x7f91d40d0430 msgr2=0x7f91d40d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:54.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.582+0000 7f91dc76a640 1 -- 172.21.15.104:0/3681825956 shutdown_connections 2024-05-08T04:24:54.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.582+0000 7f91dc76a640 1 -- 172.21.15.104:0/3681825956 wait complete. 2024-05-08T04:24:54.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.583+0000 7f91dc76a640 1 Processor -- start 2024-05-08T04:24:54.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.584+0000 7f91dc76a640 1 -- start start 2024-05-08T04:24:54.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.584+0000 7f91dc76a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91d40b5970 0x7f91d4153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.584+0000 7f91dc76a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b93b0 0x7f91d4157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.584+0000 7f91dc76a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91d415db30 0x7f91d4159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.584+0000 7f91dc76a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d415df10 con 0x7f91d415db30 2024-05-08T04:24:54.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.584+0000 7f91dc76a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d406c4f0 con 0x7f91d40b5970 2024-05-08T04:24:54.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.584+0000 7f91dc76a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d4159270 con 0x7f91d40b93b0 2024-05-08T04:24:54.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.584+0000 7f91dad07640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91d415db30 0x7f91d4159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.584+0000 7f91dad07640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91d415db30 0x7f91d4159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39368/0 (socket says 172.21.15.104:39368) 2024-05-08T04:24:54.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.584+0000 7f91dad07640 1 -- 172.21.15.104:0/3180784587 learned_addr learned my addr 172.21.15.104:0/3180784587 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:54.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.584+0000 7f91d9d05640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b93b0 0x7f91d4157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.584+0000 7f91da506640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91d40b5970 0x7f91d4153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.585+0000 7f91dad07640 1 -- 172.21.15.104:0/3180784587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b93b0 msgr2=0x7f91d4157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.585+0000 7f91dad07640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b93b0 0x7f91d4157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.585+0000 7f91dad07640 1 -- 172.21.15.104:0/3180784587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91d40b5970 msgr2=0x7f91d4153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.585+0000 7f91dad07640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91d40b5970 0x7f91d4153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.585+0000 7f91dad07640 1 -- 172.21.15.104:0/3180784587 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d4158660 con 0x7f91d415db30 2024-05-08T04:24:54.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.585+0000 7f91dad07640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91d415db30 0x7f91d4159700 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00ef00 tx=0x7f91cc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:54.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.585+0000 7f91caffd640 1 -- 172.21.15.104:0/3180784587 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc018020 con 0x7f91d415db30 2024-05-08T04:24:54.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.585+0000 7f91caffd640 1 -- 172.21.15.104:0/3180784587 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc00bd10 con 0x7f91d415db30 2024-05-08T04:24:54.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.585+0000 7f91dc76a640 1 -- 172.21.15.104:0/3180784587 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d4158940 con 0x7f91d415db30 2024-05-08T04:24:54.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.585+0000 7f91caffd640 1 -- 172.21.15.104:0/3180784587 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc014640 con 0x7f91d415db30 2024-05-08T04:24:54.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.585+0000 7f91dc76a640 1 -- 172.21.15.104:0/3180784587 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d4158f00 con 0x7f91d415db30 2024-05-08T04:24:54.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.586+0000 7f91dc76a640 1 -- 172.21.15.104:0/3180784587 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d4067420 con 0x7f91d415db30 2024-05-08T04:24:54.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.586+0000 7f91caffd640 1 -- 172.21.15.104:0/3180784587 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 9) v1 ==== 89933+0+0 (secure 0 0 0) 0x7f91cc01b020 con 0x7f91d415db30 2024-05-08T04:24:54.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.587+0000 7f91caffd640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f91b806b680 0x7f91b806db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.587+0000 7f91caffd640 1 -- 172.21.15.104:0/3180784587 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f91cc08ad00 con 0x7f91d415db30 2024-05-08T04:24:54.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.587+0000 7f91da506640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f91b806b680 0x7f91b806db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.587+0000 7f91da506640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f91b806b680 0x7f91b806db40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009a30 tx=0x7f91d0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:54.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.591+0000 7f91caffd640 1 -- 172.21.15.104:0/3180784587 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f91d4067420 con 0x7f91d415db30 2024-05-08T04:24:54.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.764+0000 7f91dc76a640 1 -- 172.21.15.104:0/3180784587 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91d4075010 con 0x7f91d415db30 2024-05-08T04:24:54.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.765+0000 7f91caffd640 1 -- 172.21.15.104:0/3180784587 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91cc022030 con 0x7f91d415db30 2024-05-08T04:24:54.767 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:24:54.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.767+0000 7f91dc76a640 1 -- 172.21.15.104:0/3180784587 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f91b806b680 msgr2=0x7f91b806db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.767+0000 7f91dc76a640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f91b806b680 0x7f91b806db40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009a30 tx=0x7f91d0008040 comp rx=0 tx=0).stop 2024-05-08T04:24:54.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.767+0000 7f91dc76a640 1 -- 172.21.15.104:0/3180784587 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91d415db30 msgr2=0x7f91d4159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.767+0000 7f91dc76a640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91d415db30 0x7f91d4159700 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00ef00 tx=0x7f91cc00b480 comp rx=0 tx=0).stop 2024-05-08T04:24:54.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.767+0000 7f91dc76a640 1 -- 172.21.15.104:0/3180784587 shutdown_connections 2024-05-08T04:24:54.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.767+0000 7f91dc76a640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f91b806b680 0x7f91b806db40 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.767+0000 7f91dc76a640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f91d415db30 0x7f91d4159700 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.767+0000 7f91dc76a640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b93b0 0x7f91d4157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.767+0000 7f91dc76a640 1 --2- 172.21.15.104:0/3180784587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91d40b5970 0x7f91d4153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.767+0000 7f91dc76a640 1 -- 172.21.15.104:0/3180784587 >> 172.21.15.104:0/3180784587 conn(0x7f91d40d0430 msgr2=0x7f91d40b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:54.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.767+0000 7f91dc76a640 1 -- 172.21.15.104:0/3180784587 shutdown_connections 2024-05-08T04:24:54.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.767+0000 7f91dc76a640 1 -- 172.21.15.104:0/3180784587 wait complete. 2024-05-08T04:24:54.780 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:24:54.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.881+0000 7f9f29b5c640 1 Processor -- start 2024-05-08T04:24:54.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.881+0000 7f9f29b5c640 1 -- start start 2024-05-08T04:24:54.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.881+0000 7f9f29b5c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9f2415de10 0x7f9f24161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.881+0000 7f9f29b5c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9f240ce5a0 0x7f9f240d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.882+0000 7f9f29b5c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f240d3210 con 0x7f9f240d05f0 2024-05-08T04:24:54.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.882+0000 7f9f29b5c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f240d0f50 con 0x7f9f2415de10 2024-05-08T04:24:54.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.882+0000 7f9f29b5c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f24161e60 con 0x7f9f240ce5a0 2024-05-08T04:24:54.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.882+0000 7f9f237fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9f2415de10 0x7f9f24161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.882+0000 7f9f237fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9f2415de10 0x7f9f24161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39380/0 (socket says 172.21.15.104:39380) 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.882+0000 7f9f237fe640 1 -- 172.21.15.104:0/287630647 learned_addr learned my addr 172.21.15.104:0/287630647 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.882+0000 7f9f22ffd640 1 --2- 172.21.15.104:0/287630647 >> v2:172.21.15.183:3300/0 conn(0x7f9f240ce5a0 0x7f9f240d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.882+0000 7f9f237fe640 1 -- 172.21.15.104:0/287630647 >> v2:172.21.15.183:3300/0 conn(0x7f9f240ce5a0 msgr2=0x7f9f240d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.882+0000 7f9f237fe640 1 --2- 172.21.15.104:0/287630647 >> v2:172.21.15.183:3300/0 conn(0x7f9f240ce5a0 0x7f9f240d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.882+0000 7f9f237fe640 1 -- 172.21.15.104:0/287630647 >> v1:172.21.15.183:6789/0 conn(0x7f9f240d05f0 legacy=0x7f9f240b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.882+0000 7f9f237fe640 1 -- 172.21.15.104:0/287630647 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2415e1f0 con 0x7f9f2415de10 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.882+0000 7f9f22ffd640 1 --2- 172.21.15.104:0/287630647 >> v2:172.21.15.183:3300/0 conn(0x7f9f240ce5a0 0x7f9f240d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.883+0000 7f9f237fe640 1 --2- 172.21.15.104:0/287630647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f2415de10 0x7f9f24161920 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9f240c7520 tx=0x7f9f1402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faaa8b47ba95ee12 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.883+0000 7f9f227fc640 1 -- 172.21.15.104:0/287630647 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14037070 con 0x7f9f2415de10 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.883+0000 7f9f227fc640 1 -- 172.21.15.104:0/287630647 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f14032440 con 0x7f9f2415de10 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.883+0000 7f9f227fc640 1 -- 172.21.15.104:0/287630647 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14032810 con 0x7f9f2415de10 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.883+0000 7f9f29b5c640 1 -- 172.21.15.104:0/287630647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f2415de10 msgr2=0x7f9f24161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.883+0000 7f9f29b5c640 1 --2- 172.21.15.104:0/287630647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f2415de10 0x7f9f24161920 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9f240c7520 tx=0x7f9f1402a1a0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.883+0000 7f9f29b5c640 1 -- 172.21.15.104:0/287630647 shutdown_connections 2024-05-08T04:24:54.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.883+0000 7f9f29b5c640 1 --2- 172.21.15.104:0/287630647 >> v2:172.21.15.183:3300/0 conn(0x7f9f240ce5a0 0x7f9f240d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.883+0000 7f9f29b5c640 1 --2- 172.21.15.104:0/287630647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f2415de10 0x7f9f24161920 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.883+0000 7f9f29b5c640 1 -- 172.21.15.104:0/287630647 >> 172.21.15.104:0/287630647 conn(0x7f9f24072290 msgr2=0x7f9f24072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:54.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.883+0000 7f9f29b5c640 1 -- 172.21.15.104:0/287630647 shutdown_connections 2024-05-08T04:24:54.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.883+0000 7f9f29b5c640 1 -- 172.21.15.104:0/287630647 wait complete. 2024-05-08T04:24:54.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.885+0000 7f9f29b5c640 1 Processor -- start 2024-05-08T04:24:54.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.885+0000 7f9f29b5c640 1 -- start start 2024-05-08T04:24:54.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.885+0000 7f9f29b5c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240ce5a0 0x7f9f240b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.885+0000 7f9f29b5c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f240d05f0 0x7f9f240b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.885+0000 7f9f29b5c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2415de10 0x7f9f240b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.885+0000 7f9f29b5c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24162090 con 0x7f9f240ce5a0 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.885+0000 7f9f29b5c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240d1a90 con 0x7f9f2415de10 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.885+0000 7f9f29b5c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24162370 con 0x7f9f240d05f0 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f237fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240ce5a0 0x7f9f240b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f237fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240ce5a0 0x7f9f240b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39390/0 (socket says 172.21.15.104:39390) 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f237fe640 1 -- 172.21.15.104:0/2552048582 learned_addr learned my addr 172.21.15.104:0/2552048582 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f237fe640 1 -- 172.21.15.104:0/2552048582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f240d05f0 msgr2=0x7f9f240b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f237fe640 1 --2- 172.21.15.104:0/2552048582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f240d05f0 0x7f9f240b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f237fe640 1 -- 172.21.15.104:0/2552048582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2415de10 msgr2=0x7f9f240b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f237fe640 1 --2- 172.21.15.104:0/2552048582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2415de10 0x7f9f240b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f237fe640 1 -- 172.21.15.104:0/2552048582 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f24161080 con 0x7f9f240ce5a0 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f237fe640 1 --2- 172.21.15.104:0/2552048582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240ce5a0 0x7f9f240b5110 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9f14000c00 tx=0x7f9f140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f0bfff640 1 -- 172.21.15.104:0/2552048582 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14041020 con 0x7f9f240ce5a0 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f0bfff640 1 -- 172.21.15.104:0/2552048582 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f14030970 con 0x7f9f240ce5a0 2024-05-08T04:24:54.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f29b5c640 1 -- 172.21.15.104:0/2552048582 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f240b4350 con 0x7f9f240ce5a0 2024-05-08T04:24:54.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f0bfff640 1 -- 172.21.15.104:0/2552048582 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14037040 con 0x7f9f240ce5a0 2024-05-08T04:24:54.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.886+0000 7f9f29b5c640 1 -- 172.21.15.104:0/2552048582 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f240b4910 con 0x7f9f240ce5a0 2024-05-08T04:24:54.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.887+0000 7f9f29b5c640 1 -- 172.21.15.104:0/2552048582 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f24075010 con 0x7f9f240ce5a0 2024-05-08T04:24:54.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.888+0000 7f9f0bfff640 1 -- 172.21.15.104:0/2552048582 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f9f14044020 con 0x7f9f240ce5a0 2024-05-08T04:24:54.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.888+0000 7f9f0bfff640 1 --2- 172.21.15.104:0/2552048582 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9f1006b710 0x7f9f1006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:54.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.888+0000 7f9f0bfff640 1 -- 172.21.15.104:0/2552048582 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9f140ab0b0 con 0x7f9f240ce5a0 2024-05-08T04:24:54.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.888+0000 7f9f22ffd640 1 --2- 172.21.15.104:0/2552048582 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9f1006b710 0x7f9f1006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:54.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.889+0000 7f9f22ffd640 1 --2- 172.21.15.104:0/2552048582 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9f1006b710 0x7f9f1006dbd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9f18006fd0 tx=0x7f9f18008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:54.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:54.892+0000 7f9f0bfff640 1 -- 172.21.15.104:0/2552048582 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9f1404b030 con 0x7f9f240ce5a0 2024-05-08T04:24:55.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.073+0000 7f9f29b5c640 1 -- 172.21.15.104:0/2552048582 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9f240d14c0 con 0x7f9f240ce5a0 2024-05-08T04:24:55.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.073+0000 7f9f0bfff640 1 -- 172.21.15.104:0/2552048582 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9f14079b90 con 0x7f9f240ce5a0 2024-05-08T04:24:55.076 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:24:55.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.075+0000 7f9f29b5c640 1 -- 172.21.15.104:0/2552048582 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9f1006b710 msgr2=0x7f9f1006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.075+0000 7f9f29b5c640 1 --2- 172.21.15.104:0/2552048582 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9f1006b710 0x7f9f1006dbd0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9f18006fd0 tx=0x7f9f18008040 comp rx=0 tx=0).stop 2024-05-08T04:24:55.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.075+0000 7f9f29b5c640 1 -- 172.21.15.104:0/2552048582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240ce5a0 msgr2=0x7f9f240b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.075+0000 7f9f29b5c640 1 --2- 172.21.15.104:0/2552048582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240ce5a0 0x7f9f240b5110 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9f14000c00 tx=0x7f9f140046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.075+0000 7f9f29b5c640 1 -- 172.21.15.104:0/2552048582 shutdown_connections 2024-05-08T04:24:55.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.075+0000 7f9f29b5c640 1 --2- 172.21.15.104:0/2552048582 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9f1006b710 0x7f9f1006dbd0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.075+0000 7f9f29b5c640 1 --2- 172.21.15.104:0/2552048582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2415de10 0x7f9f240b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.075+0000 7f9f29b5c640 1 --2- 172.21.15.104:0/2552048582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f240d05f0 0x7f9f240b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.075+0000 7f9f29b5c640 1 --2- 172.21.15.104:0/2552048582 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f240ce5a0 0x7f9f240b5110 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.075+0000 7f9f29b5c640 1 -- 172.21.15.104:0/2552048582 >> 172.21.15.104:0/2552048582 conn(0x7f9f24072290 msgr2=0x7f9f240b6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:55.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.075+0000 7f9f29b5c640 1 -- 172.21.15.104:0/2552048582 shutdown_connections 2024-05-08T04:24:55.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.076+0000 7f9f29b5c640 1 -- 172.21.15.104:0/2552048582 wait complete. 2024-05-08T04:24:55.088 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi104.front.sepia.ceph.com... 2024-05-08T04:24:55.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:55.089 DEBUG:teuthology.orchestra.run.smithi104:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-08T04:24:55.112 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi104.stderr:ceph-fuse[58504]: fuse finished with error 0 and tester_r 0 2024-05-08T04:24:55.114 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:24:55.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:55.114 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T04:24:55.225 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:24:55.225 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:24:55.245 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:24:55.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.343+0000 7f9b287f4640 1 Processor -- start 2024-05-08T04:24:55.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.343+0000 7f9b287f4640 1 -- start start 2024-05-08T04:24:55.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.344+0000 7f9b287f4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9b20099a40 0x7f9b20099e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.344+0000 7f9b287f4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9b200cf360 0x7f9b200cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.344+0000 7f9b287f4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b2015f540 0x7f9b2015f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.344+0000 7f9b287f4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2015ced0 con 0x7f9b20099a40 2024-05-08T04:24:55.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.344+0000 7f9b287f4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b200cc700 con 0x7f9b200cf360 2024-05-08T04:24:55.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.344+0000 7f9b287f4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2009a360 con 0x7f9b2015f540 2024-05-08T04:24:55.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.345+0000 7f9b26590640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9b20099a40 0x7f9b20099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.345+0000 7f9b26590640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f9b20099a40 0x7f9b20099e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39400/0 (socket says 172.21.15.104:39400) 2024-05-08T04:24:55.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.345+0000 7f9b26590640 1 -- 172.21.15.104:0/870306079 learned_addr learned my addr 172.21.15.104:0/870306079 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:55.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.345+0000 7f9b26d91640 1 --2- 172.21.15.104:0/870306079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b2015f540 0x7f9b2015f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.345+0000 7f9b25d8f640 1 --2- 172.21.15.104:0/870306079 >> v2:172.21.15.183:3300/0 conn(0x7f9b200cf360 0x7f9b200cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.345+0000 7f9b26590640 1 -- 172.21.15.104:0/870306079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b2015f540 msgr2=0x7f9b2015f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:55.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.345+0000 7f9b26590640 1 --2- 172.21.15.104:0/870306079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b2015f540 0x7f9b2015f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.345+0000 7f9b26590640 1 -- 172.21.15.104:0/870306079 >> v2:172.21.15.183:3300/0 conn(0x7f9b200cf360 msgr2=0x7f9b200cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:55.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.345+0000 7f9b26590640 1 --2- 172.21.15.104:0/870306079 >> v2:172.21.15.183:3300/0 conn(0x7f9b200cf360 0x7f9b200cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.345+0000 7f9b26590640 1 -- 172.21.15.104:0/870306079 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b200d0020 con 0x7f9b20099a40 2024-05-08T04:24:55.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.345+0000 7f9b25d8f640 1 --2- 172.21.15.104:0/870306079 >> v2:172.21.15.183:3300/0 conn(0x7f9b200cf360 0x7f9b200cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:55.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.345+0000 7f9b26d91640 1 --2- 172.21.15.104:0/870306079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b2015f540 0x7f9b2015f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:55.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.346+0000 7f9b26590640 1 --2- 172.21.15.104:0/870306079 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b20099a40 0x7f9b20099e20 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9b20072b30 tx=0x7f9b1c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b637fe7b537c358 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:55.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.346+0000 7f9b2558e640 1 -- 172.21.15.104:0/870306079 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c004030 con 0x7f9b20099a40 2024-05-08T04:24:55.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.346+0000 7f9b2558e640 1 -- 172.21.15.104:0/870306079 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c0041d0 con 0x7f9b20099a40 2024-05-08T04:24:55.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.346+0000 7f9b2558e640 1 -- 172.21.15.104:0/870306079 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c003610 con 0x7f9b20099a40 2024-05-08T04:24:55.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.346+0000 7f9b287f4640 1 -- 172.21.15.104:0/870306079 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b20099a40 msgr2=0x7f9b20099e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.346+0000 7f9b287f4640 1 --2- 172.21.15.104:0/870306079 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b20099a40 0x7f9b20099e20 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9b20072b30 tx=0x7f9b1c02a1c0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.346+0000 7f9b287f4640 1 -- 172.21.15.104:0/870306079 shutdown_connections 2024-05-08T04:24:55.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.346+0000 7f9b287f4640 1 --2- 172.21.15.104:0/870306079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b2015f540 0x7f9b2015f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.346+0000 7f9b287f4640 1 --2- 172.21.15.104:0/870306079 >> v2:172.21.15.183:3300/0 conn(0x7f9b200cf360 0x7f9b200cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.346+0000 7f9b287f4640 1 --2- 172.21.15.104:0/870306079 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b20099a40 0x7f9b20099e20 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.346+0000 7f9b287f4640 1 -- 172.21.15.104:0/870306079 >> 172.21.15.104:0/870306079 conn(0x7f9b200b3280 msgr2=0x7f9b200b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.346+0000 7f9b287f4640 1 -- 172.21.15.104:0/870306079 shutdown_connections 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.346+0000 7f9b287f4640 1 -- 172.21.15.104:0/870306079 wait complete. 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.347+0000 7f9b287f4640 1 Processor -- start 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.348+0000 7f9b287f4640 1 -- start start 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.348+0000 7f9b287f4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b20099a40 0x7f9b20156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.348+0000 7f9b287f4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b200cf360 0x7f9b200cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.348+0000 7f9b287f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b2015f540 0x7f9b200ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.348+0000 7f9b287f4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b200cfd30 con 0x7f9b2015f540 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.348+0000 7f9b287f4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b200d05e0 con 0x7f9b20099a40 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.348+0000 7f9b287f4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20159860 con 0x7f9b200cf360 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.348+0000 7f9b26d91640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b2015f540 0x7f9b200ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.348+0000 7f9b26d91640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b2015f540 0x7f9b200ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39410/0 (socket says 172.21.15.104:39410) 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.348+0000 7f9b26d91640 1 -- 172.21.15.104:0/3072282754 learned_addr learned my addr 172.21.15.104:0/3072282754 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.348+0000 7f9b25d8f640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b200cf360 0x7f9b200cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.349+0000 7f9b26590640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b20099a40 0x7f9b20156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.349+0000 7f9b26d91640 1 -- 172.21.15.104:0/3072282754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b200cf360 msgr2=0x7f9b200cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.349+0000 7f9b26d91640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b200cf360 0x7f9b200cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.349+0000 7f9b26d91640 1 -- 172.21.15.104:0/3072282754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b20099a40 msgr2=0x7f9b20156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.349+0000 7f9b26d91640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b20099a40 0x7f9b20156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.349+0000 7f9b26d91640 1 -- 172.21.15.104:0/3072282754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2015d0f0 con 0x7f9b2015f540 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.349+0000 7f9b26d91640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b2015f540 0x7f9b200ce1a0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800cef0 tx=0x7f9b1800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.349+0000 7f9b16ffd640 1 -- 172.21.15.104:0/3072282754 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1801a070 con 0x7f9b2015f540 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.349+0000 7f9b16ffd640 1 -- 172.21.15.104:0/3072282754 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1800d860 con 0x7f9b2015f540 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.349+0000 7f9b16ffd640 1 -- 172.21.15.104:0/3072282754 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1800dc50 con 0x7f9b2015f540 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.349+0000 7f9b287f4640 1 -- 172.21.15.104:0/3072282754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2015d390 con 0x7f9b2015f540 2024-05-08T04:24:55.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.349+0000 7f9b287f4640 1 -- 172.21.15.104:0/3072282754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2015d950 con 0x7f9b2015f540 2024-05-08T04:24:55.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.350+0000 7f9b287f4640 1 -- 172.21.15.104:0/3072282754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b20075010 con 0x7f9b2015f540 2024-05-08T04:24:55.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.350+0000 7f9b16ffd640 1 -- 172.21.15.104:0/3072282754 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f9b1801d070 con 0x7f9b2015f540 2024-05-08T04:24:55.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.351+0000 7f9b16ffd640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b0406b710 0x7f9b0406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.351+0000 7f9b16ffd640 1 -- 172.21.15.104:0/3072282754 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9b1808aef0 con 0x7f9b2015f540 2024-05-08T04:24:55.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.351+0000 7f9b26590640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b0406b710 0x7f9b0406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.351+0000 7f9b26590640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b0406b710 0x7f9b0406dbd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c033000 tx=0x7f9b1c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:55.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.355+0000 7f9b16ffd640 1 -- 172.21.15.104:0/3072282754 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b18059a90 con 0x7f9b2015f540 2024-05-08T04:24:55.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.525+0000 7f9b287f4640 1 -- 172.21.15.104:0/3072282754 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b20071b90 con 0x7f9b2015f540 2024-05-08T04:24:55.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.526+0000 7f9b16ffd640 1 -- 172.21.15.104:0/3072282754 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16821 (secure 0 0 0) 0x7f9b18059390 con 0x7f9b2015f540 2024-05-08T04:24:55.529 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:55.529 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":61,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:24:52.781593+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:24:36.286493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-08T04:24:37.038502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.14","mappings":[{"from":6,"to":1}]},{"pgid":"9.3b","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:24:55.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.528+0000 7f9b287f4640 1 -- 172.21.15.104:0/3072282754 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b0406b710 msgr2=0x7f9b0406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.528+0000 7f9b287f4640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b0406b710 0x7f9b0406dbd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c033000 tx=0x7f9b1c02e000 comp rx=0 tx=0).stop 2024-05-08T04:24:55.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.528+0000 7f9b287f4640 1 -- 172.21.15.104:0/3072282754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b2015f540 msgr2=0x7f9b200ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.528+0000 7f9b287f4640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b2015f540 0x7f9b200ce1a0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800cef0 tx=0x7f9b1800a710 comp rx=0 tx=0).stop 2024-05-08T04:24:55.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.528+0000 7f9b287f4640 1 -- 172.21.15.104:0/3072282754 shutdown_connections 2024-05-08T04:24:55.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.528+0000 7f9b287f4640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f9b0406b710 0x7f9b0406dbd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.528+0000 7f9b287f4640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b2015f540 0x7f9b200ce1a0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.528+0000 7f9b287f4640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b200cf360 0x7f9b200cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.528+0000 7f9b287f4640 1 --2- 172.21.15.104:0/3072282754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b20099a40 0x7f9b20156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.528+0000 7f9b287f4640 1 -- 172.21.15.104:0/3072282754 >> 172.21.15.104:0/3072282754 conn(0x7f9b200b3280 msgr2=0x7f9b200b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:55.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.528+0000 7f9b287f4640 1 -- 172.21.15.104:0/3072282754 shutdown_connections 2024-05-08T04:24:55.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.528+0000 7f9b287f4640 1 -- 172.21.15.104:0/3072282754 wait complete. 2024-05-08T04:24:55.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:24:36.286493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:24:37.038502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:24:55.542 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:24:55.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.642+0000 7f83a4258640 1 Processor -- start 2024-05-08T04:24:55.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.642+0000 7f83a4258640 1 -- start start 2024-05-08T04:24:55.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.643+0000 7f83a4258640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f839c0b2b80 0x7f839c09a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.643+0000 7f83a4258640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f839c099a40 0x7f839c099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.643+0000 7f83a4258640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f839c15d490 0x7f839c15d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.643+0000 7f83a4258640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839c09a3e0 con 0x7f839c0b2b80 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.643+0000 7f83a4258640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839c0cd940 con 0x7f839c099a40 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.643+0000 7f83a4258640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c0cc8a0 con 0x7f839c15d490 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.643+0000 7f83a1ff4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f839c0b2b80 0x7f839c09a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.643+0000 7f83a1ff4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f839c0b2b80 0x7f839c09a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39424/0 (socket says 172.21.15.104:39424) 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.643+0000 7f83a1ff4640 1 -- 172.21.15.104:0/1793312736 learned_addr learned my addr 172.21.15.104:0/1793312736 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.643+0000 7f83a17f3640 1 --2- 172.21.15.104:0/1793312736 >> v2:172.21.15.183:3300/0 conn(0x7f839c099a40 0x7f839c099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.643+0000 7f83a27f5640 1 --2- 172.21.15.104:0/1793312736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f839c15d490 0x7f839c15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.644+0000 7f83a1ff4640 1 -- 172.21.15.104:0/1793312736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f839c15d490 msgr2=0x7f839c15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.644+0000 7f83a1ff4640 1 --2- 172.21.15.104:0/1793312736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f839c15d490 0x7f839c15d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.644+0000 7f83a1ff4640 1 -- 172.21.15.104:0/1793312736 >> v2:172.21.15.183:3300/0 conn(0x7f839c099a40 msgr2=0x7f839c099ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.644+0000 7f83a1ff4640 1 --2- 172.21.15.104:0/1793312736 >> v2:172.21.15.183:3300/0 conn(0x7f839c099a40 0x7f839c099ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.644+0000 7f83a1ff4640 1 -- 172.21.15.104:0/1793312736 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c0ccb80 con 0x7f839c0b2b80 2024-05-08T04:24:55.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.644+0000 7f83a27f5640 1 --2- 172.21.15.104:0/1793312736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f839c15d490 0x7f839c15d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:55.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.644+0000 7f83a1ff4640 1 --2- 172.21.15.104:0/1793312736 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839c0b2b80 0x7f839c09a9b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f839c1617d0 tx=0x7f839802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15bd959c4c8a522 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:55.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.644+0000 7f83a0ff2640 1 -- 172.21.15.104:0/1793312736 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398037070 con 0x7f839c0b2b80 2024-05-08T04:24:55.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.645+0000 7f83a0ff2640 1 -- 172.21.15.104:0/1793312736 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8398032440 con 0x7f839c0b2b80 2024-05-08T04:24:55.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.645+0000 7f83a0ff2640 1 -- 172.21.15.104:0/1793312736 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398032810 con 0x7f839c0b2b80 2024-05-08T04:24:55.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.645+0000 7f83a4258640 1 -- 172.21.15.104:0/1793312736 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839c0b2b80 msgr2=0x7f839c09a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.645+0000 7f83a4258640 1 --2- 172.21.15.104:0/1793312736 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839c0b2b80 0x7f839c09a9b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f839c1617d0 tx=0x7f839802a270 comp rx=0 tx=0).stop 2024-05-08T04:24:55.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.645+0000 7f83a4258640 1 -- 172.21.15.104:0/1793312736 shutdown_connections 2024-05-08T04:24:55.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.645+0000 7f83a4258640 1 --2- 172.21.15.104:0/1793312736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f839c15d490 0x7f839c15d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.645+0000 7f83a4258640 1 --2- 172.21.15.104:0/1793312736 >> v2:172.21.15.183:3300/0 conn(0x7f839c099a40 0x7f839c099ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.645+0000 7f83a4258640 1 --2- 172.21.15.104:0/1793312736 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839c0b2b80 0x7f839c09a9b0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.645+0000 7f83a4258640 1 -- 172.21.15.104:0/1793312736 >> 172.21.15.104:0/1793312736 conn(0x7f839c0b3310 msgr2=0x7f839c0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:55.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.645+0000 7f83a4258640 1 -- 172.21.15.104:0/1793312736 shutdown_connections 2024-05-08T04:24:55.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.645+0000 7f83a4258640 1 -- 172.21.15.104:0/1793312736 wait complete. 2024-05-08T04:24:55.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.646+0000 7f83a4258640 1 Processor -- start 2024-05-08T04:24:55.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.646+0000 7f83a4258640 1 -- start start 2024-05-08T04:24:55.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.647+0000 7f83a4258640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839c099a40 0x7f839c151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.647+0000 7f83a4258640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f839c0b2b80 0x7f839c06cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.647+0000 7f83a4258640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f839c15d490 0x7f839c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.647+0000 7f83a4258640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c09aef0 con 0x7f839c099a40 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.647+0000 7f83a4258640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c0cd140 con 0x7f839c0b2b80 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.647+0000 7f83a4258640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c0cf830 con 0x7f839c15d490 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.647+0000 7f83a1ff4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839c099a40 0x7f839c151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.647+0000 7f83a1ff4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839c099a40 0x7f839c151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39432/0 (socket says 172.21.15.104:39432) 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.647+0000 7f83a1ff4640 1 -- 172.21.15.104:0/3038518844 learned_addr learned my addr 172.21.15.104:0/3038518844 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.647+0000 7f83a17f3640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f839c0b2b80 0x7f839c06cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.647+0000 7f83a27f5640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f839c15d490 0x7f839c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.648+0000 7f83a1ff4640 1 -- 172.21.15.104:0/3038518844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f839c15d490 msgr2=0x7f839c06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.648+0000 7f83a1ff4640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f839c15d490 0x7f839c06d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.648+0000 7f83a1ff4640 1 -- 172.21.15.104:0/3038518844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f839c0b2b80 msgr2=0x7f839c06cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.648+0000 7f83a1ff4640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f839c0b2b80 0x7f839c06cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.648+0000 7f83a1ff4640 1 -- 172.21.15.104:0/3038518844 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c15dc30 con 0x7f839c099a40 2024-05-08T04:24:55.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.648+0000 7f83a27f5640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f839c15d490 0x7f839c06d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:55.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.648+0000 7f83a1ff4640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839c099a40 0x7f839c151c50 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f839802a2b0 tx=0x7f83980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:55.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.648+0000 7f83927fc640 1 -- 172.21.15.104:0/3038518844 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398037040 con 0x7f839c099a40 2024-05-08T04:24:55.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.648+0000 7f83927fc640 1 -- 172.21.15.104:0/3038518844 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8398042070 con 0x7f839c099a40 2024-05-08T04:24:55.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.648+0000 7f83a4258640 1 -- 172.21.15.104:0/3038518844 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839c1f4290 con 0x7f839c099a40 2024-05-08T04:24:55.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.648+0000 7f83927fc640 1 -- 172.21.15.104:0/3038518844 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398030880 con 0x7f839c099a40 2024-05-08T04:24:55.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.648+0000 7f83a4258640 1 -- 172.21.15.104:0/3038518844 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839c15fd30 con 0x7f839c099a40 2024-05-08T04:24:55.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.649+0000 7f83a4258640 1 -- 172.21.15.104:0/3038518844 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839c075010 con 0x7f839c099a40 2024-05-08T04:24:55.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.649+0000 7f83927fc640 1 -- 172.21.15.104:0/3038518844 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f8398030a20 con 0x7f839c099a40 2024-05-08T04:24:55.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.650+0000 7f83927fc640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f838006b710 0x7f838006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.650+0000 7f83927fc640 1 -- 172.21.15.104:0/3038518844 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f83980aae60 con 0x7f839c099a40 2024-05-08T04:24:55.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.650+0000 7f83a17f3640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f838006b710 0x7f838006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.650+0000 7f83a17f3640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f838006b710 0x7f838006dbd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f839c09f7d0 tx=0x7f838c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:55.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.654+0000 7f83927fc640 1 -- 172.21.15.104:0/3038518844 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f839c15dc30 con 0x7f839c099a40 2024-05-08T04:24:55.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.826+0000 7f83a4258640 1 -- 172.21.15.104:0/3038518844 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f839c06e2f0 con 0x7f839c099a40 2024-05-08T04:24:55.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.827+0000 7f83927fc640 1 -- 172.21.15.104:0/3038518844 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83980799d0 con 0x7f839c099a40 2024-05-08T04:24:55.829 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:24:55.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.829+0000 7f83a4258640 1 -- 172.21.15.104:0/3038518844 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f838006b710 msgr2=0x7f838006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.829+0000 7f83a4258640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f838006b710 0x7f838006dbd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f839c09f7d0 tx=0x7f838c008040 comp rx=0 tx=0).stop 2024-05-08T04:24:55.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.829+0000 7f83a4258640 1 -- 172.21.15.104:0/3038518844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839c099a40 msgr2=0x7f839c151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.829+0000 7f83a4258640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839c099a40 0x7f839c151c50 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f839802a2b0 tx=0x7f83980046c0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.829+0000 7f83a4258640 1 -- 172.21.15.104:0/3038518844 shutdown_connections 2024-05-08T04:24:55.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.829+0000 7f83a4258640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f838006b710 0x7f838006dbd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.829+0000 7f83a4258640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f839c0b2b80 0x7f839c06cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.829+0000 7f83a4258640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f839c15d490 0x7f839c06d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.829+0000 7f83a4258640 1 --2- 172.21.15.104:0/3038518844 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f839c099a40 0x7f839c151c50 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.829+0000 7f83a4258640 1 -- 172.21.15.104:0/3038518844 >> 172.21.15.104:0/3038518844 conn(0x7f839c0b3310 msgr2=0x7f839c06c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.829+0000 7f83a4258640 1 -- 172.21.15.104:0/3038518844 shutdown_connections 2024-05-08T04:24:55.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.829+0000 7f83a4258640 1 -- 172.21.15.104:0/3038518844 wait complete. 2024-05-08T04:24:55.842 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:24:55.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.942+0000 7fac91a5d640 1 Processor -- start 2024-05-08T04:24:55.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.942+0000 7fac91a5d640 1 -- start start 2024-05-08T04:24:55.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac91a5d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fac8c0ce5a0 0x7fac8c161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac91a5d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac8c0d07c0 0x7fac8c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac91a5d640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c15e1f0 con 0x7fac8c15de10 2024-05-08T04:24:55.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac91a5d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c0d0f50 con 0x7fac8c0ce5a0 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac91a5d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c161e60 con 0x7fac8c0d07c0 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8affd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fac8c15de10 0x7fac8c0d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54510/0 (socket says 172.21.15.104:54510) 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8affd640 1 -- 172.21.15.104:0/884308706 learned_addr learned my addr 172.21.15.104:0/884308706 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506141228 0 0) 0x7fac8c15e1f0 con 0x7fac8c15de10 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac78003520 con 0x7fac8c15de10 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8b7fe640 1 --2- 172.21.15.104:0/884308706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac8c0d07c0 0x7fac8c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac83fff640 1 --2- 172.21.15.104:0/884308706 >> v2:172.21.15.183:3300/0 conn(0x7fac8c0ce5a0 0x7fac8c161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 277843873 0 0) 0x7fac78003520 con 0x7fac8c15de10 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac8c0d07c0 msgr2=0x7fac8c0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 --2- 172.21.15.104:0/884308706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac8c0d07c0 0x7fac8c0d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 >> v2:172.21.15.183:3300/0 conn(0x7fac8c0ce5a0 msgr2=0x7fac8c161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 --2- 172.21.15.104:0/884308706 >> v2:172.21.15.183:3300/0 conn(0x7fac8c0ce5a0 0x7fac8c161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c162090 con 0x7fac8c15de10 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fac7c001670 con 0x7fac8c15de10 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 >> v1:172.21.15.104:6789/0 conn(0x7fac8c15de10 legacy=0x7fac8c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 --2- 172.21.15.104:0/884308706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac780039b0 0x7fac78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 --2- 172.21.15.104:0/884308706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac8c0d07c0 0x7fac78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 --2- 172.21.15.104:0/884308706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac78004d40 0x7fac780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0d0f50 con 0x7fac780039b0 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7800b9c0 con 0x7fac78004d40 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7800bb70 con 0x7fac8c0d07c0 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.943+0000 7fac8affd640 1 --2- 172.21.15.104:0/884308706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac780039b0 0x7fac78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.944+0000 7fac83fff640 1 --2- 172.21.15.104:0/884308706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac8c0d07c0 0x7fac78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.944+0000 7fac8b7fe640 1 --2- 172.21.15.104:0/884308706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac78004d40 0x7fac780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.944+0000 7fac8affd640 1 -- 172.21.15.104:0/884308706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac8c0d07c0 msgr2=0x7fac78004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.944+0000 7fac8affd640 1 --2- 172.21.15.104:0/884308706 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac8c0d07c0 0x7fac78004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.944+0000 7fac8affd640 1 -- 172.21.15.104:0/884308706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac78004d40 msgr2=0x7fac780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.944+0000 7fac8affd640 1 --2- 172.21.15.104:0/884308706 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac78004d40 0x7fac780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.944+0000 7fac8affd640 1 -- 172.21.15.104:0/884308706 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac78003520 con 0x7fac780039b0 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.944+0000 7fac8affd640 1 --2- 172.21.15.104:0/884308706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac780039b0 0x7fac78003dd0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00c240 tx=0x7fac78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7b47d75d69cd73 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:55.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.944+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c007d60 con 0x7fac780039b0 2024-05-08T04:24:55.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.944+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c005ad0 con 0x7fac780039b0 2024-05-08T04:24:55.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.944+0000 7fac8a7fc640 1 -- 172.21.15.104:0/884308706 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c007070 con 0x7fac780039b0 2024-05-08T04:24:55.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.945+0000 7fac91a5d640 1 -- 172.21.15.104:0/884308706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac780039b0 msgr2=0x7fac78003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.945+0000 7fac91a5d640 1 --2- 172.21.15.104:0/884308706 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac780039b0 0x7fac78003dd0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00c240 tx=0x7fac78005830 comp rx=0 tx=0).stop 2024-05-08T04:24:55.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.945+0000 7fac8b7fe640 1 -- 172.21.15.104:0/884308706 reap_dead start 2024-05-08T04:24:55.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.945+0000 7fac91a5d640 1 -- 172.21.15.104:0/884308706 shutdown_connections 2024-05-08T04:24:55.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.945+0000 7fac91a5d640 1 -- 172.21.15.104:0/884308706 >> 172.21.15.104:0/884308706 conn(0x7fac8c072290 msgr2=0x7fac8c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:55.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.945+0000 7fac91a5d640 1 -- 172.21.15.104:0/884308706 shutdown_connections 2024-05-08T04:24:55.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.945+0000 7fac91a5d640 1 -- 172.21.15.104:0/884308706 wait complete. 2024-05-08T04:24:55.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.946+0000 7fac91a5d640 1 Processor -- start 2024-05-08T04:24:55.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.946+0000 7fac91a5d640 1 -- start start 2024-05-08T04:24:55.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac91a5d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac780039b0 0x7fac8c0c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac91a5d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac8c0b5590 0x7fac8c15b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac91a5d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac8c15b940 0x7fac8c1f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac91a5d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c162650 con 0x7fac8c15b940 2024-05-08T04:24:55.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac91a5d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0d1a90 con 0x7fac8c0b5590 2024-05-08T04:24:55.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac91a5d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0d1ce0 con 0x7fac780039b0 2024-05-08T04:24:55.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac8b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac8c15b940 0x7fac8c1f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac8b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac8c15b940 0x7fac8c1f6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39448/0 (socket says 172.21.15.104:39448) 2024-05-08T04:24:55.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac8b7fe640 1 -- 172.21.15.104:0/918619768 learned_addr learned my addr 172.21.15.104:0/918619768 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac83fff640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac8c0b5590 0x7fac8c15b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac8affd640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac780039b0 0x7fac8c0c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac8b7fe640 1 -- 172.21.15.104:0/918619768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac780039b0 msgr2=0x7fac8c0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac8b7fe640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac780039b0 0x7fac8c0c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac8b7fe640 1 -- 172.21.15.104:0/918619768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac8c0b5590 msgr2=0x7fac8c15b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac8b7fe640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac8c0b5590 0x7fac8c15b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac8b7fe640 1 -- 172.21.15.104:0/918619768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c15a490 con 0x7fac8c15b940 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.947+0000 7fac8affd640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac780039b0 0x7fac8c0c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.948+0000 7fac8b7fe640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac8c15b940 0x7fac8c1f6e10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fac8c068910 tx=0x7fac840115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.948+0000 7fac88ff9640 1 -- 172.21.15.104:0/918619768 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84011de0 con 0x7fac8c15b940 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.948+0000 7fac88ff9640 1 -- 172.21.15.104:0/918619768 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8401b070 con 0x7fac8c15b940 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.948+0000 7fac91a5d640 1 -- 172.21.15.104:0/918619768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c15a770 con 0x7fac8c15b940 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.948+0000 7fac88ff9640 1 -- 172.21.15.104:0/918619768 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84003990 con 0x7fac8c15b940 2024-05-08T04:24:55.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.948+0000 7fac91a5d640 1 -- 172.21.15.104:0/918619768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c15ad30 con 0x7fac8c15b940 2024-05-08T04:24:55.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.949+0000 7fac91a5d640 1 -- 172.21.15.104:0/918619768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8c075010 con 0x7fac8c15b940 2024-05-08T04:24:55.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.949+0000 7fac88ff9640 1 -- 172.21.15.104:0/918619768 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fac84003b30 con 0x7fac8c15b940 2024-05-08T04:24:55.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.950+0000 7fac88ff9640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fac6c06b740 0x7fac6c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:55.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.950+0000 7fac88ff9640 1 -- 172.21.15.104:0/918619768 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fac8408af70 con 0x7fac8c15b940 2024-05-08T04:24:55.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.950+0000 7fac8affd640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fac6c06b740 0x7fac6c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:55.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.950+0000 7fac8affd640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fac6c06b740 0x7fac6c06dc00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fac7c033000 tx=0x7fac7c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:55.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:55.954+0000 7fac88ff9640 1 -- 172.21.15.104:0/918619768 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac84003e20 con 0x7fac8c15b940 2024-05-08T04:24:56.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.122+0000 7fac91a5d640 1 -- 172.21.15.104:0/918619768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac8c0d1870 con 0x7fac8c15b940 2024-05-08T04:24:56.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.123+0000 7fac88ff9640 1 -- 172.21.15.104:0/918619768 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7fac84059940 con 0x7fac8c15b940 2024-05-08T04:24:56.125 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:24:56.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.124+0000 7fac91a5d640 1 -- 172.21.15.104:0/918619768 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fac6c06b740 msgr2=0x7fac6c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.124+0000 7fac91a5d640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fac6c06b740 0x7fac6c06dc00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fac7c033000 tx=0x7fac7c02e000 comp rx=0 tx=0).stop 2024-05-08T04:24:56.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.124+0000 7fac91a5d640 1 -- 172.21.15.104:0/918619768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac8c15b940 msgr2=0x7fac8c1f6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.124+0000 7fac91a5d640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac8c15b940 0x7fac8c1f6e10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fac8c068910 tx=0x7fac840115a0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.124+0000 7fac91a5d640 1 -- 172.21.15.104:0/918619768 shutdown_connections 2024-05-08T04:24:56.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.124+0000 7fac91a5d640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fac6c06b740 0x7fac6c06dc00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.124+0000 7fac91a5d640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac8c0b5590 0x7fac8c15b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.125+0000 7fac91a5d640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac8c15b940 0x7fac8c1f6e10 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.125+0000 7fac91a5d640 1 --2- 172.21.15.104:0/918619768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac780039b0 0x7fac8c0c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.125+0000 7fac91a5d640 1 -- 172.21.15.104:0/918619768 >> 172.21.15.104:0/918619768 conn(0x7fac8c072290 msgr2=0x7fac8c0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:56.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.125+0000 7fac91a5d640 1 -- 172.21.15.104:0/918619768 shutdown_connections 2024-05-08T04:24:56.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.125+0000 7fac91a5d640 1 -- 172.21.15.104:0/918619768 wait complete. 2024-05-08T04:24:56.138 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:24:56.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.238+0000 7f1b1dfe7640 1 Processor -- start 2024-05-08T04:24:56.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.238+0000 7f1b1dfe7640 1 -- start start 2024-05-08T04:24:56.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.239+0000 7f1b1dfe7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1b180cc930 0x7f1b180ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.239+0000 7f1b1dfe7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1b1806e860 0x7f1b1815fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.239+0000 7f1b1dfe7640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b18071fb0 con 0x7f1b180711c0 2024-05-08T04:24:56.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.239+0000 7f1b1dfe7640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b180cd250 con 0x7f1b180cc930 2024-05-08T04:24:56.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.239+0000 7f1b1dfe7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b18071710 con 0x7f1b1806e860 2024-05-08T04:24:56.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.239+0000 7f1b177fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f1b180cc930 0x7f1b180ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:56.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.239+0000 7f1b16ffd640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f1b180711c0 0x7f1b1815f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54518/0 (socket says 172.21.15.104:54518) 2024-05-08T04:24:56.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.239+0000 7f1b16ffd640 1 -- 172.21.15.104:0/1869974954 learned_addr learned my addr 172.21.15.104:0/1869974954 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:56.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.240+0000 7f1b177fe640 1 -- 172.21.15.104:0/1869974954 >> v2:172.21.15.183:3300/0 conn(0x7f1b1806e860 msgr2=0x7f1b1815fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:56.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.240+0000 7f1b177fe640 1 --2- 172.21.15.104:0/1869974954 >> v2:172.21.15.183:3300/0 conn(0x7f1b1806e860 0x7f1b1815fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.240+0000 7f1b177fe640 1 -- 172.21.15.104:0/1869974954 >> v1:172.21.15.104:6789/0 conn(0x7f1b180711c0 legacy=0x7f1b1815f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.240+0000 7f1b177fe640 1 -- 172.21.15.104:0/1869974954 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b180719f0 con 0x7f1b180cc930 2024-05-08T04:24:56.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.240+0000 7f1b167fc640 1 -- 172.21.15.104:0/1869974954 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798204069 0 0) 0x7f1b18071fb0 con 0x7f1b180711c0 2024-05-08T04:24:56.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.240+0000 7f1b177fe640 1 --2- 172.21.15.104:0/1869974954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b180cc930 0x7f1b180ccd10 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1b180af2f0 tx=0x7f1b0802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625f0eb79403d4b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:56.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.240+0000 7f1b167fc640 1 -- 172.21.15.104:0/1869974954 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08007740 con 0x7f1b180cc930 2024-05-08T04:24:56.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.241+0000 7f1b167fc640 1 -- 172.21.15.104:0/1869974954 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b080078e0 con 0x7f1b180cc930 2024-05-08T04:24:56.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.241+0000 7f1b167fc640 1 -- 172.21.15.104:0/1869974954 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08007cb0 con 0x7f1b180cc930 2024-05-08T04:24:56.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.241+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/1869974954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b180cc930 msgr2=0x7f1b180ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.241+0000 7f1b1dfe7640 1 --2- 172.21.15.104:0/1869974954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b180cc930 0x7f1b180ccd10 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1b180af2f0 tx=0x7f1b0802a5f0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.241+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/1869974954 shutdown_connections 2024-05-08T04:24:56.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.241+0000 7f1b1dfe7640 1 --2- 172.21.15.104:0/1869974954 >> v2:172.21.15.183:3300/0 conn(0x7f1b1806e860 0x7f1b1815fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.241+0000 7f1b1dfe7640 1 --2- 172.21.15.104:0/1869974954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b180cc930 0x7f1b180ccd10 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.241+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/1869974954 >> 172.21.15.104:0/1869974954 conn(0x7f1b180b13f0 msgr2=0x7f1b180b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:56.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.241+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/1869974954 shutdown_connections 2024-05-08T04:24:56.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.241+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/1869974954 wait complete. 2024-05-08T04:24:56.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.242+0000 7f1b1dfe7640 1 Processor -- start 2024-05-08T04:24:56.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.242+0000 7f1b1dfe7640 1 -- start start 2024-05-08T04:24:56.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b1dfe7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b1806e860 0x7f1b1813de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b1dfe7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b180711c0 0x7f1b181f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b1dfe7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b180cc930 0x7f1b18140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b1dfe7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b180cf3b0 con 0x7f1b180cc930 2024-05-08T04:24:56.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b1dfe7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1806d330 con 0x7f1b1806e860 2024-05-08T04:24:56.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b1dfe7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b181453f0 con 0x7f1b180711c0 2024-05-08T04:24:56.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b17fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b180cc930 0x7f1b18140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:56.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b17fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b180cc930 0x7f1b18140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39464/0 (socket says 172.21.15.104:39464) 2024-05-08T04:24:56.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b17fff640 1 -- 172.21.15.104:0/2310530913 learned_addr learned my addr 172.21.15.104:0/2310530913 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:56.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b17fff640 1 -- 172.21.15.104:0/2310530913 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b180711c0 msgr2=0x7f1b181f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b17fff640 1 --2- 172.21.15.104:0/2310530913 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b180711c0 0x7f1b181f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b17fff640 1 -- 172.21.15.104:0/2310530913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b1806e860 msgr2=0x7f1b1813de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b17fff640 1 --2- 172.21.15.104:0/2310530913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b1806e860 0x7f1b1813de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.243+0000 7f1b17fff640 1 -- 172.21.15.104:0/2310530913 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b181f50d0 con 0x7f1b180cc930 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.244+0000 7f1b17fff640 1 --2- 172.21.15.104:0/2310530913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b180cc930 0x7f1b18140e20 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000b410 tx=0x7f1b1000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.244+0000 7f1afffff640 1 -- 172.21.15.104:0/2310530913 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b10015020 con 0x7f1b180cc930 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.244+0000 7f1afffff640 1 -- 172.21.15.104:0/2310530913 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b10011850 con 0x7f1b180cc930 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.244+0000 7f1afffff640 1 -- 172.21.15.104:0/2310530913 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b10011c40 con 0x7f1b180cc930 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.244+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/2310530913 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1813fa90 con 0x7f1b180cc930 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.244+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/2310530913 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1813d320 con 0x7f1b180cc930 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.245+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/2310530913 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b180cd540 con 0x7f1b180cc930 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.245+0000 7f1afffff640 1 -- 172.21.15.104:0/2310530913 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f1b10018020 con 0x7f1b180cc930 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.246+0000 7f1afffff640 1 --2- 172.21.15.104:0/2310530913 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1b0406b710 0x7f1b0406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.246+0000 7f1afffff640 1 -- 172.21.15.104:0/2310530913 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1b1008a520 con 0x7f1b180cc930 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.246+0000 7f1b177fe640 1 --2- 172.21.15.104:0/2310530913 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1b0406b710 0x7f1b0406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.246+0000 7f1b177fe640 1 --2- 172.21.15.104:0/2310530913 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1b0406b710 0x7f1b0406dbd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1b08034000 tx=0x7f1b0802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:56.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.250+0000 7f1afffff640 1 -- 172.21.15.104:0/2310530913 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b180cd540 con 0x7f1b180cc930 2024-05-08T04:24:56.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.419+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/2310530913 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b18075010 con 0x7f1b180cc930 2024-05-08T04:24:56.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.419+0000 7f1afffff640 1 -- 172.21.15.104:0/2310530913 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1b1001f020 con 0x7f1b180cc930 2024-05-08T04:24:56.421 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:24:56.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.421+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/2310530913 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1b0406b710 msgr2=0x7f1b0406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.421+0000 7f1b1dfe7640 1 --2- 172.21.15.104:0/2310530913 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1b0406b710 0x7f1b0406dbd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1b08034000 tx=0x7f1b0802e000 comp rx=0 tx=0).stop 2024-05-08T04:24:56.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.421+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/2310530913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b180cc930 msgr2=0x7f1b18140e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.421+0000 7f1b1dfe7640 1 --2- 172.21.15.104:0/2310530913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b180cc930 0x7f1b18140e20 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000b410 tx=0x7f1b1000b8d0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.421+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/2310530913 shutdown_connections 2024-05-08T04:24:56.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.421+0000 7f1b1dfe7640 1 --2- 172.21.15.104:0/2310530913 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f1b0406b710 0x7f1b0406dbd0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.421+0000 7f1b1dfe7640 1 --2- 172.21.15.104:0/2310530913 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b180cc930 0x7f1b18140e20 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.421+0000 7f1b1dfe7640 1 --2- 172.21.15.104:0/2310530913 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b180711c0 0x7f1b181f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.421+0000 7f1b1dfe7640 1 --2- 172.21.15.104:0/2310530913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b1806e860 0x7f1b1813de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.421+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/2310530913 >> 172.21.15.104:0/2310530913 conn(0x7f1b180b13f0 msgr2=0x7f1b180a8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:56.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.421+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/2310530913 shutdown_connections 2024-05-08T04:24:56.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.421+0000 7f1b1dfe7640 1 -- 172.21.15.104:0/2310530913 wait complete. 2024-05-08T04:24:56.434 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T04:24:56.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.533+0000 7f011a7f4640 1 Processor -- start 2024-05-08T04:24:56.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.533+0000 7f011a7f4640 1 -- start start 2024-05-08T04:24:56.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f011a7f4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0114161190 0x7f0114072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f011a7f4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0114072a70 0x7f01140acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f011a7f4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011406de30 con 0x7f01140ad330 2024-05-08T04:24:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f011a7f4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01140b4db0 con 0x7f0114072a70 2024-05-08T04:24:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f011a7f4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011406e110 con 0x7f0114161190 2024-05-08T04:24:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0118d91640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f01140ad330 0x7f011406bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54526/0 (socket says 172.21.15.104:54526) 2024-05-08T04:24:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0118d91640 1 -- 172.21.15.104:0/2382302773 learned_addr learned my addr 172.21.15.104:0/2382302773 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f01137fe640 1 --2- 172.21.15.104:0/2382302773 >> v2:172.21.15.183:3300/0 conn(0x7f0114072a70 0x7f01140acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0113fff640 1 --2- 172.21.15.104:0/2382302773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0114161190 0x7f0114072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862793530 0 0) 0x7f011406de30 con 0x7f01140ad330 2024-05-08T04:24:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00fc003520 con 0x7f01140ad330 2024-05-08T04:24:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2535744216 0 0) 0x7f00fc003520 con 0x7f01140ad330 2024-05-08T04:24:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0114161190 msgr2=0x7f0114072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:56.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0112ffd640 1 --2- 172.21.15.104:0/2382302773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0114161190 0x7f0114072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 >> v2:172.21.15.183:3300/0 conn(0x7f0114072a70 msgr2=0x7f01140acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0112ffd640 1 --2- 172.21.15.104:0/2382302773 >> v2:172.21.15.183:3300/0 conn(0x7f0114072a70 0x7f01140acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011406e3f0 con 0x7f01140ad330 2024-05-08T04:24:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f010c0019f0 con 0x7f01140ad330 2024-05-08T04:24:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 >> v1:172.21.15.104:6789/0 conn(0x7f01140ad330 legacy=0x7f011406bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0112ffd640 1 --2- 172.21.15.104:0/2382302773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0114161190 0x7f00fc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0112ffd640 1 --2- 172.21.15.104:0/2382302773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00fc003f30 0x7f00fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.534+0000 7f0112ffd640 1 --2- 172.21.15.104:0/2382302773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00fc004d40 0x7f00fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.535+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011406e110 con 0x7f00fc004d40 2024-05-08T04:24:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.535+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc00b9c0 con 0x7f00fc003f30 2024-05-08T04:24:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.535+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc00bb40 con 0x7f0114161190 2024-05-08T04:24:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.535+0000 7f0118d91640 1 --2- 172.21.15.104:0/2382302773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00fc004d40 0x7f00fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:56.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.535+0000 7f0113fff640 1 --2- 172.21.15.104:0/2382302773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0114161190 0x7f00fc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.535+0000 7f01137fe640 1 --2- 172.21.15.104:0/2382302773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00fc003f30 0x7f00fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.535+0000 7f0118d91640 1 -- 172.21.15.104:0/2382302773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0114161190 msgr2=0x7f00fc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.535+0000 7f0118d91640 1 --2- 172.21.15.104:0/2382302773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0114161190 0x7f00fc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.535+0000 7f0118d91640 1 -- 172.21.15.104:0/2382302773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00fc003f30 msgr2=0x7f00fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.535+0000 7f0118d91640 1 --2- 172.21.15.104:0/2382302773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00fc003f30 0x7f00fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.535+0000 7f0118d91640 1 -- 172.21.15.104:0/2382302773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc003520 con 0x7f00fc004d40 2024-05-08T04:24:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.536+0000 7f0118d91640 1 --2- 172.21.15.104:0/2382302773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00fc004d40 0x7f00fc0051c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f010c00a920 tx=0x7f00fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c12819d95afbd4f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.536+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c00a4c0 con 0x7f00fc004d40 2024-05-08T04:24:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.536+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c02f070 con 0x7f00fc004d40 2024-05-08T04:24:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.536+0000 7f0112ffd640 1 -- 172.21.15.104:0/2382302773 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c02bd60 con 0x7f00fc004d40 2024-05-08T04:24:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.536+0000 7f011a7f4640 1 -- 172.21.15.104:0/2382302773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00fc004d40 msgr2=0x7f00fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.536+0000 7f011a7f4640 1 --2- 172.21.15.104:0/2382302773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f00fc004d40 0x7f00fc0051c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f010c00a920 tx=0x7f00fc005830 comp rx=0 tx=0).stop 2024-05-08T04:24:56.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.536+0000 7f0118d91640 1 -- 172.21.15.104:0/2382302773 reap_dead start 2024-05-08T04:24:56.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.536+0000 7f011a7f4640 1 -- 172.21.15.104:0/2382302773 shutdown_connections 2024-05-08T04:24:56.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.536+0000 7f011a7f4640 1 -- 172.21.15.104:0/2382302773 >> 172.21.15.104:0/2382302773 conn(0x7f0114071a10 msgr2=0x7f0114071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:56.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.536+0000 7f011a7f4640 1 -- 172.21.15.104:0/2382302773 shutdown_connections 2024-05-08T04:24:56.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.536+0000 7f011a7f4640 1 -- 172.21.15.104:0/2382302773 wait complete. 2024-05-08T04:24:56.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.537+0000 7f011a7f4640 1 Processor -- start 2024-05-08T04:24:56.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.538+0000 7f011a7f4640 1 -- start start 2024-05-08T04:24:56.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.538+0000 7f011a7f4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00fc004d40 0x7f0114157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.538+0000 7f011a7f4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0114156440 0x7f011413e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.538+0000 7f011a7f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01141526c0 0x7f011414f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.538+0000 7f011a7f4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011406da70 con 0x7f01141526c0 2024-05-08T04:24:56.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.538+0000 7f011a7f4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011406e9b0 con 0x7f00fc004d40 2024-05-08T04:24:56.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.538+0000 7f011a7f4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011406dbf0 con 0x7f0114156440 2024-05-08T04:24:56.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.538+0000 7f0118d91640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01141526c0 0x7f011414f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:56.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f0118d91640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01141526c0 0x7f011414f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39482/0 (socket says 172.21.15.104:39482) 2024-05-08T04:24:56.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f0118d91640 1 -- 172.21.15.104:0/3823190040 learned_addr learned my addr 172.21.15.104:0/3823190040 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:56.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f0113fff640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00fc004d40 0x7f0114157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:56.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f01137fe640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0114156440 0x7f011413e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:56.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f0118d91640 1 -- 172.21.15.104:0/3823190040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0114156440 msgr2=0x7f011413e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f0118d91640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0114156440 0x7f011413e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f0118d91640 1 -- 172.21.15.104:0/3823190040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00fc004d40 msgr2=0x7f0114157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f0118d91640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00fc004d40 0x7f0114157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f0118d91640 1 -- 172.21.15.104:0/3823190040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01141569e0 con 0x7f01141526c0 2024-05-08T04:24:56.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f0118d91640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01141526c0 0x7f011414f8b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f010c02b550 tx=0x7f01140ad780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:56.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f0110ff9640 1 -- 172.21.15.104:0/3823190040 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c044070 con 0x7f01141526c0 2024-05-08T04:24:56.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f0110ff9640 1 -- 172.21.15.104:0/3823190040 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c001a00 con 0x7f01141526c0 2024-05-08T04:24:56.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f011a7f4640 1 -- 172.21.15.104:0/3823190040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0114156cc0 con 0x7f01141526c0 2024-05-08T04:24:56.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f0110ff9640 1 -- 172.21.15.104:0/3823190040 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c00a4c0 con 0x7f01141526c0 2024-05-08T04:24:56.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.539+0000 7f011a7f4640 1 -- 172.21.15.104:0/3823190040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0114157280 con 0x7f01141526c0 2024-05-08T04:24:56.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.540+0000 7f011a7f4640 1 -- 172.21.15.104:0/3823190040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01140cf340 con 0x7f01141526c0 2024-05-08T04:24:56.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.541+0000 7f0110ff9640 1 -- 172.21.15.104:0/3823190040 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f010c047070 con 0x7f01141526c0 2024-05-08T04:24:56.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.541+0000 7f0110ff9640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f010006b710 0x7f010006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:56.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.541+0000 7f0110ff9640 1 -- 172.21.15.104:0/3823190040 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f010c0aa5c0 con 0x7f01141526c0 2024-05-08T04:24:56.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.541+0000 7f0113fff640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f010006b710 0x7f010006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:56.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.541+0000 7f0113fff640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f010006b710 0x7f010006dbd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f01040099e0 tx=0x7f0104008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:56.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.545+0000 7f0110ff9640 1 -- 172.21.15.104:0/3823190040 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f01140cf340 con 0x7f01141526c0 2024-05-08T04:24:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.727+0000 7f011a7f4640 1 -- 172.21.15.104:0/3823190040 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f01140b48d0 con 0x7f01141526c0 2024-05-08T04:24:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.728+0000 7f0110ff9640 1 -- 172.21.15.104:0/3823190040 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7f01140b48d0 con 0x7f01141526c0 2024-05-08T04:24:56.730 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-05-08T04:24:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.730+0000 7f011a7f4640 1 -- 172.21.15.104:0/3823190040 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f010006b710 msgr2=0x7f010006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.730+0000 7f011a7f4640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f010006b710 0x7f010006dbd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f01040099e0 tx=0x7f0104008040 comp rx=0 tx=0).stop 2024-05-08T04:24:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.730+0000 7f011a7f4640 1 -- 172.21.15.104:0/3823190040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01141526c0 msgr2=0x7f011414f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.730+0000 7f011a7f4640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01141526c0 0x7f011414f8b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f010c02b550 tx=0x7f01140ad780 comp rx=0 tx=0).stop 2024-05-08T04:24:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.730+0000 7f011a7f4640 1 -- 172.21.15.104:0/3823190040 shutdown_connections 2024-05-08T04:24:56.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.730+0000 7f011a7f4640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f010006b710 0x7f010006dbd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.730+0000 7f011a7f4640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01141526c0 0x7f011414f8b0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.730+0000 7f011a7f4640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0114156440 0x7f011413e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.730+0000 7f011a7f4640 1 --2- 172.21.15.104:0/3823190040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00fc004d40 0x7f0114157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:56.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.730+0000 7f011a7f4640 1 -- 172.21.15.104:0/3823190040 >> 172.21.15.104:0/3823190040 conn(0x7f0114071a10 msgr2=0x7f011415b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:56.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.730+0000 7f011a7f4640 1 -- 172.21.15.104:0/3823190040 shutdown_connections 2024-05-08T04:24:56.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:56.730+0000 7f011a7f4640 1 -- 172.21.15.104:0/3823190040 wait complete. 2024-05-08T04:24:56.743 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi183.front.sepia.ceph.com... 2024-05-08T04:24:56.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:56.743 DEBUG:teuthology.orchestra.run.smithi183:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-08T04:24:56.772 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi183.stderr:ceph-fuse[44236]: fuse finished with error 0 and tester_r 0 2024-05-08T04:24:56.774 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:24:56.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:56.774 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-08T04:24:56.919 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:24:56.919 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:24:56.935 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=587 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T04:24:56.935 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:24:56.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:56.936 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-08T04:24:56.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:24:56.991 INFO:teuthology.orchestra.run.smithi104.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-05-08T04:24:56.992 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:24:56.992 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:24:57.010 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13681 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T04:24:57.010 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:24:57.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:24:57.010 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-08T04:24:57.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:24:57.067 INFO:teuthology.orchestra.run.smithi183.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-05-08T04:24:57.067 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:57.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.165+0000 7fac1901f640 1 Processor -- start 2024-05-08T04:24:57.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.166+0000 7fac1901f640 1 -- start start 2024-05-08T04:24:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.166+0000 7fac1901f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac1415ba10 0x7fac14099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.166+0000 7fac1901f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fac140d04f0 0x7fac140b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.166+0000 7fac1901f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac140cc5d0 con 0x7fac1415ee90 2024-05-08T04:24:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.166+0000 7fac1901f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1409a340 con 0x7fac140d04f0 2024-05-08T04:24:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.166+0000 7fac1901f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1409a620 con 0x7fac1415ba10 2024-05-08T04:24:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac0bfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fac1415ee90 0x7fac140cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:54540/0 (socket says 172.21.15.104:54540) 2024-05-08T04:24:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac0bfff640 1 -- 172.21.15.104:0/2706763059 learned_addr learned my addr 172.21.15.104:0/2706763059 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1359e640 1 --2- 172.21.15.104:0/2706763059 >> v2:172.21.15.183:3300/0 conn(0x7fac140d04f0 0x7fac140b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac12d9d640 1 --2- 172.21.15.104:0/2706763059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac1415ba10 0x7fac14099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737618324 0 0) 0x7fac140cc5d0 con 0x7fac1415ee90 2024-05-08T04:24:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac00003520 con 0x7fac1415ee90 2024-05-08T04:24:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3153931626 0 0) 0x7fac00003520 con 0x7fac1415ee90 2024-05-08T04:24:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac1415ba10 msgr2=0x7fac14099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 --2- 172.21.15.104:0/2706763059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac1415ba10 0x7fac14099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 >> v2:172.21.15.183:3300/0 conn(0x7fac140d04f0 msgr2=0x7fac140b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 --2- 172.21.15.104:0/2706763059 >> v2:172.21.15.183:3300/0 conn(0x7fac140d04f0 0x7fac140b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1409a900 con 0x7fac1415ee90 2024-05-08T04:24:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fabfc001670 con 0x7fac1415ee90 2024-05-08T04:24:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 >> v1:172.21.15.104:6789/0 conn(0x7fac1415ee90 legacy=0x7fac140cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 --2- 172.21.15.104:0/2706763059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac000039b0 0x7fac00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 --2- 172.21.15.104:0/2706763059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac00004800 0x7fac00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 --2- 172.21.15.104:0/2706763059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac1415ba10 0x7fac000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1409a340 con 0x7fac00004800 2024-05-08T04:24:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1409a620 con 0x7fac000039b0 2024-05-08T04:24:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0000b9c0 con 0x7fac1415ba10 2024-05-08T04:24:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac0bfff640 1 --2- 172.21.15.104:0/2706763059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac00004800 0x7fac00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac12d9d640 1 --2- 172.21.15.104:0/2706763059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac000039b0 0x7fac00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac1359e640 1 --2- 172.21.15.104:0/2706763059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac1415ba10 0x7fac000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac0bfff640 1 -- 172.21.15.104:0/2706763059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac1415ba10 msgr2=0x7fac000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:57.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac0bfff640 1 --2- 172.21.15.104:0/2706763059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac1415ba10 0x7fac000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac0bfff640 1 -- 172.21.15.104:0/2706763059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac000039b0 msgr2=0x7fac00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:57.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac0bfff640 1 --2- 172.21.15.104:0/2706763059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac000039b0 0x7fac00003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.167+0000 7fac0bfff640 1 -- 172.21.15.104:0/2706763059 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac00003520 con 0x7fac00004800 2024-05-08T04:24:57.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.168+0000 7fac0bfff640 1 --2- 172.21.15.104:0/2706763059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac00004800 0x7fac00004c80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fabfc001050 tx=0x7fac00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7dd5bcc0bf94a78 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:57.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.168+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc02e070 con 0x7fac00004800 2024-05-08T04:24:57.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.168+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc005af0 con 0x7fac00004800 2024-05-08T04:24:57.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.168+0000 7fac1259c640 1 -- 172.21.15.104:0/2706763059 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc007d70 con 0x7fac00004800 2024-05-08T04:24:57.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.169+0000 7fac1901f640 1 -- 172.21.15.104:0/2706763059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac00004800 msgr2=0x7fac00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.169+0000 7fac1901f640 1 --2- 172.21.15.104:0/2706763059 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac00004800 0x7fac00004c80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fabfc001050 tx=0x7fac00005830 comp rx=0 tx=0).stop 2024-05-08T04:24:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.169+0000 7fac1359e640 1 -- 172.21.15.104:0/2706763059 reap_dead start 2024-05-08T04:24:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.169+0000 7fac1901f640 1 -- 172.21.15.104:0/2706763059 shutdown_connections 2024-05-08T04:24:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.169+0000 7fac1901f640 1 -- 172.21.15.104:0/2706763059 >> 172.21.15.104:0/2706763059 conn(0x7fac140b3280 msgr2=0x7fac140b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.169+0000 7fac1901f640 1 -- 172.21.15.104:0/2706763059 shutdown_connections 2024-05-08T04:24:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.169+0000 7fac1901f640 1 -- 172.21.15.104:0/2706763059 wait complete. 2024-05-08T04:24:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.170+0000 7fac1901f640 1 Processor -- start 2024-05-08T04:24:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.170+0000 7fac1901f640 1 -- start start 2024-05-08T04:24:57.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac1901f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac00004800 0x7fac1414abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac1901f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac1415bdf0 0x7fac140ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac1901f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac141605f0 0x7fac14160aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac1901f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1406bdf0 con 0x7fac00004800 2024-05-08T04:24:57.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac1901f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1406bc70 con 0x7fac1415bdf0 2024-05-08T04:24:57.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac1901f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac14099a40 con 0x7fac141605f0 2024-05-08T04:24:57.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac12d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac00004800 0x7fac1414abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac12d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac00004800 0x7fac1414abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39506/0 (socket says 172.21.15.104:39506) 2024-05-08T04:24:57.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac12d9d640 1 -- 172.21.15.104:0/1696722738 learned_addr learned my addr 172.21.15.104:0/1696722738 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:57.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac12d9d640 1 -- 172.21.15.104:0/1696722738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac141605f0 msgr2=0x7fac14160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac12d9d640 1 --2- 172.21.15.104:0/1696722738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac141605f0 0x7fac14160aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac12d9d640 1 -- 172.21.15.104:0/1696722738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac1415bdf0 msgr2=0x7fac140ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac12d9d640 1 --2- 172.21.15.104:0/1696722738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac1415bdf0 0x7fac140ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac12d9d640 1 -- 172.21.15.104:0/1696722738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140b4c50 con 0x7fac00004800 2024-05-08T04:24:57.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac12d9d640 1 --2- 172.21.15.104:0/1696722738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac00004800 0x7fac1414abc0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fac040114f0 tx=0x7fac040119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:57.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.171+0000 7fac0b7fe640 1 -- 172.21.15.104:0/1696722738 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04015870 con 0x7fac00004800 2024-05-08T04:24:57.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.172+0000 7fac0b7fe640 1 -- 172.21.15.104:0/1696722738 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac04015a10 con 0x7fac00004800 2024-05-08T04:24:57.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.172+0000 7fac1901f640 1 -- 172.21.15.104:0/1696722738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1415c360 con 0x7fac00004800 2024-05-08T04:24:57.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.172+0000 7fac0b7fe640 1 -- 172.21.15.104:0/1696722738 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04015dc0 con 0x7fac00004800 2024-05-08T04:24:57.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.172+0000 7fac1901f640 1 -- 172.21.15.104:0/1696722738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1415c920 con 0x7fac00004800 2024-05-08T04:24:57.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.172+0000 7fac1901f640 1 -- 172.21.15.104:0/1696722738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac14075010 con 0x7fac00004800 2024-05-08T04:24:57.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.173+0000 7fac0b7fe640 1 -- 172.21.15.104:0/1696722738 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fac0401d400 con 0x7fac00004800 2024-05-08T04:24:57.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.173+0000 7fac0b7fe640 1 --2- 172.21.15.104:0/1696722738 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fabf406b710 0x7fabf406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.173+0000 7fac0b7fe640 1 -- 172.21.15.104:0/1696722738 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fac0408ad80 con 0x7fac00004800 2024-05-08T04:24:57.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.173+0000 7fac0bfff640 1 --2- 172.21.15.104:0/1696722738 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fabf406b710 0x7fabf406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.174+0000 7fac0bfff640 1 --2- 172.21.15.104:0/1696722738 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fabf406b710 0x7fabf406dbd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fabfc033000 tx=0x7fabfc007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:57.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.178+0000 7fac0b7fe640 1 -- 172.21.15.104:0/1696722738 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac04019030 con 0x7fac00004800 2024-05-08T04:24:57.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.381+0000 7fac1901f640 1 -- 172.21.15.104:0/1696722738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac140cfbc0 con 0x7fac00004800 2024-05-08T04:24:57.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.382+0000 7fac0b7fe640 1 -- 172.21.15.104:0/1696722738 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fac040598f0 con 0x7fac00004800 2024-05-08T04:24:57.384 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:57.384 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5336,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1609011099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1609011099},{"type":"v1","addr":"172.21.15.183:6834","nonce":1609011099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6354,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3867059822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3867059822},{"type":"v1","addr":"172.21.15.104:6835","nonce":3867059822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6357,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/3119972029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":3119972029},{"type":"v1","addr":"172.21.15.104:6837","nonce":3119972029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:24:38.063241+0000","modified":"2024-05-08T04:24:40.069539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6366":{"gid":6366,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/495908291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":495908291},{"type":"v1","addr":"172.21.15.183:6835","nonce":495908291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-05-08T04:24:57.385 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 29 2024-05-08T04:24:57.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.384+0000 7fac1901f640 1 -- 172.21.15.104:0/1696722738 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fabf406b710 msgr2=0x7fabf406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.384+0000 7fac1901f640 1 --2- 172.21.15.104:0/1696722738 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fabf406b710 0x7fabf406dbd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fabfc033000 tx=0x7fabfc007000 comp rx=0 tx=0).stop 2024-05-08T04:24:57.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.384+0000 7fac1901f640 1 -- 172.21.15.104:0/1696722738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac00004800 msgr2=0x7fac1414abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.384+0000 7fac1901f640 1 --2- 172.21.15.104:0/1696722738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac00004800 0x7fac1414abc0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fac040114f0 tx=0x7fac040119b0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.384+0000 7fac1901f640 1 -- 172.21.15.104:0/1696722738 shutdown_connections 2024-05-08T04:24:57.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.384+0000 7fac1901f640 1 --2- 172.21.15.104:0/1696722738 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fabf406b710 0x7fabf406dbd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.384+0000 7fac1901f640 1 --2- 172.21.15.104:0/1696722738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac1415bdf0 0x7fac140ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.384+0000 7fac1901f640 1 --2- 172.21.15.104:0/1696722738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac141605f0 0x7fac14160aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.384+0000 7fac1901f640 1 --2- 172.21.15.104:0/1696722738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac00004800 0x7fac1414abc0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.384+0000 7fac1901f640 1 -- 172.21.15.104:0/1696722738 >> 172.21.15.104:0/1696722738 conn(0x7fac140b3280 msgr2=0x7fac140cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:57.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.384+0000 7fac1901f640 1 -- 172.21.15.104:0/1696722738 shutdown_connections 2024-05-08T04:24:57.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.384+0000 7fac1901f640 1 -- 172.21.15.104:0/1696722738 wait complete. 2024-05-08T04:24:57.397 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:24:57.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.496+0000 7f7af4702640 1 Processor -- start 2024-05-08T04:24:57.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.496+0000 7f7af4702640 1 -- start start 2024-05-08T04:24:57.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.497+0000 7f7af4702640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7aec0b4700 0x7f7aec0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.497+0000 7f7af4702640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec15e780 con 0x7f7aec0ceee0 2024-05-08T04:24:57.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.497+0000 7f7af4702640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec15ea60 con 0x7f7aec06ea40 2024-05-08T04:24:57.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.497+0000 7f7af4702640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec15f390 con 0x7f7aec0b4700 2024-05-08T04:24:57.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.497+0000 7f7af249e640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f7aec0ceee0 0x7f7aec06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:37402/0 (socket says 172.21.15.104:37402) 2024-05-08T04:24:57.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.497+0000 7f7af249e640 1 -- 172.21.15.104:0/1424372106 learned_addr learned my addr 172.21.15.104:0/1424372106 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:57.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.497+0000 7f7af2c9f640 1 --2- 172.21.15.104:0/1424372106 >> v2:172.21.15.183:3300/0 conn(0x7f7aec0b4700 0x7f7aec0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.497+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864686446 0 0) 0x7f7aec15e780 con 0x7f7aec0ceee0 2024-05-08T04:24:57.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.497+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ad4003520 con 0x7f7aec0ceee0 2024-05-08T04:24:57.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 392089958 0 0) 0x7f7ad4003520 con 0x7f7aec0ceee0 2024-05-08T04:24:57.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 >> v2:172.21.15.183:3300/0 conn(0x7f7aec0b4700 msgr2=0x7f7aec0b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:57.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af149c640 1 --2- 172.21.15.104:0/1424372106 >> v2:172.21.15.183:3300/0 conn(0x7f7aec0b4700 0x7f7aec0b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 >> v1:172.21.15.183:6789/0 conn(0x7f7aec06ea40 legacy=0x7f7aec0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec15ed40 con 0x7f7aec0ceee0 2024-05-08T04:24:57.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f7adc0019f0 con 0x7f7aec0ceee0 2024-05-08T04:24:57.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 >> v1:172.21.15.104:6789/0 conn(0x7f7aec0ceee0 legacy=0x7f7aec06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af149c640 1 --2- 172.21.15.104:0/1424372106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad40039b0 0x7f7ad4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af149c640 1 --2- 172.21.15.104:0/1424372106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad4004800 0x7f7ad4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af149c640 1 --2- 172.21.15.104:0/1424372106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ad40051c0 0x7f7ad400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec15f390 con 0x7f7ad40039b0 2024-05-08T04:24:57.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad400c090 con 0x7f7ad4004800 2024-05-08T04:24:57.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad400c290 con 0x7f7ad40051c0 2024-05-08T04:24:57.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af249e640 1 --2- 172.21.15.104:0/1424372106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad40039b0 0x7f7ad4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af1c9d640 1 --2- 172.21.15.104:0/1424372106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad4004800 0x7f7ad4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af2c9f640 1 --2- 172.21.15.104:0/1424372106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ad40051c0 0x7f7ad400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af249e640 1 -- 172.21.15.104:0/1424372106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ad40051c0 msgr2=0x7f7ad400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:57.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af249e640 1 --2- 172.21.15.104:0/1424372106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ad40051c0 0x7f7ad400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af249e640 1 -- 172.21.15.104:0/1424372106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad4004800 msgr2=0x7f7ad4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:57.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af249e640 1 --2- 172.21.15.104:0/1424372106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad4004800 0x7f7ad4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af249e640 1 -- 172.21.15.104:0/1424372106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad4003520 con 0x7f7ad40039b0 2024-05-08T04:24:57.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.498+0000 7f7af2c9f640 1 -- 172.21.15.104:0/1424372106 reap_dead start 2024-05-08T04:24:57.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.499+0000 7f7af249e640 1 --2- 172.21.15.104:0/1424372106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad40039b0 0x7f7ad4003df0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00a830 tx=0x7f7ad4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c7820483359372 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:57.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.499+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc00a480 con 0x7f7ad40039b0 2024-05-08T04:24:57.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.499+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc02f070 con 0x7f7ad40039b0 2024-05-08T04:24:57.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.499+0000 7f7af149c640 1 -- 172.21.15.104:0/1424372106 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc02bc50 con 0x7f7ad40039b0 2024-05-08T04:24:57.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.499+0000 7f7af4702640 1 -- 172.21.15.104:0/1424372106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad40039b0 msgr2=0x7f7ad4003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.499+0000 7f7af4702640 1 --2- 172.21.15.104:0/1424372106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad40039b0 0x7f7ad4003df0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00a830 tx=0x7f7ad4005830 comp rx=0 tx=0).stop 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.499+0000 7f7af4702640 1 -- 172.21.15.104:0/1424372106 shutdown_connections 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.499+0000 7f7af4702640 1 --2- 172.21.15.104:0/1424372106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ad40039b0 0x7f7ad4003df0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.499+0000 7f7af4702640 1 -- 172.21.15.104:0/1424372106 >> 172.21.15.104:0/1424372106 conn(0x7f7aec0b13f0 msgr2=0x7f7aec0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.500+0000 7f7af4702640 1 -- 172.21.15.104:0/1424372106 shutdown_connections 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.500+0000 7f7af4702640 1 -- 172.21.15.104:0/1424372106 wait complete. 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.501+0000 7f7af4702640 1 Processor -- start 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.501+0000 7f7af4702640 1 -- start start 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.501+0000 7f7af4702640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad40039b0 0x7f7aec15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.501+0000 7f7af4702640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7aec15d760 0x7f7aec150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.501+0000 7f7af4702640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aec1f0e60 0x7f7aec1f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.501+0000 7f7af4702640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0cf440 con 0x7f7aec15d760 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.501+0000 7f7af4702640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0cf2c0 con 0x7f7ad40039b0 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.501+0000 7f7af4702640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0b26f0 con 0x7f7aec1f0e60 2024-05-08T04:24:57.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7af1c9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7aec15d760 0x7f7aec150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7af1c9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7aec15d760 0x7f7aec150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42498/0 (socket says 172.21.15.104:42498) 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7af1c9d640 1 -- 172.21.15.104:0/2699126744 learned_addr learned my addr 172.21.15.104:0/2699126744 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7af249e640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad40039b0 0x7f7aec15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7af2c9f640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aec1f0e60 0x7f7aec1f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7af1c9d640 1 -- 172.21.15.104:0/2699126744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aec1f0e60 msgr2=0x7f7aec1f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7af1c9d640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aec1f0e60 0x7f7aec1f4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7af1c9d640 1 -- 172.21.15.104:0/2699126744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad40039b0 msgr2=0x7f7aec15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7af1c9d640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad40039b0 0x7f7aec15a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7af1c9d640 1 -- 172.21.15.104:0/2699126744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec157ca0 con 0x7f7aec15d760 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7af1c9d640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7aec15d760 0x7f7aec150f10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000f650 tx=0x7f7ae000fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7aeaffd640 1 -- 172.21.15.104:0/2699126744 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae00050d0 con 0x7f7aec15d760 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7aeaffd640 1 -- 172.21.15.104:0/2699126744 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae0018070 con 0x7f7aec15d760 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7af4702640 1 -- 172.21.15.104:0/2699126744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aec157f80 con 0x7f7aec15d760 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7aeaffd640 1 -- 172.21.15.104:0/2699126744 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0005490 con 0x7f7aec15d760 2024-05-08T04:24:57.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.502+0000 7f7af4702640 1 -- 172.21.15.104:0/2699126744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aec158540 con 0x7f7aec15d760 2024-05-08T04:24:57.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.503+0000 7f7af4702640 1 -- 172.21.15.104:0/2699126744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aec075010 con 0x7f7aec15d760 2024-05-08T04:24:57.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.504+0000 7f7aeaffd640 1 -- 172.21.15.104:0/2699126744 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f7ae000d730 con 0x7f7aec15d760 2024-05-08T04:24:57.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.504+0000 7f7aeaffd640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ad806b740 0x7f7ad806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.504+0000 7f7aeaffd640 1 -- 172.21.15.104:0/2699126744 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7ae008a1c0 con 0x7f7aec15d760 2024-05-08T04:24:57.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.504+0000 7f7af249e640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ad806b740 0x7f7ad806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.505+0000 7f7af249e640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ad806b740 0x7f7ad806dc00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00a830 tx=0x7f7adc007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:57.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.508+0000 7f7aeaffd640 1 -- 172.21.15.104:0/2699126744 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7ae00586e0 con 0x7f7aec15d760 2024-05-08T04:24:57.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.679+0000 7f7af4702640 1 -- 172.21.15.104:0/2699126744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7aec06f3f0 con 0x7f7aec15d760 2024-05-08T04:24:57.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.680+0000 7f7aeaffd640 1 -- 172.21.15.104:0/2699126744 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16821 (secure 0 0 0) 0x7f7ae005c780 con 0x7f7aec15d760 2024-05-08T04:24:57.682 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:57.683 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":61,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:24:52.781593+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:24:36.286493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-08T04:24:37.038502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.14","mappings":[{"from":6,"to":1}]},{"pgid":"9.3b","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:24:57.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.682+0000 7f7af4702640 1 -- 172.21.15.104:0/2699126744 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ad806b740 msgr2=0x7f7ad806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.682+0000 7f7af4702640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ad806b740 0x7f7ad806dc00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00a830 tx=0x7f7adc007000 comp rx=0 tx=0).stop 2024-05-08T04:24:57.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.682+0000 7f7af4702640 1 -- 172.21.15.104:0/2699126744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7aec15d760 msgr2=0x7f7aec150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.682+0000 7f7af4702640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7aec15d760 0x7f7aec150f10 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000f650 tx=0x7f7ae000fb10 comp rx=0 tx=0).stop 2024-05-08T04:24:57.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.682+0000 7f7af4702640 1 -- 172.21.15.104:0/2699126744 shutdown_connections 2024-05-08T04:24:57.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.682+0000 7f7af4702640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ad806b740 0x7f7ad806dc00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.682+0000 7f7af4702640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aec1f0e60 0x7f7aec1f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.682+0000 7f7af4702640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7aec15d760 0x7f7aec150f10 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.682+0000 7f7af4702640 1 --2- 172.21.15.104:0/2699126744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ad40039b0 0x7f7aec15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.682+0000 7f7af4702640 1 -- 172.21.15.104:0/2699126744 >> 172.21.15.104:0/2699126744 conn(0x7f7aec0b13f0 msgr2=0x7f7aec071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:57.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.682+0000 7f7af4702640 1 -- 172.21.15.104:0/2699126744 shutdown_connections 2024-05-08T04:24:57.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.682+0000 7f7af4702640 1 -- 172.21.15.104:0/2699126744 wait complete. 2024-05-08T04:24:57.696 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T04:20:58.666184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T04:24:36.286493+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T04:24:37.038502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T04:24:57.697 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T04:24:57.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.797+0000 7fbb4de53640 1 Processor -- start 2024-05-08T04:24:57.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.797+0000 7fbb4de53640 1 -- start start 2024-05-08T04:24:57.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.798+0000 7fbb4de53640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb480cdbf0 0x7fbb481668d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.798+0000 7fbb4de53640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb480cc700 con 0x7fbb480cf360 2024-05-08T04:24:57.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.798+0000 7fbb4de53640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb480d0020 con 0x7fbb48099a40 2024-05-08T04:24:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.798+0000 7fbb4de53640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4815ced0 con 0x7fbb480cdbf0 2024-05-08T04:24:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.798+0000 7fbb3ffff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fbb480cf360 0x7fbb480cf7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:37410/0 (socket says 172.21.15.104:37410) 2024-05-08T04:24:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.798+0000 7fbb3ffff640 1 -- 172.21.15.104:0/1883191748 learned_addr learned my addr 172.21.15.104:0/1883191748 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.798+0000 7fbb47fff640 1 --2- 172.21.15.104:0/1883191748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb480cdbf0 0x7fbb481668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.798+0000 7fbb47fff640 1 -- 172.21.15.104:0/1883191748 >> v1:172.21.15.183:6789/0 conn(0x7fbb48099a40 legacy=0x7fbb48099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.798+0000 7fbb47fff640 1 -- 172.21.15.104:0/1883191748 >> v1:172.21.15.104:6789/0 conn(0x7fbb480cf360 legacy=0x7fbb480cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.798+0000 7fbb47fff640 1 -- 172.21.15.104:0/1883191748 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb480d0300 con 0x7fbb480cdbf0 2024-05-08T04:24:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.799+0000 7fbb47fff640 1 --2- 172.21.15.104:0/1883191748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb480cdbf0 0x7fbb481668d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009dc0 tx=0x7fbb4002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=973ca65840a9c5c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.800+0000 7fbb46ffd640 1 -- 172.21.15.104:0/1883191748 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40007740 con 0x7fbb480cdbf0 2024-05-08T04:24:57.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.800+0000 7fbb46ffd640 1 -- 172.21.15.104:0/1883191748 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb400078e0 con 0x7fbb480cdbf0 2024-05-08T04:24:57.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.801+0000 7fbb46ffd640 1 -- 172.21.15.104:0/1883191748 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40007cb0 con 0x7fbb480cdbf0 2024-05-08T04:24:57.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.801+0000 7fbb4de53640 1 -- 172.21.15.104:0/1883191748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb480cdbf0 msgr2=0x7fbb481668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.801+0000 7fbb4de53640 1 --2- 172.21.15.104:0/1883191748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb480cdbf0 0x7fbb481668d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009dc0 tx=0x7fbb4002a6d0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.801+0000 7fbb4de53640 1 -- 172.21.15.104:0/1883191748 shutdown_connections 2024-05-08T04:24:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.801+0000 7fbb4de53640 1 --2- 172.21.15.104:0/1883191748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb480cdbf0 0x7fbb481668d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.801+0000 7fbb4de53640 1 -- 172.21.15.104:0/1883191748 >> 172.21.15.104:0/1883191748 conn(0x7fbb480b3280 msgr2=0x7fbb480b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.801+0000 7fbb4de53640 1 -- 172.21.15.104:0/1883191748 shutdown_connections 2024-05-08T04:24:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.801+0000 7fbb4de53640 1 -- 172.21.15.104:0/1883191748 wait complete. 2024-05-08T04:24:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.802+0000 7fbb4de53640 1 Processor -- start 2024-05-08T04:24:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.802+0000 7fbb4de53640 1 -- start start 2024-05-08T04:24:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.803+0000 7fbb4de53640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb48099a40 0x7fbb480b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.803+0000 7fbb4de53640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb480cdbf0 0x7fbb481489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.803+0000 7fbb4de53640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb480cf360 0x7fbb4814aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.803+0000 7fbb4de53640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb480d08c0 con 0x7fbb48099a40 2024-05-08T04:24:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.803+0000 7fbb4de53640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb48159860 con 0x7fbb480cdbf0 2024-05-08T04:24:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.803+0000 7fbb4de53640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb480d0a40 con 0x7fbb480cf360 2024-05-08T04:24:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.803+0000 7fbb477fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb48099a40 0x7fbb480b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.803+0000 7fbb477fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb48099a40 0x7fbb480b6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42504/0 (socket says 172.21.15.104:42504) 2024-05-08T04:24:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.803+0000 7fbb477fe640 1 -- 172.21.15.104:0/2128923337 learned_addr learned my addr 172.21.15.104:0/2128923337 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.803+0000 7fbb47fff640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb480cf360 0x7fbb4814aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.803+0000 7fbb477fe640 1 -- 172.21.15.104:0/2128923337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb480cf360 msgr2=0x7fbb4814aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.803+0000 7fbb3ffff640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb480cdbf0 0x7fbb481489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.803+0000 7fbb477fe640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb480cf360 0x7fbb4814aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.804+0000 7fbb477fe640 1 -- 172.21.15.104:0/2128923337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb480cdbf0 msgr2=0x7fbb481489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.804+0000 7fbb477fe640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb480cdbf0 0x7fbb481489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.804+0000 7fbb477fe640 1 -- 172.21.15.104:0/2128923337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb48159b80 con 0x7fbb48099a40 2024-05-08T04:24:57.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.804+0000 7fbb47fff640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb480cf360 0x7fbb4814aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:57.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.804+0000 7fbb3ffff640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb480cdbf0 0x7fbb481489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:57.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.804+0000 7fbb477fe640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb48099a40 0x7fbb480b6d40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c400 tx=0x7fbb3800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:57.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.804+0000 7fbb44ff9640 1 -- 172.21.15.104:0/2128923337 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb380052d0 con 0x7fbb48099a40 2024-05-08T04:24:57.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.804+0000 7fbb44ff9640 1 -- 172.21.15.104:0/2128923337 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb380054b0 con 0x7fbb48099a40 2024-05-08T04:24:57.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.804+0000 7fbb4de53640 1 -- 172.21.15.104:0/2128923337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb48159e60 con 0x7fbb48099a40 2024-05-08T04:24:57.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.804+0000 7fbb44ff9640 1 -- 172.21.15.104:0/2128923337 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb38006a40 con 0x7fbb48099a40 2024-05-08T04:24:57.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.804+0000 7fbb4de53640 1 -- 172.21.15.104:0/2128923337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4815a420 con 0x7fbb48099a40 2024-05-08T04:24:57.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.805+0000 7fbb4de53640 1 -- 172.21.15.104:0/2128923337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb48075010 con 0x7fbb48099a40 2024-05-08T04:24:57.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.805+0000 7fbb44ff9640 1 -- 172.21.15.104:0/2128923337 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fbb38006be0 con 0x7fbb48099a40 2024-05-08T04:24:57.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.806+0000 7fbb44ff9640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbb2806b710 0x7fbb2806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:57.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.806+0000 7fbb3ffff640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbb2806b710 0x7fbb2806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:57.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.806+0000 7fbb44ff9640 1 -- 172.21.15.104:0/2128923337 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbb380899b0 con 0x7fbb48099a40 2024-05-08T04:24:57.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.806+0000 7fbb3ffff640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbb2806b710 0x7fbb2806dbd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbb4815bfb0 tx=0x7fbb30009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:57.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.810+0000 7fbb44ff9640 1 -- 172.21.15.104:0/2128923337 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbb38058560 con 0x7fbb48099a40 2024-05-08T04:24:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.981+0000 7fbb4de53640 1 -- 172.21.15.104:0/2128923337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb48071b90 con 0x7fbb48099a40 2024-05-08T04:24:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.981+0000 7fbb44ff9640 1 -- 172.21.15.104:0/2128923337 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb38057e60 con 0x7fbb48099a40 2024-05-08T04:24:57.983 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-05-08T04:24:57.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.983+0000 7fbb4de53640 1 -- 172.21.15.104:0/2128923337 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbb2806b710 msgr2=0x7fbb2806dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.983+0000 7fbb4de53640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbb2806b710 0x7fbb2806dbd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbb4815bfb0 tx=0x7fbb30009040 comp rx=0 tx=0).stop 2024-05-08T04:24:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.983+0000 7fbb4de53640 1 -- 172.21.15.104:0/2128923337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb48099a40 msgr2=0x7fbb480b6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.983+0000 7fbb4de53640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb48099a40 0x7fbb480b6d40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c400 tx=0x7fbb3800c8c0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.983+0000 7fbb4de53640 1 -- 172.21.15.104:0/2128923337 shutdown_connections 2024-05-08T04:24:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.983+0000 7fbb4de53640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbb2806b710 0x7fbb2806dbd0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.983+0000 7fbb4de53640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb480cdbf0 0x7fbb481489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.983+0000 7fbb4de53640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb480cf360 0x7fbb4814aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.983+0000 7fbb4de53640 1 --2- 172.21.15.104:0/2128923337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb48099a40 0x7fbb480b6d40 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.983+0000 7fbb4de53640 1 -- 172.21.15.104:0/2128923337 >> 172.21.15.104:0/2128923337 conn(0x7fbb480b3280 msgr2=0x7fbb48099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.983+0000 7fbb4de53640 1 -- 172.21.15.104:0/2128923337 shutdown_connections 2024-05-08T04:24:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:57.983+0000 7fbb4de53640 1 -- 172.21.15.104:0/2128923337 wait complete. 2024-05-08T04:24:57.996 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T04:24:58.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.097+0000 7fe6eae41640 1 Processor -- start 2024-05-08T04:24:58.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.097+0000 7fe6eae41640 1 -- start start 2024-05-08T04:24:58.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.098+0000 7fe6eae41640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6e4159ec0 0x7fe6e406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.098+0000 7fe6eae41640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe6e4072160 0x7fe6e415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.098+0000 7fe6eae41640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e415dce0 con 0x7fe6e415a2a0 2024-05-08T04:24:58.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.098+0000 7fe6eae41640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e406eb60 con 0x7fe6e4072160 2024-05-08T04:24:58.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.098+0000 7fe6eae41640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e406ee40 con 0x7fe6e4159ec0 2024-05-08T04:24:58.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.098+0000 7fe6e93de640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe6e4072160 0x7fe6e415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.098+0000 7fe6e8bdd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6e4159ec0 0x7fe6e406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.098+0000 7fe6e8bdd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6e4159ec0 0x7fe6e406e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:57734/0 (socket says 172.21.15.104:57734) 2024-05-08T04:24:58.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.098+0000 7fe6e93de640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe6e4072160 0x7fe6e415b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.104:41716/0 (socket says 172.21.15.104:41716) 2024-05-08T04:24:58.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.098+0000 7fe6e8bdd640 1 -- 172.21.15.104:0/2696507253 learned_addr learned my addr 172.21.15.104:0/2696507253 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:58.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.098+0000 7fe6e3fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fe6e415a2a0 0x7fe6e4071a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.104:55994/0 (socket says 172.21.15.104:55994) 2024-05-08T04:24:58.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.099+0000 7fe6e8bdd640 1 -- 172.21.15.104:0/2696507253 >> v2:172.21.15.183:3300/0 conn(0x7fe6e4072160 msgr2=0x7fe6e415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:58.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.099+0000 7fe6e8bdd640 1 --2- 172.21.15.104:0/2696507253 >> v2:172.21.15.183:3300/0 conn(0x7fe6e4072160 0x7fe6e415b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.099+0000 7fe6e8bdd640 1 -- 172.21.15.104:0/2696507253 >> v1:172.21.15.183:6789/0 conn(0x7fe6e415a2a0 legacy=0x7fe6e4071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.099+0000 7fe6e8bdd640 1 -- 172.21.15.104:0/2696507253 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e415df80 con 0x7fe6e4159ec0 2024-05-08T04:24:58.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.100+0000 7fe6e8bdd640 1 --2- 172.21.15.104:0/2696507253 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6e4159ec0 0x7fe6e406e4d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009870 tx=0x7fe6d402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5476668600b191f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:58.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.100+0000 7fe6e37fe640 1 -- 172.21.15.104:0/2696507253 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4037070 con 0x7fe6e4159ec0 2024-05-08T04:24:58.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.100+0000 7fe6e37fe640 1 -- 172.21.15.104:0/2696507253 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d4032440 con 0x7fe6e4159ec0 2024-05-08T04:24:58.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.100+0000 7fe6e37fe640 1 -- 172.21.15.104:0/2696507253 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4032810 con 0x7fe6e4159ec0 2024-05-08T04:24:58.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.100+0000 7fe6eae41640 1 -- 172.21.15.104:0/2696507253 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6e4159ec0 msgr2=0x7fe6e406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.100+0000 7fe6eae41640 1 --2- 172.21.15.104:0/2696507253 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6e4159ec0 0x7fe6e406e4d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009870 tx=0x7fe6d402a270 comp rx=0 tx=0).stop 2024-05-08T04:24:58.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.100+0000 7fe6eae41640 1 -- 172.21.15.104:0/2696507253 shutdown_connections 2024-05-08T04:24:58.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.100+0000 7fe6eae41640 1 --2- 172.21.15.104:0/2696507253 >> v2:172.21.15.183:3300/0 conn(0x7fe6e4072160 0x7fe6e415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.100+0000 7fe6eae41640 1 --2- 172.21.15.104:0/2696507253 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6e4159ec0 0x7fe6e406e4d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.100+0000 7fe6eae41640 1 -- 172.21.15.104:0/2696507253 >> 172.21.15.104:0/2696507253 conn(0x7fe6e40b13f0 msgr2=0x7fe6e40b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:58.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.100+0000 7fe6eae41640 1 -- 172.21.15.104:0/2696507253 shutdown_connections 2024-05-08T04:24:58.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.100+0000 7fe6eae41640 1 -- 172.21.15.104:0/2696507253 wait complete. 2024-05-08T04:24:58.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.101+0000 7fe6eae41640 1 Processor -- start 2024-05-08T04:24:58.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.102+0000 7fe6eae41640 1 -- start start 2024-05-08T04:24:58.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.102+0000 7fe6eae41640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6e4072160 0x7fe6e413ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.102+0000 7fe6eae41640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6e4159ec0 0x7fe6e413e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.102+0000 7fe6eae41640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e415a2a0 0x7fe6e414d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.102+0000 7fe6eae41640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e415e900 con 0x7fe6e415a2a0 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.102+0000 7fe6eae41640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e415e780 con 0x7fe6e4159ec0 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.102+0000 7fe6eae41640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e415ea80 con 0x7fe6e4072160 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e93de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e415a2a0 0x7fe6e414d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e93de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e415a2a0 0x7fe6e414d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42510/0 (socket says 172.21.15.104:42510) 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e93de640 1 -- 172.21.15.104:0/2514009824 learned_addr learned my addr 172.21.15.104:0/2514009824 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e3fff640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6e4159ec0 0x7fe6e413e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e8bdd640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6e4072160 0x7fe6e413ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e93de640 1 -- 172.21.15.104:0/2514009824 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6e4072160 msgr2=0x7fe6e413ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e93de640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6e4072160 0x7fe6e413ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e93de640 1 -- 172.21.15.104:0/2514009824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6e4159ec0 msgr2=0x7fe6e413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e93de640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6e4159ec0 0x7fe6e413e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e93de640 1 -- 172.21.15.104:0/2514009824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e4156160 con 0x7fe6e415a2a0 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e93de640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e415a2a0 0x7fe6e414d4c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00e880 tx=0x7fe6dc00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:58.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e17fa640 1 -- 172.21.15.104:0/2514009824 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc017070 con 0x7fe6e415a2a0 2024-05-08T04:24:58.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e17fa640 1 -- 172.21.15.104:0/2514009824 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc00c940 con 0x7fe6e415a2a0 2024-05-08T04:24:58.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6eae41640 1 -- 172.21.15.104:0/2514009824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e4156440 con 0x7fe6e415a2a0 2024-05-08T04:24:58.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6e17fa640 1 -- 172.21.15.104:0/2514009824 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00cd30 con 0x7fe6e415a2a0 2024-05-08T04:24:58.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.103+0000 7fe6eae41640 1 -- 172.21.15.104:0/2514009824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e4156a00 con 0x7fe6e415a2a0 2024-05-08T04:24:58.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.104+0000 7fe6eae41640 1 -- 172.21.15.104:0/2514009824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e415d4d0 con 0x7fe6e415a2a0 2024-05-08T04:24:58.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.105+0000 7fe6e17fa640 1 -- 172.21.15.104:0/2514009824 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fe6dc01a070 con 0x7fe6e415a2a0 2024-05-08T04:24:58.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.105+0000 7fe6e17fa640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe6d006b710 0x7fe6d006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.105+0000 7fe6e17fa640 1 -- 172.21.15.104:0/2514009824 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe6dc08a9b0 con 0x7fe6e415a2a0 2024-05-08T04:24:58.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.105+0000 7fe6e8bdd640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe6d006b710 0x7fe6d006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.106+0000 7fe6e8bdd640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe6d006b710 0x7fe6d006dbd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4034000 tx=0x7fe6d402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:58.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.109+0000 7fe6e17fa640 1 -- 172.21.15.104:0/2514009824 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe6e415d4d0 con 0x7fe6e415a2a0 2024-05-08T04:24:58.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.280+0000 7fe6eae41640 1 -- 172.21.15.104:0/2514009824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6e4074ff0 con 0x7fe6e415a2a0 2024-05-08T04:24:58.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.280+0000 7fe6e17fa640 1 -- 172.21.15.104:0/2514009824 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe6dc058db0 con 0x7fe6e415a2a0 2024-05-08T04:24:58.283 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-05-08T04:24:58.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.282+0000 7fe6eae41640 1 -- 172.21.15.104:0/2514009824 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe6d006b710 msgr2=0x7fe6d006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.282+0000 7fe6eae41640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe6d006b710 0x7fe6d006dbd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4034000 tx=0x7fe6d402e000 comp rx=0 tx=0).stop 2024-05-08T04:24:58.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.282+0000 7fe6eae41640 1 -- 172.21.15.104:0/2514009824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e415a2a0 msgr2=0x7fe6e414d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.282+0000 7fe6eae41640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e415a2a0 0x7fe6e414d4c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00e880 tx=0x7fe6dc00ed40 comp rx=0 tx=0).stop 2024-05-08T04:24:58.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.282+0000 7fe6eae41640 1 -- 172.21.15.104:0/2514009824 shutdown_connections 2024-05-08T04:24:58.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.282+0000 7fe6eae41640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe6d006b710 0x7fe6d006dbd0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.282+0000 7fe6eae41640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6e4159ec0 0x7fe6e413e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.282+0000 7fe6eae41640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe6e415a2a0 0x7fe6e414d4c0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.282+0000 7fe6eae41640 1 --2- 172.21.15.104:0/2514009824 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6e4072160 0x7fe6e413ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.282+0000 7fe6eae41640 1 -- 172.21.15.104:0/2514009824 >> 172.21.15.104:0/2514009824 conn(0x7fe6e40b13f0 msgr2=0x7fe6e415cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:58.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.282+0000 7fe6eae41640 1 -- 172.21.15.104:0/2514009824 shutdown_connections 2024-05-08T04:24:58.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.282+0000 7fe6eae41640 1 -- 172.21.15.104:0/2514009824 wait complete. 2024-05-08T04:24:58.296 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T04:24:58.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.396+0000 7fae19d4c640 1 Processor -- start 2024-05-08T04:24:58.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.396+0000 7fae19d4c640 1 -- start start 2024-05-08T04:24:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae19d4c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae140b6c90 0x7fae140cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae19d4c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fae140d0d20 0x7fae140ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae19d4c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fae140ce750 0x7fae1415e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae19d4c640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae140cebe0 con 0x7fae140ce750 2024-05-08T04:24:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae19d4c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae140d1610 con 0x7fae140d0d20 2024-05-08T04:24:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae19d4c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae140cfee0 con 0x7fae140b6c90 2024-05-08T04:24:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae13fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fae140ce750 0x7fae1415e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae13fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fae140ce750 0x7fae1415e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42520/0 (socket says 172.21.15.104:42520) 2024-05-08T04:24:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae13fff640 1 -- 172.21.15.104:0/811313826 learned_addr learned my addr 172.21.15.104:0/811313826 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae137fe640 1 --2- 172.21.15.104:0/811313826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae140b6c90 0x7fae140cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae0bfff640 1 --2- 172.21.15.104:0/811313826 >> v2:172.21.15.183:3300/0 conn(0x7fae140d0d20 0x7fae140ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae13fff640 1 -- 172.21.15.104:0/811313826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae140b6c90 msgr2=0x7fae140cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae13fff640 1 --2- 172.21.15.104:0/811313826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae140b6c90 0x7fae140cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae13fff640 1 -- 172.21.15.104:0/811313826 >> v2:172.21.15.183:3300/0 conn(0x7fae140d0d20 msgr2=0x7fae140ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae13fff640 1 --2- 172.21.15.104:0/811313826 >> v2:172.21.15.183:3300/0 conn(0x7fae140d0d20 0x7fae140ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.397+0000 7fae13fff640 1 -- 172.21.15.104:0/811313826 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae140d01c0 con 0x7fae140ce750 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.398+0000 7fae13fff640 1 --2- 172.21.15.104:0/811313826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae140ce750 0x7fae1415e5b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fae140b44e0 tx=0x7fae0c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b31f59e2d22e1ee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.398+0000 7fae12ffd640 1 -- 172.21.15.104:0/811313826 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c036070 con 0x7fae140ce750 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.398+0000 7fae12ffd640 1 -- 172.21.15.104:0/811313826 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c031600 con 0x7fae140ce750 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.398+0000 7fae12ffd640 1 -- 172.21.15.104:0/811313826 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0319d0 con 0x7fae140ce750 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.399+0000 7fae19d4c640 1 -- 172.21.15.104:0/811313826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae140ce750 msgr2=0x7fae1415e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.399+0000 7fae19d4c640 1 --2- 172.21.15.104:0/811313826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae140ce750 0x7fae1415e5b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fae140b44e0 tx=0x7fae0c02a730 comp rx=0 tx=0).stop 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.399+0000 7fae19d4c640 1 -- 172.21.15.104:0/811313826 shutdown_connections 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.399+0000 7fae19d4c640 1 --2- 172.21.15.104:0/811313826 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae140ce750 0x7fae1415e5b0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.399+0000 7fae19d4c640 1 --2- 172.21.15.104:0/811313826 >> v2:172.21.15.183:3300/0 conn(0x7fae140d0d20 0x7fae140ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.399+0000 7fae19d4c640 1 --2- 172.21.15.104:0/811313826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae140b6c90 0x7fae140cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.399+0000 7fae19d4c640 1 -- 172.21.15.104:0/811313826 >> 172.21.15.104:0/811313826 conn(0x7fae1406f480 msgr2=0x7fae1406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:58.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.399+0000 7fae19d4c640 1 -- 172.21.15.104:0/811313826 shutdown_connections 2024-05-08T04:24:58.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.399+0000 7fae19d4c640 1 -- 172.21.15.104:0/811313826 wait complete. 2024-05-08T04:24:58.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.400+0000 7fae19d4c640 1 Processor -- start 2024-05-08T04:24:58.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.400+0000 7fae19d4c640 1 -- start start 2024-05-08T04:24:58.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae19d4c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae140b6c90 0x7fae141540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae19d4c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae140ce750 0x7fae140c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae19d4c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae140d0d20 0x7fae140c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae19d4c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae140b4880 con 0x7fae140b6c90 2024-05-08T04:24:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae19d4c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae140d0780 con 0x7fae140d0d20 2024-05-08T04:24:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae19d4c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1415eaf0 con 0x7fae140ce750 2024-05-08T04:24:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae137fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae140b6c90 0x7fae141540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae137fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae140b6c90 0x7fae141540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42534/0 (socket says 172.21.15.104:42534) 2024-05-08T04:24:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae137fe640 1 -- 172.21.15.104:0/2925695637 learned_addr learned my addr 172.21.15.104:0/2925695637 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae13fff640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae140d0d20 0x7fae140c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae0bfff640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae140ce750 0x7fae140c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae137fe640 1 -- 172.21.15.104:0/2925695637 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae140ce750 msgr2=0x7fae140c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae137fe640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae140ce750 0x7fae140c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae137fe640 1 -- 172.21.15.104:0/2925695637 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae140d0d20 msgr2=0x7fae140c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae137fe640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae140d0d20 0x7fae140c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae137fe640 1 -- 172.21.15.104:0/2925695637 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae140c9b70 con 0x7fae140b6c90 2024-05-08T04:24:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae0bfff640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae140ce750 0x7fae140c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae137fe640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae140b6c90 0x7fae141540f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fae0400e890 tx=0x7fae0400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae10ff9640 1 -- 172.21.15.104:0/2925695637 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04017070 con 0x7fae140b6c90 2024-05-08T04:24:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae10ff9640 1 -- 172.21.15.104:0/2925695637 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0400c940 con 0x7fae140b6c90 2024-05-08T04:24:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae19d4c640 1 -- 172.21.15.104:0/2925695637 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae141f2710 con 0x7fae140b6c90 2024-05-08T04:24:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae10ff9640 1 -- 172.21.15.104:0/2925695637 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0400cd10 con 0x7fae140b6c90 2024-05-08T04:24:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.401+0000 7fae19d4c640 1 -- 172.21.15.104:0/2925695637 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae141f2cd0 con 0x7fae140b6c90 2024-05-08T04:24:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.402+0000 7fae19d4c640 1 -- 172.21.15.104:0/2925695637 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae14075010 con 0x7fae140b6c90 2024-05-08T04:24:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.403+0000 7fae10ff9640 1 -- 172.21.15.104:0/2925695637 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fae0401a070 con 0x7fae140b6c90 2024-05-08T04:24:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.403+0000 7fae10ff9640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fadf406b710 0x7fadf406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.404+0000 7fae0bfff640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fadf406b710 0x7fadf406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.404+0000 7fae10ff9640 1 -- 172.21.15.104:0/2925695637 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fae0408a5a0 con 0x7fae140b6c90 2024-05-08T04:24:58.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.404+0000 7fae0bfff640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fadf406b710 0x7fadf406dbd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fae140b5810 tx=0x7fadfc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:58.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.408+0000 7fae10ff9640 1 -- 172.21.15.104:0/2925695637 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae04058a30 con 0x7fae140b6c90 2024-05-08T04:24:58.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.578+0000 7fae19d4c640 1 -- 172.21.15.104:0/2925695637 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae140d25e0 con 0x7fae140b6c90 2024-05-08T04:24:58.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.579+0000 7fae10ff9640 1 -- 172.21.15.104:0/2925695637 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7fae0405cad0 con 0x7fae140b6c90 2024-05-08T04:24:58.581 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-05-08T04:24:58.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.581+0000 7fae19d4c640 1 -- 172.21.15.104:0/2925695637 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fadf406b710 msgr2=0x7fadf406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.581+0000 7fae19d4c640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fadf406b710 0x7fadf406dbd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fae140b5810 tx=0x7fadfc008040 comp rx=0 tx=0).stop 2024-05-08T04:24:58.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.581+0000 7fae19d4c640 1 -- 172.21.15.104:0/2925695637 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae140b6c90 msgr2=0x7fae141540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.581+0000 7fae19d4c640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae140b6c90 0x7fae141540f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fae0400e890 tx=0x7fae0400ed50 comp rx=0 tx=0).stop 2024-05-08T04:24:58.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.581+0000 7fae19d4c640 1 -- 172.21.15.104:0/2925695637 shutdown_connections 2024-05-08T04:24:58.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.581+0000 7fae19d4c640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fadf406b710 0x7fadf406dbd0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.581+0000 7fae19d4c640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae140d0d20 0x7fae140c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.581+0000 7fae19d4c640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae140ce750 0x7fae140c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.581+0000 7fae19d4c640 1 --2- 172.21.15.104:0/2925695637 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae140b6c90 0x7fae141540f0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.581+0000 7fae19d4c640 1 -- 172.21.15.104:0/2925695637 >> 172.21.15.104:0/2925695637 conn(0x7fae1406f480 msgr2=0x7fae1415e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:58.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.581+0000 7fae19d4c640 1 -- 172.21.15.104:0/2925695637 shutdown_connections 2024-05-08T04:24:58.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.581+0000 7fae19d4c640 1 -- 172.21.15.104:0/2925695637 wait complete. 2024-05-08T04:24:58.594 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:58.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.693+0000 7f29d96b3640 1 Processor -- start 2024-05-08T04:24:58.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.693+0000 7f29d96b3640 1 -- start start 2024-05-08T04:24:58.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.694+0000 7f29d96b3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f29d415dad0 0x7f29d40d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.694+0000 7f29d96b3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f29d40d35c0 0x7f29d40b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.694+0000 7f29d96b3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d40b9920 con 0x7f29d40d1fa0 2024-05-08T04:24:58.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.694+0000 7f29d96b3640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d40b7b40 con 0x7f29d40d35c0 2024-05-08T04:24:58.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.694+0000 7f29d96b3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d40d2520 con 0x7f29d415dad0 2024-05-08T04:24:58.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.694+0000 7f29d27fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f29d40d35c0 0x7f29d40b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.694+0000 7f29d27fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f29d40d35c0 0x7f29d40b5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42544/0 (socket says 172.21.15.104:42544) 2024-05-08T04:24:58.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.694+0000 7f29d27fc640 1 -- 172.21.15.104:0/2399927850 learned_addr learned my addr 172.21.15.104:0/2399927850 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:58.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.694+0000 7f29d2ffd640 1 --2- 172.21.15.104:0/2399927850 >> v2:172.21.15.183:3300/0 conn(0x7f29d415dad0 0x7f29d40d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.694+0000 7f29d27fc640 1 -- 172.21.15.104:0/2399927850 >> v2:172.21.15.183:3300/0 conn(0x7f29d415dad0 msgr2=0x7f29d40d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:58.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.694+0000 7f29d27fc640 1 --2- 172.21.15.104:0/2399927850 >> v2:172.21.15.183:3300/0 conn(0x7f29d415dad0 0x7f29d40d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.694+0000 7f29d27fc640 1 -- 172.21.15.104:0/2399927850 >> v1:172.21.15.183:6789/0 conn(0x7f29d40d1fa0 legacy=0x7f29d4072290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T04:24:58.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.694+0000 7f29d27fc640 1 -- 172.21.15.104:0/2399927850 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40d2800 con 0x7f29d40d35c0 2024-05-08T04:24:58.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.695+0000 7f29d27fc640 1 --2- 172.21.15.104:0/2399927850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d40d35c0 0x7f29d40b5480 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f29d40d4a10 tx=0x7f29c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a4b85317f068da server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:58.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.695+0000 7f29d1ffb640 1 -- 172.21.15.104:0/2399927850 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8037070 con 0x7f29d40d35c0 2024-05-08T04:24:58.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.695+0000 7f29d1ffb640 1 -- 172.21.15.104:0/2399927850 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c8032440 con 0x7f29d40d35c0 2024-05-08T04:24:58.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.695+0000 7f29d1ffb640 1 -- 172.21.15.104:0/2399927850 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8032810 con 0x7f29d40d35c0 2024-05-08T04:24:58.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.696+0000 7f29d96b3640 1 -- 172.21.15.104:0/2399927850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d40d35c0 msgr2=0x7f29d40b5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.696+0000 7f29d96b3640 1 --2- 172.21.15.104:0/2399927850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d40d35c0 0x7f29d40b5480 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f29d40d4a10 tx=0x7f29c802a1a0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.696+0000 7f29d96b3640 1 -- 172.21.15.104:0/2399927850 shutdown_connections 2024-05-08T04:24:58.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.696+0000 7f29d96b3640 1 --2- 172.21.15.104:0/2399927850 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d40d35c0 0x7f29d40b5480 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.696+0000 7f29d96b3640 1 --2- 172.21.15.104:0/2399927850 >> v2:172.21.15.183:3300/0 conn(0x7f29d415dad0 0x7f29d40d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.696+0000 7f29d96b3640 1 -- 172.21.15.104:0/2399927850 >> 172.21.15.104:0/2399927850 conn(0x7f29d406c650 msgr2=0x7f29d40d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:58.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.696+0000 7f29d96b3640 1 -- 172.21.15.104:0/2399927850 shutdown_connections 2024-05-08T04:24:58.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.696+0000 7f29d96b3640 1 -- 172.21.15.104:0/2399927850 wait complete. 2024-05-08T04:24:58.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.697+0000 7f29d96b3640 1 Processor -- start 2024-05-08T04:24:58.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.697+0000 7f29d96b3640 1 -- start start 2024-05-08T04:24:58.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d96b3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29d40d1fa0 0x7f29d4155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d96b3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29d40d35c0 0x7f29d40d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d96b3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d415dad0 0x7f29d40d3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d96b3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d40d30a0 con 0x7f29d415dad0 2024-05-08T04:24:58.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d96b3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d40d2dc0 con 0x7f29d40d1fa0 2024-05-08T04:24:58.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d96b3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d415deb0 con 0x7f29d40d35c0 2024-05-08T04:24:58.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d415dad0 0x7f29d40d3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d415dad0 0x7f29d40d3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42548/0 (socket says 172.21.15.104:42548) 2024-05-08T04:24:58.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d37fe640 1 -- 172.21.15.104:0/165930503 learned_addr learned my addr 172.21.15.104:0/165930503 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:58.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d37fe640 1 -- 172.21.15.104:0/165930503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29d40d35c0 msgr2=0x7f29d40d39a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T04:24:58.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d37fe640 1 --2- 172.21.15.104:0/165930503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29d40d35c0 0x7f29d40d39a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d37fe640 1 -- 172.21.15.104:0/165930503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29d40d1fa0 msgr2=0x7f29d4155260 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T04:24:58.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d37fe640 1 --2- 172.21.15.104:0/165930503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29d40d1fa0 0x7f29d4155260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d37fe640 1 -- 172.21.15.104:0/165930503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d415edf0 con 0x7f29d415dad0 2024-05-08T04:24:58.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29d37fe640 1 --2- 172.21.15.104:0/165930503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d415dad0 0x7f29d40d3ee0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00b9c0 tx=0x7f29cc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:58.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.698+0000 7f29bb7fe640 1 -- 172.21.15.104:0/165930503 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc019070 con 0x7f29d415dad0 2024-05-08T04:24:58.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.699+0000 7f29bb7fe640 1 -- 172.21.15.104:0/165930503 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc00cba0 con 0x7f29d415dad0 2024-05-08T04:24:58.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.699+0000 7f29d96b3640 1 -- 172.21.15.104:0/165930503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d415f0d0 con 0x7f29d415dad0 2024-05-08T04:24:58.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.699+0000 7f29bb7fe640 1 -- 172.21.15.104:0/165930503 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc014440 con 0x7f29d415dad0 2024-05-08T04:24:58.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.699+0000 7f29d96b3640 1 -- 172.21.15.104:0/165930503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d415f690 con 0x7f29d415dad0 2024-05-08T04:24:58.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.699+0000 7f29d96b3640 1 -- 172.21.15.104:0/165930503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d4075010 con 0x7f29d415dad0 2024-05-08T04:24:58.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.700+0000 7f29bb7fe640 1 -- 172.21.15.104:0/165930503 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f29cc01c070 con 0x7f29d415dad0 2024-05-08T04:24:58.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.700+0000 7f29bb7fe640 1 --2- 172.21.15.104:0/165930503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29c006b710 0x7f29c006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:58.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.701+0000 7f29bb7fe640 1 -- 172.21.15.104:0/165930503 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f29cc08a350 con 0x7f29d415dad0 2024-05-08T04:24:58.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.701+0000 7f29d2ffd640 1 --2- 172.21.15.104:0/165930503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29c006b710 0x7f29c006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:58.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.701+0000 7f29d2ffd640 1 --2- 172.21.15.104:0/165930503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29c006b710 0x7f29c006dbd0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f29c400b7f0 tx=0x7f29c4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:58.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.705+0000 7f29bb7fe640 1 -- 172.21.15.104:0/165930503 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f29cc058ec0 con 0x7f29d415dad0 2024-05-08T04:24:58.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.912+0000 7f29d96b3640 1 -- 172.21.15.104:0/165930503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29d40b7cc0 con 0x7f29d415dad0 2024-05-08T04:24:58.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.912+0000 7f29bb7fe640 1 -- 172.21.15.104:0/165930503 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f29cc0587c0 con 0x7f29d415dad0 2024-05-08T04:24:58.914 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:58.915 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5336,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1609011099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1609011099},{"type":"v1","addr":"172.21.15.183:6834","nonce":1609011099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6354,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3867059822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3867059822},{"type":"v1","addr":"172.21.15.104:6835","nonce":3867059822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6357,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/3119972029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":3119972029},{"type":"v1","addr":"172.21.15.104:6837","nonce":3119972029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:24:38.063241+0000","modified":"2024-05-08T04:24:40.069539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6366":{"gid":6366,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/495908291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":495908291},{"type":"v1","addr":"172.21.15.183:6835","nonce":495908291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-05-08T04:24:58.915 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 29 2024-05-08T04:24:58.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.914+0000 7f29d96b3640 1 -- 172.21.15.104:0/165930503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29c006b710 msgr2=0x7f29c006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.914+0000 7f29d96b3640 1 --2- 172.21.15.104:0/165930503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29c006b710 0x7f29c006dbd0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f29c400b7f0 tx=0x7f29c4008040 comp rx=0 tx=0).stop 2024-05-08T04:24:58.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.914+0000 7f29d96b3640 1 -- 172.21.15.104:0/165930503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d415dad0 msgr2=0x7f29d40d3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:58.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.914+0000 7f29d96b3640 1 --2- 172.21.15.104:0/165930503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d415dad0 0x7f29d40d3ee0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f29cc00b9c0 tx=0x7f29cc00be80 comp rx=0 tx=0).stop 2024-05-08T04:24:58.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.914+0000 7f29d96b3640 1 -- 172.21.15.104:0/165930503 shutdown_connections 2024-05-08T04:24:58.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.914+0000 7f29d96b3640 1 --2- 172.21.15.104:0/165930503 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f29c006b710 0x7f29c006dbd0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.914+0000 7f29d96b3640 1 --2- 172.21.15.104:0/165930503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d415dad0 0x7f29d40d3ee0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.914+0000 7f29d96b3640 1 --2- 172.21.15.104:0/165930503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29d40d35c0 0x7f29d40d39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.914+0000 7f29d96b3640 1 --2- 172.21.15.104:0/165930503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29d40d1fa0 0x7f29d4155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:58.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.914+0000 7f29d96b3640 1 -- 172.21.15.104:0/165930503 >> 172.21.15.104:0/165930503 conn(0x7f29d406c650 msgr2=0x7f29d40b84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:58.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.914+0000 7f29d96b3640 1 -- 172.21.15.104:0/165930503 shutdown_connections 2024-05-08T04:24:58.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:58.914+0000 7f29d96b3640 1 -- 172.21.15.104:0/165930503 wait complete. 2024-05-08T04:24:58.928 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:24:59.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.025+0000 7ff775c9e640 1 Processor -- start 2024-05-08T04:24:59.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.026+0000 7ff775c9e640 1 -- start start 2024-05-08T04:24:59.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.026+0000 7ff775c9e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff77015ee90 0x7ff7700cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.026+0000 7ff775c9e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7700cc5d0 con 0x7ff77015ba10 2024-05-08T04:24:59.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.026+0000 7ff775c9e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77009a340 con 0x7ff7700d0320 2024-05-08T04:24:59.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.026+0000 7ff775c9e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7700d0770 con 0x7ff77015ee90 2024-05-08T04:24:59.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.026+0000 7ff76f7fe640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7ff77015ba10 0x7ff770099a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:37426/0 (socket says 172.21.15.104:37426) 2024-05-08T04:24:59.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.026+0000 7ff76f7fe640 1 -- 172.21.15.104:0/1772139984 learned_addr learned my addr 172.21.15.104:0/1772139984 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470135651 0 0) 0x7ff7700cc5d0 con 0x7ff77015ba10 2024-05-08T04:24:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff75c003520 con 0x7ff77015ba10 2024-05-08T04:24:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff766ffd640 1 --2- 172.21.15.104:0/1772139984 >> v2:172.21.15.183:3300/0 conn(0x7ff77015ee90 0x7ff7700cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4052701067 0 0) 0x7ff75c003520 con 0x7ff77015ba10 2024-05-08T04:24:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 >> v2:172.21.15.183:3300/0 conn(0x7ff77015ee90 msgr2=0x7ff7700cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 --2- 172.21.15.104:0/1772139984 >> v2:172.21.15.183:3300/0 conn(0x7ff77015ee90 0x7ff7700cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 >> v1:172.21.15.183:6789/0 conn(0x7ff7700d0320 legacy=0x7ff7700b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77009a620 con 0x7ff77015ba10 2024-05-08T04:24:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7ff7600017f0 con 0x7ff77015ba10 2024-05-08T04:24:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 >> v1:172.21.15.104:6789/0 conn(0x7ff77015ba10 legacy=0x7ff770099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 --2- 172.21.15.104:0/1772139984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff75c0039b0 0x7ff75c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 --2- 172.21.15.104:0/1772139984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff75c004800 0x7ff75c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 --2- 172.21.15.104:0/1772139984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c0051c0 0x7ff75c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700d0770 con 0x7ff75c0051c0 2024-05-08T04:24:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c00c0f0 con 0x7ff75c004800 2024-05-08T04:24:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c00c2f0 con 0x7ff75c0039b0 2024-05-08T04:24:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76ffff640 1 --2- 172.21.15.104:0/1772139984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c0051c0 0x7ff75c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76f7fe640 1 --2- 172.21.15.104:0/1772139984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff75c0039b0 0x7ff75c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff766ffd640 1 --2- 172.21.15.104:0/1772139984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff75c004800 0x7ff75c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76ffff640 1 -- 172.21.15.104:0/1772139984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff75c0039b0 msgr2=0x7ff75c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76ffff640 1 --2- 172.21.15.104:0/1772139984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff75c0039b0 0x7ff75c003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76ffff640 1 -- 172.21.15.104:0/1772139984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff75c004800 msgr2=0x7ff75c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76ffff640 1 --2- 172.21.15.104:0/1772139984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff75c004800 0x7ff75c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76ffff640 1 -- 172.21.15.104:0/1772139984 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c003520 con 0x7ff75c0051c0 2024-05-08T04:24:59.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.027+0000 7ff76f7fe640 1 --2- 172.21.15.104:0/1772139984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff75c0039b0 0x7ff75c003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.028+0000 7ff76ffff640 1 -- 172.21.15.104:0/1772139984 reap_dead start 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.028+0000 7ff76ffff640 1 --2- 172.21.15.104:0/1772139984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c0051c0 0x7ff75c00b9c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff768004480 tx=0x7ff75c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163870cd4e0a1c59 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.028+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff768004080 con 0x7ff75c0051c0 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.028+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76802ad80 con 0x7ff75c0051c0 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.028+0000 7ff76effd640 1 -- 172.21.15.104:0/1772139984 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff768006d90 con 0x7ff75c0051c0 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.029+0000 7ff775c9e640 1 -- 172.21.15.104:0/1772139984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c0051c0 msgr2=0x7ff75c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.029+0000 7ff775c9e640 1 --2- 172.21.15.104:0/1772139984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c0051c0 0x7ff75c00b9c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff768004480 tx=0x7ff75c005830 comp rx=0 tx=0).stop 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.029+0000 7ff775c9e640 1 -- 172.21.15.104:0/1772139984 shutdown_connections 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.029+0000 7ff775c9e640 1 --2- 172.21.15.104:0/1772139984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff75c0051c0 0x7ff75c00b9c0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.029+0000 7ff775c9e640 1 -- 172.21.15.104:0/1772139984 >> 172.21.15.104:0/1772139984 conn(0x7ff7700b3280 msgr2=0x7ff7700b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.029+0000 7ff775c9e640 1 -- 172.21.15.104:0/1772139984 shutdown_connections 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.029+0000 7ff775c9e640 1 -- 172.21.15.104:0/1772139984 wait complete. 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.030+0000 7ff775c9e640 1 Processor -- start 2024-05-08T04:24:59.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.030+0000 7ff775c9e640 1 -- start start 2024-05-08T04:24:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff775c9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff75c0051c0 0x7ff7700cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff775c9e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7700cdea0 0x7ff7700b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff775c9e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7700ce320 0x7ff7700b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff775c9e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77006bc70 con 0x7ff7700cdea0 2024-05-08T04:24:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff775c9e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700cc870 con 0x7ff7700ce320 2024-05-08T04:24:59.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff775c9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77006bdf0 con 0x7ff75c0051c0 2024-05-08T04:24:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff766ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7700cdea0 0x7ff7700b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff766ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7700cdea0 0x7ff7700b5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42558/0 (socket says 172.21.15.104:42558) 2024-05-08T04:24:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff766ffd640 1 -- 172.21.15.104:0/3699869849 learned_addr learned my addr 172.21.15.104:0/3699869849 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff76ffff640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7700ce320 0x7ff7700b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff76f7fe640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff75c0051c0 0x7ff7700cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff766ffd640 1 -- 172.21.15.104:0/3699869849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff75c0051c0 msgr2=0x7ff7700cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff766ffd640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff75c0051c0 0x7ff7700cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff766ffd640 1 -- 172.21.15.104:0/3699869849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7700ce320 msgr2=0x7ff7700b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff766ffd640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7700ce320 0x7ff7700b5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.031+0000 7ff766ffd640 1 -- 172.21.15.104:0/3699869849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7700ca100 con 0x7ff7700cdea0 2024-05-08T04:24:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.032+0000 7ff766ffd640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7700cdea0 0x7ff7700b5510 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff75800f4e0 tx=0x7ff75800f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:59.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.032+0000 7ff76cff9640 1 -- 172.21.15.104:0/3699869849 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758019020 con 0x7ff7700cdea0 2024-05-08T04:24:59.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.032+0000 7ff76cff9640 1 -- 172.21.15.104:0/3699869849 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff758014870 con 0x7ff7700cdea0 2024-05-08T04:24:59.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.032+0000 7ff775c9e640 1 -- 172.21.15.104:0/3699869849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7700ca3e0 con 0x7ff7700cdea0 2024-05-08T04:24:59.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.032+0000 7ff76cff9640 1 -- 172.21.15.104:0/3699869849 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758014c20 con 0x7ff7700cdea0 2024-05-08T04:24:59.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.032+0000 7ff775c9e640 1 -- 172.21.15.104:0/3699869849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7700ca9a0 con 0x7ff7700cdea0 2024-05-08T04:24:59.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.033+0000 7ff775c9e640 1 -- 172.21.15.104:0/3699869849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff770075010 con 0x7ff7700cdea0 2024-05-08T04:24:59.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.033+0000 7ff76cff9640 1 -- 172.21.15.104:0/3699869849 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7ff75801c020 con 0x7ff7700cdea0 2024-05-08T04:24:59.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.034+0000 7ff76cff9640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff75006b710 0x7ff75006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.034+0000 7ff76cff9640 1 -- 172.21.15.104:0/3699869849 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff75808ae50 con 0x7ff7700cdea0 2024-05-08T04:24:59.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.034+0000 7ff76f7fe640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff75006b710 0x7ff75006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.034+0000 7ff76f7fe640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff75006b710 0x7ff75006dbd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff760000ef0 tx=0x7ff760009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:59.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.038+0000 7ff76cff9640 1 -- 172.21.15.104:0/3699869849 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff758023020 con 0x7ff7700cdea0 2024-05-08T04:24:59.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.208+0000 7ff775c9e640 1 -- 172.21.15.104:0/3699869849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7700cfbc0 con 0x7ff7700cdea0 2024-05-08T04:24:59.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.209+0000 7ff76cff9640 1 -- 172.21.15.104:0/3699869849 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16821 (secure 0 0 0) 0x7ff758026350 con 0x7ff7700cdea0 2024-05-08T04:24:59.212 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:59.212 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":61,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:24:52.781593+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:24:36.286493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-08T04:24:37.038502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.14","mappings":[{"from":6,"to":1}]},{"pgid":"9.3b","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:24:59.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.211+0000 7ff775c9e640 1 -- 172.21.15.104:0/3699869849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff75006b710 msgr2=0x7ff75006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.211+0000 7ff775c9e640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff75006b710 0x7ff75006dbd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff760000ef0 tx=0x7ff760009040 comp rx=0 tx=0).stop 2024-05-08T04:24:59.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.211+0000 7ff775c9e640 1 -- 172.21.15.104:0/3699869849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7700cdea0 msgr2=0x7ff7700b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.211+0000 7ff775c9e640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7700cdea0 0x7ff7700b5510 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff75800f4e0 tx=0x7ff75800f9a0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.211+0000 7ff775c9e640 1 -- 172.21.15.104:0/3699869849 shutdown_connections 2024-05-08T04:24:59.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.211+0000 7ff775c9e640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ff75006b710 0x7ff75006dbd0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.211+0000 7ff775c9e640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7700ce320 0x7ff7700b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.211+0000 7ff775c9e640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7700cdea0 0x7ff7700b5510 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.211+0000 7ff775c9e640 1 --2- 172.21.15.104:0/3699869849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff75c0051c0 0x7ff7700cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.211+0000 7ff775c9e640 1 -- 172.21.15.104:0/3699869849 >> 172.21.15.104:0/3699869849 conn(0x7ff7700b3280 msgr2=0x7ff77006ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:59.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.211+0000 7ff775c9e640 1 -- 172.21.15.104:0/3699869849 shutdown_connections 2024-05-08T04:24:59.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.211+0000 7ff775c9e640 1 -- 172.21.15.104:0/3699869849 wait complete. 2024-05-08T04:24:59.225 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T04:24:59.225 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:59.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.323+0000 7fec85b34640 1 Processor -- start 2024-05-08T04:24:59.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.323+0000 7fec85b34640 1 -- start start 2024-05-08T04:24:59.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.324+0000 7fec85b34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec80099a40 0x7fec80099e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.324+0000 7fec85b34640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fec800ccbe0 0x7fec800cd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.324+0000 7fec85b34640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec800cc700 con 0x7fec800cf360 2024-05-08T04:24:59.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.324+0000 7fec85b34640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8015ced0 con 0x7fec800ccbe0 2024-05-08T04:24:59.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.324+0000 7fec85b34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8009a360 con 0x7fec80099a40 2024-05-08T04:24:59.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.324+0000 7fec77fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fec800cf360 0x7fec800cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:37430/0 (socket says 172.21.15.104:37430) 2024-05-08T04:24:59.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.324+0000 7fec77fff640 1 -- 172.21.15.104:0/1889027898 learned_addr learned my addr 172.21.15.104:0/1889027898 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:59.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.324+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307065727 0 0) 0x7fec800cc700 con 0x7fec800cf360 2024-05-08T04:24:59.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.324+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec6c003520 con 0x7fec800cf360 2024-05-08T04:24:59.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.324+0000 7fec7f7fe640 1 --2- 172.21.15.104:0/1889027898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec80099a40 0x7fec80099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.324+0000 7fec7ffff640 1 --2- 172.21.15.104:0/1889027898 >> v2:172.21.15.183:3300/0 conn(0x7fec800ccbe0 0x7fec800cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3152183285 0 0) 0x7fec6c003520 con 0x7fec800cf360 2024-05-08T04:24:59.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec80099a40 msgr2=0x7fec80099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:59.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 --2- 172.21.15.104:0/1889027898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec80099a40 0x7fec80099e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 >> v2:172.21.15.183:3300/0 conn(0x7fec800ccbe0 msgr2=0x7fec800cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:59.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 --2- 172.21.15.104:0/1889027898 >> v2:172.21.15.183:3300/0 conn(0x7fec800ccbe0 0x7fec800cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800d0020 con 0x7fec800cf360 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fec68001690 con 0x7fec800cf360 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 >> v1:172.21.15.104:6789/0 conn(0x7fec800cf360 legacy=0x7fec800cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 --2- 172.21.15.104:0/1889027898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec6c0039b0 0x7fec6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 --2- 172.21.15.104:0/1889027898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec6c004800 0x7fec6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 --2- 172.21.15.104:0/1889027898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec80099a40 0x7fec6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8015ced0 con 0x7fec6c004800 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8009a360 con 0x7fec6c0039b0 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c00b9c0 con 0x7fec80099a40 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec77fff640 1 --2- 172.21.15.104:0/1889027898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec6c004800 0x7fec6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7f7fe640 1 --2- 172.21.15.104:0/1889027898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec6c0039b0 0x7fec6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec7ffff640 1 --2- 172.21.15.104:0/1889027898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec80099a40 0x7fec6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec77fff640 1 -- 172.21.15.104:0/1889027898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec80099a40 msgr2=0x7fec6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec77fff640 1 --2- 172.21.15.104:0/1889027898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec80099a40 0x7fec6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec77fff640 1 -- 172.21.15.104:0/1889027898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec6c0039b0 msgr2=0x7fec6c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:59.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec77fff640 1 --2- 172.21.15.104:0/1889027898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec6c0039b0 0x7fec6c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.325+0000 7fec77fff640 1 -- 172.21.15.104:0/1889027898 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c003520 con 0x7fec6c004800 2024-05-08T04:24:59.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.326+0000 7fec77fff640 1 --2- 172.21.15.104:0/1889027898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec6c004800 0x7fec6c004c80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fec800cc8d0 tx=0x7fec6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76894193803d30f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:59.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.326+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6802e070 con 0x7fec6c004800 2024-05-08T04:24:59.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.326+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec68005ad0 con 0x7fec6c004800 2024-05-08T04:24:59.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.326+0000 7fec7effd640 1 -- 172.21.15.104:0/1889027898 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68007d90 con 0x7fec6c004800 2024-05-08T04:24:59.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.326+0000 7fec85b34640 1 -- 172.21.15.104:0/1889027898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec6c004800 msgr2=0x7fec6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.326+0000 7fec85b34640 1 --2- 172.21.15.104:0/1889027898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec6c004800 0x7fec6c004c80 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fec800cc8d0 tx=0x7fec6c005830 comp rx=0 tx=0).stop 2024-05-08T04:24:59.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.326+0000 7fec7ffff640 1 -- 172.21.15.104:0/1889027898 reap_dead start 2024-05-08T04:24:59.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.326+0000 7fec85b34640 1 -- 172.21.15.104:0/1889027898 shutdown_connections 2024-05-08T04:24:59.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.326+0000 7fec85b34640 1 -- 172.21.15.104:0/1889027898 >> 172.21.15.104:0/1889027898 conn(0x7fec800b3280 msgr2=0x7fec800b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:59.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.327+0000 7fec85b34640 1 -- 172.21.15.104:0/1889027898 shutdown_connections 2024-05-08T04:24:59.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.327+0000 7fec85b34640 1 -- 172.21.15.104:0/1889027898 wait complete. 2024-05-08T04:24:59.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.328+0000 7fec85b34640 1 Processor -- start 2024-05-08T04:24:59.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.328+0000 7fec85b34640 1 -- start start 2024-05-08T04:24:59.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.328+0000 7fec85b34640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec6c004800 0x7fec801588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.328+0000 7fec85b34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec801e5d70 0x7fec8015e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.328+0000 7fec85b34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec801f1b30 0x7fec801f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.328+0000 7fec85b34640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec80159860 con 0x7fec6c004800 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.328+0000 7fec85b34640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec800d05e0 con 0x7fec801f1b30 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.328+0000 7fec85b34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec800d08c0 con 0x7fec801e5d70 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.328+0000 7fec7f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec6c004800 0x7fec801588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec7f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec6c004800 0x7fec801588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42576/0 (socket says 172.21.15.104:42576) 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec7f7fe640 1 -- 172.21.15.104:0/2131346865 learned_addr learned my addr 172.21.15.104:0/2131346865 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec7ffff640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec801f1b30 0x7fec801f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec7f7fe640 1 -- 172.21.15.104:0/2131346865 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec801e5d70 msgr2=0x7fec8015e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec7f7fe640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec801e5d70 0x7fec8015e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec7f7fe640 1 -- 172.21.15.104:0/2131346865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec801f1b30 msgr2=0x7fec801f1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec7f7fe640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec801f1b30 0x7fec801f1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec7f7fe640 1 -- 172.21.15.104:0/2131346865 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8015eda0 con 0x7fec6c004800 2024-05-08T04:24:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec7ffff640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec801f1b30 0x7fec801f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec7f7fe640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec6c004800 0x7fec801588c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fec700118e0 tx=0x7fec70011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec7cff9640 1 -- 172.21.15.104:0/2131346865 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec70005c60 con 0x7fec6c004800 2024-05-08T04:24:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec7cff9640 1 -- 172.21.15.104:0/2131346865 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec70005e00 con 0x7fec6c004800 2024-05-08T04:24:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec85b34640 1 -- 172.21.15.104:0/2131346865 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8015f040 con 0x7fec6c004800 2024-05-08T04:24:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec7cff9640 1 -- 172.21.15.104:0/2131346865 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7000fa00 con 0x7fec6c004800 2024-05-08T04:24:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.329+0000 7fec85b34640 1 -- 172.21.15.104:0/2131346865 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8015f600 con 0x7fec6c004800 2024-05-08T04:24:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.330+0000 7fec85b34640 1 -- 172.21.15.104:0/2131346865 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec80075010 con 0x7fec6c004800 2024-05-08T04:24:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.331+0000 7fec7cff9640 1 -- 172.21.15.104:0/2131346865 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fec70012040 con 0x7fec6c004800 2024-05-08T04:24:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.331+0000 7fec7cff9640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fec6006b710 0x7fec6006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.331+0000 7fec7cff9640 1 -- 172.21.15.104:0/2131346865 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fec7008ab60 con 0x7fec6c004800 2024-05-08T04:24:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.331+0000 7fec77fff640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fec6006b710 0x7fec6006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.331+0000 7fec77fff640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fec6006b710 0x7fec6006dbd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec68033000 tx=0x7fec68009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:59.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.335+0000 7fec7cff9640 1 -- 172.21.15.104:0/2131346865 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fec70018030 con 0x7fec6c004800 2024-05-08T04:24:59.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.541+0000 7fec85b34640 1 -- 172.21.15.104:0/2131346865 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec80071b90 con 0x7fec6c004800 2024-05-08T04:24:59.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.541+0000 7fec7cff9640 1 -- 172.21.15.104:0/2131346865 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fec70059710 con 0x7fec6c004800 2024-05-08T04:24:59.543 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:59.544 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5336,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1609011099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1609011099},{"type":"v1","addr":"172.21.15.183:6834","nonce":1609011099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6354,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3867059822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3867059822},{"type":"v1","addr":"172.21.15.104:6835","nonce":3867059822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6357,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/3119972029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":3119972029},{"type":"v1","addr":"172.21.15.104:6837","nonce":3119972029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:24:38.063241+0000","modified":"2024-05-08T04:24:40.069539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6366":{"gid":6366,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/495908291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":495908291},{"type":"v1","addr":"172.21.15.183:6835","nonce":495908291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-05-08T04:24:59.544 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 29 2024-05-08T04:24:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.543+0000 7fec85b34640 1 -- 172.21.15.104:0/2131346865 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fec6006b710 msgr2=0x7fec6006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.543+0000 7fec85b34640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fec6006b710 0x7fec6006dbd0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec68033000 tx=0x7fec68009030 comp rx=0 tx=0).stop 2024-05-08T04:24:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.543+0000 7fec85b34640 1 -- 172.21.15.104:0/2131346865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec6c004800 msgr2=0x7fec801588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.543+0000 7fec85b34640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec6c004800 0x7fec801588c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fec700118e0 tx=0x7fec70011da0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.543+0000 7fec85b34640 1 -- 172.21.15.104:0/2131346865 shutdown_connections 2024-05-08T04:24:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.543+0000 7fec85b34640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fec6006b710 0x7fec6006dbd0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.543+0000 7fec85b34640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec801f1b30 0x7fec801f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.543+0000 7fec85b34640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec801e5d70 0x7fec8015e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.543+0000 7fec85b34640 1 --2- 172.21.15.104:0/2131346865 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec6c004800 0x7fec801588c0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.543+0000 7fec85b34640 1 -- 172.21.15.104:0/2131346865 >> 172.21.15.104:0/2131346865 conn(0x7fec800b3280 msgr2=0x7fec800b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.543+0000 7fec85b34640 1 -- 172.21.15.104:0/2131346865 shutdown_connections 2024-05-08T04:24:59.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.544+0000 7fec85b34640 1 -- 172.21.15.104:0/2131346865 wait complete. 2024-05-08T04:24:59.557 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:24:59.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.654+0000 7f3fdaa3a640 1 Processor -- start 2024-05-08T04:24:59.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.654+0000 7f3fdaa3a640 1 -- start start 2024-05-08T04:24:59.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.655+0000 7f3fdaa3a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3fd415b7d0 0x7f3fd415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.655+0000 7f3fdaa3a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3fd415e6a0 0x7f3fd40b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.655+0000 7f3fdaa3a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd415ed40 con 0x7f3fd40b3b80 2024-05-08T04:24:59.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.655+0000 7f3fdaa3a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd406d6d0 con 0x7f3fd415b7d0 2024-05-08T04:24:59.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.655+0000 7f3fdaa3a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd406d9b0 con 0x7f3fd415e6a0 2024-05-08T04:24:59.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.655+0000 7f3fd3fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3fd415b7d0 0x7f3fd415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.655+0000 7f3fd3fff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3fd415b7d0 0x7f3fd415e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42586/0 (socket says 172.21.15.104:42586) 2024-05-08T04:24:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.655+0000 7f3fd3fff640 1 -- 172.21.15.104:0/3141199445 learned_addr learned my addr 172.21.15.104:0/3141199445 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.655+0000 7f3fd3fff640 1 -- 172.21.15.104:0/3141199445 >> v2:172.21.15.183:3300/0 conn(0x7f3fd415e6a0 msgr2=0x7f3fd40b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.655+0000 7f3fd3fff640 1 --2- 172.21.15.104:0/3141199445 >> v2:172.21.15.183:3300/0 conn(0x7f3fd415e6a0 0x7f3fd40b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.655+0000 7f3fd3fff640 1 -- 172.21.15.104:0/3141199445 >> v1:172.21.15.183:6789/0 conn(0x7f3fd40b3b80 legacy=0x7f3fd4161750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.655+0000 7f3fd3fff640 1 -- 172.21.15.104:0/3141199445 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd406dc90 con 0x7f3fd415b7d0 2024-05-08T04:24:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.656+0000 7f3fd3fff640 1 --2- 172.21.15.104:0/3141199445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd415b7d0 0x7f3fd415e160 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009870 tx=0x7f3fc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e3a5351b5a46a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.656+0000 7f3fd37fe640 1 -- 172.21.15.104:0/3141199445 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4037070 con 0x7f3fd415b7d0 2024-05-08T04:24:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.656+0000 7f3fd37fe640 1 -- 172.21.15.104:0/3141199445 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc4032440 con 0x7f3fd415b7d0 2024-05-08T04:24:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.656+0000 7f3fd37fe640 1 -- 172.21.15.104:0/3141199445 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4032810 con 0x7f3fd415b7d0 2024-05-08T04:24:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.657+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/3141199445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd415b7d0 msgr2=0x7f3fd415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.657+0000 7f3fdaa3a640 1 --2- 172.21.15.104:0/3141199445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd415b7d0 0x7f3fd415e160 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009870 tx=0x7f3fc402a270 comp rx=0 tx=0).stop 2024-05-08T04:24:59.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.657+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/3141199445 shutdown_connections 2024-05-08T04:24:59.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.657+0000 7f3fdaa3a640 1 --2- 172.21.15.104:0/3141199445 >> v2:172.21.15.183:3300/0 conn(0x7f3fd415e6a0 0x7f3fd40b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.657+0000 7f3fdaa3a640 1 --2- 172.21.15.104:0/3141199445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd415b7d0 0x7f3fd415e160 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.657+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/3141199445 >> 172.21.15.104:0/3141199445 conn(0x7f3fd40cfa60 msgr2=0x7f3fd40cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:59.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.657+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/3141199445 shutdown_connections 2024-05-08T04:24:59.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.657+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/3141199445 wait complete. 2024-05-08T04:24:59.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.658+0000 7f3fdaa3a640 1 Processor -- start 2024-05-08T04:24:59.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.658+0000 7f3fdaa3a640 1 -- start start 2024-05-08T04:24:59.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fdaa3a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd40b3b80 0x7f3fd414f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fdaa3a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd415b7d0 0x7f3fd4140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fdaa3a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fd415e6a0 0x7f3fd41555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fdaa3a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd415f020 con 0x7f3fd415b7d0 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fdaa3a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd4071890 con 0x7f3fd415e6a0 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fdaa3a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd406f1c0 con 0x7f3fd40b3b80 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fcbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd415b7d0 0x7f3fd4140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fcbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd415b7d0 0x7f3fd4140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42596/0 (socket says 172.21.15.104:42596) 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fcbfff640 1 -- 172.21.15.104:0/347959649 learned_addr learned my addr 172.21.15.104:0/347959649 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fcbfff640 1 -- 172.21.15.104:0/347959649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd40b3b80 msgr2=0x7f3fd414f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fcbfff640 1 --2- 172.21.15.104:0/347959649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd40b3b80 0x7f3fd414f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fcbfff640 1 -- 172.21.15.104:0/347959649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fd415e6a0 msgr2=0x7f3fd41555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fcbfff640 1 --2- 172.21.15.104:0/347959649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fd415e6a0 0x7f3fd41555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fcbfff640 1 -- 172.21.15.104:0/347959649 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd4141120 con 0x7f3fd415b7d0 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fcbfff640 1 --2- 172.21.15.104:0/347959649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd415b7d0 0x7f3fd4140210 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00b440 tx=0x7f3fbc00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fd17fa640 1 -- 172.21.15.104:0/347959649 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc015020 con 0x7f3fd415b7d0 2024-05-08T04:24:59.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fd17fa640 1 -- 172.21.15.104:0/347959649 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc011890 con 0x7f3fd415b7d0 2024-05-08T04:24:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/347959649 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd414fa50 con 0x7f3fd415b7d0 2024-05-08T04:24:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fd17fa640 1 -- 172.21.15.104:0/347959649 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc011c80 con 0x7f3fd415b7d0 2024-05-08T04:24:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.659+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/347959649 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd4140b60 con 0x7f3fd415b7d0 2024-05-08T04:24:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.661+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/347959649 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd4075010 con 0x7f3fd415b7d0 2024-05-08T04:24:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.661+0000 7f3fd17fa640 1 -- 172.21.15.104:0/347959649 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f3fbc018020 con 0x7f3fd415b7d0 2024-05-08T04:24:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.661+0000 7f3fd17fa640 1 --2- 172.21.15.104:0/347959649 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3fb406b710 0x7f3fb406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.661+0000 7f3fd3fff640 1 --2- 172.21.15.104:0/347959649 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3fb406b710 0x7f3fb406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.661+0000 7f3fd17fa640 1 -- 172.21.15.104:0/347959649 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3fbc08a6a0 con 0x7f3fd415b7d0 2024-05-08T04:24:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.662+0000 7f3fd3fff640 1 --2- 172.21.15.104:0/347959649 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3fb406b710 0x7f3fb406dbd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4034000 tx=0x7f3fc402c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:59.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.665+0000 7f3fd17fa640 1 -- 172.21.15.104:0/347959649 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3fbc01f020 con 0x7f3fd415b7d0 2024-05-08T04:24:59.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.870+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/347959649 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fd40d0890 con 0x7f3fd415b7d0 2024-05-08T04:24:59.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.871+0000 7f3fd17fa640 1 -- 172.21.15.104:0/347959649 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f3fbc00d040 con 0x7f3fd415b7d0 2024-05-08T04:24:59.874 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:24:59.874 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":29,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5336,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1609011099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1609011099},{"type":"v1","addr":"172.21.15.183:6834","nonce":1609011099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6354,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3867059822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3867059822},{"type":"v1","addr":"172.21.15.104:6835","nonce":3867059822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6357,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/3119972029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":3119972029},{"type":"v1","addr":"172.21.15.104:6837","nonce":3119972029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T04:24:38.063241+0000","modified":"2024-05-08T04:24:40.069539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6366},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6366":{"gid":6366,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/495908291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":495908291},{"type":"v1","addr":"172.21.15.183:6835","nonce":495908291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-05-08T04:24:59.874 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 29 2024-05-08T04:24:59.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.873+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/347959649 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3fb406b710 msgr2=0x7f3fb406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.873+0000 7f3fdaa3a640 1 --2- 172.21.15.104:0/347959649 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3fb406b710 0x7f3fb406dbd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4034000 tx=0x7f3fc402c000 comp rx=0 tx=0).stop 2024-05-08T04:24:59.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.873+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/347959649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd415b7d0 msgr2=0x7f3fd4140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.873+0000 7f3fdaa3a640 1 --2- 172.21.15.104:0/347959649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd415b7d0 0x7f3fd4140210 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00b440 tx=0x7f3fbc00b900 comp rx=0 tx=0).stop 2024-05-08T04:24:59.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.873+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/347959649 shutdown_connections 2024-05-08T04:24:59.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.873+0000 7f3fdaa3a640 1 --2- 172.21.15.104:0/347959649 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3fb406b710 0x7f3fb406dbd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.873+0000 7f3fdaa3a640 1 --2- 172.21.15.104:0/347959649 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3fd415e6a0 0x7f3fd41555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.873+0000 7f3fdaa3a640 1 --2- 172.21.15.104:0/347959649 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fd415b7d0 0x7f3fd4140210 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.873+0000 7f3fdaa3a640 1 --2- 172.21.15.104:0/347959649 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3fd40b3b80 0x7f3fd414f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.873+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/347959649 >> 172.21.15.104:0/347959649 conn(0x7f3fd40cfa60 msgr2=0x7f3fd415a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:59.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.873+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/347959649 shutdown_connections 2024-05-08T04:24:59.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.873+0000 7f3fdaa3a640 1 -- 172.21.15.104:0/347959649 wait complete. 2024-05-08T04:24:59.887 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:24:59.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.985+0000 7f6c5d17e640 1 Processor -- start 2024-05-08T04:24:59.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.985+0000 7f6c5d17e640 1 -- start start 2024-05-08T04:24:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.986+0000 7f6c5d17e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c580d07c0 0x7f6c58161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.986+0000 7f6c5d17e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5815e1f0 con 0x7f6c5815de10 2024-05-08T04:24:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.986+0000 7f6c5d17e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c58162090 con 0x7f6c580ce5a0 2024-05-08T04:24:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.986+0000 7f6c5d17e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580d0f50 con 0x7f6c580d07c0 2024-05-08T04:24:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.986+0000 7f6c56d9d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f6c5815de10 0x7f6c580d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:37434/0 (socket says 172.21.15.104:37434) 2024-05-08T04:24:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.986+0000 7f6c56d9d640 1 -- 172.21.15.104:0/3881977143 learned_addr learned my addr 172.21.15.104:0/3881977143 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:24:59.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267608024 0 0) 0x7f6c5815e1f0 con 0x7f6c5815de10 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c44003520 con 0x7f6c5815de10 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c5759e640 1 --2- 172.21.15.104:0/3881977143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c580d07c0 0x7f6c58161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192830775 0 0) 0x7f6c58162090 con 0x7f6c580ce5a0 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c5815e1f0 con 0x7f6c580ce5a0 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1924181905 0 0) 0x7f6c44003520 con 0x7f6c5815de10 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c580d07c0 msgr2=0x7f6c58161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 --2- 172.21.15.104:0/3881977143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c580d07c0 0x7f6c58161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 >> v1:172.21.15.183:6789/0 conn(0x7f6c580ce5a0 legacy=0x7f6c580d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c58162370 con 0x7f6c5815de10 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f6c480019f0 con 0x7f6c5815de10 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 >> v1:172.21.15.104:6789/0 conn(0x7f6c5815de10 legacy=0x7f6c580d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 --2- 172.21.15.104:0/3881977143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c44003b70 0x7f6c44003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 --2- 172.21.15.104:0/3881977143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c44004800 0x7f6c44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 --2- 172.21.15.104:0/3881977143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c580d07c0 0x7f6c4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580d0f50 con 0x7f6c44004800 2024-05-08T04:24:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44005550 con 0x7f6c44003b70 2024-05-08T04:24:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4400bf00 con 0x7f6c580d07c0 2024-05-08T04:24:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c5659c640 1 --2- 172.21.15.104:0/3881977143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c44004800 0x7f6c44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c5759e640 1 --2- 172.21.15.104:0/3881977143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c580d07c0 0x7f6c4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c5659c640 1 -- 172.21.15.104:0/3881977143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c580d07c0 msgr2=0x7f6c4400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c5659c640 1 --2- 172.21.15.104:0/3881977143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c580d07c0 0x7f6c4400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c5659c640 1 -- 172.21.15.104:0/3881977143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c44003b70 msgr2=0x7f6c44003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:24:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c5659c640 1 --2- 172.21.15.104:0/3881977143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c44003b70 0x7f6c44003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.987+0000 7f6c5659c640 1 -- 172.21.15.104:0/3881977143 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c44003520 con 0x7f6c44004800 2024-05-08T04:24:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.988+0000 7f6c5659c640 1 --2- 172.21.15.104:0/3881977143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c44004800 0x7f6c44004c80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6c400018d0 tx=0x7f6c44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf8370499e8db62 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.988+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c400014f0 con 0x7f6c44004800 2024-05-08T04:24:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.988+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c400052d0 con 0x7f6c44004800 2024-05-08T04:24:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.988+0000 7f6c55d9b640 1 -- 172.21.15.104:0/3881977143 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4002aca0 con 0x7f6c44004800 2024-05-08T04:24:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.989+0000 7f6c5d17e640 1 -- 172.21.15.104:0/3881977143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c44004800 msgr2=0x7f6c44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.989+0000 7f6c5d17e640 1 --2- 172.21.15.104:0/3881977143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c44004800 0x7f6c44004c80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6c400018d0 tx=0x7f6c44005830 comp rx=0 tx=0).stop 2024-05-08T04:24:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.989+0000 7f6c5759e640 1 -- 172.21.15.104:0/3881977143 reap_dead start 2024-05-08T04:24:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.989+0000 7f6c5d17e640 1 -- 172.21.15.104:0/3881977143 shutdown_connections 2024-05-08T04:24:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.989+0000 7f6c5d17e640 1 -- 172.21.15.104:0/3881977143 >> 172.21.15.104:0/3881977143 conn(0x7f6c58072290 msgr2=0x7f6c58072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:24:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.989+0000 7f6c5d17e640 1 -- 172.21.15.104:0/3881977143 shutdown_connections 2024-05-08T04:24:59.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.989+0000 7f6c5d17e640 1 -- 172.21.15.104:0/3881977143 wait complete. 2024-05-08T04:24:59.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.990+0000 7f6c5d17e640 1 Processor -- start 2024-05-08T04:24:59.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.990+0000 7f6c5d17e640 1 -- start start 2024-05-08T04:24:59.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c5d17e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c44004800 0x7f6c581596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c5d17e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c5814fdc0 0x7f6c580c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c5d17e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c5813fc10 0x7f6c58140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c5d17e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580d1ce0 con 0x7f6c44004800 2024-05-08T04:24:59.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c5d17e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580d1a90 con 0x7f6c5813fc10 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c5d17e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c580b6dc0 con 0x7f6c5814fdc0 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c56d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c44004800 0x7f6c581596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c56d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c44004800 0x7f6c581596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42608/0 (socket says 172.21.15.104:42608) 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c56d9d640 1 -- 172.21.15.104:0/765873520 learned_addr learned my addr 172.21.15.104:0/765873520 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c5759e640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c5813fc10 0x7f6c58140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c5659c640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c5814fdc0 0x7f6c580c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c56d9d640 1 -- 172.21.15.104:0/765873520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c5814fdc0 msgr2=0x7f6c580c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c56d9d640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c5814fdc0 0x7f6c580c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c56d9d640 1 -- 172.21.15.104:0/765873520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c5813fc10 msgr2=0x7f6c58140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c56d9d640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c5813fc10 0x7f6c58140090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c56d9d640 1 -- 172.21.15.104:0/765873520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c580caaf0 con 0x7f6c44004800 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c5659c640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c5814fdc0 0x7f6c580c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c5759e640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c5813fc10 0x7f6c58140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:24:59.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.991+0000 7f6c56d9d640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c44004800 0x7f6c581596e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800caa0 tx=0x7f6c4800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:24:59.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.992+0000 7f6c4f7fe640 1 -- 172.21.15.104:0/765873520 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48018070 con 0x7f6c44004800 2024-05-08T04:24:59.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.992+0000 7f6c4f7fe640 1 -- 172.21.15.104:0/765873520 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4800a6d0 con 0x7f6c44004800 2024-05-08T04:24:59.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.992+0000 7f6c5d17e640 1 -- 172.21.15.104:0/765873520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c580cadd0 con 0x7f6c44004800 2024-05-08T04:24:59.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.992+0000 7f6c4f7fe640 1 -- 172.21.15.104:0/765873520 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800aac0 con 0x7f6c44004800 2024-05-08T04:24:59.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.992+0000 7f6c5d17e640 1 -- 172.21.15.104:0/765873520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c58158ee0 con 0x7f6c44004800 2024-05-08T04:24:59.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.993+0000 7f6c5d17e640 1 -- 172.21.15.104:0/765873520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c58075010 con 0x7f6c44004800 2024-05-08T04:24:59.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.993+0000 7f6c4f7fe640 1 -- 172.21.15.104:0/765873520 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f6c4801b070 con 0x7f6c44004800 2024-05-08T04:24:59.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.994+0000 7f6c4f7fe640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c3806b710 0x7f6c3806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:24:59.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.994+0000 7f6c4f7fe640 1 -- 172.21.15.104:0/765873520 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6c48089eb0 con 0x7f6c44004800 2024-05-08T04:24:59.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.994+0000 7f6c5659c640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c3806b710 0x7f6c3806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:24:59.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.994+0000 7f6c5659c640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c3806b710 0x7f6c3806dbd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6c40032000 tx=0x7f6c40009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:00.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:24:59.998+0000 7f6c4f7fe640 1 -- 172.21.15.104:0/765873520 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c48058990 con 0x7f6c44004800 2024-05-08T04:25:00.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.171+0000 7f6c5d17e640 1 -- 172.21.15.104:0/765873520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c580d1870 con 0x7f6c44004800 2024-05-08T04:25:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.172+0000 7f6c4f7fe640 1 -- 172.21.15.104:0/765873520 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16821 (secure 0 0 0) 0x7f6c48058290 con 0x7f6c44004800 2024-05-08T04:25:00.174 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:25:00.174 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":61,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:24:52.781593+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-08T04:24:36.286493+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-08T04:24:37.038502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.14","mappings":[{"from":6,"to":1}]},{"pgid":"9.3b","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:25:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.174+0000 7f6c5d17e640 1 -- 172.21.15.104:0/765873520 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c3806b710 msgr2=0x7f6c3806dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.174+0000 7f6c5d17e640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c3806b710 0x7f6c3806dbd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6c40032000 tx=0x7f6c40009030 comp rx=0 tx=0).stop 2024-05-08T04:25:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.174+0000 7f6c5d17e640 1 -- 172.21.15.104:0/765873520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c44004800 msgr2=0x7f6c581596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.174+0000 7f6c5d17e640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c44004800 0x7f6c581596e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800caa0 tx=0x7f6c4800cf60 comp rx=0 tx=0).stop 2024-05-08T04:25:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.174+0000 7f6c5d17e640 1 -- 172.21.15.104:0/765873520 shutdown_connections 2024-05-08T04:25:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.174+0000 7f6c5d17e640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6c3806b710 0x7f6c3806dbd0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.174+0000 7f6c5d17e640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c5813fc10 0x7f6c58140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.174+0000 7f6c5d17e640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c5814fdc0 0x7f6c580c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.174+0000 7f6c5d17e640 1 --2- 172.21.15.104:0/765873520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6c44004800 0x7f6c581596e0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.174+0000 7f6c5d17e640 1 -- 172.21.15.104:0/765873520 >> 172.21.15.104:0/765873520 conn(0x7f6c58072290 msgr2=0x7f6c58073fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.174+0000 7f6c5d17e640 1 -- 172.21.15.104:0/765873520 shutdown_connections 2024-05-08T04:25:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.174+0000 7f6c5d17e640 1 -- 172.21.15.104:0/765873520 wait complete. 2024-05-08T04:25:00.187 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T04:25:00.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.285+0000 7f546a93b640 1 Processor -- start 2024-05-08T04:25:00.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.285+0000 7f546a93b640 1 -- start start 2024-05-08T04:25:00.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.286+0000 7f546a93b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f54640b5de0 0x7f54640cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:00.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.286+0000 7f546a93b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54640d1610 con 0x7f54640b6c90 2024-05-08T04:25:00.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.286+0000 7f546a93b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54640cfee0 con 0x7f54640ce920 2024-05-08T04:25:00.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.286+0000 7f546a93b640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54640d01c0 con 0x7f54640b5de0 2024-05-08T04:25:00.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.286+0000 7f5468ed8640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f54640b5de0 0x7f54640cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:00.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.286+0000 7f5463fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f54640b6c90 0x7f54640ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:37444/0 (socket says 172.21.15.104:37444) 2024-05-08T04:25:00.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.286+0000 7f5463fff640 1 -- 172.21.15.104:0/1417418216 learned_addr learned my addr 172.21.15.104:0/1417418216 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:00.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.287+0000 7f5468ed8640 1 -- 172.21.15.104:0/1417418216 >> v1:172.21.15.183:6789/0 conn(0x7f54640ce920 legacy=0x7f546415e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:00.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.287+0000 7f5468ed8640 1 -- 172.21.15.104:0/1417418216 >> v1:172.21.15.104:6789/0 conn(0x7f54640b6c90 legacy=0x7f54640ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:00.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.287+0000 7f5468ed8640 1 -- 172.21.15.104:0/1417418216 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54640d04a0 con 0x7f54640b5de0 2024-05-08T04:25:00.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.287+0000 7f5468ed8640 1 --2- 172.21.15.104:0/1417418216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54640b5de0 0x7f54640cf900 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f545c009dc0 tx=0x7f545c02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd48ac80e74aafa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:00.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.287+0000 7f5462ffd640 1 -- 172.21.15.104:0/1417418216 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c007740 con 0x7f54640b5de0 2024-05-08T04:25:00.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.287+0000 7f5462ffd640 1 -- 172.21.15.104:0/1417418216 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c0078e0 con 0x7f54640b5de0 2024-05-08T04:25:00.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.288+0000 7f5462ffd640 1 -- 172.21.15.104:0/1417418216 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c007cb0 con 0x7f54640b5de0 2024-05-08T04:25:00.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.288+0000 7f546a93b640 1 -- 172.21.15.104:0/1417418216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54640b5de0 msgr2=0x7f54640cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:00.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.288+0000 7f546a93b640 1 --2- 172.21.15.104:0/1417418216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54640b5de0 0x7f54640cf900 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f545c009dc0 tx=0x7f545c02a760 comp rx=0 tx=0).stop 2024-05-08T04:25:00.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.288+0000 7f546a93b640 1 -- 172.21.15.104:0/1417418216 shutdown_connections 2024-05-08T04:25:00.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.288+0000 7f546a93b640 1 --2- 172.21.15.104:0/1417418216 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54640b5de0 0x7f54640cf900 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.288+0000 7f546a93b640 1 -- 172.21.15.104:0/1417418216 >> 172.21.15.104:0/1417418216 conn(0x7f546406f480 msgr2=0x7f546406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:00.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.288+0000 7f546a93b640 1 -- 172.21.15.104:0/1417418216 shutdown_connections 2024-05-08T04:25:00.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.288+0000 7f546a93b640 1 -- 172.21.15.104:0/1417418216 wait complete. 2024-05-08T04:25:00.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.289+0000 7f546a93b640 1 Processor -- start 2024-05-08T04:25:00.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.290+0000 7f546a93b640 1 -- start start 2024-05-08T04:25:00.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.290+0000 7f546a93b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54640b5de0 0x7f54641dec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:00.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.290+0000 7f546a93b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54640b6c90 0x7f54640b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:00.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.290+0000 7f546a93b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54640ce920 0x7f54641e5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:00.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.290+0000 7f546a93b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54640d0d20 con 0x7f54640b5de0 2024-05-08T04:25:00.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.290+0000 7f546a93b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54640b4880 con 0x7f54640ce920 2024-05-08T04:25:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.290+0000 7f546a93b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54640d0ea0 con 0x7f54640b6c90 2024-05-08T04:25:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.290+0000 7f5463fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54640b5de0 0x7f54641dec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.290+0000 7f5463fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54640b5de0 0x7f54641dec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42634/0 (socket says 172.21.15.104:42634) 2024-05-08T04:25:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.290+0000 7f5463fff640 1 -- 172.21.15.104:0/3730746097 learned_addr learned my addr 172.21.15.104:0/3730746097 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f5468ed8640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54640ce920 0x7f54641e5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f5463fff640 1 -- 172.21.15.104:0/3730746097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54640b6c90 msgr2=0x7f54640b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f54637fe640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54640b6c90 0x7f54640b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f5463fff640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54640b6c90 0x7f54640b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f5463fff640 1 -- 172.21.15.104:0/3730746097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54640ce920 msgr2=0x7f54641e5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f5463fff640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54640ce920 0x7f54641e5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f5463fff640 1 -- 172.21.15.104:0/3730746097 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54641e55a0 con 0x7f54640b5de0 2024-05-08T04:25:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f5468ed8640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54640ce920 0x7f54641e5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:00.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f5463fff640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54640b5de0 0x7f54641dec60 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f545400c3c0 tx=0x7f545400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:00.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f5460ff9640 1 -- 172.21.15.104:0/3730746097 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454017070 con 0x7f54640b5de0 2024-05-08T04:25:00.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f5460ff9640 1 -- 172.21.15.104:0/3730746097 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5454005ce0 con 0x7f54640b5de0 2024-05-08T04:25:00.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f546a93b640 1 -- 172.21.15.104:0/3730746097 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54640c7c90 con 0x7f54640b5de0 2024-05-08T04:25:00.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f5460ff9640 1 -- 172.21.15.104:0/3730746097 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54540072f0 con 0x7f54640b5de0 2024-05-08T04:25:00.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.291+0000 7f546a93b640 1 -- 172.21.15.104:0/3730746097 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54640c8250 con 0x7f54640b5de0 2024-05-08T04:25:00.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.292+0000 7f546a93b640 1 -- 172.21.15.104:0/3730746097 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546406fd00 con 0x7f54640b5de0 2024-05-08T04:25:00.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.293+0000 7f5460ff9640 1 -- 172.21.15.104:0/3730746097 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f545401a070 con 0x7f54640b5de0 2024-05-08T04:25:00.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.293+0000 7f5460ff9640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f545006b740 0x7f545006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:00.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.293+0000 7f5460ff9640 1 -- 172.21.15.104:0/3730746097 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5454089950 con 0x7f54640b5de0 2024-05-08T04:25:00.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.293+0000 7f54637fe640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f545006b740 0x7f545006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:00.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.294+0000 7f54637fe640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f545006b740 0x7f545006dc00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f54640c5e50 tx=0x7f5458009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.297+0000 7f5460ff9640 1 -- 172.21.15.104:0/3730746097 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f546406fd00 con 0x7f54640b5de0 2024-05-08T04:25:00.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.502+0000 7f546a93b640 1 -- 172.21.15.104:0/3730746097 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5464068090 con 0x7f54640b5de0 2024-05-08T04:25:00.505 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-05-08T04:25:00.503+0000 7f0fa0f98640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T04:25:00.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.504+0000 7f5460ff9640 1 -- 172.21.15.104:0/3730746097 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) v1 ==== 161+0+0 (secure 0 0 0) 0x7f54540584c0 con 0x7f54640b5de0 2024-05-08T04:25:00.506 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T04:25:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.506+0000 7f546a93b640 1 -- 172.21.15.104:0/3730746097 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f545006b740 msgr2=0x7f545006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.506+0000 7f546a93b640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f545006b740 0x7f545006dc00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f54640c5e50 tx=0x7f5458009040 comp rx=0 tx=0).stop 2024-05-08T04:25:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.506+0000 7f546a93b640 1 -- 172.21.15.104:0/3730746097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54640b5de0 msgr2=0x7f54641dec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.506+0000 7f546a93b640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54640b5de0 0x7f54641dec60 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f545400c3c0 tx=0x7f545400c880 comp rx=0 tx=0).stop 2024-05-08T04:25:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.506+0000 7f546a93b640 1 -- 172.21.15.104:0/3730746097 shutdown_connections 2024-05-08T04:25:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.506+0000 7f546a93b640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f545006b740 0x7f545006dc00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.506+0000 7f546a93b640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54640ce920 0x7f54641e5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.506+0000 7f546a93b640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54640b6c90 0x7f54640b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.506+0000 7f546a93b640 1 --2- 172.21.15.104:0/3730746097 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54640b5de0 0x7f54641dec60 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.506+0000 7f546a93b640 1 -- 172.21.15.104:0/3730746097 >> 172.21.15.104:0/3730746097 conn(0x7f546406f480 msgr2=0x7f54640b7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:00.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.507+0000 7f546a93b640 1 -- 172.21.15.104:0/3730746097 shutdown_connections 2024-05-08T04:25:00.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.507+0000 7f546a93b640 1 -- 172.21.15.104:0/3730746097 wait complete. 2024-05-08T04:25:00.511 INFO:tasks.ceph.mds.b.smithi183.stderr: -6110> 2024-05-08T04:24:33.666+0000 7ff356d86640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-05-08T04:25:00.512 INFO:tasks.ceph.mds.b.smithi183.stderr: -4847> 2024-05-08T04:24:43.993+0000 7ff350d7a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T04:25:00.520 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T04:25:00.544 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2024-05-08T04:25:00.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.619+0000 7fca3a86f640 1 Processor -- start 2024-05-08T04:25:00.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.620+0000 7fca3a86f640 1 -- start start 2024-05-08T04:25:00.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.620+0000 7fca3a86f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fca34099a40 0x7fca34099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:00.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.620+0000 7fca3a86f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca340cd940 con 0x7fca3415d490 2024-05-08T04:25:00.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.620+0000 7fca3a86f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca340cc8a0 con 0x7fca340b2b80 2024-05-08T04:25:00.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.620+0000 7fca3a86f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3409a3e0 con 0x7fca34099a40 2024-05-08T04:25:00.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.620+0000 7fca2bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fca34099a40 0x7fca34099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:00.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.620+0000 7fca38e0c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fca3415d490 0x7fca3415d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:37454/0 (socket says 172.21.15.104:37454) 2024-05-08T04:25:00.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.620+0000 7fca2bfff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fca34099a40 0x7fca34099ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42644/0 (socket says 172.21.15.104:42644) 2024-05-08T04:25:00.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.620+0000 7fca38e0c640 1 -- 172.21.15.104:0/733465996 learned_addr learned my addr 172.21.15.104:0/733465996 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:00.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.621+0000 7fca2bfff640 1 -- 172.21.15.104:0/733465996 >> v1:172.21.15.183:6789/0 conn(0x7fca340b2b80 legacy=0x7fca3409a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:00.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.621+0000 7fca2bfff640 1 -- 172.21.15.104:0/733465996 >> v1:172.21.15.104:6789/0 conn(0x7fca3415d490 legacy=0x7fca3415d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:00.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.621+0000 7fca337fe640 1 -- 172.21.15.104:0/733465996 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450703439 0 0) 0x7fca340cd940 con 0x7fca3415d490 2024-05-08T04:25:00.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.621+0000 7fca2bfff640 1 -- 172.21.15.104:0/733465996 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca340ccb80 con 0x7fca34099a40 2024-05-08T04:25:00.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.621+0000 7fca2bfff640 1 --2- 172.21.15.104:0/733465996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca34099a40 0x7fca34099ea0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0097a0 tx=0x7fca1c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a237ca0b74402d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:00.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.622+0000 7fca337fe640 1 -- 172.21.15.104:0/733465996 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c037070 con 0x7fca34099a40 2024-05-08T04:25:00.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.622+0000 7fca337fe640 1 -- 172.21.15.104:0/733465996 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c032640 con 0x7fca34099a40 2024-05-08T04:25:00.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.622+0000 7fca337fe640 1 -- 172.21.15.104:0/733465996 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c032a10 con 0x7fca34099a40 2024-05-08T04:25:00.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.622+0000 7fca3a86f640 1 -- 172.21.15.104:0/733465996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca34099a40 msgr2=0x7fca34099ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:00.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.622+0000 7fca3a86f640 1 --2- 172.21.15.104:0/733465996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca34099a40 0x7fca34099ea0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0097a0 tx=0x7fca1c02a2c0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.622+0000 7fca3a86f640 1 -- 172.21.15.104:0/733465996 shutdown_connections 2024-05-08T04:25:00.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.622+0000 7fca3a86f640 1 --2- 172.21.15.104:0/733465996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca34099a40 0x7fca34099ea0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.622+0000 7fca3a86f640 1 -- 172.21.15.104:0/733465996 >> 172.21.15.104:0/733465996 conn(0x7fca340b3310 msgr2=0x7fca340b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:00.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.622+0000 7fca3a86f640 1 -- 172.21.15.104:0/733465996 shutdown_connections 2024-05-08T04:25:00.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.622+0000 7fca3a86f640 1 -- 172.21.15.104:0/733465996 wait complete. 2024-05-08T04:25:00.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.623+0000 7fca3a86f640 1 Processor -- start 2024-05-08T04:25:00.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.624+0000 7fca3a86f640 1 -- start start 2024-05-08T04:25:00.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.624+0000 7fca3a86f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca34099a40 0x7fca341533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:00.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.624+0000 7fca3a86f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca340b2b80 0x7fca340b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.624+0000 7fca3a86f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca3415d490 0x7fca3406f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.624+0000 7fca3a86f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3406cc80 con 0x7fca3415d490 2024-05-08T04:25:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.624+0000 7fca3a86f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca340cd140 con 0x7fca34099a40 2024-05-08T04:25:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.624+0000 7fca3a86f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca340cf830 con 0x7fca340b2b80 2024-05-08T04:25:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.624+0000 7fca38e0c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca3415d490 0x7fca3406f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.624+0000 7fca38e0c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca3415d490 0x7fca3406f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42646/0 (socket says 172.21.15.104:42646) 2024-05-08T04:25:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.624+0000 7fca38e0c640 1 -- 172.21.15.104:0/1655076475 learned_addr learned my addr 172.21.15.104:0/1655076475 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.624+0000 7fca33fff640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca34099a40 0x7fca341533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.624+0000 7fca2bfff640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca340b2b80 0x7fca340b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.625+0000 7fca38e0c640 1 -- 172.21.15.104:0/1655076475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca340b2b80 msgr2=0x7fca340b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.625+0000 7fca38e0c640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca340b2b80 0x7fca340b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.625+0000 7fca38e0c640 1 -- 172.21.15.104:0/1655076475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca34099a40 msgr2=0x7fca341533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.625+0000 7fca38e0c640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca34099a40 0x7fca341533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.625+0000 7fca38e0c640 1 -- 172.21.15.104:0/1655076475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca341538f0 con 0x7fca3415d490 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.625+0000 7fca33fff640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca34099a40 0x7fca341533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.625+0000 7fca38e0c640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca3415d490 0x7fca3406f390 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00c730 tx=0x7fca2c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.625+0000 7fca317fa640 1 -- 172.21.15.104:0/1655076475 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c018070 con 0x7fca3415d490 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.625+0000 7fca317fa640 1 -- 172.21.15.104:0/1655076475 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c00ce40 con 0x7fca3415d490 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.625+0000 7fca3a86f640 1 -- 172.21.15.104:0/1655076475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca341f7b20 con 0x7fca3415d490 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.625+0000 7fca317fa640 1 -- 172.21.15.104:0/1655076475 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c00a880 con 0x7fca3415d490 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.625+0000 7fca3a86f640 1 -- 172.21.15.104:0/1655076475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca341f7040 con 0x7fca3415d490 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.626+0000 7fca3a86f640 1 -- 172.21.15.104:0/1655076475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca34075010 con 0x7fca3415d490 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.626+0000 7fca317fa640 1 -- 172.21.15.104:0/1655076475 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fca2c01b070 con 0x7fca3415d490 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.627+0000 7fca317fa640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fca1406b710 0x7fca1406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.627+0000 7fca317fa640 1 -- 172.21.15.104:0/1655076475 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fca2c089c30 con 0x7fca3415d490 2024-05-08T04:25:00.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.627+0000 7fca33fff640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fca1406b710 0x7fca1406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:00.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.627+0000 7fca33fff640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fca1406b710 0x7fca1406dbd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fca24007fd0 tx=0x7fca24009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:00.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.631+0000 7fca317fa640 1 -- 172.21.15.104:0/1655076475 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca341538f0 con 0x7fca3415d490 2024-05-08T04:25:00.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:00.840+0000 7fca3a86f640 1 -- 172.21.15.104:0/1655076475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fca340cf4c0 con 0x7fca3415d490 2024-05-08T04:25:01.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.509+0000 7fca317fa640 1 -- 172.21.15.104:0/1655076475 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7fca2c058630 con 0x7fca3415d490 2024-05-08T04:25:01.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.511+0000 7fca3a86f640 1 -- 172.21.15.104:0/1655076475 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fca1406b710 msgr2=0x7fca1406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:01.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.511+0000 7fca3a86f640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fca1406b710 0x7fca1406dbd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fca24007fd0 tx=0x7fca24009040 comp rx=0 tx=0).stop 2024-05-08T04:25:01.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.511+0000 7fca3a86f640 1 -- 172.21.15.104:0/1655076475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca3415d490 msgr2=0x7fca3406f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:01.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.511+0000 7fca3a86f640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca3415d490 0x7fca3406f390 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fca2c00c730 tx=0x7fca2c00cbf0 comp rx=0 tx=0).stop 2024-05-08T04:25:01.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.511+0000 7fca3a86f640 1 -- 172.21.15.104:0/1655076475 shutdown_connections 2024-05-08T04:25:01.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.511+0000 7fca3a86f640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fca1406b710 0x7fca1406dbd0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:01.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.511+0000 7fca3a86f640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca3415d490 0x7fca3406f390 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:01.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.511+0000 7fca3a86f640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca340b2b80 0x7fca340b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:01.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.511+0000 7fca3a86f640 1 --2- 172.21.15.104:0/1655076475 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca34099a40 0x7fca341533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:01.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.511+0000 7fca3a86f640 1 -- 172.21.15.104:0/1655076475 >> 172.21.15.104:0/1655076475 conn(0x7fca340b3310 msgr2=0x7fca340b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:01.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.511+0000 7fca3a86f640 1 -- 172.21.15.104:0/1655076475 shutdown_connections 2024-05-08T04:25:01.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.511+0000 7fca3a86f640 1 -- 172.21.15.104:0/1655076475 wait complete. 2024-05-08T04:25:01.525 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T04:25:01.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.628+0000 7f6ccabf4640 1 Processor -- start 2024-05-08T04:25:01.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.628+0000 7f6ccabf4640 1 -- start start 2024-05-08T04:25:01.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.629+0000 7f6ccabf4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6cc4161190 0x7f6cc4072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:01.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.629+0000 7f6ccabf4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6cc406bb70 0x7f6cc406bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:01.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.629+0000 7f6ccabf4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc406c4c0 con 0x7f6cc4072a70 2024-05-08T04:25:01.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.629+0000 7f6ccabf4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc40b4db0 con 0x7f6cc406bb70 2024-05-08T04:25:01.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.629+0000 7f6ccabf4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc406de30 con 0x7f6cc4161190 2024-05-08T04:25:01.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.629+0000 7f6cc9191640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6cc406bb70 0x7f6cc406bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:01.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.629+0000 7f6cc9191640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6cc406bb70 0x7f6cc406bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42658/0 (socket says 172.21.15.104:42658) 2024-05-08T04:25:01.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.629+0000 7f6cc9191640 1 -- 172.21.15.104:0/274656802 learned_addr learned my addr 172.21.15.104:0/274656802 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:01.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.629+0000 7f6cc8990640 1 --2- 172.21.15.104:0/274656802 >> v2:172.21.15.183:3300/0 conn(0x7f6cc4161190 0x7f6cc4072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:01.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.630+0000 7f6cc9191640 1 -- 172.21.15.104:0/274656802 >> v2:172.21.15.183:3300/0 conn(0x7f6cc4161190 msgr2=0x7f6cc4072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:01.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.630+0000 7f6cc9191640 1 --2- 172.21.15.104:0/274656802 >> v2:172.21.15.183:3300/0 conn(0x7f6cc4161190 0x7f6cc4072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:01.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.630+0000 7f6cc9191640 1 -- 172.21.15.104:0/274656802 >> v1:172.21.15.183:6789/0 conn(0x7f6cc4072a70 legacy=0x7f6cc40acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:01.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.630+0000 7f6cc9191640 1 -- 172.21.15.104:0/274656802 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc406e110 con 0x7f6cc406bb70 2024-05-08T04:25:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.630+0000 7f6cc9191640 1 --2- 172.21.15.104:0/274656802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc406bb70 0x7f6cc406bf80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6cc406faa0 tx=0x7f6cbc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d7b0db5dd9d54a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.631+0000 7f6cbb7fe640 1 -- 172.21.15.104:0/274656802 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc036070 con 0x7f6cc406bb70 2024-05-08T04:25:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.631+0000 7f6cbb7fe640 1 -- 172.21.15.104:0/274656802 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc031600 con 0x7f6cc406bb70 2024-05-08T04:25:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.631+0000 7f6cbb7fe640 1 -- 172.21.15.104:0/274656802 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc0319d0 con 0x7f6cc406bb70 2024-05-08T04:25:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.631+0000 7f6ccabf4640 1 -- 172.21.15.104:0/274656802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc406bb70 msgr2=0x7f6cc406bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.631+0000 7f6ccabf4640 1 --2- 172.21.15.104:0/274656802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc406bb70 0x7f6cc406bf80 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6cc406faa0 tx=0x7f6cbc02a6f0 comp rx=0 tx=0).stop 2024-05-08T04:25:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.631+0000 7f6ccabf4640 1 -- 172.21.15.104:0/274656802 shutdown_connections 2024-05-08T04:25:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.631+0000 7f6ccabf4640 1 --2- 172.21.15.104:0/274656802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc406bb70 0x7f6cc406bf80 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.631+0000 7f6ccabf4640 1 --2- 172.21.15.104:0/274656802 >> v2:172.21.15.183:3300/0 conn(0x7f6cc4161190 0x7f6cc4072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.631+0000 7f6ccabf4640 1 -- 172.21.15.104:0/274656802 >> 172.21.15.104:0/274656802 conn(0x7f6cc4071a10 msgr2=0x7f6cc4071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.631+0000 7f6ccabf4640 1 -- 172.21.15.104:0/274656802 shutdown_connections 2024-05-08T04:25:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.631+0000 7f6ccabf4640 1 -- 172.21.15.104:0/274656802 wait complete. 2024-05-08T04:25:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.632+0000 7f6ccabf4640 1 Processor -- start 2024-05-08T04:25:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.632+0000 7f6ccabf4640 1 -- start start 2024-05-08T04:25:01.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.633+0000 7f6ccabf4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc406bb70 0x7f6cc4159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:01.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.633+0000 7f6ccabf4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cc4161190 0x7f6cc4152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:01.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.633+0000 7f6ccabf4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cc4152c60 0x7f6cc41548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:01.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.633+0000 7f6ccabf4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc406e9b0 con 0x7f6cc406bb70 2024-05-08T04:25:01.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.633+0000 7f6ccabf4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc406e6d0 con 0x7f6cc4161190 2024-05-08T04:25:01.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.633+0000 7f6ccabf4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40ad500 con 0x7f6cc4152c60 2024-05-08T04:25:01.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.633+0000 7f6cc8990640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc406bb70 0x7f6cc4159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:01.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.633+0000 7f6cc8990640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc406bb70 0x7f6cc4159340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42664/0 (socket says 172.21.15.104:42664) 2024-05-08T04:25:01.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.633+0000 7f6cc8990640 1 -- 172.21.15.104:0/3415016200 learned_addr learned my addr 172.21.15.104:0/3415016200 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:01.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.633+0000 7f6cbbfff640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cc4161190 0x7f6cc4152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:01.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.633+0000 7f6cc9191640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cc4152c60 0x7f6cc41548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:01.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.633+0000 7f6cc8990640 1 -- 172.21.15.104:0/3415016200 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cc4152c60 msgr2=0x7f6cc41548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:01.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.634+0000 7f6cc8990640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cc4152c60 0x7f6cc41548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:01.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.634+0000 7f6cc8990640 1 -- 172.21.15.104:0/3415016200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cc4161190 msgr2=0x7f6cc4152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:01.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.634+0000 7f6cc8990640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cc4161190 0x7f6cc4152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:01.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.634+0000 7f6cc8990640 1 -- 172.21.15.104:0/3415016200 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc4155630 con 0x7f6cc406bb70 2024-05-08T04:25:01.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.634+0000 7f6cc9191640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cc4152c60 0x7f6cc41548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:01.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.634+0000 7f6cc8990640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc406bb70 0x7f6cc4159340 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000d5f0 tx=0x7f6cc000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:01.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.634+0000 7f6cb97fa640 1 -- 172.21.15.104:0/3415016200 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00125f0 con 0x7f6cc406bb70 2024-05-08T04:25:01.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.634+0000 7f6cb97fa640 1 -- 172.21.15.104:0/3415016200 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc0019070 con 0x7f6cc406bb70 2024-05-08T04:25:01.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.634+0000 7f6ccabf4640 1 -- 172.21.15.104:0/3415016200 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc4155fd0 con 0x7f6cc406bb70 2024-05-08T04:25:01.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.634+0000 7f6cb97fa640 1 -- 172.21.15.104:0/3415016200 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00129d0 con 0x7f6cc406bb70 2024-05-08T04:25:01.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.634+0000 7f6ccabf4640 1 -- 172.21.15.104:0/3415016200 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc4156590 con 0x7f6cc406bb70 2024-05-08T04:25:01.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.635+0000 7f6ccabf4640 1 -- 172.21.15.104:0/3415016200 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc4153070 con 0x7f6cc406bb70 2024-05-08T04:25:01.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.635+0000 7f6cb97fa640 1 -- 172.21.15.104:0/3415016200 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f6cc0012b70 con 0x7f6cc406bb70 2024-05-08T04:25:01.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.636+0000 7f6cb97fa640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6cb006b740 0x7f6cb006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:01.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.636+0000 7f6cb97fa640 1 -- 172.21.15.104:0/3415016200 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f6cc008a9b0 con 0x7f6cc406bb70 2024-05-08T04:25:01.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.636+0000 7f6cbbfff640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6cb006b740 0x7f6cb006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:01.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.636+0000 7f6cbbfff640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6cb006b740 0x7f6cb006dc00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6cc41608e0 tx=0x7f6cb4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:01.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.640+0000 7f6cb97fa640 1 -- 172.21.15.104:0/3415016200 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6cc4153070 con 0x7f6cc406bb70 2024-05-08T04:25:01.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:01.820+0000 7f6ccabf4640 1 -- 172.21.15.104:0/3415016200 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6cc4066a30 con 0x7f6cc406bb70 2024-05-08T04:25:02.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.812+0000 7f6cb97fa640 1 -- 172.21.15.104:0/3415016200 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6cc00594d0 con 0x7f6cc406bb70 2024-05-08T04:25:02.814 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-05-08T04:25:02.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.815+0000 7f6ccabf4640 1 -- 172.21.15.104:0/3415016200 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6cb006b740 msgr2=0x7f6cb006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:02.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.815+0000 7f6ccabf4640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6cb006b740 0x7f6cb006dc00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6cc41608e0 tx=0x7f6cb4009040 comp rx=0 tx=0).stop 2024-05-08T04:25:02.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.815+0000 7f6ccabf4640 1 -- 172.21.15.104:0/3415016200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc406bb70 msgr2=0x7f6cc4159340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:02.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.815+0000 7f6ccabf4640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc406bb70 0x7f6cc4159340 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000d5f0 tx=0x7f6cc000dab0 comp rx=0 tx=0).stop 2024-05-08T04:25:02.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.815+0000 7f6ccabf4640 1 -- 172.21.15.104:0/3415016200 shutdown_connections 2024-05-08T04:25:02.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.815+0000 7f6ccabf4640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6cb006b740 0x7f6cb006dc00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:02.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.815+0000 7f6ccabf4640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cc4161190 0x7f6cc4152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:02.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.815+0000 7f6ccabf4640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cc4152c60 0x7f6cc41548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:02.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.815+0000 7f6ccabf4640 1 --2- 172.21.15.104:0/3415016200 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cc406bb70 0x7f6cc4159340 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:02.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.815+0000 7f6ccabf4640 1 -- 172.21.15.104:0/3415016200 >> 172.21.15.104:0/3415016200 conn(0x7f6cc4071a10 msgr2=0x7f6cc406edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:02.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.815+0000 7f6ccabf4640 1 -- 172.21.15.104:0/3415016200 shutdown_connections 2024-05-08T04:25:02.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.815+0000 7f6ccabf4640 1 -- 172.21.15.104:0/3415016200 wait complete. 2024-05-08T04:25:02.831 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T04:25:02.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.938+0000 7f5a628b3640 1 Processor -- start 2024-05-08T04:25:02.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.938+0000 7f5a628b3640 1 -- start start 2024-05-08T04:25:02.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.939+0000 7f5a628b3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a5c0cc930 0x7f5a5c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:02.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.939+0000 7f5a628b3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5a5c0711c0 0x7f5a5c15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:02.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.939+0000 7f5a628b3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5c071fb0 con 0x7f5a5c144c80 2024-05-08T04:25:02.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.939+0000 7f5a628b3640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5c0cd250 con 0x7f5a5c0711c0 2024-05-08T04:25:02.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.939+0000 7f5a628b3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c071710 con 0x7f5a5c0cc930 2024-05-08T04:25:02.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.939+0000 7f5a5b7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5a5c0711c0 0x7f5a5c15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:02.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.939+0000 7f5a5b7fe640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5a5c0711c0 0x7f5a5c15f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42670/0 (socket says 172.21.15.104:42670) 2024-05-08T04:25:02.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.939+0000 7f5a5b7fe640 1 -- 172.21.15.104:0/2710620102 learned_addr learned my addr 172.21.15.104:0/2710620102 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:02.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.940+0000 7f5a5b7fe640 1 -- 172.21.15.104:0/2710620102 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a5c0cc930 msgr2=0x7f5a5c0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:02.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.940+0000 7f5a5b7fe640 1 --2- 172.21.15.104:0/2710620102 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a5c0cc930 0x7f5a5c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:02.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.940+0000 7f5a5b7fe640 1 -- 172.21.15.104:0/2710620102 >> v1:172.21.15.183:6789/0 conn(0x7f5a5c144c80 legacy=0x7f5a5c15fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:02.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.940+0000 7f5a5b7fe640 1 -- 172.21.15.104:0/2710620102 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c0719f0 con 0x7f5a5c0711c0 2024-05-08T04:25:02.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.940+0000 7f5a5b7fe640 1 --2- 172.21.15.104:0/2710620102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a5c0711c0 0x7f5a5c15f5a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009870 tx=0x7f5a5002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86511c10551391 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:02.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.940+0000 7f5a5affd640 1 -- 172.21.15.104:0/2710620102 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50037070 con 0x7f5a5c0711c0 2024-05-08T04:25:02.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.940+0000 7f5a5affd640 1 -- 172.21.15.104:0/2710620102 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a50032440 con 0x7f5a5c0711c0 2024-05-08T04:25:02.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.940+0000 7f5a5affd640 1 -- 172.21.15.104:0/2710620102 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50032810 con 0x7f5a5c0711c0 2024-05-08T04:25:02.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.941+0000 7f5a628b3640 1 -- 172.21.15.104:0/2710620102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a5c0711c0 msgr2=0x7f5a5c15f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:02.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.941+0000 7f5a628b3640 1 --2- 172.21.15.104:0/2710620102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a5c0711c0 0x7f5a5c15f5a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009870 tx=0x7f5a5002a180 comp rx=0 tx=0).stop 2024-05-08T04:25:02.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.941+0000 7f5a628b3640 1 -- 172.21.15.104:0/2710620102 shutdown_connections 2024-05-08T04:25:02.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.941+0000 7f5a628b3640 1 --2- 172.21.15.104:0/2710620102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a5c0711c0 0x7f5a5c15f5a0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:02.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.941+0000 7f5a628b3640 1 --2- 172.21.15.104:0/2710620102 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a5c0cc930 0x7f5a5c0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:02.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.941+0000 7f5a628b3640 1 -- 172.21.15.104:0/2710620102 >> 172.21.15.104:0/2710620102 conn(0x7f5a5c0b13f0 msgr2=0x7f5a5c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:02.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.941+0000 7f5a628b3640 1 -- 172.21.15.104:0/2710620102 shutdown_connections 2024-05-08T04:25:02.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.941+0000 7f5a628b3640 1 -- 172.21.15.104:0/2710620102 wait complete. 2024-05-08T04:25:02.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.942+0000 7f5a628b3640 1 Processor -- start 2024-05-08T04:25:02.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.942+0000 7f5a628b3640 1 -- start start 2024-05-08T04:25:02.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.943+0000 7f5a628b3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a5c0711c0 0x7f5a5c1f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:02.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.943+0000 7f5a628b3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a5c0cc930 0x7f5a5c1f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:02.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.943+0000 7f5a628b3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a5c144c80 0x7f5a5c0a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:02.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.943+0000 7f5a628b3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c0cf3b0 con 0x7f5a5c0cc930 2024-05-08T04:25:02.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.943+0000 7f5a628b3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c06d330 con 0x7f5a5c0711c0 2024-05-08T04:25:02.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.943+0000 7f5a628b3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c1453f0 con 0x7f5a5c144c80 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.943+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a5c0cc930 0x7f5a5c1f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.943+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a5c0cc930 0x7f5a5c1f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42678/0 (socket says 172.21.15.104:42678) 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.943+0000 7f5a5b7fe640 1 -- 172.21.15.104:0/2118303420 learned_addr learned my addr 172.21.15.104:0/2118303420 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.943+0000 7f5a60e50640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a5c144c80 0x7f5a5c0a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.943+0000 7f5a5bfff640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a5c0711c0 0x7f5a5c1f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.944+0000 7f5a5b7fe640 1 -- 172.21.15.104:0/2118303420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a5c144c80 msgr2=0x7f5a5c0a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.944+0000 7f5a5b7fe640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a5c144c80 0x7f5a5c0a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.944+0000 7f5a5b7fe640 1 -- 172.21.15.104:0/2118303420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a5c0711c0 msgr2=0x7f5a5c1f2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.944+0000 7f5a5b7fe640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a5c0711c0 0x7f5a5c1f2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.944+0000 7f5a5b7fe640 1 -- 172.21.15.104:0/2118303420 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c0a9ea0 con 0x7f5a5c0cc930 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.944+0000 7f5a5b7fe640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a5c0cc930 0x7f5a5c1f4eb0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009870 tx=0x7f5a500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.944+0000 7f5a58ff9640 1 -- 172.21.15.104:0/2118303420 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50041070 con 0x7f5a5c0cc930 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.944+0000 7f5a58ff9640 1 -- 172.21.15.104:0/2118303420 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5003c870 con 0x7f5a5c0cc930 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.944+0000 7f5a628b3640 1 -- 172.21.15.104:0/2118303420 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5c13ec90 con 0x7f5a5c0cc930 2024-05-08T04:25:02.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.944+0000 7f5a58ff9640 1 -- 172.21.15.104:0/2118303420 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50037040 con 0x7f5a5c0cc930 2024-05-08T04:25:02.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.944+0000 7f5a628b3640 1 -- 172.21.15.104:0/2118303420 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5c13f250 con 0x7f5a5c0cc930 2024-05-08T04:25:02.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.945+0000 7f5a628b3640 1 -- 172.21.15.104:0/2118303420 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5c075010 con 0x7f5a5c0cc930 2024-05-08T04:25:02.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.945+0000 7f5a58ff9640 1 -- 172.21.15.104:0/2118303420 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f5a50044070 con 0x7f5a5c0cc930 2024-05-08T04:25:02.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.946+0000 7f5a58ff9640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5a4806b740 0x7f5a4806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:02.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.946+0000 7f5a58ff9640 1 -- 172.21.15.104:0/2118303420 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f5a500ab000 con 0x7f5a5c0cc930 2024-05-08T04:25:02.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.946+0000 7f5a5bfff640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5a4806b740 0x7f5a4806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:02.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.946+0000 7f5a5bfff640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5a4806b740 0x7f5a4806dc00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00b810 tx=0x7f5a4c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:02.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:02.950+0000 7f5a58ff9640 1 -- 172.21.15.104:0/2118303420 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5a50079cd0 con 0x7f5a5c0cc930 2024-05-08T04:25:03.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.122+0000 7f5a628b3640 1 -- 172.21.15.104:0/2118303420 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5a5c15f2e0 con 0x7f5a5c0cc930 2024-05-08T04:25:03.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.813+0000 7f5a58ff9640 1 -- 172.21.15.104:0/2118303420 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5a500795d0 con 0x7f5a5c0cc930 2024-05-08T04:25:03.815 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-05-08T04:25:03.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.816+0000 7f5a628b3640 1 -- 172.21.15.104:0/2118303420 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5a4806b740 msgr2=0x7f5a4806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:03.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.816+0000 7f5a628b3640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5a4806b740 0x7f5a4806dc00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00b810 tx=0x7f5a4c008040 comp rx=0 tx=0).stop 2024-05-08T04:25:03.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.816+0000 7f5a628b3640 1 -- 172.21.15.104:0/2118303420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a5c0cc930 msgr2=0x7f5a5c1f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:03.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.816+0000 7f5a628b3640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a5c0cc930 0x7f5a5c1f4eb0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009870 tx=0x7f5a500046c0 comp rx=0 tx=0).stop 2024-05-08T04:25:03.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.816+0000 7f5a628b3640 1 -- 172.21.15.104:0/2118303420 shutdown_connections 2024-05-08T04:25:03.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.816+0000 7f5a628b3640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5a4806b740 0x7f5a4806dc00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:03.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.816+0000 7f5a628b3640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a5c144c80 0x7f5a5c0a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:03.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.816+0000 7f5a628b3640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a5c0cc930 0x7f5a5c1f4eb0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:03.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.816+0000 7f5a628b3640 1 --2- 172.21.15.104:0/2118303420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a5c0711c0 0x7f5a5c1f2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:03.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.816+0000 7f5a628b3640 1 -- 172.21.15.104:0/2118303420 >> 172.21.15.104:0/2118303420 conn(0x7f5a5c0b13f0 msgr2=0x7f5a5c0b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:03.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.817+0000 7f5a628b3640 1 -- 172.21.15.104:0/2118303420 shutdown_connections 2024-05-08T04:25:03.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.817+0000 7f5a628b3640 1 -- 172.21.15.104:0/2118303420 wait complete. 2024-05-08T04:25:03.831 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-08T04:25:03.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.930+0000 7f36300f7640 1 Processor -- start 2024-05-08T04:25:03.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.931+0000 7f36300f7640 1 -- start start 2024-05-08T04:25:03.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.931+0000 7f36300f7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3628072160 0x7f362806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:03.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.931+0000 7f36300f7640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362815dce0 con 0x7f362815a2a0 2024-05-08T04:25:03.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.931+0000 7f36300f7640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362806eb60 con 0x7f3628159ec0 2024-05-08T04:25:03.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.931+0000 7f36300f7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362806ee40 con 0x7f3628072160 2024-05-08T04:25:03.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362e694640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f362815a2a0 0x7f36280b26f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:37456/0 (socket says 172.21.15.104:37456) 2024-05-08T04:25:03.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362e694640 1 -- 172.21.15.104:0/1334185768 learned_addr learned my addr 172.21.15.104:0/1334185768 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:03.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362d692640 1 --2- 172.21.15.104:0/1334185768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3628072160 0x7f362806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:03.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207755902 0 0) 0x7f362815dce0 con 0x7f362815a2a0 2024-05-08T04:25:03.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3614003520 con 0x7f362815a2a0 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861656108 0 0) 0x7f362806eb60 con 0x7f3628159ec0 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f362815dce0 con 0x7f3628159ec0 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3544359632 0 0) 0x7f3614003520 con 0x7f362815a2a0 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3628072160 msgr2=0x7f362806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 --2- 172.21.15.104:0/1334185768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3628072160 0x7f362806e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 >> v1:172.21.15.183:6789/0 conn(0x7f3628159ec0 legacy=0x7f3628071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362815df80 con 0x7f362815a2a0 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f36200015f0 con 0x7f362815a2a0 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 >> v1:172.21.15.104:6789/0 conn(0x7f362815a2a0 legacy=0x7f36280b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 --2- 172.21.15.104:0/1334185768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3614003b70 0x7f3614003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 --2- 172.21.15.104:0/1334185768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3614004800 0x7f3614004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 --2- 172.21.15.104:0/1334185768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3628072160 0x7f36140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362806ee40 con 0x7f3614004800 2024-05-08T04:25:03.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361400baa0 con 0x7f3614003b70 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361400bca0 con 0x7f3628072160 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362d692640 1 --2- 172.21.15.104:0/1334185768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3614004800 0x7f3614004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362e694640 1 --2- 172.21.15.104:0/1334185768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3628072160 0x7f36140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.932+0000 7f362de93640 1 --2- 172.21.15.104:0/1334185768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3614003b70 0x7f3614003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.933+0000 7f362d692640 1 -- 172.21.15.104:0/1334185768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3628072160 msgr2=0x7f36140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.933+0000 7f362d692640 1 --2- 172.21.15.104:0/1334185768 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3628072160 0x7f36140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.933+0000 7f362d692640 1 -- 172.21.15.104:0/1334185768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3614003b70 msgr2=0x7f3614003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.933+0000 7f362d692640 1 --2- 172.21.15.104:0/1334185768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3614003b70 0x7f3614003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.933+0000 7f362d692640 1 -- 172.21.15.104:0/1334185768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3614003520 con 0x7f3614004800 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.933+0000 7f362d692640 1 --2- 172.21.15.104:0/1334185768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3614004800 0x7f3614004c80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f3618009a90 tx=0x7f3614005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b858f229cda4486d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.933+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618036070 con 0x7f3614004800 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.933+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3618031400 con 0x7f3614004800 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.933+0000 7f362ce91640 1 -- 172.21.15.104:0/1334185768 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618009690 con 0x7f3614004800 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.934+0000 7f36300f7640 1 -- 172.21.15.104:0/1334185768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3614004800 msgr2=0x7f3614004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.934+0000 7f36300f7640 1 --2- 172.21.15.104:0/1334185768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3614004800 0x7f3614004c80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f3618009a90 tx=0x7f3614005830 comp rx=0 tx=0).stop 2024-05-08T04:25:03.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.934+0000 7f362e694640 1 -- 172.21.15.104:0/1334185768 reap_dead start 2024-05-08T04:25:03.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.934+0000 7f36300f7640 1 -- 172.21.15.104:0/1334185768 shutdown_connections 2024-05-08T04:25:03.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.934+0000 7f36300f7640 1 -- 172.21.15.104:0/1334185768 >> 172.21.15.104:0/1334185768 conn(0x7f36280b13f0 msgr2=0x7f36280b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:03.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.934+0000 7f36300f7640 1 -- 172.21.15.104:0/1334185768 shutdown_connections 2024-05-08T04:25:03.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.934+0000 7f36300f7640 1 -- 172.21.15.104:0/1334185768 wait complete. 2024-05-08T04:25:03.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.935+0000 7f36300f7640 1 Processor -- start 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.935+0000 7f36300f7640 1 -- start start 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.936+0000 7f36300f7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3614004800 0x7f3628148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.936+0000 7f36300f7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f362815ce00 0x7f3628155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.936+0000 7f36300f7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3628149580 0x7f3628149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.936+0000 7f36300f7640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362806e650 con 0x7f3614004800 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.936+0000 7f36300f7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362806e4d0 con 0x7f362815ce00 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.936+0000 7f36300f7640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362806e7d0 con 0x7f3628149580 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.936+0000 7f362de93640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3614004800 0x7f3628148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.936+0000 7f362de93640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3614004800 0x7f3628148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42704/0 (socket says 172.21.15.104:42704) 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.936+0000 7f362de93640 1 -- 172.21.15.104:0/3931724500 learned_addr learned my addr 172.21.15.104:0/3931724500 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.936+0000 7f362e694640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3628149580 0x7f3628149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.936+0000 7f362d692640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f362815ce00 0x7f3628155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.936+0000 7f362de93640 1 -- 172.21.15.104:0/3931724500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3628149580 msgr2=0x7f3628149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.936+0000 7f362de93640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3628149580 0x7f3628149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:03.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.937+0000 7f362de93640 1 -- 172.21.15.104:0/3931724500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f362815ce00 msgr2=0x7f3628155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.937+0000 7f362de93640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f362815ce00 0x7f3628155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.937+0000 7f362de93640 1 -- 172.21.15.104:0/3931724500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36281f7390 con 0x7f3614004800 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.937+0000 7f362de93640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3614004800 0x7f3628148cb0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f362400fc30 tx=0x7f362400d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.937+0000 7f361e7fc640 1 -- 172.21.15.104:0/3931724500 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624016020 con 0x7f3614004800 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.937+0000 7f361e7fc640 1 -- 172.21.15.104:0/3931724500 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3624006b50 con 0x7f3614004800 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.937+0000 7f36300f7640 1 -- 172.21.15.104:0/3931724500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36281f7670 con 0x7f3614004800 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.937+0000 7f361e7fc640 1 -- 172.21.15.104:0/3931724500 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400c040 con 0x7f3614004800 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.937+0000 7f36300f7640 1 -- 172.21.15.104:0/3931724500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36281f7c30 con 0x7f3614004800 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.938+0000 7f36300f7640 1 -- 172.21.15.104:0/3931724500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3628075010 con 0x7f3614004800 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.938+0000 7f361e7fc640 1 -- 172.21.15.104:0/3931724500 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f3624019020 con 0x7f3614004800 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.939+0000 7f361e7fc640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f360c06b740 0x7f360c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.939+0000 7f361e7fc640 1 -- 172.21.15.104:0/3931724500 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f362408a830 con 0x7f3614004800 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.939+0000 7f362d692640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f360c06b740 0x7f360c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:03.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.939+0000 7f362d692640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f360c06b740 0x7f360c06dc00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3618033000 tx=0x7f3618008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:03.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:03.943+0000 7f361e7fc640 1 -- 172.21.15.104:0/3931724500 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3624020020 con 0x7f3614004800 2024-05-08T04:25:04.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.114+0000 7f36300f7640 1 -- 172.21.15.104:0/3931724500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f36280b0560 con 0x7f3614004800 2024-05-08T04:25:04.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.117+0000 7f361e7fc640 1 -- 172.21.15.104:0/3931724500 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3624011350 con 0x7f3614004800 2024-05-08T04:25:04.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.119+0000 7f36300f7640 1 -- 172.21.15.104:0/3931724500 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f360c06b740 msgr2=0x7f360c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:04.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.119+0000 7f36300f7640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f360c06b740 0x7f360c06dc00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3618033000 tx=0x7f3618008030 comp rx=0 tx=0).stop 2024-05-08T04:25:04.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.119+0000 7f36300f7640 1 -- 172.21.15.104:0/3931724500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3614004800 msgr2=0x7f3628148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:04.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.119+0000 7f36300f7640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3614004800 0x7f3628148cb0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f362400fc30 tx=0x7f362400d5c0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.119+0000 7f36300f7640 1 -- 172.21.15.104:0/3931724500 shutdown_connections 2024-05-08T04:25:04.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.119+0000 7f36300f7640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f360c06b740 0x7f360c06dc00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.119+0000 7f36300f7640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f362815ce00 0x7f3628155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.119+0000 7f36300f7640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3628149580 0x7f3628149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.119+0000 7f36300f7640 1 --2- 172.21.15.104:0/3931724500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3614004800 0x7f3628148cb0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.119+0000 7f36300f7640 1 -- 172.21.15.104:0/3931724500 >> 172.21.15.104:0/3931724500 conn(0x7f36280b13f0 msgr2=0x7f36280b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:04.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.119+0000 7f36300f7640 1 -- 172.21.15.104:0/3931724500 shutdown_connections 2024-05-08T04:25:04.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.119+0000 7f36300f7640 1 -- 172.21.15.104:0/3931724500 wait complete. 2024-05-08T04:25:04.133 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_dangling_symlink' 2024-05-08T04:25:04.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.230+0000 7f56e024a640 1 Processor -- start 2024-05-08T04:25:04.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.230+0000 7f56e024a640 1 -- start start 2024-05-08T04:25:04.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56e024a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56d80ceee0 0x7f56d80b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:04.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56e024a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f56d806e330 0x7f56d806e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:04.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56e024a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f56d80b3ff0 0x7f56d80b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:04.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56e024a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d815f390 con 0x7f56d806e330 2024-05-08T04:25:04.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56e024a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d80b49c0 con 0x7f56d80b3ff0 2024-05-08T04:25:04.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56e024a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d815e780 con 0x7f56d80ceee0 2024-05-08T04:25:04.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56dd7e5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f56d806e330 0x7f56d806e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:04.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56dd7e5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f56d806e330 0x7f56d806e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42716/0 (socket says 172.21.15.104:42716) 2024-05-08T04:25:04.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56dd7e5640 1 -- 172.21.15.104:0/2406601598 learned_addr learned my addr 172.21.15.104:0/2406601598 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:04.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56ddfe6640 1 --2- 172.21.15.104:0/2406601598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56d80ceee0 0x7f56d80b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:04.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56de7e7640 1 --2- 172.21.15.104:0/2406601598 >> v2:172.21.15.183:3300/0 conn(0x7f56d80b3ff0 0x7f56d80b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:04.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56dd7e5640 1 -- 172.21.15.104:0/2406601598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56d80ceee0 msgr2=0x7f56d80b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:04.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56dd7e5640 1 --2- 172.21.15.104:0/2406601598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56d80ceee0 0x7f56d80b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56dd7e5640 1 -- 172.21.15.104:0/2406601598 >> v2:172.21.15.183:3300/0 conn(0x7f56d80b3ff0 msgr2=0x7f56d80b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:04.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56dd7e5640 1 --2- 172.21.15.104:0/2406601598 >> v2:172.21.15.183:3300/0 conn(0x7f56d80b3ff0 0x7f56d80b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.231+0000 7f56dd7e5640 1 -- 172.21.15.104:0/2406601598 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d815ea60 con 0x7f56d806e330 2024-05-08T04:25:04.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.232+0000 7f56dd7e5640 1 --2- 172.21.15.104:0/2406601598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56d806e330 0x7f56d806e7b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009870 tx=0x7f56c802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f1de4dbcac951f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:04.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.232+0000 7f56dcfe4640 1 -- 172.21.15.104:0/2406601598 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8037070 con 0x7f56d806e330 2024-05-08T04:25:04.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.232+0000 7f56dcfe4640 1 -- 172.21.15.104:0/2406601598 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c8032440 con 0x7f56d806e330 2024-05-08T04:25:04.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.232+0000 7f56dcfe4640 1 -- 172.21.15.104:0/2406601598 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8032810 con 0x7f56d806e330 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.232+0000 7f56e024a640 1 -- 172.21.15.104:0/2406601598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56d806e330 msgr2=0x7f56d806e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.232+0000 7f56e024a640 1 --2- 172.21.15.104:0/2406601598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56d806e330 0x7f56d806e7b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009870 tx=0x7f56c802a210 comp rx=0 tx=0).stop 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.233+0000 7f56e024a640 1 -- 172.21.15.104:0/2406601598 shutdown_connections 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.233+0000 7f56e024a640 1 --2- 172.21.15.104:0/2406601598 >> v2:172.21.15.183:3300/0 conn(0x7f56d80b3ff0 0x7f56d80b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.233+0000 7f56e024a640 1 --2- 172.21.15.104:0/2406601598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56d806e330 0x7f56d806e7b0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.233+0000 7f56e024a640 1 --2- 172.21.15.104:0/2406601598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56d80ceee0 0x7f56d80b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.233+0000 7f56e024a640 1 -- 172.21.15.104:0/2406601598 >> 172.21.15.104:0/2406601598 conn(0x7f56d80b13f0 msgr2=0x7f56d80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.233+0000 7f56e024a640 1 -- 172.21.15.104:0/2406601598 shutdown_connections 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.233+0000 7f56e024a640 1 -- 172.21.15.104:0/2406601598 wait complete. 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.234+0000 7f56e024a640 1 Processor -- start 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.234+0000 7f56e024a640 1 -- start start 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56e024a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56d806e330 0x7f56d81efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56e024a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56d80b3ff0 0x7f56d80711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:04.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56e024a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56d80ceee0 0x7f56d8071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56e024a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80cf2c0 con 0x7f56d80b3ff0 2024-05-08T04:25:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56e024a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d815f020 con 0x7f56d80ceee0 2024-05-08T04:25:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56e024a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80cf440 con 0x7f56d806e330 2024-05-08T04:25:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56dd7e5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56d80b3ff0 0x7f56d80711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56dd7e5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56d80b3ff0 0x7f56d80711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42726/0 (socket says 172.21.15.104:42726) 2024-05-08T04:25:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56dd7e5640 1 -- 172.21.15.104:0/3784267075 learned_addr learned my addr 172.21.15.104:0/3784267075 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56de7e7640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56d80ceee0 0x7f56d8071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56ddfe6640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56d806e330 0x7f56d81efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56dd7e5640 1 -- 172.21.15.104:0/3784267075 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56d806e330 msgr2=0x7f56d81efbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56dd7e5640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56d806e330 0x7f56d81efbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56dd7e5640 1 -- 172.21.15.104:0/3784267075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56d80ceee0 msgr2=0x7f56d8071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56dd7e5640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56d80ceee0 0x7f56d8071700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56dd7e5640 1 -- 172.21.15.104:0/3784267075 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d815b110 con 0x7f56d80b3ff0 2024-05-08T04:25:04.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56de7e7640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56d80ceee0 0x7f56d8071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:04.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56dd7e5640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56d80b3ff0 0x7f56d80711c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f56c8000c00 tx=0x7f56c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:04.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56ce7fc640 1 -- 172.21.15.104:0/3784267075 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8044680 con 0x7f56d80b3ff0 2024-05-08T04:25:04.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56ce7fc640 1 -- 172.21.15.104:0/3784267075 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c8044820 con 0x7f56d80b3ff0 2024-05-08T04:25:04.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56e024a640 1 -- 172.21.15.104:0/3784267075 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d815b3f0 con 0x7f56d80b3ff0 2024-05-08T04:25:04.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56ce7fc640 1 -- 172.21.15.104:0/3784267075 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8044c10 con 0x7f56d80b3ff0 2024-05-08T04:25:04.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.235+0000 7f56e024a640 1 -- 172.21.15.104:0/3784267075 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d815b9b0 con 0x7f56d80b3ff0 2024-05-08T04:25:04.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.236+0000 7f56e024a640 1 -- 172.21.15.104:0/3784267075 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d8075010 con 0x7f56d80b3ff0 2024-05-08T04:25:04.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.237+0000 7f56ce7fc640 1 -- 172.21.15.104:0/3784267075 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f56c804d3f0 con 0x7f56d80b3ff0 2024-05-08T04:25:04.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.237+0000 7f56ce7fc640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f56bc06b740 0x7f56bc06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:04.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.238+0000 7f56ddfe6640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f56bc06b740 0x7f56bc06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:04.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.238+0000 7f56ce7fc640 1 -- 172.21.15.104:0/3784267075 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f56c80ac7a0 con 0x7f56d80b3ff0 2024-05-08T04:25:04.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.238+0000 7f56ddfe6640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f56bc06b740 0x7f56bc06dc00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f56d4006fd0 tx=0x7f56d4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:04.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.242+0000 7f56ce7fc640 1 -- 172.21.15.104:0/3784267075 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56c807b000 con 0x7f56d80b3ff0 2024-05-08T04:25:04.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.475+0000 7f56e024a640 1 -- 172.21.15.104:0/3784267075 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_dangling_symlink"]} v 0) v1 -- 0x7f56d81585b0 con 0x7f56d80b3ff0 2024-05-08T04:25:04.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.818+0000 7f56ce7fc640 1 -- 172.21.15.104:0/3784267075 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_dangling_symlink"]}]=0 v217) v1 ==== 135+0+0 (secure 0 0 0) 0x7f56c807f0a0 con 0x7f56d80b3ff0 2024-05-08T04:25:04.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.820+0000 7f56e024a640 1 -- 172.21.15.104:0/3784267075 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f56bc06b740 msgr2=0x7f56bc06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:04.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.820+0000 7f56e024a640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f56bc06b740 0x7f56bc06dc00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f56d4006fd0 tx=0x7f56d4008040 comp rx=0 tx=0).stop 2024-05-08T04:25:04.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.820+0000 7f56e024a640 1 -- 172.21.15.104:0/3784267075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56d80b3ff0 msgr2=0x7f56d80711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:04.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.820+0000 7f56e024a640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56d80b3ff0 0x7f56d80711c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f56c8000c00 tx=0x7f56c80046c0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.820+0000 7f56e024a640 1 -- 172.21.15.104:0/3784267075 shutdown_connections 2024-05-08T04:25:04.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.820+0000 7f56e024a640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f56bc06b740 0x7f56bc06dc00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.820+0000 7f56e024a640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56d80ceee0 0x7f56d8071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.820+0000 7f56e024a640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56d80b3ff0 0x7f56d80711c0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.820+0000 7f56e024a640 1 --2- 172.21.15.104:0/3784267075 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56d806e330 0x7f56d81efbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:04.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.820+0000 7f56e024a640 1 -- 172.21.15.104:0/3784267075 >> 172.21.15.104:0/3784267075 conn(0x7f56d80b13f0 msgr2=0x7f56d80b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:04.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.820+0000 7f56e024a640 1 -- 172.21.15.104:0/3784267075 shutdown_connections 2024-05-08T04:25:04.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:04.820+0000 7f56e024a640 1 -- 172.21.15.104:0/3784267075 wait complete. 2024-05-08T04:25:04.837 INFO:tasks.cephfs_test_runner:Tests for the presence of any dangling symlink, if yes, ... ERROR 2024-05-08T04:25:04.837 INFO:tasks.cephfs_test_runner: 2024-05-08T04:25:04.837 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-08T04:25:04.837 INFO:tasks.cephfs_test_runner:ERROR: test_dangling_symlink (tasks.cephfs.test_volumes.TestMisc) 2024-05-08T04:25:04.837 INFO:tasks.cephfs_test_runner:Tests for the presence of any dangling symlink, if yes, 2024-05-08T04:25:04.837 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-08T04:25:04.837 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-08T04:25:04.837 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa/tasks/cephfs/test_volumes.py", line 8185, in test_dangling_symlink 2024-05-08T04:25:04.837 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolumegroup", "snapshot", "create", self.volname, group, snapshot) 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa/tasks/cephfs/test_volumes.py", line 33, in _fs_cmd 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: r.wait() 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-05-08T04:25:04.838 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi104 with status 38: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot create cephfs subvol_grp9070 subvol_snap54470' 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner: 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner:Ran 3 tests in 205.929s 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner: 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner: 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner:ERROR: test_dangling_symlink (tasks.cephfs.test_volumes.TestMisc) 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner:Tests for the presence of any dangling symlink, if yes, 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa/tasks/cephfs/test_volumes.py", line 8185, in test_dangling_symlink 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolumegroup", "snapshot", "create", self.volname, group, snapshot) 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa/tasks/cephfs/test_volumes.py", line 33, in _fs_cmd 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-05-08T04:25:04.839 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner: r.wait() 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi104 with status 38: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot create cephfs subvol_grp9070 subvol_snap54470' 2024-05-08T04:25:04.840 INFO:tasks.cephfs_test_runner: 2024-05-08T04:25:04.841 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_dangling_symlink (tasks.cephfs.test_volumes.TestMisc) 2024-05-08T04:25:05.028 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=62d96d4f8908412ba6f287d52c67760a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4f7075d1ae67d7d50c1b1c72da1cb2a47b619f20/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_dangling_symlink (tasks.cephfs.test_volumes.TestMisc) 2024-05-08T04:25:05.030 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-08T04:25:05.039 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-08T04:25:05.054 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-08T04:25:05.054 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:25:05.054 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:25:05.074 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=587 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T04:25:05.074 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-05-08T04:25:05.074 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:25:05.130 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=587 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-08T04:25:05.130 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:25:05.130 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:25:05.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13681 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T04:25:05.151 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T04:25:05.151 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T04:25:05.210 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13681 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-08T04:25:05.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:25:05.211 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-05-08T04:25:05.227 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-08T04:25:05.227 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T04:25:05.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:25:05.228 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T04:25:05.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:25:05.293 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T04:25:05.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:25:05.359 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-05-08T04:25:05.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:25:05.463 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2024-05-08T04:25:05.481 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-08T04:25:05.482 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-08T04:25:05.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:25:05.482 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T04:25:05.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:25:05.553 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T04:25:05.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T04:25:05.623 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2024-05-08T04:25:05.721 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T04:25:05.730 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T04:25:05.731 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:25:05.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.832+0000 7fc4dd34f640 1 Processor -- start 2024-05-08T04:25:05.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.832+0000 7fc4dd34f640 1 -- start start 2024-05-08T04:25:05.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4dd34f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4d8159ec0 0x7fc4d806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:05.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4dd34f640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc4d815a2a0 0x7fc4d815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:05.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4dd34f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc4d815e780 0x7fc4d8071a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:05.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4dd34f640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d815dce0 con 0x7fc4d815a2a0 2024-05-08T04:25:05.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4dd34f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d806eb60 con 0x7fc4d815e780 2024-05-08T04:25:05.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4dd34f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d806ee40 con 0x7fc4d8159ec0 2024-05-08T04:25:05.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4cffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc4d815a2a0 0x7fc4d815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:05.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4cffff640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc4d815a2a0 0x7fc4d815b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42728/0 (socket says 172.21.15.104:42728) 2024-05-08T04:25:05.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4cffff640 1 -- 172.21.15.104:0/3224648450 learned_addr learned my addr 172.21.15.104:0/3224648450 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:05.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4d77fe640 1 --2- 172.21.15.104:0/3224648450 >> v2:172.21.15.183:3300/0 conn(0x7fc4d815e780 0x7fc4d8071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:05.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4cffff640 1 -- 172.21.15.104:0/3224648450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4d8159ec0 msgr2=0x7fc4d806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:05.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4d6ffd640 1 --2- 172.21.15.104:0/3224648450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4d8159ec0 0x7fc4d806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:05.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4cffff640 1 --2- 172.21.15.104:0/3224648450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4d8159ec0 0x7fc4d806e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:05.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4cffff640 1 -- 172.21.15.104:0/3224648450 >> v2:172.21.15.183:3300/0 conn(0x7fc4d815e780 msgr2=0x7fc4d8071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:05.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4cffff640 1 --2- 172.21.15.104:0/3224648450 >> v2:172.21.15.183:3300/0 conn(0x7fc4d815e780 0x7fc4d8071a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:05.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4cffff640 1 -- 172.21.15.104:0/3224648450 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d815df80 con 0x7fc4d815a2a0 2024-05-08T04:25:05.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4d77fe640 1 --2- 172.21.15.104:0/3224648450 >> v2:172.21.15.183:3300/0 conn(0x7fc4d815e780 0x7fc4d8071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:05.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.833+0000 7fc4d6ffd640 1 --2- 172.21.15.104:0/3224648450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4d8159ec0 0x7fc4d806e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:05.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.834+0000 7fc4cffff640 1 --2- 172.21.15.104:0/3224648450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4d815a2a0 0x7fc4d815b1e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fc4d806f120 tx=0x7fc4c002b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b415835d90739770 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:05.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.834+0000 7fc4d67fc640 1 -- 172.21.15.104:0/3224648450 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c000b040 con 0x7fc4d815a2a0 2024-05-08T04:25:05.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.834+0000 7fc4d67fc640 1 -- 172.21.15.104:0/3224648450 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c0030710 con 0x7fc4d815a2a0 2024-05-08T04:25:05.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.834+0000 7fc4d67fc640 1 -- 172.21.15.104:0/3224648450 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0030ae0 con 0x7fc4d815a2a0 2024-05-08T04:25:05.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.835+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3224648450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4d815a2a0 msgr2=0x7fc4d815b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:05.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.835+0000 7fc4dd34f640 1 --2- 172.21.15.104:0/3224648450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4d815a2a0 0x7fc4d815b1e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fc4d806f120 tx=0x7fc4c002b5a0 comp rx=0 tx=0).stop 2024-05-08T04:25:05.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.835+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3224648450 shutdown_connections 2024-05-08T04:25:05.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.835+0000 7fc4dd34f640 1 --2- 172.21.15.104:0/3224648450 >> v2:172.21.15.183:3300/0 conn(0x7fc4d815e780 0x7fc4d8071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:05.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.835+0000 7fc4dd34f640 1 --2- 172.21.15.104:0/3224648450 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4d815a2a0 0x7fc4d815b1e0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:05.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.835+0000 7fc4dd34f640 1 --2- 172.21.15.104:0/3224648450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4d8159ec0 0x7fc4d806e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:05.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.835+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3224648450 >> 172.21.15.104:0/3224648450 conn(0x7fc4d80b13f0 msgr2=0x7fc4d80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:05.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.835+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3224648450 shutdown_connections 2024-05-08T04:25:05.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.835+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3224648450 wait complete. 2024-05-08T04:25:05.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.836+0000 7fc4dd34f640 1 Processor -- start 2024-05-08T04:25:05.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.836+0000 7fc4dd34f640 1 -- start start 2024-05-08T04:25:05.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4dd34f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4d8159ec0 0x7fc4d80cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:05.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4dd34f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4d815a2a0 0x7fc4d80cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:05.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4dd34f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4d815e780 0x7fc4d81f17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:05.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4dd34f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d8071f90 con 0x7fc4d815e780 2024-05-08T04:25:05.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4dd34f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d815ec10 con 0x7fc4d8159ec0 2024-05-08T04:25:05.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4dd34f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d8072110 con 0x7fc4d815a2a0 2024-05-08T04:25:05.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4d77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4d815e780 0x7fc4d81f17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:05.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4d77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4d815e780 0x7fc4d81f17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42742/0 (socket says 172.21.15.104:42742) 2024-05-08T04:25:05.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4d77fe640 1 -- 172.21.15.104:0/3733888325 learned_addr learned my addr 172.21.15.104:0/3733888325 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:05.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4cffff640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4d815a2a0 0x7fc4d80cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:05.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4d6ffd640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4d8159ec0 0x7fc4d80cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:05.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4d77fe640 1 -- 172.21.15.104:0/3733888325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4d815a2a0 msgr2=0x7fc4d80cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:05.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4d77fe640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4d815a2a0 0x7fc4d80cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:05.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4d77fe640 1 -- 172.21.15.104:0/3733888325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4d8159ec0 msgr2=0x7fc4d80cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:05.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4d77fe640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4d8159ec0 0x7fc4d80cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:05.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4d77fe640 1 -- 172.21.15.104:0/3733888325 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d80aea40 con 0x7fc4d815e780 2024-05-08T04:25:05.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4d77fe640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4d815e780 0x7fc4d81f17a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000cd50 tx=0x7fc4d000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:05.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4cf7fe640 1 -- 172.21.15.104:0/3733888325 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d000f680 con 0x7fc4d815e780 2024-05-08T04:25:05.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4cf7fe640 1 -- 172.21.15.104:0/3733888325 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d000f840 con 0x7fc4d815e780 2024-05-08T04:25:05.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.837+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3733888325 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d81f23d0 con 0x7fc4d815e780 2024-05-08T04:25:05.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.838+0000 7fc4cf7fe640 1 -- 172.21.15.104:0/3733888325 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d000fc30 con 0x7fc4d815e780 2024-05-08T04:25:05.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.838+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3733888325 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d815b2b0 con 0x7fc4d815e780 2024-05-08T04:25:05.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.838+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3733888325 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d8075010 con 0x7fc4d815e780 2024-05-08T04:25:05.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.839+0000 7fc4cf7fe640 1 -- 172.21.15.104:0/3733888325 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fc4d00213f0 con 0x7fc4d815e780 2024-05-08T04:25:05.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.839+0000 7fc4cf7fe640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc4b806b710 0x7fc4b806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:05.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.839+0000 7fc4cf7fe640 1 -- 172.21.15.104:0/3733888325 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc4d008b050 con 0x7fc4d815e780 2024-05-08T04:25:05.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.839+0000 7fc4d6ffd640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc4b806b710 0x7fc4b806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:05.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.840+0000 7fc4d6ffd640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc4b806b710 0x7fc4b806dbd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80ae700 tx=0x7fc4c8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:05.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:05.844+0000 7fc4cf7fe640 1 -- 172.21.15.104:0/3733888325 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc4d0014030 con 0x7fc4d815e780 2024-05-08T04:25:06.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.010+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3733888325 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4d8159390 con 0x7fc4b806b710 2024-05-08T04:25:06.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.011+0000 7fc4cf7fe640 1 -- 172.21.15.104:0/3733888325 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13427 (secure 0 0 0) 0x7fc4c800f950 con 0x7fc4b806b710 2024-05-08T04:25:06.014 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:25:06.017 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:25:06.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.013+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3733888325 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc4b806b710 msgr2=0x7fc4b806dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.013+0000 7fc4dd34f640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc4b806b710 0x7fc4b806dbd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80ae700 tx=0x7fc4c8008040 comp rx=0 tx=0).stop 2024-05-08T04:25:06.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.013+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3733888325 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4d815e780 msgr2=0x7fc4d81f17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.013+0000 7fc4dd34f640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4d815e780 0x7fc4d81f17a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000cd50 tx=0x7fc4d000a650 comp rx=0 tx=0).stop 2024-05-08T04:25:06.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.013+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3733888325 shutdown_connections 2024-05-08T04:25:06.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.013+0000 7fc4dd34f640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc4b806b710 0x7fc4b806dbd0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.013+0000 7fc4dd34f640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc4d815e780 0x7fc4d81f17a0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.013+0000 7fc4dd34f640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4d815a2a0 0x7fc4d80cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.013+0000 7fc4dd34f640 1 --2- 172.21.15.104:0/3733888325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4d8159ec0 0x7fc4d80cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.013+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3733888325 >> 172.21.15.104:0/3733888325 conn(0x7fc4d80b13f0 msgr2=0x7fc4d8155190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:06.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.013+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3733888325 shutdown_connections 2024-05-08T04:25:06.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.013+0000 7fc4dd34f640 1 -- 172.21.15.104:0/3733888325 wait complete. 2024-05-08T04:25:06.026 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-05-08T04:25:04.686037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223248,"kb_used_data":7096,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751472,"statfs":{"total":773094113280,"available":772865507328,"internally_reserved":0,"allocated":7266304,"data_stored":3752284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28550,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-61,"num_write_kb":-50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001286"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":247,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-08T04:25:01.076914+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:25:01.076914+0000","last_peered":"2024-05-08T04:25:01.076914+0000","last_clean":"2024-05-08T04:25:01.076914+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:25:01.076914+0000","last_undegraded":"2024-05-08T04:25:01.076914+0000","last_fullsized":"2024-05-08T04:25:01.076914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":314051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":313981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1347584,"data_stored":904497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":314575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":314049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":786432,"data_stored":343123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1343488,"data_stored":904909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":782336,"data_stored":343099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:25:06.027 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:25:06.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.125+0000 7f38b3189640 1 Processor -- start 2024-05-08T04:25:06.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.126+0000 7f38b3189640 1 -- start start 2024-05-08T04:25:06.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.126+0000 7f38b3189640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f38ac158540 0x7f38ac15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.126+0000 7f38b3189640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ac073030 con 0x7f38ac0cd830 2024-05-08T04:25:06.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.126+0000 7f38b3189640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ac072210 con 0x7f38ac0701a0 2024-05-08T04:25:06.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.126+0000 7f38b3189640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ac0cbf50 con 0x7f38ac158540 2024-05-08T04:25:06.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.126+0000 7f38b1726640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f38ac0cd830 0x7f38ac0cc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:37458/0 (socket says 172.21.15.104:37458) 2024-05-08T04:25:06.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.126+0000 7f38b1726640 1 -- 172.21.15.104:0/2779118676 learned_addr learned my addr 172.21.15.104:0/2779118676 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:06.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38b0f25640 1 --2- 172.21.15.104:0/2779118676 >> v2:172.21.15.183:3300/0 conn(0x7f38ac158540 0x7f38ac15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127829073 0 0) 0x7f38ac073030 con 0x7f38ac0cd830 2024-05-08T04:25:06.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3894003520 con 0x7f38ac0cd830 2024-05-08T04:25:06.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 32153940 0 0) 0x7f3894003520 con 0x7f38ac0cd830 2024-05-08T04:25:06.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 >> v2:172.21.15.183:3300/0 conn(0x7f38ac158540 msgr2=0x7f38ac15e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:06.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 --2- 172.21.15.104:0/2779118676 >> v2:172.21.15.183:3300/0 conn(0x7f38ac158540 0x7f38ac15e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 >> v1:172.21.15.183:6789/0 conn(0x7f38ac0701a0 legacy=0x7f38ac0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac15e900 con 0x7f38ac0cd830 2024-05-08T04:25:06.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f38a4001670 con 0x7f38ac0cd830 2024-05-08T04:25:06.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 >> v1:172.21.15.104:6789/0 conn(0x7f38ac0cd830 legacy=0x7f38ac0cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 --2- 172.21.15.104:0/2779118676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38940039b0 0x7f3894003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 --2- 172.21.15.104:0/2779118676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3894004800 0x7f3894004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 --2- 172.21.15.104:0/2779118676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38940051c0 0x7f389400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389400c030 con 0x7f38940039b0 2024-05-08T04:25:06.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389400c1e0 con 0x7f38940051c0 2024-05-08T04:25:06.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389400c3e0 con 0x7f3894004800 2024-05-08T04:25:06.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38b0f25640 1 --2- 172.21.15.104:0/2779118676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38940039b0 0x7f3894003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38b1726640 1 --2- 172.21.15.104:0/2779118676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38940051c0 0x7f389400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38abfff640 1 --2- 172.21.15.104:0/2779118676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3894004800 0x7f3894004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38b0f25640 1 -- 172.21.15.104:0/2779118676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3894004800 msgr2=0x7f3894004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:06.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38b0f25640 1 --2- 172.21.15.104:0/2779118676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3894004800 0x7f3894004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38b0f25640 1 -- 172.21.15.104:0/2779118676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38940051c0 msgr2=0x7f389400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:06.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38b0f25640 1 --2- 172.21.15.104:0/2779118676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38940051c0 0x7f389400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38b0f25640 1 -- 172.21.15.104:0/2779118676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3894003520 con 0x7f38940039b0 2024-05-08T04:25:06.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.127+0000 7f38b1726640 1 -- 172.21.15.104:0/2779118676 reap_dead start 2024-05-08T04:25:06.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.128+0000 7f38b0f25640 1 --2- 172.21.15.104:0/2779118676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38940039b0 0x7f3894003dd0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f389c009fc0 tx=0x7f3894005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1380831a66719e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:06.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.128+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c009c10 con 0x7f38940039b0 2024-05-08T04:25:06.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.128+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c036070 con 0x7f38940039b0 2024-05-08T04:25:06.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.128+0000 7f38ab7fe640 1 -- 172.21.15.104:0/2779118676 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c031880 con 0x7f38940039b0 2024-05-08T04:25:06.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.129+0000 7f38b3189640 1 -- 172.21.15.104:0/2779118676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38940039b0 msgr2=0x7f3894003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.129+0000 7f38b3189640 1 --2- 172.21.15.104:0/2779118676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38940039b0 0x7f3894003dd0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f389c009fc0 tx=0x7f3894005830 comp rx=0 tx=0).stop 2024-05-08T04:25:06.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.129+0000 7f38b3189640 1 -- 172.21.15.104:0/2779118676 shutdown_connections 2024-05-08T04:25:06.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.129+0000 7f38b3189640 1 --2- 172.21.15.104:0/2779118676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38940039b0 0x7f3894003dd0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.129+0000 7f38b3189640 1 -- 172.21.15.104:0/2779118676 >> 172.21.15.104:0/2779118676 conn(0x7f38ac0b23e0 msgr2=0x7f38ac0b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:06.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.129+0000 7f38b3189640 1 -- 172.21.15.104:0/2779118676 shutdown_connections 2024-05-08T04:25:06.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.129+0000 7f38b3189640 1 -- 172.21.15.104:0/2779118676 wait complete. 2024-05-08T04:25:06.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.130+0000 7f38b3189640 1 Processor -- start 2024-05-08T04:25:06.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.130+0000 7f38b3189640 1 -- start start 2024-05-08T04:25:06.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b3189640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38940039b0 0x7f38ac14a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b3189640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38ac0b4210 0x7f38ac15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b3189640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38ac14b700 0x7f38ac0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b3189640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac072a70 con 0x7f38ac14b700 2024-05-08T04:25:06.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b3189640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac072790 con 0x7f38ac0b4210 2024-05-08T04:25:06.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b3189640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac072d50 con 0x7f38940039b0 2024-05-08T04:25:06.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b1726640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38ac14b700 0x7f38ac0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b1726640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38ac14b700 0x7f38ac0b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42760/0 (socket says 172.21.15.104:42760) 2024-05-08T04:25:06.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b1726640 1 -- 172.21.15.104:0/136541785 learned_addr learned my addr 172.21.15.104:0/136541785 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:06.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b0f25640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38940039b0 0x7f38ac14a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38abfff640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38ac0b4210 0x7f38ac15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b1726640 1 -- 172.21.15.104:0/136541785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38940039b0 msgr2=0x7f38ac14a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b1726640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38940039b0 0x7f38ac14a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b1726640 1 -- 172.21.15.104:0/136541785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38ac0b4210 msgr2=0x7f38ac15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b1726640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38ac0b4210 0x7f38ac15d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b1726640 1 -- 172.21.15.104:0/136541785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac15afe0 con 0x7f38ac14b700 2024-05-08T04:25:06.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.131+0000 7f38b1726640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38ac14b700 0x7f38ac0b5000 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f38ac06d9e0 tx=0x7f38a400e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:06.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.132+0000 7f38a97fa640 1 -- 172.21.15.104:0/136541785 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a4010450 con 0x7f38ac14b700 2024-05-08T04:25:06.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.132+0000 7f38a97fa640 1 -- 172.21.15.104:0/136541785 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a4010610 con 0x7f38ac14b700 2024-05-08T04:25:06.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.132+0000 7f38b3189640 1 -- 172.21.15.104:0/136541785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38ac15b2c0 con 0x7f38ac14b700 2024-05-08T04:25:06.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.132+0000 7f38a97fa640 1 -- 172.21.15.104:0/136541785 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a4010a00 con 0x7f38ac14b700 2024-05-08T04:25:06.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.132+0000 7f38b3189640 1 -- 172.21.15.104:0/136541785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ac15b880 con 0x7f38ac14b700 2024-05-08T04:25:06.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.133+0000 7f38b3189640 1 -- 172.21.15.104:0/136541785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ac15ba80 con 0x7f38ac14b700 2024-05-08T04:25:06.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.133+0000 7f38a97fa640 1 -- 172.21.15.104:0/136541785 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f38a4010ba0 con 0x7f38ac14b700 2024-05-08T04:25:06.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.134+0000 7f38a97fa640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f389806b710 0x7f389806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.134+0000 7f38b0f25640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f389806b710 0x7f389806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.134+0000 7f38a97fa640 1 -- 172.21.15.104:0/136541785 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f38a4089750 con 0x7f38ac14b700 2024-05-08T04:25:06.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.134+0000 7f38b0f25640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f389806b710 0x7f389806dbd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f389c035000 tx=0x7f389c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:06.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.138+0000 7f38a97fa640 1 -- 172.21.15.104:0/136541785 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f38ac15ba80 con 0x7f38ac14b700 2024-05-08T04:25:06.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.304+0000 7f38b3189640 1 -- 172.21.15.104:0/136541785 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38ac075010 con 0x7f389806b710 2024-05-08T04:25:06.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.305+0000 7f38a97fa640 1 -- 172.21.15.104:0/136541785 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13427 (secure 0 0 0) 0x7f38ac075010 con 0x7f389806b710 2024-05-08T04:25:06.310 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:25:06.311 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:25:06.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.307+0000 7f38b3189640 1 -- 172.21.15.104:0/136541785 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f389806b710 msgr2=0x7f389806dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.307+0000 7f38b3189640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f389806b710 0x7f389806dbd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f389c035000 tx=0x7f389c02f000 comp rx=0 tx=0).stop 2024-05-08T04:25:06.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.307+0000 7f38b3189640 1 -- 172.21.15.104:0/136541785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38ac14b700 msgr2=0x7f38ac0b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.307+0000 7f38b3189640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38ac14b700 0x7f38ac0b5000 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f38ac06d9e0 tx=0x7f38a400e820 comp rx=0 tx=0).stop 2024-05-08T04:25:06.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.307+0000 7f38b3189640 1 -- 172.21.15.104:0/136541785 shutdown_connections 2024-05-08T04:25:06.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.307+0000 7f38b3189640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f389806b710 0x7f389806dbd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.307+0000 7f38b3189640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38ac0b4210 0x7f38ac15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.307+0000 7f38b3189640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38ac14b700 0x7f38ac0b5000 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.307+0000 7f38b3189640 1 --2- 172.21.15.104:0/136541785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38940039b0 0x7f38ac14a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.307+0000 7f38b3189640 1 -- 172.21.15.104:0/136541785 >> 172.21.15.104:0/136541785 conn(0x7f38ac0b23e0 msgr2=0x7f38ac14e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:06.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.307+0000 7f38b3189640 1 -- 172.21.15.104:0/136541785 shutdown_connections 2024-05-08T04:25:06.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.307+0000 7f38b3189640 1 -- 172.21.15.104:0/136541785 wait complete. 2024-05-08T04:25:06.320 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-05-08T04:25:04.686037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223248,"kb_used_data":7096,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751472,"statfs":{"total":773094113280,"available":772865507328,"internally_reserved":0,"allocated":7266304,"data_stored":3752284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28550,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-61,"num_write_kb":-50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001286"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":247,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-08T04:25:01.076914+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:25:01.076914+0000","last_peered":"2024-05-08T04:25:01.076914+0000","last_clean":"2024-05-08T04:25:01.076914+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:25:01.076914+0000","last_undegraded":"2024-05-08T04:25:01.076914+0000","last_fullsized":"2024-05-08T04:25:01.076914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":314051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":313981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1347584,"data_stored":904497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":314575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":314049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":786432,"data_stored":343123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1343488,"data_stored":904909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":782336,"data_stored":343099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:25:06.321 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T04:25:06.321 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:25:06.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.418+0000 7ffbe4522640 1 Processor -- start 2024-05-08T04:25:06.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.418+0000 7ffbe4522640 1 -- start start 2024-05-08T04:25:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe4522640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffbdc0ceee0 0x7ffbdc0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe4522640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffbdc06e330 0x7ffbdc06e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe4522640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbdc0b3ff0 0x7ffbdc0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe4522640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbdc15f390 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe4522640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbdc0b49c0 con 0x7ffbdc06e330 2024-05-08T04:25:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe4522640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc15e780 con 0x7ffbdc0b3ff0 2024-05-08T04:25:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe22be640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffbdc0ceee0 0x7ffbdc0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe22be640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7ffbdc0ceee0 0x7ffbdc0b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42762/0 (socket says 172.21.15.104:42762) 2024-05-08T04:25:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe22be640 1 -- 172.21.15.104:0/2562249340 learned_addr learned my addr 172.21.15.104:0/2562249340 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe1abd640 1 --2- 172.21.15.104:0/2562249340 >> v2:172.21.15.183:3300/0 conn(0x7ffbdc06e330 0x7ffbdc06e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe2abf640 1 --2- 172.21.15.104:0/2562249340 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbdc0b3ff0 0x7ffbdc0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe22be640 1 -- 172.21.15.104:0/2562249340 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbdc0b3ff0 msgr2=0x7ffbdc0b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe22be640 1 --2- 172.21.15.104:0/2562249340 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbdc0b3ff0 0x7ffbdc0b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe22be640 1 -- 172.21.15.104:0/2562249340 >> v2:172.21.15.183:3300/0 conn(0x7ffbdc06e330 msgr2=0x7ffbdc06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:06.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe22be640 1 --2- 172.21.15.104:0/2562249340 >> v2:172.21.15.183:3300/0 conn(0x7ffbdc06e330 0x7ffbdc06e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe22be640 1 -- 172.21.15.104:0/2562249340 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc15ea60 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.419+0000 7ffbe2abf640 1 --2- 172.21.15.104:0/2562249340 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbdc0b3ff0 0x7ffbdc0b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:06.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.420+0000 7ffbe22be640 1 --2- 172.21.15.104:0/2562249340 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbdc0ceee0 0x7ffbdc0b26f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc072a90 tx=0x7ffbd802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25ed5d6b6dc3a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:06.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.420+0000 7ffbe12bc640 1 -- 172.21.15.104:0/2562249340 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8032790 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.420+0000 7ffbe12bc640 1 -- 172.21.15.104:0/2562249340 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd8038070 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.420+0000 7ffbe12bc640 1 -- 172.21.15.104:0/2562249340 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8032b50 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.420+0000 7ffbe4522640 1 -- 172.21.15.104:0/2562249340 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbdc0ceee0 msgr2=0x7ffbdc0b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.420+0000 7ffbe4522640 1 --2- 172.21.15.104:0/2562249340 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbdc0ceee0 0x7ffbdc0b26f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc072a90 tx=0x7ffbd802c890 comp rx=0 tx=0).stop 2024-05-08T04:25:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.421+0000 7ffbe4522640 1 -- 172.21.15.104:0/2562249340 shutdown_connections 2024-05-08T04:25:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.421+0000 7ffbe4522640 1 --2- 172.21.15.104:0/2562249340 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbdc0b3ff0 0x7ffbdc0b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.421+0000 7ffbe4522640 1 --2- 172.21.15.104:0/2562249340 >> v2:172.21.15.183:3300/0 conn(0x7ffbdc06e330 0x7ffbdc06e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.421+0000 7ffbe4522640 1 --2- 172.21.15.104:0/2562249340 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbdc0ceee0 0x7ffbdc0b26f0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.421+0000 7ffbe4522640 1 -- 172.21.15.104:0/2562249340 >> 172.21.15.104:0/2562249340 conn(0x7ffbdc0b13f0 msgr2=0x7ffbdc0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.421+0000 7ffbe4522640 1 -- 172.21.15.104:0/2562249340 shutdown_connections 2024-05-08T04:25:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.421+0000 7ffbe4522640 1 -- 172.21.15.104:0/2562249340 wait complete. 2024-05-08T04:25:06.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.422+0000 7ffbe4522640 1 Processor -- start 2024-05-08T04:25:06.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.422+0000 7ffbe4522640 1 -- start start 2024-05-08T04:25:06.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe4522640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbdc06e330 0x7ffbdc155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe4522640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbdc0b3ff0 0x7ffbdc071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe4522640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbdc0ceee0 0x7ffbdc153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe4522640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0cf2c0 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe4522640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc15f020 con 0x7ffbdc06e330 2024-05-08T04:25:06.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe4522640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0cf440 con 0x7ffbdc0b3ff0 2024-05-08T04:25:06.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe2abf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbdc0ceee0 0x7ffbdc153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe2abf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbdc0ceee0 0x7ffbdc153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42774/0 (socket says 172.21.15.104:42774) 2024-05-08T04:25:06.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe2abf640 1 -- 172.21.15.104:0/2655042421 learned_addr learned my addr 172.21.15.104:0/2655042421 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:06.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe22be640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbdc06e330 0x7ffbdc155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe1abd640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbdc0b3ff0 0x7ffbdc071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe2abf640 1 -- 172.21.15.104:0/2655042421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbdc0b3ff0 msgr2=0x7ffbdc071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe2abf640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbdc0b3ff0 0x7ffbdc071430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe2abf640 1 -- 172.21.15.104:0/2655042421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbdc06e330 msgr2=0x7ffbdc155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe2abf640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbdc06e330 0x7ffbdc155080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe2abf640 1 -- 172.21.15.104:0/2655042421 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc0c6060 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe2abf640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbdc0ceee0 0x7ffbdc153330 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4007ef0 tx=0x7ffbd400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbd2ffd640 1 -- 172.21.15.104:0/2655042421 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd401a070 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbd2ffd640 1 -- 172.21.15.104:0/2655042421 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd4003b90 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbd2ffd640 1 -- 172.21.15.104:0/2655042421 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4004030 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe4522640 1 -- 172.21.15.104:0/2655042421 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc0c65e0 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.423+0000 7ffbe4522640 1 -- 172.21.15.104:0/2655042421 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc0c6ba0 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.424+0000 7ffbe4522640 1 -- 172.21.15.104:0/2655042421 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbdc075010 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.425+0000 7ffbd2ffd640 1 -- 172.21.15.104:0/2655042421 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7ffbd401d070 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.425+0000 7ffbd2ffd640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffbc006b710 0x7ffbc006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.425+0000 7ffbd2ffd640 1 -- 172.21.15.104:0/2655042421 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffbd408a550 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.425+0000 7ffbe22be640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffbc006b710 0x7ffbc006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.426+0000 7ffbe22be640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffbc006b710 0x7ffbc006dbd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8037000 tx=0x7ffbd8032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:06.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.430+0000 7ffbd2ffd640 1 -- 172.21.15.104:0/2655042421 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ffbd4010070 con 0x7ffbdc0ceee0 2024-05-08T04:25:06.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.595+0000 7ffbe4522640 1 -- 172.21.15.104:0/2655042421 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffbdc15a9a0 con 0x7ffbc006b710 2024-05-08T04:25:06.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.596+0000 7ffbd2ffd640 1 -- 172.21.15.104:0/2655042421 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13427 (secure 0 0 0) 0x7ffbdc15a9a0 con 0x7ffbc006b710 2024-05-08T04:25:06.599 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:25:06.599 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:25:06.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.598+0000 7ffbe4522640 1 -- 172.21.15.104:0/2655042421 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffbc006b710 msgr2=0x7ffbc006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.598+0000 7ffbe4522640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffbc006b710 0x7ffbc006dbd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8037000 tx=0x7ffbd8032000 comp rx=0 tx=0).stop 2024-05-08T04:25:06.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.598+0000 7ffbe4522640 1 -- 172.21.15.104:0/2655042421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbdc0ceee0 msgr2=0x7ffbdc153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.598+0000 7ffbe4522640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbdc0ceee0 0x7ffbdc153330 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4007ef0 tx=0x7ffbd400d4a0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.598+0000 7ffbe4522640 1 -- 172.21.15.104:0/2655042421 shutdown_connections 2024-05-08T04:25:06.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.598+0000 7ffbe4522640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7ffbc006b710 0x7ffbc006dbd0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.598+0000 7ffbe4522640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffbdc0ceee0 0x7ffbdc153330 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.598+0000 7ffbe4522640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbdc0b3ff0 0x7ffbdc071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.598+0000 7ffbe4522640 1 --2- 172.21.15.104:0/2655042421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbdc06e330 0x7ffbdc155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.598+0000 7ffbe4522640 1 -- 172.21.15.104:0/2655042421 >> 172.21.15.104:0/2655042421 conn(0x7ffbdc0b13f0 msgr2=0x7ffbdc06d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.598+0000 7ffbe4522640 1 -- 172.21.15.104:0/2655042421 shutdown_connections 2024-05-08T04:25:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.598+0000 7ffbe4522640 1 -- 172.21.15.104:0/2655042421 wait complete. 2024-05-08T04:25:06.611 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-05-08T04:25:04.686037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223248,"kb_used_data":7096,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754751472,"statfs":{"total":773094113280,"available":772865507328,"internally_reserved":0,"allocated":7266304,"data_stored":3752284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-28550,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-61,"num_write_kb":-50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001286"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":247,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-08T04:25:01.076914+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:25:01.076914+0000","last_peered":"2024-05-08T04:25:01.076914+0000","last_clean":"2024-05-08T04:25:01.076914+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:25:01.076914+0000","last_undegraded":"2024-05-08T04:25:01.076914+0000","last_fullsized":"2024-05-08T04:25:01.076914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":314051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":313981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1347584,"data_stored":904497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":753664,"data_stored":314575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":314049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":786432,"data_stored":343123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1343488,"data_stored":904909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":782336,"data_stored":343099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:25:06.611 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T04:25:06.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.710+0000 7fee6837e640 1 Processor -- start 2024-05-08T04:25:06.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.710+0000 7fee6837e640 1 -- start start 2024-05-08T04:25:06.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.711+0000 7fee6837e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fee600d07c0 0x7fee60161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.711+0000 7fee6837e640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6015e1f0 con 0x7fee600ce5a0 2024-05-08T04:25:06.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.711+0000 7fee6837e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee60162090 con 0x7fee6015de10 2024-05-08T04:25:06.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.711+0000 7fee6837e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee600d0f50 con 0x7fee600d07c0 2024-05-08T04:25:06.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.711+0000 7fee65919640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fee600ce5a0 0x7fee600d2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:37468/0 (socket says 172.21.15.104:37468) 2024-05-08T04:25:06.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.711+0000 7fee65919640 1 -- 172.21.15.104:0/1630040925 learned_addr learned my addr 172.21.15.104:0/1630040925 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:06.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee6691b640 1 --2- 172.21.15.104:0/1630040925 >> v2:172.21.15.183:3300/0 conn(0x7fee600d07c0 0x7fee60161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046948280 0 0) 0x7fee6015e1f0 con 0x7fee600ce5a0 2024-05-08T04:25:06.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee4c003520 con 0x7fee600ce5a0 2024-05-08T04:25:06.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1068523816 0 0) 0x7fee4c003520 con 0x7fee600ce5a0 2024-05-08T04:25:06.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 >> v2:172.21.15.183:3300/0 conn(0x7fee600d07c0 msgr2=0x7fee60161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:06.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 --2- 172.21.15.104:0/1630040925 >> v2:172.21.15.183:3300/0 conn(0x7fee600d07c0 0x7fee60161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 >> v1:172.21.15.183:6789/0 conn(0x7fee6015de10 legacy=0x7fee600d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60162370 con 0x7fee600ce5a0 2024-05-08T04:25:06.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fee50001670 con 0x7fee600ce5a0 2024-05-08T04:25:06.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 >> v1:172.21.15.104:6789/0 conn(0x7fee600ce5a0 legacy=0x7fee600d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 --2- 172.21.15.104:0/1630040925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee4c0039b0 0x7fee4c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 --2- 172.21.15.104:0/1630040925 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee4c004800 0x7fee4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 --2- 172.21.15.104:0/1630040925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee4c0051c0 0x7fee4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee600d0f50 con 0x7fee4c0039b0 2024-05-08T04:25:06.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c00c160 con 0x7fee4c0051c0 2024-05-08T04:25:06.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c00c360 con 0x7fee4c004800 2024-05-08T04:25:06.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee6611a640 1 --2- 172.21.15.104:0/1630040925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee4c0039b0 0x7fee4c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee6691b640 1 --2- 172.21.15.104:0/1630040925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee4c0051c0 0x7fee4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65919640 1 --2- 172.21.15.104:0/1630040925 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee4c004800 0x7fee4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee6611a640 1 -- 172.21.15.104:0/1630040925 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee4c004800 msgr2=0x7fee4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:06.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee6611a640 1 --2- 172.21.15.104:0/1630040925 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee4c004800 0x7fee4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee6611a640 1 -- 172.21.15.104:0/1630040925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee4c0051c0 msgr2=0x7fee4c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:06.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee6611a640 1 --2- 172.21.15.104:0/1630040925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee4c0051c0 0x7fee4c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee6611a640 1 -- 172.21.15.104:0/1630040925 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c003520 con 0x7fee4c0039b0 2024-05-08T04:25:06.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee65919640 1 --2- 172.21.15.104:0/1630040925 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee4c004800 0x7fee4c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:06.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee6691b640 1 --2- 172.21.15.104:0/1630040925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee4c0051c0 0x7fee4c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:06.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.712+0000 7fee6691b640 1 -- 172.21.15.104:0/1630040925 reap_dead start 2024-05-08T04:25:06.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.713+0000 7fee6611a640 1 --2- 172.21.15.104:0/1630040925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee4c0039b0 0x7fee4c003dd0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fee5c001750 tx=0x7fee4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f908801d56b1b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:06.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.713+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c001370 con 0x7fee4c0039b0 2024-05-08T04:25:06.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.713+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c0052d0 con 0x7fee4c0039b0 2024-05-08T04:25:06.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.713+0000 7fee65118640 1 -- 172.21.15.104:0/1630040925 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c02abc0 con 0x7fee4c0039b0 2024-05-08T04:25:06.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.714+0000 7fee6837e640 1 -- 172.21.15.104:0/1630040925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee4c0039b0 msgr2=0x7fee4c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.714+0000 7fee6837e640 1 --2- 172.21.15.104:0/1630040925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee4c0039b0 0x7fee4c003dd0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fee5c001750 tx=0x7fee4c005830 comp rx=0 tx=0).stop 2024-05-08T04:25:06.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.714+0000 7fee6837e640 1 -- 172.21.15.104:0/1630040925 shutdown_connections 2024-05-08T04:25:06.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.714+0000 7fee6837e640 1 --2- 172.21.15.104:0/1630040925 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee4c0039b0 0x7fee4c003dd0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.714+0000 7fee6837e640 1 -- 172.21.15.104:0/1630040925 >> 172.21.15.104:0/1630040925 conn(0x7fee60072290 msgr2=0x7fee60072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:06.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.714+0000 7fee6837e640 1 -- 172.21.15.104:0/1630040925 shutdown_connections 2024-05-08T04:25:06.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.714+0000 7fee6837e640 1 -- 172.21.15.104:0/1630040925 wait complete. 2024-05-08T04:25:06.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.715+0000 7fee6837e640 1 Processor -- start 2024-05-08T04:25:06.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.715+0000 7fee6837e640 1 -- start start 2024-05-08T04:25:06.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6837e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee4c0039b0 0x7fee60155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6837e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee600b3480 0x7fee600b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6837e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee600b5800 0x7fee601f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6837e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee600d1ce0 con 0x7fee4c0039b0 2024-05-08T04:25:06.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6837e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee600d1a90 con 0x7fee600b3480 2024-05-08T04:25:06.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6837e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee600b6dc0 con 0x7fee600b5800 2024-05-08T04:25:06.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6611a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee4c0039b0 0x7fee60155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6611a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee4c0039b0 0x7fee60155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42798/0 (socket says 172.21.15.104:42798) 2024-05-08T04:25:06.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6611a640 1 -- 172.21.15.104:0/2273968344 learned_addr learned my addr 172.21.15.104:0/2273968344 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:06.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6611a640 1 -- 172.21.15.104:0/2273968344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee600b5800 msgr2=0x7fee601f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6611a640 1 --2- 172.21.15.104:0/2273968344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee600b5800 0x7fee601f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6611a640 1 -- 172.21.15.104:0/2273968344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee600b3480 msgr2=0x7fee600b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6611a640 1 --2- 172.21.15.104:0/2273968344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee600b3480 0x7fee600b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6611a640 1 -- 172.21.15.104:0/2273968344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee601552c0 con 0x7fee4c0039b0 2024-05-08T04:25:06.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6611a640 1 --2- 172.21.15.104:0/2273968344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee4c0039b0 0x7fee60155510 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fee5c001870 tx=0x7fee5c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:06.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee56ffd640 1 -- 172.21.15.104:0/2273968344 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c03f030 con 0x7fee4c0039b0 2024-05-08T04:25:06.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee56ffd640 1 -- 172.21.15.104:0/2273968344 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c005480 con 0x7fee4c0039b0 2024-05-08T04:25:06.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee56ffd640 1 -- 172.21.15.104:0/2273968344 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c037040 con 0x7fee4c0039b0 2024-05-08T04:25:06.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6837e640 1 -- 172.21.15.104:0/2273968344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee600b3900 con 0x7fee4c0039b0 2024-05-08T04:25:06.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.716+0000 7fee6837e640 1 -- 172.21.15.104:0/2273968344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee600b6140 con 0x7fee4c0039b0 2024-05-08T04:25:06.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.717+0000 7fee6837e640 1 -- 172.21.15.104:0/2273968344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee60075010 con 0x7fee4c0039b0 2024-05-08T04:25:06.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.718+0000 7fee56ffd640 1 -- 172.21.15.104:0/2273968344 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fee5c042070 con 0x7fee4c0039b0 2024-05-08T04:25:06.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.718+0000 7fee56ffd640 1 --2- 172.21.15.104:0/2273968344 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fee4406b710 0x7fee4406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:06.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.718+0000 7fee56ffd640 1 -- 172.21.15.104:0/2273968344 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fee5c007640 con 0x7fee4c0039b0 2024-05-08T04:25:06.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.718+0000 7fee65919640 1 --2- 172.21.15.104:0/2273968344 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fee4406b710 0x7fee4406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:06.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.719+0000 7fee65919640 1 --2- 172.21.15.104:0/2273968344 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fee4406b710 0x7fee4406dbd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fee50000c00 tx=0x7fee50009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:06.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.722+0000 7fee56ffd640 1 -- 172.21.15.104:0/2273968344 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fee5c078840 con 0x7fee4c0039b0 2024-05-08T04:25:06.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.898+0000 7fee6837e640 1 -- 172.21.15.104:0/2273968344 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee60152c10 con 0x7fee4c0039b0 2024-05-08T04:25:06.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.898+0000 7fee56ffd640 1 -- 172.21.15.104:0/2273968344 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+13080 (secure 0 0 0) 0x7fee5c078140 con 0x7fee4c0039b0 2024-05-08T04:25:06.901 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:25:06.901 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":64,"fsid":"c8b1f73b-90d2-40b8-ad3c-a036617abfed","created":"2024-05-08T04:20:46.443045+0000","modified":"2024-05-08T04:25:03.813843+0000","last_up_change":"2024-05-08T04:20:57.615354+0000","last_in_change":"2024-05-08T04:20:48.724780+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T04:20:58.666184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b46048bf-ae50-47a6-bc07-2e61e9ba7693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6809","nonce":3224694674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6811","nonce":3224694674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6815","nonce":3224694674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":3224694674},{"type":"v1","addr":"172.21.15.104:6813","nonce":3224694674}]},"public_addr":"172.21.15.104:6809/3224694674","cluster_addr":"172.21.15.104:6811/3224694674","heartbeat_back_addr":"172.21.15.104:6815/3224694674","heartbeat_front_addr":"172.21.15.104:6813/3224694674","state":["exists","up"]},{"osd":1,"uuid":"34c6e8e7-370e-4174-a877-d78be6a72479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6801","nonce":3900877386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6803","nonce":3900877386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6807","nonce":3900877386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3900877386},{"type":"v1","addr":"172.21.15.104:6805","nonce":3900877386}]},"public_addr":"172.21.15.104:6801/3900877386","cluster_addr":"172.21.15.104:6803/3900877386","heartbeat_back_addr":"172.21.15.104:6807/3900877386","heartbeat_front_addr":"172.21.15.104:6805/3900877386","state":["exists","up"]},{"osd":2,"uuid":"c3981d86-c512-4836-ab38-4bef72d3ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6825","nonce":2587310492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6827","nonce":2587310492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6831","nonce":2587310492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":2587310492},{"type":"v1","addr":"172.21.15.104:6829","nonce":2587310492}]},"public_addr":"172.21.15.104:6825/2587310492","cluster_addr":"172.21.15.104:6827/2587310492","heartbeat_back_addr":"172.21.15.104:6831/2587310492","heartbeat_front_addr":"172.21.15.104:6829/2587310492","state":["exists","up"]},{"osd":3,"uuid":"1bf57c2e-6076-43ac-a956-f3b61891430e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6817","nonce":2847992975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6819","nonce":2847992975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6823","nonce":2847992975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":2847992975},{"type":"v1","addr":"172.21.15.104:6821","nonce":2847992975}]},"public_addr":"172.21.15.104:6817/2847992975","cluster_addr":"172.21.15.104:6819/2847992975","heartbeat_back_addr":"172.21.15.104:6823/2847992975","heartbeat_front_addr":"172.21.15.104:6821/2847992975","state":["exists","up"]},{"osd":4,"uuid":"337042e4-bd32-40e9-b393-503c01b4a0b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6801","nonce":3103695044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6803","nonce":3103695044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6807","nonce":3103695044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3103695044},{"type":"v1","addr":"172.21.15.183:6805","nonce":3103695044}]},"public_addr":"172.21.15.183:6801/3103695044","cluster_addr":"172.21.15.183:6803/3103695044","heartbeat_back_addr":"172.21.15.183:6807/3103695044","heartbeat_front_addr":"172.21.15.183:6805/3103695044","state":["exists","up"]},{"osd":5,"uuid":"87223252-b257-4ec9-b05d-82dd21528ec7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6809","nonce":1596442327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6811","nonce":1596442327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6815","nonce":1596442327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1596442327},{"type":"v1","addr":"172.21.15.183:6813","nonce":1596442327}]},"public_addr":"172.21.15.183:6809/1596442327","cluster_addr":"172.21.15.183:6811/1596442327","heartbeat_back_addr":"172.21.15.183:6815/1596442327","heartbeat_front_addr":"172.21.15.183:6813/1596442327","state":["exists","up"]},{"osd":6,"uuid":"3e8bb4ff-0934-4c2c-a8bf-d0168ecdc0fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6825","nonce":1610978569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6827","nonce":1610978569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6831","nonce":1610978569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1610978569},{"type":"v1","addr":"172.21.15.183:6829","nonce":1610978569}]},"public_addr":"172.21.15.183:6825/1610978569","cluster_addr":"172.21.15.183:6827/1610978569","heartbeat_back_addr":"172.21.15.183:6831/1610978569","heartbeat_front_addr":"172.21.15.183:6829/1610978569","state":["exists","up"]},{"osd":7,"uuid":"352a8ab2-3103-4355-ae61-4f958e8b1259","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6817","nonce":2951178506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6819","nonce":2951178506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6823","nonce":2951178506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2951178506},{"type":"v1","addr":"172.21.15.183:6821","nonce":2951178506}]},"public_addr":"172.21.15.183:6817/2951178506","cluster_addr":"172.21.15.183:6819/2951178506","heartbeat_back_addr":"172.21.15.183:6823/2951178506","heartbeat_front_addr":"172.21.15.183:6821/2951178506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.854448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.852983+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.875479+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.900465+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.788737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920756+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.920957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T04:20:53.901613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.183:6835/495908291":"2024-05-09T04:25:00.504815+0000","172.21.15.183:6833/495908291":"2024-05-09T04:25:00.504815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T04:25:06.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.900+0000 7fee6837e640 1 -- 172.21.15.104:0/2273968344 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fee4406b710 msgr2=0x7fee4406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.900+0000 7fee6837e640 1 --2- 172.21.15.104:0/2273968344 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fee4406b710 0x7fee4406dbd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fee50000c00 tx=0x7fee50009040 comp rx=0 tx=0).stop 2024-05-08T04:25:06.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.900+0000 7fee6837e640 1 -- 172.21.15.104:0/2273968344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee4c0039b0 msgr2=0x7fee60155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:06.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.900+0000 7fee6837e640 1 --2- 172.21.15.104:0/2273968344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee4c0039b0 0x7fee60155510 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fee5c001870 tx=0x7fee5c001120 comp rx=0 tx=0).stop 2024-05-08T04:25:06.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.900+0000 7fee6837e640 1 -- 172.21.15.104:0/2273968344 shutdown_connections 2024-05-08T04:25:06.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.900+0000 7fee6837e640 1 --2- 172.21.15.104:0/2273968344 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fee4406b710 0x7fee4406dbd0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.900+0000 7fee6837e640 1 --2- 172.21.15.104:0/2273968344 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee600b3480 0x7fee600b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.900+0000 7fee6837e640 1 --2- 172.21.15.104:0/2273968344 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee600b5800 0x7fee601f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.900+0000 7fee6837e640 1 --2- 172.21.15.104:0/2273968344 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee4c0039b0 0x7fee60155510 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:06.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.900+0000 7fee6837e640 1 -- 172.21.15.104:0/2273968344 >> 172.21.15.104:0/2273968344 conn(0x7fee60072290 msgr2=0x7fee600d39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:06.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.901+0000 7fee6837e640 1 -- 172.21.15.104:0/2273968344 shutdown_connections 2024-05-08T04:25:06.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:06.901+0000 7fee6837e640 1 -- 172.21.15.104:0/2273968344 wait complete. 2024-05-08T04:25:07.914 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T04:25:07.915 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T04:25:08.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.029+0000 7fa397b42640 1 Processor -- start 2024-05-08T04:25:08.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.029+0000 7fa397b42640 1 -- start start 2024-05-08T04:25:08.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.030+0000 7fa397b42640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa3900d0970 0x7fa39015c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.030+0000 7fa397b42640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa39015cad0 0x7fa39015dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.030+0000 7fa397b42640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39015d420 con 0x7fa390070c70 2024-05-08T04:25:08.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.030+0000 7fa397b42640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3900d16a0 con 0x7fa39015cad0 2024-05-08T04:25:08.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.030+0000 7fa397b42640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3900d0e20 con 0x7fa3900d0970 2024-05-08T04:25:08.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.030+0000 7fa3960df640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fa39015cad0 0x7fa39015dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.030+0000 7fa3958de640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fa390070c70 0x7fa390071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42744/0 (socket says 172.21.15.104:42744) 2024-05-08T04:25:08.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.030+0000 7fa3958de640 1 -- 172.21.15.104:0/3710155950 learned_addr learned my addr 172.21.15.104:0/3710155950 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:08.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.031+0000 7fa3960df640 1 -- 172.21.15.104:0/3710155950 >> v2:172.21.15.183:3300/0 conn(0x7fa3900d0970 msgr2=0x7fa39015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:08.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.031+0000 7fa3950dd640 1 --2- 172.21.15.104:0/3710155950 >> v2:172.21.15.183:3300/0 conn(0x7fa3900d0970 0x7fa39015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.031+0000 7fa3948dc640 1 -- 172.21.15.104:0/3710155950 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429151751 0 0) 0x7fa39015d420 con 0x7fa390070c70 2024-05-08T04:25:08.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.031+0000 7fa3960df640 1 --2- 172.21.15.104:0/3710155950 >> v2:172.21.15.183:3300/0 conn(0x7fa3900d0970 0x7fa39015c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.031+0000 7fa3960df640 1 -- 172.21.15.104:0/3710155950 >> v1:172.21.15.104:6789/0 conn(0x7fa390070c70 legacy=0x7fa390071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.031+0000 7fa3960df640 1 -- 172.21.15.104:0/3710155950 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3900d10e0 con 0x7fa39015cad0 2024-05-08T04:25:08.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.031+0000 7fa3950dd640 1 --2- 172.21.15.104:0/3710155950 >> v2:172.21.15.183:3300/0 conn(0x7fa3900d0970 0x7fa39015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:08.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.031+0000 7fa3960df640 1 --2- 172.21.15.104:0/3710155950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa39015cad0 0x7fa39015dbe0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fa39006eff0 tx=0x7fa38802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12afe8ad6b1ca2a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.031+0000 7fa3948dc640 1 -- 172.21.15.104:0/3710155950 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388037070 con 0x7fa39015cad0 2024-05-08T04:25:08.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.032+0000 7fa3948dc640 1 -- 172.21.15.104:0/3710155950 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa388032440 con 0x7fa39015cad0 2024-05-08T04:25:08.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.032+0000 7fa3948dc640 1 -- 172.21.15.104:0/3710155950 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388032810 con 0x7fa39015cad0 2024-05-08T04:25:08.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.032+0000 7fa397b42640 1 -- 172.21.15.104:0/3710155950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa39015cad0 msgr2=0x7fa39015dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.032+0000 7fa397b42640 1 --2- 172.21.15.104:0/3710155950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa39015cad0 0x7fa39015dbe0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fa39006eff0 tx=0x7fa38802a1a0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.032+0000 7fa397b42640 1 -- 172.21.15.104:0/3710155950 shutdown_connections 2024-05-08T04:25:08.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.032+0000 7fa397b42640 1 --2- 172.21.15.104:0/3710155950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa39015cad0 0x7fa39015dbe0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.032+0000 7fa397b42640 1 --2- 172.21.15.104:0/3710155950 >> v2:172.21.15.183:3300/0 conn(0x7fa3900d0970 0x7fa39015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.032+0000 7fa397b42640 1 -- 172.21.15.104:0/3710155950 >> 172.21.15.104:0/3710155950 conn(0x7fa3900b3450 msgr2=0x7fa3900b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:08.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.032+0000 7fa397b42640 1 -- 172.21.15.104:0/3710155950 shutdown_connections 2024-05-08T04:25:08.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.032+0000 7fa397b42640 1 -- 172.21.15.104:0/3710155950 wait complete. 2024-05-08T04:25:08.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.033+0000 7fa397b42640 1 Processor -- start 2024-05-08T04:25:08.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.033+0000 7fa397b42640 1 -- start start 2024-05-08T04:25:08.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.034+0000 7fa397b42640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa390070c70 0x7fa39013edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.034+0000 7fa397b42640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3900d0970 0x7fa390157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.034+0000 7fa397b42640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa39015cad0 0x7fa3901f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.034+0000 7fa397b42640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39015e120 con 0x7fa39015cad0 2024-05-08T04:25:08.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.034+0000 7fa397b42640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39015d6c0 con 0x7fa3900d0970 2024-05-08T04:25:08.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.034+0000 7fa397b42640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39015e2a0 con 0x7fa390070c70 2024-05-08T04:25:08.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.034+0000 7fa3960df640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa39015cad0 0x7fa3901f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.034+0000 7fa3960df640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa39015cad0 0x7fa3901f3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38452/0 (socket says 172.21.15.104:38452) 2024-05-08T04:25:08.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.034+0000 7fa3960df640 1 -- 172.21.15.104:0/891409904 learned_addr learned my addr 172.21.15.104:0/891409904 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:08.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa3960df640 1 -- 172.21.15.104:0/891409904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa390070c70 msgr2=0x7fa39013edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.034+0000 7fa3950dd640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3900d0970 0x7fa390157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa3958de640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa390070c70 0x7fa39013edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa3960df640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa390070c70 0x7fa39013edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa3960df640 1 -- 172.21.15.104:0/891409904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3900d0970 msgr2=0x7fa390157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa3960df640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3900d0970 0x7fa390157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa3960df640 1 -- 172.21.15.104:0/891409904 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3901f3ee0 con 0x7fa39015cad0 2024-05-08T04:25:08.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa3950dd640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3900d0970 0x7fa390157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:08.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa3958de640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa390070c70 0x7fa39013edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa3960df640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa39015cad0 0x7fa3901f3490 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa388035040 tx=0x7fa3880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa3867fc640 1 -- 172.21.15.104:0/891409904 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388037040 con 0x7fa39015cad0 2024-05-08T04:25:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa3867fc640 1 -- 172.21.15.104:0/891409904 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa388042070 con 0x7fa39015cad0 2024-05-08T04:25:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa3867fc640 1 -- 172.21.15.104:0/891409904 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388030b30 con 0x7fa39015cad0 2024-05-08T04:25:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa397b42640 1 -- 172.21.15.104:0/891409904 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3901f41c0 con 0x7fa39015cad0 2024-05-08T04:25:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.035+0000 7fa397b42640 1 -- 172.21.15.104:0/891409904 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa390157720 con 0x7fa39015cad0 2024-05-08T04:25:08.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.036+0000 7fa397b42640 1 -- 172.21.15.104:0/891409904 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa390158ed0 con 0x7fa39015cad0 2024-05-08T04:25:08.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.036+0000 7fa3867fc640 1 -- 172.21.15.104:0/891409904 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fa388030cd0 con 0x7fa39015cad0 2024-05-08T04:25:08.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.037+0000 7fa3867fc640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa37406b710 0x7fa37406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.037+0000 7fa3867fc640 1 -- 172.21.15.104:0/891409904 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa3880aae50 con 0x7fa39015cad0 2024-05-08T04:25:08.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.037+0000 7fa3958de640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa37406b710 0x7fa37406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.037+0000 7fa3867fc640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] conn(0x7fa3740715d0 0x7fa3740739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.037+0000 7fa3867fc640 1 -- 172.21.15.104:0/891409904 --> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa388049e70 con 0x7fa3740715d0 2024-05-08T04:25:08.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.037+0000 7fa3867fc640 1 -- 172.21.15.104:0/891409904 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3880b0520 con 0x7fa39015cad0 2024-05-08T04:25:08.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.037+0000 7fa3950dd640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] conn(0x7fa3740715d0 0x7fa3740739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.037+0000 7fa3958de640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa37406b710 0x7fa37406dbd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0012e0 tx=0x7fa38c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.038+0000 7fa3950dd640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] conn(0x7fa3740715d0 0x7fa3740739f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.038+0000 7fa3867fc640 1 -- 172.21.15.104:0/891409904 <== osd.0 v2:172.21.15.104:6808/3224694674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa388049e70 con 0x7fa3740715d0 2024-05-08T04:25:08.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.051+0000 7fa397b42640 1 -- 172.21.15.104:0/891409904 --> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa390075010 con 0x7fa3740715d0 2024-05-08T04:25:08.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.051+0000 7fa3867fc640 1 -- 172.21.15.104:0/891409904 <== osd.0 v2:172.21.15.104:6808/3224694674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa390075010 con 0x7fa3740715d0 2024-05-08T04:25:08.054 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:25:08.054 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T04:25:08.054 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:25:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.052+0000 7fa397b42640 1 -- 172.21.15.104:0/891409904 >> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] conn(0x7fa3740715d0 msgr2=0x7fa3740739f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.052+0000 7fa397b42640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.104:6808/3224694674,v1:172.21.15.104:6809/3224694674] conn(0x7fa3740715d0 0x7fa3740739f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.052+0000 7fa397b42640 1 -- 172.21.15.104:0/891409904 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa37406b710 msgr2=0x7fa37406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.052+0000 7fa397b42640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fa37406b710 0x7fa37406dbd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0012e0 tx=0x7fa38c009040 comp rx=0 tx=0).stop 2024-05-08T04:25:08.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.052+0000 7fa397b42640 1 -- 172.21.15.104:0/891409904 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa39015cad0 msgr2=0x7fa3901f3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.052+0000 7fa397b42640 1 --2- 172.21.15.104:0/891409904 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa39015cad0 0x7fa3901f3490 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa388035040 tx=0x7fa3880046c0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.052+0000 7fa3960df640 1 -- 172.21.15.104:0/891409904 reap_dead start 2024-05-08T04:25:08.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.052+0000 7fa397b42640 1 -- 172.21.15.104:0/891409904 shutdown_connections 2024-05-08T04:25:08.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.052+0000 7fa397b42640 1 -- 172.21.15.104:0/891409904 >> 172.21.15.104:0/891409904 conn(0x7fa3900b3450 msgr2=0x7fa3900b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:08.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.052+0000 7fa397b42640 1 -- 172.21.15.104:0/891409904 shutdown_connections 2024-05-08T04:25:08.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.052+0000 7fa397b42640 1 -- 172.21.15.104:0/891409904 wait complete. 2024-05-08T04:25:08.064 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T04:25:08.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.162+0000 7f3a83e76640 1 Processor -- start 2024-05-08T04:25:08.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.163+0000 7f3a83e76640 1 -- start start 2024-05-08T04:25:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.163+0000 7f3a83e76640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3a7c15db30 0x7f3a7c06bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.163+0000 7f3a83e76640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3a7c0b5b40 0x7f3a7c0d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.163+0000 7f3a83e76640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7c0b6b50 con 0x7f3a7c0b93b0 2024-05-08T04:25:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.163+0000 7f3a83e76640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7c06c800 con 0x7f3a7c15db30 2024-05-08T04:25:08.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.163+0000 7f3a83e76640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7c06cae0 con 0x7f3a7c0b5b40 2024-05-08T04:25:08.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.164+0000 7f3a81c12640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3a7c15db30 0x7f3a7c06bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.164+0000 7f3a81c12640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f3a7c15db30 0x7f3a7c06bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38456/0 (socket says 172.21.15.104:38456) 2024-05-08T04:25:08.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.164+0000 7f3a81c12640 1 -- 172.21.15.104:0/4054884685 learned_addr learned my addr 172.21.15.104:0/4054884685 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:08.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.164+0000 7f3a82413640 1 --2- 172.21.15.104:0/4054884685 >> v2:172.21.15.183:3300/0 conn(0x7f3a7c0b5b40 0x7f3a7c0d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.164+0000 7f3a81c12640 1 -- 172.21.15.104:0/4054884685 >> v2:172.21.15.183:3300/0 conn(0x7f3a7c0b5b40 msgr2=0x7f3a7c0d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:08.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.164+0000 7f3a81c12640 1 --2- 172.21.15.104:0/4054884685 >> v2:172.21.15.183:3300/0 conn(0x7f3a7c0b5b40 0x7f3a7c0d24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.164+0000 7f3a81c12640 1 -- 172.21.15.104:0/4054884685 >> v1:172.21.15.183:6789/0 conn(0x7f3a7c0b93b0 legacy=0x7f3a7c0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:08.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.164+0000 7f3a81c12640 1 -- 172.21.15.104:0/4054884685 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c06cdc0 con 0x7f3a7c15db30 2024-05-08T04:25:08.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.164+0000 7f3a81c12640 1 --2- 172.21.15.104:0/4054884685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a7c15db30 0x7f3a7c06bfb0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0b6550 tx=0x7f3a6c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5831b502ee33036 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.165+0000 7f3a80c10640 1 -- 172.21.15.104:0/4054884685 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c036070 con 0x7f3a7c15db30 2024-05-08T04:25:08.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.165+0000 7f3a80c10640 1 -- 172.21.15.104:0/4054884685 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c031600 con 0x7f3a7c15db30 2024-05-08T04:25:08.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.165+0000 7f3a80c10640 1 -- 172.21.15.104:0/4054884685 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c0319d0 con 0x7f3a7c15db30 2024-05-08T04:25:08.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.165+0000 7f3a83e76640 1 -- 172.21.15.104:0/4054884685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a7c15db30 msgr2=0x7f3a7c06bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.165+0000 7f3a83e76640 1 --2- 172.21.15.104:0/4054884685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a7c15db30 0x7f3a7c06bfb0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0b6550 tx=0x7f3a6c02a660 comp rx=0 tx=0).stop 2024-05-08T04:25:08.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.165+0000 7f3a83e76640 1 -- 172.21.15.104:0/4054884685 shutdown_connections 2024-05-08T04:25:08.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.165+0000 7f3a83e76640 1 --2- 172.21.15.104:0/4054884685 >> v2:172.21.15.183:3300/0 conn(0x7f3a7c0b5b40 0x7f3a7c0d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.165+0000 7f3a83e76640 1 --2- 172.21.15.104:0/4054884685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a7c15db30 0x7f3a7c06bfb0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.165+0000 7f3a83e76640 1 -- 172.21.15.104:0/4054884685 >> 172.21.15.104:0/4054884685 conn(0x7f3a7c0d0430 msgr2=0x7f3a7c0d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:08.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.165+0000 7f3a83e76640 1 -- 172.21.15.104:0/4054884685 shutdown_connections 2024-05-08T04:25:08.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.165+0000 7f3a83e76640 1 -- 172.21.15.104:0/4054884685 wait complete. 2024-05-08T04:25:08.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.166+0000 7f3a83e76640 1 Processor -- start 2024-05-08T04:25:08.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.167+0000 7f3a83e76640 1 -- start start 2024-05-08T04:25:08.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.167+0000 7f3a83e76640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a7c0b5b40 0x7f3a7c154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.167+0000 7f3a83e76640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a7c0b93b0 0x7f3a7c153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.167+0000 7f3a83e76640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a7c15db30 0x7f3a7c151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.167+0000 7f3a83e76640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c15df10 con 0x7f3a7c0b93b0 2024-05-08T04:25:08.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.167+0000 7f3a83e76640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c06c4f0 con 0x7f3a7c0b5b40 2024-05-08T04:25:08.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.167+0000 7f3a83e76640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c1544a0 con 0x7f3a7c15db30 2024-05-08T04:25:08.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.167+0000 7f3a81411640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a7c0b93b0 0x7f3a7c153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.167+0000 7f3a81411640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a7c0b93b0 0x7f3a7c153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38462/0 (socket says 172.21.15.104:38462) 2024-05-08T04:25:08.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.167+0000 7f3a81411640 1 -- 172.21.15.104:0/1157603182 learned_addr learned my addr 172.21.15.104:0/1157603182 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:08.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.167+0000 7f3a81c12640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a7c0b5b40 0x7f3a7c154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.168+0000 7f3a82413640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a7c15db30 0x7f3a7c151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.168+0000 7f3a81411640 1 -- 172.21.15.104:0/1157603182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a7c15db30 msgr2=0x7f3a7c151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.168+0000 7f3a81411640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a7c15db30 0x7f3a7c151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.168+0000 7f3a81411640 1 -- 172.21.15.104:0/1157603182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a7c0b5b40 msgr2=0x7f3a7c154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.168+0000 7f3a81411640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a7c0b5b40 0x7f3a7c154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.168+0000 7f3a81411640 1 -- 172.21.15.104:0/1157603182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c153960 con 0x7f3a7c0b93b0 2024-05-08T04:25:08.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.168+0000 7f3a81c12640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a7c0b5b40 0x7f3a7c154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:08.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.168+0000 7f3a81411640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a7c0b93b0 0x7f3a7c153420 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c400 tx=0x7f3a7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.168+0000 7f3a7a7fc640 1 -- 172.21.15.104:0/1157603182 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70017070 con 0x7f3a7c0b93b0 2024-05-08T04:25:08.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.168+0000 7f3a7a7fc640 1 -- 172.21.15.104:0/1157603182 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a700035f0 con 0x7f3a7c0b93b0 2024-05-08T04:25:08.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.168+0000 7f3a7a7fc640 1 -- 172.21.15.104:0/1157603182 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70003a20 con 0x7f3a7c0b93b0 2024-05-08T04:25:08.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.168+0000 7f3a83e76640 1 -- 172.21.15.104:0/1157603182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7c153c00 con 0x7f3a7c0b93b0 2024-05-08T04:25:08.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.168+0000 7f3a83e76640 1 -- 172.21.15.104:0/1157603182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7c1541c0 con 0x7f3a7c0b93b0 2024-05-08T04:25:08.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.169+0000 7f3a83e76640 1 -- 172.21.15.104:0/1157603182 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7c075010 con 0x7f3a7c0b93b0 2024-05-08T04:25:08.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.169+0000 7f3a7a7fc640 1 -- 172.21.15.104:0/1157603182 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f3a7001a070 con 0x7f3a7c0b93b0 2024-05-08T04:25:08.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.170+0000 7f3a7a7fc640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3a6806b710 0x7f3a6806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.170+0000 7f3a7a7fc640 1 -- 172.21.15.104:0/1157603182 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3a70089540 con 0x7f3a7c0b93b0 2024-05-08T04:25:08.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.170+0000 7f3a81c12640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3a6806b710 0x7f3a6806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.170+0000 7f3a81c12640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3a6806b710 0x7f3a6806dbd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c033000 tx=0x7f3a6c009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.175+0000 7f3a7a7fc640 1 -- 172.21.15.104:0/1157603182 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3a700010c0 con 0x7f3a7c0b93b0 2024-05-08T04:25:08.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.345+0000 7f3a83e76640 1 -- 172.21.15.104:0/1157603182 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a7c0d35b0 con 0x7f3a6806b710 2024-05-08T04:25:08.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.346+0000 7f3a7a7fc640 1 -- 172.21.15.104:0/1157603182 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3a7c0d35b0 con 0x7f3a6806b710 2024-05-08T04:25:08.348 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T04:25:08.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.348+0000 7f3a83e76640 1 -- 172.21.15.104:0/1157603182 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3a6806b710 msgr2=0x7f3a6806dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.348+0000 7f3a83e76640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3a6806b710 0x7f3a6806dbd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c033000 tx=0x7f3a6c009000 comp rx=0 tx=0).stop 2024-05-08T04:25:08.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.348+0000 7f3a83e76640 1 -- 172.21.15.104:0/1157603182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a7c0b93b0 msgr2=0x7f3a7c153420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.348+0000 7f3a83e76640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a7c0b93b0 0x7f3a7c153420 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c400 tx=0x7f3a7000c8c0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.348+0000 7f3a83e76640 1 -- 172.21.15.104:0/1157603182 shutdown_connections 2024-05-08T04:25:08.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.348+0000 7f3a83e76640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3a6806b710 0x7f3a6806dbd0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.348+0000 7f3a83e76640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a7c15db30 0x7f3a7c151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.348+0000 7f3a83e76640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a7c0b93b0 0x7f3a7c153420 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.348+0000 7f3a83e76640 1 --2- 172.21.15.104:0/1157603182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a7c0b5b40 0x7f3a7c154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.348+0000 7f3a83e76640 1 -- 172.21.15.104:0/1157603182 >> 172.21.15.104:0/1157603182 conn(0x7f3a7c0d0430 msgr2=0x7f3a7c0b7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:08.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.348+0000 7f3a83e76640 1 -- 172.21.15.104:0/1157603182 shutdown_connections 2024-05-08T04:25:08.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.348+0000 7f3a83e76640 1 -- 172.21.15.104:0/1157603182 wait complete. 2024-05-08T04:25:08.361 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T04:25:08.361 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T04:25:08.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.462+0000 7fdbecadd640 1 Processor -- start 2024-05-08T04:25:08.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.462+0000 7fdbecadd640 1 -- start start 2024-05-08T04:25:08.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.463+0000 7fdbecadd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbe8070c70 0x7fdbe8071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.463+0000 7fdbecadd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe8071590 con 0x7fdbe8157ac0 2024-05-08T04:25:08.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.463+0000 7fdbecadd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe80d15c0 con 0x7fdbe815edf0 2024-05-08T04:25:08.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.463+0000 7fdbecadd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe806bc70 con 0x7fdbe8070c70 2024-05-08T04:25:08.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.463+0000 7fdbe6d9d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fdbe8157ac0 0x7fdbe8157f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42754/0 (socket says 172.21.15.104:42754) 2024-05-08T04:25:08.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.463+0000 7fdbe6d9d640 1 -- 172.21.15.104:0/4267597625 learned_addr learned my addr 172.21.15.104:0/4267597625 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:08.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe659c640 1 --2- 172.21.15.104:0/4267597625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbe8070c70 0x7fdbe8071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686604296 0 0) 0x7fdbe8071590 con 0x7fdbe8157ac0 2024-05-08T04:25:08.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd0003520 con 0x7fdbe8157ac0 2024-05-08T04:25:08.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4217900686 0 0) 0x7fdbd0003520 con 0x7fdbe8157ac0 2024-05-08T04:25:08.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbe8070c70 msgr2=0x7fdbe8071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:08.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 --2- 172.21.15.104:0/4267597625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbe8070c70 0x7fdbe8071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 >> v1:172.21.15.183:6789/0 conn(0x7fdbe815edf0 legacy=0x7fdbe80b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe815f550 con 0x7fdbe8157ac0 2024-05-08T04:25:08.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fdbe00019f0 con 0x7fdbe8157ac0 2024-05-08T04:25:08.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 >> v1:172.21.15.104:6789/0 conn(0x7fdbe8157ac0 legacy=0x7fdbe8157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 --2- 172.21.15.104:0/4267597625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbe8070c70 0x7fdbd00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 --2- 172.21.15.104:0/4267597625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbd0003f60 0x7fdbd0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 --2- 172.21.15.104:0/4267597625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd0004d40 0x7fdbd00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd000ba70 con 0x7fdbd0004d40 2024-05-08T04:25:08.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd000bc20 con 0x7fdbd0003f60 2024-05-08T04:25:08.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd000be20 con 0x7fdbe8070c70 2024-05-08T04:25:08.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe6d9d640 1 --2- 172.21.15.104:0/4267597625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd0004d40 0x7fdbd00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe659c640 1 --2- 172.21.15.104:0/4267597625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbe8070c70 0x7fdbd00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe5d9b640 1 --2- 172.21.15.104:0/4267597625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbd0003f60 0x7fdbd0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe6d9d640 1 -- 172.21.15.104:0/4267597625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbe8070c70 msgr2=0x7fdbd00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:08.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe6d9d640 1 --2- 172.21.15.104:0/4267597625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbe8070c70 0x7fdbd00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe6d9d640 1 -- 172.21.15.104:0/4267597625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbd0003f60 msgr2=0x7fdbd0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:08.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe6d9d640 1 --2- 172.21.15.104:0/4267597625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbd0003f60 0x7fdbd0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.464+0000 7fdbe6d9d640 1 -- 172.21.15.104:0/4267597625 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd0003520 con 0x7fdbd0004d40 2024-05-08T04:25:08.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.465+0000 7fdbe6d9d640 1 --2- 172.21.15.104:0/4267597625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd0004d40 0x7fdbd00051c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000a850 tx=0x7fdbd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90b0bd02440ed5d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.465+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe000a4a0 con 0x7fdbd0004d40 2024-05-08T04:25:08.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.465+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe002f070 con 0x7fdbd0004d40 2024-05-08T04:25:08.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.465+0000 7fdbe559a640 1 -- 172.21.15.104:0/4267597625 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe002bd20 con 0x7fdbd0004d40 2024-05-08T04:25:08.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.466+0000 7fdbecadd640 1 -- 172.21.15.104:0/4267597625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd0004d40 msgr2=0x7fdbd00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.466+0000 7fdbecadd640 1 --2- 172.21.15.104:0/4267597625 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd0004d40 0x7fdbd00051c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000a850 tx=0x7fdbd0005830 comp rx=0 tx=0).stop 2024-05-08T04:25:08.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.466+0000 7fdbe6d9d640 1 -- 172.21.15.104:0/4267597625 reap_dead start 2024-05-08T04:25:08.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.466+0000 7fdbecadd640 1 -- 172.21.15.104:0/4267597625 shutdown_connections 2024-05-08T04:25:08.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.466+0000 7fdbecadd640 1 -- 172.21.15.104:0/4267597625 >> 172.21.15.104:0/4267597625 conn(0x7fdbe80b3450 msgr2=0x7fdbe80b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:08.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.466+0000 7fdbecadd640 1 -- 172.21.15.104:0/4267597625 shutdown_connections 2024-05-08T04:25:08.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.466+0000 7fdbecadd640 1 -- 172.21.15.104:0/4267597625 wait complete. 2024-05-08T04:25:08.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.467+0000 7fdbecadd640 1 Processor -- start 2024-05-08T04:25:08.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.467+0000 7fdbecadd640 1 -- start start 2024-05-08T04:25:08.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbecadd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd0004d40 0x7fdbe80caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbecadd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbe8156d20 0x7fdbe80cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbecadd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbe80b13a0 0x7fdbe80b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbecadd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80b5b80 con 0x7fdbd0004d40 2024-05-08T04:25:08.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbecadd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe815fb10 con 0x7fdbe8156d20 2024-05-08T04:25:08.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbecadd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe8161320 con 0x7fdbe80b13a0 2024-05-08T04:25:08.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbe659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd0004d40 0x7fdbe80caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbe659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd0004d40 0x7fdbe80caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38488/0 (socket says 172.21.15.104:38488) 2024-05-08T04:25:08.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbe659c640 1 -- 172.21.15.104:0/2512701083 learned_addr learned my addr 172.21.15.104:0/2512701083 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:08.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbe5d9b640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbe8156d20 0x7fdbe80cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbe6d9d640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbe80b13a0 0x7fdbe80b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbe659c640 1 -- 172.21.15.104:0/2512701083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbe80b13a0 msgr2=0x7fdbe80b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbe659c640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbe80b13a0 0x7fdbe80b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbe659c640 1 -- 172.21.15.104:0/2512701083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbe8156d20 msgr2=0x7fdbe80cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbe659c640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbe8156d20 0x7fdbe80cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.468+0000 7fdbe659c640 1 -- 172.21.15.104:0/2512701083 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe80cb010 con 0x7fdbd0004d40 2024-05-08T04:25:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.469+0000 7fdbe5d9b640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbe8156d20 0x7fdbe80cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.469+0000 7fdbe659c640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd0004d40 0x7fdbe80caad0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8011a00 tx=0x7fdbd8011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.469+0000 7fdbd6ffd640 1 -- 172.21.15.104:0/2512701083 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800fb50 con 0x7fdbd0004d40 2024-05-08T04:25:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.469+0000 7fdbd6ffd640 1 -- 172.21.15.104:0/2512701083 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd800fcf0 con 0x7fdbd0004d40 2024-05-08T04:25:08.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.469+0000 7fdbecadd640 1 -- 172.21.15.104:0/2512701083 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe80cb2c0 con 0x7fdbd0004d40 2024-05-08T04:25:08.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.469+0000 7fdbd6ffd640 1 -- 172.21.15.104:0/2512701083 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800fea0 con 0x7fdbd0004d40 2024-05-08T04:25:08.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.469+0000 7fdbecadd640 1 -- 172.21.15.104:0/2512701083 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe80cb880 con 0x7fdbd0004d40 2024-05-08T04:25:08.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.470+0000 7fdbecadd640 1 -- 172.21.15.104:0/2512701083 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdbe80683d0 con 0x7fdbd0004d40 2024-05-08T04:25:08.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.470+0000 7fdbd6ffd640 1 -- 172.21.15.104:0/2512701083 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fdbd8012040 con 0x7fdbd0004d40 2024-05-08T04:25:08.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.471+0000 7fdbd6ffd640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdbc806b710 0x7fdbc806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.471+0000 7fdbd6ffd640 1 -- 172.21.15.104:0/2512701083 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdbd808b020 con 0x7fdbd0004d40 2024-05-08T04:25:08.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.471+0000 7fdbe5d9b640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdbc806b710 0x7fdbc806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.471+0000 7fdbd6ffd640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] conn(0x7fdbc80715d0 0x7fdbc80739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.471+0000 7fdbd6ffd640 1 -- 172.21.15.104:0/2512701083 --> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbd8027e50 con 0x7fdbc80715d0 2024-05-08T04:25:08.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.471+0000 7fdbd6ffd640 1 -- 172.21.15.104:0/2512701083 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbd808b4b0 con 0x7fdbd0004d40 2024-05-08T04:25:08.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.471+0000 7fdbe6d9d640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] conn(0x7fdbc80715d0 0x7fdbc80739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.471+0000 7fdbe5d9b640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdbc806b710 0x7fdbc806dbd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8144b90 tx=0x7fdbdc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.471+0000 7fdbe6d9d640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] conn(0x7fdbc80715d0 0x7fdbc80739f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.472+0000 7fdbd6ffd640 1 -- 172.21.15.104:0/2512701083 <== osd.1 v2:172.21.15.104:6800/3900877386 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdbd8027e50 con 0x7fdbc80715d0 2024-05-08T04:25:08.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.485+0000 7fdbecadd640 1 -- 172.21.15.104:0/2512701083 --> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdbe8075010 con 0x7fdbc80715d0 2024-05-08T04:25:08.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.485+0000 7fdbd6ffd640 1 -- 172.21.15.104:0/2512701083 <== osd.1 v2:172.21.15.104:6800/3900877386 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdbe8075010 con 0x7fdbc80715d0 2024-05-08T04:25:08.487 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:25:08.488 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T04:25:08.488 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:25:08.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.485+0000 7fdbecadd640 1 -- 172.21.15.104:0/2512701083 >> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] conn(0x7fdbc80715d0 msgr2=0x7fdbc80739f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.485+0000 7fdbecadd640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.104:6800/3900877386,v1:172.21.15.104:6801/3900877386] conn(0x7fdbc80715d0 0x7fdbc80739f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.486+0000 7fdbecadd640 1 -- 172.21.15.104:0/2512701083 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdbc806b710 msgr2=0x7fdbc806dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.486+0000 7fdbecadd640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fdbc806b710 0x7fdbc806dbd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8144b90 tx=0x7fdbdc009040 comp rx=0 tx=0).stop 2024-05-08T04:25:08.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.486+0000 7fdbecadd640 1 -- 172.21.15.104:0/2512701083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd0004d40 msgr2=0x7fdbe80caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.486+0000 7fdbecadd640 1 --2- 172.21.15.104:0/2512701083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd0004d40 0x7fdbe80caad0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8011a00 tx=0x7fdbd8011ec0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.486+0000 7fdbe6d9d640 1 -- 172.21.15.104:0/2512701083 reap_dead start 2024-05-08T04:25:08.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.486+0000 7fdbecadd640 1 -- 172.21.15.104:0/2512701083 shutdown_connections 2024-05-08T04:25:08.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.486+0000 7fdbecadd640 1 -- 172.21.15.104:0/2512701083 >> 172.21.15.104:0/2512701083 conn(0x7fdbe80b3450 msgr2=0x7fdbe815cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:08.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.486+0000 7fdbecadd640 1 -- 172.21.15.104:0/2512701083 shutdown_connections 2024-05-08T04:25:08.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.486+0000 7fdbecadd640 1 -- 172.21.15.104:0/2512701083 wait complete. 2024-05-08T04:25:08.498 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T04:25:08.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.598+0000 7f27a75d5640 1 Processor -- start 2024-05-08T04:25:08.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.598+0000 7f27a75d5640 1 -- start start 2024-05-08T04:25:08.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f27a75d5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f27a006c280 0x7f27a00ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f27a75d5640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a0072c40 con 0x7f27a00acdf0 2024-05-08T04:25:08.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f27a75d5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a006de30 con 0x7f27a0161190 2024-05-08T04:25:08.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f27a75d5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a00b4db0 con 0x7f27a006c280 2024-05-08T04:25:08.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f27a4b70640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f27a00acdf0 0x7f27a006bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42760/0 (socket says 172.21.15.104:42760) 2024-05-08T04:25:08.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f27a4b70640 1 -- 172.21.15.104:0/3395166085 learned_addr learned my addr 172.21.15.104:0/3395166085 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:08.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f27a5b72640 1 --2- 172.21.15.104:0/3395166085 >> v2:172.21.15.183:3300/0 conn(0x7f27a006c280 0x7f27a00ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582042017 0 0) 0x7f27a0072c40 con 0x7f27a00acdf0 2024-05-08T04:25:08.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f278c003520 con 0x7f27a00acdf0 2024-05-08T04:25:08.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3781631453 0 0) 0x7f278c003520 con 0x7f27a00acdf0 2024-05-08T04:25:08.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 >> v2:172.21.15.183:3300/0 conn(0x7f27a006c280 msgr2=0x7f27a00ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:08.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 --2- 172.21.15.104:0/3395166085 >> v2:172.21.15.183:3300/0 conn(0x7f27a006c280 0x7f27a00ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 >> v1:172.21.15.183:6789/0 conn(0x7f27a0161190 legacy=0x7f27a0072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a006e110 con 0x7f27a00acdf0 2024-05-08T04:25:08.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f2790001670 con 0x7f27a00acdf0 2024-05-08T04:25:08.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f27a5b72640 1 --2- 172.21.15.104:0/3395166085 >> v2:172.21.15.183:3300/0 conn(0x7f27a006c280 0x7f27a00ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:25:08.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 >> v1:172.21.15.104:6789/0 conn(0x7f27a00acdf0 legacy=0x7f27a006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 --2- 172.21.15.104:0/3395166085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f278c0039b0 0x7f278c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 --2- 172.21.15.104:0/3395166085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278c004800 0x7f278c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 --2- 172.21.15.104:0/3395166085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f278c0051c0 0x7f278c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c00c030 con 0x7f278c004800 2024-05-08T04:25:08.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c00c1e0 con 0x7f278c0051c0 2024-05-08T04:25:08.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.599+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c00c3e0 con 0x7f278c0039b0 2024-05-08T04:25:08.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.600+0000 7f27a4b70640 1 --2- 172.21.15.104:0/3395166085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278c004800 0x7f278c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.600+0000 7f27a5b72640 1 --2- 172.21.15.104:0/3395166085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f278c0051c0 0x7f278c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.600+0000 7f27a5371640 1 --2- 172.21.15.104:0/3395166085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f278c0039b0 0x7f278c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.600+0000 7f27a4b70640 1 -- 172.21.15.104:0/3395166085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f278c0039b0 msgr2=0x7f278c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:08.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.600+0000 7f27a4b70640 1 --2- 172.21.15.104:0/3395166085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f278c0039b0 0x7f278c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.600+0000 7f27a4b70640 1 -- 172.21.15.104:0/3395166085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f278c0051c0 msgr2=0x7f278c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:08.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.600+0000 7f27a4b70640 1 --2- 172.21.15.104:0/3395166085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f278c0051c0 0x7f278c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.600+0000 7f27a4b70640 1 -- 172.21.15.104:0/3395166085 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c003520 con 0x7f278c004800 2024-05-08T04:25:08.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.600+0000 7f27a5b72640 1 --2- 172.21.15.104:0/3395166085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f278c0051c0 0x7f278c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:08.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.600+0000 7f27a5b72640 1 -- 172.21.15.104:0/3395166085 reap_dead start 2024-05-08T04:25:08.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.600+0000 7f27a4b70640 1 --2- 172.21.15.104:0/3395166085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278c004800 0x7f278c004c80 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f279000c240 tx=0x7f278c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae69ee539f965ebb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.601+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790007cf0 con 0x7f278c004800 2024-05-08T04:25:08.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.601+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2790005af0 con 0x7f278c004800 2024-05-08T04:25:08.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.601+0000 7f2797fff640 1 -- 172.21.15.104:0/3395166085 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790007070 con 0x7f278c004800 2024-05-08T04:25:08.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.601+0000 7f27a75d5640 1 -- 172.21.15.104:0/3395166085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278c004800 msgr2=0x7f278c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.601+0000 7f27a75d5640 1 --2- 172.21.15.104:0/3395166085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278c004800 0x7f278c004c80 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f279000c240 tx=0x7f278c005830 comp rx=0 tx=0).stop 2024-05-08T04:25:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.601+0000 7f27a75d5640 1 -- 172.21.15.104:0/3395166085 shutdown_connections 2024-05-08T04:25:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.601+0000 7f27a75d5640 1 --2- 172.21.15.104:0/3395166085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278c004800 0x7f278c004c80 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.601+0000 7f27a75d5640 1 -- 172.21.15.104:0/3395166085 >> 172.21.15.104:0/3395166085 conn(0x7f27a0071a10 msgr2=0x7f27a0071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.601+0000 7f27a75d5640 1 -- 172.21.15.104:0/3395166085 shutdown_connections 2024-05-08T04:25:08.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.601+0000 7f27a75d5640 1 -- 172.21.15.104:0/3395166085 wait complete. 2024-05-08T04:25:08.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.602+0000 7f27a75d5640 1 Processor -- start 2024-05-08T04:25:08.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.602+0000 7f27a75d5640 1 -- start start 2024-05-08T04:25:08.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a75d5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278c004800 0x7f27a013d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a75d5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27a0153790 0x7f27a0150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a75d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27a0153c10 0x7f27a01508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a75d5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a006e9b0 con 0x7f278c004800 2024-05-08T04:25:08.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a75d5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a006e6d0 con 0x7f27a0153790 2024-05-08T04:25:08.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a75d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a006da70 con 0x7f27a0153c10 2024-05-08T04:25:08.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a5371640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278c004800 0x7f27a013d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a5371640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278c004800 0x7f27a013d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38506/0 (socket says 172.21.15.104:38506) 2024-05-08T04:25:08.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a5371640 1 -- 172.21.15.104:0/3866545380 learned_addr learned my addr 172.21.15.104:0/3866545380 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:08.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a4b70640 1 --2- 172.21.15.104:0/3866545380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27a0153790 0x7f27a0150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a5371640 1 -- 172.21.15.104:0/3866545380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27a0153c10 msgr2=0x7f27a01508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a5371640 1 --2- 172.21.15.104:0/3866545380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27a0153c10 0x7f27a01508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a5371640 1 -- 172.21.15.104:0/3866545380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27a0153790 msgr2=0x7f27a0150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a5371640 1 --2- 172.21.15.104:0/3866545380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27a0153790 0x7f27a0150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.603+0000 7f27a5371640 1 -- 172.21.15.104:0/3866545380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a0154150 con 0x7f278c004800 2024-05-08T04:25:08.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.604+0000 7f27a5371640 1 --2- 172.21.15.104:0/3866545380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278c004800 0x7f27a013d550 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f279c00e450 tx=0x7f279c00e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.604+0000 7f2795ffb640 1 -- 172.21.15.104:0/3866545380 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c0053a0 con 0x7f278c004800 2024-05-08T04:25:08.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.604+0000 7f2795ffb640 1 -- 172.21.15.104:0/3866545380 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279c018070 con 0x7f278c004800 2024-05-08T04:25:08.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.604+0000 7f27a75d5640 1 -- 172.21.15.104:0/3866545380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a0154430 con 0x7f278c004800 2024-05-08T04:25:08.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.604+0000 7f2795ffb640 1 -- 172.21.15.104:0/3866545380 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c003810 con 0x7f278c004800 2024-05-08T04:25:08.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.604+0000 7f27a75d5640 1 -- 172.21.15.104:0/3866545380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a013dda0 con 0x7f278c004800 2024-05-08T04:25:08.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.605+0000 7f27a75d5640 1 -- 172.21.15.104:0/3866545380 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a0075010 con 0x7f278c004800 2024-05-08T04:25:08.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.605+0000 7f2795ffb640 1 -- 172.21.15.104:0/3866545380 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f279c0039b0 con 0x7f278c004800 2024-05-08T04:25:08.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.606+0000 7f2795ffb640 1 --2- 172.21.15.104:0/3866545380 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f278406b740 0x7f278406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.606+0000 7f2795ffb640 1 -- 172.21.15.104:0/3866545380 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f279c089f70 con 0x7f278c004800 2024-05-08T04:25:08.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.606+0000 7f27a4b70640 1 --2- 172.21.15.104:0/3866545380 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f278406b740 0x7f278406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.606+0000 7f27a4b70640 1 --2- 172.21.15.104:0/3866545380 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f278406b740 0x7f278406dc00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2790032000 tx=0x7f2790009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.610+0000 7f2795ffb640 1 -- 172.21.15.104:0/3866545380 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f279c058d90 con 0x7f278c004800 2024-05-08T04:25:08.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.783+0000 7f27a75d5640 1 -- 172.21.15.104:0/3866545380 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f27a0066a30 con 0x7f278406b740 2024-05-08T04:25:08.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.783+0000 7f2795ffb640 1 -- 172.21.15.104:0/3866545380 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f27a0066a30 con 0x7f278406b740 2024-05-08T04:25:08.785 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T04:25:08.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.786+0000 7f27a75d5640 1 -- 172.21.15.104:0/3866545380 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f278406b740 msgr2=0x7f278406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.786+0000 7f27a75d5640 1 --2- 172.21.15.104:0/3866545380 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f278406b740 0x7f278406dc00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2790032000 tx=0x7f2790009030 comp rx=0 tx=0).stop 2024-05-08T04:25:08.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.786+0000 7f27a75d5640 1 -- 172.21.15.104:0/3866545380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278c004800 msgr2=0x7f27a013d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.786+0000 7f27a75d5640 1 --2- 172.21.15.104:0/3866545380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278c004800 0x7f27a013d550 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f279c00e450 tx=0x7f279c00e910 comp rx=0 tx=0).stop 2024-05-08T04:25:08.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.786+0000 7f27a75d5640 1 -- 172.21.15.104:0/3866545380 shutdown_connections 2024-05-08T04:25:08.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.786+0000 7f27a75d5640 1 --2- 172.21.15.104:0/3866545380 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f278406b740 0x7f278406dc00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.786+0000 7f27a75d5640 1 --2- 172.21.15.104:0/3866545380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27a0153790 0x7f27a0150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.786+0000 7f27a75d5640 1 --2- 172.21.15.104:0/3866545380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27a0153c10 0x7f27a01508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.786+0000 7f27a75d5640 1 --2- 172.21.15.104:0/3866545380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278c004800 0x7f27a013d550 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.786+0000 7f27a75d5640 1 -- 172.21.15.104:0/3866545380 >> 172.21.15.104:0/3866545380 conn(0x7f27a0071a10 msgr2=0x7f27a0154cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:08.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.786+0000 7f27a75d5640 1 -- 172.21.15.104:0/3866545380 shutdown_connections 2024-05-08T04:25:08.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.786+0000 7f27a75d5640 1 -- 172.21.15.104:0/3866545380 wait complete. 2024-05-08T04:25:08.798 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T04:25:08.798 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T04:25:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.900+0000 7f81048e4640 1 Processor -- start 2024-05-08T04:25:08.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.900+0000 7f81048e4640 1 -- start start 2024-05-08T04:25:08.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.901+0000 7f81048e4640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f810015b7d0 0x7f810015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.901+0000 7f81048e4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f810015e6a0 0x7f81000b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.901+0000 7f81048e4640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810015ed40 con 0x7f81000b3b80 2024-05-08T04:25:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.901+0000 7f81048e4640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810006d6d0 con 0x7f810015b7d0 2024-05-08T04:25:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.901+0000 7f81048e4640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810006d9b0 con 0x7f810015e6a0 2024-05-08T04:25:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.901+0000 7f80fe59c640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f810015b7d0 0x7f810015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.901+0000 7f80fed9d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f81000b3b80 0x7f8100161750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42770/0 (socket says 172.21.15.104:42770) 2024-05-08T04:25:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.901+0000 7f80fed9d640 1 -- 172.21.15.104:0/377815804 learned_addr learned my addr 172.21.15.104:0/377815804 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.901+0000 7f80fe59c640 1 -- 172.21.15.104:0/377815804 >> v2:172.21.15.183:3300/0 conn(0x7f810015e6a0 msgr2=0x7f81000b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.901+0000 7f80fe59c640 1 --2- 172.21.15.104:0/377815804 >> v2:172.21.15.183:3300/0 conn(0x7f810015e6a0 0x7f81000b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.901+0000 7f80fe59c640 1 -- 172.21.15.104:0/377815804 >> v1:172.21.15.104:6789/0 conn(0x7f81000b3b80 legacy=0x7f8100161750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.901+0000 7f80fe59c640 1 -- 172.21.15.104:0/377815804 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810006dc90 con 0x7f810015b7d0 2024-05-08T04:25:08.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.901+0000 7f80fd59a640 1 -- 172.21.15.104:0/377815804 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977660533 0 0) 0x7f810015ed40 con 0x7f81000b3b80 2024-05-08T04:25:08.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.902+0000 7f80fe59c640 1 --2- 172.21.15.104:0/377815804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f810015b7d0 0x7f810015e160 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f80f00097a0 tx=0x7f80f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa7725735ebf10b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.902+0000 7f80fd59a640 1 -- 172.21.15.104:0/377815804 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0037070 con 0x7f810015b7d0 2024-05-08T04:25:08.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.902+0000 7f80fd59a640 1 -- 172.21.15.104:0/377815804 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0032440 con 0x7f810015b7d0 2024-05-08T04:25:08.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.902+0000 7f80fd59a640 1 -- 172.21.15.104:0/377815804 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0032810 con 0x7f810015b7d0 2024-05-08T04:25:08.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.903+0000 7f81048e4640 1 -- 172.21.15.104:0/377815804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f810015b7d0 msgr2=0x7f810015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.903+0000 7f81048e4640 1 --2- 172.21.15.104:0/377815804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f810015b7d0 0x7f810015e160 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f80f00097a0 tx=0x7f80f002a1e0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.903+0000 7f81048e4640 1 -- 172.21.15.104:0/377815804 shutdown_connections 2024-05-08T04:25:08.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.903+0000 7f81048e4640 1 --2- 172.21.15.104:0/377815804 >> v2:172.21.15.183:3300/0 conn(0x7f810015e6a0 0x7f81000b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.903+0000 7f81048e4640 1 --2- 172.21.15.104:0/377815804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f810015b7d0 0x7f810015e160 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.903+0000 7f81048e4640 1 -- 172.21.15.104:0/377815804 >> 172.21.15.104:0/377815804 conn(0x7f81000cfa60 msgr2=0x7f81000cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:08.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.903+0000 7f81048e4640 1 -- 172.21.15.104:0/377815804 shutdown_connections 2024-05-08T04:25:08.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.903+0000 7f81048e4640 1 -- 172.21.15.104:0/377815804 wait complete. 2024-05-08T04:25:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.904+0000 7f81048e4640 1 Processor -- start 2024-05-08T04:25:08.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.904+0000 7f81048e4640 1 -- start start 2024-05-08T04:25:08.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f81048e4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81000b3b80 0x7f81001454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f81048e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f810015b7d0 0x7f810015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f81048e4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f810015e6a0 0x7f810015c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f81048e4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810015f020 con 0x7f810015b7d0 2024-05-08T04:25:08.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f81048e4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8100071890 con 0x7f810015e6a0 2024-05-08T04:25:08.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f81048e4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810006f1c0 con 0x7f81000b3b80 2024-05-08T04:25:08.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f80fdd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f810015b7d0 0x7f810015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f80fdd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f810015b7d0 0x7f810015c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38532/0 (socket says 172.21.15.104:38532) 2024-05-08T04:25:08.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f80fdd9b640 1 -- 172.21.15.104:0/757701940 learned_addr learned my addr 172.21.15.104:0/757701940 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:08.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f80fed9d640 1 --2- 172.21.15.104:0/757701940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f810015e6a0 0x7f810015c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f80fdd9b640 1 -- 172.21.15.104:0/757701940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81000b3b80 msgr2=0x7f81001454e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T04:25:08.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f80fdd9b640 1 --2- 172.21.15.104:0/757701940 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81000b3b80 0x7f81001454e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f80fdd9b640 1 -- 172.21.15.104:0/757701940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f810015e6a0 msgr2=0x7f810015c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f80fdd9b640 1 --2- 172.21.15.104:0/757701940 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f810015e6a0 0x7f810015c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.905+0000 7f80fdd9b640 1 -- 172.21.15.104:0/757701940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100145a20 con 0x7f810015b7d0 2024-05-08T04:25:08.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.906+0000 7f80fdd9b640 1 --2- 172.21.15.104:0/757701940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f810015b7d0 0x7f810015c1c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f80f400b440 tx=0x7f80f400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.906+0000 7f80eeffd640 1 -- 172.21.15.104:0/757701940 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4015020 con 0x7f810015b7d0 2024-05-08T04:25:08.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.906+0000 7f80eeffd640 1 -- 172.21.15.104:0/757701940 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f4011890 con 0x7f810015b7d0 2024-05-08T04:25:08.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.906+0000 7f81048e4640 1 -- 172.21.15.104:0/757701940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8100146db0 con 0x7f810015b7d0 2024-05-08T04:25:08.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.906+0000 7f80eeffd640 1 -- 172.21.15.104:0/757701940 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4011c80 con 0x7f810015b7d0 2024-05-08T04:25:08.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.906+0000 7f81048e4640 1 -- 172.21.15.104:0/757701940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8100147370 con 0x7f810015b7d0 2024-05-08T04:25:08.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.906+0000 7f81048e4640 1 -- 172.21.15.104:0/757701940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8100075010 con 0x7f810015b7d0 2024-05-08T04:25:08.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.907+0000 7f80eeffd640 1 -- 172.21.15.104:0/757701940 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f80f4018020 con 0x7f810015b7d0 2024-05-08T04:25:08.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.908+0000 7f80eeffd640 1 --2- 172.21.15.104:0/757701940 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f80e006b710 0x7f80e006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.908+0000 7f80eeffd640 1 -- 172.21.15.104:0/757701940 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f80f408a430 con 0x7f810015b7d0 2024-05-08T04:25:08.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.908+0000 7f80fe59c640 1 --2- 172.21.15.104:0/757701940 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f80e006b710 0x7f80e006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.908+0000 7f80eeffd640 1 --2- 172.21.15.104:0/757701940 >> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] conn(0x7f80e00715d0 0x7f80e00739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:08.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.908+0000 7f80eeffd640 1 -- 172.21.15.104:0/757701940 --> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80e00740a0 con 0x7f80e00715d0 2024-05-08T04:25:08.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.908+0000 7f80eeffd640 1 -- 172.21.15.104:0/757701940 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80f4091050 con 0x7f810015b7d0 2024-05-08T04:25:08.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.908+0000 7f80fed9d640 1 --2- 172.21.15.104:0/757701940 >> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] conn(0x7f80e00715d0 0x7f80e00739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:08.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.908+0000 7f80fe59c640 1 --2- 172.21.15.104:0/757701940 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f80e006b710 0x7f80e006dbd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f80f0034000 tx=0x7f80f002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.908+0000 7f80fed9d640 1 --2- 172.21.15.104:0/757701940 >> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] conn(0x7f80e00715d0 0x7f80e00739f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:08.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.909+0000 7f80eeffd640 1 -- 172.21.15.104:0/757701940 <== osd.2 v2:172.21.15.104:6824/2587310492 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f80e00740a0 con 0x7f80e00715d0 2024-05-08T04:25:08.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.922+0000 7f81048e4640 1 -- 172.21.15.104:0/757701940 --> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f81001477c0 con 0x7f80e00715d0 2024-05-08T04:25:08.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.922+0000 7f80eeffd640 1 -- 172.21.15.104:0/757701940 <== osd.2 v2:172.21.15.104:6824/2587310492 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f81001477c0 con 0x7f80e00715d0 2024-05-08T04:25:08.924 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:25:08.925 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T04:25:08.925 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:25:08.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.922+0000 7f81048e4640 1 -- 172.21.15.104:0/757701940 >> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] conn(0x7f80e00715d0 msgr2=0x7f80e00739f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.922+0000 7f81048e4640 1 --2- 172.21.15.104:0/757701940 >> [v2:172.21.15.104:6824/2587310492,v1:172.21.15.104:6825/2587310492] conn(0x7f80e00715d0 0x7f80e00739f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:08.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.922+0000 7f81048e4640 1 -- 172.21.15.104:0/757701940 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f80e006b710 msgr2=0x7f80e006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.922+0000 7f81048e4640 1 --2- 172.21.15.104:0/757701940 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f80e006b710 0x7f80e006dbd0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f80f0034000 tx=0x7f80f002e000 comp rx=0 tx=0).stop 2024-05-08T04:25:08.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.922+0000 7f81048e4640 1 -- 172.21.15.104:0/757701940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f810015b7d0 msgr2=0x7f810015c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:08.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.922+0000 7f81048e4640 1 --2- 172.21.15.104:0/757701940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f810015b7d0 0x7f810015c1c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f80f400b440 tx=0x7f80f400b900 comp rx=0 tx=0).stop 2024-05-08T04:25:08.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.922+0000 7f80fed9d640 1 -- 172.21.15.104:0/757701940 reap_dead start 2024-05-08T04:25:08.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.922+0000 7f81048e4640 1 -- 172.21.15.104:0/757701940 shutdown_connections 2024-05-08T04:25:08.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.922+0000 7f81048e4640 1 -- 172.21.15.104:0/757701940 >> 172.21.15.104:0/757701940 conn(0x7f81000cfa60 msgr2=0x7f810015a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:08.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.922+0000 7f81048e4640 1 -- 172.21.15.104:0/757701940 shutdown_connections 2024-05-08T04:25:08.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:08.922+0000 7f81048e4640 1 -- 172.21.15.104:0/757701940 wait complete. 2024-05-08T04:25:08.935 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T04:25:09.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.033+0000 7f7c4fe4a640 1 Processor -- start 2024-05-08T04:25:09.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.034+0000 7f7c4fe4a640 1 -- start start 2024-05-08T04:25:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.034+0000 7f7c4fe4a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7c480cf360 0x7f7c480cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.034+0000 7f7c4fe4a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7c480ccbe0 0x7f7c480cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.034+0000 7f7c4fe4a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c480cc700 con 0x7f7c48099a40 2024-05-08T04:25:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.034+0000 7f7c4fe4a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4815ced0 con 0x7f7c480ccbe0 2024-05-08T04:25:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.034+0000 7f7c4fe4a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c480d0020 con 0x7f7c480cf360 2024-05-08T04:25:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.034+0000 7f7c4dbe6640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f7c48099a40 0x7f7c48099e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42778/0 (socket says 172.21.15.104:42778) 2024-05-08T04:25:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.034+0000 7f7c4e3e7640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f7c480ccbe0 0x7f7c480cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.034+0000 7f7c4dbe6640 1 -- 172.21.15.104:0/1853509601 learned_addr learned my addr 172.21.15.104:0/1853509601 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.035+0000 7f7c4e3e7640 1 -- 172.21.15.104:0/1853509601 >> v2:172.21.15.183:3300/0 conn(0x7f7c480cf360 msgr2=0x7f7c480cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.035+0000 7f7c4e3e7640 1 --2- 172.21.15.104:0/1853509601 >> v2:172.21.15.183:3300/0 conn(0x7f7c480cf360 0x7f7c480cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.035+0000 7f7c4e3e7640 1 -- 172.21.15.104:0/1853509601 >> v1:172.21.15.104:6789/0 conn(0x7f7c48099a40 legacy=0x7f7c48099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.035+0000 7f7c4e3e7640 1 -- 172.21.15.104:0/1853509601 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480d0300 con 0x7f7c480ccbe0 2024-05-08T04:25:09.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.035+0000 7f7c4cbe4640 1 -- 172.21.15.104:0/1853509601 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504085988 0 0) 0x7f7c480cc700 con 0x7f7c48099a40 2024-05-08T04:25:09.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.035+0000 7f7c4e3e7640 1 --2- 172.21.15.104:0/1853509601 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c480ccbe0 0x7f7c480cd010 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f7c48072b30 tx=0x7f7c4002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218a2fab6858fb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.036+0000 7f7c4cbe4640 1 -- 172.21.15.104:0/1853509601 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40037070 con 0x7f7c480ccbe0 2024-05-08T04:25:09.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.036+0000 7f7c4cbe4640 1 -- 172.21.15.104:0/1853509601 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c40032440 con 0x7f7c480ccbe0 2024-05-08T04:25:09.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.036+0000 7f7c4cbe4640 1 -- 172.21.15.104:0/1853509601 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40032810 con 0x7f7c480ccbe0 2024-05-08T04:25:09.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.036+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/1853509601 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c480ccbe0 msgr2=0x7f7c480cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.036+0000 7f7c4fe4a640 1 --2- 172.21.15.104:0/1853509601 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c480ccbe0 0x7f7c480cd010 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f7c48072b30 tx=0x7f7c4002a1a0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.036+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/1853509601 shutdown_connections 2024-05-08T04:25:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.036+0000 7f7c4fe4a640 1 --2- 172.21.15.104:0/1853509601 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c480ccbe0 0x7f7c480cd010 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.036+0000 7f7c4fe4a640 1 --2- 172.21.15.104:0/1853509601 >> v2:172.21.15.183:3300/0 conn(0x7f7c480cf360 0x7f7c480cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.036+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/1853509601 >> 172.21.15.104:0/1853509601 conn(0x7f7c480b3280 msgr2=0x7f7c480b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.036+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/1853509601 shutdown_connections 2024-05-08T04:25:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.036+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/1853509601 wait complete. 2024-05-08T04:25:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.037+0000 7f7c4fe4a640 1 Processor -- start 2024-05-08T04:25:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.038+0000 7f7c4fe4a640 1 -- start start 2024-05-08T04:25:09.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.038+0000 7f7c4fe4a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c48099a40 0x7f7c48158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.038+0000 7f7c4fe4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c480ccbe0 0x7f7c480cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.038+0000 7f7c4fe4a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c480cf360 0x7f7c480c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.038+0000 7f7c4fe4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c48159860 con 0x7f7c480ccbe0 2024-05-08T04:25:09.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.038+0000 7f7c4fe4a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480cfd30 con 0x7f7c480cf360 2024-05-08T04:25:09.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.038+0000 7f7c4fe4a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480d08c0 con 0x7f7c48099a40 2024-05-08T04:25:09.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.038+0000 7f7c4d3e5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c480ccbe0 0x7f7c480cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.038+0000 7f7c4d3e5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c480ccbe0 0x7f7c480cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38546/0 (socket says 172.21.15.104:38546) 2024-05-08T04:25:09.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.038+0000 7f7c4d3e5640 1 -- 172.21.15.104:0/2074373066 learned_addr learned my addr 172.21.15.104:0/2074373066 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:09.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.038+0000 7f7c4e3e7640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c480cf360 0x7f7c480c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.039+0000 7f7c4dbe6640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c48099a40 0x7f7c48158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.039+0000 7f7c4d3e5640 1 -- 172.21.15.104:0/2074373066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c48099a40 msgr2=0x7f7c48158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.039+0000 7f7c4d3e5640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c48099a40 0x7f7c48158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.039+0000 7f7c4d3e5640 1 -- 172.21.15.104:0/2074373066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c480cf360 msgr2=0x7f7c480c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.039+0000 7f7c4d3e5640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c480cf360 0x7f7c480c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.039+0000 7f7c4d3e5640 1 -- 172.21.15.104:0/2074373066 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480cb600 con 0x7f7c480ccbe0 2024-05-08T04:25:09.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.039+0000 7f7c4d3e5640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c480ccbe0 0x7f7c480cb0c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800b410 tx=0x7f7c3800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.039+0000 7f7c3e7fc640 1 -- 172.21.15.104:0/2074373066 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38015020 con 0x7f7c480ccbe0 2024-05-08T04:25:09.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.039+0000 7f7c3e7fc640 1 -- 172.21.15.104:0/2074373066 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c38011850 con 0x7f7c480ccbe0 2024-05-08T04:25:09.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.039+0000 7f7c3e7fc640 1 -- 172.21.15.104:0/2074373066 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38011c40 con 0x7f7c480ccbe0 2024-05-08T04:25:09.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.039+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/2074373066 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4806d250 con 0x7f7c480ccbe0 2024-05-08T04:25:09.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.039+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/2074373066 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4806d810 con 0x7f7c480ccbe0 2024-05-08T04:25:09.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.040+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/2074373066 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c48075010 con 0x7f7c480ccbe0 2024-05-08T04:25:09.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.040+0000 7f7c3e7fc640 1 -- 172.21.15.104:0/2074373066 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f7c38018020 con 0x7f7c480ccbe0 2024-05-08T04:25:09.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.041+0000 7f7c3e7fc640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c2c06b710 0x7f7c2c06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.041+0000 7f7c3e7fc640 1 -- 172.21.15.104:0/2074373066 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7c3808a170 con 0x7f7c480ccbe0 2024-05-08T04:25:09.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.041+0000 7f7c4dbe6640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c2c06b710 0x7f7c2c06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.041+0000 7f7c4dbe6640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c2c06b710 0x7f7c2c06dbd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7c44001380 tx=0x7f7c44009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.045+0000 7f7c3e7fc640 1 -- 172.21.15.104:0/2074373066 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c3801f020 con 0x7f7c480ccbe0 2024-05-08T04:25:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.217+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/2074373066 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c48071b90 con 0x7f7c2c06b710 2024-05-08T04:25:09.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.217+0000 7f7c3e7fc640 1 -- 172.21.15.104:0/2074373066 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7c48071b90 con 0x7f7c2c06b710 2024-05-08T04:25:09.220 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T04:25:09.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.219+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/2074373066 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c2c06b710 msgr2=0x7f7c2c06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.219+0000 7f7c4fe4a640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c2c06b710 0x7f7c2c06dbd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7c44001380 tx=0x7f7c44009040 comp rx=0 tx=0).stop 2024-05-08T04:25:09.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.219+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/2074373066 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c480ccbe0 msgr2=0x7f7c480cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.219+0000 7f7c4fe4a640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c480ccbe0 0x7f7c480cb0c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800b410 tx=0x7f7c3800b8d0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.219+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/2074373066 shutdown_connections 2024-05-08T04:25:09.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.219+0000 7f7c4fe4a640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7c2c06b710 0x7f7c2c06dbd0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.219+0000 7f7c4fe4a640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c480cf360 0x7f7c480c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.219+0000 7f7c4fe4a640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c480ccbe0 0x7f7c480cb0c0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.219+0000 7f7c4fe4a640 1 --2- 172.21.15.104:0/2074373066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c48099a40 0x7f7c48158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.219+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/2074373066 >> 172.21.15.104:0/2074373066 conn(0x7f7c480b3280 msgr2=0x7f7c480af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:09.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.219+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/2074373066 shutdown_connections 2024-05-08T04:25:09.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.219+0000 7f7c4fe4a640 1 -- 172.21.15.104:0/2074373066 wait complete. 2024-05-08T04:25:09.232 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T04:25:09.233 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T04:25:09.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.335+0000 7f5cf7ebd640 1 Processor -- start 2024-05-08T04:25:09.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.335+0000 7f5cf7ebd640 1 -- start start 2024-05-08T04:25:09.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.336+0000 7f5cf7ebd640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5cf00acdf0 0x7f5cf00ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.336+0000 7f5cf7ebd640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf0072c40 con 0x7f5cf0161190 2024-05-08T04:25:09.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.336+0000 7f5cf7ebd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf006de30 con 0x7f5cf006bb70 2024-05-08T04:25:09.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.336+0000 7f5cf7ebd640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf00b4db0 con 0x7f5cf00acdf0 2024-05-08T04:25:09.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.336+0000 7f5cf5458640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f5cf00acdf0 0x7f5cf00ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.336+0000 7f5cf5c59640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f5cf0161190 0x7f5cf0072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42788/0 (socket says 172.21.15.104:42788) 2024-05-08T04:25:09.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.336+0000 7f5cf5c59640 1 -- 172.21.15.104:0/644983244 learned_addr learned my addr 172.21.15.104:0/644983244 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:09.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.337+0000 7f5cf5458640 1 -- 172.21.15.104:0/644983244 >> v1:172.21.15.183:6789/0 conn(0x7f5cf006bb70 legacy=0x7f5cf006eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:09.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.337+0000 7f5cf5458640 1 -- 172.21.15.104:0/644983244 >> v1:172.21.15.104:6789/0 conn(0x7f5cf0161190 legacy=0x7f5cf0072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.337+0000 7f5cf4c57640 1 -- 172.21.15.104:0/644983244 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228153859 0 0) 0x7f5cf0072c40 con 0x7f5cf0161190 2024-05-08T04:25:09.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.337+0000 7f5cf5458640 1 -- 172.21.15.104:0/644983244 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf006e110 con 0x7f5cf00acdf0 2024-05-08T04:25:09.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.337+0000 7f5cf5458640 1 --2- 172.21.15.104:0/644983244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cf00acdf0 0x7f5cf00ad280 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00097a0 tx=0x7f5ce002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767d7a7775f24ed4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.338+0000 7f5cf4c57640 1 -- 172.21.15.104:0/644983244 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0037070 con 0x7f5cf00acdf0 2024-05-08T04:25:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.338+0000 7f5cf4c57640 1 -- 172.21.15.104:0/644983244 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce0032440 con 0x7f5cf00acdf0 2024-05-08T04:25:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.338+0000 7f5cf4c57640 1 -- 172.21.15.104:0/644983244 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0032810 con 0x7f5cf00acdf0 2024-05-08T04:25:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.338+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/644983244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cf00acdf0 msgr2=0x7f5cf00ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.338+0000 7f5cf7ebd640 1 --2- 172.21.15.104:0/644983244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cf00acdf0 0x7f5cf00ad280 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00097a0 tx=0x7f5ce002a1e0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.338+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/644983244 shutdown_connections 2024-05-08T04:25:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.338+0000 7f5cf7ebd640 1 --2- 172.21.15.104:0/644983244 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cf00acdf0 0x7f5cf00ad280 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.338+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/644983244 >> 172.21.15.104:0/644983244 conn(0x7f5cf0071a10 msgr2=0x7f5cf0071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:09.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.338+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/644983244 shutdown_connections 2024-05-08T04:25:09.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.338+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/644983244 wait complete. 2024-05-08T04:25:09.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.339+0000 7f5cf7ebd640 1 Processor -- start 2024-05-08T04:25:09.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.339+0000 7f5cf7ebd640 1 -- start start 2024-05-08T04:25:09.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf7ebd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cf006bb70 0x7f5cf0156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf7ebd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cf00acdf0 0x7f5cf0142860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf7ebd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cf0161190 0x7f5cf0154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf7ebd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf006e9b0 con 0x7f5cf0161190 2024-05-08T04:25:09.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf7ebd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf006e6d0 con 0x7f5cf006bb70 2024-05-08T04:25:09.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf7ebd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf006da70 con 0x7f5cf00acdf0 2024-05-08T04:25:09.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf645a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cf0161190 0x7f5cf0154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf645a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cf0161190 0x7f5cf0154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38562/0 (socket says 172.21.15.104:38562) 2024-05-08T04:25:09.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf645a640 1 -- 172.21.15.104:0/2442574551 learned_addr learned my addr 172.21.15.104:0/2442574551 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:09.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf5c59640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cf006bb70 0x7f5cf0156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf645a640 1 -- 172.21.15.104:0/2442574551 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cf00acdf0 msgr2=0x7f5cf0142860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf645a640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5cf00acdf0 0x7f5cf0142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf645a640 1 -- 172.21.15.104:0/2442574551 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cf006bb70 msgr2=0x7f5cf0156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf645a640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cf006bb70 0x7f5cf0156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf645a640 1 -- 172.21.15.104:0/2442574551 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0155580 con 0x7f5cf0161190 2024-05-08T04:25:09.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.340+0000 7f5cf5c59640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5cf006bb70 0x7f5cf0156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:09.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.341+0000 7f5cf645a640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cf0161190 0x7f5cf0154ba0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800c390 tx=0x7f5ce800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.341+0000 7f5ce67fc640 1 -- 172.21.15.104:0/2442574551 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8017070 con 0x7f5cf0161190 2024-05-08T04:25:09.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.341+0000 7f5ce67fc640 1 -- 172.21.15.104:0/2442574551 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce80035f0 con 0x7f5cf0161190 2024-05-08T04:25:09.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.341+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/2442574551 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf0155860 con 0x7f5cf0161190 2024-05-08T04:25:09.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.341+0000 7f5ce67fc640 1 -- 172.21.15.104:0/2442574551 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80039e0 con 0x7f5cf0161190 2024-05-08T04:25:09.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.341+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/2442574551 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf0155e20 con 0x7f5cf0161190 2024-05-08T04:25:09.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.341+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/2442574551 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5cf0156200 con 0x7f5cf0161190 2024-05-08T04:25:09.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.342+0000 7f5ce67fc640 1 -- 172.21.15.104:0/2442574551 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f5ce801a070 con 0x7f5cf0161190 2024-05-08T04:25:09.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.343+0000 7f5ce67fc640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5cd406b710 0x7f5cd406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.343+0000 7f5ce67fc640 1 -- 172.21.15.104:0/2442574551 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5ce8089ec0 con 0x7f5cf0161190 2024-05-08T04:25:09.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.343+0000 7f5cf5c59640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5cd406b710 0x7f5cd406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.343+0000 7f5ce67fc640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] conn(0x7f5cd40715d0 0x7f5cd40739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.343+0000 7f5ce67fc640 1 -- 172.21.15.104:0/2442574551 --> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cd40740a0 con 0x7f5cd40715d0 2024-05-08T04:25:09.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.343+0000 7f5ce67fc640 1 -- 172.21.15.104:0/2442574551 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ce808a330 con 0x7f5cf0161190 2024-05-08T04:25:09.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.343+0000 7f5cf5458640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] conn(0x7f5cd40715d0 0x7f5cd40739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.343+0000 7f5cf5c59640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5cd406b710 0x7f5cd406dbd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5cec007fd0 tx=0x7f5cec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.343+0000 7f5cf5458640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] conn(0x7f5cd40715d0 0x7f5cd40739f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.344+0000 7f5ce67fc640 1 -- 172.21.15.104:0/2442574551 <== osd.3 v2:172.21.15.104:6816/2847992975 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5cd40740a0 con 0x7f5cd40715d0 2024-05-08T04:25:09.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.357+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/2442574551 --> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5cf0075010 con 0x7f5cd40715d0 2024-05-08T04:25:09.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.357+0000 7f5ce67fc640 1 -- 172.21.15.104:0/2442574551 <== osd.3 v2:172.21.15.104:6816/2847992975 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5cf0075010 con 0x7f5cd40715d0 2024-05-08T04:25:09.360 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:25:09.360 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T04:25:09.360 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:25:09.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.357+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/2442574551 >> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] conn(0x7f5cd40715d0 msgr2=0x7f5cd40739f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.357+0000 7f5cf7ebd640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.104:6816/2847992975,v1:172.21.15.104:6817/2847992975] conn(0x7f5cd40715d0 0x7f5cd40739f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.357+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/2442574551 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5cd406b710 msgr2=0x7f5cd406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.357+0000 7f5cf7ebd640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f5cd406b710 0x7f5cd406dbd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5cec007fd0 tx=0x7f5cec009040 comp rx=0 tx=0).stop 2024-05-08T04:25:09.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.357+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/2442574551 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cf0161190 msgr2=0x7f5cf0154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.357+0000 7f5cf7ebd640 1 --2- 172.21.15.104:0/2442574551 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cf0161190 0x7f5cf0154ba0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800c390 tx=0x7f5ce800c850 comp rx=0 tx=0).stop 2024-05-08T04:25:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.357+0000 7f5cf645a640 1 -- 172.21.15.104:0/2442574551 reap_dead start 2024-05-08T04:25:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.358+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/2442574551 shutdown_connections 2024-05-08T04:25:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.358+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/2442574551 >> 172.21.15.104:0/2442574551 conn(0x7f5cf0071a10 msgr2=0x7f5cf015fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.358+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/2442574551 shutdown_connections 2024-05-08T04:25:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.358+0000 7f5cf7ebd640 1 -- 172.21.15.104:0/2442574551 wait complete. 2024-05-08T04:25:09.370 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T04:25:09.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.468+0000 7fc5f20b6640 1 Processor -- start 2024-05-08T04:25:09.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.468+0000 7fc5f20b6640 1 -- start start 2024-05-08T04:25:09.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5f20b6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc5ec070c70 0x7fc5ec071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5f20b6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec15edf0 0x7fc5ec0b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5f20b6640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5ec071590 con 0x7fc5ec157ac0 2024-05-08T04:25:09.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5f20b6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ec06bc70 con 0x7fc5ec070c70 2024-05-08T04:25:09.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5f20b6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec0d15c0 con 0x7fc5ec15edf0 2024-05-08T04:25:09.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5ebfff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fc5ec157ac0 0x7fc5ec157f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42798/0 (socket says 172.21.15.104:42798) 2024-05-08T04:25:09.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5ebfff640 1 -- 172.21.15.104:0/2781486179 learned_addr learned my addr 172.21.15.104:0/2781486179 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:09.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5eb7fe640 1 --2- 172.21.15.104:0/2781486179 >> v2:172.21.15.183:3300/0 conn(0x7fc5ec070c70 0x7fc5ec071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644338109 0 0) 0x7fc5ec071590 con 0x7fc5ec157ac0 2024-05-08T04:25:09.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5d4003520 con 0x7fc5ec157ac0 2024-05-08T04:25:09.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5eaffd640 1 --2- 172.21.15.104:0/2781486179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec15edf0 0x7fc5ec0b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3751403249 0 0) 0x7fc5d4003520 con 0x7fc5ec157ac0 2024-05-08T04:25:09.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec15edf0 msgr2=0x7fc5ec0b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:09.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5ea7fc640 1 --2- 172.21.15.104:0/2781486179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec15edf0 0x7fc5ec0b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 >> v2:172.21.15.183:3300/0 conn(0x7fc5ec070c70 msgr2=0x7fc5ec071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:09.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.469+0000 7fc5ea7fc640 1 --2- 172.21.15.104:0/2781486179 >> v2:172.21.15.183:3300/0 conn(0x7fc5ec070c70 0x7fc5ec071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec15f550 con 0x7fc5ec157ac0 2024-05-08T04:25:09.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7fc5e4001670 con 0x7fc5ec157ac0 2024-05-08T04:25:09.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 >> v1:172.21.15.104:6789/0 conn(0x7fc5ec157ac0 legacy=0x7fc5ec157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5ea7fc640 1 --2- 172.21.15.104:0/2781486179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec15edf0 0x7fc5d40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5ea7fc640 1 --2- 172.21.15.104:0/2781486179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5d4003fe0 0x7fc5d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5ea7fc640 1 --2- 172.21.15.104:0/2781486179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d4004d40 0x7fc5d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec0d15c0 con 0x7fc5d4003fe0 2024-05-08T04:25:09.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d400ba70 con 0x7fc5d4004d40 2024-05-08T04:25:09.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d400bc40 con 0x7fc5ec15edf0 2024-05-08T04:25:09.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5eb7fe640 1 --2- 172.21.15.104:0/2781486179 >> v2:172.21.15.183:3300/0 conn(0x7fc5ec070c70 0x7fc5ec071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:09.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5eaffd640 1 --2- 172.21.15.104:0/2781486179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5d4003fe0 0x7fc5d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5eb7fe640 1 --2- 172.21.15.104:0/2781486179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec15edf0 0x7fc5d40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5ebfff640 1 --2- 172.21.15.104:0/2781486179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d4004d40 0x7fc5d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5eaffd640 1 -- 172.21.15.104:0/2781486179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec15edf0 msgr2=0x7fc5d40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5eaffd640 1 --2- 172.21.15.104:0/2781486179 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec15edf0 0x7fc5d40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5eaffd640 1 -- 172.21.15.104:0/2781486179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d4004d40 msgr2=0x7fc5d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5eaffd640 1 --2- 172.21.15.104:0/2781486179 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d4004d40 0x7fc5d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.470+0000 7fc5eaffd640 1 -- 172.21.15.104:0/2781486179 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d4003520 con 0x7fc5d4003fe0 2024-05-08T04:25:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.471+0000 7fc5eaffd640 1 --2- 172.21.15.104:0/2781486179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5d4003fe0 0x7fc5d4004800 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000ba00 tx=0x7fc5d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2558a61529418a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.471+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0030070 con 0x7fc5d4003fe0 2024-05-08T04:25:09.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.471+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e002adb0 con 0x7fc5d4003fe0 2024-05-08T04:25:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.471+0000 7fc5ea7fc640 1 -- 172.21.15.104:0/2781486179 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000b600 con 0x7fc5d4003fe0 2024-05-08T04:25:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.471+0000 7fc5f20b6640 1 -- 172.21.15.104:0/2781486179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5d4003fe0 msgr2=0x7fc5d4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.471+0000 7fc5f20b6640 1 --2- 172.21.15.104:0/2781486179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5d4003fe0 0x7fc5d4004800 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000ba00 tx=0x7fc5d4005830 comp rx=0 tx=0).stop 2024-05-08T04:25:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.471+0000 7fc5ebfff640 1 -- 172.21.15.104:0/2781486179 reap_dead start 2024-05-08T04:25:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.471+0000 7fc5f20b6640 1 -- 172.21.15.104:0/2781486179 shutdown_connections 2024-05-08T04:25:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.471+0000 7fc5f20b6640 1 -- 172.21.15.104:0/2781486179 >> 172.21.15.104:0/2781486179 conn(0x7fc5ec0b3450 msgr2=0x7fc5ec0b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.471+0000 7fc5f20b6640 1 -- 172.21.15.104:0/2781486179 shutdown_connections 2024-05-08T04:25:09.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.471+0000 7fc5f20b6640 1 -- 172.21.15.104:0/2781486179 wait complete. 2024-05-08T04:25:09.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.473+0000 7fc5f20b6640 1 Processor -- start 2024-05-08T04:25:09.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.473+0000 7fc5f20b6640 1 -- start start 2024-05-08T04:25:09.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.473+0000 7fc5f20b6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d4003fe0 0x7fc5ec0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.473+0000 7fc5f20b6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5ec15a170 0x7fc5ec15a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.473+0000 7fc5f20b6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec158100 0x7fc5ec1585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.473+0000 7fc5f20b6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec0b5b80 con 0x7fc5ec15a170 2024-05-08T04:25:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.473+0000 7fc5f20b6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec15fb10 con 0x7fc5d4003fe0 2024-05-08T04:25:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.473+0000 7fc5f20b6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec0b52a0 con 0x7fc5ec158100 2024-05-08T04:25:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5eaffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5ec15a170 0x7fc5ec15a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5eaffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5ec15a170 0x7fc5ec15a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38568/0 (socket says 172.21.15.104:38568) 2024-05-08T04:25:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5eaffd640 1 -- 172.21.15.104:0/327852726 learned_addr learned my addr 172.21.15.104:0/327852726 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:09.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5eb7fe640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d4003fe0 0x7fc5ec0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5ebfff640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec158100 0x7fc5ec1585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5eaffd640 1 -- 172.21.15.104:0/327852726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec158100 msgr2=0x7fc5ec1585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5eaffd640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec158100 0x7fc5ec1585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5eaffd640 1 -- 172.21.15.104:0/327852726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d4003fe0 msgr2=0x7fc5ec0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5eaffd640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d4003fe0 0x7fc5ec0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5eaffd640 1 -- 172.21.15.104:0/327852726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec159f10 con 0x7fc5ec15a170 2024-05-08T04:25:09.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5ebfff640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec158100 0x7fc5ec1585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:09.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5eaffd640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5ec15a170 0x7fc5ec15a5f0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000bb20 tx=0x7fc5e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5d3fff640 1 -- 172.21.15.104:0/327852726 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0043020 con 0x7fc5ec15a170 2024-05-08T04:25:09.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5d3fff640 1 -- 172.21.15.104:0/327852726 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e003f680 con 0x7fc5ec15a170 2024-05-08T04:25:09.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5f20b6640 1 -- 172.21.15.104:0/327852726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ec0cd860 con 0x7fc5ec15a170 2024-05-08T04:25:09.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5d3fff640 1 -- 172.21.15.104:0/327852726 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000b600 con 0x7fc5ec15a170 2024-05-08T04:25:09.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.474+0000 7fc5f20b6640 1 -- 172.21.15.104:0/327852726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ec159150 con 0x7fc5ec15a170 2024-05-08T04:25:09.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.475+0000 7fc5f20b6640 1 -- 172.21.15.104:0/327852726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ec075010 con 0x7fc5ec15a170 2024-05-08T04:25:09.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.476+0000 7fc5d3fff640 1 -- 172.21.15.104:0/327852726 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fc5e0046020 con 0x7fc5ec15a170 2024-05-08T04:25:09.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.476+0000 7fc5d3fff640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc5d806b740 0x7fc5d806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.476+0000 7fc5eb7fe640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc5d806b740 0x7fc5d806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.477+0000 7fc5d3fff640 1 -- 172.21.15.104:0/327852726 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc5e00aa990 con 0x7fc5ec15a170 2024-05-08T04:25:09.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.477+0000 7fc5eb7fe640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc5d806b740 0x7fc5d806dc00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0ce080 tx=0x7fc5dc003cd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.481+0000 7fc5d3fff640 1 -- 172.21.15.104:0/327852726 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc5e004d070 con 0x7fc5ec15a170 2024-05-08T04:25:09.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.652+0000 7fc5f20b6640 1 -- 172.21.15.104:0/327852726 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5ec0683d0 con 0x7fc5d806b740 2024-05-08T04:25:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.652+0000 7fc5d3fff640 1 -- 172.21.15.104:0/327852726 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc5dc0047b0 con 0x7fc5d806b740 2024-05-08T04:25:09.655 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T04:25:09.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.654+0000 7fc5f20b6640 1 -- 172.21.15.104:0/327852726 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc5d806b740 msgr2=0x7fc5d806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.654+0000 7fc5f20b6640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc5d806b740 0x7fc5d806dc00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0ce080 tx=0x7fc5dc003cd0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.654+0000 7fc5f20b6640 1 -- 172.21.15.104:0/327852726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5ec15a170 msgr2=0x7fc5ec15a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.654+0000 7fc5f20b6640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5ec15a170 0x7fc5ec15a5f0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000bb20 tx=0x7fc5e0004730 comp rx=0 tx=0).stop 2024-05-08T04:25:09.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.654+0000 7fc5f20b6640 1 -- 172.21.15.104:0/327852726 shutdown_connections 2024-05-08T04:25:09.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.654+0000 7fc5f20b6640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc5d806b740 0x7fc5d806dc00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.654+0000 7fc5f20b6640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5ec158100 0x7fc5ec1585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.654+0000 7fc5f20b6640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5ec15a170 0x7fc5ec15a5f0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.654+0000 7fc5f20b6640 1 --2- 172.21.15.104:0/327852726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d4003fe0 0x7fc5ec0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.654+0000 7fc5f20b6640 1 -- 172.21.15.104:0/327852726 >> 172.21.15.104:0/327852726 conn(0x7fc5ec0b3450 msgr2=0x7fc5ec156cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:09.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.654+0000 7fc5f20b6640 1 -- 172.21.15.104:0/327852726 shutdown_connections 2024-05-08T04:25:09.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.654+0000 7fc5f20b6640 1 -- 172.21.15.104:0/327852726 wait complete. 2024-05-08T04:25:09.667 INFO:tasks.ceph:Scrubbing osd.4 2024-05-08T04:25:09.667 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-08T04:25:09.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.769+0000 7fc9f8a5d640 1 Processor -- start 2024-05-08T04:25:09.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.769+0000 7fc9f8a5d640 1 -- start start 2024-05-08T04:25:09.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.770+0000 7fc9f8a5d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc9f415bac0 0x7fc9f40b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.770+0000 7fc9f8a5d640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc9f406ab60 0x7fc9f406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.770+0000 7fc9f8a5d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9f40cc3a0 0x7fc9f40cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.770+0000 7fc9f8a5d640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f40b1c00 con 0x7fc9f406ab60 2024-05-08T04:25:09.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.770+0000 7fc9f8a5d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f406b500 con 0x7fc9f415bac0 2024-05-08T04:25:09.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.770+0000 7fc9f8a5d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40b3d10 con 0x7fc9f40cc3a0 2024-05-08T04:25:09.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.770+0000 7fc9f1d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc9f406ab60 0x7fc9f406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.770+0000 7fc9f1d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fc9f406ab60 0x7fc9f406afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38570/0 (socket says 172.21.15.104:38570) 2024-05-08T04:25:09.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.770+0000 7fc9f1d9b640 1 -- 172.21.15.104:0/699588988 learned_addr learned my addr 172.21.15.104:0/699588988 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:09.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.770+0000 7fc9f2d9d640 1 --2- 172.21.15.104:0/699588988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9f40cc3a0 0x7fc9f40cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.771+0000 7fc9f259c640 1 --2- 172.21.15.104:0/699588988 >> v2:172.21.15.183:3300/0 conn(0x7fc9f415bac0 0x7fc9f40b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.771+0000 7fc9f1d9b640 1 -- 172.21.15.104:0/699588988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9f40cc3a0 msgr2=0x7fc9f40cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:09.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.771+0000 7fc9f1d9b640 1 --2- 172.21.15.104:0/699588988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9f40cc3a0 0x7fc9f40cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.771+0000 7fc9f1d9b640 1 -- 172.21.15.104:0/699588988 >> v2:172.21.15.183:3300/0 conn(0x7fc9f415bac0 msgr2=0x7fc9f40b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:09.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.771+0000 7fc9f1d9b640 1 --2- 172.21.15.104:0/699588988 >> v2:172.21.15.183:3300/0 conn(0x7fc9f415bac0 0x7fc9f40b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.771+0000 7fc9f1d9b640 1 -- 172.21.15.104:0/699588988 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f40b1e30 con 0x7fc9f406ab60 2024-05-08T04:25:09.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.771+0000 7fc9f259c640 1 --2- 172.21.15.104:0/699588988 >> v2:172.21.15.183:3300/0 conn(0x7fc9f415bac0 0x7fc9f40b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:09.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.771+0000 7fc9f1d9b640 1 --2- 172.21.15.104:0/699588988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9f406ab60 0x7fc9f406afc0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40d1770 tx=0x7fc9e802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152577aac9116fc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.771+0000 7fc9f159a640 1 -- 172.21.15.104:0/699588988 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8037070 con 0x7fc9f406ab60 2024-05-08T04:25:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.772+0000 7fc9f159a640 1 -- 172.21.15.104:0/699588988 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e8032440 con 0x7fc9f406ab60 2024-05-08T04:25:09.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.772+0000 7fc9f159a640 1 -- 172.21.15.104:0/699588988 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8032810 con 0x7fc9f406ab60 2024-05-08T04:25:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.772+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/699588988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9f406ab60 msgr2=0x7fc9f406afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.772+0000 7fc9f8a5d640 1 --2- 172.21.15.104:0/699588988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9f406ab60 0x7fc9f406afc0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40d1770 tx=0x7fc9e802a140 comp rx=0 tx=0).stop 2024-05-08T04:25:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.772+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/699588988 shutdown_connections 2024-05-08T04:25:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.772+0000 7fc9f8a5d640 1 --2- 172.21.15.104:0/699588988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9f40cc3a0 0x7fc9f40cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.772+0000 7fc9f8a5d640 1 --2- 172.21.15.104:0/699588988 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9f406ab60 0x7fc9f406afc0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.772+0000 7fc9f8a5d640 1 --2- 172.21.15.104:0/699588988 >> v2:172.21.15.183:3300/0 conn(0x7fc9f415bac0 0x7fc9f40b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.772+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/699588988 >> 172.21.15.104:0/699588988 conn(0x7fc9f40b2220 msgr2=0x7fc9f40b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:09.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.772+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/699588988 shutdown_connections 2024-05-08T04:25:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.772+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/699588988 wait complete. 2024-05-08T04:25:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.773+0000 7fc9f8a5d640 1 Processor -- start 2024-05-08T04:25:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.774+0000 7fc9f8a5d640 1 -- start start 2024-05-08T04:25:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.774+0000 7fc9f8a5d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9f406ab60 0x7fc9f41510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.774+0000 7fc9f8a5d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9f40cc3a0 0x7fc9f415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.774+0000 7fc9f8a5d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9f415bac0 0x7fc9f415ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.774+0000 7fc9f8a5d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40c3f00 con 0x7fc9f415bac0 2024-05-08T04:25:09.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.774+0000 7fc9f8a5d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40b39a0 con 0x7fc9f406ab60 2024-05-08T04:25:09.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.774+0000 7fc9f8a5d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f415bea0 con 0x7fc9f40cc3a0 2024-05-08T04:25:09.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.774+0000 7fc9f2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9f415bac0 0x7fc9f415ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.774+0000 7fc9f2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9f415bac0 0x7fc9f415ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38582/0 (socket says 172.21.15.104:38582) 2024-05-08T04:25:09.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.774+0000 7fc9f2d9d640 1 -- 172.21.15.104:0/221969767 learned_addr learned my addr 172.21.15.104:0/221969767 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:09.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.775+0000 7fc9f259c640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9f406ab60 0x7fc9f41510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.775+0000 7fc9f1d9b640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9f40cc3a0 0x7fc9f415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.775+0000 7fc9f2d9d640 1 -- 172.21.15.104:0/221969767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9f40cc3a0 msgr2=0x7fc9f415e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.775+0000 7fc9f2d9d640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9f40cc3a0 0x7fc9f415e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.775+0000 7fc9f2d9d640 1 -- 172.21.15.104:0/221969767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9f406ab60 msgr2=0x7fc9f41510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.775+0000 7fc9f2d9d640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9f406ab60 0x7fc9f41510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.775+0000 7fc9f2d9d640 1 -- 172.21.15.104:0/221969767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f40c4f00 con 0x7fc9f415bac0 2024-05-08T04:25:09.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.775+0000 7fc9f2d9d640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9f415bac0 0x7fc9f415ec20 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00ef00 tx=0x7fc9ec00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.775+0000 7fc9e2ffd640 1 -- 172.21.15.104:0/221969767 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec018020 con 0x7fc9f415bac0 2024-05-08T04:25:09.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.775+0000 7fc9e2ffd640 1 -- 172.21.15.104:0/221969767 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec014400 con 0x7fc9f415bac0 2024-05-08T04:25:09.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.775+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/221969767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f415c3f0 con 0x7fc9f415bac0 2024-05-08T04:25:09.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.775+0000 7fc9e2ffd640 1 -- 172.21.15.104:0/221969767 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0147f0 con 0x7fc9f415bac0 2024-05-08T04:25:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.775+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/221969767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f415c9b0 con 0x7fc9f415bac0 2024-05-08T04:25:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.776+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/221969767 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc9f4075010 con 0x7fc9f415bac0 2024-05-08T04:25:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.777+0000 7fc9e2ffd640 1 -- 172.21.15.104:0/221969767 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fc9ec005d10 con 0x7fc9f415bac0 2024-05-08T04:25:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.777+0000 7fc9e2ffd640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc9d406b740 0x7fc9d406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.777+0000 7fc9e2ffd640 1 -- 172.21.15.104:0/221969767 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc9ec08aa30 con 0x7fc9f415bac0 2024-05-08T04:25:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.777+0000 7fc9f259c640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc9d406b740 0x7fc9d406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.777+0000 7fc9e2ffd640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] conn(0x7fc9d4071600 0x7fc9d4073a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.777+0000 7fc9e2ffd640 1 -- 172.21.15.104:0/221969767 --> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9ec00fe50 con 0x7fc9d4071600 2024-05-08T04:25:09.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.777+0000 7fc9e2ffd640 1 -- 172.21.15.104:0/221969767 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9ec08f2a0 con 0x7fc9f415bac0 2024-05-08T04:25:09.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.777+0000 7fc9f1d9b640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] conn(0x7fc9d4071600 0x7fc9d4073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.778+0000 7fc9f259c640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc9d406b740 0x7fc9d406dc00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4006fd0 tx=0x7fc9e4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.778+0000 7fc9f1d9b640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] conn(0x7fc9d4071600 0x7fc9d4073a20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.779+0000 7fc9e2ffd640 1 -- 172.21.15.104:0/221969767 <== osd.4 v2:172.21.15.183:6800/3103695044 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc9ec00fe50 con 0x7fc9d4071600 2024-05-08T04:25:09.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.791+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/221969767 --> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc9f40d0fa0 con 0x7fc9d4071600 2024-05-08T04:25:09.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.792+0000 7fc9e2ffd640 1 -- 172.21.15.104:0/221969767 <== osd.4 v2:172.21.15.183:6800/3103695044 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc9f40d0fa0 con 0x7fc9d4071600 2024-05-08T04:25:09.794 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:25:09.795 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T04:25:09.795 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:25:09.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.792+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/221969767 >> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] conn(0x7fc9d4071600 msgr2=0x7fc9d4073a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.792+0000 7fc9f8a5d640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.183:6800/3103695044,v1:172.21.15.183:6801/3103695044] conn(0x7fc9d4071600 0x7fc9d4073a20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.793+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/221969767 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc9d406b740 msgr2=0x7fc9d406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.793+0000 7fc9f8a5d640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fc9d406b740 0x7fc9d406dc00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4006fd0 tx=0x7fc9e4008040 comp rx=0 tx=0).stop 2024-05-08T04:25:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.793+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/221969767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9f415bac0 msgr2=0x7fc9f415ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.793+0000 7fc9f8a5d640 1 --2- 172.21.15.104:0/221969767 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9f415bac0 0x7fc9f415ec20 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00ef00 tx=0x7fc9ec00b480 comp rx=0 tx=0).stop 2024-05-08T04:25:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.793+0000 7fc9f2d9d640 1 -- 172.21.15.104:0/221969767 reap_dead start 2024-05-08T04:25:09.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.793+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/221969767 shutdown_connections 2024-05-08T04:25:09.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.793+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/221969767 >> 172.21.15.104:0/221969767 conn(0x7fc9f40b2220 msgr2=0x7fc9f40b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:09.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.793+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/221969767 shutdown_connections 2024-05-08T04:25:09.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.793+0000 7fc9f8a5d640 1 -- 172.21.15.104:0/221969767 wait complete. 2024-05-08T04:25:09.805 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-08T04:25:09.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.905+0000 7f7418c9a640 1 Processor -- start 2024-05-08T04:25:09.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.905+0000 7f7418c9a640 1 -- start start 2024-05-08T04:25:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.905+0000 7f7418c9a640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f74140701a0 0x7f7414070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.906+0000 7f7418c9a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7414073030 con 0x7f7414158540 2024-05-08T04:25:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.906+0000 7f7418c9a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7414072210 con 0x7f74140cd120 2024-05-08T04:25:09.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.906+0000 7f7418c9a640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74140cbf50 con 0x7f74140701a0 2024-05-08T04:25:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.906+0000 7f7411d9b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f74140701a0 0x7f7414070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.906+0000 7f741259c640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f7414158540 0x7f741415e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42814/0 (socket says 172.21.15.104:42814) 2024-05-08T04:25:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.906+0000 7f741259c640 1 -- 172.21.15.104:0/3447101057 learned_addr learned my addr 172.21.15.104:0/3447101057 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.906+0000 7f7411d9b640 1 -- 172.21.15.104:0/3447101057 >> v1:172.21.15.183:6789/0 conn(0x7f74140cd120 legacy=0x7f74140cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.906+0000 7f7411d9b640 1 -- 172.21.15.104:0/3447101057 >> v1:172.21.15.104:6789/0 conn(0x7f7414158540 legacy=0x7f741415e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.906+0000 7f7411d9b640 1 -- 172.21.15.104:0/3447101057 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74140724b0 con 0x7f74140701a0 2024-05-08T04:25:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.907+0000 7f7411d9b640 1 --2- 172.21.15.104:0/3447101057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74140701a0 0x7f7414070600 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0097a0 tx=0x7f73fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d4d2d6356b2e3a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.907+0000 7f741159a640 1 -- 172.21.15.104:0/3447101057 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc037070 con 0x7f74140701a0 2024-05-08T04:25:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.907+0000 7f741159a640 1 -- 172.21.15.104:0/3447101057 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc032440 con 0x7f74140701a0 2024-05-08T04:25:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.907+0000 7f741159a640 1 -- 172.21.15.104:0/3447101057 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc032810 con 0x7f74140701a0 2024-05-08T04:25:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.907+0000 7f7418c9a640 1 -- 172.21.15.104:0/3447101057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74140701a0 msgr2=0x7f7414070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.907+0000 7f7418c9a640 1 --2- 172.21.15.104:0/3447101057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74140701a0 0x7f7414070600 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0097a0 tx=0x7f73fc02a1e0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.907+0000 7f7418c9a640 1 -- 172.21.15.104:0/3447101057 shutdown_connections 2024-05-08T04:25:09.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.907+0000 7f7418c9a640 1 --2- 172.21.15.104:0/3447101057 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74140701a0 0x7f7414070600 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.907+0000 7f7418c9a640 1 -- 172.21.15.104:0/3447101057 >> 172.21.15.104:0/3447101057 conn(0x7f74140b23e0 msgr2=0x7f74140b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:09.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.907+0000 7f7418c9a640 1 -- 172.21.15.104:0/3447101057 shutdown_connections 2024-05-08T04:25:09.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.907+0000 7f7418c9a640 1 -- 172.21.15.104:0/3447101057 wait complete. 2024-05-08T04:25:09.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.909+0000 7f7418c9a640 1 Processor -- start 2024-05-08T04:25:09.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.909+0000 7f7418c9a640 1 -- start start 2024-05-08T04:25:09.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.909+0000 7f7418c9a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74140701a0 0x7f74140b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.909+0000 7f7418c9a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74140cd120 0x7f74140c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.909+0000 7f7418c9a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7414158540 0x7f74140c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.909+0000 7f7418c9a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7414072d50 con 0x7f7414158540 2024-05-08T04:25:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.909+0000 7f7418c9a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7414072a70 con 0x7f74140701a0 2024-05-08T04:25:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.909+0000 7f7418c9a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74140cca90 con 0x7f74140cd120 2024-05-08T04:25:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f7412d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7414158540 0x7f74140c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f7412d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7414158540 0x7f74140c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38600/0 (socket says 172.21.15.104:38600) 2024-05-08T04:25:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f7412d9d640 1 -- 172.21.15.104:0/1698451933 learned_addr learned my addr 172.21.15.104:0/1698451933 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f741259c640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74140701a0 0x7f74140b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f7411d9b640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74140cd120 0x7f74140c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f7412d9d640 1 -- 172.21.15.104:0/1698451933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74140cd120 msgr2=0x7f74140c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f7412d9d640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74140cd120 0x7f74140c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f7412d9d640 1 -- 172.21.15.104:0/1698451933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74140701a0 msgr2=0x7f74140b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f7412d9d640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74140701a0 0x7f74140b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f7412d9d640 1 -- 172.21.15.104:0/1698451933 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74141f7310 con 0x7f7414158540 2024-05-08T04:25:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f7412d9d640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7414158540 0x7f74140c7650 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c780 tx=0x7f740c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f740affd640 1 -- 172.21.15.104:0/1698451933 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c017070 con 0x7f7414158540 2024-05-08T04:25:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f740affd640 1 -- 172.21.15.104:0/1698451933 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c003da0 con 0x7f7414158540 2024-05-08T04:25:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f740affd640 1 -- 172.21.15.104:0/1698451933 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c0052b0 con 0x7f7414158540 2024-05-08T04:25:09.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f7418c9a640 1 -- 172.21.15.104:0/1698451933 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74141f75f0 con 0x7f7414158540 2024-05-08T04:25:09.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.910+0000 7f7418c9a640 1 -- 172.21.15.104:0/1698451933 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74141f7bb0 con 0x7f7414158540 2024-05-08T04:25:09.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.911+0000 7f7418c9a640 1 -- 172.21.15.104:0/1698451933 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74141f7f90 con 0x7f7414158540 2024-05-08T04:25:09.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.912+0000 7f740affd640 1 -- 172.21.15.104:0/1698451933 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f740c01a070 con 0x7f7414158540 2024-05-08T04:25:09.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.912+0000 7f740affd640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f73f406b710 0x7f73f406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:09.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.912+0000 7f741259c640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f73f406b710 0x7f73f406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:09.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.912+0000 7f740affd640 1 -- 172.21.15.104:0/1698451933 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f740c089980 con 0x7f7414158540 2024-05-08T04:25:09.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.913+0000 7f741259c640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f73f406b710 0x7f73f406dbd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f74140b1ec0 tx=0x7f7404009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:09.917+0000 7f740affd640 1 -- 172.21.15.104:0/1698451933 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f74141f7f90 con 0x7f7414158540 2024-05-08T04:25:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.087+0000 7f7418c9a640 1 -- 172.21.15.104:0/1698451933 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7414075010 con 0x7f73f406b710 2024-05-08T04:25:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.087+0000 7f740affd640 1 -- 172.21.15.104:0/1698451933 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7414075010 con 0x7f73f406b710 2024-05-08T04:25:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 4 to deep-scrub 2024-05-08T04:25:10.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.089+0000 7f7418c9a640 1 -- 172.21.15.104:0/1698451933 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f73f406b710 msgr2=0x7f73f406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.089+0000 7f7418c9a640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f73f406b710 0x7f73f406dbd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f74140b1ec0 tx=0x7f7404009040 comp rx=0 tx=0).stop 2024-05-08T04:25:10.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.089+0000 7f7418c9a640 1 -- 172.21.15.104:0/1698451933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7414158540 msgr2=0x7f74140c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.089+0000 7f7418c9a640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7414158540 0x7f74140c7650 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c780 tx=0x7f740c00cc40 comp rx=0 tx=0).stop 2024-05-08T04:25:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.089+0000 7f7418c9a640 1 -- 172.21.15.104:0/1698451933 shutdown_connections 2024-05-08T04:25:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.089+0000 7f7418c9a640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f73f406b710 0x7f73f406dbd0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.089+0000 7f7418c9a640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7414158540 0x7f74140c7650 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.089+0000 7f7418c9a640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74140cd120 0x7f74140c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.089+0000 7f7418c9a640 1 --2- 172.21.15.104:0/1698451933 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74140701a0 0x7f74140b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.089+0000 7f7418c9a640 1 -- 172.21.15.104:0/1698451933 >> 172.21.15.104:0/1698451933 conn(0x7f74140b23e0 msgr2=0x7f74140cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.089+0000 7f7418c9a640 1 -- 172.21.15.104:0/1698451933 shutdown_connections 2024-05-08T04:25:10.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.089+0000 7f7418c9a640 1 -- 172.21.15.104:0/1698451933 wait complete. 2024-05-08T04:25:10.102 INFO:tasks.ceph:Scrubbing osd.5 2024-05-08T04:25:10.102 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-08T04:25:10.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.203+0000 7f2cdbc1f640 1 Processor -- start 2024-05-08T04:25:10.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.203+0000 7f2cdbc1f640 1 -- start start 2024-05-08T04:25:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.204+0000 7f2cdbc1f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2cd4161190 0x7f2cd4072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.204+0000 7f2cdbc1f640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd406de30 con 0x7f2cd4072a70 2024-05-08T04:25:10.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.204+0000 7f2cdbc1f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd406e110 con 0x7f2cd406bb70 2024-05-08T04:25:10.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.204+0000 7f2cdbc1f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd40b4db0 con 0x7f2cd4161190 2024-05-08T04:25:10.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.204+0000 7f2cd91ba640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f2cd4072a70 0x7f2cd40acdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42820/0 (socket says 172.21.15.104:42820) 2024-05-08T04:25:10.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.204+0000 7f2cd91ba640 1 -- 172.21.15.104:0/1480882024 learned_addr learned my addr 172.21.15.104:0/1480882024 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:10.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd99bb640 1 --2- 172.21.15.104:0/1480882024 >> v2:172.21.15.183:3300/0 conn(0x7f2cd4161190 0x7f2cd4072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968819102 0 0) 0x7f2cd406de30 con 0x7f2cd4072a70 2024-05-08T04:25:10.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc0003520 con 0x7f2cd4072a70 2024-05-08T04:25:10.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2948011661 0 0) 0x7f2cc0003520 con 0x7f2cd4072a70 2024-05-08T04:25:10.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 >> v2:172.21.15.183:3300/0 conn(0x7f2cd4161190 msgr2=0x7f2cd4072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:10.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 --2- 172.21.15.104:0/1480882024 >> v2:172.21.15.183:3300/0 conn(0x7f2cd4161190 0x7f2cd4072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 >> v1:172.21.15.183:6789/0 conn(0x7f2cd406bb70 legacy=0x7f2cd406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd406e3f0 con 0x7f2cd4072a70 2024-05-08T04:25:10.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f2cc4001670 con 0x7f2cd4072a70 2024-05-08T04:25:10.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 >> v1:172.21.15.104:6789/0 conn(0x7f2cd4072a70 legacy=0x7f2cd40acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 --2- 172.21.15.104:0/1480882024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cc00039b0 0x7f2cc0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 --2- 172.21.15.104:0/1480882024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cc0004800 0x7f2cc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 --2- 172.21.15.104:0/1480882024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cc00051c0 0x7f2cc000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc000c030 con 0x7f2cc0004800 2024-05-08T04:25:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc000c1e0 con 0x7f2cc00039b0 2024-05-08T04:25:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc000c3e0 con 0x7f2cc00051c0 2024-05-08T04:25:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd91ba640 1 --2- 172.21.15.104:0/1480882024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cc0004800 0x7f2cc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd99bb640 1 --2- 172.21.15.104:0/1480882024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cc00039b0 0x7f2cc0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cda1bc640 1 --2- 172.21.15.104:0/1480882024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cc00051c0 0x7f2cc000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd91ba640 1 -- 172.21.15.104:0/1480882024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cc00051c0 msgr2=0x7f2cc000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd91ba640 1 --2- 172.21.15.104:0/1480882024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cc00051c0 0x7f2cc000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd91ba640 1 -- 172.21.15.104:0/1480882024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cc00039b0 msgr2=0x7f2cc0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd91ba640 1 --2- 172.21.15.104:0/1480882024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cc00039b0 0x7f2cc0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd91ba640 1 -- 172.21.15.104:0/1480882024 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0003520 con 0x7f2cc0004800 2024-05-08T04:25:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cda1bc640 1 -- 172.21.15.104:0/1480882024 reap_dead start 2024-05-08T04:25:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.205+0000 7f2cd99bb640 1 --2- 172.21.15.104:0/1480882024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cc00039b0 0x7f2cc0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.206+0000 7f2cd91ba640 1 --2- 172.21.15.104:0/1480882024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cc0004800 0x7f2cc0004c80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400c240 tx=0x7f2cc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26165647f09c732e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.206+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4007cf0 con 0x7f2cc0004800 2024-05-08T04:25:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.206+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc40058d0 con 0x7f2cc0004800 2024-05-08T04:25:10.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.206+0000 7f2cd89b9640 1 -- 172.21.15.104:0/1480882024 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4005d20 con 0x7f2cc0004800 2024-05-08T04:25:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.207+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1480882024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cc0004800 msgr2=0x7f2cc0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.207+0000 7f2cdbc1f640 1 --2- 172.21.15.104:0/1480882024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cc0004800 0x7f2cc0004c80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400c240 tx=0x7f2cc0005830 comp rx=0 tx=0).stop 2024-05-08T04:25:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.207+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1480882024 shutdown_connections 2024-05-08T04:25:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.207+0000 7f2cdbc1f640 1 --2- 172.21.15.104:0/1480882024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cc0004800 0x7f2cc0004c80 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.207+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1480882024 >> 172.21.15.104:0/1480882024 conn(0x7f2cd4071a10 msgr2=0x7f2cd4071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.207+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1480882024 shutdown_connections 2024-05-08T04:25:10.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.207+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1480882024 wait complete. 2024-05-08T04:25:10.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.208+0000 7f2cdbc1f640 1 Processor -- start 2024-05-08T04:25:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.208+0000 7f2cdbc1f640 1 -- start start 2024-05-08T04:25:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cdbc1f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cc0004800 0x7f2cd4149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cdbc1f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cd414a2b0 0x7f2cd40c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cdbc1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cd414b8c0 0x7f2cd414bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cdbc1f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd406da70 con 0x7f2cd414b8c0 2024-05-08T04:25:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cdbc1f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd406e9b0 con 0x7f2cd414a2b0 2024-05-08T04:25:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cdbc1f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd406dbf0 con 0x7f2cc0004800 2024-05-08T04:25:10.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cda1bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cd414b8c0 0x7f2cd414bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cda1bc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cd414b8c0 0x7f2cd414bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38624/0 (socket says 172.21.15.104:38624) 2024-05-08T04:25:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cda1bc640 1 -- 172.21.15.104:0/1214819449 learned_addr learned my addr 172.21.15.104:0/1214819449 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cda1bc640 1 -- 172.21.15.104:0/1214819449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cc0004800 msgr2=0x7f2cd4149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cda1bc640 1 --2- 172.21.15.104:0/1214819449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cc0004800 0x7f2cd4149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cda1bc640 1 -- 172.21.15.104:0/1214819449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cd414a2b0 msgr2=0x7f2cd40c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cda1bc640 1 --2- 172.21.15.104:0/1214819449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cd414a2b0 0x7f2cd40c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cda1bc640 1 -- 172.21.15.104:0/1214819449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd4149fa0 con 0x7f2cd414b8c0 2024-05-08T04:25:10.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cda1bc640 1 --2- 172.21.15.104:0/1214819449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cd414b8c0 0x7f2cd414bd40 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40b5380 tx=0x7f2ccc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cca7fc640 1 -- 172.21.15.104:0/1214819449 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc003970 con 0x7f2cd414b8c0 2024-05-08T04:25:10.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cca7fc640 1 -- 172.21.15.104:0/1214819449 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc018070 con 0x7f2cd414b8c0 2024-05-08T04:25:10.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1214819449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd414a820 con 0x7f2cd414b8c0 2024-05-08T04:25:10.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cca7fc640 1 -- 172.21.15.104:0/1214819449 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc003d70 con 0x7f2cd414b8c0 2024-05-08T04:25:10.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.209+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1214819449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd414ade0 con 0x7f2cd414b8c0 2024-05-08T04:25:10.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.210+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1214819449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2cd4075010 con 0x7f2cd414b8c0 2024-05-08T04:25:10.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.211+0000 7f2cca7fc640 1 -- 172.21.15.104:0/1214819449 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f2ccc0050d0 con 0x7f2cd414b8c0 2024-05-08T04:25:10.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.211+0000 7f2cca7fc640 1 --2- 172.21.15.104:0/1214819449 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2cb806b740 0x7f2cb806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.211+0000 7f2cca7fc640 1 -- 172.21.15.104:0/1214819449 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2ccc089ef0 con 0x7f2cd414b8c0 2024-05-08T04:25:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.211+0000 7f2cd99bb640 1 --2- 172.21.15.104:0/1214819449 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2cb806b740 0x7f2cb806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.211+0000 7f2cca7fc640 1 --2- 172.21.15.104:0/1214819449 >> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] conn(0x7f2cb8071600 0x7f2cb8073a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.211+0000 7f2cca7fc640 1 -- 172.21.15.104:0/1214819449 --> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ccc0079b0 con 0x7f2cb8071600 2024-05-08T04:25:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.211+0000 7f2cca7fc640 1 -- 172.21.15.104:0/1214819449 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ccc08c5b0 con 0x7f2cd414b8c0 2024-05-08T04:25:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.212+0000 7f2cd99bb640 1 --2- 172.21.15.104:0/1214819449 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2cb806b740 0x7f2cb806dc00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4050700 tx=0x7f2cd0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.212+0000 7f2cd91ba640 1 --2- 172.21.15.104:0/1214819449 >> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] conn(0x7f2cb8071600 0x7f2cb8073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.212+0000 7f2cd91ba640 1 --2- 172.21.15.104:0/1214819449 >> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] conn(0x7f2cb8071600 0x7f2cb8073a20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.213+0000 7f2cca7fc640 1 -- 172.21.15.104:0/1214819449 <== osd.5 v2:172.21.15.183:6808/1596442327 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2ccc0079b0 con 0x7f2cb8071600 2024-05-08T04:25:10.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.226+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1214819449 --> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2cd40b3670 con 0x7f2cb8071600 2024-05-08T04:25:10.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.227+0000 7f2cca7fc640 1 -- 172.21.15.104:0/1214819449 <== osd.5 v2:172.21.15.183:6808/1596442327 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2cd40b3670 con 0x7f2cb8071600 2024-05-08T04:25:10.229 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:25:10.229 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T04:25:10.229 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:25:10.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.227+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1214819449 >> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] conn(0x7f2cb8071600 msgr2=0x7f2cb8073a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.227+0000 7f2cdbc1f640 1 --2- 172.21.15.104:0/1214819449 >> [v2:172.21.15.183:6808/1596442327,v1:172.21.15.183:6809/1596442327] conn(0x7f2cb8071600 0x7f2cb8073a20 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.227+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1214819449 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2cb806b740 msgr2=0x7f2cb806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.227+0000 7f2cdbc1f640 1 --2- 172.21.15.104:0/1214819449 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f2cb806b740 0x7f2cb806dc00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4050700 tx=0x7f2cd0008040 comp rx=0 tx=0).stop 2024-05-08T04:25:10.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.227+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1214819449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cd414b8c0 msgr2=0x7f2cd414bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.227+0000 7f2cdbc1f640 1 --2- 172.21.15.104:0/1214819449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cd414b8c0 0x7f2cd414bd40 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40b5380 tx=0x7f2ccc00ec10 comp rx=0 tx=0).stop 2024-05-08T04:25:10.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.227+0000 7f2cda1bc640 1 -- 172.21.15.104:0/1214819449 reap_dead start 2024-05-08T04:25:10.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.227+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1214819449 shutdown_connections 2024-05-08T04:25:10.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.227+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1214819449 >> 172.21.15.104:0/1214819449 conn(0x7f2cd4071a10 msgr2=0x7f2cd40b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:10.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.227+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1214819449 shutdown_connections 2024-05-08T04:25:10.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.227+0000 7f2cdbc1f640 1 -- 172.21.15.104:0/1214819449 wait complete. 2024-05-08T04:25:10.240 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-08T04:25:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.338+0000 7f699373b640 1 Processor -- start 2024-05-08T04:25:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.338+0000 7f699373b640 1 -- start start 2024-05-08T04:25:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.338+0000 7f699373b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f698c0ce5a0 0x7f698c161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.338+0000 7f699373b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f698c0d07c0 0x7f698c0d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.338+0000 7f699373b640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698c15e1f0 con 0x7f698c15de10 2024-05-08T04:25:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.338+0000 7f699373b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698c0d0f50 con 0x7f698c0d07c0 2024-05-08T04:25:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.338+0000 7f699373b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c161e60 con 0x7f698c0ce5a0 2024-05-08T04:25:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f69914d7640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f698c15de10 0x7f698c0d00b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42830/0 (socket says 172.21.15.104:42830) 2024-05-08T04:25:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f69914d7640 1 -- 172.21.15.104:0/2052961061 learned_addr learned my addr 172.21.15.104:0/2052961061 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:10.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478155289 0 0) 0x7f698c15e1f0 con 0x7f698c15de10 2024-05-08T04:25:10.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6974003520 con 0x7f698c15de10 2024-05-08T04:25:10.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f6991cd8640 1 --2- 172.21.15.104:0/2052961061 >> v2:172.21.15.183:3300/0 conn(0x7f698c0d07c0 0x7f698c0d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f6990cd6640 1 --2- 172.21.15.104:0/2052961061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f698c0ce5a0 0x7f698c161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1743293733 0 0) 0x7f6974003520 con 0x7f698c15de10 2024-05-08T04:25:10.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f698c0ce5a0 msgr2=0x7f698c161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:10.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 --2- 172.21.15.104:0/2052961061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f698c0ce5a0 0x7f698c161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 >> v2:172.21.15.183:3300/0 conn(0x7f698c0d07c0 msgr2=0x7f698c0d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:10.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 --2- 172.21.15.104:0/2052961061 >> v2:172.21.15.183:3300/0 conn(0x7f698c0d07c0 0x7f698c0d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c162090 con 0x7f698c15de10 2024-05-08T04:25:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f6984001670 con 0x7f698c15de10 2024-05-08T04:25:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 >> v1:172.21.15.104:6789/0 conn(0x7f698c15de10 legacy=0x7f698c0d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 --2- 172.21.15.104:0/2052961061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69740039b0 0x7f6974003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 --2- 172.21.15.104:0/2052961061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6974004800 0x7f6974004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 --2- 172.21.15.104:0/2052961061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f698c0ce5a0 0x7f69740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c0d0f50 con 0x7f69740039b0 2024-05-08T04:25:10.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697400baa0 con 0x7f6974004800 2024-05-08T04:25:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697400bca0 con 0x7f698c0ce5a0 2024-05-08T04:25:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f69914d7640 1 --2- 172.21.15.104:0/2052961061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69740039b0 0x7f6974003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f69914d7640 1 -- 172.21.15.104:0/2052961061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f698c0ce5a0 msgr2=0x7f69740051c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T04:25:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f69914d7640 1 --2- 172.21.15.104:0/2052961061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f698c0ce5a0 0x7f69740051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f69914d7640 1 -- 172.21.15.104:0/2052961061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6974004800 msgr2=0x7f6974004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T04:25:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f69914d7640 1 --2- 172.21.15.104:0/2052961061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6974004800 0x7f6974004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.339+0000 7f69914d7640 1 -- 172.21.15.104:0/2052961061 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6974003520 con 0x7f69740039b0 2024-05-08T04:25:10.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.340+0000 7f69914d7640 1 --2- 172.21.15.104:0/2052961061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69740039b0 0x7f6974003dd0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6984001eb0 tx=0x7f6974005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40d208543727cf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.340+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984007d70 con 0x7f69740039b0 2024-05-08T04:25:10.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.340+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69840058d0 con 0x7f69740039b0 2024-05-08T04:25:10.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.340+0000 7f698bfff640 1 -- 172.21.15.104:0/2052961061 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984005ca0 con 0x7f69740039b0 2024-05-08T04:25:10.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.341+0000 7f699373b640 1 -- 172.21.15.104:0/2052961061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69740039b0 msgr2=0x7f6974003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.341+0000 7f699373b640 1 --2- 172.21.15.104:0/2052961061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69740039b0 0x7f6974003dd0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6984001eb0 tx=0x7f6974005830 comp rx=0 tx=0).stop 2024-05-08T04:25:10.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.341+0000 7f6991cd8640 1 -- 172.21.15.104:0/2052961061 reap_dead start 2024-05-08T04:25:10.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.341+0000 7f699373b640 1 -- 172.21.15.104:0/2052961061 shutdown_connections 2024-05-08T04:25:10.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.341+0000 7f699373b640 1 -- 172.21.15.104:0/2052961061 >> 172.21.15.104:0/2052961061 conn(0x7f698c072290 msgr2=0x7f698c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:10.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.341+0000 7f699373b640 1 -- 172.21.15.104:0/2052961061 shutdown_connections 2024-05-08T04:25:10.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.341+0000 7f699373b640 1 -- 172.21.15.104:0/2052961061 wait complete. 2024-05-08T04:25:10.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.342+0000 7f699373b640 1 Processor -- start 2024-05-08T04:25:10.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.342+0000 7f699373b640 1 -- start start 2024-05-08T04:25:10.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f699373b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69740039b0 0x7f698c0cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f699373b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f698c0cd0c0 0x7f698c0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f699373b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f698c0b47b0 0x7f698c0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f699373b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c162650 con 0x7f69740039b0 2024-05-08T04:25:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f699373b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c0d1a90 con 0x7f698c0cd0c0 2024-05-08T04:25:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f699373b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c0d1ce0 con 0x7f698c0b47b0 2024-05-08T04:25:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f69914d7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69740039b0 0x7f698c0cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f69914d7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69740039b0 0x7f698c0cb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38634/0 (socket says 172.21.15.104:38634) 2024-05-08T04:25:10.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f69914d7640 1 -- 172.21.15.104:0/799481869 learned_addr learned my addr 172.21.15.104:0/799481869 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f69914d7640 1 -- 172.21.15.104:0/799481869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f698c0b47b0 msgr2=0x7f698c0b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f69914d7640 1 --2- 172.21.15.104:0/799481869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f698c0b47b0 0x7f698c0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f69914d7640 1 -- 172.21.15.104:0/799481869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f698c0cd0c0 msgr2=0x7f698c0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f69914d7640 1 --2- 172.21.15.104:0/799481869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f698c0cd0c0 0x7f698c0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f69914d7640 1 -- 172.21.15.104:0/799481869 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c0b5170 con 0x7f69740039b0 2024-05-08T04:25:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f69914d7640 1 --2- 172.21.15.104:0/799481869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69740039b0 0x7f698c0cb500 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f698402adf0 tx=0x7f6984000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.343+0000 7f6989ffb640 1 -- 172.21.15.104:0/799481869 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984007d50 con 0x7f69740039b0 2024-05-08T04:25:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.344+0000 7f6989ffb640 1 -- 172.21.15.104:0/799481869 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6984043070 con 0x7f69740039b0 2024-05-08T04:25:10.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.344+0000 7f6989ffb640 1 -- 172.21.15.104:0/799481869 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698403e420 con 0x7f69740039b0 2024-05-08T04:25:10.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.344+0000 7f699373b640 1 -- 172.21.15.104:0/799481869 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698c0cbb70 con 0x7f69740039b0 2024-05-08T04:25:10.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.344+0000 7f699373b640 1 -- 172.21.15.104:0/799481869 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c0cc130 con 0x7f69740039b0 2024-05-08T04:25:10.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.345+0000 7f699373b640 1 -- 172.21.15.104:0/799481869 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698c075010 con 0x7f69740039b0 2024-05-08T04:25:10.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.345+0000 7f6989ffb640 1 -- 172.21.15.104:0/799481869 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f698403e5c0 con 0x7f69740039b0 2024-05-08T04:25:10.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.345+0000 7f6989ffb640 1 --2- 172.21.15.104:0/799481869 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f697806b740 0x7f697806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.346+0000 7f6990cd6640 1 --2- 172.21.15.104:0/799481869 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f697806b740 0x7f697806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.346+0000 7f6989ffb640 1 -- 172.21.15.104:0/799481869 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f69840aab70 con 0x7f69740039b0 2024-05-08T04:25:10.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.346+0000 7f6990cd6640 1 --2- 172.21.15.104:0/799481869 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f697806b740 0x7f697806dc00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f698c0b6560 tx=0x7f6980008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.350+0000 7f6989ffb640 1 -- 172.21.15.104:0/799481869 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6984079a00 con 0x7f69740039b0 2024-05-08T04:25:10.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.520+0000 7f699373b640 1 -- 172.21.15.104:0/799481869 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f698c15a260 con 0x7f697806b740 2024-05-08T04:25:10.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.520+0000 7f6989ffb640 1 -- 172.21.15.104:0/799481869 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f698c15a260 con 0x7f697806b740 2024-05-08T04:25:10.521 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 5 to deep-scrub 2024-05-08T04:25:10.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.522+0000 7f699373b640 1 -- 172.21.15.104:0/799481869 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f697806b740 msgr2=0x7f697806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.522+0000 7f699373b640 1 --2- 172.21.15.104:0/799481869 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f697806b740 0x7f697806dc00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f698c0b6560 tx=0x7f6980008040 comp rx=0 tx=0).stop 2024-05-08T04:25:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.522+0000 7f699373b640 1 -- 172.21.15.104:0/799481869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69740039b0 msgr2=0x7f698c0cb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.522+0000 7f699373b640 1 --2- 172.21.15.104:0/799481869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69740039b0 0x7f698c0cb500 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f698402adf0 tx=0x7f6984000fe0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.522+0000 7f699373b640 1 -- 172.21.15.104:0/799481869 shutdown_connections 2024-05-08T04:25:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.522+0000 7f699373b640 1 --2- 172.21.15.104:0/799481869 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f697806b740 0x7f697806dc00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.522+0000 7f699373b640 1 --2- 172.21.15.104:0/799481869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f698c0cd0c0 0x7f698c0b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.522+0000 7f699373b640 1 --2- 172.21.15.104:0/799481869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f698c0b47b0 0x7f698c0b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.522+0000 7f699373b640 1 --2- 172.21.15.104:0/799481869 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69740039b0 0x7f698c0cb500 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.522+0000 7f699373b640 1 -- 172.21.15.104:0/799481869 >> 172.21.15.104:0/799481869 conn(0x7f698c072290 msgr2=0x7f698c0cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:10.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.522+0000 7f699373b640 1 -- 172.21.15.104:0/799481869 shutdown_connections 2024-05-08T04:25:10.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.522+0000 7f699373b640 1 -- 172.21.15.104:0/799481869 wait complete. 2024-05-08T04:25:10.534 INFO:tasks.ceph:Scrubbing osd.6 2024-05-08T04:25:10.534 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-08T04:25:10.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.636+0000 7fe2b81e0640 1 Processor -- start 2024-05-08T04:25:10.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.637+0000 7fe2b81e0640 1 -- start start 2024-05-08T04:25:10.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.637+0000 7fe2b81e0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe2b0158540 0x7fe2b015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.637+0000 7fe2b81e0640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe2b00701a0 0x7fe2b0070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.637+0000 7fe2b81e0640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b0073030 con 0x7fe2b00cd120 2024-05-08T04:25:10.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.638+0000 7fe2b81e0640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b00cbf50 con 0x7fe2b00701a0 2024-05-08T04:25:10.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.638+0000 7fe2b81e0640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b0072210 con 0x7fe2b0158540 2024-05-08T04:25:10.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.638+0000 7fe2b577b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe2b00701a0 0x7fe2b0070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.638+0000 7fe2b577b640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fe2b00701a0 0x7fe2b0070600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38636/0 (socket says 172.21.15.104:38636) 2024-05-08T04:25:10.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.638+0000 7fe2b677d640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7fe2b00cd120 0x7fe2b00cc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42840/0 (socket says 172.21.15.104:42840) 2024-05-08T04:25:10.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.638+0000 7fe2b577b640 1 -- 172.21.15.104:0/622872078 learned_addr learned my addr 172.21.15.104:0/622872078 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:10.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.638+0000 7fe2b577b640 1 -- 172.21.15.104:0/622872078 >> v2:172.21.15.183:3300/0 conn(0x7fe2b0158540 msgr2=0x7fe2b015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:10.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.638+0000 7fe2b577b640 1 --2- 172.21.15.104:0/622872078 >> v2:172.21.15.183:3300/0 conn(0x7fe2b0158540 0x7fe2b015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.638+0000 7fe2b577b640 1 -- 172.21.15.104:0/622872078 >> v1:172.21.15.104:6789/0 conn(0x7fe2b00cd120 legacy=0x7fe2b00cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.638+0000 7fe2b577b640 1 -- 172.21.15.104:0/622872078 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b015e900 con 0x7fe2b00701a0 2024-05-08T04:25:10.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.638+0000 7fe2b4f7a640 1 -- 172.21.15.104:0/622872078 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788571624 0 0) 0x7fe2b0073030 con 0x7fe2b00cd120 2024-05-08T04:25:10.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.639+0000 7fe2b577b640 1 --2- 172.21.15.104:0/622872078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b00701a0 0x7fe2b0070600 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00b01a0 tx=0x7fe2ac02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef91f4d2f0878cc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.639+0000 7fe2b4f7a640 1 -- 172.21.15.104:0/622872078 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac036020 con 0x7fe2b00701a0 2024-05-08T04:25:10.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.639+0000 7fe2b4f7a640 1 -- 172.21.15.104:0/622872078 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac032640 con 0x7fe2b00701a0 2024-05-08T04:25:10.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.639+0000 7fe2b4f7a640 1 -- 172.21.15.104:0/622872078 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac032a10 con 0x7fe2b00701a0 2024-05-08T04:25:10.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.639+0000 7fe2b81e0640 1 -- 172.21.15.104:0/622872078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b00701a0 msgr2=0x7fe2b0070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.639+0000 7fe2b81e0640 1 --2- 172.21.15.104:0/622872078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b00701a0 0x7fe2b0070600 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00b01a0 tx=0x7fe2ac02c940 comp rx=0 tx=0).stop 2024-05-08T04:25:10.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.639+0000 7fe2b81e0640 1 -- 172.21.15.104:0/622872078 shutdown_connections 2024-05-08T04:25:10.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.639+0000 7fe2b81e0640 1 --2- 172.21.15.104:0/622872078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b00701a0 0x7fe2b0070600 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.639+0000 7fe2b81e0640 1 --2- 172.21.15.104:0/622872078 >> v2:172.21.15.183:3300/0 conn(0x7fe2b0158540 0x7fe2b015e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.639+0000 7fe2b81e0640 1 -- 172.21.15.104:0/622872078 >> 172.21.15.104:0/622872078 conn(0x7fe2b00b23e0 msgr2=0x7fe2b00b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:10.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.639+0000 7fe2b81e0640 1 -- 172.21.15.104:0/622872078 shutdown_connections 2024-05-08T04:25:10.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.639+0000 7fe2b81e0640 1 -- 172.21.15.104:0/622872078 wait complete. 2024-05-08T04:25:10.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.641+0000 7fe2b81e0640 1 Processor -- start 2024-05-08T04:25:10.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.641+0000 7fe2b81e0640 1 -- start start 2024-05-08T04:25:10.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.641+0000 7fe2b81e0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2b00701a0 0x7fe2b015add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.641+0000 7fe2b81e0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b00cd120 0x7fe2b014e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.641+0000 7fe2b81e0640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2b0158540 0x7fe2b00c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.641+0000 7fe2b81e0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b0072a70 con 0x7fe2b00cd120 2024-05-08T04:25:10.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.641+0000 7fe2b81e0640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b0072790 con 0x7fe2b0158540 2024-05-08T04:25:10.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.641+0000 7fe2b81e0640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b0072d50 con 0x7fe2b00701a0 2024-05-08T04:25:10.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.641+0000 7fe2b577b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b00cd120 0x7fe2b014e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.641+0000 7fe2b577b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b00cd120 0x7fe2b014e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38638/0 (socket says 172.21.15.104:38638) 2024-05-08T04:25:10.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.641+0000 7fe2b577b640 1 -- 172.21.15.104:0/3066337251 learned_addr learned my addr 172.21.15.104:0/3066337251 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:10.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2b677d640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2b0158540 0x7fe2b00c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2b5f7c640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2b00701a0 0x7fe2b015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2b577b640 1 -- 172.21.15.104:0/3066337251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2b00701a0 msgr2=0x7fe2b015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2b577b640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2b00701a0 0x7fe2b015add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2b577b640 1 -- 172.21.15.104:0/3066337251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2b0158540 msgr2=0x7fe2b00c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2b577b640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2b0158540 0x7fe2b00c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2b577b640 1 -- 172.21.15.104:0/3066337251 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b015b3b0 con 0x7fe2b00cd120 2024-05-08T04:25:10.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2b677d640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2b0158540 0x7fe2b00c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:10.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2b5f7c640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2b00701a0 0x7fe2b015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:10.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2b577b640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b00cd120 0x7fe2b014e310 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00bc00 tx=0x7fe2ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2a27fc640 1 -- 172.21.15.104:0/3066337251 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac042070 con 0x7fe2b00cd120 2024-05-08T04:25:10.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2a27fc640 1 -- 172.21.15.104:0/3066337251 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac03bd90 con 0x7fe2b00cd120 2024-05-08T04:25:10.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2a27fc640 1 -- 172.21.15.104:0/3066337251 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac004270 con 0x7fe2b00cd120 2024-05-08T04:25:10.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2b81e0640 1 -- 172.21.15.104:0/3066337251 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b015b690 con 0x7fe2b00cd120 2024-05-08T04:25:10.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.642+0000 7fe2b81e0640 1 -- 172.21.15.104:0/3066337251 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b015bc50 con 0x7fe2b00cd120 2024-05-08T04:25:10.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.643+0000 7fe2b81e0640 1 -- 172.21.15.104:0/3066337251 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2b0075010 con 0x7fe2b00cd120 2024-05-08T04:25:10.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.643+0000 7fe2a27fc640 1 -- 172.21.15.104:0/3066337251 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fe2ac039020 con 0x7fe2b00cd120 2024-05-08T04:25:10.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.644+0000 7fe2a27fc640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe29406b710 0x7fe29406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.644+0000 7fe2a27fc640 1 -- 172.21.15.104:0/3066337251 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe2ac0ab230 con 0x7fe2b00cd120 2024-05-08T04:25:10.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.644+0000 7fe2b5f7c640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe29406b710 0x7fe29406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.644+0000 7fe2a27fc640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] conn(0x7fe2940715d0 0x7fe2940739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.644+0000 7fe2a27fc640 1 -- 172.21.15.104:0/3066337251 --> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2ac032640 con 0x7fe2940715d0 2024-05-08T04:25:10.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.644+0000 7fe2a27fc640 1 -- 172.21.15.104:0/3066337251 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2ac0b2050 con 0x7fe2b00cd120 2024-05-08T04:25:10.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.644+0000 7fe2b5f7c640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe29406b710 0x7fe29406dbd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400a870 tx=0x7fe2a4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.644+0000 7fe2b677d640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] conn(0x7fe2940715d0 0x7fe2940739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.645+0000 7fe2b677d640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] conn(0x7fe2940715d0 0x7fe2940739f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.646+0000 7fe2a27fc640 1 -- 172.21.15.104:0/3066337251 <== osd.6 v2:172.21.15.183:6824/1610978569 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe2ac032640 con 0x7fe2940715d0 2024-05-08T04:25:10.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.658+0000 7fe2b81e0640 1 -- 172.21.15.104:0/3066337251 --> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe2b015c210 con 0x7fe2940715d0 2024-05-08T04:25:10.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.659+0000 7fe2a27fc640 1 -- 172.21.15.104:0/3066337251 <== osd.6 v2:172.21.15.183:6824/1610978569 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe2b015c210 con 0x7fe2940715d0 2024-05-08T04:25:10.660 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:25:10.660 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T04:25:10.660 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:25:10.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.659+0000 7fe2b81e0640 1 -- 172.21.15.104:0/3066337251 >> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] conn(0x7fe2940715d0 msgr2=0x7fe2940739f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.659+0000 7fe2b81e0640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.183:6824/1610978569,v1:172.21.15.183:6825/1610978569] conn(0x7fe2940715d0 0x7fe2940739f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.659+0000 7fe2b81e0640 1 -- 172.21.15.104:0/3066337251 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe29406b710 msgr2=0x7fe29406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.659+0000 7fe2b81e0640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fe29406b710 0x7fe29406dbd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400a870 tx=0x7fe2a4008040 comp rx=0 tx=0).stop 2024-05-08T04:25:10.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.659+0000 7fe2b81e0640 1 -- 172.21.15.104:0/3066337251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b00cd120 msgr2=0x7fe2b014e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.659+0000 7fe2b81e0640 1 --2- 172.21.15.104:0/3066337251 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe2b00cd120 0x7fe2b014e310 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00bc00 tx=0x7fe2ac004730 comp rx=0 tx=0).stop 2024-05-08T04:25:10.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.659+0000 7fe2b677d640 1 -- 172.21.15.104:0/3066337251 reap_dead start 2024-05-08T04:25:10.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.659+0000 7fe2b81e0640 1 -- 172.21.15.104:0/3066337251 shutdown_connections 2024-05-08T04:25:10.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.659+0000 7fe2b81e0640 1 -- 172.21.15.104:0/3066337251 >> 172.21.15.104:0/3066337251 conn(0x7fe2b00b23e0 msgr2=0x7fe2b00ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:10.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.660+0000 7fe2b81e0640 1 -- 172.21.15.104:0/3066337251 shutdown_connections 2024-05-08T04:25:10.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.660+0000 7fe2b81e0640 1 -- 172.21.15.104:0/3066337251 wait complete. 2024-05-08T04:25:10.671 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-08T04:25:10.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.772+0000 7f7f16437640 1 Processor -- start 2024-05-08T04:25:10.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.772+0000 7f7f16437640 1 -- start start 2024-05-08T04:25:10.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f16437640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f100b6c90 0x7f7f100cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f16437640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7f100ce920 0x7f7f1015e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f16437640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f100d1610 con 0x7f7f100d0d20 2024-05-08T04:25:10.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f16437640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f100cfee0 con 0x7f7f100ce920 2024-05-08T04:25:10.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f16437640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100d01c0 con 0x7f7f100b6c90 2024-05-08T04:25:10.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f149d4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7f100ce920 0x7f7f1015e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f0ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f100b6c90 0x7f7f100cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f0ffff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f100b6c90 0x7f7f100cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.104:54952/0 (socket says 172.21.15.104:54952) 2024-05-08T04:25:10.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f0ffff640 1 -- 172.21.15.104:0/3229319609 learned_addr learned my addr 172.21.15.104:0/3229319609 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:10.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f0ffff640 1 -- 172.21.15.104:0/3229319609 >> v2:172.21.15.183:3300/0 conn(0x7f7f100ce920 msgr2=0x7f7f1015e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:10.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f0ffff640 1 --2- 172.21.15.104:0/3229319609 >> v2:172.21.15.183:3300/0 conn(0x7f7f100ce920 0x7f7f1015e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f0ffff640 1 -- 172.21.15.104:0/3229319609 >> v1:172.21.15.183:6789/0 conn(0x7f7f100d0d20 legacy=0x7f7f100ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f0ffff640 1 -- 172.21.15.104:0/3229319609 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100d04a0 con 0x7f7f100b6c90 2024-05-08T04:25:10.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.773+0000 7f7f149d4640 1 --2- 172.21.15.104:0/3229319609 >> v2:172.21.15.183:3300/0 conn(0x7f7f100ce920 0x7f7f1015e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:25:10.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.774+0000 7f7f0ffff640 1 --2- 172.21.15.104:0/3229319609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f100b6c90 0x7f7f100cf900 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009870 tx=0x7f7f0002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b6bf9d44e0f69b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.774+0000 7f7f0f7fe640 1 -- 172.21.15.104:0/3229319609 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00037070 con 0x7f7f100b6c90 2024-05-08T04:25:10.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.774+0000 7f7f0f7fe640 1 -- 172.21.15.104:0/3229319609 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0002ae50 con 0x7f7f100b6c90 2024-05-08T04:25:10.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.774+0000 7f7f0f7fe640 1 -- 172.21.15.104:0/3229319609 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00032860 con 0x7f7f100b6c90 2024-05-08T04:25:10.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.775+0000 7f7f16437640 1 -- 172.21.15.104:0/3229319609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f100b6c90 msgr2=0x7f7f100cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.775+0000 7f7f16437640 1 --2- 172.21.15.104:0/3229319609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f100b6c90 0x7f7f100cf900 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009870 tx=0x7f7f0002a300 comp rx=0 tx=0).stop 2024-05-08T04:25:10.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.775+0000 7f7f16437640 1 -- 172.21.15.104:0/3229319609 shutdown_connections 2024-05-08T04:25:10.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.775+0000 7f7f16437640 1 --2- 172.21.15.104:0/3229319609 >> v2:172.21.15.183:3300/0 conn(0x7f7f100ce920 0x7f7f1015e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.775+0000 7f7f16437640 1 --2- 172.21.15.104:0/3229319609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f100b6c90 0x7f7f100cf900 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.775+0000 7f7f16437640 1 -- 172.21.15.104:0/3229319609 >> 172.21.15.104:0/3229319609 conn(0x7f7f1006f480 msgr2=0x7f7f1006f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:10.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.775+0000 7f7f16437640 1 -- 172.21.15.104:0/3229319609 shutdown_connections 2024-05-08T04:25:10.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.775+0000 7f7f16437640 1 -- 172.21.15.104:0/3229319609 wait complete. 2024-05-08T04:25:10.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.776+0000 7f7f16437640 1 Processor -- start 2024-05-08T04:25:10.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.776+0000 7f7f16437640 1 -- start start 2024-05-08T04:25:10.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f16437640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f100b6c90 0x7f7f101f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f16437640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f100ce920 0x7f7f1014aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f16437640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f100d0d20 0x7f7f100b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f16437640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1015eaf0 con 0x7f7f100ce920 2024-05-08T04:25:10.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f16437640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100b4880 con 0x7f7f100b6c90 2024-05-08T04:25:10.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f16437640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1015ec70 con 0x7f7f100d0d20 2024-05-08T04:25:10.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f07fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f100ce920 0x7f7f1014aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f07fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f100ce920 0x7f7f1014aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38652/0 (socket says 172.21.15.104:38652) 2024-05-08T04:25:10.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f07fff640 1 -- 172.21.15.104:0/253345267 learned_addr learned my addr 172.21.15.104:0/253345267 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:10.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f0ffff640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f100b6c90 0x7f7f101f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f149d4640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f100d0d20 0x7f7f100b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f07fff640 1 -- 172.21.15.104:0/253345267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f100d0d20 msgr2=0x7f7f100b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f07fff640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f100d0d20 0x7f7f100b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f07fff640 1 -- 172.21.15.104:0/253345267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f100b6c90 msgr2=0x7f7f101f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f07fff640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f100b6c90 0x7f7f101f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f07fff640 1 -- 172.21.15.104:0/253345267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f101f59c0 con 0x7f7f100ce920 2024-05-08T04:25:10.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f0ffff640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f100b6c90 0x7f7f101f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:10.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f149d4640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f100d0d20 0x7f7f100b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:10.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f07fff640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f100ce920 0x7f7f1014aff0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800c3f0 tx=0x7f7ef800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.777+0000 7f7f0d7fa640 1 -- 172.21.15.104:0/253345267 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef80052d0 con 0x7f7f100ce920 2024-05-08T04:25:10.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.778+0000 7f7f0d7fa640 1 -- 172.21.15.104:0/253345267 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef8005490 con 0x7f7f100ce920 2024-05-08T04:25:10.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.778+0000 7f7f16437640 1 -- 172.21.15.104:0/253345267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f100b1200 con 0x7f7f100ce920 2024-05-08T04:25:10.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.778+0000 7f7f0d7fa640 1 -- 172.21.15.104:0/253345267 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8007260 con 0x7f7f100ce920 2024-05-08T04:25:10.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.778+0000 7f7f16437640 1 -- 172.21.15.104:0/253345267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f100b17c0 con 0x7f7f100ce920 2024-05-08T04:25:10.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.779+0000 7f7f16437640 1 -- 172.21.15.104:0/253345267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f10075010 con 0x7f7f100ce920 2024-05-08T04:25:10.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.779+0000 7f7f0d7fa640 1 -- 172.21.15.104:0/253345267 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f7ef8007400 con 0x7f7f100ce920 2024-05-08T04:25:10.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.779+0000 7f7f0d7fa640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ef006b710 0x7f7ef006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:10.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.780+0000 7f7f0d7fa640 1 -- 172.21.15.104:0/253345267 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7ef8089650 con 0x7f7f100ce920 2024-05-08T04:25:10.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.780+0000 7f7f0ffff640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ef006b710 0x7f7ef006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:10.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.780+0000 7f7f0ffff640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ef006b710 0x7f7ef006dbd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7f00034000 tx=0x7f7f0002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:10.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.783+0000 7f7f0d7fa640 1 -- 172.21.15.104:0/253345267 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7ef80585d0 con 0x7f7f100ce920 2024-05-08T04:25:10.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.955+0000 7f7f16437640 1 -- 172.21.15.104:0/253345267 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f1006fa00 con 0x7f7ef006b710 2024-05-08T04:25:10.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.955+0000 7f7f0d7fa640 1 -- 172.21.15.104:0/253345267 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7f1006fa00 con 0x7f7ef006b710 2024-05-08T04:25:10.957 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 6 to deep-scrub 2024-05-08T04:25:10.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.957+0000 7f7f16437640 1 -- 172.21.15.104:0/253345267 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ef006b710 msgr2=0x7f7ef006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.957+0000 7f7f16437640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ef006b710 0x7f7ef006dbd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7f00034000 tx=0x7f7f0002e000 comp rx=0 tx=0).stop 2024-05-08T04:25:10.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.957+0000 7f7f16437640 1 -- 172.21.15.104:0/253345267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f100ce920 msgr2=0x7f7f1014aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:10.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.957+0000 7f7f16437640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f100ce920 0x7f7f1014aff0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800c3f0 tx=0x7f7ef800c8b0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.957+0000 7f7f16437640 1 -- 172.21.15.104:0/253345267 shutdown_connections 2024-05-08T04:25:10.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.957+0000 7f7f16437640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f7ef006b710 0x7f7ef006dbd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.957+0000 7f7f16437640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f100d0d20 0x7f7f100b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.957+0000 7f7f16437640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f100ce920 0x7f7f1014aff0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.957+0000 7f7f16437640 1 --2- 172.21.15.104:0/253345267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f100b6c90 0x7f7f101f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:10.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.957+0000 7f7f16437640 1 -- 172.21.15.104:0/253345267 >> 172.21.15.104:0/253345267 conn(0x7f7f1006f480 msgr2=0x7f7f100c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:10.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.957+0000 7f7f16437640 1 -- 172.21.15.104:0/253345267 shutdown_connections 2024-05-08T04:25:10.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:10.957+0000 7f7f16437640 1 -- 172.21.15.104:0/253345267 wait complete. 2024-05-08T04:25:10.970 INFO:tasks.ceph:Scrubbing osd.7 2024-05-08T04:25:10.970 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-08T04:25:11.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.073+0000 7f6da7b63640 1 Processor -- start 2024-05-08T04:25:11.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.073+0000 7f6da7b63640 1 -- start start 2024-05-08T04:25:11.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.074+0000 7f6da7b63640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6da00ceee0 0x7f6da00b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.074+0000 7f6da7b63640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6da00b4700 0x7f6da006e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.074+0000 7f6da7b63640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da015e780 con 0x7f6da006e330 2024-05-08T04:25:11.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.074+0000 7f6da7b63640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da015f390 con 0x7f6da00b4700 2024-05-08T04:25:11.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.074+0000 7f6da7b63640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da015ea60 con 0x7f6da00ceee0 2024-05-08T04:25:11.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.074+0000 7f6da6100640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6da00b4700 0x7f6da006e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.074+0000 7f6da6100640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f6da00b4700 0x7f6da006e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38660/0 (socket says 172.21.15.104:38660) 2024-05-08T04:25:11.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.074+0000 7f6da6100640 1 -- 172.21.15.104:0/676910617 learned_addr learned my addr 172.21.15.104:0/676910617 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:11.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.074+0000 7f6da58ff640 1 --2- 172.21.15.104:0/676910617 >> v2:172.21.15.183:3300/0 conn(0x7f6da00ceee0 0x7f6da00b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.074+0000 7f6da6100640 1 -- 172.21.15.104:0/676910617 >> v2:172.21.15.183:3300/0 conn(0x7f6da00ceee0 msgr2=0x7f6da00b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:11.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.074+0000 7f6da6100640 1 --2- 172.21.15.104:0/676910617 >> v2:172.21.15.183:3300/0 conn(0x7f6da00ceee0 0x7f6da00b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.074+0000 7f6da6100640 1 -- 172.21.15.104:0/676910617 >> v1:172.21.15.183:6789/0 conn(0x7f6da006e330 legacy=0x7f6da00b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:11.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.074+0000 7f6da6100640 1 -- 172.21.15.104:0/676910617 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da015ed40 con 0x7f6da00b4700 2024-05-08T04:25:11.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.075+0000 7f6da6100640 1 --2- 172.21.15.104:0/676910617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6da00b4700 0x7f6da006e7e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f6da0072a60 tx=0x7f6d9802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3203e8fe755c4bab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:11.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.075+0000 7f6da48fd640 1 -- 172.21.15.104:0/676910617 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d98037070 con 0x7f6da00b4700 2024-05-08T04:25:11.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.075+0000 7f6da48fd640 1 -- 172.21.15.104:0/676910617 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d98032440 con 0x7f6da00b4700 2024-05-08T04:25:11.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.075+0000 7f6da48fd640 1 -- 172.21.15.104:0/676910617 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d98032810 con 0x7f6da00b4700 2024-05-08T04:25:11.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.076+0000 7f6da7b63640 1 -- 172.21.15.104:0/676910617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6da00b4700 msgr2=0x7f6da006e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.076+0000 7f6da7b63640 1 --2- 172.21.15.104:0/676910617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6da00b4700 0x7f6da006e7e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f6da0072a60 tx=0x7f6d9802a230 comp rx=0 tx=0).stop 2024-05-08T04:25:11.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.076+0000 7f6da7b63640 1 -- 172.21.15.104:0/676910617 shutdown_connections 2024-05-08T04:25:11.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.076+0000 7f6da7b63640 1 --2- 172.21.15.104:0/676910617 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6da00b4700 0x7f6da006e7e0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.076+0000 7f6da7b63640 1 --2- 172.21.15.104:0/676910617 >> v2:172.21.15.183:3300/0 conn(0x7f6da00ceee0 0x7f6da00b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.076+0000 7f6da7b63640 1 -- 172.21.15.104:0/676910617 >> 172.21.15.104:0/676910617 conn(0x7f6da00b13f0 msgr2=0x7f6da00b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:11.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.076+0000 7f6da7b63640 1 -- 172.21.15.104:0/676910617 shutdown_connections 2024-05-08T04:25:11.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.076+0000 7f6da7b63640 1 -- 172.21.15.104:0/676910617 wait complete. 2024-05-08T04:25:11.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.077+0000 7f6da7b63640 1 Processor -- start 2024-05-08T04:25:11.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.077+0000 7f6da7b63640 1 -- start start 2024-05-08T04:25:11.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.077+0000 7f6da7b63640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6da006e330 0x7f6da01443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.077+0000 7f6da7b63640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6da00b4700 0x7f6da01f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da7b63640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da00ceee0 0x7f6da00b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da7b63640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00cf440 con 0x7f6da00b4700 2024-05-08T04:25:11.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da7b63640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00cf2c0 con 0x7f6da00ceee0 2024-05-08T04:25:11.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da7b63640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da015b210 con 0x7f6da006e330 2024-05-08T04:25:11.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da50fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6da00b4700 0x7f6da01f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da50fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6da00b4700 0x7f6da01f3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38674/0 (socket says 172.21.15.104:38674) 2024-05-08T04:25:11.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da50fe640 1 -- 172.21.15.104:0/594958683 learned_addr learned my addr 172.21.15.104:0/594958683 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:11.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da58ff640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6da006e330 0x7f6da01443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da50fe640 1 -- 172.21.15.104:0/594958683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6da006e330 msgr2=0x7f6da01443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da50fe640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6da006e330 0x7f6da01443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da6100640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da00ceee0 0x7f6da00b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da50fe640 1 -- 172.21.15.104:0/594958683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da00ceee0 msgr2=0x7f6da00b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da50fe640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da00ceee0 0x7f6da00b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da50fe640 1 -- 172.21.15.104:0/594958683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da01f4720 con 0x7f6da00b4700 2024-05-08T04:25:11.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da50fe640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6da00b4700 0x7f6da01f3e20 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000e6e0 tx=0x7f6d9000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:11.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6d967fc640 1 -- 172.21.15.104:0/594958683 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90015070 con 0x7f6da00b4700 2024-05-08T04:25:11.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6d967fc640 1 -- 172.21.15.104:0/594958683 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d90005290 con 0x7f6da00b4700 2024-05-08T04:25:11.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da7b63640 1 -- 172.21.15.104:0/594958683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da01f4a00 con 0x7f6da00b4700 2024-05-08T04:25:11.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6d967fc640 1 -- 172.21.15.104:0/594958683 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90001940 con 0x7f6da00b4700 2024-05-08T04:25:11.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.078+0000 7f6da7b63640 1 -- 172.21.15.104:0/594958683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da015c990 con 0x7f6da00b4700 2024-05-08T04:25:11.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.079+0000 7f6da7b63640 1 -- 172.21.15.104:0/594958683 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6da0075010 con 0x7f6da00b4700 2024-05-08T04:25:11.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.080+0000 7f6d967fc640 1 -- 172.21.15.104:0/594958683 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f6d90018070 con 0x7f6da00b4700 2024-05-08T04:25:11.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.080+0000 7f6d967fc640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6d8406b710 0x7f6d8406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.080+0000 7f6d967fc640 1 -- 172.21.15.104:0/594958683 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6d9008cbc0 con 0x7f6da00b4700 2024-05-08T04:25:11.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.080+0000 7f6da58ff640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6d8406b710 0x7f6d8406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.080+0000 7f6d967fc640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] conn(0x7f6d840715d0 0x7f6d840739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.080+0000 7f6d967fc640 1 -- 172.21.15.104:0/594958683 --> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d9000c0c0 con 0x7f6d840715d0 2024-05-08T04:25:11.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.080+0000 7f6d967fc640 1 -- 172.21.15.104:0/594958683 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d9008d010 con 0x7f6da00b4700 2024-05-08T04:25:11.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.081+0000 7f6da58ff640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6d8406b710 0x7f6d8406dbd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c008e50 tx=0x7f6d9c0083a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:11.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.081+0000 7f6da6100640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] conn(0x7f6d840715d0 0x7f6d840739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.081+0000 7f6da6100640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] conn(0x7f6d840715d0 0x7f6d840739f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:11.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.082+0000 7f6d967fc640 1 -- 172.21.15.104:0/594958683 <== osd.7 v2:172.21.15.183:6816/2951178506 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6d9000c0c0 con 0x7f6d840715d0 2024-05-08T04:25:11.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.095+0000 7f6da7b63640 1 -- 172.21.15.104:0/594958683 --> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6da006f3f0 con 0x7f6d840715d0 2024-05-08T04:25:11.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.096+0000 7f6d967fc640 1 -- 172.21.15.104:0/594958683 <== osd.7 v2:172.21.15.183:6816/2951178506 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6da006f3f0 con 0x7f6d840715d0 2024-05-08T04:25:11.097 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-05-08T04:25:11.097 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T04:25:11.098 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-05-08T04:25:11.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.096+0000 7f6da7b63640 1 -- 172.21.15.104:0/594958683 >> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] conn(0x7f6d840715d0 msgr2=0x7f6d840739f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.096+0000 7f6da7b63640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.183:6816/2951178506,v1:172.21.15.183:6817/2951178506] conn(0x7f6d840715d0 0x7f6d840739f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.096+0000 7f6da7b63640 1 -- 172.21.15.104:0/594958683 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6d8406b710 msgr2=0x7f6d8406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.096+0000 7f6da7b63640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f6d8406b710 0x7f6d8406dbd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c008e50 tx=0x7f6d9c0083a0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.096+0000 7f6da7b63640 1 -- 172.21.15.104:0/594958683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6da00b4700 msgr2=0x7f6da01f3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.096+0000 7f6da7b63640 1 --2- 172.21.15.104:0/594958683 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6da00b4700 0x7f6da01f3e20 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f6d9000e6e0 tx=0x7f6d9000eba0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.096+0000 7f6da6100640 1 -- 172.21.15.104:0/594958683 reap_dead start 2024-05-08T04:25:11.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.096+0000 7f6da7b63640 1 -- 172.21.15.104:0/594958683 shutdown_connections 2024-05-08T04:25:11.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.096+0000 7f6da7b63640 1 -- 172.21.15.104:0/594958683 >> 172.21.15.104:0/594958683 conn(0x7f6da00b13f0 msgr2=0x7f6da00b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:11.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.096+0000 7f6da7b63640 1 -- 172.21.15.104:0/594958683 shutdown_connections 2024-05-08T04:25:11.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.096+0000 7f6da7b63640 1 -- 172.21.15.104:0/594958683 wait complete. 2024-05-08T04:25:11.108 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-08T04:25:11.196 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:25:11.199 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:25:11.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.208+0000 7f3ea2b0a640 1 Processor -- start 2024-05-08T04:25:11.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.208+0000 7f3ea2b0a640 1 -- start start 2024-05-08T04:25:11.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.209+0000 7f3ea2b0a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3e9c0701a0 0x7f3e9c070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.209+0000 7f3ea2b0a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e9c0cd120 0x7f3e9c0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.209+0000 7f3ea2b0a640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9c073030 con 0x7f3e9c158540 2024-05-08T04:25:11.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.209+0000 7f3ea2b0a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e9c0cbf50 con 0x7f3e9c0701a0 2024-05-08T04:25:11.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.209+0000 7f3ea2b0a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c072210 con 0x7f3e9c0cd120 2024-05-08T04:25:11.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.209+0000 7f3ea08a6640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f3e9c158540 0x7f3e9c15e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42848/0 (socket says 172.21.15.104:42848) 2024-05-08T04:25:11.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.209+0000 7f3ea08a6640 1 -- 172.21.15.104:0/3578912190 learned_addr learned my addr 172.21.15.104:0/3578912190 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:11.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.209+0000 7f3ea10a7640 1 --2- 172.21.15.104:0/3578912190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e9c0cd120 0x7f3e9c0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.209+0000 7f3e9bfff640 1 --2- 172.21.15.104:0/3578912190 >> v2:172.21.15.183:3300/0 conn(0x7f3e9c0701a0 0x7f3e9c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.209+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166772425 0 0) 0x7f3e9c073030 con 0x7f3e9c158540 2024-05-08T04:25:11.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.209+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e8c003520 con 0x7f3e9c158540 2024-05-08T04:25:11.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 580008265 0 0) 0x7f3e8c003520 con 0x7f3e9c158540 2024-05-08T04:25:11.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e9c0cd120 msgr2=0x7f3e9c0cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:11.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 --2- 172.21.15.104:0/3578912190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e9c0cd120 0x7f3e9c0cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 >> v2:172.21.15.183:3300/0 conn(0x7f3e9c0701a0 msgr2=0x7f3e9c070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:11.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 --2- 172.21.15.104:0/3578912190 >> v2:172.21.15.183:3300/0 conn(0x7f3e9c0701a0 0x7f3e9c070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c0724b0 con 0x7f3e9c158540 2024-05-08T04:25:11.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f3e90001670 con 0x7f3e9c158540 2024-05-08T04:25:11.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9bfff640 1 --2- 172.21.15.104:0/3578912190 >> v2:172.21.15.183:3300/0 conn(0x7f3e9c0701a0 0x7f3e9c070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T04:25:11.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 >> v1:172.21.15.104:6789/0 conn(0x7f3e9c158540 legacy=0x7f3e9c15e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 --2- 172.21.15.104:0/3578912190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8c0039b0 0x7f3e8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 --2- 172.21.15.104:0/3578912190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e9c0cd120 0x7f3e8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 --2- 172.21.15.104:0/3578912190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e8c004d40 0x7f3e8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c072210 con 0x7f3e8c004d40 2024-05-08T04:25:11.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c00b9c0 con 0x7f3e8c0039b0 2024-05-08T04:25:11.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c00bb40 con 0x7f3e9c0cd120 2024-05-08T04:25:11.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3ea10a7640 1 --2- 172.21.15.104:0/3578912190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e8c004d40 0x7f3e8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3ea08a6640 1 --2- 172.21.15.104:0/3578912190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8c0039b0 0x7f3e8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3e9bfff640 1 --2- 172.21.15.104:0/3578912190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e9c0cd120 0x7f3e8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3ea10a7640 1 -- 172.21.15.104:0/3578912190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e9c0cd120 msgr2=0x7f3e8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:11.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3ea10a7640 1 --2- 172.21.15.104:0/3578912190 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e9c0cd120 0x7f3e8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3ea10a7640 1 -- 172.21.15.104:0/3578912190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8c0039b0 msgr2=0x7f3e8c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:11.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3ea10a7640 1 --2- 172.21.15.104:0/3578912190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8c0039b0 0x7f3e8c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3ea10a7640 1 -- 172.21.15.104:0/3578912190 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c003520 con 0x7f3e8c004d40 2024-05-08T04:25:11.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.210+0000 7f3ea08a6640 1 --2- 172.21.15.104:0/3578912190 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e8c0039b0 0x7f3e8c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:11.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.211+0000 7f3ea10a7640 1 --2- 172.21.15.104:0/3578912190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e8c004d40 0x7f3e8c0051c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009fc0 tx=0x7f3e8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678bedd58928b2ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:11.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.211+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94009c10 con 0x7f3e8c004d40 2024-05-08T04:25:11.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.211+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e94036070 con 0x7f3e8c004d40 2024-05-08T04:25:11.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.211+0000 7f3e9b7fe640 1 -- 172.21.15.104:0/3578912190 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94031880 con 0x7f3e8c004d40 2024-05-08T04:25:11.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.211+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/3578912190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e8c004d40 msgr2=0x7f3e8c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.211+0000 7f3ea2b0a640 1 --2- 172.21.15.104:0/3578912190 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e8c004d40 0x7f3e8c0051c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009fc0 tx=0x7f3e8c005830 comp rx=0 tx=0).stop 2024-05-08T04:25:11.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.211+0000 7f3ea10a7640 1 -- 172.21.15.104:0/3578912190 reap_dead start 2024-05-08T04:25:11.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.212+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/3578912190 shutdown_connections 2024-05-08T04:25:11.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.212+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/3578912190 >> 172.21.15.104:0/3578912190 conn(0x7f3e9c0b23e0 msgr2=0x7f3e9c0b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:11.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.212+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/3578912190 shutdown_connections 2024-05-08T04:25:11.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.212+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/3578912190 wait complete. 2024-05-08T04:25:11.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.213+0000 7f3ea2b0a640 1 Processor -- start 2024-05-08T04:25:11.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.213+0000 7f3ea2b0a640 1 -- start start 2024-05-08T04:25:11.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3ea2b0a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8c004d40 0x7f3e9c1eebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3ea2b0a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e9c0cc210 0x7f3e9c0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3ea2b0a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e9c0b5520 0x7f3e9c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3ea2b0a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c072d50 con 0x7f3e9c0cc210 2024-05-08T04:25:11.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3ea2b0a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c072a70 con 0x7f3e9c0b5520 2024-05-08T04:25:11.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3ea2b0a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0cd5b0 con 0x7f3e8c004d40 2024-05-08T04:25:11.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3e9bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e9c0cc210 0x7f3e9c0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3e9bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e9c0cc210 0x7f3e9c0cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38694/0 (socket says 172.21.15.104:38694) 2024-05-08T04:25:11.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3e9bfff640 1 -- 172.21.15.104:0/1930695275 learned_addr learned my addr 172.21.15.104:0/1930695275 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:11.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3ea10a7640 1 --2- 172.21.15.104:0/1930695275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e9c0b5520 0x7f3e9c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3e9bfff640 1 -- 172.21.15.104:0/1930695275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8c004d40 msgr2=0x7f3e9c1eebb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T04:25:11.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3e9bfff640 1 --2- 172.21.15.104:0/1930695275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8c004d40 0x7f3e9c1eebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3e9bfff640 1 -- 172.21.15.104:0/1930695275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e9c0b5520 msgr2=0x7f3e9c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3e9bfff640 1 --2- 172.21.15.104:0/1930695275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e9c0b5520 0x7f3e9c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3e9bfff640 1 -- 172.21.15.104:0/1930695275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c1f15a0 con 0x7f3e9c0cc210 2024-05-08T04:25:11.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3e9bfff640 1 --2- 172.21.15.104:0/1930695275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e9c0cc210 0x7f3e9c0cc690 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f3e88011900 tx=0x7f3e88011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:11.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3e997fa640 1 -- 172.21.15.104:0/1930695275 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800fb70 con 0x7f3e9c0cc210 2024-05-08T04:25:11.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3e997fa640 1 -- 172.21.15.104:0/1930695275 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8800fd10 con 0x7f3e9c0cc210 2024-05-08T04:25:11.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/1930695275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9c0b5f10 con 0x7f3e9c0cc210 2024-05-08T04:25:11.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.214+0000 7f3e997fa640 1 -- 172.21.15.104:0/1930695275 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88015660 con 0x7f3e9c0cc210 2024-05-08T04:25:11.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.215+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/1930695275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c1f1b00 con 0x7f3e9c0cc210 2024-05-08T04:25:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.216+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/1930695275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9c0ccbd0 con 0x7f3e9c0cc210 2024-05-08T04:25:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.216+0000 7f3e997fa640 1 -- 172.21.15.104:0/1930695275 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f3e88015800 con 0x7f3e9c0cc210 2024-05-08T04:25:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.216+0000 7f3e997fa640 1 --2- 172.21.15.104:0/1930695275 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e8006b710 0x7f3e8006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.217+0000 7f3ea08a6640 1 --2- 172.21.15.104:0/1930695275 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e8006b710 0x7f3e8006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.217+0000 7f3e997fa640 1 -- 172.21.15.104:0/1930695275 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3e8808ade0 con 0x7f3e9c0cc210 2024-05-08T04:25:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.217+0000 7f3ea08a6640 1 --2- 172.21.15.104:0/1930695275 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e8006b710 0x7f3e8006dbd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3e90001eb0 tx=0x7f3e90001b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:11.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.221+0000 7f3e997fa640 1 -- 172.21.15.104:0/1930695275 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e9c1f15a0 con 0x7f3e9c0cc210 2024-05-08T04:25:11.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.393+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/1930695275 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e9c075010 con 0x7f3e8006b710 2024-05-08T04:25:11.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.393+0000 7f3e997fa640 1 -- 172.21.15.104:0/1930695275 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3e9c075010 con 0x7f3e8006b710 2024-05-08T04:25:11.395 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 7 to deep-scrub 2024-05-08T04:25:11.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.395+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/1930695275 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e8006b710 msgr2=0x7f3e8006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.395+0000 7f3ea2b0a640 1 --2- 172.21.15.104:0/1930695275 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e8006b710 0x7f3e8006dbd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3e90001eb0 tx=0x7f3e90001b50 comp rx=0 tx=0).stop 2024-05-08T04:25:11.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.395+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/1930695275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e9c0cc210 msgr2=0x7f3e9c0cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.395+0000 7f3ea2b0a640 1 --2- 172.21.15.104:0/1930695275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e9c0cc210 0x7f3e9c0cc690 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f3e88011900 tx=0x7f3e88011dc0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.395+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/1930695275 shutdown_connections 2024-05-08T04:25:11.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.395+0000 7f3ea2b0a640 1 --2- 172.21.15.104:0/1930695275 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f3e8006b710 0x7f3e8006dbd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.395+0000 7f3ea2b0a640 1 --2- 172.21.15.104:0/1930695275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e9c0b5520 0x7f3e9c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.395+0000 7f3ea2b0a640 1 --2- 172.21.15.104:0/1930695275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3e9c0cc210 0x7f3e9c0cc690 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.395+0000 7f3ea2b0a640 1 --2- 172.21.15.104:0/1930695275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e8c004d40 0x7f3e9c1eebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.395+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/1930695275 >> 172.21.15.104:0/1930695275 conn(0x7f3e9c0b23e0 msgr2=0x7f3e9c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:11.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.395+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/1930695275 shutdown_connections 2024-05-08T04:25:11.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.395+0000 7f3ea2b0a640 1 -- 172.21.15.104:0/1930695275 wait complete. 2024-05-08T04:25:11.407 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:25:11.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.506+0000 7f6126bc8640 1 Processor -- start 2024-05-08T04:25:11.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.506+0000 7f6126bc8640 1 -- start start 2024-05-08T04:25:11.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f6126bc8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f612015bac0 0x7f61200b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f6126bc8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200b51b0 0x7f612006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f6126bc8640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61200b1e30 con 0x7f612006ab60 2024-05-08T04:25:11.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f6126bc8640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61200b1c00 con 0x7f612015bac0 2024-05-08T04:25:11.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f6126bc8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612006b500 con 0x7f61200b51b0 2024-05-08T04:25:11.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f6117fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f612006ab60 0x7f61200cc3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:42856/0 (socket says 172.21.15.104:42856) 2024-05-08T04:25:11.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f6117fff640 1 -- 172.21.15.104:0/1999072308 learned_addr learned my addr 172.21.15.104:0/1999072308 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:11.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f6124964640 1 --2- 172.21.15.104:0/1999072308 >> v2:172.21.15.183:3300/0 conn(0x7f612015bac0 0x7f61200b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f6125165640 1 --2- 172.21.15.104:0/1999072308 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200b51b0 0x7f612006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767174580 0 0) 0x7f61200b1e30 con 0x7f612006ab60 2024-05-08T04:25:11.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6108003520 con 0x7f612006ab60 2024-05-08T04:25:11.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1291526135 0 0) 0x7f6108003520 con 0x7f612006ab60 2024-05-08T04:25:11.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200b51b0 msgr2=0x7f612006afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:11.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f61177fe640 1 --2- 172.21.15.104:0/1999072308 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200b51b0 0x7f612006afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 >> v2:172.21.15.183:3300/0 conn(0x7f612015bac0 msgr2=0x7f61200b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:11.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f61177fe640 1 --2- 172.21.15.104:0/1999072308 >> v2:172.21.15.183:3300/0 conn(0x7f612015bac0 0x7f61200b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61200b36c0 con 0x7f612006ab60 2024-05-08T04:25:11.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.507+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f6110001670 con 0x7f612006ab60 2024-05-08T04:25:11.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 >> v1:172.21.15.104:6789/0 conn(0x7f612006ab60 legacy=0x7f61200cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f61177fe640 1 --2- 172.21.15.104:0/1999072308 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200b51b0 0x7f61080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f61177fe640 1 --2- 172.21.15.104:0/1999072308 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6108003f30 0x7f6108004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f61177fe640 1 --2- 172.21.15.104:0/1999072308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6108004d40 0x7f61080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610800b9c0 con 0x7f6108004d40 2024-05-08T04:25:11.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610800bb40 con 0x7f6108003f30 2024-05-08T04:25:11.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610800bd10 con 0x7f61200b51b0 2024-05-08T04:25:11.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f6125165640 1 --2- 172.21.15.104:0/1999072308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6108004d40 0x7f61080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f6117fff640 1 --2- 172.21.15.104:0/1999072308 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6108003f30 0x7f6108004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f6124964640 1 --2- 172.21.15.104:0/1999072308 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200b51b0 0x7f61080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f6125165640 1 -- 172.21.15.104:0/1999072308 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200b51b0 msgr2=0x7f61080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:11.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f6125165640 1 --2- 172.21.15.104:0/1999072308 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200b51b0 0x7f61080039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f6125165640 1 -- 172.21.15.104:0/1999072308 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6108003f30 msgr2=0x7f6108004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:11.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f6125165640 1 --2- 172.21.15.104:0/1999072308 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6108003f30 0x7f6108004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f6125165640 1 -- 172.21.15.104:0/1999072308 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6108003520 con 0x7f6108004d40 2024-05-08T04:25:11.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.508+0000 7f6117fff640 1 --2- 172.21.15.104:0/1999072308 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6108003f30 0x7f6108004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:11.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.509+0000 7f6125165640 1 --2- 172.21.15.104:0/1999072308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6108004d40 0x7f61080051c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f6118009af0 tx=0x7f6108005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6964ccbc0be916b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:11.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.509+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118036070 con 0x7f6108004d40 2024-05-08T04:25:11.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.509+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6118031400 con 0x7f6108004d40 2024-05-08T04:25:11.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.509+0000 7f61177fe640 1 -- 172.21.15.104:0/1999072308 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118009690 con 0x7f6108004d40 2024-05-08T04:25:11.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.509+0000 7f6126bc8640 1 -- 172.21.15.104:0/1999072308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6108004d40 msgr2=0x7f61080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.509+0000 7f6126bc8640 1 --2- 172.21.15.104:0/1999072308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6108004d40 0x7f61080051c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f6118009af0 tx=0x7f6108005830 comp rx=0 tx=0).stop 2024-05-08T04:25:11.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.509+0000 7f6125165640 1 -- 172.21.15.104:0/1999072308 reap_dead start 2024-05-08T04:25:11.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.509+0000 7f6126bc8640 1 -- 172.21.15.104:0/1999072308 shutdown_connections 2024-05-08T04:25:11.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.509+0000 7f6126bc8640 1 -- 172.21.15.104:0/1999072308 >> 172.21.15.104:0/1999072308 conn(0x7f61200b2220 msgr2=0x7f61200b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:11.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.509+0000 7f6126bc8640 1 -- 172.21.15.104:0/1999072308 shutdown_connections 2024-05-08T04:25:11.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.509+0000 7f6126bc8640 1 -- 172.21.15.104:0/1999072308 wait complete. 2024-05-08T04:25:11.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.511+0000 7f6126bc8640 1 Processor -- start 2024-05-08T04:25:11.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.511+0000 7f6126bc8640 1 -- start start 2024-05-08T04:25:11.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.511+0000 7f6126bc8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6108004d40 0x7f61200ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.511+0000 7f6126bc8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61200c5d60 0x7f61201572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.511+0000 7f6126bc8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200b0d40 0x7f612006e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.511+0000 7f6126bc8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61200c3f00 con 0x7f61200c5d60 2024-05-08T04:25:11.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6126bc8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61200b3d10 con 0x7f6108004d40 2024-05-08T04:25:11.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6126bc8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612015bea0 con 0x7f61200b0d40 2024-05-08T04:25:11.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6117fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61200c5d60 0x7f61201572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6117fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61200c5d60 0x7f61201572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38718/0 (socket says 172.21.15.104:38718) 2024-05-08T04:25:11.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6117fff640 1 -- 172.21.15.104:0/3911545856 learned_addr learned my addr 172.21.15.104:0/3911545856 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:11.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6124964640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6108004d40 0x7f61200ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6125165640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200b0d40 0x7f612006e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6117fff640 1 -- 172.21.15.104:0/3911545856 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200b0d40 msgr2=0x7f612006e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6117fff640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200b0d40 0x7f612006e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6117fff640 1 -- 172.21.15.104:0/3911545856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6108004d40 msgr2=0x7f61200ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6117fff640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6108004d40 0x7f61200ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6117fff640 1 -- 172.21.15.104:0/3911545856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61201577f0 con 0x7f61200c5d60 2024-05-08T04:25:11.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6124964640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6108004d40 0x7f61200ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:11.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6117fff640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61200c5d60 0x7f61201572b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f611000e8c0 tx=0x7f611000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:11.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f61157fa640 1 -- 172.21.15.104:0/3911545856 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000c870 con 0x7f61200c5d60 2024-05-08T04:25:11.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f61157fa640 1 -- 172.21.15.104:0/3911545856 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110018070 con 0x7f61200c5d60 2024-05-08T04:25:11.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6126bc8640 1 -- 172.21.15.104:0/3911545856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61200c6260 con 0x7f61200c5d60 2024-05-08T04:25:11.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f61157fa640 1 -- 172.21.15.104:0/3911545856 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000cc10 con 0x7f61200c5d60 2024-05-08T04:25:11.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.512+0000 7f6126bc8640 1 -- 172.21.15.104:0/3911545856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61200c6820 con 0x7f61200c5d60 2024-05-08T04:25:11.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.513+0000 7f6126bc8640 1 -- 172.21.15.104:0/3911545856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6120075010 con 0x7f61200c5d60 2024-05-08T04:25:11.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.514+0000 7f61157fa640 1 -- 172.21.15.104:0/3911545856 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f611001d460 con 0x7f61200c5d60 2024-05-08T04:25:11.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.514+0000 7f61157fa640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f610c06b710 0x7f610c06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:11.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.514+0000 7f61157fa640 1 -- 172.21.15.104:0/3911545856 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f611008a110 con 0x7f61200c5d60 2024-05-08T04:25:11.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.514+0000 7f6124964640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f610c06b710 0x7f610c06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:11.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.514+0000 7f6124964640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f610c06b710 0x7f610c06dbd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f611c0074d0 tx=0x7f611c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:11.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.518+0000 7f61157fa640 1 -- 172.21.15.104:0/3911545856 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6110059000 con 0x7f61200c5d60 2024-05-08T04:25:11.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.686+0000 7f6126bc8640 1 -- 172.21.15.104:0/3911545856 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f612006ba30 con 0x7f610c06b710 2024-05-08T04:25:11.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.687+0000 7f61157fa640 1 -- 172.21.15.104:0/3911545856 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13483 (secure 0 0 0) 0x7f612006ba30 con 0x7f610c06b710 2024-05-08T04:25:11.688 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:25:11.688 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:25:11.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.689+0000 7f6126bc8640 1 -- 172.21.15.104:0/3911545856 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f610c06b710 msgr2=0x7f610c06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.689+0000 7f6126bc8640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f610c06b710 0x7f610c06dbd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f611c0074d0 tx=0x7f611c00b040 comp rx=0 tx=0).stop 2024-05-08T04:25:11.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.689+0000 7f6126bc8640 1 -- 172.21.15.104:0/3911545856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61200c5d60 msgr2=0x7f61201572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:11.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.689+0000 7f6126bc8640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61200c5d60 0x7f61201572b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f611000e8c0 tx=0x7f611000ed80 comp rx=0 tx=0).stop 2024-05-08T04:25:11.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.689+0000 7f6126bc8640 1 -- 172.21.15.104:0/3911545856 shutdown_connections 2024-05-08T04:25:11.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.689+0000 7f6126bc8640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f610c06b710 0x7f610c06dbd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.689+0000 7f6126bc8640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200b0d40 0x7f612006e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.689+0000 7f6126bc8640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61200c5d60 0x7f61201572b0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.689+0000 7f6126bc8640 1 --2- 172.21.15.104:0/3911545856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6108004d40 0x7f61200ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:11.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.689+0000 7f6126bc8640 1 -- 172.21.15.104:0/3911545856 >> 172.21.15.104:0/3911545856 conn(0x7f61200b2220 msgr2=0x7f61200b2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:11.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.689+0000 7f6126bc8640 1 -- 172.21.15.104:0/3911545856 shutdown_connections 2024-05-08T04:25:11.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:11.689+0000 7f6126bc8640 1 -- 172.21.15.104:0/3911545856 wait complete. 2024-05-08T04:25:11.701 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-05-08T04:25:10.686924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":227588,"kb_used_data":7240,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747132,"statfs":{"total":773094113280,"available":772861063168,"internally_reserved":0,"allocated":7413760,"data_stored":3785688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-36077,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-66,"num_write_kb":-60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001366"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":251,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-08T04:25:04.754518+0000","last_change":"2024-05-08T04:20:59.688579+0000","last_active":"2024-05-08T04:25:04.754518+0000","last_peered":"2024-05-08T04:25:04.754518+0000","last_clean":"2024-05-08T04:25:04.754518+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:25:04.754518+0000","last_undegraded":"2024-05-08T04:25:04.754518+0000","last_fullsized":"2024-05-08T04:25:04.754518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T04:20:58.674018+0000","last_clean_scrub_stamp":"2024-05-08T04:20:58.674018+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:10:02.094396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":325619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":325619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1372160,"data_stored":915987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":325619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":325619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":325619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28360,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343480,"statfs":{"total":96636764160,"available":96607723520,"internally_reserved":0,"allocated":1372160,"data_stored":915987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":325619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:25:11.703 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T04:20:58.674018+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=4, tm_min=20, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=4, tm_min=25, tm_sec=6, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T04:25:11.704 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T04:25:31.705 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T04:25:31.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.816+0000 7f72658f5640 1 Processor -- start 2024-05-08T04:25:31.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.816+0000 7f72658f5640 1 -- start start 2024-05-08T04:25:31.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.817+0000 7f72658f5640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f726006ea40 0x7f72600b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:31.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.817+0000 7f72658f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72600b3ff0 0x7f72600b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:31.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.817+0000 7f72658f5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72600b49c0 con 0x7f72600ceee0 2024-05-08T04:25:31.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.817+0000 7f72658f5640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726015f390 con 0x7f726006ea40 2024-05-08T04:25:31.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.817+0000 7f72658f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726015e780 con 0x7f72600b3ff0 2024-05-08T04:25:31.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.817+0000 7f725e7fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f726006ea40 0x7f72600b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:31.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.817+0000 7f725e7fc640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7f726006ea40 0x7f72600b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38034/0 (socket says 172.21.15.104:38034) 2024-05-08T04:25:31.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.817+0000 7f725e7fc640 1 -- 172.21.15.104:0/899658198 learned_addr learned my addr 172.21.15.104:0/899658198 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:31.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.818+0000 7f725f7fe640 1 --2- 172.21.15.104:0/899658198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72600b3ff0 0x7f72600b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:31.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.818+0000 7f725e7fc640 1 -- 172.21.15.104:0/899658198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72600b3ff0 msgr2=0x7f72600b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:31.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.818+0000 7f725e7fc640 1 --2- 172.21.15.104:0/899658198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72600b3ff0 0x7f72600b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:31.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.818+0000 7f725e7fc640 1 -- 172.21.15.104:0/899658198 >> v1:172.21.15.183:6789/0 conn(0x7f72600ceee0 legacy=0x7f726006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:31.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.818+0000 7f725e7fc640 1 -- 172.21.15.104:0/899658198 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726015ea60 con 0x7f726006ea40 2024-05-08T04:25:31.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.818+0000 7f725e7fc640 1 --2- 172.21.15.104:0/899658198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f726006ea40 0x7f72600b26f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f725400bb10 tx=0x7f725402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d414c0aeec9ca99e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:31.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.818+0000 7f725dffb640 1 -- 172.21.15.104:0/899658198 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254036020 con 0x7f726006ea40 2024-05-08T04:25:31.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.819+0000 7f725dffb640 1 -- 172.21.15.104:0/899658198 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254032820 con 0x7f726006ea40 2024-05-08T04:25:31.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.819+0000 7f725dffb640 1 -- 172.21.15.104:0/899658198 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254032bf0 con 0x7f726006ea40 2024-05-08T04:25:31.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.819+0000 7f72658f5640 1 -- 172.21.15.104:0/899658198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f726006ea40 msgr2=0x7f72600b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:31.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.819+0000 7f72658f5640 1 --2- 172.21.15.104:0/899658198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f726006ea40 0x7f72600b26f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f725400bb10 tx=0x7f725402c920 comp rx=0 tx=0).stop 2024-05-08T04:25:31.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.819+0000 7f72658f5640 1 -- 172.21.15.104:0/899658198 shutdown_connections 2024-05-08T04:25:31.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.819+0000 7f72658f5640 1 --2- 172.21.15.104:0/899658198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72600b3ff0 0x7f72600b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:31.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.819+0000 7f72658f5640 1 --2- 172.21.15.104:0/899658198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f726006ea40 0x7f72600b26f0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:31.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.819+0000 7f72658f5640 1 -- 172.21.15.104:0/899658198 >> 172.21.15.104:0/899658198 conn(0x7f72600b13f0 msgr2=0x7f72600b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:31.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.819+0000 7f72658f5640 1 -- 172.21.15.104:0/899658198 shutdown_connections 2024-05-08T04:25:31.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.819+0000 7f72658f5640 1 -- 172.21.15.104:0/899658198 wait complete. 2024-05-08T04:25:31.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.820+0000 7f72658f5640 1 Processor -- start 2024-05-08T04:25:31.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.821+0000 7f72658f5640 1 -- start start 2024-05-08T04:25:31.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.821+0000 7f72658f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f726006ea40 0x7f72601f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:31.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.821+0000 7f72658f5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72600b3ff0 0x7f726014bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:31.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.821+0000 7f72658f5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72600ceee0 0x7f72600cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:31.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.821+0000 7f72658f5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72600cf2c0 con 0x7f726006ea40 2024-05-08T04:25:31.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.821+0000 7f72658f5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726015f020 con 0x7f72600ceee0 2024-05-08T04:25:31.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.821+0000 7f72658f5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72600cf440 con 0x7f72600b3ff0 2024-05-08T04:25:31.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.821+0000 7f725effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f726006ea40 0x7f72601f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:31.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.821+0000 7f725effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f726006ea40 0x7f72601f3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38036/0 (socket says 172.21.15.104:38036) 2024-05-08T04:25:31.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.821+0000 7f725effd640 1 -- 172.21.15.104:0/2643795400 learned_addr learned my addr 172.21.15.104:0/2643795400 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:31.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.821+0000 7f725f7fe640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72600ceee0 0x7f72600cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:31.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.821+0000 7f725e7fc640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72600b3ff0 0x7f726014bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:31.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.822+0000 7f725effd640 1 -- 172.21.15.104:0/2643795400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72600b3ff0 msgr2=0x7f726014bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:31.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.822+0000 7f725effd640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72600b3ff0 0x7f726014bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:31.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.822+0000 7f725effd640 1 -- 172.21.15.104:0/2643795400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72600ceee0 msgr2=0x7f72600cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:31.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.822+0000 7f725effd640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72600ceee0 0x7f72600cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:31.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.822+0000 7f725effd640 1 -- 172.21.15.104:0/2643795400 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72600acdb0 con 0x7f726006ea40 2024-05-08T04:25:31.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.822+0000 7f725effd640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f726006ea40 0x7f72601f3df0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f725000c730 tx=0x7f725000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:31.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.822+0000 7f7247fff640 1 -- 172.21.15.104:0/2643795400 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250016020 con 0x7f726006ea40 2024-05-08T04:25:31.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.822+0000 7f7247fff640 1 -- 172.21.15.104:0/2643795400 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7250006d50 con 0x7f726006ea40 2024-05-08T04:25:31.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.822+0000 7f72658f5640 1 -- 172.21.15.104:0/2643795400 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72601f4670 con 0x7f726006ea40 2024-05-08T04:25:31.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.822+0000 7f7247fff640 1 -- 172.21.15.104:0/2643795400 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250003bb0 con 0x7f726006ea40 2024-05-08T04:25:31.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.822+0000 7f72658f5640 1 -- 172.21.15.104:0/2643795400 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72601f4c30 con 0x7f726006ea40 2024-05-08T04:25:31.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.823+0000 7f72658f5640 1 -- 172.21.15.104:0/2643795400 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7260075010 con 0x7f726006ea40 2024-05-08T04:25:31.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.824+0000 7f7247fff640 1 -- 172.21.15.104:0/2643795400 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f725000a850 con 0x7f726006ea40 2024-05-08T04:25:31.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.824+0000 7f7247fff640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f724c06b710 0x7f724c06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:31.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.824+0000 7f7247fff640 1 -- 172.21.15.104:0/2643795400 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7250089da0 con 0x7f726006ea40 2024-05-08T04:25:31.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.824+0000 7f725e7fc640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f724c06b710 0x7f724c06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:31.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.825+0000 7f725e7fc640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f724c06b710 0x7f724c06dbd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7254037000 tx=0x7f7254008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:31.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:31.828+0000 7f7247fff640 1 -- 172.21.15.104:0/2643795400 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7250020020 con 0x7f726006ea40 2024-05-08T04:25:32.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.003+0000 7f72658f5640 1 -- 172.21.15.104:0/2643795400 --> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72600b11d0 con 0x7f724c06b710 2024-05-08T04:25:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.004+0000 7f7247fff640 1 -- 172.21.15.104:0/2643795400 <== mgr.4113 v2:172.21.15.104:6832/2468818054 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13359 (secure 0 0 0) 0x7f72600b11d0 con 0x7f724c06b710 2024-05-08T04:25:32.005 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:25:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-05-08T04:25:32.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.006+0000 7f72658f5640 1 -- 172.21.15.104:0/2643795400 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f724c06b710 msgr2=0x7f724c06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.006+0000 7f72658f5640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f724c06b710 0x7f724c06dbd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7254037000 tx=0x7f7254008040 comp rx=0 tx=0).stop 2024-05-08T04:25:32.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.006+0000 7f72658f5640 1 -- 172.21.15.104:0/2643795400 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f726006ea40 msgr2=0x7f72601f3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.006+0000 7f72658f5640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f726006ea40 0x7f72601f3df0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f725000c730 tx=0x7f725000cbf0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.006+0000 7f72658f5640 1 -- 172.21.15.104:0/2643795400 shutdown_connections 2024-05-08T04:25:32.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.006+0000 7f72658f5640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f724c06b710 0x7f724c06dbd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.006+0000 7f72658f5640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72600ceee0 0x7f72600cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.006+0000 7f72658f5640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72600b3ff0 0x7f726014bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.006+0000 7f72658f5640 1 --2- 172.21.15.104:0/2643795400 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f726006ea40 0x7f72601f3df0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.006+0000 7f72658f5640 1 -- 172.21.15.104:0/2643795400 >> 172.21.15.104:0/2643795400 conn(0x7f72600b13f0 msgr2=0x7f726006db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.006+0000 7f72658f5640 1 -- 172.21.15.104:0/2643795400 shutdown_connections 2024-05-08T04:25:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.006+0000 7f72658f5640 1 -- 172.21.15.104:0/2643795400 wait complete. 2024-05-08T04:25:32.018 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-05-08T04:25:30.691206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":227576,"kb_used_data":7240,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747144,"statfs":{"total":773094113280,"available":772861075456,"internally_reserved":0,"allocated":7413760,"data_stored":3785688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002359"},"pg_stats":[{"pgid":"1.0","version":"64'119","reported_seq":262,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-08T04:25:09.291801+0000","last_change":"2024-05-08T04:25:09.291852+0000","last_active":"2024-05-08T04:25:09.291801+0000","last_peered":"2024-05-08T04:25:09.291801+0000","last_clean":"2024-05-08T04:25:09.291801+0000","last_became_active":"2024-05-08T04:20:59.687612+0000","last_became_peered":"2024-05-08T04:20:59.687612+0000","last_unstale":"2024-05-08T04:25:09.291801+0000","last_undegraded":"2024-05-08T04:25:09.291801+0000","last_fullsized":"2024-05-08T04:25:09.291801+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'119","last_scrub_stamp":"2024-05-08T04:25:09.291719+0000","last_deep_scrub":"64'119","last_deep_scrub_stamp":"2024-05-08T04:25:09.291719+0000","last_clean_scrub_stamp":"2024-05-08T04:25:09.291719+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:41:02.744286+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":325619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":325619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1372160,"data_stored":915987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":325619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":325619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":325619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28356,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343484,"statfs":{"total":96636764160,"available":96607727616,"internally_reserved":0,"allocated":1372160,"data_stored":915987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":325619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T04:25:32.019 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T04:25:32.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.119+0000 7f54eeec6640 1 Processor -- start 2024-05-08T04:25:32.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.119+0000 7f54eeec6640 1 -- start start 2024-05-08T04:25:32.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.120+0000 7f54eeec6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54e8158540 0x7f54e815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.120+0000 7f54eeec6640 1 -- --> v1:172.21.15.104:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e8073030 con 0x7f54e80701a0 2024-05-08T04:25:32.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.120+0000 7f54eeec6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e8072210 con 0x7f54e80cd830 2024-05-08T04:25:32.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.120+0000 7f54eeec6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80cbf50 con 0x7f54e8158540 2024-05-08T04:25:32.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.120+0000 7f54e7fff640 1 --1- >> v1:172.21.15.104:6789/0 conn(0x7f54e80701a0 0x7f54e80cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.104:6789/0 says I am v1:172.21.15.104:43350/0 (socket says 172.21.15.104:43350) 2024-05-08T04:25:32.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.120+0000 7f54e7fff640 1 -- 172.21.15.104:0/828178687 learned_addr learned my addr 172.21.15.104:0/828178687 (peer_addr_for_me v1:172.21.15.104:0/0) 2024-05-08T04:25:32.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.120+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 <== mon.0 v1:172.21.15.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208310822 0 0) 0x7f54e8073030 con 0x7f54e80701a0 2024-05-08T04:25:32.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.120+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 --> v1:172.21.15.104:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54d8003520 con 0x7f54e80701a0 2024-05-08T04:25:32.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.120+0000 7f54ecc62640 1 --2- 172.21.15.104:0/828178687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54e8158540 0x7f54e815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 <== mon.0 v1:172.21.15.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 690579988 0 0) 0x7f54d8003520 con 0x7f54e80701a0 2024-05-08T04:25:32.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54e8158540 msgr2=0x7f54e815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:32.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e77fe640 1 --2- 172.21.15.104:0/828178687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54e8158540 0x7f54e815e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 >> v1:172.21.15.183:6789/0 conn(0x7f54e80cd830 legacy=0x7f54e80cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 --> v1:172.21.15.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e815e900 con 0x7f54e80701a0 2024-05-08T04:25:32.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 <== mon.0 v1:172.21.15.104:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421645566 0 0) 0x7f54d4001670 con 0x7f54e80701a0 2024-05-08T04:25:32.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 >> v1:172.21.15.104:6789/0 conn(0x7f54e80701a0 legacy=0x7f54e80cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e77fe640 1 --2- 172.21.15.104:0/828178687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54d80039e0 0x7f54d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e77fe640 1 --2- 172.21.15.104:0/828178687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54d8004800 0x7f54d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e77fe640 1 --2- 172.21.15.104:0/828178687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d80051c0 0x7f54d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d800c030 con 0x7f54d8004800 2024-05-08T04:25:32.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d800c1e0 con 0x7f54d80039e0 2024-05-08T04:25:32.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d800c3e0 con 0x7f54d80051c0 2024-05-08T04:25:32.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54ecc62640 1 --2- 172.21.15.104:0/828178687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54e8158540 0x7f54e815e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:32.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e7fff640 1 --2- 172.21.15.104:0/828178687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54d8004800 0x7f54d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54ed463640 1 --2- 172.21.15.104:0/828178687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d80051c0 0x7f54d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54ecc62640 1 --2- 172.21.15.104:0/828178687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54d80039e0 0x7f54d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e7fff640 1 -- 172.21.15.104:0/828178687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d80051c0 msgr2=0x7f54d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:32.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e7fff640 1 --2- 172.21.15.104:0/828178687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d80051c0 0x7f54d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e7fff640 1 -- 172.21.15.104:0/828178687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54d80039e0 msgr2=0x7f54d8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:32.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e7fff640 1 --2- 172.21.15.104:0/828178687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54d80039e0 0x7f54d8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.121+0000 7f54e7fff640 1 -- 172.21.15.104:0/828178687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d8003520 con 0x7f54d8004800 2024-05-08T04:25:32.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.122+0000 7f54e7fff640 1 --2- 172.21.15.104:0/828178687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54d8004800 0x7f54d8004c80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f54d400c240 tx=0x7f54d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ac46e0da13adec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:32.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.122+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4007d10 con 0x7f54d8004800 2024-05-08T04:25:32.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.122+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d4005ad0 con 0x7f54d8004800 2024-05-08T04:25:32.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.122+0000 7f54e77fe640 1 -- 172.21.15.104:0/828178687 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4007070 con 0x7f54d8004800 2024-05-08T04:25:32.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.122+0000 7f54eeec6640 1 -- 172.21.15.104:0/828178687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54d8004800 msgr2=0x7f54d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.122+0000 7f54eeec6640 1 --2- 172.21.15.104:0/828178687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54d8004800 0x7f54d8004c80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f54d400c240 tx=0x7f54d8005830 comp rx=0 tx=0).stop 2024-05-08T04:25:32.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.122+0000 7f54ed463640 1 -- 172.21.15.104:0/828178687 reap_dead start 2024-05-08T04:25:32.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.122+0000 7f54eeec6640 1 -- 172.21.15.104:0/828178687 shutdown_connections 2024-05-08T04:25:32.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.122+0000 7f54eeec6640 1 -- 172.21.15.104:0/828178687 >> 172.21.15.104:0/828178687 conn(0x7f54e80b23e0 msgr2=0x7f54e80b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:32.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.123+0000 7f54eeec6640 1 -- 172.21.15.104:0/828178687 shutdown_connections 2024-05-08T04:25:32.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.123+0000 7f54eeec6640 1 -- 172.21.15.104:0/828178687 wait complete. 2024-05-08T04:25:32.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.124+0000 7f54eeec6640 1 Processor -- start 2024-05-08T04:25:32.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.124+0000 7f54eeec6640 1 -- start start 2024-05-08T04:25:32.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54eeec6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d8004800 0x7f54e815d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54eeec6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54e815ae40 0x7f54e8159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54eeec6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54e8148ae0 0x7f54e8148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54eeec6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8072a70 con 0x7f54e815ae40 2024-05-08T04:25:32.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54eeec6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8072790 con 0x7f54e8148ae0 2024-05-08T04:25:32.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54eeec6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8072d50 con 0x7f54d8004800 2024-05-08T04:25:32.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54e7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54e815ae40 0x7f54e8159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54e7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54e815ae40 0x7f54e8159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38058/0 (socket says 172.21.15.104:38058) 2024-05-08T04:25:32.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54e7fff640 1 -- 172.21.15.104:0/2061636191 learned_addr learned my addr 172.21.15.104:0/2061636191 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:32.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54ecc62640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d8004800 0x7f54e815d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54ed463640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54e8148ae0 0x7f54e8148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54e7fff640 1 -- 172.21.15.104:0/2061636191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d8004800 msgr2=0x7f54e815d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54e7fff640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d8004800 0x7f54e815d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54e7fff640 1 -- 172.21.15.104:0/2061636191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54e8148ae0 msgr2=0x7f54e8148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54e7fff640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54e8148ae0 0x7f54e8148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54e7fff640 1 -- 172.21.15.104:0/2061636191 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e806b4d0 con 0x7f54e815ae40 2024-05-08T04:25:32.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54ed463640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54e8148ae0 0x7f54e8148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:32.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54e7fff640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54e815ae40 0x7f54e8159c70 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f54d4001970 tx=0x7f54e815add0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:32.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54e57fa640 1 -- 172.21.15.104:0/2061636191 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4042020 con 0x7f54e815ae40 2024-05-08T04:25:32.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54e57fa640 1 -- 172.21.15.104:0/2061636191 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d4004bf0 con 0x7f54e815ae40 2024-05-08T04:25:32.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54eeec6640 1 -- 172.21.15.104:0/2061636191 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e815b3e0 con 0x7f54e815ae40 2024-05-08T04:25:32.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54e57fa640 1 -- 172.21.15.104:0/2061636191 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4007d10 con 0x7f54e815ae40 2024-05-08T04:25:32.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.125+0000 7f54eeec6640 1 -- 172.21.15.104:0/2061636191 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e815b9a0 con 0x7f54e815ae40 2024-05-08T04:25:32.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.127+0000 7f54eeec6640 1 -- 172.21.15.104:0/2061636191 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e8067c10 con 0x7f54e815ae40 2024-05-08T04:25:32.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.127+0000 7f54e57fa640 1 -- 172.21.15.104:0/2061636191 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7f54d4045020 con 0x7f54e815ae40 2024-05-08T04:25:32.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.127+0000 7f54e57fa640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f54cc06b740 0x7f54cc06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.128+0000 7f54e57fa640 1 -- 172.21.15.104:0/2061636191 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f54d40aa890 con 0x7f54e815ae40 2024-05-08T04:25:32.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.128+0000 7f54ecc62640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f54cc06b740 0x7f54cc06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.128+0000 7f54ecc62640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f54cc06b740 0x7f54cc06dc00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f54dc006fd0 tx=0x7f54dc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:32.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.132+0000 7f54e57fa640 1 -- 172.21.15.104:0/2061636191 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f54e8067c10 con 0x7f54e815ae40 2024-05-08T04:25:32.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.310+0000 7f54eeec6640 1 -- 172.21.15.104:0/2061636191 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f54e80745d0 con 0x7f54e815ae40 2024-05-08T04:25:32.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.315+0000 7f54e57fa640 1 -- 172.21.15.104:0/2061636191 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f54d4079740 con 0x7f54e815ae40 2024-05-08T04:25:32.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.316+0000 7f54e57fa640 1 -- 172.21.15.104:0/2061636191 <== mon.0 v2:172.21.15.104:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f54d40b0080 con 0x7f54e815ae40 2024-05-08T04:25:32.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.317+0000 7f54eeec6640 1 -- 172.21.15.104:0/2061636191 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f54cc06b740 msgr2=0x7f54cc06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.317+0000 7f54eeec6640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f54cc06b740 0x7f54cc06dc00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f54dc006fd0 tx=0x7f54dc008040 comp rx=0 tx=0).stop 2024-05-08T04:25:32.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.317+0000 7f54eeec6640 1 -- 172.21.15.104:0/2061636191 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54e815ae40 msgr2=0x7f54e8159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.317+0000 7f54eeec6640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54e815ae40 0x7f54e8159c70 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f54d4001970 tx=0x7f54e815add0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.318+0000 7f54eeec6640 1 -- 172.21.15.104:0/2061636191 shutdown_connections 2024-05-08T04:25:32.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.318+0000 7f54eeec6640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7f54cc06b740 0x7f54cc06dc00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.318+0000 7f54eeec6640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54e8148ae0 0x7f54e8148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.318+0000 7f54eeec6640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54e815ae40 0x7f54e8159c70 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.318+0000 7f54eeec6640 1 --2- 172.21.15.104:0/2061636191 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54d8004800 0x7f54e815d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.318+0000 7f54eeec6640 1 -- 172.21.15.104:0/2061636191 >> 172.21.15.104:0/2061636191 conn(0x7f54e80b23e0 msgr2=0x7f54e80b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:32.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.318+0000 7f54eeec6640 1 -- 172.21.15.104:0/2061636191 shutdown_connections 2024-05-08T04:25:32.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.318+0000 7f54eeec6640 1 -- 172.21.15.104:0/2061636191 wait complete. 2024-05-08T04:25:32.330 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T04:25:32.331 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T04:25:32.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.434+0000 7fbf8fe38640 1 Processor -- start 2024-05-08T04:25:32.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.434+0000 7fbf8fe38640 1 -- start start 2024-05-08T04:25:32.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8fe38640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbf880acdf0 0x7fbf880ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8fe38640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbf8806bb70 0x7fbf8806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8fe38640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf88072c40 con 0x7fbf88161190 2024-05-08T04:25:32.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8fe38640 1 -- --> v2:172.21.15.104:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf880b4db0 con 0x7fbf880acdf0 2024-05-08T04:25:32.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8fe38640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8806de30 con 0x7fbf8806bb70 2024-05-08T04:25:32.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8d3d3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbf880acdf0 0x7fbf880ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8d3d3640 1 --2- >> v2:172.21.15.104:3300/0 conn(0x7fbf880acdf0 0x7fbf880ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38060/0 (socket says 172.21.15.104:38060) 2024-05-08T04:25:32.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8d3d3640 1 -- 172.21.15.104:0/2908977830 learned_addr learned my addr 172.21.15.104:0/2908977830 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:32.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8e3d5640 1 --2- 172.21.15.104:0/2908977830 >> v2:172.21.15.183:3300/0 conn(0x7fbf8806bb70 0x7fbf8806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8d3d3640 1 -- 172.21.15.104:0/2908977830 >> v2:172.21.15.183:3300/0 conn(0x7fbf8806bb70 msgr2=0x7fbf8806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T04:25:32.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8d3d3640 1 --2- 172.21.15.104:0/2908977830 >> v2:172.21.15.183:3300/0 conn(0x7fbf8806bb70 0x7fbf8806c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8d3d3640 1 -- 172.21.15.104:0/2908977830 >> v1:172.21.15.183:6789/0 conn(0x7fbf88161190 legacy=0x7fbf88072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8d3d3640 1 -- 172.21.15.104:0/2908977830 --> v2:172.21.15.104:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8806e110 con 0x7fbf880acdf0 2024-05-08T04:25:32.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.435+0000 7fbf8e3d5640 1 --2- 172.21.15.104:0/2908977830 >> v2:172.21.15.183:3300/0 conn(0x7fbf8806bb70 0x7fbf8806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T04:25:32.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.436+0000 7fbf8d3d3640 1 --2- 172.21.15.104:0/2908977830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf880acdf0 0x7fbf880ad280 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fbf88067400 tx=0x7fbf8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c836c69a6779d605 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:32.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.436+0000 7fbf8cbd2640 1 -- 172.21.15.104:0/2908977830 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84037070 con 0x7fbf880acdf0 2024-05-08T04:25:32.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.436+0000 7fbf8cbd2640 1 -- 172.21.15.104:0/2908977830 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbf84032440 con 0x7fbf880acdf0 2024-05-08T04:25:32.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.436+0000 7fbf8cbd2640 1 -- 172.21.15.104:0/2908977830 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84032830 con 0x7fbf880acdf0 2024-05-08T04:25:32.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.437+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2908977830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf880acdf0 msgr2=0x7fbf880ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.437+0000 7fbf8fe38640 1 --2- 172.21.15.104:0/2908977830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf880acdf0 0x7fbf880ad280 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fbf88067400 tx=0x7fbf8402a270 comp rx=0 tx=0).stop 2024-05-08T04:25:32.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.437+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2908977830 shutdown_connections 2024-05-08T04:25:32.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.437+0000 7fbf8fe38640 1 --2- 172.21.15.104:0/2908977830 >> v2:172.21.15.183:3300/0 conn(0x7fbf8806bb70 0x7fbf8806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.437+0000 7fbf8fe38640 1 --2- 172.21.15.104:0/2908977830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf880acdf0 0x7fbf880ad280 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.437+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2908977830 >> 172.21.15.104:0/2908977830 conn(0x7fbf88071a10 msgr2=0x7fbf88071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:32.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.437+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2908977830 shutdown_connections 2024-05-08T04:25:32.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.437+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2908977830 wait complete. 2024-05-08T04:25:32.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.438+0000 7fbf8fe38640 1 Processor -- start 2024-05-08T04:25:32.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.438+0000 7fbf8fe38640 1 -- start start 2024-05-08T04:25:32.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8fe38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf8806bb70 0x7fbf8814c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8fe38640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf880acdf0 0x7fbf8814d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8fe38640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf88161190 0x7fbf8815e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8fe38640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8806e9b0 con 0x7fbf8806bb70 2024-05-08T04:25:32.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8fe38640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8806e6d0 con 0x7fbf880acdf0 2024-05-08T04:25:32.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8fe38640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8806da70 con 0x7fbf88161190 2024-05-08T04:25:32.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8dbd4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf8806bb70 0x7fbf8814c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8dbd4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf8806bb70 0x7fbf8814c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38064/0 (socket says 172.21.15.104:38064) 2024-05-08T04:25:32.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8dbd4640 1 -- 172.21.15.104:0/2541976514 learned_addr learned my addr 172.21.15.104:0/2541976514 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-05-08T04:25:32.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8e3d5640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf88161190 0x7fbf8815e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8d3d3640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf880acdf0 0x7fbf8814d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8dbd4640 1 -- 172.21.15.104:0/2541976514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf88161190 msgr2=0x7fbf8815e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8dbd4640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf88161190 0x7fbf8815e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8dbd4640 1 -- 172.21.15.104:0/2541976514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf880acdf0 msgr2=0x7fbf8814d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8dbd4640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf880acdf0 0x7fbf8814d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8dbd4640 1 -- 172.21.15.104:0/2541976514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8814e1e0 con 0x7fbf8806bb70 2024-05-08T04:25:32.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8e3d5640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf88161190 0x7fbf8815e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:32.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.439+0000 7fbf8d3d3640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf880acdf0 0x7fbf8814d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T04:25:32.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.440+0000 7fbf8dbd4640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf8806bb70 0x7fbf8814c900 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000c730 tx=0x7fbf8000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:32.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.440+0000 7fbf7a7fc640 1 -- 172.21.15.104:0/2541976514 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80016020 con 0x7fbf8806bb70 2024-05-08T04:25:32.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.440+0000 7fbf7a7fc640 1 -- 172.21.15.104:0/2541976514 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbf80006d50 con 0x7fbf8806bb70 2024-05-08T04:25:32.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.440+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2541976514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8814dc20 con 0x7fbf8806bb70 2024-05-08T04:25:32.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.440+0000 7fbf7a7fc640 1 -- 172.21.15.104:0/2541976514 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80003bd0 con 0x7fbf8806bb70 2024-05-08T04:25:32.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.440+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2541976514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8814ea70 con 0x7fbf8806bb70 2024-05-08T04:25:32.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.441+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2541976514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf88075010 con 0x7fbf8806bb70 2024-05-08T04:25:32.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.441+0000 7fbf7a7fc640 1 -- 172.21.15.104:0/2541976514 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 10) v1 ==== 89984+0+0 (secure 0 0 0) 0x7fbf8000a7f0 con 0x7fbf8806bb70 2024-05-08T04:25:32.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.442+0000 7fbf7a7fc640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbf6c06b740 0x7fbf6c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T04:25:32.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.442+0000 7fbf8d3d3640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbf6c06b740 0x7fbf6c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T04:25:32.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.442+0000 7fbf7a7fc640 1 -- 172.21.15.104:0/2541976514 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbf80089eb0 con 0x7fbf8806bb70 2024-05-08T04:25:32.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.442+0000 7fbf8d3d3640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbf6c06b740 0x7fbf6c06dc00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbf84034000 tx=0x7fbf8402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T04:25:32.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.446+0000 7fbf7a7fc640 1 -- 172.21.15.104:0/2541976514 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbf80020020 con 0x7fbf8806bb70 2024-05-08T04:25:32.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.690+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2541976514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf880b1390 con 0x7fbf8806bb70 2024-05-08T04:25:32.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.691+0000 7fbf7a7fc640 1 -- 172.21.15.104:0/2541976514 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+3711 (secure 0 0 0) 0x7fbf80058d60 con 0x7fbf8806bb70 2024-05-08T04:25:32.692 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-05-08T04:25:32.693 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":31,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5336,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1609011099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1609011099},{"type":"v1","addr":"172.21.15.183:6834","nonce":1609011099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5504,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1243523397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1243523397},{"type":"v1","addr":"172.21.15.183:6835","nonce":1243523397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6354,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3867059822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":3867059822},{"type":"v1","addr":"172.21.15.104:6835","nonce":3867059822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":6357,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6837/3119972029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6836","nonce":3119972029},{"type":"v1","addr":"172.21.15.104:6837","nonce":3119972029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[]} 2024-05-08T04:25:32.693 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 31 2024-05-08T04:25:32.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.693+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2541976514 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbf6c06b740 msgr2=0x7fbf6c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.693+0000 7fbf8fe38640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbf6c06b740 0x7fbf6c06dc00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbf84034000 tx=0x7fbf8402e000 comp rx=0 tx=0).stop 2024-05-08T04:25:32.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.693+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2541976514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf8806bb70 msgr2=0x7fbf8814c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T04:25:32.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.693+0000 7fbf8fe38640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf8806bb70 0x7fbf8814c900 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fbf8000c730 tx=0x7fbf8000cbf0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.693+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2541976514 shutdown_connections 2024-05-08T04:25:32.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.693+0000 7fbf8fe38640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.104:6832/2468818054,v1:172.21.15.104:6833/2468818054] conn(0x7fbf6c06b740 0x7fbf6c06dc00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.693+0000 7fbf8fe38640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf880acdf0 0x7fbf8814d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.693+0000 7fbf8fe38640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf88161190 0x7fbf8815e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.693+0000 7fbf8fe38640 1 --2- 172.21.15.104:0/2541976514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf8806bb70 0x7fbf8814c900 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T04:25:32.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.693+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2541976514 >> 172.21.15.104:0/2541976514 conn(0x7fbf88071a10 msgr2=0x7fbf8815fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T04:25:32.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.693+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2541976514 shutdown_connections 2024-05-08T04:25:32.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-05-08T04:25:32.693+0000 7fbf8fe38640 1 -- 172.21.15.104:0/2541976514 wait complete. 2024-05-08T04:25:32.705 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-08T04:25:32.705 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T04:25:32.705 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T04:25:32.705 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:32.714 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T04:25:32.714 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T04:25:32.714 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:32.766 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T04:25:32.767 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T04:25:32.767 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:32.779 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T04:25:32.779 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T04:25:32.779 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:32.832 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T04:25:32.832 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T04:25:32.832 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T04:25:32.832 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:32.867 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T04:25:32.867 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T04:25:32.867 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:32.939 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T04:25:32.939 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T04:25:32.940 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:33.014 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T04:25:33.014 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T04:25:33.014 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:33.090 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T04:25:33.090 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-08T04:25:33.090 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:33.123 INFO:tasks.ceph.osd.4:Stopped 2024-05-08T04:25:33.123 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-08T04:25:33.123 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:33.190 INFO:tasks.ceph.osd.5:Stopped 2024-05-08T04:25:33.191 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-08T04:25:33.191 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:33.261 INFO:tasks.ceph.osd.6:Stopped 2024-05-08T04:25:33.262 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-08T04:25:33.262 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:33.337 INFO:tasks.ceph.osd.7:Stopped 2024-05-08T04:25:33.338 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T04:25:33.338 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-08T04:25:33.338 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:33.365 INFO:tasks.ceph.mgr.y:Stopped 2024-05-08T04:25:33.365 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T04:25:33.366 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:33.405 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T04:25:33.405 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T04:25:33.405 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T04:25:33.406 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:33.417 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T04:25:33.417 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T04:25:33.417 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:33.458 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T04:25:33.458 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T04:25:33.458 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T04:25:33.511 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T04:25:33.511 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T04:25:33.512 DEBUG:teuthology.orchestra.run.smithi104:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-05-08T04:25:33.547 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:25:33.547 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T04:25:33.733 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:25:33.733 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T04:25:33.854 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:25:33.854 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T04:25:33.922 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:25:33.922 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T04:25:33.978 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:25:33.978 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-08T04:25:34.110 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:25:34.110 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-08T04:25:34.190 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:25:34.190 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-08T04:25:34.246 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:25:34.246 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-08T04:25:34.297 INFO:tasks.ceph:Archiving mon data... 2024-05-08T04:25:34.298 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278/data/mon.a.tgz 2024-05-08T04:25:34.298 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-05-08T04:25:34.314 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.V963tNkOzG 2024-05-08T04:25:34.317 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.V963tNkOzG 2024-05-08T04:25:34.482 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.V963tNkOzG 2024-05-08T04:25:34.566 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.V963tNkOzG is 549KB 2024-05-08T04:25:34.667 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.V963tNkOzG 2024-05-08T04:25:34.682 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278/data/mon.b.tgz 2024-05-08T04:25:34.682 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2024-05-08T04:25:34.702 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.jMzEsomX56 2024-05-08T04:25:34.702 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.jMzEsomX56 2024-05-08T04:25:34.912 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.jMzEsomX56 2024-05-08T04:25:34.995 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.jMzEsomX56 is 752KB 2024-05-08T04:25:35.098 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.jMzEsomX56 2024-05-08T04:25:35.113 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278/data/mon.c.tgz 2024-05-08T04:25:35.113 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2024-05-08T04:25:35.168 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.2VEgM6ep6W 2024-05-08T04:25:35.168 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.2VEgM6ep6W 2024-05-08T04:25:35.364 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.2VEgM6ep6W 2024-05-08T04:25:35.447 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.2VEgM6ep6W is 751KB 2024-05-08T04:25:35.549 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.2VEgM6ep6W 2024-05-08T04:25:35.564 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T04:25:35.564 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T04:25:35.567 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T04:25:35.651 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T04:25:35.683 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T04:25:35.684 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T04:25:35.685 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278/remote/smithi104/crash 2024-05-08T04:25:35.686 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T04:25:35.720 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278/remote/smithi183/crash 2024-05-08T04:25:35.720 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T04:25:35.747 INFO:tasks.ceph:Shutting down logrotate 2024-05-08T04:25:35.747 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:25:35.764 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T04:25:35.843 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T04:25:35.869 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T04:25:35.894 INFO:tasks.ceph:Compressing logs... 2024-05-08T04:25:35.894 DEBUG:teuthology.orchestra.run.smithi104:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T04:25:35.912 DEBUG:teuthology.orchestra.run.smithi183:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T04:25:35.935 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47115.log 2024-05-08T04:25:35.935 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47871.log 2024-05-08T04:25:35.935 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45468.log 2024-05-08T04:25:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35757.log 2024-05-08T04:25:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35466.log 2024-05-08T04:25:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.35757.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T04:25:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.35466.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35757.log.gzgzip 2024-05-08T04:25:35.987 INFO:teuthology.orchestra.run.smithi183.stderr: -5 --verbose -- /var/log/ceph/ceph-client.3.42142.log 2024-05-08T04:25:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph.log: gzip -5 87.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.35466.log.gz -- 2024-05-08T04:25:35.987 INFO:teuthology.orchestra.run.smithi183.stderr: /var/log/ceph/ceph.audit.log 2024-05-08T04:25:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.3.42142.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-08T04:25:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-08T04:25:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.7.log: 90.5% -- replaced with /var/log/ceph/ceph-client.3.42142.log.gz 2024-05-08T04:25:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-08T04:25:35.987 INFO:teuthology.orchestra.run.smithi183.stderr: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T04:25:35.988 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-08T04:25:35.988 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43493.log 2024-05-08T04:25:35.988 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42864.log 2024-05-08T04:25:35.988 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.43493.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-08T04:25:35.988 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.42864.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-08T04:25:35.988 INFO:teuthology.orchestra.run.smithi183.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.1.43493.log.gz 2024-05-08T04:25:35.988 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mgr.x.log: 89.1% -- replaced with /var/log/ceph/ceph-client.1.42864.log.gz 2024-05-08T04:25:35.988 INFO:teuthology.orchestra.run.smithi183.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T04:25:35.989 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41695.log 2024-05-08T04:25:35.989 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-08T04:25:35.989 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35717.log 2024-05-08T04:25:35.989 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.1.41695.log: 89.8% -- replaced with /var/log/ceph/ceph-client.1.41695.log.gz 2024-05-08T04:25:35.989 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35677.log 2024-05-08T04:25:35.989 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.35717.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35717.log.gz 2024-05-08T04:25:35.989 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44236.log 2024-05-08T04:25:35.989 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.35677.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35677.log.gz 2024-05-08T04:25:35.989 INFO:teuthology.orchestra.run.smithi183.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-08T04:25:35.990 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35637.log 2024-05-08T04:25:35.990 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35506.log 2024-05-08T04:25:35.990 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.44236.log: /var/log/ceph/ceph-client.admin.35637.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35637.log.gz 2024-05-08T04:25:35.990 INFO:teuthology.orchestra.run.smithi183.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.1.44236.log.gz 2024-05-08T04:25:35.990 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35546.log 2024-05-08T04:25:35.990 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.35506.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-08T04:25:35.990 INFO:teuthology.orchestra.run.smithi183.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35506.log.gz 2024-05-08T04:25:35.990 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.35546.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35546.log.gz 2024-05-08T04:25:35.991 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-08T04:25:35.991 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35597.log 2024-05-08T04:25:35.991 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 92.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-08T04:25:35.991 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.35597.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35597.log.gz 2024-05-08T04:25:36.006 INFO:teuthology.orchestra.run.smithi183.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-08T04:25:36.026 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53204.log 2024-05-08T04:25:36.027 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47115.log.gz 2024-05-08T04:25:36.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47871.log: /var/log/ceph/ceph-client.admin.45468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47787.log 2024-05-08T04:25:36.027 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47871.log.gz 2024-05-08T04:25:36.027 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45468.log.gz 2024-05-08T04:25:36.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51635.log 2024-05-08T04:25:36.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47787.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53204.log.gz 2024-05-08T04:25:36.027 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55396.log 2024-05-08T04:25:36.027 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47787.log.gz 2024-05-08T04:25:36.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47913.log 2024-05-08T04:25:36.027 INFO:teuthology.orchestra.run.smithi104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51635.log.gz 2024-05-08T04:25:36.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43142.log 2024-05-08T04:25:36.028 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55396.log.gz 2024-05-08T04:25:36.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60402.log 2024-05-08T04:25:36.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43142.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47913.log.gz 2024-05-08T04:25:36.028 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46947.log 2024-05-08T04:25:36.028 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43142.log.gz 2024-05-08T04:25:36.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53938.log 2024-05-08T04:25:36.029 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56679.log 2024-05-08T04:25:36.029 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60402.log.gz 2024-05-08T04:25:36.029 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47357.log 2024-05-08T04:25:36.029 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46947.log.gz 2024-05-08T04:25:36.029 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53938.log.gz 2024-05-08T04:25:36.029 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57401.log 2024-05-08T04:25:36.029 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47357.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56679.log.gz 2024-05-08T04:25:36.029 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59534.log 2024-05-08T04:25:36.029 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57401.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47357.log.gz 2024-05-08T04:25:36.029 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52643.log 2024-05-08T04:25:36.030 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57401.log.gz 2024-05-08T04:25:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36039.log 2024-05-08T04:25:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52242.log 2024-05-08T04:25:36.030 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59534.log.gz 2024-05-08T04:25:36.030 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.52643.log.gz -5 2024-05-08T04:25:36.030 INFO:teuthology.orchestra.run.smithi104.stderr: --verbose --/var/log/ceph/ceph-client.admin.36039.log: /var/log/ceph/ceph-client.admin.48039.log 2024-05-08T04:25:36.030 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36039.log.gz 2024-05-08T04:25:36.030 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57801.log 2024-05-08T04:25:36.031 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48039.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52242.log.gz 2024-05-08T04:25:36.031 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46659.log 2024-05-08T04:25:36.031 INFO:teuthology.orchestra.run.smithi104.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48039.log.gz 2024-05-08T04:25:36.031 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47415.log 2024-05-08T04:25:36.031 INFO:teuthology.orchestra.run.smithi104.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57801.log.gz 2024-05-08T04:25:36.031 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59492.log 2024-05-08T04:25:36.031 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59702.log 2024-05-08T04:25:36.031 INFO:teuthology.orchestra.run.smithi104.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46659.log.gz 2024-05-08T04:25:36.032 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42417.log 2024-05-08T04:25:36.032 INFO:teuthology.orchestra.run.smithi104.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47415.log.gz 2024-05-08T04:25:36.032 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56369.log 2024-05-08T04:25:36.032 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59492.log.gz 2024-05-08T04:25:36.032 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42417.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59702.log.gz 2024-05-08T04:25:36.032 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58925.log 2024-05-08T04:25:36.032 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56369.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42417.log.gz 2024-05-08T04:25:36.032 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57193.log 2024-05-08T04:25:36.033 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56369.log.gz 2024-05-08T04:25:36.033 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45846.log 2024-05-08T04:25:36.033 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58925.log: /var/log/ceph/ceph-client.admin.57193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45300.log 2024-05-08T04:25:36.033 INFO:teuthology.orchestra.run.smithi104.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.58925.log.gz 2024-05-08T04:25:36.033 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45846.log: gzip -5 88.2% --verbose -- /var/log/ceph/ceph-client.admin.43467.log -- replaced with /var/log/ceph/ceph-client.admin.57193.log.gz 2024-05-08T04:25:36.033 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-08T04:25:36.033 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45300.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45846.log.gz 2024-05-08T04:25:36.033 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48849.log 2024-05-08T04:25:36.033 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43467.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45300.log.gz 2024-05-08T04:25:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42803.log 2024-05-08T04:25:36.034 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43467.log.gz 2024-05-08T04:25:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60612.log 2024-05-08T04:25:36.034 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48849.log.gz 2024-05-08T04:25:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54022.log 2024-05-08T04:25:36.034 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46737.log 2024-05-08T04:25:36.034 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42803.log.gz 2024-05-08T04:25:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58179.log 2024-05-08T04:25:36.035 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60612.log.gz 2024-05-08T04:25:36.035 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54022.log.gz 2024-05-08T04:25:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46056.log 2024-05-08T04:25:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58179.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46737.log.gz 2024-05-08T04:25:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57657.log 2024-05-08T04:25:36.035 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49228.log 2024-05-08T04:25:36.036 INFO:teuthology.orchestra.run.smithi104.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.58179.log.gz 2024-05-08T04:25:36.036 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53522.log 88.6% 2024-05-08T04:25:36.036 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46056.log.gz 2024-05-08T04:25:36.036 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49228.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.57657.log.gz 2024-05-08T04:25:36.036 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49451.log 2024-05-08T04:25:36.036 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53522.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49228.log.gz 2024-05-08T04:25:36.036 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51990.log 2024-05-08T04:25:36.036 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53522.log.gz 2024-05-08T04:25:36.037 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46905.log 2024-05-08T04:25:36.037 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49451.log.gz 2024-05-08T04:25:36.037 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51224.log 2024-05-08T04:25:36.037 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46905.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.42333.log 2024-05-08T04:25:36.037 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51990.log.gz 2024-05-08T04:25:36.037 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52032.log 2024-05-08T04:25:36.037 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46905.log.gz 2024-05-08T04:25:36.037 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42333.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T04:25:36.037 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51224.log.gz 2024-05-08T04:25:36.038 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52032.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42333.log.gz 2024-05-08T04:25:36.038 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51146.log 2024-05-08T04:25:36.038 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52032.log.gz 2024-05-08T04:25:36.038 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57927.log 2024-05-08T04:25:36.038 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48123.log 2024-05-08T04:25:36.038 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51146.log: /var/log/ceph/ceph-client.admin.57927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54594.log 2024-05-08T04:25:36.038 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51146.log.gz 2024-05-08T04:25:36.038 INFO:teuthology.orchestra.run.smithi104.stderr: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T04:25:36.039 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7%/var/log/ceph/ceph-client.admin.48123.log: -- replaced with /var/log/ceph/ceph-client.admin.57927.log.gz 2024-05-08T04:25:36.039 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49765.log 2024-05-08T04:25:36.039 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48123.log.gz 2024-05-08T04:25:36.039 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45930.log 2024-05-08T04:25:36.039 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54594.log.gz 2024-05-08T04:25:36.039 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49765.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-08T04:25:36.039 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49765.log.gz 2024-05-08T04:25:36.039 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52559.log 2024-05-08T04:25:36.040 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54930.log 2024-05-08T04:25:36.040 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.2.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45930.log.gz 2024-05-08T04:25:36.040 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56453.log 2024-05-08T04:25:36.040 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52559.log.gz 2024-05-08T04:25:36.040 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49849.log 2024-05-08T04:25:36.040 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56453.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54930.log.gz 2024-05-08T04:25:36.040 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56052.log 2024-05-08T04:25:36.040 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49849.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56453.log.gz 2024-05-08T04:25:36.041 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43140.log 2024-05-08T04:25:36.041 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49849.log.gz 2024-05-08T04:25:36.041 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49639.log 2024-05-08T04:25:36.041 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43140.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56052.log.gz 2024-05-08T04:25:36.041 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52727.log 2024-05-08T04:25:36.041 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43140.log.gz 2024-05-08T04:25:36.041 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41880.log 2024-05-08T04:25:36.041 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49639.log.gz 2024-05-08T04:25:36.041 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45720.log 2024-05-08T04:25:36.042 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41880.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52727.log.gz 2024-05-08T04:25:36.042 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46158.log 2024-05-08T04:25:36.042 INFO:teuthology.orchestra.run.smithi104.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41880.log.gz 2024-05-08T04:25:36.042 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51551.log 2024-05-08T04:25:36.042 INFO:teuthology.orchestra.run.smithi104.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45720.log.gz 2024-05-08T04:25:36.042 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54290.log 2024-05-08T04:25:36.042 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58703.log 2024-05-08T04:25:36.042 INFO:teuthology.orchestra.run.smithi104.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46158.log.gz 2024-05-08T04:25:36.043 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51551.log.gz 2024-05-08T04:25:36.043 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42799.log 2024-05-08T04:25:36.043 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54290.log.gz 2024-05-08T04:25:36.043 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51677.log 2024-05-08T04:25:36.043 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42799.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58703.log.gz 2024-05-08T04:25:36.043 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45888.log 2024-05-08T04:25:36.043 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51677.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42799.log.gz 2024-05-08T04:25:36.043 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53288.log 2024-05-08T04:25:36.043 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51677.log.gz 2024-05-08T04:25:36.043 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54762.log 2024-05-08T04:25:36.044 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53288.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45888.log.gz 2024-05-08T04:25:36.044 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52284.log 2024-05-08T04:25:36.044 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54762.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53288.log.gz 2024-05-08T04:25:36.044 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41968.log 2024-05-08T04:25:36.044 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54762.log.gz 2024-05-08T04:25:36.044 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57885.log 2024-05-08T04:25:36.044 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41968.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52284.log.gz 2024-05-08T04:25:36.044 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T04:25:36.045 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41968.log.gz 2024-05-08T04:25:36.045 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48934.log 2024-05-08T04:25:36.045 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57885.log.gz 2024-05-08T04:25:36.045 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57843.log 2024-05-08T04:25:36.045 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54888.log 2024-05-08T04:25:36.045 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48934.log.gz 2024-05-08T04:25:36.045 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55848.log 2024-05-08T04:25:36.045 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57843.log.gz 2024-05-08T04:25:36.046 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42165.log 2024-05-08T04:25:36.046 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54888.log: /var/log/ceph/ceph-client.admin.55848.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.54888.log.gz 2024-05-08T04:25:36.046 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55272.log 2024-05-08T04:25:36.046 INFO:teuthology.orchestra.run.smithi104.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T04:25:36.046 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58504.log 2024-05-08T04:25:36.046 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55848.log.gz 2024-05-08T04:25:36.046 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42165.log: /var/log/ceph/ceph-client.admin.55272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49060.log 2024-05-08T04:25:36.046 INFO:teuthology.orchestra.run.smithi104.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42165.log.gz 2024-05-08T04:25:36.047 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55272.log.gz 2024-05-08T04:25:36.047 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.58504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54846.log 2024-05-08T04:25:36.047 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58829.log 2024-05-08T04:25:36.047 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49060.log.gz 2024-05-08T04:25:36.047 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59171.log 2024-05-08T04:25:36.047 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.0.58504.log.gz 2024-05-08T04:25:36.047 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54846.log.gz 2024-05-08T04:25:36.047 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56892.log 2024-05-08T04:25:36.047 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58829.log: /var/log/ceph/ceph-client.admin.59171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43139.log 2024-05-08T04:25:36.048 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58829.log.gz 2024-05-08T04:25:36.048 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59171.log.gz 2024-05-08T04:25:36.048 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45342.log 2024-05-08T04:25:36.048 INFO:teuthology.orchestra.run.smithi104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56892.log.gz 2024-05-08T04:25:36.048 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51062.log 2024-05-08T04:25:36.048 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45342.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43139.log.gz 2024-05-08T04:25:36.048 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55148.log 2024-05-08T04:25:36.048 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51062.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.45342.log.gz --verbose 2024-05-08T04:25:36.049 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.59828.log 2024-05-08T04:25:36.049 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55148.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51062.log.gz 2024-05-08T04:25:36.049 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48646.log 2024-05-08T04:25:36.049 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58883.log 2024-05-08T04:25:36.049 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55148.log.gz 2024-05-08T04:25:36.049 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59828.log.gz 2024-05-08T04:25:36.049 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55786.log 2024-05-08T04:25:36.049 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48646.log.gz 2024-05-08T04:25:36.049 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60738.log 2024-05-08T04:25:36.050 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55786.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.48333.log -- replaced with /var/log/ceph/ceph-client.admin.58883.log.gz 2024-05-08T04:25:36.050 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-08T04:25:36.050 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55786.log.gz 2024-05-08T04:25:36.050 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59954.log 2024-05-08T04:25:36.050 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60738.log.gz 2024-05-08T04:25:36.050 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59417.log 2024-05-08T04:25:36.050 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59954.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48333.log.gz 2024-05-08T04:25:36.051 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48501.log 2024-05-08T04:25:36.051 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59954.log.gz 2024-05-08T04:25:36.051 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54720.log 2024-05-08T04:25:36.051 INFO:teuthology.orchestra.run.smithi104.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59417.log.gz 2024-05-08T04:25:36.051 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54390.log 2024-05-08T04:25:36.051 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54720.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48501.log.gz 2024-05-08T04:25:36.051 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-08T04:25:36.051 INFO:teuthology.orchestra.run.smithi104.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54720.log.gz 2024-05-08T04:25:36.052 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54636.log 2024-05-08T04:25:36.052 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54390.log.gz 2024-05-08T04:25:36.052 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60444.log 2024-05-08T04:25:36.052 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46863.log 2024-05-08T04:25:36.052 INFO:teuthology.orchestra.run.smithi104.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54636.log.gz 2024-05-08T04:25:36.052 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50978.log 2024-05-08T04:25:36.052 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42501.log 2024-05-08T04:25:36.052 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60444.log.gz 2024-05-08T04:25:36.052 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46863.log: /var/log/ceph/ceph-client.admin.50978.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46863.log.gz 2024-05-08T04:25:36.053 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48375.log 2024-05-08T04:25:36.053 INFO:teuthology.orchestra.run.smithi104.stderr:gzip 89.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.50978.log.gz --verbose 2024-05-08T04:25:36.053 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.43719.log 2024-05-08T04:25:36.053 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42501.log: /var/log/ceph/ceph-client.admin.48375.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42501.log.gz 2024-05-08T04:25:36.053 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51020.log 2024-05-08T04:25:36.053 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48375.log.gz 2024-05-08T04:25:36.053 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47457.log 2024-05-08T04:25:36.053 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43719.log: /var/log/ceph/ceph-client.admin.51020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57113.log 2024-05-08T04:25:36.054 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43719.log.gz 2024-05-08T04:25:36.054 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51020.log.gz 2024-05-08T04:25:36.054 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44612.log 2024-05-08T04:25:36.054 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47457.log.gz 2024-05-08T04:25:36.054 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43145.log 2024-05-08T04:25:36.054 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57113.log.gz 2024-05-08T04:25:36.054 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50699.log 2024-05-08T04:25:36.054 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44612.log: /var/log/ceph/ceph-client.admin.43145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50899.log 2024-05-08T04:25:36.054 INFO:teuthology.orchestra.run.smithi104.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44612.log.gz 2024-05-08T04:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50699.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43145.log.gz 2024-05-08T04:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42037.log 2024-05-08T04:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50699.log.gz 2024-05-08T04:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49316.log 2024-05-08T04:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50899.log: /var/log/ceph/ceph-client.admin.42037.log: gzip 89.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.50899.log.gz --verbose 2024-05-08T04:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.59744.log 2024-05-08T04:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56411.log 2024-05-08T04:25:36.055 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49316.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42037.log.gz 2024-05-08T04:25:36.056 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54164.log 2024-05-08T04:25:36.056 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49316.log.gz 2024-05-08T04:25:36.056 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50755.log 89.0% 2024-05-08T04:25:36.056 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59744.log.gz 2024-05-08T04:25:36.056 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54164.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56411.log.gz 2024-05-08T04:25:36.056 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45594.log 2024-05-08T04:25:36.056 INFO:teuthology.orchestra.run.smithi104.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54164.log.gz 2024-05-08T04:25:36.056 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43803.log 2024-05-08T04:25:36.057 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50755.log: /var/log/ceph/ceph-client.admin.45594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61134.log 2024-05-08T04:25:36.057 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50755.log.gz 2024-05-08T04:25:36.057 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45594.log.gz 2024-05-08T04:25:36.057 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43383.log 2024-05-08T04:25:36.057 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43803.log.gz 2024-05-08T04:25:36.057 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49891.log 2024-05-08T04:25:36.057 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61134.log: /var/log/ceph/ceph-client.admin.43383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45510.log 2024-05-08T04:25:36.057 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61134.log.gz 2024-05-08T04:25:36.057 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49891.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43383.log.gz 2024-05-08T04:25:36.058 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54804.log 2024-05-08T04:25:36.058 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49891.log.gz 2024-05-08T04:25:36.058 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48165.log 2024-05-08T04:25:36.058 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56850.log 2024-05-08T04:25:36.058 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54804.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45510.log.gz 2024-05-08T04:25:36.058 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48165.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54804.log.gz 2024-05-08T04:25:36.058 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48891.log 2024-05-08T04:25:36.058 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48165.log.gz 2024-05-08T04:25:36.059 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43677.log 2024-05-08T04:25:36.059 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56850.log: /var/log/ceph/ceph-client.admin.48891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42207.log 2024-05-08T04:25:36.059 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56850.log.gz 2024-05-08T04:25:36.059 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43677.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48891.log.gz 2024-05-08T04:25:36.059 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47703.log 2024-05-08T04:25:36.059 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42207.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43677.log.gz 2024-05-08T04:25:36.059 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-08T04:25:36.059 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42207.log.gz 2024-05-08T04:25:36.059 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58745.log 2024-05-08T04:25:36.060 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47703.log.gz 2024-05-08T04:25:36.060 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42375.log 2024-05-08T04:25:36.060 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.58745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51509.log 2024-05-08T04:25:36.060 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58745.log.gz 2024-05-08T04:25:36.060 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46480.log 2024-05-08T04:25:36.060 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59660.log 2024-05-08T04:25:36.060 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51509.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42375.log.gz 2024-05-08T04:25:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57359.log 2024-05-08T04:25:36.061 INFO:teuthology.orchestra.run.smithi104.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51509.log.gz 2024-05-08T04:25:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60990.log 2024-05-08T04:25:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59660.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46480.log.gz 2024-05-08T04:25:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57359.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59660.log.gz 2024-05-08T04:25:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52074.log 2024-05-08T04:25:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43887.log 2024-05-08T04:25:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60990.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57359.log.gz 2024-05-08T04:25:36.061 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52074.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60990.log.gz 2024-05-08T04:25:36.062 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42123.log 2024-05-08T04:25:36.062 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52074.log.gz 2024-05-08T04:25:36.062 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54678.log 2024-05-08T04:25:36.062 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43887.log: /var/log/ceph/ceph-client.admin.42123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55094.log 2024-05-08T04:25:36.062 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43887.log.gz 2024-05-08T04:25:36.062 INFO:teuthology.orchestra.run.smithi104.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42123.log.gz 2024-05-08T04:25:36.062 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54432.log 2024-05-08T04:25:36.062 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56724.log 2024-05-08T04:25:36.062 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0%/var/log/ceph/ceph-client.admin.55094.log: -- replaced with /var/log/ceph/ceph-client.admin.54678.log.gz 2024-05-08T04:25:36.063 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46337.log 2024-05-08T04:25:36.063 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55094.log.gz 2024-05-08T04:25:36.063 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54432.log.gz 2024-05-08T04:25:36.063 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52950.log 2024-05-08T04:25:36.063 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56724.log: /var/log/ceph/ceph-client.admin.46337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56327.log 2024-05-08T04:25:36.063 INFO:teuthology.orchestra.run.smithi104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56724.log.gz 2024-05-08T04:25:36.063 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46337.log.gz 2024-05-08T04:25:36.063 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52950.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-08T04:25:36.064 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42808.log 2024-05-08T04:25:36.064 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3%/var/log/ceph/ceph-client.admin.56327.log: -- replaced with /var/log/ceph/ceph-client.admin.52950.log.gz 2024-05-08T04:25:36.064 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-08T04:25:36.064 INFO:teuthology.orchestra.run.smithi104.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56327.log.gz 2024-05-08T04:25:36.064 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53246.log 2024-05-08T04:25:36.064 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42808.log: /var/log/ceph/ceph-mgr.y.log: gzip 88.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.53980.log 2024-05-08T04:25:36.064 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42808.log.gz 2024-05-08T04:25:36.064 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60122.log 2024-05-08T04:25:36.064 INFO:teuthology.orchestra.run.smithi104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53246.log.gz/var/log/ceph/ceph-client.admin.53980.log: 2024-05-08T04:25:36.065 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49102.log 2024-05-08T04:25:36.065 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53980.log.gz 2024-05-08T04:25:36.065 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47583.log 2024-05-08T04:25:36.065 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60122.log: /var/log/ceph/ceph-client.admin.49102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53120.log 2024-05-08T04:25:36.065 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47583.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49102.log.gz 2024-05-08T04:25:36.065 INFO:teuthology.orchestra.run.smithi104.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60122.log.gz 2024-05-08T04:25:36.065 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48726.log 2024-05-08T04:25:36.065 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47583.log.gz 2024-05-08T04:25:36.065 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-08T04:25:36.066 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53120.log: /var/log/ceph/ceph-client.admin.48726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59786.log 2024-05-08T04:25:36.066 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.0.log: 88.4% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48726.log.gz 2024-05-08T04:25:36.066 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53120.log.gz 2024-05-08T04:25:36.066 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55458.log 2024-05-08T04:25:36.066 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42249.log 2024-05-08T04:25:36.066 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59786.log.gz 2024-05-08T04:25:36.066 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55458.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55458.log.gz 2024-05-08T04:25:36.066 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55928.log 2024-05-08T04:25:36.067 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59996.log 2024-05-08T04:25:36.067 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42249.log: /var/log/ceph/ceph-client.admin.55928.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42249.log.gz 2024-05-08T04:25:36.067 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55928.log.gz 2024-05-08T04:25:36.067 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50457.log 2024-05-08T04:25:36.067 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59996.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59996.log.gz 2024-05-08T04:25:36.067 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59249.log 2024-05-08T04:25:36.067 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48081.log 2024-05-08T04:25:36.067 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50457.log: /var/log/ceph/ceph-client.admin.59249.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50457.log.gz 2024-05-08T04:25:36.067 INFO:teuthology.orchestra.run.smithi104.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.59249.log.gz 2024-05-08T04:25:36.067 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60486.log 2024-05-08T04:25:36.068 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48081.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48081.log.gz 2024-05-08T04:25:36.068 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59087.log 2024-05-08T04:25:36.068 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51266.log 2024-05-08T04:25:36.068 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60486.log: /var/log/ceph/ceph-client.admin.59087.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60486.log.gz 2024-05-08T04:25:36.068 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59087.log.gz 2024-05-08T04:25:36.068 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42806.log 2024-05-08T04:25:36.068 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51266.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51266.log.gz 2024-05-08T04:25:36.068 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48459.log 2024-05-08T04:25:36.068 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42585.log 2024-05-08T04:25:36.068 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42806.log: /var/log/ceph/ceph-client.admin.48459.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42806.log.gz 2024-05-08T04:25:36.069 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48459.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49495.log 2024-05-08T04:25:36.069 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-08T04:25:36.069 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42585.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42585.log.gz 2024-05-08T04:25:36.069 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45678.log 2024-05-08T04:25:36.069 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55990.log 2024-05-08T04:25:36.069 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49495.log: /var/log/ceph/ceph-client.admin.45678.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49495.log.gz 2024-05-08T04:25:36.069 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45678.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54206.log 2024-05-08T04:25:36.069 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-08T04:25:36.070 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55990.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55990.log.gz 2024-05-08T04:25:36.070 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46379.log 2024-05-08T04:25:36.070 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47315.log 2024-05-08T04:25:36.070 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54206.log: /var/log/ceph/ceph-client.admin.46379.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54206.log.gz 2024-05-08T04:25:36.070 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46379.log.gz 2024-05-08T04:25:36.070 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53162.log 2024-05-08T04:25:36.070 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45552.log 2024-05-08T04:25:36.070 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47315.log: /var/log/ceph/ceph-client.admin.53162.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47315.log.gz 2024-05-08T04:25:36.071 INFO:teuthology.orchestra.run.smithi104.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53162.log.gz 2024-05-08T04:25:36.071 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42809.log 2024-05-08T04:25:36.071 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45552.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45552.log.gz 2024-05-08T04:25:36.071 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60038.log 2024-05-08T04:25:36.071 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60570.log 2024-05-08T04:25:36.071 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42809.log: /var/log/ceph/ceph-client.admin.60038.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42809.log.gz 2024-05-08T04:25:36.071 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60038.log.gz 2024-05-08T04:25:36.071 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52601.log 2024-05-08T04:25:36.071 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60570.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60570.log.gz 2024-05-08T04:25:36.071 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47955.log 2024-05-08T04:25:36.072 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48249.log 2024-05-08T04:25:36.072 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52601.log: /var/log/ceph/ceph-client.admin.47955.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52601.log.gz 2024-05-08T04:25:36.072 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47955.log.gz 2024-05-08T04:25:36.072 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53456.log 2024-05-08T04:25:36.072 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48249.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48249.log.gz 2024-05-08T04:25:36.072 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53372.log 2024-05-08T04:25:36.072 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56495.log 2024-05-08T04:25:36.072 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53456.log: /var/log/ceph/ceph-client.admin.53372.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53372.log.gz 2024-05-08T04:25:36.072 INFO:teuthology.orchestra.run.smithi104.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53456.log.gz 2024-05-08T04:25:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41627.log 2024-05-08T04:25:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44489.log 2024-05-08T04:25:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56495.log: /var/log/ceph/ceph-client.admin.41627.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56495.log.gz 2024-05-08T04:25:36.073 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41627.log.gzgzip 2024-05-08T04:25:36.073 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58245.log 2024-05-08T04:25:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.44489.log: 89.9% -- replaced with /var/log/ceph/ceph-client.0.44489.log.gz 2024-05-08T04:25:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49933.log 2024-05-08T04:25:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-08T04:25:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58245.log: /var/log/ceph/ceph-client.admin.49933.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58245.log.gz 2024-05-08T04:25:36.074 INFO:teuthology.orchestra.run.smithi104.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49933.log.gz 2024-05-08T04:25:36.074 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55032.log 2024-05-08T04:25:36.074 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54474.log 2024-05-08T04:25:36.074 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55032.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55032.log.gz 2024-05-08T04:25:36.075 INFO:teuthology.orchestra.run.smithi183.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-08T04:25:36.127 INFO:teuthology.orchestra.run.smithi183.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-08T04:25:36.148 INFO:teuthology.orchestra.run.smithi183.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-08T04:25:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55724.log 2024-05-08T04:25:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54474.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54474.log.gz 2024-05-08T04:25:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47031.log 2024-05-08T04:25:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55724.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55724.log.gz 2024-05-08T04:25:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48417.log 2024-05-08T04:25:36.181 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47031.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47031.log.gz 2024-05-08T04:25:36.182 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41358.log 2024-05-08T04:25:36.182 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48417.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48417.log.gz 2024-05-08T04:25:36.182 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43593.log 2024-05-08T04:25:36.182 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41358.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41358.log.gz 2024-05-08T04:25:36.182 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49723.log 2024-05-08T04:25:36.182 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43593.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43593.log.gz 2024-05-08T04:25:36.182 INFO:teuthology.orchestra.run.smithi104.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-08T04:25:36.182 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42798.log 2024-05-08T04:25:36.183 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52771.log 2024-05-08T04:25:36.183 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0%/var/log/ceph/ceph-client.admin.42798.log: -- replaced with /var/log/ceph/ceph-client.admin.49723.log.gz 2024-05-08T04:25:36.183 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49186.log 2024-05-08T04:25:36.183 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42798.log.gz 2024-05-08T04:25:36.183 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51719.log 2024-05-08T04:25:36.183 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52771.log: /var/log/ceph/ceph-client.admin.49186.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52771.log.gz 2024-05-08T04:25:36.183 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49186.log.gz 2024-05-08T04:25:36.183 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51467.log 2024-05-08T04:25:36.184 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59129.log 2024-05-08T04:25:36.184 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51719.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51719.log.gz 2024-05-08T04:25:36.184 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50583.log 2024-05-08T04:25:36.184 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51467.log.gz 2024-05-08T04:25:36.184 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59870.log 2024-05-08T04:25:36.184 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50583.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59129.log.gz 2024-05-08T04:25:36.184 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50583.log.gz 2024-05-08T04:25:36.184 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43425.log 2024-05-08T04:25:36.185 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61176.log 2024-05-08T04:25:36.185 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59870.log: /var/log/ceph/ceph-client.admin.43425.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59870.log.gz 2024-05-08T04:25:36.185 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43425.log.gz 2024-05-08T04:25:36.185 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47189.log 2024-05-08T04:25:36.185 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58095.log 2024-05-08T04:25:36.185 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61176.log: /var/log/ceph/ceph-client.admin.47189.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61176.log.gz 2024-05-08T04:25:36.185 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47189.log.gz 2024-05-08T04:25:36.185 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55210.log 2024-05-08T04:25:36.186 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44073.log 2024-05-08T04:25:36.186 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58095.log: /var/log/ceph/ceph-client.admin.55210.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58095.log.gz 2024-05-08T04:25:36.186 INFO:teuthology.orchestra.run.smithi104.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55210.log.gz 2024-05-08T04:25:36.186 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45106.log 2024-05-08T04:25:36.186 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45426.log 2024-05-08T04:25:36.186 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44073.log: /var/log/ceph/ceph-client.admin.45106.log: 88.7% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45106.log.gz 2024-05-08T04:25:36.186 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44073.log.gz 2024-05-08T04:25:36.186 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54122.log 2024-05-08T04:25:36.186 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51308.log 2024-05-08T04:25:36.187 INFO:teuthology.orchestra.run.smithi104.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45426.log.gz 2024-05-08T04:25:36.187 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45972.log 2024-05-08T04:25:36.187 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51308.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54122.log.gz 2024-05-08T04:25:36.187 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56934.log 2024-05-08T04:25:36.187 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51308.log.gz 2024-05-08T04:25:36.187 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60948.log 2024-05-08T04:25:36.187 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45972.log: /var/log/ceph/ceph-client.admin.56934.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45972.log.gz 2024-05-08T04:25:36.187 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56934.log.gz 2024-05-08T04:25:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57699.log 2024-05-08T04:25:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52158.log 2024-05-08T04:25:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60948.log: /var/log/ceph/ceph-client.admin.57699.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60948.log.gz 2024-05-08T04:25:36.188 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57699.log.gz 2024-05-08T04:25:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51803.log 2024-05-08T04:25:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52200.log 2024-05-08T04:25:36.188 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52158.log.gz 2024-05-08T04:25:36.188 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46779.log 2024-05-08T04:25:36.188 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51803.log.gz 2024-05-08T04:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52200.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55600.log 2024-05-08T04:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52200.log.gz 2024-05-08T04:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42291.log 2024-05-08T04:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46779.log: /var/log/ceph/ceph-client.admin.55600.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2024-05-08T04:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55334.log 2024-05-08T04:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55600.log.gz 2024-05-08T04:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49272.log 2024-05-08T04:25:36.189 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42291.log: /var/log/ceph/ceph-client.admin.55334.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42291.log.gz 2024-05-08T04:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55334.log.gz 2024-05-08T04:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51392.log 2024-05-08T04:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49272.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49272.log.gz 2024-05-08T04:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56243.log 2024-05-08T04:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41924.log 2024-05-08T04:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51392.log.gz 2024-05-08T04:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56243.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59003.log 2024-05-08T04:25:36.190 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56243.log.gz 2024-05-08T04:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42627.log 2024-05-08T04:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41924.log: /var/log/ceph/ceph-client.admin.59003.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41924.log.gz 2024-05-08T04:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59003.log.gz 2024-05-08T04:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57487.log 2024-05-08T04:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58137.log 2024-05-08T04:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42627.log.gz 2024-05-08T04:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57531.log 2024-05-08T04:25:36.191 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58137.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57487.log.gz 2024-05-08T04:25:36.192 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55662.log 2024-05-08T04:25:36.192 INFO:teuthology.orchestra.run.smithi104.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58137.log.gz 2024-05-08T04:25:36.192 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49555.log 2024-05-08T04:25:36.192 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55662.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57531.log.gz 2024-05-08T04:25:36.192 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55662.log.gz 2024-05-08T04:25:36.192 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46821.log 2024-05-08T04:25:36.192 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56201.log 2024-05-08T04:25:36.192 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49555.log: /var/log/ceph/ceph-client.admin.46821.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49555.log.gz 2024-05-08T04:25:36.192 INFO:teuthology.orchestra.run.smithi104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46821.log.gz 2024-05-08T04:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50041.log 2024-05-08T04:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43141.log 2024-05-08T04:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56201.log: /var/log/ceph/ceph-client.admin.50041.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56201.log.gz 2024-05-08T04:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50041.log.gz 2024-05-08T04:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43635.log 2024-05-08T04:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41838.log 2024-05-08T04:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43141.log: /var/log/ceph/ceph-client.admin.43635.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43141.log.gz 2024-05-08T04:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43635.log.gz 2024-05-08T04:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45384.log 2024-05-08T04:25:36.193 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47661.log 2024-05-08T04:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41838.log: /var/log/ceph/ceph-client.admin.45384.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41838.log.gz 2024-05-08T04:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45384.log.gz 2024-05-08T04:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52459.log 2024-05-08T04:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46295.log 2024-05-08T04:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47661.log: /var/log/ceph/ceph-client.admin.52459.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47661.log.gz 2024-05-08T04:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52459.log.gz 2024-05-08T04:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41796.log 2024-05-08T04:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41754.log 2024-05-08T04:25:36.194 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46295.log: /var/log/ceph/ceph-client.admin.41796.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46295.log.gz 2024-05-08T04:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41796.log.gz 2024-05-08T04:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56621.log 2024-05-08T04:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46098.log 2024-05-08T04:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41754.log: /var/log/ceph/ceph-client.admin.56621.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41754.log.gz 2024-05-08T04:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58053.log 2024-05-08T04:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56621.log.gz 2024-05-08T04:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45762.log 2024-05-08T04:25:36.195 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58053.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46098.log.gz 2024-05-08T04:25:36.196 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58053.log.gz 2024-05-08T04:25:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42459.log 2024-05-08T04:25:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52116.log 2024-05-08T04:25:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42459.log: /var/log/ceph/ceph-client.admin.45762.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45762.log.gz 2024-05-08T04:25:36.196 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42459.log.gz 2024-05-08T04:25:36.196 INFO:teuthology.orchestra.run.smithi104.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-08T04:25:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41712.log 2024-05-08T04:25:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59912.log 2024-05-08T04:25:36.196 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52116.log: /var/log/ceph/ceph-client.admin.41712.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52116.log.gz 2024-05-08T04:25:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56766.log 2024-05-08T04:25:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43551.log 2024-05-08T04:25:36.197 INFO:teuthology.orchestra.run.smithi104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41712.log.gz 2024-05-08T04:25:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56766.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59912.log.gz 2024-05-08T04:25:36.197 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56766.log.gz 2024-05-08T04:25:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47273.log 2024-05-08T04:25:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60696.log 2024-05-08T04:25:36.197 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47273.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43551.log.gz 2024-05-08T04:25:36.198 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48291.log 2024-05-08T04:25:36.198 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47273.log.gz 2024-05-08T04:25:36.198 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44984.log 2024-05-08T04:25:36.198 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60696.log: /var/log/ceph/ceph-client.admin.48291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60528.log 2024-05-08T04:25:36.198 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60696.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48291.log.gz 2024-05-08T04:25:36.198 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-08T04:25:36.198 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.2.44984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54248.log 2024-05-08T04:25:36.198 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43509.log 2024-05-08T04:25:36.198 INFO:teuthology.orchestra.run.smithi104.stderr: 90.8% 88.8% -- replaced with /var/log/ceph/ceph-client.2.44984.log.gz 2024-05-08T04:25:36.199 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60528.log.gz 2024-05-08T04:25:36.199 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51845.log 2024-05-08T04:25:36.199 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54248.log.gz 2024-05-08T04:25:36.199 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59375.log 2024-05-08T04:25:36.199 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49681.log 2024-05-08T04:25:36.199 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43509.log.gz 2024-05-08T04:25:36.199 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51845.log: gzip -5/var/log/ceph/ceph-client.admin.59375.log: --verbose -- /var/log/ceph/ceph-client.admin.45636.log 2024-05-08T04:25:36.199 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51845.log.gz 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59375.log.gz 2024-05-08T04:25:36.199 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-08T04:25:36.200 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53414.log 2024-05-08T04:25:36.200 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49681.log.gz 2024-05-08T04:25:36.200 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61032.log 2024-05-08T04:25:36.200 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45636.log.gz 2024-05-08T04:25:36.200 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57741.log 2024-05-08T04:25:36.200 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53414.log.gz 2024-05-08T04:25:36.200 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57018.log 2024-05-08T04:25:36.200 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61032.log.gz 2024-05-08T04:25:36.200 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45804.log 2024-05-08T04:25:36.201 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57741.log.gz 2024-05-08T04:25:36.201 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56579.log 2024-05-08T04:25:36.201 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57018.log.gz 2024-05-08T04:25:36.201 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46989.log 2024-05-08T04:25:36.201 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45804.log: /var/log/ceph/ceph-client.admin.56579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53781.log 2024-05-08T04:25:36.201 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45804.log.gz 2024-05-08T04:25:36.201 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8%/var/log/ceph/ceph-client.admin.46989.log: -- replaced with /var/log/ceph/ceph-client.admin.56579.log.gz 2024-05-08T04:25:36.201 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41669.log 2024-05-08T04:25:36.202 INFO:teuthology.orchestra.run.smithi104.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46989.log.gz 2024-05-08T04:25:36.202 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.53781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60864.log 2024-05-08T04:25:36.202 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52379.log 2024-05-08T04:25:36.202 INFO:teuthology.orchestra.run.smithi104.stderr: 89.2% 89.0% -- replaced with /var/log/ceph/ceph-client.0.53781.log.gz 2024-05-08T04:25:36.202 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41669.log.gz 2024-05-08T04:25:36.202 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51350.log 2024-05-08T04:25:36.202 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60864.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59291.log 2024-05-08T04:25:36.202 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-08T04:25:36.203 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52379.log: /var/log/ceph/ceph-client.admin.51350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47073.log 2024-05-08T04:25:36.203 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59291.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52379.log.gz 2024-05-08T04:25:36.203 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51350.log.gz 2024-05-08T04:25:36.203 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43845.log 2024-05-08T04:25:36.203 INFO:teuthology.orchestra.run.smithi104.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59291.log.gz 2024-05-08T04:25:36.203 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52994.log 2024-05-08T04:25:36.203 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43761.log 2024-05-08T04:25:36.203 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47073.log.gz 2024-05-08T04:25:36.203 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1%/var/log/ceph/ceph-client.admin.52994.log: -- replaced with /var/log/ceph/ceph-client.admin.43845.log.gz 2024-05-08T04:25:36.204 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51104.log 2024-05-08T04:25:36.204 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43144.log 2024-05-08T04:25:36.204 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52994.log.gz 2024-05-08T04:25:36.204 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51104.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60822.log 2024-05-08T04:25:36.204 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43761.log.gz 2024-05-08T04:25:36.204 INFO:teuthology.orchestra.run.smithi104.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51104.log.gz 2024-05-08T04:25:36.204 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49975.log 2024-05-08T04:25:36.204 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43144.log: /var/log/ceph/ceph-client.admin.60822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43143.log 2024-05-08T04:25:36.204 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43144.log.gz 2024-05-08T04:25:36.205 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49975.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60822.log.gz 2024-05-08T04:25:36.205 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45148.log 2024-05-08T04:25:36.205 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43143.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.49975.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59333.log 2024-05-08T04:25:36.205 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-08T04:25:36.205 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43143.log.gz 2024-05-08T04:25:36.205 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-client.admin.45148.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60080.log 2024-05-08T04:25:36.205 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59333.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45148.log.gz 2024-05-08T04:25:36.205 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56537.log 2024-05-08T04:25:36.205 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59333.log.gz 2024-05-08T04:25:36.206 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57443.log 2024-05-08T04:25:36.206 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60080.log: /var/log/ceph/ceph-client.admin.56537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48807.log 2024-05-08T04:25:36.206 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57443.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60080.log.gz 2024-05-08T04:25:36.206 INFO:teuthology.orchestra.run.smithi104.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56537.log.gz 2024-05-08T04:25:36.206 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57443.log.gz 2024-05-08T04:25:36.206 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.57969.log 2024-05-08T04:25:36.206 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48807.log: gzip -5 --verbose -- 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48807.log.gz 2024-05-08T04:25:36.206 INFO:teuthology.orchestra.run.smithi104.stderr: /var/log/ceph/ceph-client.admin.54516.log 2024-05-08T04:25:36.207 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58787.log 2024-05-08T04:25:36.207 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57969.log.gz 2024-05-08T04:25:36.207 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57317.log 2024-05-08T04:25:36.207 INFO:teuthology.orchestra.run.smithi104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54516.log.gz 2024-05-08T04:25:36.207 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59576.log 2024-05-08T04:25:36.207 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52815.log 2024-05-08T04:25:36.207 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9%/var/log/ceph/ceph-client.admin.57317.log: -- replaced with /var/log/ceph/ceph-client.admin.58787.log.gz 2024-05-08T04:25:36.207 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46530.log 2024-05-08T04:25:36.207 INFO:teuthology.orchestra.run.smithi104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57317.log.gz 2024-05-08T04:25:36.208 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59576.log.gz 2024-05-08T04:25:36.208 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47997.log 2024-05-08T04:25:36.208 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52815.log.gz/var/log/ceph/ceph-client.admin.46530.log: 2024-05-08T04:25:36.208 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46014.log 2024-05-08T04:25:36.208 INFO:teuthology.orchestra.run.smithi104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46530.log.gz 2024-05-08T04:25:36.208 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49018.log 2024-05-08T04:25:36.208 INFO:teuthology.orchestra.run.smithi104.stderr: 89.3%/var/log/ceph/ceph-client.admin.46014.log: -- replaced with /var/log/ceph/ceph-client.admin.47997.log.gz 2024-05-08T04:25:36.208 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54990.log 2024-05-08T04:25:36.208 INFO:teuthology.orchestra.run.smithi104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46014.log.gz 2024-05-08T04:25:36.209 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49409.log 2024-05-08T04:25:36.209 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49018.log: /var/log/ceph/ceph-client.admin.54990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56285.log 2024-05-08T04:25:36.209 INFO:teuthology.orchestra.run.smithi104.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49018.log.gz 2024-05-08T04:25:36.209 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7%/var/log/ceph/ceph-client.admin.49409.log: -- replaced with /var/log/ceph/ceph-client.admin.54990.log.gz 2024-05-08T04:25:36.209 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49144.log 2024-05-08T04:25:36.209 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49409.log.gz/var/log/ceph/ceph-client.admin.56285.log: 2024-05-08T04:25:36.209 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47745.log 2024-05-08T04:25:36.209 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56285.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46616.log 2024-05-08T04:25:36.209 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-08T04:25:36.210 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49144.log: /var/log/ceph/ceph-client.admin.47745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53036.log 2024-05-08T04:25:36.210 INFO:teuthology.orchestra.run.smithi104.stderr: 88.1%/var/log/ceph/ceph-client.admin.46616.log: -- replaced with /var/log/ceph/ceph-client.admin.49144.log.gz 2024-05-08T04:25:36.210 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47745.log.gz 2024-05-08T04:25:36.210 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46616.log.gz 2024-05-08T04:25:36.210 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60318.log 2024-05-08T04:25:36.210 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53330.log 2024-05-08T04:25:36.210 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53036.log.gz/var/log/ceph/ceph-client.admin.60318.log: 2024-05-08T04:25:36.210 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50816.log 2024-05-08T04:25:36.211 INFO:teuthology.orchestra.run.smithi104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60318.log.gz 2024-05-08T04:25:36.211 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60654.log 2024-05-08T04:25:36.211 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53330.log: /var/log/ceph/ceph-client.admin.50816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52908.log 2024-05-08T04:25:36.211 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60654.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53330.log.gz 88.8% 2024-05-08T04:25:36.211 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50816.log.gz 2024-05-08T04:25:36.211 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60654.log.gz 2024-05-08T04:25:36.211 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43129.log 2024-05-08T04:25:36.211 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60276.log 2024-05-08T04:25:36.211 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7%/var/log/ceph/ceph-client.admin.43129.log: -- replaced with /var/log/ceph/ceph-client.admin.52908.log.gz 2024-05-08T04:25:36.212 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52866.log 2024-05-08T04:25:36.212 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43129.log.gz 2024-05-08T04:25:36.212 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57615.log 2024-05-08T04:25:36.212 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47499.log 2024-05-08T04:25:36.212 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52866.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60276.log.gz 2024-05-08T04:25:36.212 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57615.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52866.log.gz 2024-05-08T04:25:36.212 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57615.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-08T04:25:36.212 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-08T04:25:36.213 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-client.admin.47499.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59618.log 2024-05-08T04:25:36.213 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mds.a.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47499.log.gz 2024-05-08T04:25:36.213 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51887.log 2024-05-08T04:25:36.213 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48207.log 2024-05-08T04:25:36.213 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51887.log: /var/log/ceph/ceph-client.admin.59618.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59618.log.gz 2024-05-08T04:25:36.213 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51887.log.gz 2024-05-08T04:25:36.213 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57573.log 2024-05-08T04:25:36.213 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5/var/log/ceph/ceph-client.admin.48207.log: --verbose -- /var/log/ceph/ceph-client.admin.56808.log 2024-05-08T04:25:36.213 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57573.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48207.log.gz 2024-05-08T04:25:36.213 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42801.log 2024-05-08T04:25:36.214 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56808.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57573.log.gz 2024-05-08T04:25:36.214 INFO:teuthology.orchestra.run.smithi104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56808.log.gz 2024-05-08T04:25:36.214 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50300.log 2024-05-08T04:25:36.214 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47231.log 2024-05-08T04:25:36.214 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42801.log: /var/log/ceph/ceph-client.0.50300.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42801.log.gz 2024-05-08T04:25:36.214 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46421.log 2024-05-08T04:25:36.214 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47231.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47231.log.gz 2024-05-08T04:25:36.214 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61262.log 2024-05-08T04:25:36.215 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46421.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46421.log.gz 2024-05-08T04:25:36.215 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48561.log 2024-05-08T04:25:36.215 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61262.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61262.log.gz 2024-05-08T04:25:36.215 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51761.log 2024-05-08T04:25:36.215 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48561.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48561.log.gz 2024-05-08T04:25:36.215 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43971.log 2024-05-08T04:25:36.215 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51761.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51761.log.gz 2024-05-08T04:25:36.215 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35657.log 2024-05-08T04:25:36.215 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43971.log: 92.4% -- replaced with /var/log/ceph/ceph-client.0.50300.log.gz 2024-05-08T04:25:36.216 INFO:teuthology.orchestra.run.smithi104.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.43971.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61217.log 2024-05-08T04:25:36.216 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-08T04:25:36.216 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55520.log 2024-05-08T04:25:36.216 INFO:teuthology.orchestra.run.smithi104.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35657.log.gz 2024-05-08T04:25:36.216 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47541.log 2024-05-08T04:25:36.216 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55520.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61217.log.gz 2024-05-08T04:25:36.216 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55520.log.gz 2024-05-08T04:25:36.216 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41546.log 2024-05-08T04:25:36.217 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41450.log 2024-05-08T04:25:36.217 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47541.log: /var/log/ceph/ceph-client.admin.41546.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47541.log.gz 2024-05-08T04:25:36.217 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41546.log.gz 2024-05-08T04:25:36.217 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46253.log 2024-05-08T04:25:36.217 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49807.log 2024-05-08T04:25:36.217 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41450.log: /var/log/ceph/ceph-client.admin.46253.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41450.log.gz 2024-05-08T04:25:36.217 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46253.log.gz 2024-05-08T04:25:36.217 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43341.log 2024-05-08T04:25:36.217 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29595.log 2024-05-08T04:25:36.218 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43341.log: /var/log/ceph/ceph-client.admin.49807.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49807.log.gz 2024-05-08T04:25:36.218 INFO:teuthology.orchestra.run.smithi104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43341.log.gz 2024-05-08T04:25:36.218 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58011.log 2024-05-08T04:25:36.218 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.tmp-client.admin.29595.log: gzip 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29595.log.gz 2024-05-08T04:25:36.218 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42079.log 2024-05-08T04:25:36.218 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51593.log 2024-05-08T04:25:36.218 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58011.log: /var/log/ceph/ceph-client.admin.42079.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58011.log.gz 2024-05-08T04:25:36.218 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42079.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49597.log 2024-05-08T04:25:36.219 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-08T04:25:36.219 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50499.log 2024-05-08T04:25:36.219 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51593.log.gz 2024-05-08T04:25:36.219 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48976.log 2024-05-08T04:25:36.219 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50499.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49597.log.gz 2024-05-08T04:25:36.219 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50499.log.gz 2024-05-08T04:25:36.219 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42543.log 2024-05-08T04:25:36.219 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53078.log 2024-05-08T04:25:36.219 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48976.log: /var/log/ceph/ceph-client.admin.42543.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48976.log.gz 2024-05-08T04:25:36.220 INFO:teuthology.orchestra.run.smithi104.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42543.log.gz 2024-05-08T04:25:36.220 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54348.log 2024-05-08T04:25:36.220 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57275.log 2024-05-08T04:25:36.220 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53078.log: /var/log/ceph/ceph-client.admin.54348.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53078.log.gz 2024-05-08T04:25:36.220 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54348.log.gz 2024-05-08T04:25:36.220 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58661.log 2024-05-08T04:25:36.220 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60780.log 2024-05-08T04:25:36.220 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57275.log: /var/log/ceph/ceph-client.admin.58661.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57275.log.gz 2024-05-08T04:25:36.220 INFO:teuthology.orchestra.run.smithi104.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52685.log 2024-05-08T04:25:36.220 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58661.log.gz 2024-05-08T04:25:36.221 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49367.log 2024-05-08T04:25:36.221 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60780.log: /var/log/ceph/ceph-client.admin.52685.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52685.log.gz 2024-05-08T04:25:36.221 INFO:teuthology.orchestra.run.smithi104.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60780.log.gz 2024-05-08T04:25:36.221 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45258.log 2024-05-08T04:25:36.221 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42800.log 2024-05-08T04:25:36.221 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49367.log.gz 2024-05-08T04:25:36.221 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50541.log 2024-05-08T04:25:36.221 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42800.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45258.log.gz 2024-05-08T04:25:36.221 INFO:teuthology.orchestra.run.smithi104.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42800.log.gz 2024-05-08T04:25:36.222 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35920.log 2024-05-08T04:25:36.222 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60360.log 2024-05-08T04:25:36.222 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50541.log.gz 2024-05-08T04:25:36.222 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35920.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54064.log 2024-05-08T04:25:36.222 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35920.log.gz 2024-05-08T04:25:36.222 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59045.log 2024-05-08T04:25:36.222 INFO:teuthology.orchestra.run.smithi104.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60360.log.gz 2024-05-08T04:25:36.222 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43929.log 2024-05-08T04:25:36.222 INFO:teuthology.orchestra.run.smithi104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54064.log.gz 2024-05-08T04:25:36.223 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56976.log 2024-05-08T04:25:36.223 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43929.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59045.log.gz 2024-05-08T04:25:36.223 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60906.log 2024-05-08T04:25:36.223 INFO:teuthology.orchestra.run.smithi104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43929.log.gz 2024-05-08T04:25:36.223 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61074.log 2024-05-08T04:25:36.223 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60906.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56976.log.gz 2024-05-08T04:25:36.223 INFO:teuthology.orchestra.run.smithi104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60906.log.gz 2024-05-08T04:25:36.223 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47829.log 2024-05-08T04:25:36.223 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46574.log 2024-05-08T04:25:36.224 INFO:teuthology.orchestra.run.smithi104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61074.log.gz 2024-05-08T04:25:36.224 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48604.log 2024-05-08T04:25:36.224 INFO:teuthology.orchestra.run.smithi104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47829.log.gz 2024-05-08T04:25:36.224 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51939.log 2024-05-08T04:25:36.224 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46574.log.gz 2024-05-08T04:25:36.224 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48604.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48604.log.gz 2024-05-08T04:25:36.224 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51939.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51939.log.gz 2024-05-08T04:25:36.225 INFO:teuthology.orchestra.run.smithi183.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-08T04:25:36.225 INFO:teuthology.orchestra.run.smithi104.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-08T04:25:36.225 INFO:teuthology.orchestra.run.smithi104.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-08T04:25:36.237 INFO:teuthology.orchestra.run.smithi183.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-08T04:25:36.245 INFO:teuthology.orchestra.run.smithi183.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-08T04:25:36.247 INFO:teuthology.orchestra.run.smithi183.stderr: 2024-05-08T04:25:36.247 INFO:teuthology.orchestra.run.smithi183.stderr:real 0m0.299s 2024-05-08T04:25:36.247 INFO:teuthology.orchestra.run.smithi183.stderr:user 0m1.284s 2024-05-08T04:25:36.247 INFO:teuthology.orchestra.run.smithi183.stderr:sys 0m0.070s 2024-05-08T04:25:36.272 INFO:teuthology.orchestra.run.smithi104.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-08T04:25:36.277 INFO:teuthology.orchestra.run.smithi104.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-08T04:25:36.282 INFO:teuthology.orchestra.run.smithi104.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-08T04:25:36.387 INFO:teuthology.orchestra.run.smithi104.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-08T04:25:36.389 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-05-08T04:25:36.390 INFO:teuthology.orchestra.run.smithi104.stderr:real 0m0.464s 2024-05-08T04:25:36.390 INFO:teuthology.orchestra.run.smithi104.stderr:user 0m1.921s 2024-05-08T04:25:36.390 INFO:teuthology.orchestra.run.smithi104.stderr:sys 0m0.305s 2024-05-08T04:25:36.390 INFO:tasks.ceph:Archiving logs... 2024-05-08T04:25:36.390 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278/remote/smithi104/log 2024-05-08T04:25:36.391 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T04:25:36.961 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278/remote/smithi183/log 2024-05-08T04:25:36.962 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T04:25:37.163 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T04:25:37.178 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T04:25:37.179 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T04:25:37.182 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T04:25:37.258 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T04:25:37.267 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T04:25:37.268 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T04:25:37.270 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T04:25:37.282 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-05-08T04:25:37.285 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2024-05-08T04:25:37.287 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T04:25:37.288 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-05-08T04:25:37.288 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 42 +410us[ +410us] +/- 56ms 2024-05-08T04:25:37.288 INFO:teuthology.orchestra.run.smithi104.stdout:^* hv02.front.sepia.ceph.com 3 6 377 42 -280us[ -277us] +/- 51ms 2024-05-08T04:25:37.288 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 -132us[ -129us] +/- 83ms 2024-05-08T04:25:37.288 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T04:25:37.290 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T04:25:37.290 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-05-08T04:25:37.291 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 44 +432us[ +450us] +/- 56ms 2024-05-08T04:25:37.291 INFO:teuthology.orchestra.run.smithi183.stdout:^* hv02.front.sepia.ceph.com 3 6 377 43 -270us[ -253us] +/- 51ms 2024-05-08T04:25:37.291 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 -131us[ -113us] +/- 83ms 2024-05-08T04:25:37.291 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T04:25:37.291 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T04:25:37.300 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T04:25:37.301 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T04:25:37.309 DEBUG:teuthology.orchestra.run.smithi104:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T04:25:37.400 DEBUG:teuthology.orchestra.run.smithi183:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T04:25:37.462 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T04:25:37.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:25:37.491 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T04:25:37.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:25:37.519 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T04:25:37.528 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T04:25:37.537 INFO:teuthology.task.internal:Duration was 675.484562 seconds 2024-05-08T04:25:37.537 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T04:25:37.545 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T04:25:37.546 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T04:25:37.548 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T04:25:37.584 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T04:25:37.597 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T04:25:37.794 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T04:25:37.795 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2024-05-08T04:25:37.795 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T04:25:37.855 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T04:25:37.855 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T04:25:37.881 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T04:25:37.881 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T04:25:37.898 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T04:25:37.947 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T04:25:37.948 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T04:25:37.964 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T04:25:38.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T04:25:38.096 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T04:25:38.096 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T04:25:38.121 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T04:25:38.146 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T04:25:38.156 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T04:25:38.164 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T04:25:38.185 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2024-05-08T04:25:38.210 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2024-05-08T04:25:38.223 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T04:25:38.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:25:38.257 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T04:25:38.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T04:25:38.278 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T04:25:38.288 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T04:25:38.289 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278/remote/smithi104 2024-05-08T04:25:38.289 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T04:25:38.332 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278/remote/smithi183 2024-05-08T04:25:38.333 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T04:25:38.365 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T04:25:38.365 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T04:25:38.369 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T04:25:38.415 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T04:25:38.426 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T04:25:38.426 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T04:25:38.436 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T04:25:38.436 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T04:25:38.439 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T04:25:38.451 INFO:teuthology.orchestra.run.smithi104.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 04:25 /home/ubuntu/cephtest 2024-05-08T04:25:38.469 INFO:teuthology.orchestra.run.smithi183.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 04:25 /home/ubuntu/cephtest 2024-05-08T04:25:38.470 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T04:25:38.481 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T04:25:38.501 INFO:teuthology.nuke:Checking targets against current locks 2024-05-08T04:25:38.527 DEBUG:teuthology.nuke:shortname: smithi104 2024-05-08T04:25:38.528 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T04:25:38.552 DEBUG:teuthology.nuke:shortname: smithi183 2024-05-08T04:25:38.552 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T04:25:38.559 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 04:05:17.840735', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLkQZmD4UKgDLUlTN3eD7ez8gWVGDcIG7qap/3Ikrxc4kaLNkn8UTloZTVp6CTSriWeefdhK3HTtCBt4gUTGLKM='} 2024-05-08T04:25:38.576 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-05-08_04:04:15-fs:volumes-wip-neesingh-testing1-20240507-distro-default-smithi/7697278', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 04:05:17.841886', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPzmz//D1fxQ0e3NWkqEk9Qr95vHu4nCk7FJj6EKa6srYzFX6mzgDzxX+snfwqWhqGmmdtNtIGZm6ZJG7XVNH2M='} 2024-05-08T04:25:38.608 INFO:teuthology.orchestra.console.smithi104:Power off 2024-05-08T04:25:38.608 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-08T04:25:38.624 INFO:teuthology.orchestra.console.smithi183:Power off 2024-05-08T04:25:38.625 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-08T04:25:38.634 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2024-05-08T04:25:38.634 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T04:25:38.646 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2024-05-08T04:25:38.646 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T04:25:38.657 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-05-08T04:25:38.669 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2024-05-08T04:25:42.659 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T04:25:42.670 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T04:25:42.770 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-05-08T04:25:42.779 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2024-05-08T04:25:46.773 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T04:25:46.783 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T04:25:46.885 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-05-08T04:25:46.894 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2024-05-08T04:25:46.986 INFO:teuthology.orchestra.console.smithi104:Power off completed 2024-05-08T04:25:50.897 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T04:25:51.007 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2024-05-08T04:25:51.107 INFO:teuthology.orchestra.console.smithi183:Power off completed 2024-05-08T04:25:51.212 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} duration: 675.484561920166 failure_reason: 'Test failure: test_dangling_symlink (tasks.cephfs.test_volumes.TestMisc)' flavor: default owner: scheduled_neesingh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=62d96d4f8908412ba6f287d52c67760a status: fail success: false 2024-05-08T04:25:51.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T04:25:51.293 INFO:teuthology.run:FAIL